[08/05/2021-07:26:30] [V] [TRT] Tactic: 1179757074518529353 time 0.027584 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: 2105695814191699972 time 0.047936 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: 2148106709480872763 time 0.03072 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: 2410442691266548717 time 0.043776 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: 3041642431972138763 time 0.025664 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: 3754069740140581927 time 0.049632 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: 4555462412611657028 time 0.032416 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: 5666160310350604399 time 0.047104 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: 5925270497649423688 time 0.074432 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: 6680916730816870145 time 0.043136 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: 7158029511300006471 time 0.049408 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: 7859952145590271433 time 0.043008 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: 8283847742354150423 time 0.048352 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: -8992262742606384444 time 0.034464 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: -8391760416076885205 time 0.071712 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: -6273232454637933930 time 0.026176 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: -5818527483287834165 time 0.025728 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: -4534876761957424274 time 0.072288 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: -3237051169894153788 time 0.039616 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: -3136088851200285532 time 0.025024 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: -2586046817576862066 time 0.040992 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: -2422160065350346448 time 0.041024 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: -1216445540764179377 time 0.041408 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] Tactic: -229563042944049199 time 0.026016 [08/05/2021-07:26:30] [V] [TRT] Fastest Tactic: -3136088851200285532 Time: 0.025024 [08/05/2021-07:26:30] [V] [TRT] --------------- Timing Runner: Conv_110 + Relu_112 (CudaConvolution) [08/05/2021-07:26:30] [V] [TRT] Tactic: 0 time 0.184192 [08/05/2021-07:26:30] [V] [TRT] Tactic: 1 time 0.230112 [08/05/2021-07:26:30] [V] [TRT] Tactic: 2 time 0.267872 [08/05/2021-07:26:30] [V] [TRT] Fastest Tactic: 0 Time: 0.184192 [08/05/2021-07:26:30] [V] [TRT] --------------- Timing Runner: Conv_110 + Relu_112 (CudaDepthwiseConvolution) [08/05/2021-07:26:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3136088851200285532 [08/05/2021-07:26:30] [V] [TRT] Conv_110 + Relu_112 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:30] [V] [TRT] [08/05/2021-07:26:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:30] [V] [TRT] Tactic: 0 time 0.007712 [08/05/2021-07:26:30] [V] [TRT] Fastest Tactic: 0 Time: 0.007712 [08/05/2021-07:26:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:30] [V] [TRT] Tactic: 0 time 0.006944 [08/05/2021-07:26:30] [V] [TRT] Fastest Tactic: 0 Time: 0.006944 [08/05/2021-07:26:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:30] [V] [TRT] Tactic: 0 time 0.007712 [08/05/2021-07:26:30] [V] [TRT] Fastest Tactic: 0 Time: 0.007712 [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:31] [V] [TRT] Tactic: 0 time 0.007328 [08/05/2021-07:26:31] [V] [TRT] Fastest Tactic: 0 Time: 0.007328 [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:31] [V] [TRT] Tactic: 0 time 0.007712 [08/05/2021-07:26:31] [V] [TRT] Fastest Tactic: 0 Time: 0.007712 [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:31] [V] [TRT] Tactic: 0 time 0.006144 [08/05/2021-07:26:31] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:31] [V] [TRT] Tactic: 0 time 0.006304 [08/05/2021-07:26:31] [V] [TRT] Fastest Tactic: 0 Time: 0.006304 [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:31] [V] [TRT] Tactic: 0 time 0.00656 [08/05/2021-07:26:31] [V] [TRT] Fastest Tactic: 0 Time: 0.00656 [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:31] [V] [TRT] Tactic: 0 time 0.005088 [08/05/2021-07:26:31] [V] [TRT] Fastest Tactic: 0 Time: 0.005088 [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:31] [V] [TRT] Tactic: 0 time 0.00608 [08/05/2021-07:26:31] [V] [TRT] Fastest Tactic: 0 Time: 0.00608 [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:31] [V] [TRT] Tactic: 0 time 0.005984 [08/05/2021-07:26:31] [V] [TRT] Fastest Tactic: 0 Time: 0.005984 [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:31] [V] [TRT] Tactic: 0 time 0.005056 [08/05/2021-07:26:31] [V] [TRT] Fastest Tactic: 0 Time: 0.005056 [08/05/2021-07:26:31] [V] [TRT] *************** Autotuning format combination: Float(1,9,162,41472) -> Float(1,9,162,41472) *************** [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (LegacySASSConvolution) [08/05/2021-07:26:31] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (FusedConvActConvolution) [08/05/2021-07:26:31] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (CaskConvolution) [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 1825138533642645384 time 0.321472 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 2775507031594384867 time 0.203936 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 2842488832350522458 time 0.221184 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 3915320020053085238 time 0.305312 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 6448355332020552203 time 0.323712 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 6808617066150061604 time 0.185824 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -8060443123034038864 time 0.226048 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -4420849921117327522 time 0.24352 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -3946921629105938337 time 0.35312 [08/05/2021-07:26:31] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.185824 [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (CudaConvolution) [08/05/2021-07:26:31] [V] [TRT] Tactic: 0 time 0.302912 [08/05/2021-07:26:31] [V] [TRT] Tactic: 1 time 0.193728 [08/05/2021-07:26:31] [V] [TRT] Tactic: 2 time 0.317056 [08/05/2021-07:26:31] [V] [TRT] Tactic: 4 time 2.13846 [08/05/2021-07:26:31] [V] [TRT] Tactic: 5 time 2.05658 [08/05/2021-07:26:31] [V] [TRT] Tactic: 6 time 0.228992 [08/05/2021-07:26:31] [V] [TRT] Fastest Tactic: 1 Time: 0.193728 [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (CudaDepthwiseConvolution) [08/05/2021-07:26:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6808617066150061604 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [08/05/2021-07:26:31] [V] [TRT] [08/05/2021-07:26:31] [V] [TRT] *************** Autotuning format combination: Half(1,9,162,41472) -> Half(1,9,162,41472) *************** [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (FusedConvActConvolution) [08/05/2021-07:26:31] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (CaskConvolution) [08/05/2021-07:26:31] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (CudaConvolution) [08/05/2021-07:26:31] [V] [TRT] Tactic: 0 time 0.392608 [08/05/2021-07:26:31] [V] [TRT] Tactic: 1 time 0.202752 [08/05/2021-07:26:31] [V] [TRT] Tactic: 2 time 0.43904 [08/05/2021-07:26:31] [V] [TRT] Tactic: 4 time 2.17293 [08/05/2021-07:26:31] [V] [TRT] Tactic: 5 time 2.02656 [08/05/2021-07:26:31] [V] [TRT] Tactic: 6 time 0.298176 [08/05/2021-07:26:31] [V] [TRT] Fastest Tactic: 1 Time: 0.202752 [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (CudaDepthwiseConvolution) [08/05/2021-07:26:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [08/05/2021-07:26:31] [V] [TRT] [08/05/2021-07:26:31] [V] [TRT] *************** Autotuning format combination: Half(1,9,162:2,20736) -> Half(1,9,162:2,20736) *************** [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (LegacySASSConvolution) [08/05/2021-07:26:31] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (FusedConvActConvolution) [08/05/2021-07:26:31] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (CaskConvolution) [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 1145226902788474763 time 0.125856 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 1651411198763708804 time 0.119456 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 2418518597804310654 time 0.120832 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 4318470497547290900 time 0.099872 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 4653005425971292725 time 0.12288 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 4930470141256631146 time 0.187776 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 8292881859266835088 time 0.186144 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 8401509141903434922 time 0.096032 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -8654297089785671176 time 0.157696 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -7448936905981214224 time 0.186368 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -6004726995029373073 time 0.10896 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -5719726816705110014 time 0.155808 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -3754890472406891741 time 0.167936 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -3689982367035295496 time 0.16464 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -3140347171730126532 time 0.102368 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -2894005464278291378 time 0.184704 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -2027588946874785071 time 0.166688 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -1968398013367819764 time 0.164352 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -245090590808296743 time 0.168 [08/05/2021-07:26:31] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 0.096032 [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (CudaConvolution) [08/05/2021-07:26:31] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (CudaDepthwiseConvolution) [08/05/2021-07:26:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8401509141903434922 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:31] [V] [TRT] [08/05/2021-07:26:31] [V] [TRT] *************** Autotuning format combination: Half(32,288,1:8,5184) -> Float(1,9,162,41472) *************** [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (FusedConvActConvolution) [08/05/2021-07:26:31] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (CaskConvolution) [08/05/2021-07:26:31] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (CudaConvolution) [08/05/2021-07:26:31] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (CudaDepthwiseConvolution) [08/05/2021-07:26:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:31] [V] [TRT] *************** Autotuning format combination: Half(32,288,1:8,5184) -> Half(32,288,1:8,5184) *************** [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (FusedConvActConvolution) [08/05/2021-07:26:31] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (CaskConvolution) [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 2148106709480872763 time 0.057184 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 2410442691266548717 time 0.084832 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 3754069740140581927 time 0.088416 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 3823144360994712832 time 0.050624 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 5635311898703673455 time 0.05136 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 5925270497649423688 time 0.155648 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 6680916730816870145 time 0.086016 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 7158029511300006471 time 0.086016 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 7859952145590271433 time 0.08544 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: 8283847742354150423 time 0.090016 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -8992262742606384444 time 0.06304 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -8682550625095202832 time 0.06144 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -6273232454637933930 time 0.05024 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -5818527483287834165 time 0.047872 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -4954692664176521434 time 0.085536 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -4534876761957424274 time 0.154336 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -3237051169894153788 time 0.080928 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -3136088851200285532 time 0.047104 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -2586046817576862066 time 0.086016 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:31] [V] [TRT] Tactic: -229563042944049199 time 0.050336 [08/05/2021-07:26:31] [V] [TRT] Fastest Tactic: -3136088851200285532 Time: 0.047104 [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (CudaConvolution) [08/05/2021-07:26:31] [V] [TRT] Tactic: 0 time 0.384256 [08/05/2021-07:26:31] [V] [TRT] Tactic: 1 time 0.452608 [08/05/2021-07:26:31] [V] [TRT] Tactic: 2 time 0.492256 [08/05/2021-07:26:31] [V] [TRT] Tactic: 6 time 0.368032 [08/05/2021-07:26:31] [V] [TRT] Fastest Tactic: 6 Time: 0.368032 [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: Conv_113 + Relu_115 (CudaDepthwiseConvolution) [08/05/2021-07:26:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3136088851200285532 [08/05/2021-07:26:31] [V] [TRT] Conv_113 + Relu_115 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:31] [V] [TRT] [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:31] [V] [TRT] Tactic: 0 time 0.00816 [08/05/2021-07:26:31] [V] [TRT] Fastest Tactic: 0 Time: 0.00816 [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:31] [V] [TRT] Tactic: 0 time 0.00672 [08/05/2021-07:26:31] [V] [TRT] Fastest Tactic: 0 Time: 0.00672 [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:31] [V] [TRT] Tactic: 0 time 0.007008 [08/05/2021-07:26:31] [V] [TRT] Fastest Tactic: 0 Time: 0.007008 [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:31] [V] [TRT] Tactic: 0 time 0.006912 [08/05/2021-07:26:31] [V] [TRT] Fastest Tactic: 0 Time: 0.006912 [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:31] [V] [TRT] Tactic: 0 time 0.006144 [08/05/2021-07:26:31] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:31] [V] [TRT] Tactic: 0 time 0.006368 [08/05/2021-07:26:31] [V] [TRT] Fastest Tactic: 0 Time: 0.006368 [08/05/2021-07:26:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.00656 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 0 Time: 0.00656 [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.006592 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006592 [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.005888 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 0 Time: 0.005888 [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.00576 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 0 Time: 0.00576 [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.005952 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 0 Time: 0.005952 [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.005568 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 0 Time: 0.005568 [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.021088 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 0 Time: 0.021088 [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.018848 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 0 Time: 0.018848 [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.016384 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 0 Time: 0.016384 [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.019456 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 0 Time: 0.019456 [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.016416 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 0 Time: 0.016416 [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.015296 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 0 Time: 0.015296 [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.016576 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 0 Time: 0.016576 [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.016384 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 0 Time: 0.016384 [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.01232 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 0 Time: 0.01232 [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.014528 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 0 Time: 0.014528 [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.012288 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.011008 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 0 Time: 0.011008 [08/05/2021-07:26:32] [V] [TRT] *************** Autotuning format combination: Float(1,9,162,41472), Float(1,9,162,165888) -> Float(1,9,162,165888) *************** [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: Conv_116 + Add_118 + Relu_119 (LegacySASSConvolution) [08/05/2021-07:26:32] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: Conv_116 + Add_118 + Relu_119 (CaskConvolution) [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 1754569683116234317 time 0.08192 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 1825138533642645384 time 0.08288 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 2733356012094739613 time 0.09216 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 3915320020053085238 time 0.08192 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 6808617066150061604 time 0.087968 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 9091006216302412844 time 0.082496 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -8060443123034038864 time 0.088896 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -4420849921117327522 time 0.100352 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -3946921629105938337 time 0.097856 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 1754569683116234317 Time: 0.08192 [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: Conv_116 + Add_118 + Relu_119 (CudaConvolution) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.160544 [08/05/2021-07:26:32] [V] [TRT] Tactic: 1 time 0.134912 [08/05/2021-07:26:32] [V] [TRT] Tactic: 2 time 0.28144 [08/05/2021-07:26:32] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2349596672, available: 2097152000 [08/05/2021-07:26:32] [V] [TRT] Tactic: 5 time 0.801184 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 1 Time: 0.134912 [08/05/2021-07:26:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1754569683116234317 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [08/05/2021-07:26:32] [V] [TRT] [08/05/2021-07:26:32] [V] [TRT] *************** Autotuning format combination: Half(1,9,162,41472), Half(1,9,162,165888) -> Half(1,9,162,165888) *************** [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: Conv_116 + Add_118 + Relu_119 (CaskConvolution) [08/05/2021-07:26:32] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: Conv_116 + Add_118 + Relu_119 (CudaConvolution) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.13264 [08/05/2021-07:26:32] [V] [TRT] Tactic: 1 time 0.115264 [08/05/2021-07:26:32] [V] [TRT] Tactic: 2 time 0.238784 [08/05/2021-07:26:32] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2349596672, available: 2097152000 [08/05/2021-07:26:32] [V] [TRT] Tactic: 5 time 0.763328 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 1 Time: 0.115264 [08/05/2021-07:26:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [08/05/2021-07:26:32] [V] [TRT] [08/05/2021-07:26:32] [V] [TRT] *************** Autotuning format combination: Half(1,9,162:2,20736), Half(1,9,162:2,82944) -> Half(1,9,162:2,82944) *************** [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: Conv_116 + Add_118 + Relu_119 (LegacySASSConvolution) [08/05/2021-07:26:32] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: Conv_116 + Add_118 + Relu_119 (CaskConvolution) [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 1651411198763708804 time 0.045408 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 2418518597804310654 time 0.045056 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 4318470497547290900 time 0.044896 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 4930470141256631146 time 0.053312 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 8292881859266835088 time 0.05408 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 8401509141903434922 time 0.045056 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -8654297089785671176 time 0.047552 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -7516584506774355935 time 0.050976 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -7140760933967189247 time 0.045056 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -6004726995029373073 time 0.057152 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -5719726816705110014 time 0.045056 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -4097850214384059472 time 0.04944 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -3717489476759089008 time 0.043616 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -3689982367035295496 time 0.045536 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -2640575123064142123 time 0.04352 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -2534402059426524406 time 0.043072 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -2027588946874785071 time 0.051264 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -1968398013367819764 time 0.04576 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: -2534402059426524406 Time: 0.043072 [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: Conv_116 + Add_118 + Relu_119 (CudaConvolution) [08/05/2021-07:26:32] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2534402059426524406 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:32] [V] [TRT] [08/05/2021-07:26:32] [V] [TRT] *************** Autotuning format combination: Half(32,288,1:8,5184), Float(1,9,162,165888) -> Float(1,9,162,165888) *************** [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: Conv_116 + Add_118 + Relu_119 (CaskConvolution) [08/05/2021-07:26:32] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: Conv_116 + Add_118 + Relu_119 (CudaConvolution) [08/05/2021-07:26:32] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:32] [V] [TRT] *************** Autotuning format combination: Half(32,288,1:8,5184), Half(128,1152,1:8,20736) -> Half(128,1152,1:8,20736) *************** [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: Conv_116 + Add_118 + Relu_119 (CaskConvolution) [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 1179757074518529353 time 0.026624 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 2105695814191699972 time 0.033312 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 2148106709480872763 time 0.02304 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 2410442691266548717 time 0.021184 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 3041642431972138763 time 0.020288 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 3754069740140581927 time 0.033536 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 4555462412611657028 time 0.022912 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 5666160310350604399 time 0.032768 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 5925270497649423688 time 0.028672 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 6680916730816870145 time 0.035168 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 7158029511300006471 time 0.034048 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 7859952145590271433 time 0.034816 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: 8283847742354150423 time 0.034048 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -8992262742606384444 time 0.023584 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -8391760416076885205 time 0.028544 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -6273232454637933930 time 0.026848 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -5818527483287834165 time 0.026688 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -4534876761957424274 time 0.026912 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -3237051169894153788 time 0.031488 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -3136088851200285532 time 0.02032 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -2586046817576862066 time 0.020288 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -2422160065350346448 time 0.034272 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -1216445540764179377 time 0.02016 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] Tactic: -229563042944049199 time 0.02048 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: -1216445540764179377 Time: 0.02016 [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: Conv_116 + Add_118 + Relu_119 (CudaConvolution) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.14336 [08/05/2021-07:26:32] [V] [TRT] Tactic: 1 time 0.216288 [08/05/2021-07:26:32] [V] [TRT] Tactic: 2 time 0.210688 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 0 Time: 0.14336 [08/05/2021-07:26:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1216445540764179377 [08/05/2021-07:26:32] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:32] [V] [TRT] [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.020608 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 0 Time: 0.020608 [08/05/2021-07:26:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:32] [V] [TRT] Tactic: 0 time 0.018432 [08/05/2021-07:26:32] [V] [TRT] Fastest Tactic: 0 Time: 0.018432 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.0176 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0176 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.019872 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.019872 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.017184 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.017184 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.015104 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.015104 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.017152 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.017152 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.016384 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.016384 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.012416 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.012416 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.014432 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.014432 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.012288 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.011232 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.011232 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.021088 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.021088 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.018432 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.018432 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.017024 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.017024 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.019232 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.019232 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.016736 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.016736 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.01568 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.01568 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.01696 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.01696 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.015328 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.015328 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.01232 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.01232 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.014112 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.014112 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.012288 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.011264 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 0 Time: 0.011264 [08/05/2021-07:26:33] [V] [TRT] *************** Autotuning format combination: Float(1,9,162,165888) -> Float(1,9,162,41472) *************** [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (LegacySASSConvolution) [08/05/2021-07:26:33] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (FusedConvActConvolution) [08/05/2021-07:26:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (CaskConvolution) [08/05/2021-07:26:33] [V] [TRT] Conv_120 + Relu_122 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [08/05/2021-07:26:33] [V] [TRT] Tactic: 1754569683116234317 time 0.140224 [08/05/2021-07:26:33] [V] [TRT] Conv_120 + Relu_122 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [08/05/2021-07:26:33] [V] [TRT] Tactic: 1825138533642645384 time 0.141888 [08/05/2021-07:26:33] [V] [TRT] Conv_120 + Relu_122 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [08/05/2021-07:26:33] [V] [TRT] Tactic: 2733356012094739613 time 0.157568 [08/05/2021-07:26:33] [V] [TRT] Conv_120 + Relu_122 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [08/05/2021-07:26:33] [V] [TRT] Tactic: 3915320020053085238 time 0.141152 [08/05/2021-07:26:33] [V] [TRT] Conv_120 + Relu_122 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [08/05/2021-07:26:33] [V] [TRT] Tactic: 6808617066150061604 time 0.097312 [08/05/2021-07:26:33] [V] [TRT] Conv_120 + Relu_122 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [08/05/2021-07:26:33] [V] [TRT] Tactic: 9091006216302412844 time 0.09216 [08/05/2021-07:26:33] [V] [TRT] Conv_120 + Relu_122 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [08/05/2021-07:26:33] [V] [TRT] Tactic: -8060443123034038864 time 0.094208 [08/05/2021-07:26:33] [V] [TRT] Conv_120 + Relu_122 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [08/05/2021-07:26:33] [V] [TRT] Tactic: -4420849921117327522 time 0.125024 [08/05/2021-07:26:33] [V] [TRT] Conv_120 + Relu_122 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [08/05/2021-07:26:33] [V] [TRT] Tactic: -3946921629105938337 time 0.166656 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.09216 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (CudaConvolution) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.124928 [08/05/2021-07:26:33] [V] [TRT] Tactic: 1 time 0.09904 [08/05/2021-07:26:33] [V] [TRT] Tactic: 2 time 0.235168 [08/05/2021-07:26:33] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2550136832, available: 2097152000 [08/05/2021-07:26:33] [V] [TRT] Tactic: 5 time 0.807136 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 1 Time: 0.09904 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (CudaDepthwiseConvolution) [08/05/2021-07:26:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [08/05/2021-07:26:33] [V] [TRT] Conv_120 + Relu_122 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [08/05/2021-07:26:33] [V] [TRT] [08/05/2021-07:26:33] [V] [TRT] *************** Autotuning format combination: Half(1,9,162,165888) -> Half(1,9,162,41472) *************** [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (FusedConvActConvolution) [08/05/2021-07:26:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (CaskConvolution) [08/05/2021-07:26:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (CudaConvolution) [08/05/2021-07:26:33] [V] [TRT] Tactic: 0 time 0.1848 [08/05/2021-07:26:33] [V] [TRT] Tactic: 1 time 0.097856 [08/05/2021-07:26:33] [V] [TRT] Tactic: 2 time 0.303104 [08/05/2021-07:26:33] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2550136832, available: 2097152000 [08/05/2021-07:26:33] [V] [TRT] Tactic: 5 time 0.808736 [08/05/2021-07:26:33] [V] [TRT] Fastest Tactic: 1 Time: 0.097856 [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (CudaDepthwiseConvolution) [08/05/2021-07:26:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [08/05/2021-07:26:33] [V] [TRT] [08/05/2021-07:26:33] [V] [TRT] *************** Autotuning format combination: Half(1,9,162:2,82944) -> Half(1,9,162:2,20736) *************** [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (LegacySASSConvolution) [08/05/2021-07:26:33] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (FusedConvActConvolution) [08/05/2021-07:26:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:33] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (CaskConvolution) [08/05/2021-07:26:33] [V] [TRT] Conv_120 + Relu_122 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:33] [V] [TRT] Tactic: 1651411198763708804 time 0.052256 [08/05/2021-07:26:33] [V] [TRT] Conv_120 + Relu_122 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:33] [V] [TRT] Tactic: 2418518597804310654 time 0.053824 [08/05/2021-07:26:33] [V] [TRT] Conv_120 + Relu_122 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:33] [V] [TRT] Tactic: 4318470497547290900 time 0.049984 [08/05/2021-07:26:33] [V] [TRT] Conv_120 + Relu_122 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:33] [V] [TRT] Tactic: 4930470141256631146 time 0.08192 [08/05/2021-07:26:33] [V] [TRT] Conv_120 + Relu_122 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:33] [V] [TRT] Tactic: 8292881859266835088 time 0.080608 [08/05/2021-07:26:33] [V] [TRT] Conv_120 + Relu_122 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:33] [V] [TRT] Tactic: 8401509141903434922 time 0.051296 [08/05/2021-07:26:33] [V] [TRT] Conv_120 + Relu_122 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:33] [V] [TRT] Tactic: -8654297089785671176 time 0.073856 [08/05/2021-07:26:33] [V] [TRT] Conv_120 + Relu_122 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:33] [V] [TRT] Tactic: -7516584506774355935 time 0.075776 [08/05/2021-07:26:33] [V] [TRT] Conv_120 + Relu_122 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:33] [V] [TRT] Tactic: -7140760933967189247 time 0.049152 [08/05/2021-07:26:33] [V] [TRT] Conv_120 + Relu_122 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -6004726995029373073 time 0.057344 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -5719726816705110014 time 0.0736 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -4097850214384059472 time 0.075808 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -3717489476759089008 time 0.043008 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -3689982367035295496 time 0.073664 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -2640575123064142123 time 0.072288 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -2534402059426524406 time 0.07264 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -2027588946874785071 time 0.077824 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -1968398013367819764 time 0.073504 [08/05/2021-07:26:34] [V] [TRT] Fastest Tactic: -3717489476759089008 Time: 0.043008 [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (CudaConvolution) [08/05/2021-07:26:34] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (CudaDepthwiseConvolution) [08/05/2021-07:26:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3717489476759089008 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:34] [V] [TRT] [08/05/2021-07:26:34] [V] [TRT] *************** Autotuning format combination: Half(128,1152,1:8,20736) -> Float(1,9,162,41472) *************** [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (FusedConvActConvolution) [08/05/2021-07:26:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (CaskConvolution) [08/05/2021-07:26:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (CudaConvolution) [08/05/2021-07:26:34] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (CudaDepthwiseConvolution) [08/05/2021-07:26:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] *************** Autotuning format combination: Half(128,1152,1:8,20736) -> Half(32,288,1:8,5184) *************** [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (FusedConvActConvolution) [08/05/2021-07:26:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (CaskConvolution) [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 1179757074518529353 time 0.027456 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 2105695814191699972 time 0.048992 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 2148106709480872763 time 0.030784 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 2410442691266548717 time 0.044224 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 3041642431972138763 time 0.026208 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 3754069740140581927 time 0.0504 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 4555462412611657028 time 0.0328 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 5666160310350604399 time 0.0472 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 5925270497649423688 time 0.073856 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 6680916730816870145 time 0.04208 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 7158029511300006471 time 0.049152 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 7859952145590271433 time 0.043008 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 8283847742354150423 time 0.047744 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -8992262742606384444 time 0.033568 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -8391760416076885205 time 0.075776 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -6273232454637933930 time 0.02864 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -5818527483287834165 time 0.0256 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -4534876761957424274 time 0.071904 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -3237051169894153788 time 0.038912 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -3136088851200285532 time 0.024128 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -2586046817576862066 time 0.041664 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -2422160065350346448 time 0.04096 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -1216445540764179377 time 0.04096 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -229563042944049199 time 0.025312 [08/05/2021-07:26:34] [V] [TRT] Fastest Tactic: -3136088851200285532 Time: 0.024128 [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (CudaConvolution) [08/05/2021-07:26:34] [V] [TRT] Tactic: 0 time 0.187488 [08/05/2021-07:26:34] [V] [TRT] Tactic: 1 time 0.230304 [08/05/2021-07:26:34] [V] [TRT] Tactic: 2 time 0.265216 [08/05/2021-07:26:34] [V] [TRT] Fastest Tactic: 0 Time: 0.187488 [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_120 + Relu_122 (CudaDepthwiseConvolution) [08/05/2021-07:26:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3136088851200285532 [08/05/2021-07:26:34] [V] [TRT] Conv_120 + Relu_122 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:34] [V] [TRT] Tactic: 0 time 0.008096 [08/05/2021-07:26:34] [V] [TRT] Fastest Tactic: 0 Time: 0.008096 [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:34] [V] [TRT] Tactic: 0 time 0.00688 [08/05/2021-07:26:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00688 [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:34] [V] [TRT] Tactic: 0 time 0.00688 [08/05/2021-07:26:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00688 [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:34] [V] [TRT] Tactic: 0 time 0.006688 [08/05/2021-07:26:34] [V] [TRT] Fastest Tactic: 0 Time: 0.006688 [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:34] [V] [TRT] Tactic: 0 time 0.006144 [08/05/2021-07:26:34] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:34] [V] [TRT] Tactic: 0 time 0.006144 [08/05/2021-07:26:34] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:34] [V] [TRT] Tactic: 0 time 0.006144 [08/05/2021-07:26:34] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:34] [V] [TRT] Tactic: 0 time 0.006144 [08/05/2021-07:26:34] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:34] [V] [TRT] Tactic: 0 time 0.005824 [08/05/2021-07:26:34] [V] [TRT] Fastest Tactic: 0 Time: 0.005824 [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:34] [V] [TRT] Tactic: 0 time 0.006304 [08/05/2021-07:26:34] [V] [TRT] Fastest Tactic: 0 Time: 0.006304 [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:34] [V] [TRT] Tactic: 0 time 0.006144 [08/05/2021-07:26:34] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:34] [V] [TRT] Tactic: 0 time 0.005952 [08/05/2021-07:26:34] [V] [TRT] Fastest Tactic: 0 Time: 0.005952 [08/05/2021-07:26:34] [V] [TRT] *************** Autotuning format combination: Float(1,9,162,41472) -> Float(1,9,162,41472) *************** [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (LegacySASSConvolution) [08/05/2021-07:26:34] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (FusedConvActConvolution) [08/05/2021-07:26:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (CaskConvolution) [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 1825138533642645384 time 0.321632 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 2775507031594384867 time 0.205568 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 2842488832350522458 time 0.222656 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 3915320020053085238 time 0.305152 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 6448355332020552203 time 0.323584 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 6808617066150061604 time 0.188864 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -8060443123034038864 time 0.226912 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -4420849921117327522 time 0.244832 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -3946921629105938337 time 0.352544 [08/05/2021-07:26:34] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.188864 [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (CudaConvolution) [08/05/2021-07:26:34] [V] [TRT] Tactic: 0 time 0.309248 [08/05/2021-07:26:34] [V] [TRT] Tactic: 1 time 0.192608 [08/05/2021-07:26:34] [V] [TRT] Tactic: 2 time 0.319488 [08/05/2021-07:26:34] [V] [TRT] Tactic: 4 time 2.14509 [08/05/2021-07:26:34] [V] [TRT] Tactic: 5 time 2.05629 [08/05/2021-07:26:34] [V] [TRT] Tactic: 6 time 0.228096 [08/05/2021-07:26:34] [V] [TRT] Fastest Tactic: 1 Time: 0.192608 [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (CudaDepthwiseConvolution) [08/05/2021-07:26:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6808617066150061604 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [08/05/2021-07:26:34] [V] [TRT] [08/05/2021-07:26:34] [V] [TRT] *************** Autotuning format combination: Half(1,9,162,41472) -> Half(1,9,162,41472) *************** [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (FusedConvActConvolution) [08/05/2021-07:26:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (CaskConvolution) [08/05/2021-07:26:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (CudaConvolution) [08/05/2021-07:26:34] [V] [TRT] Tactic: 0 time 0.389056 [08/05/2021-07:26:34] [V] [TRT] Tactic: 1 time 0.202752 [08/05/2021-07:26:34] [V] [TRT] Tactic: 2 time 0.44032 [08/05/2021-07:26:34] [V] [TRT] Tactic: 4 time 2.18698 [08/05/2021-07:26:34] [V] [TRT] Tactic: 5 time 2.03459 [08/05/2021-07:26:34] [V] [TRT] Tactic: 6 time 0.299584 [08/05/2021-07:26:34] [V] [TRT] Fastest Tactic: 1 Time: 0.202752 [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (CudaDepthwiseConvolution) [08/05/2021-07:26:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [08/05/2021-07:26:34] [V] [TRT] [08/05/2021-07:26:34] [V] [TRT] *************** Autotuning format combination: Half(1,9,162:2,20736) -> Half(1,9,162:2,20736) *************** [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (LegacySASSConvolution) [08/05/2021-07:26:34] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (FusedConvActConvolution) [08/05/2021-07:26:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (CaskConvolution) [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 1145226902788474763 time 0.125696 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 1651411198763708804 time 0.119296 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 2418518597804310654 time 0.119584 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 4318470497547290900 time 0.099904 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 4653005425971292725 time 0.119328 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 4930470141256631146 time 0.183136 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 8292881859266835088 time 0.181088 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 8401509141903434922 time 0.09504 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -8654297089785671176 time 0.157696 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -7448936905981214224 time 0.1872 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -6004726995029373073 time 0.169632 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -5719726816705110014 time 0.15728 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -3754890472406891741 time 0.167936 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -3689982367035295496 time 0.165376 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -3140347171730126532 time 0.103104 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -2894005464278291378 time 0.186112 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -2027588946874785071 time 0.168736 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -1968398013367819764 time 0.16672 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -245090590808296743 time 0.169984 [08/05/2021-07:26:34] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 0.09504 [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (CudaConvolution) [08/05/2021-07:26:34] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (CudaDepthwiseConvolution) [08/05/2021-07:26:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8401509141903434922 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:34] [V] [TRT] [08/05/2021-07:26:34] [V] [TRT] *************** Autotuning format combination: Half(32,288,1:8,5184) -> Float(1,9,162,41472) *************** [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (FusedConvActConvolution) [08/05/2021-07:26:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (CaskConvolution) [08/05/2021-07:26:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (CudaConvolution) [08/05/2021-07:26:34] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (CudaDepthwiseConvolution) [08/05/2021-07:26:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] *************** Autotuning format combination: Half(32,288,1:8,5184) -> Half(32,288,1:8,5184) *************** [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (FusedConvActConvolution) [08/05/2021-07:26:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (CaskConvolution) [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 2148106709480872763 time 0.057344 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 2410442691266548717 time 0.086016 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 3754069740140581927 time 0.089344 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 3823144360994712832 time 0.0512 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 5635311898703673455 time 0.051744 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 5925270497649423688 time 0.157696 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 6680916730816870145 time 0.08704 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 7158029511300006471 time 0.088128 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 7859952145590271433 time 0.086016 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: 8283847742354150423 time 0.09088 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -8992262742606384444 time 0.062464 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -8682550625095202832 time 0.062272 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -6273232454637933930 time 0.050848 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -5818527483287834165 time 0.049568 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -4954692664176521434 time 0.08688 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -4534876761957424274 time 0.156256 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -3237051169894153788 time 0.082336 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -3136088851200285532 time 0.0472 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -2586046817576862066 time 0.086048 [08/05/2021-07:26:34] [V] [TRT] Conv_123 + Relu_125 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:34] [V] [TRT] Tactic: -229563042944049199 time 0.051328 [08/05/2021-07:26:34] [V] [TRT] Fastest Tactic: -3136088851200285532 Time: 0.0472 [08/05/2021-07:26:34] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (CudaConvolution) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.388544 [08/05/2021-07:26:35] [V] [TRT] Tactic: 1 time 0.456704 [08/05/2021-07:26:35] [V] [TRT] Tactic: 2 time 0.4976 [08/05/2021-07:26:35] [V] [TRT] Tactic: 6 time 0.369504 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 6 Time: 0.369504 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: Conv_123 + Relu_125 (CudaDepthwiseConvolution) [08/05/2021-07:26:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3136088851200285532 [08/05/2021-07:26:35] [V] [TRT] Conv_123 + Relu_125 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:35] [V] [TRT] [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.008096 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.008096 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.006976 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.006976 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.007328 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.007328 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.006912 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.006912 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.006144 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.006656 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.006656 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.00672 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00672 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.006144 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.00576 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00576 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.006304 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.006304 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.006144 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.004864 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.021024 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.021024 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.018432 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.018432 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.016992 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.016992 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.019328 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.019328 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.017088 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.017088 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.015264 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.015264 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.018208 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.018208 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.016384 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.016384 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.012288 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.014368 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.014368 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.01232 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.01232 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.011808 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 0 Time: 0.011808 [08/05/2021-07:26:35] [V] [TRT] *************** Autotuning format combination: Float(1,9,162,41472), Float(1,9,162,165888) -> Float(1,9,162,165888) *************** [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: Conv_126 + Add_128 + Relu_129 (LegacySASSConvolution) [08/05/2021-07:26:35] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: Conv_126 + Add_128 + Relu_129 (CaskConvolution) [08/05/2021-07:26:35] [V] [TRT] Conv_126 + Add_128 + Relu_129 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [08/05/2021-07:26:35] [V] [TRT] Tactic: 1754569683116234317 time 0.082848 [08/05/2021-07:26:35] [V] [TRT] Conv_126 + Add_128 + Relu_129 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [08/05/2021-07:26:35] [V] [TRT] Tactic: 1825138533642645384 time 0.082784 [08/05/2021-07:26:35] [V] [TRT] Conv_126 + Add_128 + Relu_129 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [08/05/2021-07:26:35] [V] [TRT] Tactic: 2733356012094739613 time 0.093312 [08/05/2021-07:26:35] [V] [TRT] Conv_126 + Add_128 + Relu_129 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [08/05/2021-07:26:35] [V] [TRT] Tactic: 3915320020053085238 time 0.082784 [08/05/2021-07:26:35] [V] [TRT] Conv_126 + Add_128 + Relu_129 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [08/05/2021-07:26:35] [V] [TRT] Tactic: 6808617066150061604 time 0.088064 [08/05/2021-07:26:35] [V] [TRT] Conv_126 + Add_128 + Relu_129 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [08/05/2021-07:26:35] [V] [TRT] Tactic: 9091006216302412844 time 0.082688 [08/05/2021-07:26:35] [V] [TRT] Conv_126 + Add_128 + Relu_129 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [08/05/2021-07:26:35] [V] [TRT] Tactic: -8060443123034038864 time 0.089888 [08/05/2021-07:26:35] [V] [TRT] Conv_126 + Add_128 + Relu_129 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [08/05/2021-07:26:35] [V] [TRT] Tactic: -4420849921117327522 time 0.101248 [08/05/2021-07:26:35] [V] [TRT] Conv_126 + Add_128 + Relu_129 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [08/05/2021-07:26:35] [V] [TRT] Tactic: -3946921629105938337 time 0.097888 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.082688 [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: Conv_126 + Add_128 + Relu_129 (CudaConvolution) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.162112 [08/05/2021-07:26:35] [V] [TRT] Tactic: 1 time 0.135872 [08/05/2021-07:26:35] [V] [TRT] Tactic: 2 time 0.28256 [08/05/2021-07:26:35] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2349596672, available: 2097152000 [08/05/2021-07:26:35] [V] [TRT] Tactic: 5 time 0.80672 [08/05/2021-07:26:35] [V] [TRT] Fastest Tactic: 1 Time: 0.135872 [08/05/2021-07:26:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [08/05/2021-07:26:35] [V] [TRT] Conv_126 + Add_128 + Relu_129 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [08/05/2021-07:26:35] [V] [TRT] [08/05/2021-07:26:35] [V] [TRT] *************** Autotuning format combination: Half(1,9,162,41472), Half(1,9,162,165888) -> Half(1,9,162,165888) *************** [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: Conv_126 + Add_128 + Relu_129 (CaskConvolution) [08/05/2021-07:26:35] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:35] [V] [TRT] --------------- Timing Runner: Conv_126 + Add_128 + Relu_129 (CudaConvolution) [08/05/2021-07:26:35] [V] [TRT] Tactic: 0 time 0.135168 [08/05/2021-07:26:35] [V] [TRT] Tactic: 1 time 0.116672 [08/05/2021-07:26:35] [V] [TRT] Tactic: 2 time 0.240704 [08/05/2021-07:26:35] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2349596672, available: 2097152000 [08/05/2021-07:26:36] [V] [TRT] Tactic: 5 time 0.768416 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 1 Time: 0.116672 [08/05/2021-07:26:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [08/05/2021-07:26:36] [V] [TRT] [08/05/2021-07:26:36] [V] [TRT] *************** Autotuning format combination: Half(1,9,162:2,20736), Half(1,9,162:2,82944) -> Half(1,9,162:2,82944) *************** [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: Conv_126 + Add_128 + Relu_129 (LegacySASSConvolution) [08/05/2021-07:26:36] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: Conv_126 + Add_128 + Relu_129 (CaskConvolution) [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: 1651411198763708804 time 0.045152 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: 2418518597804310654 time 0.045856 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: 4318470497547290900 time 0.045056 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: 4930470141256631146 time 0.054016 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: 8292881859266835088 time 0.054368 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: 8401509141903434922 time 0.045056 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -8654297089785671176 time 0.045152 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -7516584506774355935 time 0.049696 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -7140760933967189247 time 0.044768 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -6004726995029373073 time 0.053216 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -5719726816705110014 time 0.047936 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -4097850214384059472 time 0.049664 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -3717489476759089008 time 0.045056 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -3689982367035295496 time 0.0464 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -2640575123064142123 time 0.04384 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -2534402059426524406 time 0.043744 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -2027588946874785071 time 0.05152 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -1968398013367819764 time 0.045888 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: -2534402059426524406 Time: 0.043744 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: Conv_126 + Add_128 + Relu_129 (CudaConvolution) [08/05/2021-07:26:36] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2534402059426524406 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:36] [V] [TRT] [08/05/2021-07:26:36] [V] [TRT] *************** Autotuning format combination: Half(32,288,1:8,5184), Float(1,9,162,165888) -> Float(1,9,162,165888) *************** [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: Conv_126 + Add_128 + Relu_129 (CaskConvolution) [08/05/2021-07:26:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: Conv_126 + Add_128 + Relu_129 (CudaConvolution) [08/05/2021-07:26:36] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:36] [V] [TRT] *************** Autotuning format combination: Half(32,288,1:8,5184), Half(128,1152,1:8,20736) -> Half(128,1152,1:8,20736) *************** [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: Conv_126 + Add_128 + Relu_129 (CaskConvolution) [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: 1179757074518529353 time 0.027264 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: 2105695814191699972 time 0.03376 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: 2148106709480872763 time 0.02352 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: 2410442691266548717 time 0.021312 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: 3041642431972138763 time 0.02048 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: 3754069740140581927 time 0.032768 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: 4555462412611657028 time 0.023264 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: 5666160310350604399 time 0.034272 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: 5925270497649423688 time 0.028672 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: 6680916730816870145 time 0.035264 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: 7158029511300006471 time 0.034304 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: 7859952145590271433 time 0.03488 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: 8283847742354150423 time 0.033568 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -8992262742606384444 time 0.022656 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -8391760416076885205 time 0.028672 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -6273232454637933930 time 0.026848 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -5818527483287834165 time 0.026624 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -4534876761957424274 time 0.02672 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -3237051169894153788 time 0.031552 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -3136088851200285532 time 0.02048 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -2586046817576862066 time 0.02048 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -2422160065350346448 time 0.035008 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -1216445540764179377 time 0.020352 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] Tactic: -229563042944049199 time 0.020864 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: -1216445540764179377 Time: 0.020352 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: Conv_126 + Add_128 + Relu_129 (CudaConvolution) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.145408 [08/05/2021-07:26:36] [V] [TRT] Tactic: 1 time 0.218912 [08/05/2021-07:26:36] [V] [TRT] Tactic: 2 time 0.210976 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.145408 [08/05/2021-07:26:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1216445540764179377 [08/05/2021-07:26:36] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:36] [V] [TRT] [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.02128 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.02128 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.018528 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.018528 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.016928 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.016928 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.019168 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.019168 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.017088 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.017088 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.016064 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.016064 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.017056 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.017056 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.015968 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.015968 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.012416 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.012416 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.014336 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.012288 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.012288 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.0216 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.0216 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.018432 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.018432 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.017344 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.017344 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.01904 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.01904 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.016704 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.016704 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.015296 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.015296 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.01728 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.01728 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.016576 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.016576 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.012288 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:36] [V] [TRT] Tactic: 0 time 0.014176 [08/05/2021-07:26:36] [V] [TRT] Fastest Tactic: 0 Time: 0.014176 [08/05/2021-07:26:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:37] [V] [TRT] Tactic: 0 time 0.012288 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:37] [V] [TRT] Tactic: 0 time 0.011072 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: 0 Time: 0.011072 [08/05/2021-07:26:37] [V] [TRT] *************** Autotuning format combination: Float(1,9,162,165888) -> Float(1,9,162,41472) *************** [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (LegacySASSConvolution) [08/05/2021-07:26:37] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (FusedConvActConvolution) [08/05/2021-07:26:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (CaskConvolution) [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 1754569683116234317 time 0.142304 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 1825138533642645384 time 0.14336 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 2733356012094739613 time 0.159744 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 3915320020053085238 time 0.142656 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 6808617066150061604 time 0.097376 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 9091006216302412844 time 0.0928 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -8060443123034038864 time 0.1024 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -4420849921117327522 time 0.13728 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -3946921629105938337 time 0.167584 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.0928 [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (CudaConvolution) [08/05/2021-07:26:37] [V] [TRT] Tactic: 0 time 0.129792 [08/05/2021-07:26:37] [V] [TRT] Tactic: 1 time 0.104448 [08/05/2021-07:26:37] [V] [TRT] Tactic: 2 time 0.251776 [08/05/2021-07:26:37] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2550136832, available: 2097152000 [08/05/2021-07:26:37] [V] [TRT] Tactic: 5 time 0.812736 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: 1 Time: 0.104448 [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (CudaDepthwiseConvolution) [08/05/2021-07:26:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [08/05/2021-07:26:37] [V] [TRT] [08/05/2021-07:26:37] [V] [TRT] *************** Autotuning format combination: Half(1,9,162,165888) -> Half(1,9,162,41472) *************** [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (FusedConvActConvolution) [08/05/2021-07:26:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (CaskConvolution) [08/05/2021-07:26:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (CudaConvolution) [08/05/2021-07:26:37] [V] [TRT] Tactic: 0 time 0.186368 [08/05/2021-07:26:37] [V] [TRT] Tactic: 1 time 0.098304 [08/05/2021-07:26:37] [V] [TRT] Tactic: 2 time 0.306816 [08/05/2021-07:26:37] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2550136832, available: 2097152000 [08/05/2021-07:26:37] [V] [TRT] Tactic: 5 time 0.81456 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: 1 Time: 0.098304 [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (CudaDepthwiseConvolution) [08/05/2021-07:26:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [08/05/2021-07:26:37] [V] [TRT] [08/05/2021-07:26:37] [V] [TRT] *************** Autotuning format combination: Half(1,9,162:2,82944) -> Half(1,9,162:2,20736) *************** [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (LegacySASSConvolution) [08/05/2021-07:26:37] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (FusedConvActConvolution) [08/05/2021-07:26:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (CaskConvolution) [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 1651411198763708804 time 0.053248 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 2418518597804310654 time 0.05408 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 4318470497547290900 time 0.049984 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 4930470141256631146 time 0.082368 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 8292881859266835088 time 0.08304 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 8401509141903434922 time 0.0512 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -8654297089785671176 time 0.075008 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -7516584506774355935 time 0.076768 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -7140760933967189247 time 0.049984 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -6004726995029373073 time 0.057408 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -5719726816705110014 time 0.073728 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -4097850214384059472 time 0.07664 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -3717489476759089008 time 0.044 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -3689982367035295496 time 0.07424 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -2640575123064142123 time 0.073728 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -2534402059426524406 time 0.073472 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -2027588946874785071 time 0.0776 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -1968398013367819764 time 0.073728 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: -3717489476759089008 Time: 0.044 [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (CudaConvolution) [08/05/2021-07:26:37] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (CudaDepthwiseConvolution) [08/05/2021-07:26:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3717489476759089008 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:37] [V] [TRT] [08/05/2021-07:26:37] [V] [TRT] *************** Autotuning format combination: Half(128,1152,1:8,20736) -> Float(1,9,162,41472) *************** [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (FusedConvActConvolution) [08/05/2021-07:26:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (CaskConvolution) [08/05/2021-07:26:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (CudaConvolution) [08/05/2021-07:26:37] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (CudaDepthwiseConvolution) [08/05/2021-07:26:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] *************** Autotuning format combination: Half(128,1152,1:8,20736) -> Half(32,288,1:8,5184) *************** [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (FusedConvActConvolution) [08/05/2021-07:26:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (CaskConvolution) [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 1179757074518529353 time 0.027424 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 2105695814191699972 time 0.049152 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 2148106709480872763 time 0.03072 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 2410442691266548717 time 0.04384 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 3041642431972138763 time 0.026176 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 3754069740140581927 time 0.04992 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 4555462412611657028 time 0.0328 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 5666160310350604399 time 0.04816 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 5925270497649423688 time 0.0752 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 6680916730816870145 time 0.042656 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 7158029511300006471 time 0.049984 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 7859952145590271433 time 0.043072 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 8283847742354150423 time 0.049152 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -8992262742606384444 time 0.034816 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -8391760416076885205 time 0.076608 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -6273232454637933930 time 0.029408 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -5818527483287834165 time 0.024864 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -4534876761957424274 time 0.073376 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -3237051169894153788 time 0.04032 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -3136088851200285532 time 0.024576 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -2586046817576862066 time 0.041216 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -2422160065350346448 time 0.041792 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -1216445540764179377 time 0.041344 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -229563042944049199 time 0.025408 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: -3136088851200285532 Time: 0.024576 [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (CudaConvolution) [08/05/2021-07:26:37] [V] [TRT] Tactic: 0 time 0.184928 [08/05/2021-07:26:37] [V] [TRT] Tactic: 1 time 0.232256 [08/05/2021-07:26:37] [V] [TRT] Tactic: 2 time 0.270336 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: 0 Time: 0.184928 [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_130 + Relu_132 (CudaDepthwiseConvolution) [08/05/2021-07:26:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3136088851200285532 [08/05/2021-07:26:37] [V] [TRT] Conv_130 + Relu_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:37] [V] [TRT] [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:37] [V] [TRT] Tactic: 0 time 0.00816 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: 0 Time: 0.00816 [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:37] [V] [TRT] Tactic: 0 time 0.006976 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: 0 Time: 0.006976 [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:37] [V] [TRT] Tactic: 0 time 0.007712 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: 0 Time: 0.007712 [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:37] [V] [TRT] Tactic: 0 time 0.007712 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: 0 Time: 0.007712 [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:37] [V] [TRT] Tactic: 0 time 0.00624 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: 0 Time: 0.00624 [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:37] [V] [TRT] Tactic: 0 time 0.006144 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:37] [V] [TRT] Tactic: 0 time 0.006688 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: 0 Time: 0.006688 [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:37] [V] [TRT] Tactic: 0 time 0.006208 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: 0 Time: 0.006208 [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:37] [V] [TRT] Tactic: 0 time 0.004832 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004832 [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:37] [V] [TRT] Tactic: 0 time 0.006208 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: 0 Time: 0.006208 [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:37] [V] [TRT] Tactic: 0 time 0.005088 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: 0 Time: 0.005088 [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:37] [V] [TRT] Tactic: 0 time 0.005824 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: 0 Time: 0.005824 [08/05/2021-07:26:37] [V] [TRT] *************** Autotuning format combination: Float(1,9,162,41472) -> Float(1,9,162,41472) *************** [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (LegacySASSConvolution) [08/05/2021-07:26:37] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (FusedConvActConvolution) [08/05/2021-07:26:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (CaskConvolution) [08/05/2021-07:26:37] [V] [TRT] Conv_133 + Relu_135 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 1825138533642645384 time 0.324512 [08/05/2021-07:26:37] [V] [TRT] Conv_133 + Relu_135 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 2775507031594384867 time 0.205568 [08/05/2021-07:26:37] [V] [TRT] Conv_133 + Relu_135 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 2842488832350522458 time 0.223936 [08/05/2021-07:26:37] [V] [TRT] Conv_133 + Relu_135 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 3915320020053085238 time 0.309312 [08/05/2021-07:26:37] [V] [TRT] Conv_133 + Relu_135 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 6448355332020552203 time 0.327232 [08/05/2021-07:26:37] [V] [TRT] Conv_133 + Relu_135 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 6808617066150061604 time 0.19872 [08/05/2021-07:26:37] [V] [TRT] Conv_133 + Relu_135 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -8060443123034038864 time 0.229376 [08/05/2021-07:26:37] [V] [TRT] Conv_133 + Relu_135 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -4420849921117327522 time 0.247424 [08/05/2021-07:26:37] [V] [TRT] Conv_133 + Relu_135 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: -3946921629105938337 time 0.356352 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.19872 [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (CudaConvolution) [08/05/2021-07:26:37] [V] [TRT] Tactic: 0 time 0.30768 [08/05/2021-07:26:37] [V] [TRT] Tactic: 1 time 0.196224 [08/05/2021-07:26:37] [V] [TRT] Tactic: 2 time 0.323488 [08/05/2021-07:26:37] [V] [TRT] Tactic: 4 time 2.16304 [08/05/2021-07:26:37] [V] [TRT] Tactic: 5 time 2.06573 [08/05/2021-07:26:37] [V] [TRT] Tactic: 6 time 0.229248 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: 1 Time: 0.196224 [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (CudaDepthwiseConvolution) [08/05/2021-07:26:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [08/05/2021-07:26:37] [V] [TRT] [08/05/2021-07:26:37] [V] [TRT] *************** Autotuning format combination: Half(1,9,162,41472) -> Half(1,9,162,41472) *************** [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (FusedConvActConvolution) [08/05/2021-07:26:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (CaskConvolution) [08/05/2021-07:26:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (CudaConvolution) [08/05/2021-07:26:37] [V] [TRT] Tactic: 0 time 0.392736 [08/05/2021-07:26:37] [V] [TRT] Tactic: 1 time 0.20352 [08/05/2021-07:26:37] [V] [TRT] Tactic: 2 time 0.443072 [08/05/2021-07:26:37] [V] [TRT] Tactic: 4 time 2.23363 [08/05/2021-07:26:37] [V] [TRT] Tactic: 5 time 2.15734 [08/05/2021-07:26:37] [V] [TRT] Tactic: 6 time 0.29984 [08/05/2021-07:26:37] [V] [TRT] Fastest Tactic: 1 Time: 0.20352 [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (CudaDepthwiseConvolution) [08/05/2021-07:26:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [08/05/2021-07:26:37] [V] [TRT] [08/05/2021-07:26:37] [V] [TRT] *************** Autotuning format combination: Half(1,9,162:2,20736) -> Half(1,9,162:2,20736) *************** [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (LegacySASSConvolution) [08/05/2021-07:26:37] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (FusedConvActConvolution) [08/05/2021-07:26:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:37] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (CaskConvolution) [08/05/2021-07:26:37] [V] [TRT] Conv_133 + Relu_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 1145226902788474763 time 0.12768 [08/05/2021-07:26:37] [V] [TRT] Conv_133 + Relu_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 1651411198763708804 time 0.120448 [08/05/2021-07:26:37] [V] [TRT] Conv_133 + Relu_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 2418518597804310654 time 0.122496 [08/05/2021-07:26:37] [V] [TRT] Conv_133 + Relu_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 4318470497547290900 time 0.100448 [08/05/2021-07:26:37] [V] [TRT] Conv_133 + Relu_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 4653005425971292725 time 0.123008 [08/05/2021-07:26:37] [V] [TRT] Conv_133 + Relu_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 4930470141256631146 time 0.18096 [08/05/2021-07:26:37] [V] [TRT] Conv_133 + Relu_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:37] [V] [TRT] Tactic: 8292881859266835088 time 0.180224 [08/05/2021-07:26:37] [V] [TRT] Conv_133 + Relu_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: 8401509141903434922 time 0.096256 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: -8654297089785671176 time 0.158432 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: -7448936905981214224 time 0.192512 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: -6004726995029373073 time 0.169984 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: -5719726816705110014 time 0.157696 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: -3754890472406891741 time 0.168672 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: -3689982367035295496 time 0.16624 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: -3140347171730126532 time 0.103168 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: -2894005464278291378 time 0.184352 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: -2027588946874785071 time 0.168352 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: -1968398013367819764 time 0.166304 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: -245090590808296743 time 0.169472 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 0.096256 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (CudaConvolution) [08/05/2021-07:26:38] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (CudaDepthwiseConvolution) [08/05/2021-07:26:38] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8401509141903434922 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:38] [V] [TRT] [08/05/2021-07:26:38] [V] [TRT] *************** Autotuning format combination: Half(32,288,1:8,5184) -> Float(1,9,162,41472) *************** [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (FusedConvActConvolution) [08/05/2021-07:26:38] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (CaskConvolution) [08/05/2021-07:26:38] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (CudaConvolution) [08/05/2021-07:26:38] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (CudaDepthwiseConvolution) [08/05/2021-07:26:38] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:38] [V] [TRT] *************** Autotuning format combination: Half(32,288,1:8,5184) -> Half(32,288,1:8,5184) *************** [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (FusedConvActConvolution) [08/05/2021-07:26:38] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (CaskConvolution) [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: 2148106709480872763 time 0.057952 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: 2410442691266548717 time 0.085632 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: 3754069740140581927 time 0.089216 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: 3823144360994712832 time 0.051104 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: 5635311898703673455 time 0.051968 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: 5925270497649423688 time 0.15696 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: 6680916730816870145 time 0.0864 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: 7158029511300006471 time 0.086848 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: 7859952145590271433 time 0.086176 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: 8283847742354150423 time 0.09024 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: -8992262742606384444 time 0.0632 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: -8682550625095202832 time 0.062176 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: -6273232454637933930 time 0.051136 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: -5818527483287834165 time 0.049152 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: -4954692664176521434 time 0.087968 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: -4534876761957424274 time 0.155648 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: -3237051169894153788 time 0.082016 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: -3136088851200285532 time 0.0472 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: -2586046817576862066 time 0.08624 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:38] [V] [TRT] Tactic: -229563042944049199 time 0.050976 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: -3136088851200285532 Time: 0.0472 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (CudaConvolution) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.38736 [08/05/2021-07:26:38] [V] [TRT] Tactic: 1 time 0.456704 [08/05/2021-07:26:38] [V] [TRT] Tactic: 2 time 0.495616 [08/05/2021-07:26:38] [V] [TRT] Tactic: 6 time 0.365344 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 6 Time: 0.365344 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: Conv_133 + Relu_135 (CudaDepthwiseConvolution) [08/05/2021-07:26:38] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3136088851200285532 [08/05/2021-07:26:38] [V] [TRT] Conv_133 + Relu_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:38] [V] [TRT] [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.008192 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.006528 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.006528 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.00688 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.00688 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.00688 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.00688 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.0064 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.006144 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.00624 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.00624 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.007424 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.007424 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.004864 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.006176 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.006176 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.006016 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.006016 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.005184 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.005184 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.021728 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.021728 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.018464 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.018464 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.01696 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.01696 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.019008 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.019008 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.016832 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.016832 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.015296 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.015296 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.017312 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.017312 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.016384 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.016384 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.012288 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:38] [V] [TRT] Tactic: 0 time 0.014336 [08/05/2021-07:26:38] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [08/05/2021-07:26:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.012416 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 0 Time: 0.012416 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.011872 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 0 Time: 0.011872 [08/05/2021-07:26:39] [V] [TRT] *************** Autotuning format combination: Float(1,9,162,41472), Float(1,9,162,165888) -> Float(1,9,162,165888) *************** [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: Conv_136 + Add_138 + Relu_139 (LegacySASSConvolution) [08/05/2021-07:26:39] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: Conv_136 + Add_138 + Relu_139 (CaskConvolution) [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 1754569683116234317 time 0.08304 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 1825138533642645384 time 0.082976 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 2733356012094739613 time 0.09296 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 3915320020053085238 time 0.082656 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 6808617066150061604 time 0.088416 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 9091006216302412844 time 0.082048 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -8060443123034038864 time 0.089024 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -4420849921117327522 time 0.100352 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -3946921629105938337 time 0.096704 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.082048 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: Conv_136 + Add_138 + Relu_139 (CudaConvolution) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.179616 [08/05/2021-07:26:39] [V] [TRT] Tactic: 1 time 0.153408 [08/05/2021-07:26:39] [V] [TRT] Tactic: 2 time 0.311648 [08/05/2021-07:26:39] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2349596672, available: 2097152000 [08/05/2021-07:26:39] [V] [TRT] Tactic: 5 time 0.80208 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 1 Time: 0.153408 [08/05/2021-07:26:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [08/05/2021-07:26:39] [V] [TRT] [08/05/2021-07:26:39] [V] [TRT] *************** Autotuning format combination: Half(1,9,162,41472), Half(1,9,162,165888) -> Half(1,9,162,165888) *************** [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: Conv_136 + Add_138 + Relu_139 (CaskConvolution) [08/05/2021-07:26:39] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: Conv_136 + Add_138 + Relu_139 (CudaConvolution) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.133696 [08/05/2021-07:26:39] [V] [TRT] Tactic: 1 time 0.115392 [08/05/2021-07:26:39] [V] [TRT] Tactic: 2 time 0.239328 [08/05/2021-07:26:39] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2349596672, available: 2097152000 [08/05/2021-07:26:39] [V] [TRT] Tactic: 5 time 0.772096 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 1 Time: 0.115392 [08/05/2021-07:26:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [08/05/2021-07:26:39] [V] [TRT] [08/05/2021-07:26:39] [V] [TRT] *************** Autotuning format combination: Half(1,9,162:2,20736), Half(1,9,162:2,82944) -> Half(1,9,162:2,82944) *************** [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: Conv_136 + Add_138 + Relu_139 (LegacySASSConvolution) [08/05/2021-07:26:39] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: Conv_136 + Add_138 + Relu_139 (CaskConvolution) [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 1651411198763708804 time 0.045728 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 2418518597804310654 time 0.045888 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 4318470497547290900 time 0.045056 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 4930470141256631146 time 0.054176 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 8292881859266835088 time 0.054944 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 8401509141903434922 time 0.045056 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -8654297089785671176 time 0.047232 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -7516584506774355935 time 0.050496 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -7140760933967189247 time 0.04592 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -6004726995029373073 time 0.054752 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -5719726816705110014 time 0.045344 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -4097850214384059472 time 0.05072 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -3717489476759089008 time 0.044672 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -3689982367035295496 time 0.045888 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -2640575123064142123 time 0.043008 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -2534402059426524406 time 0.043712 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -2027588946874785071 time 0.053248 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -1968398013367819764 time 0.045056 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: -2640575123064142123 Time: 0.043008 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: Conv_136 + Add_138 + Relu_139 (CudaConvolution) [08/05/2021-07:26:39] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2640575123064142123 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:39] [V] [TRT] [08/05/2021-07:26:39] [V] [TRT] *************** Autotuning format combination: Half(32,288,1:8,5184), Float(1,9,162,165888) -> Float(1,9,162,165888) *************** [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: Conv_136 + Add_138 + Relu_139 (CaskConvolution) [08/05/2021-07:26:39] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: Conv_136 + Add_138 + Relu_139 (CudaConvolution) [08/05/2021-07:26:39] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:39] [V] [TRT] *************** Autotuning format combination: Half(32,288,1:8,5184), Half(128,1152,1:8,20736) -> Half(128,1152,1:8,20736) *************** [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: Conv_136 + Add_138 + Relu_139 (CaskConvolution) [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 1179757074518529353 time 0.027648 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 2105695814191699972 time 0.0336 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 2148106709480872763 time 0.023328 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 2410442691266548717 time 0.021504 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 3041642431972138763 time 0.020416 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 3754069740140581927 time 0.032896 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 4555462412611657028 time 0.02288 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 5666160310350604399 time 0.033728 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 5925270497649423688 time 0.028672 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 6680916730816870145 time 0.035392 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 7158029511300006471 time 0.034528 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 7859952145590271433 time 0.034848 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: 8283847742354150423 time 0.034368 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -8992262742606384444 time 0.023808 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -8391760416076885205 time 0.028704 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -6273232454637933930 time 0.026624 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -5818527483287834165 time 0.026496 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -4534876761957424274 time 0.027712 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -3237051169894153788 time 0.03152 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -3136088851200285532 time 0.02048 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -2586046817576862066 time 0.020032 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -2422160065350346448 time 0.033632 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -1216445540764179377 time 0.020256 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] Tactic: -229563042944049199 time 0.02048 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: -2586046817576862066 Time: 0.020032 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: Conv_136 + Add_138 + Relu_139 (CudaConvolution) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.145888 [08/05/2021-07:26:39] [V] [TRT] Tactic: 1 time 0.218496 [08/05/2021-07:26:39] [V] [TRT] Tactic: 2 time 0.20912 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 0 Time: 0.145888 [08/05/2021-07:26:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2586046817576862066 [08/05/2021-07:26:39] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:39] [V] [TRT] [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.021312 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 0 Time: 0.021312 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.018432 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 0 Time: 0.018432 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.017376 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 0 Time: 0.017376 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.019008 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 0 Time: 0.019008 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.016384 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 0 Time: 0.016384 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.015104 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 0 Time: 0.015104 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.017568 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 0 Time: 0.017568 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.016352 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 0 Time: 0.016352 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.012576 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 0 Time: 0.012576 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.014816 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 0 Time: 0.014816 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.012288 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.011872 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 0 Time: 0.011872 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.02144 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 0 Time: 0.02144 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.0184 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 0 Time: 0.0184 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.017024 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 0 Time: 0.017024 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.01968 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 0 Time: 0.01968 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.016384 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 0 Time: 0.016384 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:39] [V] [TRT] Tactic: 0 time 0.015072 [08/05/2021-07:26:39] [V] [TRT] Fastest Tactic: 0 Time: 0.015072 [08/05/2021-07:26:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:40] [V] [TRT] Tactic: 0 time 0.017376 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: 0 Time: 0.017376 [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:40] [V] [TRT] Tactic: 0 time 0.016384 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: 0 Time: 0.016384 [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:40] [V] [TRT] Tactic: 0 time 0.013024 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: 0 Time: 0.013024 [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:40] [V] [TRT] Tactic: 0 time 0.014336 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:40] [V] [TRT] Tactic: 0 time 0.012288 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:40] [V] [TRT] Tactic: 0 time 0.011264 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: 0 Time: 0.011264 [08/05/2021-07:26:40] [V] [TRT] *************** Autotuning format combination: Float(1,9,162,165888) -> Float(1,9,162,82944) *************** [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (LegacySASSConvolution) [08/05/2021-07:26:40] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (FusedConvActConvolution) [08/05/2021-07:26:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (CaskConvolution) [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 1754569683116234317 time 0.142048 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 1825138533642645384 time 0.144128 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 2733356012094739613 time 0.174432 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 3915320020053085238 time 0.14336 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 6808617066150061604 time 0.16384 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 9091006216302412844 time 0.151712 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -8060443123034038864 time 0.162656 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -4420849921117327522 time 0.19616 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -3946921629105938337 time 0.184832 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: 1754569683116234317 Time: 0.142048 [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (CudaConvolution) [08/05/2021-07:26:40] [V] [TRT] Tactic: 0 time 0.222656 [08/05/2021-07:26:40] [V] [TRT] Tactic: 1 time 0.161344 [08/05/2021-07:26:40] [V] [TRT] Tactic: 2 time 0.339424 [08/05/2021-07:26:40] [V] [TRT] Tactic: 4 skipped. Scratch requested: 4832886784, available: 2097152000 [08/05/2021-07:26:40] [V] [TRT] Tactic: 5 time 1.4624 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: 1 Time: 0.161344 [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (CudaDepthwiseConvolution) [08/05/2021-07:26:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1754569683116234317 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [08/05/2021-07:26:40] [V] [TRT] [08/05/2021-07:26:40] [V] [TRT] *************** Autotuning format combination: Half(1,9,162,165888) -> Half(1,9,162,82944) *************** [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (FusedConvActConvolution) [08/05/2021-07:26:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (CaskConvolution) [08/05/2021-07:26:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (CudaConvolution) [08/05/2021-07:26:40] [V] [TRT] Tactic: 0 time 0.194912 [08/05/2021-07:26:40] [V] [TRT] Tactic: 1 time 0.162624 [08/05/2021-07:26:40] [V] [TRT] Tactic: 2 time 0.307904 [08/05/2021-07:26:40] [V] [TRT] Tactic: 4 skipped. Scratch requested: 4832886784, available: 2097152000 [08/05/2021-07:26:40] [V] [TRT] Tactic: 5 time 1.47866 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: 1 Time: 0.162624 [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (CudaDepthwiseConvolution) [08/05/2021-07:26:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [08/05/2021-07:26:40] [V] [TRT] [08/05/2021-07:26:40] [V] [TRT] *************** Autotuning format combination: Half(1,9,162:2,82944) -> Half(1,9,162:2,41472) *************** [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (LegacySASSConvolution) [08/05/2021-07:26:40] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (FusedConvActConvolution) [08/05/2021-07:26:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (CaskConvolution) [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 1651411198763708804 time 0.079648 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 2418518597804310654 time 0.080928 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 4318470497547290900 time 0.078944 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 4930470141256631146 time 0.086272 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 8292881859266835088 time 0.086016 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 8401509141903434922 time 0.079392 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -8654297089785671176 time 0.075744 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -7516584506774355935 time 0.080544 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -7140760933967189247 time 0.077408 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -6004726995029373073 time 0.083232 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -5719726816705110014 time 0.07456 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -4097850214384059472 time 0.080192 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -3717489476759089008 time 0.077792 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -3689982367035295496 time 0.075392 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -2640575123064142123 time 0.074304 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -2534402059426524406 time 0.074496 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -2027588946874785071 time 0.08256 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -1968398013367819764 time 0.074912 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: -2640575123064142123 Time: 0.074304 [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (CudaConvolution) [08/05/2021-07:26:40] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (CudaDepthwiseConvolution) [08/05/2021-07:26:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2640575123064142123 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:40] [V] [TRT] [08/05/2021-07:26:40] [V] [TRT] *************** Autotuning format combination: Half(128,1152,1:8,20736) -> Float(1,9,162,82944) *************** [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (FusedConvActConvolution) [08/05/2021-07:26:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (CaskConvolution) [08/05/2021-07:26:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (CudaConvolution) [08/05/2021-07:26:40] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (CudaDepthwiseConvolution) [08/05/2021-07:26:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:40] [V] [TRT] *************** Autotuning format combination: Half(128,1152,1:8,20736) -> Half(64,576,1:8,10368) *************** [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (FusedConvActConvolution) [08/05/2021-07:26:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (CaskConvolution) [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 1179757074518529353 time 0.030496 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 2105695814191699972 time 0.05024 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 2148106709480872763 time 0.034816 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 2410442691266548717 time 0.045056 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 3041642431972138763 time 0.028576 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 3754069740140581927 time 0.053152 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 4555462412611657028 time 0.034976 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 5666160310350604399 time 0.0512 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 5925270497649423688 time 0.074464 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 6680916730816870145 time 0.045056 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 7158029511300006471 time 0.050784 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 7859952145590271433 time 0.045152 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: 8283847742354150423 time 0.046144 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -8992262742606384444 time 0.034528 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -8391760416076885205 time 0.073312 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -6273232454637933930 time 0.031424 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -5818527483287834165 time 0.029408 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -4534876761957424274 time 0.07248 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -3237051169894153788 time 0.04304 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -3136088851200285532 time 0.027392 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -2586046817576862066 time 0.043136 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -2422160065350346448 time 0.04512 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -1216445540764179377 time 0.041184 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] Tactic: -229563042944049199 time 0.02736 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: -229563042944049199 Time: 0.02736 [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (CudaConvolution) [08/05/2021-07:26:40] [V] [TRT] Tactic: 0 time 0.226016 [08/05/2021-07:26:40] [V] [TRT] Tactic: 1 time 0.28672 [08/05/2021-07:26:40] [V] [TRT] Tactic: 2 time 0.279264 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: 0 Time: 0.226016 [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: Conv_140 + Relu_142 (CudaDepthwiseConvolution) [08/05/2021-07:26:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -229563042944049199 [08/05/2021-07:26:40] [V] [TRT] Conv_140 + Relu_142 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:40] [V] [TRT] [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:40] [V] [TRT] Tactic: 0 time 0.013088 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: 0 Time: 0.013088 [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:40] [V] [TRT] Tactic: 0 time 0.01024 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:40] [V] [TRT] Tactic: 0 time 0.01024 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:40] [V] [TRT] Tactic: 0 time 0.011872 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: 0 Time: 0.011872 [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:40] [V] [TRT] Tactic: 0 time 0.00992 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: 0 Time: 0.00992 [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:40] [V] [TRT] Tactic: 0 time 0.008928 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: 0 Time: 0.008928 [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:40] [V] [TRT] Tactic: 0 time 0.009152 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: 0 Time: 0.009152 [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:40] [V] [TRT] Tactic: 0 time 0.009344 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: 0 Time: 0.009344 [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:40] [V] [TRT] Tactic: 0 time 0.007776 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: 0 Time: 0.007776 [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:40] [V] [TRT] Tactic: 0 time 0.009408 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: 0 Time: 0.009408 [08/05/2021-07:26:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:40] [V] [TRT] Tactic: 0 time 0.008096 [08/05/2021-07:26:40] [V] [TRT] Fastest Tactic: 0 Time: 0.008096 [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:41] [V] [TRT] Tactic: 0 time 0.00784 [08/05/2021-07:26:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00784 [08/05/2021-07:26:41] [V] [TRT] *************** Autotuning format combination: Float(1,9,162,82944) -> Float(1,5,45,23040) *************** [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (LegacySASSConvolution) [08/05/2021-07:26:41] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (FusedConvActConvolution) [08/05/2021-07:26:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (CaskConvolution) [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 1825138533642645384 time 0.641056 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 2842488832350522458 time 0.458016 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 3915320020053085238 time 0.606816 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 6448355332020552203 time 0.647008 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 6808617066150061604 time 0.37104 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -8060443123034038864 time 0.448128 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -4420849921117327522 time 0.516736 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -3946921629105938337 time 0.551744 [08/05/2021-07:26:41] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.37104 [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (CudaConvolution) [08/05/2021-07:26:41] [V] [TRT] Tactic: 0 time 0.394592 [08/05/2021-07:26:41] [V] [TRT] Tactic: 1 time 0.379968 [08/05/2021-07:26:41] [V] [TRT] Tactic: 2 time 0.347648 [08/05/2021-07:26:41] [V] [TRT] Tactic: 5 time 8.07171 [08/05/2021-07:26:41] [V] [TRT] Fastest Tactic: 2 Time: 0.347648 [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (CudaDepthwiseConvolution) [08/05/2021-07:26:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2 [08/05/2021-07:26:41] [V] [TRT] [08/05/2021-07:26:41] [V] [TRT] *************** Autotuning format combination: Half(1,9,162,82944) -> Half(1,5,45,23040) *************** [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (FusedConvActConvolution) [08/05/2021-07:26:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (CaskConvolution) [08/05/2021-07:26:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (CudaConvolution) [08/05/2021-07:26:41] [V] [TRT] Tactic: 0 time 0.781088 [08/05/2021-07:26:41] [V] [TRT] Tactic: 1 time 0.391168 [08/05/2021-07:26:41] [V] [TRT] Tactic: 2 time 0.813152 [08/05/2021-07:26:41] [V] [TRT] Tactic: 5 time 8.3072 [08/05/2021-07:26:41] [V] [TRT] Fastest Tactic: 1 Time: 0.391168 [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (CudaDepthwiseConvolution) [08/05/2021-07:26:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [08/05/2021-07:26:41] [V] [TRT] [08/05/2021-07:26:41] [V] [TRT] *************** Autotuning format combination: Half(1,9,162:2,41472) -> Half(1,5,45:2,11520) *************** [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (LegacySASSConvolution) [08/05/2021-07:26:41] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (FusedConvActConvolution) [08/05/2021-07:26:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (CaskConvolution) [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 1145226902788474763 time 0.251904 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 1651411198763708804 time 0.238304 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 2418518597804310654 time 0.22816 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 4318470497547290900 time 0.188896 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 4653005425971292725 time 0.237056 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 4930470141256631146 time 0.260512 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 8292881859266835088 time 0.270336 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 8401509141903434922 time 0.189856 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -8654297089785671176 time 0.310912 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -7448936905981214224 time 0.289504 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -6004726995029373073 time 0.20928 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -5719726816705110014 time 0.30912 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -3754890472406891741 time 0.3336 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -3689982367035295496 time 0.324448 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -2894005464278291378 time 0.270336 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -2027588946874785071 time 0.206848 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -1968398013367819764 time 0.325632 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -245090590808296743 time 0.333888 [08/05/2021-07:26:41] [V] [TRT] Fastest Tactic: 4318470497547290900 Time: 0.188896 [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (CudaConvolution) [08/05/2021-07:26:41] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (CudaDepthwiseConvolution) [08/05/2021-07:26:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4318470497547290900 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:41] [V] [TRT] [08/05/2021-07:26:41] [V] [TRT] *************** Autotuning format combination: Half(64,576,1:8,10368) -> Float(1,5,45,23040) *************** [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (FusedConvActConvolution) [08/05/2021-07:26:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (CaskConvolution) [08/05/2021-07:26:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (CudaConvolution) [08/05/2021-07:26:41] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (CudaDepthwiseConvolution) [08/05/2021-07:26:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:41] [V] [TRT] *************** Autotuning format combination: Half(64,576,1:8,10368) -> Half(64,320,1:8,2880) *************** [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (FusedConvActConvolution) [08/05/2021-07:26:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (CaskConvolution) [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 2148106709480872763 time 0.114784 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 2410442691266548717 time 0.161856 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 3754069740140581927 time 0.172032 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 3823144360994712832 time 0.09296 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 5635311898703673455 time 0.099008 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 5925270497649423688 time 0.305504 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 6680916730816870145 time 0.16384 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 7158029511300006471 time 0.164576 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 7859952145590271433 time 0.161792 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: 8283847742354150423 time 0.173856 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -8992262742606384444 time 0.118784 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -8682550625095202832 time 0.117568 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -6273232454637933930 time 0.093376 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -5818527483287834165 time 0.088896 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -4954692664176521434 time 0.164704 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -4534876761957424274 time 0.304736 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -3237051169894153788 time 0.159808 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -3136088851200285532 time 0.088064 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -2586046817576862066 time 0.165568 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:41] [V] [TRT] Tactic: -229563042944049199 time 0.096992 [08/05/2021-07:26:41] [V] [TRT] Fastest Tactic: -3136088851200285532 Time: 0.088064 [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (CudaConvolution) [08/05/2021-07:26:41] [V] [TRT] Tactic: 0 time 0.776192 [08/05/2021-07:26:41] [V] [TRT] Tactic: 1 time 0.919552 [08/05/2021-07:26:41] [V] [TRT] Tactic: 2 time 0.824416 [08/05/2021-07:26:41] [V] [TRT] Fastest Tactic: 0 Time: 0.776192 [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: Conv_143 + Relu_145 (CudaDepthwiseConvolution) [08/05/2021-07:26:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3136088851200285532 [08/05/2021-07:26:41] [V] [TRT] Conv_143 + Relu_145 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:41] [V] [TRT] [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:41] [V] [TRT] Tactic: 0 time 0.006144 [08/05/2021-07:26:41] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:41] [V] [TRT] Tactic: 0 time 0.005088 [08/05/2021-07:26:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005088 [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:41] [V] [TRT] Tactic: 0 time 0.006304 [08/05/2021-07:26:41] [V] [TRT] Fastest Tactic: 0 Time: 0.006304 [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:41] [V] [TRT] Tactic: 0 time 0.005632 [08/05/2021-07:26:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005632 [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:41] [V] [TRT] Tactic: 0 time 0.00528 [08/05/2021-07:26:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00528 [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:41] [V] [TRT] Tactic: 0 time 0.006176 [08/05/2021-07:26:41] [V] [TRT] Fastest Tactic: 0 Time: 0.006176 [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:41] [V] [TRT] Tactic: 0 time 0.00576 [08/05/2021-07:26:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00576 [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:41] [V] [TRT] Tactic: 0 time 0.004704 [08/05/2021-07:26:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004704 [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:41] [V] [TRT] Tactic: 0 time 0.004896 [08/05/2021-07:26:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004896 [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:41] [V] [TRT] Tactic: 0 time 0.005216 [08/05/2021-07:26:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005216 [08/05/2021-07:26:41] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:42] [V] [TRT] Tactic: 0 time 0.005312 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: 0 Time: 0.005312 [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:42] [V] [TRT] Tactic: 0 time 0.005088 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: 0 Time: 0.005088 [08/05/2021-07:26:42] [V] [TRT] *************** Autotuning format combination: Float(1,5,45,23040) -> Float(1,5,45,92160) *************** [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (LegacySASSConvolution) [08/05/2021-07:26:42] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (FusedConvActConvolution) [08/05/2021-07:26:42] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (CaskConvolution) [08/05/2021-07:26:42] [V] [TRT] Conv_146 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 1754569683116234317 time 0.076544 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 1825138533642645384 time 0.077824 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 2733356012094739613 time 0.099968 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 3915320020053085238 time 0.077664 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 6808617066150061604 time 0.085696 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 9091006216302412844 time 0.079936 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -8060443123034038864 time 0.086496 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -4420849921117327522 time 0.108544 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -3946921629105938337 time 0.104448 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: 1754569683116234317 Time: 0.076544 [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (CudaConvolution) [08/05/2021-07:26:42] [V] [TRT] Tactic: 0 time 0.124928 [08/05/2021-07:26:42] [V] [TRT] Tactic: 1 time 0.089888 [08/05/2021-07:26:42] [V] [TRT] Tactic: 2 time 0.214304 [08/05/2021-07:26:42] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2455502848, available: 2097152000 [08/05/2021-07:26:42] [V] [TRT] Tactic: 5 time 1.97952 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: 1 Time: 0.089888 [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (CudaDepthwiseConvolution) [08/05/2021-07:26:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1754569683116234317 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [08/05/2021-07:26:42] [V] [TRT] [08/05/2021-07:26:42] [V] [TRT] *************** Autotuning format combination: Half(1,5,45,23040) -> Half(1,5,45,92160) *************** [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (FusedConvActConvolution) [08/05/2021-07:26:42] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (CaskConvolution) [08/05/2021-07:26:42] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (CudaConvolution) [08/05/2021-07:26:42] [V] [TRT] Tactic: 0 time 0.109376 [08/05/2021-07:26:42] [V] [TRT] Tactic: 1 time 0.089056 [08/05/2021-07:26:42] [V] [TRT] Tactic: 2 time 0.211008 [08/05/2021-07:26:42] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2455502848, available: 2097152000 [08/05/2021-07:26:42] [V] [TRT] Tactic: 5 time 1.93638 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: 1 Time: 0.089056 [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (CudaDepthwiseConvolution) [08/05/2021-07:26:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [08/05/2021-07:26:42] [V] [TRT] [08/05/2021-07:26:42] [V] [TRT] *************** Autotuning format combination: Half(1,5,45:2,11520) -> Half(1,5,45:2,46080) *************** [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (LegacySASSConvolution) [08/05/2021-07:26:42] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (FusedConvActConvolution) [08/05/2021-07:26:42] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (CaskConvolution) [08/05/2021-07:26:42] [V] [TRT] Conv_146 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 1651411198763708804 time 0.044544 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 2418518597804310654 time 0.045056 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 4318470497547290900 time 0.043008 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 4930470141256631146 time 0.065536 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 8292881859266835088 time 0.047712 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 8401509141903434922 time 0.042752 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -8654297089785671176 time 0.041248 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -7516584506774355935 time 0.04544 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -7140760933967189247 time 0.042976 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -6004726995029373073 time 0.063168 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -5719726816705110014 time 0.04096 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -4097850214384059472 time 0.045056 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -3717489476759089008 time 0.043008 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -3689982367035295496 time 0.040992 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -2640575123064142123 time 0.041184 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -2534402059426524406 time 0.04096 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -2027588946874785071 time 0.062272 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -1968398013367819764 time 0.041408 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: -5719726816705110014 Time: 0.04096 [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (CudaConvolution) [08/05/2021-07:26:42] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (CudaDepthwiseConvolution) [08/05/2021-07:26:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5719726816705110014 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:42] [V] [TRT] [08/05/2021-07:26:42] [V] [TRT] *************** Autotuning format combination: Half(64,320,1:8,2880) -> Float(1,5,45,92160) *************** [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (FusedConvActConvolution) [08/05/2021-07:26:42] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (CaskConvolution) [08/05/2021-07:26:42] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (CudaConvolution) [08/05/2021-07:26:42] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (CudaDepthwiseConvolution) [08/05/2021-07:26:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:42] [V] [TRT] *************** Autotuning format combination: Half(64,320,1:8,2880) -> Half(256,1280,1:8,11520) *************** [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (FusedConvActConvolution) [08/05/2021-07:26:42] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (CaskConvolution) [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 1179757074518529353 time 0.020032 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 2105695814191699972 time 0.027456 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 2148106709480872763 time 0.021056 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 2410442691266548717 time 0.024672 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 3041642431972138763 time 0.017216 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 3754069740140581927 time 0.02896 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 4555462412611657028 time 0.021312 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 5666160310350604399 time 0.028704 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 5925270497649423688 time 0.041248 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 6680916730816870145 time 0.026784 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 7158029511300006471 time 0.024928 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 7859952145590271433 time 0.026624 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: 8283847742354150423 time 0.025792 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -8992262742606384444 time 0.020288 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -8391760416076885205 time 0.039392 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -6273232454637933930 time 0.0192 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -5818527483287834165 time 0.018432 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -4534876761957424274 time 0.039744 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -3237051169894153788 time 0.024672 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -3136088851200285532 time 0.018048 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -2586046817576862066 time 0.024608 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -2422160065350346448 time 0.02656 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -1216445540764179377 time 0.024416 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] Tactic: -229563042944049199 time 0.017216 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: 3041642431972138763 Time: 0.017216 [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (CudaConvolution) [08/05/2021-07:26:42] [V] [TRT] Tactic: 0 time 0.122816 [08/05/2021-07:26:42] [V] [TRT] Tactic: 1 time 0.163648 [08/05/2021-07:26:42] [V] [TRT] Tactic: 2 time 0.14336 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: 0 Time: 0.122816 [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: Conv_146 (CudaDepthwiseConvolution) [08/05/2021-07:26:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3041642431972138763 [08/05/2021-07:26:42] [V] [TRT] Conv_146 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:42] [V] [TRT] [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:42] [V] [TRT] Tactic: 0 time 0.020608 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: 0 Time: 0.020608 [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:42] [V] [TRT] Tactic: 0 time 0.018432 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: 0 Time: 0.018432 [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:42] [V] [TRT] Tactic: 0 time 0.017632 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: 0 Time: 0.017632 [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:42] [V] [TRT] Tactic: 0 time 0.0192 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: 0 Time: 0.0192 [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:42] [V] [TRT] Tactic: 0 time 0.016384 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: 0 Time: 0.016384 [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:42] [V] [TRT] Tactic: 0 time 0.01584 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: 0 Time: 0.01584 [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:42] [V] [TRT] Tactic: 0 time 0.017824 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: 0 Time: 0.017824 [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:42] [V] [TRT] Tactic: 0 time 0.016416 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: 0 Time: 0.016416 [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:42] [V] [TRT] Tactic: 0 time 0.012128 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: 0 Time: 0.012128 [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:42] [V] [TRT] Tactic: 0 time 0.014336 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:42] [V] [TRT] Tactic: 0 time 0.012288 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:42] [V] [TRT] Tactic: 0 time 0.011136 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: 0 Time: 0.011136 [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:42] [V] [TRT] Tactic: 0 time 0.012992 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: 0 Time: 0.012992 [08/05/2021-07:26:42] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:42] [V] [TRT] Tactic: 0 time 0.011936 [08/05/2021-07:26:42] [V] [TRT] Fastest Tactic: 0 Time: 0.011936 [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:43] [V] [TRT] Tactic: 0 time 0.011264 [08/05/2021-07:26:43] [V] [TRT] Fastest Tactic: 0 Time: 0.011264 [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:43] [V] [TRT] Tactic: 0 time 0.012288 [08/05/2021-07:26:43] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:43] [V] [TRT] Tactic: 0 time 0.010656 [08/05/2021-07:26:43] [V] [TRT] Fastest Tactic: 0 Time: 0.010656 [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:43] [V] [TRT] Tactic: 0 time 0.011584 [08/05/2021-07:26:43] [V] [TRT] Fastest Tactic: 0 Time: 0.011584 [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:43] [V] [TRT] Tactic: 0 time 0.010464 [08/05/2021-07:26:43] [V] [TRT] Fastest Tactic: 0 Time: 0.010464 [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:43] [V] [TRT] Tactic: 0 time 0.011264 [08/05/2021-07:26:43] [V] [TRT] Fastest Tactic: 0 Time: 0.011264 [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:43] [V] [TRT] Tactic: 0 time 0.008416 [08/05/2021-07:26:43] [V] [TRT] Fastest Tactic: 0 Time: 0.008416 [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:43] [V] [TRT] Tactic: 0 time 0.01024 [08/05/2021-07:26:43] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:43] [V] [TRT] Tactic: 0 time 0.009696 [08/05/2021-07:26:43] [V] [TRT] Fastest Tactic: 0 Time: 0.009696 [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:43] [V] [TRT] Tactic: 0 time 0.008384 [08/05/2021-07:26:43] [V] [TRT] Fastest Tactic: 0 Time: 0.008384 [08/05/2021-07:26:43] [V] [TRT] *************** Autotuning format combination: Float(1,9,162,165888), Float(1,5,45,92160) -> Float(1,5,45,92160) *************** [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: Conv_148 + Add_150 + Relu_151 (LegacySASSConvolution) [08/05/2021-07:26:43] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: Conv_148 + Add_150 + Relu_151 (CaskConvolution) [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 1754569683116234317 time 0.167776 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 1825138533642645384 time 0.170816 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 2733356012094739613 time 0.212032 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 3915320020053085238 time 0.163392 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 6808617066150061604 time 0.176544 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 9091006216302412844 time 0.166176 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -8060443123034038864 time 0.17696 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -4420849921117327522 time 0.236288 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -3946921629105938337 time 0.222912 [08/05/2021-07:26:43] [V] [TRT] Fastest Tactic: 3915320020053085238 Time: 0.163392 [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: Conv_148 + Add_150 + Relu_151 (CudaConvolution) [08/05/2021-07:26:43] [V] [TRT] Tactic: 0 time 0.247776 [08/05/2021-07:26:43] [V] [TRT] Tactic: 1 time 0.1848 [08/05/2021-07:26:43] [V] [TRT] Tactic: 2 time 0.32576 [08/05/2021-07:26:43] [V] [TRT] Fastest Tactic: 1 Time: 0.1848 [08/05/2021-07:26:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3915320020053085238 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [08/05/2021-07:26:43] [V] [TRT] [08/05/2021-07:26:43] [V] [TRT] *************** Autotuning format combination: Half(1,9,162,165888), Half(1,5,45,92160) -> Half(1,5,45,92160) *************** [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: Conv_148 + Add_150 + Relu_151 (CaskConvolution) [08/05/2021-07:26:43] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: Conv_148 + Add_150 + Relu_151 (CudaConvolution) [08/05/2021-07:26:43] [V] [TRT] Tactic: 0 time 0.207776 [08/05/2021-07:26:43] [V] [TRT] Tactic: 1 time 0.174784 [08/05/2021-07:26:43] [V] [TRT] Tactic: 2 time 0.314688 [08/05/2021-07:26:43] [V] [TRT] Fastest Tactic: 1 Time: 0.174784 [08/05/2021-07:26:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [08/05/2021-07:26:43] [V] [TRT] [08/05/2021-07:26:43] [V] [TRT] *************** Autotuning format combination: Half(1,9,162:2,82944), Half(1,5,45:2,46080) -> Half(1,5,45:2,46080) *************** [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: Conv_148 + Add_150 + Relu_151 (LegacySASSConvolution) [08/05/2021-07:26:43] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: Conv_148 + Add_150 + Relu_151 (CaskConvolution) [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 1651411198763708804 time 0.086016 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 2418518597804310654 time 0.086784 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 4318470497547290900 time 0.087616 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 4930470141256631146 time 0.130848 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 8292881859266835088 time 0.134176 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 8401509141903434922 time 0.086016 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -8654297089785671176 time 0.077984 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -7516584506774355935 time 0.104224 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -7140760933967189247 time 0.086848 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -6004726995029373073 time 0.133824 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -5719726816705110014 time 0.077824 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -4097850214384059472 time 0.104224 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -3717489476759089008 time 0.087648 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -3689982367035295496 time 0.078592 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -2640575123064142123 time 0.083968 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -2534402059426524406 time 0.084256 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -2027588946874785071 time 0.131936 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -1968398013367819764 time 0.077824 [08/05/2021-07:26:43] [V] [TRT] Fastest Tactic: -5719726816705110014 Time: 0.077824 [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: Conv_148 + Add_150 + Relu_151 (CudaConvolution) [08/05/2021-07:26:43] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5719726816705110014 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:43] [V] [TRT] [08/05/2021-07:26:43] [V] [TRT] *************** Autotuning format combination: Half(128,1152,1:8,20736), Float(1,5,45,92160) -> Float(1,5,45,92160) *************** [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: Conv_148 + Add_150 + Relu_151 (CaskConvolution) [08/05/2021-07:26:43] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: Conv_148 + Add_150 + Relu_151 (CudaConvolution) [08/05/2021-07:26:43] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:43] [V] [TRT] *************** Autotuning format combination: Half(128,1152,1:8,20736), Half(256,1280,1:8,11520) -> Half(256,1280,1:8,11520) *************** [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: Conv_148 + Add_150 + Relu_151 (CaskConvolution) [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 1179757074518529353 time 0.032768 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 2105695814191699972 time 0.050272 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 2148106709480872763 time 0.036448 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 2410442691266548717 time 0.045056 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 3041642431972138763 time 0.029792 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 3754069740140581927 time 0.050976 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 4555462412611657028 time 0.03584 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 5666160310350604399 time 0.049152 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 5925270497649423688 time 0.076416 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 6680916730816870145 time 0.047424 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 7158029511300006471 time 0.047968 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 7859952145590271433 time 0.047264 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: 8283847742354150423 time 0.050816 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -8992262742606384444 time 0.036928 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -8391760416076885205 time 0.076096 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -6273232454637933930 time 0.033504 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -5818527483287834165 time 0.032768 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -4534876761957424274 time 0.076064 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -3237051169894153788 time 0.047168 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -3136088851200285532 time 0.029504 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -2586046817576862066 time 0.045152 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -2422160065350346448 time 0.046912 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -1216445540764179377 time 0.043584 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] Tactic: -229563042944049199 time 0.030816 [08/05/2021-07:26:43] [V] [TRT] Fastest Tactic: -3136088851200285532 Time: 0.029504 [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: Conv_148 + Add_150 + Relu_151 (CudaConvolution) [08/05/2021-07:26:43] [V] [TRT] Tactic: 0 time 0.238976 [08/05/2021-07:26:43] [V] [TRT] Tactic: 1 time 0.297792 [08/05/2021-07:26:43] [V] [TRT] Tactic: 2 time 0.25104 [08/05/2021-07:26:43] [V] [TRT] Fastest Tactic: 0 Time: 0.238976 [08/05/2021-07:26:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3136088851200285532 [08/05/2021-07:26:43] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:43] [V] [TRT] [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:43] [V] [TRT] Tactic: 0 time 0.01312 [08/05/2021-07:26:43] [V] [TRT] Fastest Tactic: 0 Time: 0.01312 [08/05/2021-07:26:43] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.01168 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.01168 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.011232 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.011232 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.012288 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.010336 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.010336 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.011136 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.011136 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.01024 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.010432 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.010432 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.008192 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.010336 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.010336 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.010208 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.010208 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.008192 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.014016 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.014016 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.011008 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.011008 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.012288 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.012256 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.012256 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.010784 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.010784 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.010848 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.010848 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.01024 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.01024 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.008192 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.01024 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.008928 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.008928 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.008256 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.008256 [08/05/2021-07:26:44] [V] [TRT] *************** Autotuning format combination: Float(1,5,45,92160) -> Float(1,5,45,23040) *************** [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (LegacySASSConvolution) [08/05/2021-07:26:44] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (FusedConvActConvolution) [08/05/2021-07:26:44] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (CaskConvolution) [08/05/2021-07:26:44] [V] [TRT] Conv_152 + Relu_154 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [08/05/2021-07:26:44] [V] [TRT] Tactic: 1754569683116234317 time 0.27248 [08/05/2021-07:26:44] [V] [TRT] Conv_152 + Relu_154 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [08/05/2021-07:26:44] [V] [TRT] Tactic: 1825138533642645384 time 0.27648 [08/05/2021-07:26:44] [V] [TRT] Conv_152 + Relu_154 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [08/05/2021-07:26:44] [V] [TRT] Tactic: 2733356012094739613 time 0.300032 [08/05/2021-07:26:44] [V] [TRT] Conv_152 + Relu_154 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [08/05/2021-07:26:44] [V] [TRT] Tactic: 3915320020053085238 time 0.273952 [08/05/2021-07:26:44] [V] [TRT] Conv_152 + Relu_154 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [08/05/2021-07:26:44] [V] [TRT] Tactic: 6808617066150061604 time 0.169984 [08/05/2021-07:26:44] [V] [TRT] Conv_152 + Relu_154 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [08/05/2021-07:26:44] [V] [TRT] Tactic: 9091006216302412844 time 0.16384 [08/05/2021-07:26:44] [V] [TRT] Conv_152 + Relu_154 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [08/05/2021-07:26:44] [V] [TRT] Tactic: -8060443123034038864 time 0.181888 [08/05/2021-07:26:44] [V] [TRT] Conv_152 + Relu_154 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [08/05/2021-07:26:44] [V] [TRT] Tactic: -4420849921117327522 time 0.239936 [08/05/2021-07:26:44] [V] [TRT] Conv_152 + Relu_154 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [08/05/2021-07:26:44] [V] [TRT] Tactic: -3946921629105938337 time 0.273216 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.16384 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (CudaConvolution) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.161856 [08/05/2021-07:26:44] [V] [TRT] Tactic: 1 time 0.171968 [08/05/2021-07:26:44] [V] [TRT] Tactic: 2 time 0.23552 [08/05/2021-07:26:44] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2561671168, available: 2097152000 [08/05/2021-07:26:44] [V] [TRT] Tactic: 5 time 2.1736 [08/05/2021-07:26:44] [V] [TRT] Fastest Tactic: 0 Time: 0.161856 [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (CudaDepthwiseConvolution) [08/05/2021-07:26:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0 [08/05/2021-07:26:44] [V] [TRT] [08/05/2021-07:26:44] [V] [TRT] *************** Autotuning format combination: Half(1,5,45,92160) -> Half(1,5,45,23040) *************** [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (FusedConvActConvolution) [08/05/2021-07:26:44] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (CaskConvolution) [08/05/2021-07:26:44] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:44] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (CudaConvolution) [08/05/2021-07:26:44] [V] [TRT] Tactic: 0 time 0.352256 [08/05/2021-07:26:45] [V] [TRT] Tactic: 1 time 0.176128 [08/05/2021-07:26:45] [V] [TRT] Tactic: 2 time 0.462464 [08/05/2021-07:26:45] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2561671168, available: 2097152000 [08/05/2021-07:26:45] [V] [TRT] Tactic: 5 time 2.23008 [08/05/2021-07:26:45] [V] [TRT] Fastest Tactic: 1 Time: 0.176128 [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (CudaDepthwiseConvolution) [08/05/2021-07:26:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [08/05/2021-07:26:45] [V] [TRT] [08/05/2021-07:26:45] [V] [TRT] *************** Autotuning format combination: Half(1,5,45:2,46080) -> Half(1,5,45:2,11520) *************** [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (LegacySASSConvolution) [08/05/2021-07:26:45] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (FusedConvActConvolution) [08/05/2021-07:26:45] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (CaskConvolution) [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 1651411198763708804 time 0.099136 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 2418518597804310654 time 0.0992 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 4318470497547290900 time 0.092896 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 4930470141256631146 time 0.11744 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 8292881859266835088 time 0.104544 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 8401509141903434922 time 0.084256 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -8654297089785671176 time 0.141376 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -7516584506774355935 time 0.081952 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -7140760933967189247 time 0.081024 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -6004726995029373073 time 0.094208 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -5719726816705110014 time 0.140128 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -4097850214384059472 time 0.092384 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -3717489476759089008 time 0.080672 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -3689982367035295496 time 0.1416 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -2640575123064142123 time 0.139264 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -2534402059426524406 time 0.139264 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -2027588946874785071 time 0.090976 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -1968398013367819764 time 0.141312 [08/05/2021-07:26:45] [V] [TRT] Fastest Tactic: -3717489476759089008 Time: 0.080672 [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (CudaConvolution) [08/05/2021-07:26:45] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (CudaDepthwiseConvolution) [08/05/2021-07:26:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3717489476759089008 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:45] [V] [TRT] [08/05/2021-07:26:45] [V] [TRT] *************** Autotuning format combination: Half(256,1280,1:8,11520) -> Float(1,5,45,23040) *************** [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (FusedConvActConvolution) [08/05/2021-07:26:45] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (CaskConvolution) [08/05/2021-07:26:45] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (CudaConvolution) [08/05/2021-07:26:45] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (CudaDepthwiseConvolution) [08/05/2021-07:26:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:45] [V] [TRT] *************** Autotuning format combination: Half(256,1280,1:8,11520) -> Half(64,320,1:8,2880) *************** [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (FusedConvActConvolution) [08/05/2021-07:26:45] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (CaskConvolution) [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 1179757074518529353 time 0.044864 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 2105695814191699972 time 0.082688 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 2148106709480872763 time 0.058112 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 2410442691266548717 time 0.076864 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 3041642431972138763 time 0.043936 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 3754069740140581927 time 0.08976 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 4555462412611657028 time 0.058176 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 5666160310350604399 time 0.085792 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 5925270497649423688 time 0.140096 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 6680916730816870145 time 0.076544 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 7158029511300006471 time 0.07424 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 7859952145590271433 time 0.075552 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 8283847742354150423 time 0.079872 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -8992262742606384444 time 0.049888 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -8391760416076885205 time 0.137824 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -6273232454637933930 time 0.0448 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -5818527483287834165 time 0.04352 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -4534876761957424274 time 0.138784 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -3237051169894153788 time 0.072448 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -3136088851200285532 time 0.042784 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -2586046817576862066 time 0.075872 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -2422160065350346448 time 0.075424 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -1216445540764179377 time 0.074592 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -229563042944049199 time 0.045056 [08/05/2021-07:26:45] [V] [TRT] Fastest Tactic: -3136088851200285532 Time: 0.042784 [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (CudaConvolution) [08/05/2021-07:26:45] [V] [TRT] Tactic: 0 time 0.350496 [08/05/2021-07:26:45] [V] [TRT] Tactic: 1 time 0.42576 [08/05/2021-07:26:45] [V] [TRT] Tactic: 2 time 0.385376 [08/05/2021-07:26:45] [V] [TRT] Fastest Tactic: 0 Time: 0.350496 [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_152 + Relu_154 (CudaDepthwiseConvolution) [08/05/2021-07:26:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3136088851200285532 [08/05/2021-07:26:45] [V] [TRT] Conv_152 + Relu_154 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:45] [V] [TRT] [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:45] [V] [TRT] Tactic: 0 time 0.006016 [08/05/2021-07:26:45] [V] [TRT] Fastest Tactic: 0 Time: 0.006016 [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:45] [V] [TRT] Tactic: 0 time 0.0056 [08/05/2021-07:26:45] [V] [TRT] Fastest Tactic: 0 Time: 0.0056 [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:45] [V] [TRT] Tactic: 0 time 0.006144 [08/05/2021-07:26:45] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:45] [V] [TRT] Tactic: 0 time 0.00512 [08/05/2021-07:26:45] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:45] [V] [TRT] Tactic: 0 time 0.004192 [08/05/2021-07:26:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004192 [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:45] [V] [TRT] Tactic: 0 time 0.006144 [08/05/2021-07:26:45] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:45] [V] [TRT] Tactic: 0 time 0.004768 [08/05/2021-07:26:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004768 [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:45] [V] [TRT] Tactic: 0 time 0.004832 [08/05/2021-07:26:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004832 [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:45] [V] [TRT] Tactic: 0 time 0.004128 [08/05/2021-07:26:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004128 [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:45] [V] [TRT] Tactic: 0 time 0.005216 [08/05/2021-07:26:45] [V] [TRT] Fastest Tactic: 0 Time: 0.005216 [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:45] [V] [TRT] Tactic: 0 time 0.004832 [08/05/2021-07:26:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004832 [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:45] [V] [TRT] Tactic: 0 time 0.004992 [08/05/2021-07:26:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004992 [08/05/2021-07:26:45] [V] [TRT] *************** Autotuning format combination: Float(1,5,45,23040) -> Float(1,5,45,23040) *************** [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (LegacySASSConvolution) [08/05/2021-07:26:45] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (FusedConvActConvolution) [08/05/2021-07:26:45] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (CaskConvolution) [08/05/2021-07:26:45] [V] [TRT] Conv_155 + Relu_157 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 1825138533642645384 time 0.662048 [08/05/2021-07:26:45] [V] [TRT] Conv_155 + Relu_157 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 2775507031594384867 time 0.49152 [08/05/2021-07:26:45] [V] [TRT] Conv_155 + Relu_157 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 2842488832350522458 time 0.479104 [08/05/2021-07:26:45] [V] [TRT] Conv_155 + Relu_157 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 3915320020053085238 time 0.606272 [08/05/2021-07:26:45] [V] [TRT] Conv_155 + Relu_157 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 6448355332020552203 time 0.669696 [08/05/2021-07:26:45] [V] [TRT] Conv_155 + Relu_157 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: 6808617066150061604 time 0.370688 [08/05/2021-07:26:45] [V] [TRT] Conv_155 + Relu_157 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -8060443123034038864 time 0.473824 [08/05/2021-07:26:45] [V] [TRT] Conv_155 + Relu_157 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -4420849921117327522 time 0.51104 [08/05/2021-07:26:45] [V] [TRT] Conv_155 + Relu_157 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [08/05/2021-07:26:45] [V] [TRT] Tactic: -3946921629105938337 time 0.515104 [08/05/2021-07:26:45] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.370688 [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (CudaConvolution) [08/05/2021-07:26:45] [V] [TRT] Tactic: 0 time 0.359168 [08/05/2021-07:26:45] [V] [TRT] Tactic: 1 time 0.378016 [08/05/2021-07:26:45] [V] [TRT] Tactic: 2 time 0.332288 [08/05/2021-07:26:45] [V] [TRT] Tactic: 4 time 2.59638 [08/05/2021-07:26:45] [V] [TRT] Tactic: 5 time 8.04653 [08/05/2021-07:26:45] [V] [TRT] Tactic: 6 time 0.581184 [08/05/2021-07:26:45] [V] [TRT] Fastest Tactic: 2 Time: 0.332288 [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (CudaDepthwiseConvolution) [08/05/2021-07:26:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2 [08/05/2021-07:26:45] [V] [TRT] [08/05/2021-07:26:45] [V] [TRT] *************** Autotuning format combination: Half(1,5,45,23040) -> Half(1,5,45,23040) *************** [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (FusedConvActConvolution) [08/05/2021-07:26:45] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (CaskConvolution) [08/05/2021-07:26:45] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:45] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (CudaConvolution) [08/05/2021-07:26:45] [V] [TRT] Tactic: 0 time 0.770304 [08/05/2021-07:26:45] [V] [TRT] Tactic: 1 time 0.387264 [08/05/2021-07:26:45] [V] [TRT] Tactic: 2 time 0.794528 [08/05/2021-07:26:45] [V] [TRT] Tactic: 4 time 2.59062 [08/05/2021-07:26:45] [V] [TRT] Tactic: 5 time 7.89261 [08/05/2021-07:26:46] [V] [TRT] Tactic: 6 time 0.73568 [08/05/2021-07:26:46] [V] [TRT] Fastest Tactic: 1 Time: 0.387264 [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (CudaDepthwiseConvolution) [08/05/2021-07:26:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [08/05/2021-07:26:46] [V] [TRT] [08/05/2021-07:26:46] [V] [TRT] *************** Autotuning format combination: Half(1,5,45:2,11520) -> Half(1,5,45:2,11520) *************** [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (LegacySASSConvolution) [08/05/2021-07:26:46] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (FusedConvActConvolution) [08/05/2021-07:26:46] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (CaskConvolution) [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: 1145226902788474763 time 0.266272 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: 1651411198763708804 time 0.24928 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: 2418518597804310654 time 0.242528 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: 4318470497547290900 time 0.189248 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: 4653005425971292725 time 0.249664 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: 4930470141256631146 time 0.285216 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: 8292881859266835088 time 0.297792 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: 8401509141903434922 time 0.189184 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: -8654297089785671176 time 0.311872 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: -7448936905981214224 time 0.314688 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: -6004726995029373073 time 0.207488 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: -5719726816705110014 time 0.30992 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: -3754890472406891741 time 0.346464 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: -3689982367035295496 time 0.335872 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: -3140347171730126532 time 0.24576 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: -2894005464278291378 time 0.290624 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: -2027588946874785071 time 0.205536 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: -1968398013367819764 time 0.337568 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: -245090590808296743 time 0.344896 [08/05/2021-07:26:46] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 0.189184 [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (CudaConvolution) [08/05/2021-07:26:46] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (CudaDepthwiseConvolution) [08/05/2021-07:26:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8401509141903434922 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:46] [V] [TRT] [08/05/2021-07:26:46] [V] [TRT] *************** Autotuning format combination: Half(64,320,1:8,2880) -> Float(1,5,45,23040) *************** [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (FusedConvActConvolution) [08/05/2021-07:26:46] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (CaskConvolution) [08/05/2021-07:26:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (CudaConvolution) [08/05/2021-07:26:46] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (CudaDepthwiseConvolution) [08/05/2021-07:26:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:46] [V] [TRT] *************** Autotuning format combination: Half(64,320,1:8,2880) -> Half(64,320,1:8,2880) *************** [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (FusedConvActConvolution) [08/05/2021-07:26:46] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (CaskConvolution) [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: 2148106709480872763 time 0.113856 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: 2410442691266548717 time 0.163296 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: 3754069740140581927 time 0.172032 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: 3823144360994712832 time 0.092992 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: 5635311898703673455 time 0.097952 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: 5925270497649423688 time 0.306848 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: 6680916730816870145 time 0.164672 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: 7158029511300006471 time 0.163008 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: 7859952145590271433 time 0.161792 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: 8283847742354150423 time 0.173824 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: -8992262742606384444 time 0.119552 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: -8682550625095202832 time 0.119456 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: -6273232454637933930 time 0.094176 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: -5818527483287834165 time 0.090112 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: -4954692664176521434 time 0.165888 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: -4534876761957424274 time 0.305152 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: -3237051169894153788 time 0.15776 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: -3136088851200285532 time 0.088576 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: -2586046817576862066 time 0.166368 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:46] [V] [TRT] Tactic: -229563042944049199 time 0.09712 [08/05/2021-07:26:46] [V] [TRT] Fastest Tactic: -3136088851200285532 Time: 0.088576 [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (CudaConvolution) [08/05/2021-07:26:46] [V] [TRT] Tactic: 0 time 0.774112 [08/05/2021-07:26:46] [V] [TRT] Tactic: 1 time 0.845344 [08/05/2021-07:26:46] [V] [TRT] Tactic: 2 time 0.81488 [08/05/2021-07:26:46] [V] [TRT] Tactic: 6 time 0.87568 [08/05/2021-07:26:46] [V] [TRT] Fastest Tactic: 0 Time: 0.774112 [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: Conv_155 + Relu_157 (CudaDepthwiseConvolution) [08/05/2021-07:26:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3136088851200285532 [08/05/2021-07:26:46] [V] [TRT] Conv_155 + Relu_157 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:46] [V] [TRT] [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:46] [V] [TRT] Tactic: 0 time 0.006144 [08/05/2021-07:26:46] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:46] [V] [TRT] Tactic: 0 time 0.005472 [08/05/2021-07:26:46] [V] [TRT] Fastest Tactic: 0 Time: 0.005472 [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:46] [V] [TRT] Tactic: 0 time 0.006144 [08/05/2021-07:26:46] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:46] [V] [TRT] Tactic: 0 time 0.005792 [08/05/2021-07:26:46] [V] [TRT] Fastest Tactic: 0 Time: 0.005792 [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:46] [V] [TRT] Tactic: 0 time 0.004832 [08/05/2021-07:26:46] [V] [TRT] Fastest Tactic: 0 Time: 0.004832 [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:46] [V] [TRT] Tactic: 0 time 0.006208 [08/05/2021-07:26:46] [V] [TRT] Fastest Tactic: 0 Time: 0.006208 [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:46] [V] [TRT] Tactic: 0 time 0.005504 [08/05/2021-07:26:46] [V] [TRT] Fastest Tactic: 0 Time: 0.005504 [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:46] [V] [TRT] Tactic: 0 time 0.004672 [08/05/2021-07:26:46] [V] [TRT] Fastest Tactic: 0 Time: 0.004672 [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:46] [V] [TRT] Tactic: 0 time 0.00496 [08/05/2021-07:26:46] [V] [TRT] Fastest Tactic: 0 Time: 0.00496 [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:46] [V] [TRT] Tactic: 0 time 0.006048 [08/05/2021-07:26:46] [V] [TRT] Fastest Tactic: 0 Time: 0.006048 [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:46] [V] [TRT] Tactic: 0 time 0.005568 [08/05/2021-07:26:46] [V] [TRT] Fastest Tactic: 0 Time: 0.005568 [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:46] [V] [TRT] Tactic: 0 time 0.005408 [08/05/2021-07:26:46] [V] [TRT] Fastest Tactic: 0 Time: 0.005408 [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:46] [V] [TRT] Tactic: 0 time 0.013024 [08/05/2021-07:26:46] [V] [TRT] Fastest Tactic: 0 Time: 0.013024 [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:46] [V] [TRT] Tactic: 0 time 0.011872 [08/05/2021-07:26:46] [V] [TRT] Fastest Tactic: 0 Time: 0.011872 [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:46] [V] [TRT] Tactic: 0 time 0.012288 [08/05/2021-07:26:46] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:46] [V] [TRT] Tactic: 0 time 0.012448 [08/05/2021-07:26:46] [V] [TRT] Fastest Tactic: 0 Time: 0.012448 [08/05/2021-07:26:46] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:46] [V] [TRT] Tactic: 0 time 0.010656 [08/05/2021-07:26:46] [V] [TRT] Fastest Tactic: 0 Time: 0.010656 [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:47] [V] [TRT] Tactic: 0 time 0.01024 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:47] [V] [TRT] Tactic: 0 time 0.010624 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: 0 Time: 0.010624 [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:47] [V] [TRT] Tactic: 0 time 0.01024 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:47] [V] [TRT] Tactic: 0 time 0.008256 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: 0 Time: 0.008256 [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:47] [V] [TRT] Tactic: 0 time 0.010112 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: 0 Time: 0.010112 [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:47] [V] [TRT] Tactic: 0 time 0.009184 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: 0 Time: 0.009184 [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:47] [V] [TRT] Tactic: 0 time 0.008192 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [08/05/2021-07:26:47] [V] [TRT] *************** Autotuning format combination: Float(1,5,45,23040), Float(1,5,45,92160) -> Float(1,5,45,92160) *************** [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: Conv_158 + Add_160 + Relu_161 (LegacySASSConvolution) [08/05/2021-07:26:47] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: Conv_158 + Add_160 + Relu_161 (CaskConvolution) [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 1754569683116234317 time 0.079872 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 1825138533642645384 time 0.080672 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 2733356012094739613 time 0.103616 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 3915320020053085238 time 0.079872 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 6808617066150061604 time 0.090112 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 9091006216302412844 time 0.083232 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -8060443123034038864 time 0.08944 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -4420849921117327522 time 0.11088 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -3946921629105938337 time 0.106848 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: 1754569683116234317 Time: 0.079872 [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: Conv_158 + Add_160 + Relu_161 (CudaConvolution) [08/05/2021-07:26:47] [V] [TRT] Tactic: 0 time 0.13808 [08/05/2021-07:26:47] [V] [TRT] Tactic: 1 time 0.103072 [08/05/2021-07:26:47] [V] [TRT] Tactic: 2 time 0.227328 [08/05/2021-07:26:47] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2455502848, available: 2097152000 [08/05/2021-07:26:47] [V] [TRT] Tactic: 5 time 1.9679 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: 1 Time: 0.103072 [08/05/2021-07:26:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1754569683116234317 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [08/05/2021-07:26:47] [V] [TRT] [08/05/2021-07:26:47] [V] [TRT] *************** Autotuning format combination: Half(1,5,45,23040), Half(1,5,45,92160) -> Half(1,5,45,92160) *************** [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: Conv_158 + Add_160 + Relu_161 (CaskConvolution) [08/05/2021-07:26:47] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: Conv_158 + Add_160 + Relu_161 (CudaConvolution) [08/05/2021-07:26:47] [V] [TRT] Tactic: 0 time 0.123776 [08/05/2021-07:26:47] [V] [TRT] Tactic: 1 time 0.10272 [08/05/2021-07:26:47] [V] [TRT] Tactic: 2 time 0.22528 [08/05/2021-07:26:47] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2455502848, available: 2097152000 [08/05/2021-07:26:47] [V] [TRT] Tactic: 5 time 1.96051 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: 1 Time: 0.10272 [08/05/2021-07:26:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [08/05/2021-07:26:47] [V] [TRT] [08/05/2021-07:26:47] [V] [TRT] *************** Autotuning format combination: Half(1,5,45:2,11520), Half(1,5,45:2,46080) -> Half(1,5,45:2,46080) *************** [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: Conv_158 + Add_160 + Relu_161 (LegacySASSConvolution) [08/05/2021-07:26:47] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: Conv_158 + Add_160 + Relu_161 (CaskConvolution) [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 1651411198763708804 time 0.045056 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 2418518597804310654 time 0.045184 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 4318470497547290900 time 0.045056 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 4930470141256631146 time 0.066368 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 8292881859266835088 time 0.065536 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 8401509141903434922 time 0.044768 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -8654297089785671176 time 0.042336 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -7516584506774355935 time 0.045824 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -7140760933967189247 time 0.044032 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -6004726995029373073 time 0.064 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -5719726816705110014 time 0.041248 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -4097850214384059472 time 0.046912 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -3717489476759089008 time 0.044416 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -3689982367035295496 time 0.041792 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -2640575123064142123 time 0.041792 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -2534402059426524406 time 0.041824 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -2027588946874785071 time 0.063968 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -1968398013367819764 time 0.0424 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: -5719726816705110014 Time: 0.041248 [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: Conv_158 + Add_160 + Relu_161 (CudaConvolution) [08/05/2021-07:26:47] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5719726816705110014 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:47] [V] [TRT] [08/05/2021-07:26:47] [V] [TRT] *************** Autotuning format combination: Half(64,320,1:8,2880), Float(1,5,45,92160) -> Float(1,5,45,92160) *************** [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: Conv_158 + Add_160 + Relu_161 (CaskConvolution) [08/05/2021-07:26:47] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: Conv_158 + Add_160 + Relu_161 (CudaConvolution) [08/05/2021-07:26:47] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:47] [V] [TRT] *************** Autotuning format combination: Half(64,320,1:8,2880), Half(256,1280,1:8,11520) -> Half(256,1280,1:8,11520) *************** [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: Conv_158 + Add_160 + Relu_161 (CaskConvolution) [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 1179757074518529353 time 0.021312 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 2105695814191699972 time 0.029632 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 2148106709480872763 time 0.022528 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 2410442691266548717 time 0.027456 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 3041642431972138763 time 0.018432 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 3754069740140581927 time 0.031264 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 4555462412611657028 time 0.022528 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 5666160310350604399 time 0.03056 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 5925270497649423688 time 0.041824 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 6680916730816870145 time 0.028672 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 7158029511300006471 time 0.026624 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 7859952145590271433 time 0.028672 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: 8283847742354150423 time 0.028448 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -8992262742606384444 time 0.021248 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -8391760416076885205 time 0.042528 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -6273232454637933930 time 0.021056 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -5818527483287834165 time 0.02048 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -4534876761957424274 time 0.041792 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -3237051169894153788 time 0.026624 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -3136088851200285532 time 0.019584 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -2586046817576862066 time 0.026592 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -2422160065350346448 time 0.028512 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -1216445540764179377 time 0.025408 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] Tactic: -229563042944049199 time 0.019264 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: 3041642431972138763 Time: 0.018432 [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: Conv_158 + Add_160 + Relu_161 (CudaConvolution) [08/05/2021-07:26:47] [V] [TRT] Tactic: 0 time 0.13472 [08/05/2021-07:26:47] [V] [TRT] Tactic: 1 time 0.174944 [08/05/2021-07:26:47] [V] [TRT] Tactic: 2 time 0.157216 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: 0 Time: 0.13472 [08/05/2021-07:26:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3041642431972138763 [08/05/2021-07:26:47] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:47] [V] [TRT] [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:47] [V] [TRT] Tactic: 0 time 0.014016 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: 0 Time: 0.014016 [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:47] [V] [TRT] Tactic: 0 time 0.011808 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: 0 Time: 0.011808 [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:47] [V] [TRT] Tactic: 0 time 0.01216 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: 0 Time: 0.01216 [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:47] [V] [TRT] Tactic: 0 time 0.012288 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:47] [V] [TRT] Tactic: 0 time 0.010816 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: 0 Time: 0.010816 [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:47] [V] [TRT] Tactic: 0 time 0.0104 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: 0 Time: 0.0104 [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:47] [V] [TRT] Tactic: 0 time 0.01024 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:47] [V] [TRT] Tactic: 0 time 0.01072 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: 0 Time: 0.01072 [08/05/2021-07:26:47] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:47] [V] [TRT] Tactic: 0 time 0.008192 [08/05/2021-07:26:47] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:48] [V] [TRT] Tactic: 0 time 0.01024 [08/05/2021-07:26:48] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:48] [V] [TRT] Tactic: 0 time 0.010016 [08/05/2021-07:26:48] [V] [TRT] Fastest Tactic: 0 Time: 0.010016 [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:48] [V] [TRT] Tactic: 0 time 0.008192 [08/05/2021-07:26:48] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:48] [V] [TRT] Tactic: 0 time 0.01392 [08/05/2021-07:26:48] [V] [TRT] Fastest Tactic: 0 Time: 0.01392 [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:48] [V] [TRT] Tactic: 0 time 0.01168 [08/05/2021-07:26:48] [V] [TRT] Fastest Tactic: 0 Time: 0.01168 [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:48] [V] [TRT] Tactic: 0 time 0.012032 [08/05/2021-07:26:48] [V] [TRT] Fastest Tactic: 0 Time: 0.012032 [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:48] [V] [TRT] Tactic: 0 time 0.012384 [08/05/2021-07:26:48] [V] [TRT] Fastest Tactic: 0 Time: 0.012384 [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:48] [V] [TRT] Tactic: 0 time 0.010368 [08/05/2021-07:26:48] [V] [TRT] Fastest Tactic: 0 Time: 0.010368 [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:48] [V] [TRT] Tactic: 0 time 0.011136 [08/05/2021-07:26:48] [V] [TRT] Fastest Tactic: 0 Time: 0.011136 [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:48] [V] [TRT] Tactic: 0 time 0.010624 [08/05/2021-07:26:48] [V] [TRT] Fastest Tactic: 0 Time: 0.010624 [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:48] [V] [TRT] Tactic: 0 time 0.01024 [08/05/2021-07:26:48] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:48] [V] [TRT] Tactic: 0 time 0.008192 [08/05/2021-07:26:48] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:48] [V] [TRT] Tactic: 0 time 0.010368 [08/05/2021-07:26:48] [V] [TRT] Fastest Tactic: 0 Time: 0.010368 [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:48] [V] [TRT] Tactic: 0 time 0.009152 [08/05/2021-07:26:48] [V] [TRT] Fastest Tactic: 0 Time: 0.009152 [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:48] [V] [TRT] Tactic: 0 time 0.008896 [08/05/2021-07:26:48] [V] [TRT] Fastest Tactic: 0 Time: 0.008896 [08/05/2021-07:26:48] [V] [TRT] *************** Autotuning format combination: Float(1,5,45,92160) -> Float(1,5,45,23040) *************** [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (LegacySASSConvolution) [08/05/2021-07:26:48] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (FusedConvActConvolution) [08/05/2021-07:26:48] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (CaskConvolution) [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 1754569683116234317 time 0.273184 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 1825138533642645384 time 0.27648 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 2733356012094739613 time 0.301056 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 3915320020053085238 time 0.273568 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 6808617066150061604 time 0.169504 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 9091006216302412844 time 0.16368 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: -8060443123034038864 time 0.181024 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: -4420849921117327522 time 0.237472 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: -3946921629105938337 time 0.271328 [08/05/2021-07:26:48] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.16368 [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (CudaConvolution) [08/05/2021-07:26:48] [V] [TRT] Tactic: 0 time 0.161792 [08/05/2021-07:26:48] [V] [TRT] Tactic: 1 time 0.170816 [08/05/2021-07:26:48] [V] [TRT] Tactic: 2 time 0.235232 [08/05/2021-07:26:48] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2561671168, available: 2097152000 [08/05/2021-07:26:48] [V] [TRT] Tactic: 5 time 2.17306 [08/05/2021-07:26:48] [V] [TRT] Fastest Tactic: 0 Time: 0.161792 [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (CudaDepthwiseConvolution) [08/05/2021-07:26:48] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0 [08/05/2021-07:26:48] [V] [TRT] [08/05/2021-07:26:48] [V] [TRT] *************** Autotuning format combination: Half(1,5,45,92160) -> Half(1,5,45,23040) *************** [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (FusedConvActConvolution) [08/05/2021-07:26:48] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (CaskConvolution) [08/05/2021-07:26:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (CudaConvolution) [08/05/2021-07:26:48] [V] [TRT] Tactic: 0 time 0.350656 [08/05/2021-07:26:48] [V] [TRT] Tactic: 1 time 0.176128 [08/05/2021-07:26:48] [V] [TRT] Tactic: 2 time 0.462848 [08/05/2021-07:26:48] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2561671168, available: 2097152000 [08/05/2021-07:26:48] [V] [TRT] Tactic: 5 time 2.22874 [08/05/2021-07:26:48] [V] [TRT] Fastest Tactic: 1 Time: 0.176128 [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (CudaDepthwiseConvolution) [08/05/2021-07:26:48] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [08/05/2021-07:26:48] [V] [TRT] [08/05/2021-07:26:48] [V] [TRT] *************** Autotuning format combination: Half(1,5,45:2,46080) -> Half(1,5,45:2,11520) *************** [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (LegacySASSConvolution) [08/05/2021-07:26:48] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (FusedConvActConvolution) [08/05/2021-07:26:48] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (CaskConvolution) [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 1651411198763708804 time 0.098848 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 2418518597804310654 time 0.099104 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 4318470497547290900 time 0.093536 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 4930470141256631146 time 0.116608 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 8292881859266835088 time 0.10528 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 8401509141903434922 time 0.084832 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: -8654297089785671176 time 0.141088 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: -7516584506774355935 time 0.082976 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: -7140760933967189247 time 0.081216 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: -6004726995029373073 time 0.09504 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: -5719726816705110014 time 0.14096 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: -4097850214384059472 time 0.08192 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: -3717489476759089008 time 0.081408 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: -3689982367035295496 time 0.141312 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: -2640575123064142123 time 0.140032 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: -2534402059426524406 time 0.140096 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: -2027588946874785071 time 0.091712 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: -1968398013367819764 time 0.141312 [08/05/2021-07:26:48] [V] [TRT] Fastest Tactic: -7140760933967189247 Time: 0.081216 [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (CudaConvolution) [08/05/2021-07:26:48] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (CudaDepthwiseConvolution) [08/05/2021-07:26:48] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7140760933967189247 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:48] [V] [TRT] [08/05/2021-07:26:48] [V] [TRT] *************** Autotuning format combination: Half(256,1280,1:8,11520) -> Float(1,5,45,23040) *************** [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (FusedConvActConvolution) [08/05/2021-07:26:48] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (CaskConvolution) [08/05/2021-07:26:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (CudaConvolution) [08/05/2021-07:26:48] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (CudaDepthwiseConvolution) [08/05/2021-07:26:48] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:48] [V] [TRT] *************** Autotuning format combination: Half(256,1280,1:8,11520) -> Half(64,320,1:8,2880) *************** [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (FusedConvActConvolution) [08/05/2021-07:26:48] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:48] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (CaskConvolution) [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 1179757074518529353 time 0.044928 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 2105695814191699972 time 0.083968 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 2148106709480872763 time 0.0584 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 2410442691266548717 time 0.07696 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 3041642431972138763 time 0.043776 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 3754069740140581927 time 0.090112 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 4555462412611657028 time 0.0592 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 5666160310350604399 time 0.07872 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 5925270497649423688 time 0.139328 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 6680916730816870145 time 0.076032 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 7158029511300006471 time 0.074528 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 7859952145590271433 time 0.074912 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: 8283847742354150423 time 0.079872 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: -8992262742606384444 time 0.049664 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:48] [V] [TRT] Tactic: -8391760416076885205 time 0.137984 [08/05/2021-07:26:48] [V] [TRT] Conv_162 + Relu_164 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -6273232454637933930 time 0.044832 [08/05/2021-07:26:49] [V] [TRT] Conv_162 + Relu_164 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -5818527483287834165 time 0.043648 [08/05/2021-07:26:49] [V] [TRT] Conv_162 + Relu_164 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -4534876761957424274 time 0.138784 [08/05/2021-07:26:49] [V] [TRT] Conv_162 + Relu_164 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -3237051169894153788 time 0.07248 [08/05/2021-07:26:49] [V] [TRT] Conv_162 + Relu_164 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -3136088851200285532 time 0.042752 [08/05/2021-07:26:49] [V] [TRT] Conv_162 + Relu_164 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -2586046817576862066 time 0.076 [08/05/2021-07:26:49] [V] [TRT] Conv_162 + Relu_164 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -2422160065350346448 time 0.075168 [08/05/2021-07:26:49] [V] [TRT] Conv_162 + Relu_164 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -1216445540764179377 time 0.07456 [08/05/2021-07:26:49] [V] [TRT] Conv_162 + Relu_164 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -229563042944049199 time 0.045056 [08/05/2021-07:26:49] [V] [TRT] Fastest Tactic: -3136088851200285532 Time: 0.042752 [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (CudaConvolution) [08/05/2021-07:26:49] [V] [TRT] Tactic: 0 time 0.35088 [08/05/2021-07:26:49] [V] [TRT] Tactic: 1 time 0.425984 [08/05/2021-07:26:49] [V] [TRT] Tactic: 2 time 0.387072 [08/05/2021-07:26:49] [V] [TRT] Fastest Tactic: 0 Time: 0.35088 [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_162 + Relu_164 (CudaDepthwiseConvolution) [08/05/2021-07:26:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3136088851200285532 [08/05/2021-07:26:49] [V] [TRT] Conv_162 + Relu_164 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:49] [V] [TRT] [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:49] [V] [TRT] Tactic: 0 time 0.006144 [08/05/2021-07:26:49] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:49] [V] [TRT] Tactic: 0 time 0.005536 [08/05/2021-07:26:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005536 [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:49] [V] [TRT] Tactic: 0 time 0.006144 [08/05/2021-07:26:49] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:49] [V] [TRT] Tactic: 0 time 0.004704 [08/05/2021-07:26:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004704 [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:49] [V] [TRT] Tactic: 0 time 0.00416 [08/05/2021-07:26:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00416 [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:49] [V] [TRT] Tactic: 0 time 0.006368 [08/05/2021-07:26:49] [V] [TRT] Fastest Tactic: 0 Time: 0.006368 [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:49] [V] [TRT] Tactic: 0 time 0.004672 [08/05/2021-07:26:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004672 [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:49] [V] [TRT] Tactic: 0 time 0.005568 [08/05/2021-07:26:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005568 [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:49] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:26:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:49] [V] [TRT] Tactic: 0 time 0.004832 [08/05/2021-07:26:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004832 [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:49] [V] [TRT] Tactic: 0 time 0.005056 [08/05/2021-07:26:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005056 [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:49] [V] [TRT] Tactic: 0 time 0.004768 [08/05/2021-07:26:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004768 [08/05/2021-07:26:49] [V] [TRT] *************** Autotuning format combination: Float(1,5,45,23040) -> Float(1,5,45,23040) *************** [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (LegacySASSConvolution) [08/05/2021-07:26:49] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (FusedConvActConvolution) [08/05/2021-07:26:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (CaskConvolution) [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: 1825138533642645384 time 0.661504 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: 2775507031594384867 time 0.49296 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: 2842488832350522458 time 0.476992 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: 3915320020053085238 time 0.607072 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: 6448355332020552203 time 0.669696 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: 6808617066150061604 time 0.371264 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -8060443123034038864 time 0.475136 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -4420849921117327522 time 0.510272 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -3946921629105938337 time 0.510144 [08/05/2021-07:26:49] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.371264 [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (CudaConvolution) [08/05/2021-07:26:49] [V] [TRT] Tactic: 0 time 0.358624 [08/05/2021-07:26:49] [V] [TRT] Tactic: 1 time 0.377664 [08/05/2021-07:26:49] [V] [TRT] Tactic: 2 time 0.332384 [08/05/2021-07:26:49] [V] [TRT] Tactic: 4 time 2.59072 [08/05/2021-07:26:49] [V] [TRT] Tactic: 5 time 8.04826 [08/05/2021-07:26:49] [V] [TRT] Tactic: 6 time 0.577504 [08/05/2021-07:26:49] [V] [TRT] Fastest Tactic: 2 Time: 0.332384 [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (CudaDepthwiseConvolution) [08/05/2021-07:26:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2 [08/05/2021-07:26:49] [V] [TRT] [08/05/2021-07:26:49] [V] [TRT] *************** Autotuning format combination: Half(1,5,45,23040) -> Half(1,5,45,23040) *************** [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (FusedConvActConvolution) [08/05/2021-07:26:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (CaskConvolution) [08/05/2021-07:26:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (CudaConvolution) [08/05/2021-07:26:49] [V] [TRT] Tactic: 0 time 0.767488 [08/05/2021-07:26:49] [V] [TRT] Tactic: 1 time 0.387072 [08/05/2021-07:26:49] [V] [TRT] Tactic: 2 time 0.792576 [08/05/2021-07:26:49] [V] [TRT] Tactic: 4 time 2.58662 [08/05/2021-07:26:49] [V] [TRT] Tactic: 5 time 7.86464 [08/05/2021-07:26:49] [V] [TRT] Tactic: 6 time 0.74736 [08/05/2021-07:26:49] [V] [TRT] Fastest Tactic: 1 Time: 0.387072 [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (CudaDepthwiseConvolution) [08/05/2021-07:26:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [08/05/2021-07:26:49] [V] [TRT] [08/05/2021-07:26:49] [V] [TRT] *************** Autotuning format combination: Half(1,5,45:2,11520) -> Half(1,5,45:2,11520) *************** [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (LegacySASSConvolution) [08/05/2021-07:26:49] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (FusedConvActConvolution) [08/05/2021-07:26:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (CaskConvolution) [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: 1145226902788474763 time 0.252672 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: 1651411198763708804 time 0.245056 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: 2418518597804310654 time 0.243232 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: 4318470497547290900 time 0.188416 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: 4653005425971292725 time 0.249632 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: 4930470141256631146 time 0.28592 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: 8292881859266835088 time 0.293696 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: 8401509141903434922 time 0.189056 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -8654297089785671176 time 0.311744 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -7448936905981214224 time 0.314208 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -6004726995029373073 time 0.211552 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -5719726816705110014 time 0.309696 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -3754890472406891741 time 0.346112 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -3689982367035295496 time 0.335872 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -3140347171730126532 time 0.248896 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -2894005464278291378 time 0.29152 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -2027588946874785071 time 0.204192 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -1968398013367819764 time 0.336736 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [08/05/2021-07:26:49] [V] [TRT] Tactic: -245090590808296743 time 0.344832 [08/05/2021-07:26:49] [V] [TRT] Fastest Tactic: 4318470497547290900 Time: 0.188416 [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (CudaConvolution) [08/05/2021-07:26:49] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (CudaDepthwiseConvolution) [08/05/2021-07:26:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4318470497547290900 [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:49] [V] [TRT] [08/05/2021-07:26:49] [V] [TRT] *************** Autotuning format combination: Half(64,320,1:8,2880) -> Float(1,5,45,23040) *************** [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (FusedConvActConvolution) [08/05/2021-07:26:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (CaskConvolution) [08/05/2021-07:26:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (CudaConvolution) [08/05/2021-07:26:49] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (CudaDepthwiseConvolution) [08/05/2021-07:26:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:49] [V] [TRT] *************** Autotuning format combination: Half(64,320,1:8,2880) -> Half(64,320,1:8,2880) *************** [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (FusedConvActConvolution) [08/05/2021-07:26:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:49] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (CaskConvolution) [08/05/2021-07:26:49] [V] [TRT] Conv_165 + Relu_167 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:50] [V] [TRT] Tactic: 2148106709480872763 time 0.11408 [08/05/2021-07:26:50] [V] [TRT] Conv_165 + Relu_167 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:50] [V] [TRT] Tactic: 2410442691266548717 time 0.16256 [08/05/2021-07:26:50] [V] [TRT] Conv_165 + Relu_167 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:50] [V] [TRT] Tactic: 3754069740140581927 time 0.172032 [08/05/2021-07:26:50] [V] [TRT] Conv_165 + Relu_167 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:50] [V] [TRT] Tactic: 3823144360994712832 time 0.092992 [08/05/2021-07:26:50] [V] [TRT] Conv_165 + Relu_167 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:50] [V] [TRT] Tactic: 5635311898703673455 time 0.09808 [08/05/2021-07:26:50] [V] [TRT] Conv_165 + Relu_167 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:50] [V] [TRT] Tactic: 5925270497649423688 time 0.307072 [08/05/2021-07:26:50] [V] [TRT] Conv_165 + Relu_167 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:50] [V] [TRT] Tactic: 6680916730816870145 time 0.164128 [08/05/2021-07:26:50] [V] [TRT] Conv_165 + Relu_167 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:50] [V] [TRT] Tactic: 7158029511300006471 time 0.162336 [08/05/2021-07:26:50] [V] [TRT] Conv_165 + Relu_167 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:50] [V] [TRT] Tactic: 7859952145590271433 time 0.161792 [08/05/2021-07:26:50] [V] [TRT] Conv_165 + Relu_167 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:50] [V] [TRT] Tactic: 8283847742354150423 time 0.174816 [08/05/2021-07:26:50] [V] [TRT] Conv_165 + Relu_167 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:50] [V] [TRT] Tactic: -8992262742606384444 time 0.120384 [08/05/2021-07:26:50] [V] [TRT] Conv_165 + Relu_167 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:50] [V] [TRT] Tactic: -8682550625095202832 time 0.119936 [08/05/2021-07:26:50] [V] [TRT] Conv_165 + Relu_167 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:50] [V] [TRT] Tactic: -6273232454637933930 time 0.092928 [08/05/2021-07:26:50] [V] [TRT] Conv_165 + Relu_167 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:50] [V] [TRT] Tactic: -5818527483287834165 time 0.090112 [08/05/2021-07:26:50] [V] [TRT] Conv_165 + Relu_167 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [08/05/2021-07:26:50] [V] [TRT] Tactic: -4954692664176521434 time 0.165888 [08/05/2021-07:26:50] [V] [TRT] Conv_165 + Relu_167 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:50] [V] [TRT] Tactic: -4534876761957424274 time 0.305152 [08/05/2021-07:26:50] [V] [TRT] Conv_165 + Relu_167 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:50] [V] [TRT] Tactic: -3237051169894153788 time 0.158528 [08/05/2021-07:26:50] [V] [TRT] Conv_165 + Relu_167 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:50] [V] [TRT] Tactic: -3136088851200285532 time 0.088256 [08/05/2021-07:26:50] [V] [TRT] Conv_165 + Relu_167 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:50] [V] [TRT] Tactic: -2586046817576862066 time 0.165952 [08/05/2021-07:26:50] [V] [TRT] Conv_165 + Relu_167 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:50] [V] [TRT] Tactic: -229563042944049199 time 0.097184 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: -3136088851200285532 Time: 0.088256 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (CudaConvolution) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.776064 [08/05/2021-07:26:50] [V] [TRT] Tactic: 1 time 0.845824 [08/05/2021-07:26:50] [V] [TRT] Tactic: 2 time 0.815904 [08/05/2021-07:26:50] [V] [TRT] Tactic: 6 time 0.874272 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.776064 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: Conv_165 + Relu_167 (CudaDepthwiseConvolution) [08/05/2021-07:26:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3136088851200285532 [08/05/2021-07:26:50] [V] [TRT] Conv_165 + Relu_167 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:50] [V] [TRT] [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.006016 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.006016 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.004896 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004896 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.006144 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.004928 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004928 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.004288 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004288 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.005984 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.005984 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.004576 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004576 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.004608 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004608 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.0048 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.0048 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.005536 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.005536 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.005312 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.005312 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.01344 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.01344 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.011808 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.011808 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.012288 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.012288 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.010528 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.010528 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.01136 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.01136 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.01024 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.010336 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.010336 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.008352 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.008352 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.010592 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.010592 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:50] [V] [TRT] Tactic: 0 time 0.009632 [08/05/2021-07:26:50] [V] [TRT] Fastest Tactic: 0 Time: 0.009632 [08/05/2021-07:26:50] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:51] [V] [TRT] Tactic: 0 time 0.008928 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: 0 Time: 0.008928 [08/05/2021-07:26:51] [V] [TRT] *************** Autotuning format combination: Float(1,5,45,23040), Float(1,5,45,92160) -> Float(1,5,45,92160) *************** [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: Conv_168 + Add_170 + Relu_171 (LegacySASSConvolution) [08/05/2021-07:26:51] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: Conv_168 + Add_170 + Relu_171 (CaskConvolution) [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 1754569683116234317 time 0.080736 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 1825138533642645384 time 0.080672 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 2733356012094739613 time 0.104448 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 3915320020053085238 time 0.079872 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 6808617066150061604 time 0.090816 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 9091006216302412844 time 0.082624 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -8060443123034038864 time 0.089696 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -4420849921117327522 time 0.111328 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -3946921629105938337 time 0.106688 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: 3915320020053085238 Time: 0.079872 [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: Conv_168 + Add_170 + Relu_171 (CudaConvolution) [08/05/2021-07:26:51] [V] [TRT] Tactic: 0 time 0.13824 [08/05/2021-07:26:51] [V] [TRT] Tactic: 1 time 0.102432 [08/05/2021-07:26:51] [V] [TRT] Tactic: 2 time 0.227584 [08/05/2021-07:26:51] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2455502848, available: 2097152000 [08/05/2021-07:26:51] [V] [TRT] Tactic: 5 time 2.00099 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: 1 Time: 0.102432 [08/05/2021-07:26:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3915320020053085238 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [08/05/2021-07:26:51] [V] [TRT] [08/05/2021-07:26:51] [V] [TRT] *************** Autotuning format combination: Half(1,5,45,23040), Half(1,5,45,92160) -> Half(1,5,45,92160) *************** [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: Conv_168 + Add_170 + Relu_171 (CaskConvolution) [08/05/2021-07:26:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: Conv_168 + Add_170 + Relu_171 (CudaConvolution) [08/05/2021-07:26:51] [V] [TRT] Tactic: 0 time 0.123968 [08/05/2021-07:26:51] [V] [TRT] Tactic: 1 time 0.1024 [08/05/2021-07:26:51] [V] [TRT] Tactic: 2 time 0.224768 [08/05/2021-07:26:51] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2455502848, available: 2097152000 [08/05/2021-07:26:51] [V] [TRT] Tactic: 5 time 1.95235 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: 1 Time: 0.1024 [08/05/2021-07:26:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [08/05/2021-07:26:51] [V] [TRT] [08/05/2021-07:26:51] [V] [TRT] *************** Autotuning format combination: Half(1,5,45:2,11520), Half(1,5,45:2,46080) -> Half(1,5,45:2,46080) *************** [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: Conv_168 + Add_170 + Relu_171 (LegacySASSConvolution) [08/05/2021-07:26:51] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: Conv_168 + Add_170 + Relu_171 (CaskConvolution) [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 1651411198763708804 time 0.045952 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 2418518597804310654 time 0.045888 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 4318470497547290900 time 0.045056 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 4930470141256631146 time 0.066368 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 8292881859266835088 time 0.066016 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 8401509141903434922 time 0.043296 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -8654297089785671176 time 0.042112 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -7516584506774355935 time 0.046848 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -7140760933967189247 time 0.04384 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -6004726995029373073 time 0.063488 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -5719726816705110014 time 0.042432 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -4097850214384059472 time 0.046816 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -3717489476759089008 time 0.044352 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -3689982367035295496 time 0.041888 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -2640575123064142123 time 0.041696 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -2534402059426524406 time 0.041792 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -2027588946874785071 time 0.064352 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -1968398013367819764 time 0.042496 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: -2640575123064142123 Time: 0.041696 [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: Conv_168 + Add_170 + Relu_171 (CudaConvolution) [08/05/2021-07:26:51] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2640575123064142123 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [08/05/2021-07:26:51] [V] [TRT] [08/05/2021-07:26:51] [V] [TRT] *************** Autotuning format combination: Half(64,320,1:8,2880), Float(1,5,45,92160) -> Float(1,5,45,92160) *************** [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: Conv_168 + Add_170 + Relu_171 (CaskConvolution) [08/05/2021-07:26:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: Conv_168 + Add_170 + Relu_171 (CudaConvolution) [08/05/2021-07:26:51] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [08/05/2021-07:26:51] [V] [TRT] *************** Autotuning format combination: Half(64,320,1:8,2880), Half(256,1280,1:8,11520) -> Half(256,1280,1:8,11520) *************** [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: Conv_168 + Add_170 + Relu_171 (CaskConvolution) [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 1179757074518529353 time 0.02128 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 2105695814191699972 time 0.03056 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 2148106709480872763 time 0.022528 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 2410442691266548717 time 0.027296 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 3041642431972138763 time 0.018496 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 3754069740140581927 time 0.030976 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 4555462412611657028 time 0.022656 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 5666160310350604399 time 0.031456 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 5925270497649423688 time 0.041728 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 6680916730816870145 time 0.028448 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 7158029511300006471 time 0.026624 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 7859952145590271433 time 0.027456 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: 8283847742354150423 time 0.02864 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -8992262742606384444 time 0.021312 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -8391760416076885205 time 0.041504 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -6273232454637933930 time 0.021696 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -5818527483287834165 time 0.02048 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -4534876761957424274 time 0.0416 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -3237051169894153788 time 0.026624 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -3136088851200285532 time 0.018432 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -2586046817576862066 time 0.026624 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -2422160065350346448 time 0.028576 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -1216445540764179377 time 0.025408 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] Tactic: -229563042944049199 time 0.02 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: -3136088851200285532 Time: 0.018432 [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: Conv_168 + Add_170 + Relu_171 (CudaConvolution) [08/05/2021-07:26:51] [V] [TRT] Tactic: 0 time 0.134176 [08/05/2021-07:26:51] [V] [TRT] Tactic: 1 time 0.174464 [08/05/2021-07:26:51] [V] [TRT] Tactic: 2 time 0.156128 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: 0 Time: 0.134176 [08/05/2021-07:26:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3136088851200285532 [08/05/2021-07:26:51] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:26:51] [V] [TRT] [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:51] [V] [TRT] Tactic: 0 time 0.013376 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: 0 Time: 0.013376 [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:51] [V] [TRT] Tactic: 0 time 0.011584 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: 0 Time: 0.011584 [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:51] [V] [TRT] Tactic: 0 time 0.012256 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: 0 Time: 0.012256 [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:51] [V] [TRT] Tactic: 0 time 0.012288 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:51] [V] [TRT] Tactic: 0 time 0.011392 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: 0 Time: 0.011392 [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:51] [V] [TRT] Tactic: 0 time 0.0112 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: 0 Time: 0.0112 [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:51] [V] [TRT] Tactic: 0 time 0.01024 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:51] [V] [TRT] Tactic: 0 time 0.01024 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:51] [V] [TRT] Tactic: 0 time 0.008576 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: 0 Time: 0.008576 [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:51] [V] [TRT] Tactic: 0 time 0.01024 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:51] [V] [TRT] Tactic: 0 time 0.009056 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: 0 Time: 0.009056 [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:51] [V] [TRT] Tactic: 0 time 0.008192 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [08/05/2021-07:26:51] [V] [TRT] *************** Autotuning format combination: Float(1,5,45,92160) -> Float(1,1,1,2048) *************** [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_172 (Pooling) [08/05/2021-07:26:51] [V] [TRT] Tactic: -1 time 0.012 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: -1 Time: 0.012 [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_172 (TiledPooling) [08/05/2021-07:26:51] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [08/05/2021-07:26:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -1 [08/05/2021-07:26:51] [V] [TRT] [08/05/2021-07:26:51] [V] [TRT] *************** Autotuning format combination: Half(1,5,45,92160) -> Half(1,1,1,2048) *************** [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_172 (Pooling) [08/05/2021-07:26:51] [V] [TRT] Tactic: -1 time 0.009024 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: -1 Time: 0.009024 [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_172 (TiledPooling) [08/05/2021-07:26:51] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [08/05/2021-07:26:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -1 [08/05/2021-07:26:51] [V] [TRT] [08/05/2021-07:26:51] [V] [TRT] *************** Autotuning format combination: Half(1,5,45:2,46080) -> Half(1,1,1:2,1024) *************** [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_172 (Pooling) [08/05/2021-07:26:51] [V] [TRT] Tactic: -3 time 0.011392 [08/05/2021-07:26:51] [V] [TRT] Fastest Tactic: -3 Time: 0.011392 [08/05/2021-07:26:51] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_172 (TiledPooling) [08/05/2021-07:26:51] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [08/05/2021-07:26:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -3 [08/05/2021-07:26:51] [V] [TRT] [08/05/2021-07:26:51] [V] [TRT] *************** Autotuning format combination: Half(256,1280,1:8,11520) -> Half(256,256,1:8,256) *************** [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_172 (Pooling) [08/05/2021-07:26:52] [V] [TRT] Tactic: -2 time 0.013024 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: -2 Time: 0.013024 [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_172 (TiledPooling) [08/05/2021-07:26:52] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [08/05/2021-07:26:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -2 [08/05/2021-07:26:52] [V] [TRT] [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.003456 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.003328 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 0 Time: 0.003328 [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.00624 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 0 Time: 0.00624 [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.006528 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 0 Time: 0.006528 [08/05/2021-07:26:52] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,2048) -> Float(1,2048) *************** [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 185) [Shuffle] + Reshape_179 (Shuffle) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.002848 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 0 Time: 0.002848 [08/05/2021-07:26:52] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,2048) -> Half(1,2048) *************** [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 185) [Shuffle] + Reshape_179 (Shuffle) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.002688 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.002976 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 0 Time: 0.002976 [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:26:52] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:26:52] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.02528 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 0 Time: 0.02528 [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.023904 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 0 Time: 0.023904 [08/05/2021-07:26:52] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 195) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.023264 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 0 Time: 0.023264 [08/05/2021-07:26:52] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 195) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.021216 [08/05/2021-07:26:52] [V] [TRT] Tactic: 1 time 0.014336 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 1 Time: 0.014336 [08/05/2021-07:26:52] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:26:52] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.00288 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 0 Time: 0.00288 [08/05/2021-07:26:52] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 198) [ElementWise] (ElementWise) [08/05/2021-07:26:52] [V] [TRT] Tactic: 1 time 0.004096 [08/05/2021-07:26:52] [V] [TRT] Tactic: 2 time 0.008192 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 1 Time: 0.004096 [08/05/2021-07:26:52] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 198) [ElementWise] (ElementWise) [08/05/2021-07:26:52] [V] [TRT] Tactic: 1 time 0.002784 [08/05/2021-07:26:52] [V] [TRT] Tactic: 2 time 0.00608 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 1 Time: 0.002784 [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:26:52] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:52] [V] [TRT] Tactic: 0 time 0.003456 [08/05/2021-07:26:52] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [08/05/2021-07:26:52] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: BatchNormalization_181 (Shuffle) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.00336 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.00336 [08/05/2021-07:26:53] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: BatchNormalization_181 (Shuffle) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.003904 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.003904 [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.003744 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.003744 [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.004704 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.004704 [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.003616 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.003616 [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.005632 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.005632 [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.002976 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.002976 [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.00288 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.00288 [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.00448 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.00448 [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:26:53] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 200) [Scale] (Scale) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.002848 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.002848 [08/05/2021-07:26:53] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 200) [Scale] (Scale) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:26:53] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 200) [Scale] (Scale) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.00384 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.00384 [08/05/2021-07:26:53] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 200) [Scale] (Scale) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.003936 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.003936 [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.003872 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.003872 [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.002912 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.002912 [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.002848 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.002848 [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:26:53] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 201) [Shuffle] (Shuffle) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.003456 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [08/05/2021-07:26:53] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 201) [Shuffle] (Shuffle) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.002848 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.002848 [08/05/2021-07:26:53] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:53] [V] [TRT] Tactic: 0 time 0.004 [08/05/2021-07:26:53] [V] [TRT] Fastest Tactic: 0 Time: 0.004 [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:54] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:26:54] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: LeakyRelu_182 (PointWise) [08/05/2021-07:26:54] [V] [TRT] Tactic: 128 time 0.004544 [08/05/2021-07:26:54] [V] [TRT] Tactic: 256 time 0.00368 [08/05/2021-07:26:54] [V] [TRT] Tactic: 512 time 0.003392 [08/05/2021-07:26:54] [V] [TRT] Tactic: -32 time 0.013376 [08/05/2021-07:26:54] [V] [TRT] Tactic: -64 time 0.008192 [08/05/2021-07:26:54] [V] [TRT] Tactic: -128 time 0.00608 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 512 Time: 0.003392 [08/05/2021-07:26:54] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: LeakyRelu_182 (PointWise) [08/05/2021-07:26:54] [V] [TRT] Tactic: 128 time 0.005472 [08/05/2021-07:26:54] [V] [TRT] Tactic: 256 time 0.005664 [08/05/2021-07:26:54] [V] [TRT] Tactic: 512 time 0.005408 [08/05/2021-07:26:54] [V] [TRT] Tactic: -32 time 0.012288 [08/05/2021-07:26:54] [V] [TRT] Tactic: -64 time 0.007872 [08/05/2021-07:26:54] [V] [TRT] Tactic: -128 time 0.006144 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 512 Time: 0.005408 [08/05/2021-07:26:54] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:26:54] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:54] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:54] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:54] [V] [TRT] Tactic: 0 time 0.00352 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 0 Time: 0.00352 [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:54] [V] [TRT] Tactic: 0 time 0.002592 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 0 Time: 0.002592 [08/05/2021-07:26:54] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 205) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:26:54] [V] [TRT] Tactic: 0 time 0.004416 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 0 Time: 0.004416 [08/05/2021-07:26:54] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 205) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:26:54] [V] [TRT] Tactic: 0 time 0.014336 [08/05/2021-07:26:54] [V] [TRT] Tactic: 1 time 0.01456 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:54] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:54] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:26:54] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 206) [Constant] + (Unnamed Layer* 207) [Shuffle], (Unnamed Layer* 208) [ElementWise]), Sigmoid_184) (PointWise) [08/05/2021-07:26:54] [V] [TRT] Tactic: 128 time 0.002784 [08/05/2021-07:26:54] [V] [TRT] Tactic: 256 time 0.003712 [08/05/2021-07:26:54] [V] [TRT] Tactic: 512 time 0.002816 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 128 Time: 0.002784 [08/05/2021-07:26:54] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 206) [Constant] + (Unnamed Layer* 207) [Shuffle], (Unnamed Layer* 208) [ElementWise]), Sigmoid_184) (PointWise) [08/05/2021-07:26:54] [V] [TRT] Tactic: 128 time 0.00384 [08/05/2021-07:26:54] [V] [TRT] Tactic: 256 time 0.004064 [08/05/2021-07:26:54] [V] [TRT] Tactic: 512 time 0.003008 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 512 Time: 0.003008 [08/05/2021-07:26:54] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:26:54] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:54] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:54] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:54] [V] [TRT] Tactic: 0 time 0.025952 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 0 Time: 0.025952 [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:54] [V] [TRT] Tactic: 0 time 0.024064 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 0 Time: 0.024064 [08/05/2021-07:26:54] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 212) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:26:54] [V] [TRT] Tactic: 0 time 0.02336 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 0 Time: 0.02336 [08/05/2021-07:26:54] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 212) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:26:54] [V] [TRT] Tactic: 0 time 0.02064 [08/05/2021-07:26:54] [V] [TRT] Tactic: 1 time 0.014304 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 1 Time: 0.014304 [08/05/2021-07:26:54] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:26:54] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:54] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:54] [V] [TRT] Tactic: 0 time 0.003616 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 0 Time: 0.003616 [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:54] [V] [TRT] Tactic: 0 time 0.002976 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 0 Time: 0.002976 [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:54] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:26:54] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 215) [ElementWise] (ElementWise) [08/05/2021-07:26:54] [V] [TRT] Tactic: 1 time 0.00304 [08/05/2021-07:26:54] [V] [TRT] Tactic: 2 time 0.008224 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 1 Time: 0.00304 [08/05/2021-07:26:54] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:26:54] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 215) [ElementWise] (ElementWise) [08/05/2021-07:26:54] [V] [TRT] Tactic: 1 time 0.003008 [08/05/2021-07:26:54] [V] [TRT] Tactic: 2 time 0.004096 [08/05/2021-07:26:54] [V] [TRT] Fastest Tactic: 1 Time: 0.003008 [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.003424 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.003424 [08/05/2021-07:26:55] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: BatchNormalization_186 (Shuffle) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:26:55] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: BatchNormalization_186 (Shuffle) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.00544 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.00544 [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.002944 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.002944 [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.004768 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.004768 [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.003232 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.003232 [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:26:55] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 217) [Scale] (Scale) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.003872 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.003872 [08/05/2021-07:26:55] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 217) [Scale] (Scale) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.00288 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.00288 [08/05/2021-07:26:55] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 217) [Scale] (Scale) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:26:55] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 217) [Scale] (Scale) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.003744 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.003744 [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.003744 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.003744 [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.003872 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.003872 [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:55] [V] [TRT] Tactic: 0 time 0.004544 [08/05/2021-07:26:55] [V] [TRT] Fastest Tactic: 0 Time: 0.004544 [08/05/2021-07:26:55] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:26:56] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 218) [Shuffle] (Shuffle) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:26:56] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 218) [Shuffle] (Shuffle) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.0032 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 0 Time: 0.0032 [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:26:56] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: LeakyRelu_187 (PointWise) [08/05/2021-07:26:56] [V] [TRT] Tactic: 128 time 0.003872 [08/05/2021-07:26:56] [V] [TRT] Tactic: 256 time 0.003616 [08/05/2021-07:26:56] [V] [TRT] Tactic: 512 time 0.002784 [08/05/2021-07:26:56] [V] [TRT] Tactic: -32 time 0.011296 [08/05/2021-07:26:56] [V] [TRT] Tactic: -64 time 0.007712 [08/05/2021-07:26:56] [V] [TRT] Tactic: -128 time 0.004672 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 512 Time: 0.002784 [08/05/2021-07:26:56] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: LeakyRelu_187 (PointWise) [08/05/2021-07:26:56] [V] [TRT] Tactic: 128 time 0.004896 [08/05/2021-07:26:56] [V] [TRT] Tactic: 256 time 0.004896 [08/05/2021-07:26:56] [V] [TRT] Tactic: 512 time 0.004864 [08/05/2021-07:26:56] [V] [TRT] Tactic: -32 time 0.012288 [08/05/2021-07:26:56] [V] [TRT] Tactic: -64 time 0.008064 [08/05/2021-07:26:56] [V] [TRT] Tactic: -128 time 0.0048 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: -128 Time: 0.0048 [08/05/2021-07:26:56] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:26:56] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.003552 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 0 Time: 0.003552 [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.003552 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 0 Time: 0.003552 [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.002912 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 0 Time: 0.002912 [08/05/2021-07:26:56] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 222) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.004864 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [08/05/2021-07:26:56] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 222) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.014336 [08/05/2021-07:26:56] [V] [TRT] Tactic: 1 time 0.014336 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.002688 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.003328 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 0 Time: 0.003328 [08/05/2021-07:26:56] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 223) [Constant] + (Unnamed Layer* 224) [Shuffle], (Unnamed Layer* 225) [ElementWise]), Sigmoid_189) (PointWise) [08/05/2021-07:26:56] [V] [TRT] Tactic: 128 time 0.003744 [08/05/2021-07:26:56] [V] [TRT] Tactic: 256 time 0.00304 [08/05/2021-07:26:56] [V] [TRT] Tactic: 512 time 0.003008 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 512 Time: 0.003008 [08/05/2021-07:26:56] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 223) [Constant] + (Unnamed Layer* 224) [Shuffle], (Unnamed Layer* 225) [ElementWise]), Sigmoid_189) (PointWise) [08/05/2021-07:26:56] [V] [TRT] Tactic: 128 time 0.003872 [08/05/2021-07:26:56] [V] [TRT] Tactic: 256 time 0.00384 [08/05/2021-07:26:56] [V] [TRT] Tactic: 512 time 0.002944 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 512 Time: 0.002944 [08/05/2021-07:26:56] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:26:56] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.026112 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 0 Time: 0.026112 [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.02384 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 0 Time: 0.02384 [08/05/2021-07:26:56] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 229) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.023904 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 0 Time: 0.023904 [08/05/2021-07:26:56] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 229) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.02048 [08/05/2021-07:26:56] [V] [TRT] Tactic: 1 time 0.01424 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 1 Time: 0.01424 [08/05/2021-07:26:56] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:26:56] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.003744 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 0 Time: 0.003744 [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:26:56] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:56] [V] [TRT] Tactic: 0 time 0.004 [08/05/2021-07:26:56] [V] [TRT] Fastest Tactic: 0 Time: 0.004 [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:26:57] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 232) [ElementWise] (ElementWise) [08/05/2021-07:26:57] [V] [TRT] Tactic: 1 time 0.003136 [08/05/2021-07:26:57] [V] [TRT] Tactic: 2 time 0.007936 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 1 Time: 0.003136 [08/05/2021-07:26:57] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 232) [ElementWise] (ElementWise) [08/05/2021-07:26:57] [V] [TRT] Tactic: 1 time 0.003968 [08/05/2021-07:26:57] [V] [TRT] Tactic: 2 time 0.004512 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 1 Time: 0.003968 [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.002688 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.003424 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003424 [08/05/2021-07:26:57] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: BatchNormalization_191 (Shuffle) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:26:57] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: BatchNormalization_191 (Shuffle) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.005024 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.005024 [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.003296 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003296 [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.004864 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.0048 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.0048 [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.00416 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00416 [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:26:57] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 234) [Scale] (Scale) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:26:57] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 234) [Scale] (Scale) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:26:57] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 234) [Scale] (Scale) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.003808 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003808 [08/05/2021-07:26:57] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 234) [Scale] (Scale) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.003904 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003904 [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.00352 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00352 [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:26:57] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:57] [V] [TRT] Tactic: 0 time 0.002528 [08/05/2021-07:26:57] [V] [TRT] Fastest Tactic: 0 Time: 0.002528 [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.00416 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 0 Time: 0.00416 [08/05/2021-07:26:58] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 235) [Shuffle] (Shuffle) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.003328 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 0 Time: 0.003328 [08/05/2021-07:26:58] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 235) [Shuffle] (Shuffle) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:26:58] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: LeakyRelu_192 (PointWise) [08/05/2021-07:26:58] [V] [TRT] Tactic: 128 time 0.003296 [08/05/2021-07:26:58] [V] [TRT] Tactic: 256 time 0.004096 [08/05/2021-07:26:58] [V] [TRT] Tactic: 512 time 0.003904 [08/05/2021-07:26:58] [V] [TRT] Tactic: -32 time 0.01312 [08/05/2021-07:26:58] [V] [TRT] Tactic: -64 time 0.008576 [08/05/2021-07:26:58] [V] [TRT] Tactic: -128 time 0.006272 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 128 Time: 0.003296 [08/05/2021-07:26:58] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: LeakyRelu_192 (PointWise) [08/05/2021-07:26:58] [V] [TRT] Tactic: 128 time 0.00464 [08/05/2021-07:26:58] [V] [TRT] Tactic: 256 time 0.005568 [08/05/2021-07:26:58] [V] [TRT] Tactic: 512 time 0.004576 [08/05/2021-07:26:58] [V] [TRT] Tactic: -32 time 0.011744 [08/05/2021-07:26:58] [V] [TRT] Tactic: -64 time 0.007776 [08/05/2021-07:26:58] [V] [TRT] Tactic: -128 time 0.004832 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 512 Time: 0.004576 [08/05/2021-07:26:58] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:26:58] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.002976 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 0 Time: 0.002976 [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:26:58] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 239) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.004736 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 0 Time: 0.004736 [08/05/2021-07:26:58] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 239) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.014336 [08/05/2021-07:26:58] [V] [TRT] Tactic: 1 time 0.014432 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.003808 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 0 Time: 0.003808 [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:26:58] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 240) [Constant] + (Unnamed Layer* 241) [Shuffle], (Unnamed Layer* 242) [ElementWise]), Sigmoid_194) (PointWise) [08/05/2021-07:26:58] [V] [TRT] Tactic: 128 time 0.003712 [08/05/2021-07:26:58] [V] [TRT] Tactic: 256 time 0.003296 [08/05/2021-07:26:58] [V] [TRT] Tactic: 512 time 0.003776 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 256 Time: 0.003296 [08/05/2021-07:26:58] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 240) [Constant] + (Unnamed Layer* 241) [Shuffle], (Unnamed Layer* 242) [ElementWise]), Sigmoid_194) (PointWise) [08/05/2021-07:26:58] [V] [TRT] Tactic: 128 time 0.002816 [08/05/2021-07:26:58] [V] [TRT] Tactic: 256 time 0.003936 [08/05/2021-07:26:58] [V] [TRT] Tactic: 512 time 0.002816 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 128 Time: 0.002816 [08/05/2021-07:26:58] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:26:58] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.004032 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 0 Time: 0.004032 [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.026176 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 0 Time: 0.026176 [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.024096 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 0 Time: 0.024096 [08/05/2021-07:26:58] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 246) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.023232 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 0 Time: 0.023232 [08/05/2021-07:26:58] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 246) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.020512 [08/05/2021-07:26:58] [V] [TRT] Tactic: 1 time 0.014272 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 1 Time: 0.014272 [08/05/2021-07:26:58] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:26:58] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:58] [V] [TRT] Tactic: 0 time 0.002848 [08/05/2021-07:26:58] [V] [TRT] Fastest Tactic: 0 Time: 0.002848 [08/05/2021-07:26:58] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.003136 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.003136 [08/05/2021-07:26:59] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 249) [ElementWise] (ElementWise) [08/05/2021-07:26:59] [V] [TRT] Tactic: 1 time 0.003648 [08/05/2021-07:26:59] [V] [TRT] Tactic: 2 time 0.008192 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 1 Time: 0.003648 [08/05/2021-07:26:59] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 249) [ElementWise] (ElementWise) [08/05/2021-07:26:59] [V] [TRT] Tactic: 1 time 0.002976 [08/05/2021-07:26:59] [V] [TRT] Tactic: 2 time 0.006144 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 1 Time: 0.002976 [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.00384 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.00384 [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:26:59] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: BatchNormalization_196 (Shuffle) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.00256 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.00256 [08/05/2021-07:26:59] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: BatchNormalization_196 (Shuffle) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.002208 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.002208 [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.003328 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.003328 [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.004704 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.004704 [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.003584 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.003584 [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.002976 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.002976 [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.004832 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.004832 [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:26:59] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 251) [Scale] (Scale) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:26:59] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 251) [Scale] (Scale) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.00288 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.00288 [08/05/2021-07:26:59] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 251) [Scale] (Scale) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.00336 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.00336 [08/05/2021-07:26:59] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 251) [Scale] (Scale) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.004064 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.004064 [08/05/2021-07:26:59] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:26:59] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:26:59] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.003424 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.003424 [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:00] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 252) [Shuffle] (Shuffle) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.002688 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [08/05/2021-07:27:00] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 252) [Shuffle] (Shuffle) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.002496 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.002496 [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.003904 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.003904 [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:00] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: LeakyRelu_197 (PointWise) [08/05/2021-07:27:00] [V] [TRT] Tactic: 128 time 0.00368 [08/05/2021-07:27:00] [V] [TRT] Tactic: 256 time 0.00368 [08/05/2021-07:27:00] [V] [TRT] Tactic: 512 time 0.004 [08/05/2021-07:27:00] [V] [TRT] Tactic: -32 time 0.013536 [08/05/2021-07:27:00] [V] [TRT] Tactic: -64 time 0.008448 [08/05/2021-07:27:00] [V] [TRT] Tactic: -128 time 0.006048 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 128 Time: 0.00368 [08/05/2021-07:27:00] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: LeakyRelu_197 (PointWise) [08/05/2021-07:27:00] [V] [TRT] Tactic: 128 time 0.004928 [08/05/2021-07:27:00] [V] [TRT] Tactic: 256 time 0.004512 [08/05/2021-07:27:00] [V] [TRT] Tactic: 512 time 0.00464 [08/05/2021-07:27:00] [V] [TRT] Tactic: -32 time 0.01264 [08/05/2021-07:27:00] [V] [TRT] Tactic: -64 time 0.007936 [08/05/2021-07:27:00] [V] [TRT] Tactic: -128 time 0.004864 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 256 Time: 0.004512 [08/05/2021-07:27:00] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:27:00] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.003232 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.003232 [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.003392 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.003392 [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:00] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 256) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.005408 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.005408 [08/05/2021-07:27:00] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 256) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.014336 [08/05/2021-07:27:00] [V] [TRT] Tactic: 1 time 0.014336 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.003488 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.003488 [08/05/2021-07:27:00] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 257) [Constant] + (Unnamed Layer* 258) [Shuffle], (Unnamed Layer* 259) [ElementWise]), Sigmoid_199) (PointWise) [08/05/2021-07:27:00] [V] [TRT] Tactic: 128 time 0.004064 [08/05/2021-07:27:00] [V] [TRT] Tactic: 256 time 0.003808 [08/05/2021-07:27:00] [V] [TRT] Tactic: 512 time 0.003808 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 256 Time: 0.003808 [08/05/2021-07:27:00] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 257) [Constant] + (Unnamed Layer* 258) [Shuffle], (Unnamed Layer* 259) [ElementWise]), Sigmoid_199) (PointWise) [08/05/2021-07:27:00] [V] [TRT] Tactic: 128 time 0.004096 [08/05/2021-07:27:00] [V] [TRT] Tactic: 256 time 0.003904 [08/05/2021-07:27:00] [V] [TRT] Tactic: 512 time 0.004096 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 256 Time: 0.003904 [08/05/2021-07:27:00] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:00] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.025568 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.025568 [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.022528 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.022528 [08/05/2021-07:27:00] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:00] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 263) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:00] [V] [TRT] Tactic: 0 time 0.025088 [08/05/2021-07:27:00] [V] [TRT] Fastest Tactic: 0 Time: 0.025088 [08/05/2021-07:27:00] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 263) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.02048 [08/05/2021-07:27:01] [V] [TRT] Tactic: 1 time 0.014176 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 1 Time: 0.014176 [08/05/2021-07:27:01] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:01] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.003392 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.003392 [08/05/2021-07:27:01] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 266) [ElementWise] (ElementWise) [08/05/2021-07:27:01] [V] [TRT] Tactic: 1 time 0.002752 [08/05/2021-07:27:01] [V] [TRT] Tactic: 2 time 0.008 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 1 Time: 0.002752 [08/05/2021-07:27:01] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 266) [ElementWise] (ElementWise) [08/05/2021-07:27:01] [V] [TRT] Tactic: 1 time 0.004096 [08/05/2021-07:27:01] [V] [TRT] Tactic: 2 time 0.005984 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 1 Time: 0.004096 [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.003136 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.003136 [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.003392 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.003392 [08/05/2021-07:27:01] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: BatchNormalization_201 (Shuffle) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.002368 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.002368 [08/05/2021-07:27:01] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: BatchNormalization_201 (Shuffle) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.005408 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.005408 [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.003456 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.002912 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.002912 [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.004704 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.004704 [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.002688 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.004384 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.004384 [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:01] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 268) [Scale] (Scale) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.003936 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.003936 [08/05/2021-07:27:01] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 268) [Scale] (Scale) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:27:01] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:27:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 268) [Scale] (Scale) [08/05/2021-07:27:01] [V] [TRT] Tactic: 0 time 0.00384 [08/05/2021-07:27:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00384 [08/05/2021-07:27:01] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 268) [Scale] (Scale) [08/05/2021-07:27:02] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:02] [V] [TRT] Tactic: 0 time 0.003744 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 0 Time: 0.003744 [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:02] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:02] [V] [TRT] Tactic: 0 time 0.003616 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 0 Time: 0.003616 [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:02] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:02] [V] [TRT] Tactic: 0 time 0.004352 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:02] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:02] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 269) [Shuffle] (Shuffle) [08/05/2021-07:27:02] [V] [TRT] Tactic: 0 time 0.003584 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 0 Time: 0.003584 [08/05/2021-07:27:02] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 269) [Shuffle] (Shuffle) [08/05/2021-07:27:02] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:02] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:02] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:27:02] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: LeakyRelu_202 (PointWise) [08/05/2021-07:27:02] [V] [TRT] Tactic: 128 time 0.002816 [08/05/2021-07:27:02] [V] [TRT] Tactic: 256 time 0.004096 [08/05/2021-07:27:02] [V] [TRT] Tactic: 512 time 0.003648 [08/05/2021-07:27:02] [V] [TRT] Tactic: -32 time 0.01392 [08/05/2021-07:27:02] [V] [TRT] Tactic: -64 time 0.008992 [08/05/2021-07:27:02] [V] [TRT] Tactic: -128 time 0.006144 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 128 Time: 0.002816 [08/05/2021-07:27:02] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: LeakyRelu_202 (PointWise) [08/05/2021-07:27:02] [V] [TRT] Tactic: 128 time 0.005024 [08/05/2021-07:27:02] [V] [TRT] Tactic: 256 time 0.005088 [08/05/2021-07:27:02] [V] [TRT] Tactic: 512 time 0.0064 [08/05/2021-07:27:02] [V] [TRT] Tactic: -32 time 0.012736 [08/05/2021-07:27:02] [V] [TRT] Tactic: -64 time 0.008096 [08/05/2021-07:27:02] [V] [TRT] Tactic: -128 time 0.005696 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 128 Time: 0.005024 [08/05/2021-07:27:02] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:27:02] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:02] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:02] [V] [TRT] Tactic: 0 time 0.003488 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 0 Time: 0.003488 [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:02] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:02] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:02] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 273) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:02] [V] [TRT] Tactic: 0 time 0.004864 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [08/05/2021-07:27:02] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 273) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:02] [V] [TRT] Tactic: 0 time 0.014336 [08/05/2021-07:27:02] [V] [TRT] Tactic: 1 time 0.015008 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:02] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:02] [V] [TRT] Tactic: 0 time 0.003488 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 0 Time: 0.003488 [08/05/2021-07:27:02] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 274) [Constant] + (Unnamed Layer* 275) [Shuffle], (Unnamed Layer* 276) [ElementWise]), Sigmoid_204) (PointWise) [08/05/2021-07:27:02] [V] [TRT] Tactic: 128 time 0.00432 [08/05/2021-07:27:02] [V] [TRT] Tactic: 256 time 0.002976 [08/05/2021-07:27:02] [V] [TRT] Tactic: 512 time 0.002912 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 512 Time: 0.002912 [08/05/2021-07:27:02] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 274) [Constant] + (Unnamed Layer* 275) [Shuffle], (Unnamed Layer* 276) [ElementWise]), Sigmoid_204) (PointWise) [08/05/2021-07:27:02] [V] [TRT] Tactic: 128 time 0.003072 [08/05/2021-07:27:02] [V] [TRT] Tactic: 256 time 0.003808 [08/05/2021-07:27:02] [V] [TRT] Tactic: 512 time 0.003872 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 128 Time: 0.003072 [08/05/2021-07:27:02] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:02] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:02] [V] [TRT] Tactic: 0 time 0.003936 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 0 Time: 0.003936 [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:02] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:02] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:02] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.025472 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.025472 [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.023488 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.023488 [08/05/2021-07:27:03] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 280) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.024128 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.024128 [08/05/2021-07:27:03] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 280) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.021376 [08/05/2021-07:27:03] [V] [TRT] Tactic: 1 time 0.014304 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 1 Time: 0.014304 [08/05/2021-07:27:03] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:03] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.002944 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.002944 [08/05/2021-07:27:03] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 283) [ElementWise] (ElementWise) [08/05/2021-07:27:03] [V] [TRT] Tactic: 1 time 0.00368 [08/05/2021-07:27:03] [V] [TRT] Tactic: 2 time 0.008192 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 1 Time: 0.00368 [08/05/2021-07:27:03] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 283) [ElementWise] (ElementWise) [08/05/2021-07:27:03] [V] [TRT] Tactic: 1 time 0.002784 [08/05/2021-07:27:03] [V] [TRT] Tactic: 2 time 0.005984 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 1 Time: 0.002784 [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.002912 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.002912 [08/05/2021-07:27:03] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: BatchNormalization_206 (Shuffle) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:03] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: BatchNormalization_206 (Shuffle) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.003456 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.003456 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.004992 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.004992 [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.0048 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.0048 [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.004288 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.004288 [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:03] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:03] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 285) [Scale] (Scale) [08/05/2021-07:27:03] [V] [TRT] Tactic: 0 time 0.003808 [08/05/2021-07:27:03] [V] [TRT] Fastest Tactic: 0 Time: 0.003808 [08/05/2021-07:27:03] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 285) [Scale] (Scale) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.003808 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 0 Time: 0.003808 [08/05/2021-07:27:04] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 285) [Scale] (Scale) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.003808 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 0 Time: 0.003808 [08/05/2021-07:27:04] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 285) [Scale] (Scale) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.003872 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 0 Time: 0.003872 [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.002944 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 0 Time: 0.002944 [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.00416 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 0 Time: 0.00416 [08/05/2021-07:27:04] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 286) [Shuffle] (Shuffle) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.002304 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 0 Time: 0.002304 [08/05/2021-07:27:04] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 286) [Shuffle] (Shuffle) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.003584 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 0 Time: 0.003584 [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.003264 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 0 Time: 0.003264 [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.002688 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [08/05/2021-07:27:04] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: LeakyRelu_207 (PointWise) [08/05/2021-07:27:04] [V] [TRT] Tactic: 128 time 0.00384 [08/05/2021-07:27:04] [V] [TRT] Tactic: 256 time 0.00384 [08/05/2021-07:27:04] [V] [TRT] Tactic: 512 time 0.003968 [08/05/2021-07:27:04] [V] [TRT] Tactic: -32 time 0.013056 [08/05/2021-07:27:04] [V] [TRT] Tactic: -64 time 0.008192 [08/05/2021-07:27:04] [V] [TRT] Tactic: -128 time 0.006016 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 128 Time: 0.00384 [08/05/2021-07:27:04] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: LeakyRelu_207 (PointWise) [08/05/2021-07:27:04] [V] [TRT] Tactic: 128 time 0.005152 [08/05/2021-07:27:04] [V] [TRT] Tactic: 256 time 0.004736 [08/05/2021-07:27:04] [V] [TRT] Tactic: 512 time 0.0048 [08/05/2021-07:27:04] [V] [TRT] Tactic: -32 time 0.012288 [08/05/2021-07:27:04] [V] [TRT] Tactic: -64 time 0.008064 [08/05/2021-07:27:04] [V] [TRT] Tactic: -128 time 0.005888 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 256 Time: 0.004736 [08/05/2021-07:27:04] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:27:04] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.004032 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 0 Time: 0.004032 [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.003872 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 0 Time: 0.003872 [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:04] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 290) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.004896 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 0 Time: 0.004896 [08/05/2021-07:27:04] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 290) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.015328 [08/05/2021-07:27:04] [V] [TRT] Tactic: 1 time 0.014336 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 1 Time: 0.014336 [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.003296 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 0 Time: 0.003296 [08/05/2021-07:27:04] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 291) [Constant] + (Unnamed Layer* 292) [Shuffle], (Unnamed Layer* 293) [ElementWise]), Sigmoid_209) (PointWise) [08/05/2021-07:27:04] [V] [TRT] Tactic: 128 time 0.004192 [08/05/2021-07:27:04] [V] [TRT] Tactic: 256 time 0.002784 [08/05/2021-07:27:04] [V] [TRT] Tactic: 512 time 0.002784 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 256 Time: 0.002784 [08/05/2021-07:27:04] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 291) [Constant] + (Unnamed Layer* 292) [Shuffle], (Unnamed Layer* 293) [ElementWise]), Sigmoid_209) (PointWise) [08/05/2021-07:27:04] [V] [TRT] Tactic: 128 time 0.003808 [08/05/2021-07:27:04] [V] [TRT] Tactic: 256 time 0.004352 [08/05/2021-07:27:04] [V] [TRT] Tactic: 512 time 0.003008 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 512 Time: 0.003008 [08/05/2021-07:27:04] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:04] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:04] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:04] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:04] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.025152 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.025152 [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.024256 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.024256 [08/05/2021-07:27:05] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 297) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.022592 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.022592 [08/05/2021-07:27:05] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 297) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.021728 [08/05/2021-07:27:05] [V] [TRT] Tactic: 1 time 0.014144 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 1 Time: 0.014144 [08/05/2021-07:27:05] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:05] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.00288 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.00288 [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.004064 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.004064 [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:05] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 300) [ElementWise] (ElementWise) [08/05/2021-07:27:05] [V] [TRT] Tactic: 1 time 0.003008 [08/05/2021-07:27:05] [V] [TRT] Tactic: 2 time 0.008192 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 1 Time: 0.003008 [08/05/2021-07:27:05] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 300) [ElementWise] (ElementWise) [08/05/2021-07:27:05] [V] [TRT] Tactic: 1 time 0.00368 [08/05/2021-07:27:05] [V] [TRT] Tactic: 2 time 0.00512 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 1 Time: 0.00368 [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.0032 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.0032 [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:05] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: BatchNormalization_211 (Shuffle) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:05] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: BatchNormalization_211 (Shuffle) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.003456 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.003616 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.003616 [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.004672 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.004672 [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.004896 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.004896 [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.002912 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.002912 [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.00256 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.00256 [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:05] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:05] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:05] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:06] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 302) [Scale] (Scale) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.003744 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.003744 [08/05/2021-07:27:06] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 302) [Scale] (Scale) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.003968 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.003968 [08/05/2021-07:27:06] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 302) [Scale] (Scale) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.00384 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.00384 [08/05/2021-07:27:06] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 302) [Scale] (Scale) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.003744 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.003744 [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.002944 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.002944 [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.002944 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.002944 [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.003552 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.003552 [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.004864 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [08/05/2021-07:27:06] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 303) [Shuffle] (Shuffle) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:06] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 303) [Shuffle] (Shuffle) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.003968 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.003968 [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.0032 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.0032 [08/05/2021-07:27:06] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: LeakyRelu_212 (PointWise) [08/05/2021-07:27:06] [V] [TRT] Tactic: 128 time 0.003712 [08/05/2021-07:27:06] [V] [TRT] Tactic: 256 time 0.00384 [08/05/2021-07:27:06] [V] [TRT] Tactic: 512 time 0.004096 [08/05/2021-07:27:06] [V] [TRT] Tactic: -32 time 0.014336 [08/05/2021-07:27:06] [V] [TRT] Tactic: -64 time 0.008192 [08/05/2021-07:27:06] [V] [TRT] Tactic: -128 time 0.005088 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 128 Time: 0.003712 [08/05/2021-07:27:06] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: LeakyRelu_212 (PointWise) [08/05/2021-07:27:06] [V] [TRT] Tactic: 128 time 0.004928 [08/05/2021-07:27:06] [V] [TRT] Tactic: 256 time 0.005056 [08/05/2021-07:27:06] [V] [TRT] Tactic: 512 time 0.004928 [08/05/2021-07:27:06] [V] [TRT] Tactic: -32 time 0.012576 [08/05/2021-07:27:06] [V] [TRT] Tactic: -64 time 0.006976 [08/05/2021-07:27:06] [V] [TRT] Tactic: -128 time 0.004928 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 128 Time: 0.004928 [08/05/2021-07:27:06] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:27:06] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.003968 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.003968 [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:06] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 307) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.005856 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.005856 [08/05/2021-07:27:06] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 307) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.014336 [08/05/2021-07:27:06] [V] [TRT] Tactic: 1 time 0.014336 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:06] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:06] [V] [TRT] Tactic: 0 time 0.003264 [08/05/2021-07:27:06] [V] [TRT] Fastest Tactic: 0 Time: 0.003264 [08/05/2021-07:27:06] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 308) [Constant] + (Unnamed Layer* 309) [Shuffle], (Unnamed Layer* 310) [ElementWise]), Sigmoid_214) (PointWise) [08/05/2021-07:27:07] [V] [TRT] Tactic: 128 time 0.00416 [08/05/2021-07:27:07] [V] [TRT] Tactic: 256 time 0.0032 [08/05/2021-07:27:07] [V] [TRT] Tactic: 512 time 0.003072 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 512 Time: 0.003072 [08/05/2021-07:27:07] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 308) [Constant] + (Unnamed Layer* 309) [Shuffle], (Unnamed Layer* 310) [ElementWise]), Sigmoid_214) (PointWise) [08/05/2021-07:27:07] [V] [TRT] Tactic: 128 time 0.004096 [08/05/2021-07:27:07] [V] [TRT] Tactic: 256 time 0.003872 [08/05/2021-07:27:07] [V] [TRT] Tactic: 512 time 0.004096 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 256 Time: 0.003872 [08/05/2021-07:27:07] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:07] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.002848 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 0 Time: 0.002848 [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.025152 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 0 Time: 0.025152 [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.023552 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 0 Time: 0.023552 [08/05/2021-07:27:07] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 314) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.024352 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 0 Time: 0.024352 [08/05/2021-07:27:07] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 314) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.02048 [08/05/2021-07:27:07] [V] [TRT] Tactic: 1 time 0.014208 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 1 Time: 0.014208 [08/05/2021-07:27:07] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:07] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.003904 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003904 [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.003424 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003424 [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.00288 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00288 [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:07] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 317) [ElementWise] (ElementWise) [08/05/2021-07:27:07] [V] [TRT] Tactic: 1 time 0.003648 [08/05/2021-07:27:07] [V] [TRT] Tactic: 2 time 0.008832 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 1 Time: 0.003648 [08/05/2021-07:27:07] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 317) [ElementWise] (ElementWise) [08/05/2021-07:27:07] [V] [TRT] Tactic: 1 time 0.00368 [08/05/2021-07:27:07] [V] [TRT] Tactic: 2 time 0.00576 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 1 Time: 0.00368 [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.003968 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003968 [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:07] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: BatchNormalization_216 (Shuffle) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:07] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: BatchNormalization_216 (Shuffle) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.003104 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003104 [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.003744 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003744 [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.003744 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003744 [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.004512 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004512 [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.003392 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003392 [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.004128 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004128 [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.005152 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 0 Time: 0.005152 [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.00384 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00384 [08/05/2021-07:27:07] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:07] [V] [TRT] Tactic: 0 time 0.003616 [08/05/2021-07:27:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003616 [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.00432 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.00432 [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.005056 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.005056 [08/05/2021-07:27:08] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 319) [Scale] (Scale) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:08] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 319) [Scale] (Scale) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.004032 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.004032 [08/05/2021-07:27:08] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 319) [Scale] (Scale) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:27:08] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 319) [Scale] (Scale) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.00432 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.00432 [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.002976 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.002976 [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.002304 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.002304 [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.004224 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.004224 [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:08] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 320) [Shuffle] (Shuffle) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:08] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 320) [Shuffle] (Shuffle) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.002688 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:27:08] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: LeakyRelu_217 (PointWise) [08/05/2021-07:27:08] [V] [TRT] Tactic: 128 time 0.003904 [08/05/2021-07:27:08] [V] [TRT] Tactic: 256 time 0.00288 [08/05/2021-07:27:08] [V] [TRT] Tactic: 512 time 0.00368 [08/05/2021-07:27:08] [V] [TRT] Tactic: -32 time 0.011392 [08/05/2021-07:27:08] [V] [TRT] Tactic: -64 time 0.007616 [08/05/2021-07:27:08] [V] [TRT] Tactic: -128 time 0.004832 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 256 Time: 0.00288 [08/05/2021-07:27:08] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: LeakyRelu_217 (PointWise) [08/05/2021-07:27:08] [V] [TRT] Tactic: 128 time 0.006144 [08/05/2021-07:27:08] [V] [TRT] Tactic: 256 time 0.0048 [08/05/2021-07:27:08] [V] [TRT] Tactic: 512 time 0.0048 [08/05/2021-07:27:08] [V] [TRT] Tactic: -32 time 0.012288 [08/05/2021-07:27:08] [V] [TRT] Tactic: -64 time 0.00816 [08/05/2021-07:27:08] [V] [TRT] Tactic: -128 time 0.005824 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 256 Time: 0.0048 [08/05/2021-07:27:08] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:27:08] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:08] [V] [TRT] Tactic: 0 time 0.003104 [08/05/2021-07:27:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003104 [08/05/2021-07:27:08] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 324) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.004928 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004928 [08/05/2021-07:27:09] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 324) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.016192 [08/05/2021-07:27:09] [V] [TRT] Tactic: 1 time 0.015488 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 1 Time: 0.015488 [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.004224 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004224 [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.002688 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [08/05/2021-07:27:09] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 325) [Constant] + (Unnamed Layer* 326) [Shuffle], (Unnamed Layer* 327) [ElementWise]), Sigmoid_219) (PointWise) [08/05/2021-07:27:09] [V] [TRT] Tactic: 128 time 0.004096 [08/05/2021-07:27:09] [V] [TRT] Tactic: 256 time 0.003808 [08/05/2021-07:27:09] [V] [TRT] Tactic: 512 time 0.003712 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 512 Time: 0.003712 [08/05/2021-07:27:09] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 325) [Constant] + (Unnamed Layer* 326) [Shuffle], (Unnamed Layer* 327) [ElementWise]), Sigmoid_219) (PointWise) [08/05/2021-07:27:09] [V] [TRT] Tactic: 128 time 0.004096 [08/05/2021-07:27:09] [V] [TRT] Tactic: 256 time 0.004096 [08/05/2021-07:27:09] [V] [TRT] Tactic: 512 time 0.004384 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 128 Time: 0.004096 [08/05/2021-07:27:09] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:09] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.003936 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003936 [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.003808 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003808 [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.026592 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 0 Time: 0.026592 [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.024 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 0 Time: 0.024 [08/05/2021-07:27:09] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 331) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.025248 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 0 Time: 0.025248 [08/05/2021-07:27:09] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 331) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.021728 [08/05/2021-07:27:09] [V] [TRT] Tactic: 1 time 0.013952 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 1 Time: 0.013952 [08/05/2021-07:27:09] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:09] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.004064 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004064 [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.002848 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 0 Time: 0.002848 [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.003936 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003936 [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.002848 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 0 Time: 0.002848 [08/05/2021-07:27:09] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 334) [ElementWise] (ElementWise) [08/05/2021-07:27:09] [V] [TRT] Tactic: 1 time 0.004064 [08/05/2021-07:27:09] [V] [TRT] Tactic: 2 time 0.008192 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 1 Time: 0.004064 [08/05/2021-07:27:09] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 334) [ElementWise] (ElementWise) [08/05/2021-07:27:09] [V] [TRT] Tactic: 1 time 0.003808 [08/05/2021-07:27:09] [V] [TRT] Tactic: 2 time 0.005056 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 1 Time: 0.003808 [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:09] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: BatchNormalization_221 (Shuffle) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:09] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: BatchNormalization_221 (Shuffle) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.003904 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003904 [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.002944 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 0 Time: 0.002944 [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.004768 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004768 [08/05/2021-07:27:09] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:09] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.003872 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003872 [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.005536 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.005536 [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.00432 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00432 [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.004608 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.004608 [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.004256 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.004256 [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.004608 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.004608 [08/05/2021-07:27:10] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 336) [Scale] (Scale) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:10] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 336) [Scale] (Scale) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.002848 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.002848 [08/05/2021-07:27:10] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 336) [Scale] (Scale) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.00416 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00416 [08/05/2021-07:27:10] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 336) [Scale] (Scale) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.002912 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.002912 [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.004288 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.004288 [08/05/2021-07:27:10] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 337) [Shuffle] (Shuffle) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.0032 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.0032 [08/05/2021-07:27:10] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 337) [Shuffle] (Shuffle) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.003488 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003488 [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.00288 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00288 [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:10] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: LeakyRelu_222 (PointWise) [08/05/2021-07:27:10] [V] [TRT] Tactic: 128 time 0.003776 [08/05/2021-07:27:10] [V] [TRT] Tactic: 256 time 0.003808 [08/05/2021-07:27:10] [V] [TRT] Tactic: 512 time 0.003968 [08/05/2021-07:27:10] [V] [TRT] Tactic: -32 time 0.01408 [08/05/2021-07:27:10] [V] [TRT] Tactic: -64 time 0.008736 [08/05/2021-07:27:10] [V] [TRT] Tactic: -128 time 0.005088 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 128 Time: 0.003776 [08/05/2021-07:27:10] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: LeakyRelu_222 (PointWise) [08/05/2021-07:27:10] [V] [TRT] Tactic: 128 time 0.005024 [08/05/2021-07:27:10] [V] [TRT] Tactic: 256 time 0.004672 [08/05/2021-07:27:10] [V] [TRT] Tactic: 512 time 0.005024 [08/05/2021-07:27:10] [V] [TRT] Tactic: -32 time 0.012352 [08/05/2021-07:27:10] [V] [TRT] Tactic: -64 time 0.008192 [08/05/2021-07:27:10] [V] [TRT] Tactic: -128 time 0.005856 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 256 Time: 0.004672 [08/05/2021-07:27:10] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:27:10] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.003136 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003136 [08/05/2021-07:27:10] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:10] [V] [TRT] Tactic: 0 time 0.003616 [08/05/2021-07:27:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003616 [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:11] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 341) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.005088 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.005088 [08/05/2021-07:27:11] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 341) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.014336 [08/05/2021-07:27:11] [V] [TRT] Tactic: 1 time 0.014528 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.002976 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002976 [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:11] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 342) [Constant] + (Unnamed Layer* 343) [Shuffle], (Unnamed Layer* 344) [ElementWise]), Sigmoid_224) (PointWise) [08/05/2021-07:27:11] [V] [TRT] Tactic: 128 time 0.003872 [08/05/2021-07:27:11] [V] [TRT] Tactic: 256 time 0.003712 [08/05/2021-07:27:11] [V] [TRT] Tactic: 512 time 0.003936 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 256 Time: 0.003712 [08/05/2021-07:27:11] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 342) [Constant] + (Unnamed Layer* 343) [Shuffle], (Unnamed Layer* 344) [ElementWise]), Sigmoid_224) (PointWise) [08/05/2021-07:27:11] [V] [TRT] Tactic: 128 time 0.00384 [08/05/2021-07:27:11] [V] [TRT] Tactic: 256 time 0.003968 [08/05/2021-07:27:11] [V] [TRT] Tactic: 512 time 0.003072 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 512 Time: 0.003072 [08/05/2021-07:27:11] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:11] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.003808 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003808 [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.02576 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.02576 [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.023136 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.023136 [08/05/2021-07:27:11] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 348) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.023424 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.023424 [08/05/2021-07:27:11] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 348) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.02048 [08/05/2021-07:27:11] [V] [TRT] Tactic: 1 time 0.014304 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 1 Time: 0.014304 [08/05/2021-07:27:11] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:11] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.003808 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003808 [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:11] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 351) [ElementWise] (ElementWise) [08/05/2021-07:27:11] [V] [TRT] Tactic: 1 time 0.003072 [08/05/2021-07:27:11] [V] [TRT] Tactic: 2 time 0.00816 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 1 Time: 0.003072 [08/05/2021-07:27:11] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 351) [ElementWise] (ElementWise) [08/05/2021-07:27:11] [V] [TRT] Tactic: 1 time 0.00384 [08/05/2021-07:27:11] [V] [TRT] Tactic: 2 time 0.006144 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 1 Time: 0.00384 [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.003424 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003424 [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.003424 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003424 [08/05/2021-07:27:11] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: BatchNormalization_226 (Shuffle) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:11] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: BatchNormalization_226 (Shuffle) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.00416 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00416 [08/05/2021-07:27:11] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:11] [V] [TRT] Tactic: 0 time 0.003136 [08/05/2021-07:27:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003136 [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.003104 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.003104 [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.004128 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.004128 [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.0032 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.0032 [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.003296 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.003296 [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.004352 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:12] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 353) [Scale] (Scale) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.004192 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.004192 [08/05/2021-07:27:12] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 353) [Scale] (Scale) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.003872 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.003872 [08/05/2021-07:27:12] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 353) [Scale] (Scale) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:12] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 353) [Scale] (Scale) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.00288 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00288 [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.004032 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.004032 [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.00288 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00288 [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.004224 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.004224 [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.004192 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.004192 [08/05/2021-07:27:12] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 354) [Shuffle] (Shuffle) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:12] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 354) [Shuffle] (Shuffle) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:27:12] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: LeakyRelu_227 (PointWise) [08/05/2021-07:27:12] [V] [TRT] Tactic: 128 time 0.004096 [08/05/2021-07:27:12] [V] [TRT] Tactic: 256 time 0.00368 [08/05/2021-07:27:12] [V] [TRT] Tactic: 512 time 0.004032 [08/05/2021-07:27:12] [V] [TRT] Tactic: -32 time 0.013984 [08/05/2021-07:27:12] [V] [TRT] Tactic: -64 time 0.008192 [08/05/2021-07:27:12] [V] [TRT] Tactic: -128 time 0.005984 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 256 Time: 0.00368 [08/05/2021-07:27:12] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: LeakyRelu_227 (PointWise) [08/05/2021-07:27:12] [V] [TRT] Tactic: 128 time 0.005248 [08/05/2021-07:27:12] [V] [TRT] Tactic: 256 time 0.0048 [08/05/2021-07:27:12] [V] [TRT] Tactic: 512 time 0.00544 [08/05/2021-07:27:12] [V] [TRT] Tactic: -32 time 0.012704 [08/05/2021-07:27:12] [V] [TRT] Tactic: -64 time 0.008192 [08/05/2021-07:27:12] [V] [TRT] Tactic: -128 time 0.0056 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 256 Time: 0.0048 [08/05/2021-07:27:12] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:27:12] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:27:12] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:12] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:12] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.003552 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 0 Time: 0.003552 [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.003552 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 0 Time: 0.003552 [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.003136 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 0 Time: 0.003136 [08/05/2021-07:27:13] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 358) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.004608 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 0 Time: 0.004608 [08/05/2021-07:27:13] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 358) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.0144 [08/05/2021-07:27:13] [V] [TRT] Tactic: 1 time 0.01472 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 0 Time: 0.0144 [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.003264 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 0 Time: 0.003264 [08/05/2021-07:27:13] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 359) [Constant] + (Unnamed Layer* 360) [Shuffle], (Unnamed Layer* 361) [ElementWise]), Sigmoid_229) (PointWise) [08/05/2021-07:27:13] [V] [TRT] Tactic: 128 time 0.003296 [08/05/2021-07:27:13] [V] [TRT] Tactic: 256 time 0.004256 [08/05/2021-07:27:13] [V] [TRT] Tactic: 512 time 0.004096 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 128 Time: 0.003296 [08/05/2021-07:27:13] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 359) [Constant] + (Unnamed Layer* 360) [Shuffle], (Unnamed Layer* 361) [ElementWise]), Sigmoid_229) (PointWise) [08/05/2021-07:27:13] [V] [TRT] Tactic: 128 time 0.004064 [08/05/2021-07:27:13] [V] [TRT] Tactic: 256 time 0.004 [08/05/2021-07:27:13] [V] [TRT] Tactic: 512 time 0.003808 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 512 Time: 0.003808 [08/05/2021-07:27:13] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:13] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.025632 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 0 Time: 0.025632 [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.02448 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 0 Time: 0.02448 [08/05/2021-07:27:13] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 365) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.023232 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 0 Time: 0.023232 [08/05/2021-07:27:13] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 365) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.021792 [08/05/2021-07:27:13] [V] [TRT] Tactic: 1 time 0.013952 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 1 Time: 0.013952 [08/05/2021-07:27:13] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:13] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.003936 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 0 Time: 0.003936 [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:13] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 368) [ElementWise] (ElementWise) [08/05/2021-07:27:13] [V] [TRT] Tactic: 1 time 0.00288 [08/05/2021-07:27:13] [V] [TRT] Tactic: 2 time 0.008064 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 1 Time: 0.00288 [08/05/2021-07:27:13] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 368) [ElementWise] (ElementWise) [08/05/2021-07:27:13] [V] [TRT] Tactic: 1 time 0.003264 [08/05/2021-07:27:13] [V] [TRT] Tactic: 2 time 0.004896 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 1 Time: 0.003264 [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.004 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 0 Time: 0.004 [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.003616 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 0 Time: 0.003616 [08/05/2021-07:27:13] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: BatchNormalization_231 (Shuffle) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.00256 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00256 [08/05/2021-07:27:13] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: BatchNormalization_231 (Shuffle) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.002848 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 0 Time: 0.002848 [08/05/2021-07:27:13] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:13] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:13] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.003424 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.003424 [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.004224 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.004224 [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.002944 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.002944 [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.004768 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.004768 [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.002176 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.002176 [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.002912 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.002912 [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.004128 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.004128 [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:14] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 370) [Scale] (Scale) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:14] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 370) [Scale] (Scale) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.003872 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.003872 [08/05/2021-07:27:14] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 370) [Scale] (Scale) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:14] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 370) [Scale] (Scale) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.003808 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.003808 [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.003296 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.003296 [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.004768 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.004768 [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.004544 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.004544 [08/05/2021-07:27:14] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 371) [Shuffle] (Shuffle) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:14] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 371) [Shuffle] (Shuffle) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.002368 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.002368 [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.003968 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.003968 [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:14] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:14] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:14] [V] [TRT] --------------- Timing Runner: LeakyRelu_232 (PointWise) [08/05/2021-07:27:14] [V] [TRT] Tactic: 128 time 0.00384 [08/05/2021-07:27:14] [V] [TRT] Tactic: 256 time 0.00384 [08/05/2021-07:27:14] [V] [TRT] Tactic: 512 time 0.004096 [08/05/2021-07:27:15] [V] [TRT] Tactic: -32 time 0.013248 [08/05/2021-07:27:15] [V] [TRT] Tactic: -64 time 0.008192 [08/05/2021-07:27:15] [V] [TRT] Tactic: -128 time 0.006112 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 128 Time: 0.00384 [08/05/2021-07:27:15] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: LeakyRelu_232 (PointWise) [08/05/2021-07:27:15] [V] [TRT] Tactic: 128 time 0.006144 [08/05/2021-07:27:15] [V] [TRT] Tactic: 256 time 0.005504 [08/05/2021-07:27:15] [V] [TRT] Tactic: 512 time 0.004704 [08/05/2021-07:27:15] [V] [TRT] Tactic: -32 time 0.012288 [08/05/2021-07:27:15] [V] [TRT] Tactic: -64 time 0.008192 [08/05/2021-07:27:15] [V] [TRT] Tactic: -128 time 0.004768 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 512 Time: 0.004704 [08/05/2021-07:27:15] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:27:15] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.00256 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00256 [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.003744 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 0 Time: 0.003744 [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.003488 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 0 Time: 0.003488 [08/05/2021-07:27:15] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 375) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.005408 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 0 Time: 0.005408 [08/05/2021-07:27:15] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 375) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.014336 [08/05/2021-07:27:15] [V] [TRT] Tactic: 1 time 0.014496 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.002592 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 0 Time: 0.002592 [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.002848 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 0 Time: 0.002848 [08/05/2021-07:27:15] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 376) [Constant] + (Unnamed Layer* 377) [Shuffle], (Unnamed Layer* 378) [ElementWise]), Sigmoid_234) (PointWise) [08/05/2021-07:27:15] [V] [TRT] Tactic: 128 time 0.004096 [08/05/2021-07:27:15] [V] [TRT] Tactic: 256 time 0.003008 [08/05/2021-07:27:15] [V] [TRT] Tactic: 512 time 0.00304 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 256 Time: 0.003008 [08/05/2021-07:27:15] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 376) [Constant] + (Unnamed Layer* 377) [Shuffle], (Unnamed Layer* 378) [ElementWise]), Sigmoid_234) (PointWise) [08/05/2021-07:27:15] [V] [TRT] Tactic: 128 time 0.002816 [08/05/2021-07:27:15] [V] [TRT] Tactic: 256 time 0.003296 [08/05/2021-07:27:15] [V] [TRT] Tactic: 512 time 0.004 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 128 Time: 0.002816 [08/05/2021-07:27:15] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:15] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.004064 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 0 Time: 0.004064 [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.026208 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 0 Time: 0.026208 [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.023488 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 0 Time: 0.023488 [08/05/2021-07:27:15] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 382) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.023104 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 0 Time: 0.023104 [08/05/2021-07:27:15] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 382) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.020896 [08/05/2021-07:27:15] [V] [TRT] Tactic: 1 time 0.014336 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 1 Time: 0.014336 [08/05/2021-07:27:15] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:15] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.003552 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 0 Time: 0.003552 [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.00336 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00336 [08/05/2021-07:27:15] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 385) [ElementWise] (ElementWise) [08/05/2021-07:27:15] [V] [TRT] Tactic: 1 time 0.003744 [08/05/2021-07:27:15] [V] [TRT] Tactic: 2 time 0.008128 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 1 Time: 0.003744 [08/05/2021-07:27:15] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 385) [ElementWise] (ElementWise) [08/05/2021-07:27:15] [V] [TRT] Tactic: 1 time 0.002976 [08/05/2021-07:27:15] [V] [TRT] Tactic: 2 time 0.004992 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 1 Time: 0.002976 [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:15] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: BatchNormalization_236 (Shuffle) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:15] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:15] [V] [TRT] --------------- Timing Runner: BatchNormalization_236 (Shuffle) [08/05/2021-07:27:15] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:15] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.0048 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0048 [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.003616 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.003616 [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.003328 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.003328 [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.005312 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.005312 [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.003328 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.003328 [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.002944 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.002944 [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.004928 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.004928 [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:16] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 387) [Scale] (Scale) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:16] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 387) [Scale] (Scale) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:27:16] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 387) [Scale] (Scale) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:16] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 387) [Scale] (Scale) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.00416 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.00416 [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.003616 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.003616 [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:16] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 388) [Shuffle] (Shuffle) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:16] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 388) [Shuffle] (Shuffle) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.002208 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.002208 [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:16] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:16] [V] [TRT] Tactic: 0 time 0.003904 [08/05/2021-07:27:16] [V] [TRT] Fastest Tactic: 0 Time: 0.003904 [08/05/2021-07:27:16] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: LeakyRelu_237 (PointWise) [08/05/2021-07:27:17] [V] [TRT] Tactic: 128 time 0.004064 [08/05/2021-07:27:17] [V] [TRT] Tactic: 256 time 0.003488 [08/05/2021-07:27:17] [V] [TRT] Tactic: 512 time 0.002816 [08/05/2021-07:27:17] [V] [TRT] Tactic: -32 time 0.011648 [08/05/2021-07:27:17] [V] [TRT] Tactic: -64 time 0.00768 [08/05/2021-07:27:17] [V] [TRT] Tactic: -128 time 0.004768 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 512 Time: 0.002816 [08/05/2021-07:27:17] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: LeakyRelu_237 (PointWise) [08/05/2021-07:27:17] [V] [TRT] Tactic: 128 time 0.004864 [08/05/2021-07:27:17] [V] [TRT] Tactic: 256 time 0.004864 [08/05/2021-07:27:17] [V] [TRT] Tactic: 512 time 0.004864 [08/05/2021-07:27:17] [V] [TRT] Tactic: -32 time 0.012352 [08/05/2021-07:27:17] [V] [TRT] Tactic: -64 time 0.008032 [08/05/2021-07:27:17] [V] [TRT] Tactic: -128 time 0.0048 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: -128 Time: 0.0048 [08/05/2021-07:27:17] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:27:17] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:17] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:17] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:17] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:17] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:17] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 392) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:17] [V] [TRT] Tactic: 0 time 0.004864 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [08/05/2021-07:27:17] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 392) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:17] [V] [TRT] Tactic: 0 time 0.014848 [08/05/2021-07:27:17] [V] [TRT] Tactic: 1 time 0.014336 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 1 Time: 0.014336 [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:17] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:17] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:17] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 393) [Constant] + (Unnamed Layer* 394) [Shuffle], (Unnamed Layer* 395) [ElementWise]), Sigmoid_239) (PointWise) [08/05/2021-07:27:17] [V] [TRT] Tactic: 128 time 0.003872 [08/05/2021-07:27:17] [V] [TRT] Tactic: 256 time 0.002976 [08/05/2021-07:27:17] [V] [TRT] Tactic: 512 time 0.003936 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 256 Time: 0.002976 [08/05/2021-07:27:17] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 393) [Constant] + (Unnamed Layer* 394) [Shuffle], (Unnamed Layer* 395) [ElementWise]), Sigmoid_239) (PointWise) [08/05/2021-07:27:17] [V] [TRT] Tactic: 128 time 0.003424 [08/05/2021-07:27:17] [V] [TRT] Tactic: 256 time 0.003808 [08/05/2021-07:27:17] [V] [TRT] Tactic: 512 time 0.002976 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 512 Time: 0.002976 [08/05/2021-07:27:17] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:17] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:17] [V] [TRT] Tactic: 0 time 0.003616 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003616 [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:17] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:17] [V] [TRT] Tactic: 0 time 0.025728 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 0 Time: 0.025728 [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:17] [V] [TRT] Tactic: 0 time 0.024256 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 0 Time: 0.024256 [08/05/2021-07:27:17] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 399) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:17] [V] [TRT] Tactic: 0 time 0.023296 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 0 Time: 0.023296 [08/05/2021-07:27:17] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 399) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:17] [V] [TRT] Tactic: 0 time 0.02048 [08/05/2021-07:27:17] [V] [TRT] Tactic: 1 time 0.014208 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 1 Time: 0.014208 [08/05/2021-07:27:17] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:17] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:17] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:17] [V] [TRT] Tactic: 0 time 0.003584 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003584 [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:17] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:17] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:17] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 402) [ElementWise] (ElementWise) [08/05/2021-07:27:17] [V] [TRT] Tactic: 1 time 0.002624 [08/05/2021-07:27:17] [V] [TRT] Tactic: 2 time 0.008032 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 1 Time: 0.002624 [08/05/2021-07:27:17] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 402) [ElementWise] (ElementWise) [08/05/2021-07:27:17] [V] [TRT] Tactic: 1 time 0.002624 [08/05/2021-07:27:17] [V] [TRT] Tactic: 2 time 0.005984 [08/05/2021-07:27:17] [V] [TRT] Fastest Tactic: 1 Time: 0.002624 [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.0032 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.0032 [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.003552 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003552 [08/05/2021-07:27:18] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: BatchNormalization_241 (Shuffle) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.002688 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [08/05/2021-07:27:18] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: BatchNormalization_241 (Shuffle) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.003616 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003616 [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.005536 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.005536 [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.002528 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.002528 [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.004864 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.002688 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.004416 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.004416 [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:18] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 404) [Scale] (Scale) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.003936 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003936 [08/05/2021-07:27:18] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 404) [Scale] (Scale) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:18] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 404) [Scale] (Scale) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.003872 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003872 [08/05/2021-07:27:18] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 404) [Scale] (Scale) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.003904 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003904 [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.003264 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003264 [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.002976 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.002976 [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.00384 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00384 [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:18] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:18] [V] [TRT] Tactic: 0 time 0.004352 [08/05/2021-07:27:18] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [08/05/2021-07:27:18] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 405) [Shuffle] (Shuffle) [08/05/2021-07:27:19] [V] [TRT] Tactic: 0 time 0.002368 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002368 [08/05/2021-07:27:19] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 405) [Shuffle] (Shuffle) [08/05/2021-07:27:19] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:19] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:19] [V] [TRT] Tactic: 0 time 0.002944 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002944 [08/05/2021-07:27:19] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: LeakyRelu_242 (PointWise) [08/05/2021-07:27:19] [V] [TRT] Tactic: 128 time 0.003872 [08/05/2021-07:27:19] [V] [TRT] Tactic: 256 time 0.00384 [08/05/2021-07:27:19] [V] [TRT] Tactic: 512 time 0.003904 [08/05/2021-07:27:19] [V] [TRT] Tactic: -32 time 0.014176 [08/05/2021-07:27:19] [V] [TRT] Tactic: -64 time 0.00832 [08/05/2021-07:27:19] [V] [TRT] Tactic: -128 time 0.006016 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 256 Time: 0.00384 [08/05/2021-07:27:19] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: LeakyRelu_242 (PointWise) [08/05/2021-07:27:19] [V] [TRT] Tactic: 128 time 0.004768 [08/05/2021-07:27:19] [V] [TRT] Tactic: 256 time 0.005824 [08/05/2021-07:27:19] [V] [TRT] Tactic: 512 time 0.005952 [08/05/2021-07:27:19] [V] [TRT] Tactic: -32 time 0.01248 [08/05/2021-07:27:19] [V] [TRT] Tactic: -64 time 0.008128 [08/05/2021-07:27:19] [V] [TRT] Tactic: -128 time 0.005568 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 128 Time: 0.004768 [08/05/2021-07:27:19] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:27:19] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:19] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:19] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:19] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:19] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:19] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 409) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:19] [V] [TRT] Tactic: 0 time 0.0048 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 0 Time: 0.0048 [08/05/2021-07:27:19] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 409) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:19] [V] [TRT] Tactic: 0 time 0.014432 [08/05/2021-07:27:19] [V] [TRT] Tactic: 1 time 0.014016 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 1 Time: 0.014016 [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:19] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:19] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:19] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 410) [Constant] + (Unnamed Layer* 411) [Shuffle], (Unnamed Layer* 412) [ElementWise]), Sigmoid_244) (PointWise) [08/05/2021-07:27:19] [V] [TRT] Tactic: 128 time 0.004352 [08/05/2021-07:27:19] [V] [TRT] Tactic: 256 time 0.003744 [08/05/2021-07:27:19] [V] [TRT] Tactic: 512 time 0.002592 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 512 Time: 0.002592 [08/05/2021-07:27:19] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 410) [Constant] + (Unnamed Layer* 411) [Shuffle], (Unnamed Layer* 412) [ElementWise]), Sigmoid_244) (PointWise) [08/05/2021-07:27:19] [V] [TRT] Tactic: 128 time 0.004096 [08/05/2021-07:27:19] [V] [TRT] Tactic: 256 time 0.00384 [08/05/2021-07:27:19] [V] [TRT] Tactic: 512 time 0.003648 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 512 Time: 0.003648 [08/05/2021-07:27:19] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:19] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:19] [V] [TRT] Tactic: 0 time 0.003616 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003616 [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:19] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:19] [V] [TRT] Tactic: 0 time 0.026496 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 0 Time: 0.026496 [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:19] [V] [TRT] Tactic: 0 time 0.02416 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 0 Time: 0.02416 [08/05/2021-07:27:19] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 416) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:19] [V] [TRT] Tactic: 0 time 0.023488 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 0 Time: 0.023488 [08/05/2021-07:27:19] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 416) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:19] [V] [TRT] Tactic: 0 time 0.02128 [08/05/2021-07:27:19] [V] [TRT] Tactic: 1 time 0.014112 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 1 Time: 0.014112 [08/05/2021-07:27:19] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:19] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:19] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:19] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:19] [V] [TRT] Tactic: 0 time 0.002688 [08/05/2021-07:27:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [08/05/2021-07:27:19] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:20] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 419) [ElementWise] (ElementWise) [08/05/2021-07:27:20] [V] [TRT] Tactic: 1 time 0.004224 [08/05/2021-07:27:20] [V] [TRT] Tactic: 2 time 0.008 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 1 Time: 0.004224 [08/05/2021-07:27:20] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 419) [ElementWise] (ElementWise) [08/05/2021-07:27:20] [V] [TRT] Tactic: 1 time 0.00304 [08/05/2021-07:27:20] [V] [TRT] Tactic: 2 time 0.006144 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 1 Time: 0.00304 [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.003264 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003264 [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.003488 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003488 [08/05/2021-07:27:20] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: BatchNormalization_246 (Shuffle) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:20] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: BatchNormalization_246 (Shuffle) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.005088 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.005088 [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.002912 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002912 [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.003296 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003296 [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.004256 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.004256 [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.00224 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00224 [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:20] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 421) [Scale] (Scale) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.004032 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.004032 [08/05/2021-07:27:20] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 421) [Scale] (Scale) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:20] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 421) [Scale] (Scale) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:20] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 421) [Scale] (Scale) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.003936 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003936 [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:20] [V] [TRT] Tactic: 0 time 0.003584 [08/05/2021-07:27:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003584 [08/05/2021-07:27:20] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.003328 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003328 [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:21] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 422) [Shuffle] (Shuffle) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:21] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 422) [Shuffle] (Shuffle) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:27:21] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: LeakyRelu_247 (PointWise) [08/05/2021-07:27:21] [V] [TRT] Tactic: 128 time 0.003808 [08/05/2021-07:27:21] [V] [TRT] Tactic: 256 time 0.00368 [08/05/2021-07:27:21] [V] [TRT] Tactic: 512 time 0.004 [08/05/2021-07:27:21] [V] [TRT] Tactic: -32 time 0.014336 [08/05/2021-07:27:21] [V] [TRT] Tactic: -64 time 0.008288 [08/05/2021-07:27:21] [V] [TRT] Tactic: -128 time 0.005952 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 256 Time: 0.00368 [08/05/2021-07:27:21] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: LeakyRelu_247 (PointWise) [08/05/2021-07:27:21] [V] [TRT] Tactic: 128 time 0.004608 [08/05/2021-07:27:21] [V] [TRT] Tactic: 256 time 0.004608 [08/05/2021-07:27:21] [V] [TRT] Tactic: 512 time 0.005344 [08/05/2021-07:27:21] [V] [TRT] Tactic: -32 time 0.012448 [08/05/2021-07:27:21] [V] [TRT] Tactic: -64 time 0.008064 [08/05/2021-07:27:21] [V] [TRT] Tactic: -128 time 0.004768 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 128 Time: 0.004608 [08/05/2021-07:27:21] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:27:21] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.003552 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003552 [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:21] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 426) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.004896 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004896 [08/05/2021-07:27:21] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 426) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.014496 [08/05/2021-07:27:21] [V] [TRT] Tactic: 1 time 0.014528 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.014496 [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.003616 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003616 [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.003456 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [08/05/2021-07:27:21] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 427) [Constant] + (Unnamed Layer* 428) [Shuffle], (Unnamed Layer* 429) [ElementWise]), Sigmoid_249) (PointWise) [08/05/2021-07:27:21] [V] [TRT] Tactic: 128 time 0.003712 [08/05/2021-07:27:21] [V] [TRT] Tactic: 256 time 0.003712 [08/05/2021-07:27:21] [V] [TRT] Tactic: 512 time 0.002976 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 512 Time: 0.002976 [08/05/2021-07:27:21] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 427) [Constant] + (Unnamed Layer* 428) [Shuffle], (Unnamed Layer* 429) [ElementWise]), Sigmoid_249) (PointWise) [08/05/2021-07:27:21] [V] [TRT] Tactic: 128 time 0.004032 [08/05/2021-07:27:21] [V] [TRT] Tactic: 256 time 0.00384 [08/05/2021-07:27:21] [V] [TRT] Tactic: 512 time 0.003904 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 256 Time: 0.00384 [08/05/2021-07:27:21] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:21] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.025536 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.025536 [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.0232 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.0232 [08/05/2021-07:27:21] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 433) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.022624 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.022624 [08/05/2021-07:27:21] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 433) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.021216 [08/05/2021-07:27:21] [V] [TRT] Tactic: 1 time 0.014304 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 1 Time: 0.014304 [08/05/2021-07:27:21] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:21] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:21] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:21] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:27:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.003744 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.003744 [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.00352 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00352 [08/05/2021-07:27:22] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 436) [ElementWise] (ElementWise) [08/05/2021-07:27:22] [V] [TRT] Tactic: 1 time 0.002624 [08/05/2021-07:27:22] [V] [TRT] Tactic: 2 time 0.008192 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 1 Time: 0.002624 [08/05/2021-07:27:22] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 436) [ElementWise] (ElementWise) [08/05/2021-07:27:22] [V] [TRT] Tactic: 1 time 0.003648 [08/05/2021-07:27:22] [V] [TRT] Tactic: 2 time 0.005088 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 1 Time: 0.003648 [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:22] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: BatchNormalization_251 (Shuffle) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.002688 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [08/05/2021-07:27:22] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: BatchNormalization_251 (Shuffle) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.002112 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.002112 [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.005344 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.005344 [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:22] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 438) [Scale] (Scale) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:22] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 438) [Scale] (Scale) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:22] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 438) [Scale] (Scale) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.003808 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.003808 [08/05/2021-07:27:22] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 438) [Scale] (Scale) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:22] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:22] [V] [TRT] Tactic: 0 time 0.004 [08/05/2021-07:27:22] [V] [TRT] Fastest Tactic: 0 Time: 0.004 [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.00288 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00288 [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.003584 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 0 Time: 0.003584 [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.00352 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00352 [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.004352 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [08/05/2021-07:27:23] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 439) [Shuffle] (Shuffle) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:23] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 439) [Shuffle] (Shuffle) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.004 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004 [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:23] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: LeakyRelu_252 (PointWise) [08/05/2021-07:27:23] [V] [TRT] Tactic: 128 time 0.004096 [08/05/2021-07:27:23] [V] [TRT] Tactic: 256 time 0.002976 [08/05/2021-07:27:23] [V] [TRT] Tactic: 512 time 0.003936 [08/05/2021-07:27:23] [V] [TRT] Tactic: -32 time 0.01408 [08/05/2021-07:27:23] [V] [TRT] Tactic: -64 time 0.008192 [08/05/2021-07:27:23] [V] [TRT] Tactic: -128 time 0.006048 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 256 Time: 0.002976 [08/05/2021-07:27:23] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: LeakyRelu_252 (PointWise) [08/05/2021-07:27:23] [V] [TRT] Tactic: 128 time 0.0048 [08/05/2021-07:27:23] [V] [TRT] Tactic: 256 time 0.004832 [08/05/2021-07:27:23] [V] [TRT] Tactic: 512 time 0.005664 [08/05/2021-07:27:23] [V] [TRT] Tactic: -32 time 0.012288 [08/05/2021-07:27:23] [V] [TRT] Tactic: -64 time 0.008192 [08/05/2021-07:27:23] [V] [TRT] Tactic: -128 time 0.004704 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: -128 Time: 0.004704 [08/05/2021-07:27:23] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:27:23] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.003808 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 0 Time: 0.003808 [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:23] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 443) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.00528 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00528 [08/05/2021-07:27:23] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 443) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.014624 [08/05/2021-07:27:23] [V] [TRT] Tactic: 1 time 0.014336 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 1 Time: 0.014336 [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.00288 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00288 [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:23] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 444) [Constant] + (Unnamed Layer* 445) [Shuffle], (Unnamed Layer* 446) [ElementWise]), Sigmoid_254) (PointWise) [08/05/2021-07:27:23] [V] [TRT] Tactic: 128 time 0.004416 [08/05/2021-07:27:23] [V] [TRT] Tactic: 256 time 0.003392 [08/05/2021-07:27:23] [V] [TRT] Tactic: 512 time 0.004096 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 256 Time: 0.003392 [08/05/2021-07:27:23] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 444) [Constant] + (Unnamed Layer* 445) [Shuffle], (Unnamed Layer* 446) [ElementWise]), Sigmoid_254) (PointWise) [08/05/2021-07:27:23] [V] [TRT] Tactic: 128 time 0.003808 [08/05/2021-07:27:23] [V] [TRT] Tactic: 256 time 0.002848 [08/05/2021-07:27:23] [V] [TRT] Tactic: 512 time 0.003744 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 256 Time: 0.002848 [08/05/2021-07:27:23] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:23] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.003136 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 0 Time: 0.003136 [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.025696 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 0 Time: 0.025696 [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.02336 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 0 Time: 0.02336 [08/05/2021-07:27:23] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 450) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.023136 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 0 Time: 0.023136 [08/05/2021-07:27:23] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 450) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.020992 [08/05/2021-07:27:23] [V] [TRT] Tactic: 1 time 0.01408 [08/05/2021-07:27:23] [V] [TRT] Fastest Tactic: 1 Time: 0.01408 [08/05/2021-07:27:23] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:23] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:23] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:23] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:24] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 453) [ElementWise] (ElementWise) [08/05/2021-07:27:24] [V] [TRT] Tactic: 1 time 0.002656 [08/05/2021-07:27:24] [V] [TRT] Tactic: 2 time 0.008064 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 1 Time: 0.002656 [08/05/2021-07:27:24] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 453) [ElementWise] (ElementWise) [08/05/2021-07:27:24] [V] [TRT] Tactic: 1 time 0.00368 [08/05/2021-07:27:24] [V] [TRT] Tactic: 2 time 0.005952 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 1 Time: 0.00368 [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.003904 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.003904 [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:24] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: BatchNormalization_256 (Shuffle) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.002272 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.002272 [08/05/2021-07:27:24] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: BatchNormalization_256 (Shuffle) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.003456 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.0048 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0048 [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.00336 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00336 [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.003584 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.003584 [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.005376 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.005376 [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.004224 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004224 [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:24] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 455) [Scale] (Scale) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.003904 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.003904 [08/05/2021-07:27:24] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 455) [Scale] (Scale) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.003808 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.003808 [08/05/2021-07:27:24] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 455) [Scale] (Scale) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.003808 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.003808 [08/05/2021-07:27:24] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:27:24] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 455) [Scale] (Scale) [08/05/2021-07:27:24] [V] [TRT] Tactic: 0 time 0.003904 [08/05/2021-07:27:24] [V] [TRT] Fastest Tactic: 0 Time: 0.003904 [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:25] [V] [TRT] Tactic: 0 time 0.003904 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 0 Time: 0.003904 [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:25] [V] [TRT] Tactic: 0 time 0.002528 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 0 Time: 0.002528 [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:25] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:25] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:25] [V] [TRT] Tactic: 0 time 0.00416 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00416 [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:25] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:25] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 456) [Shuffle] (Shuffle) [08/05/2021-07:27:25] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:25] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 456) [Shuffle] (Shuffle) [08/05/2021-07:27:25] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:25] [V] [TRT] Tactic: 0 time 0.004064 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 0 Time: 0.004064 [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:25] [V] [TRT] Tactic: 0 time 0.003584 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 0 Time: 0.003584 [08/05/2021-07:27:25] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: LeakyRelu_257 (PointWise) [08/05/2021-07:27:25] [V] [TRT] Tactic: 128 time 0.002816 [08/05/2021-07:27:25] [V] [TRT] Tactic: 256 time 0.00368 [08/05/2021-07:27:25] [V] [TRT] Tactic: 512 time 0.003968 [08/05/2021-07:27:25] [V] [TRT] Tactic: -32 time 0.014176 [08/05/2021-07:27:25] [V] [TRT] Tactic: -64 time 0.008736 [08/05/2021-07:27:25] [V] [TRT] Tactic: -128 time 0.005984 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 128 Time: 0.002816 [08/05/2021-07:27:25] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: LeakyRelu_257 (PointWise) [08/05/2021-07:27:25] [V] [TRT] Tactic: 128 time 0.004224 [08/05/2021-07:27:25] [V] [TRT] Tactic: 256 time 0.005312 [08/05/2021-07:27:25] [V] [TRT] Tactic: 512 time 0.005632 [08/05/2021-07:27:25] [V] [TRT] Tactic: -32 time 0.012704 [08/05/2021-07:27:25] [V] [TRT] Tactic: -64 time 0.008192 [08/05/2021-07:27:25] [V] [TRT] Tactic: -128 time 0.005728 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 128 Time: 0.004224 [08/05/2021-07:27:25] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:27:25] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:25] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:25] [V] [TRT] Tactic: 0 time 0.00352 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00352 [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:25] [V] [TRT] Tactic: 0 time 0.002848 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 0 Time: 0.002848 [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:25] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:25] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 460) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:25] [V] [TRT] Tactic: 0 time 0.005856 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 0 Time: 0.005856 [08/05/2021-07:27:25] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 460) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:25] [V] [TRT] Tactic: 0 time 0.014336 [08/05/2021-07:27:25] [V] [TRT] Tactic: 1 time 0.014336 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:25] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:25] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:25] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 461) [Constant] + (Unnamed Layer* 462) [Shuffle], (Unnamed Layer* 463) [ElementWise]), Sigmoid_259) (PointWise) [08/05/2021-07:27:25] [V] [TRT] Tactic: 128 time 0.00384 [08/05/2021-07:27:25] [V] [TRT] Tactic: 256 time 0.003808 [08/05/2021-07:27:25] [V] [TRT] Tactic: 512 time 0.003616 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 512 Time: 0.003616 [08/05/2021-07:27:25] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 461) [Constant] + (Unnamed Layer* 462) [Shuffle], (Unnamed Layer* 463) [ElementWise]), Sigmoid_259) (PointWise) [08/05/2021-07:27:25] [V] [TRT] Tactic: 128 time 0.004064 [08/05/2021-07:27:25] [V] [TRT] Tactic: 256 time 0.003872 [08/05/2021-07:27:25] [V] [TRT] Tactic: 512 time 0.002784 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 512 Time: 0.002784 [08/05/2021-07:27:25] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:25] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:25] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:25] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:25] [V] [TRT] Tactic: 0 time 0.026368 [08/05/2021-07:27:25] [V] [TRT] Fastest Tactic: 0 Time: 0.026368 [08/05/2021-07:27:25] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.023584 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.023584 [08/05/2021-07:27:26] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 467) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.02496 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.02496 [08/05/2021-07:27:26] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 467) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.021152 [08/05/2021-07:27:26] [V] [TRT] Tactic: 1 time 0.014144 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 1 Time: 0.014144 [08/05/2021-07:27:26] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:26] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.003296 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.003296 [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:26] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 470) [ElementWise] (ElementWise) [08/05/2021-07:27:26] [V] [TRT] Tactic: 1 time 0.00368 [08/05/2021-07:27:26] [V] [TRT] Tactic: 2 time 0.008064 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 1 Time: 0.00368 [08/05/2021-07:27:26] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 470) [ElementWise] (ElementWise) [08/05/2021-07:27:26] [V] [TRT] Tactic: 1 time 0.002752 [08/05/2021-07:27:26] [V] [TRT] Tactic: 2 time 0.006144 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 1 Time: 0.002752 [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.002912 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.002912 [08/05/2021-07:27:26] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: BatchNormalization_261 (Shuffle) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.002496 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.002496 [08/05/2021-07:27:26] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: BatchNormalization_261 (Shuffle) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.00336 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.00336 [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.002496 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.002496 [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.00544 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.00544 [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.00352 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.00352 [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.005504 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.005504 [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.004192 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.004192 [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.00416 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.00416 [08/05/2021-07:27:26] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 472) [Scale] (Scale) [08/05/2021-07:27:26] [V] [TRT] Tactic: 0 time 0.003904 [08/05/2021-07:27:26] [V] [TRT] Fastest Tactic: 0 Time: 0.003904 [08/05/2021-07:27:26] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:26] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 472) [Scale] (Scale) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.003808 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003808 [08/05/2021-07:27:27] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 472) [Scale] (Scale) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.003744 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003744 [08/05/2021-07:27:27] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 472) [Scale] (Scale) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.004 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 0 Time: 0.004 [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.003616 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003616 [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.002848 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 0 Time: 0.002848 [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.00416 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00416 [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:27] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 473) [Shuffle] (Shuffle) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:27] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 473) [Shuffle] (Shuffle) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.003744 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003744 [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.002848 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 0 Time: 0.002848 [08/05/2021-07:27:27] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: LeakyRelu_262 (PointWise) [08/05/2021-07:27:27] [V] [TRT] Tactic: 128 time 0.003712 [08/05/2021-07:27:27] [V] [TRT] Tactic: 256 time 0.002816 [08/05/2021-07:27:27] [V] [TRT] Tactic: 512 time 0.003872 [08/05/2021-07:27:27] [V] [TRT] Tactic: -32 time 0.014336 [08/05/2021-07:27:27] [V] [TRT] Tactic: -64 time 0.008192 [08/05/2021-07:27:27] [V] [TRT] Tactic: -128 time 0.006144 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 256 Time: 0.002816 [08/05/2021-07:27:27] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: LeakyRelu_262 (PointWise) [08/05/2021-07:27:27] [V] [TRT] Tactic: 128 time 0.004864 [08/05/2021-07:27:27] [V] [TRT] Tactic: 256 time 0.0048 [08/05/2021-07:27:27] [V] [TRT] Tactic: 512 time 0.0048 [08/05/2021-07:27:27] [V] [TRT] Tactic: -32 time 0.012832 [08/05/2021-07:27:27] [V] [TRT] Tactic: -64 time 0.008064 [08/05/2021-07:27:27] [V] [TRT] Tactic: -128 time 0.004864 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 256 Time: 0.0048 [08/05/2021-07:27:27] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:27:27] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.002848 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 0 Time: 0.002848 [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:27] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 477) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.004864 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [08/05/2021-07:27:27] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 477) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.014752 [08/05/2021-07:27:27] [V] [TRT] Tactic: 1 time 0.014336 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 1 Time: 0.014336 [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:27:27] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 478) [Constant] + (Unnamed Layer* 479) [Shuffle], (Unnamed Layer* 480) [ElementWise]), Sigmoid_264) (PointWise) [08/05/2021-07:27:27] [V] [TRT] Tactic: 128 time 0.003616 [08/05/2021-07:27:27] [V] [TRT] Tactic: 256 time 0.002816 [08/05/2021-07:27:27] [V] [TRT] Tactic: 512 time 0.004064 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 256 Time: 0.002816 [08/05/2021-07:27:27] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 478) [Constant] + (Unnamed Layer* 479) [Shuffle], (Unnamed Layer* 480) [ElementWise]), Sigmoid_264) (PointWise) [08/05/2021-07:27:27] [V] [TRT] Tactic: 128 time 0.003872 [08/05/2021-07:27:27] [V] [TRT] Tactic: 256 time 0.003904 [08/05/2021-07:27:27] [V] [TRT] Tactic: 512 time 0.002848 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 512 Time: 0.002848 [08/05/2021-07:27:27] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:27] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:27] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:27] [V] [TRT] Tactic: 0 time 0.003808 [08/05/2021-07:27:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003808 [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.00352 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00352 [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.025344 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.025344 [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.02288 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.02288 [08/05/2021-07:27:28] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 484) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.023616 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.023616 [08/05/2021-07:27:28] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 484) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.021504 [08/05/2021-07:27:28] [V] [TRT] Tactic: 1 time 0.013888 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 1 Time: 0.013888 [08/05/2021-07:27:28] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:28] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.00384 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00384 [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.003488 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003488 [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:28] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 487) [ElementWise] (ElementWise) [08/05/2021-07:27:28] [V] [TRT] Tactic: 1 time 0.002848 [08/05/2021-07:27:28] [V] [TRT] Tactic: 2 time 0.008 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 1 Time: 0.002848 [08/05/2021-07:27:28] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 487) [ElementWise] (ElementWise) [08/05/2021-07:27:28] [V] [TRT] Tactic: 1 time 0.003808 [08/05/2021-07:27:28] [V] [TRT] Tactic: 2 time 0.005824 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 1 Time: 0.003808 [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.003328 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003328 [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.003424 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003424 [08/05/2021-07:27:28] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: BatchNormalization_266 (Shuffle) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:28] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: BatchNormalization_266 (Shuffle) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.002496 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002496 [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.005536 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.005536 [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.003456 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.004064 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004064 [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:28] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:28] [V] [TRT] Tactic: 0 time 0.004256 [08/05/2021-07:27:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004256 [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:29] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 489) [Scale] (Scale) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:29] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 489) [Scale] (Scale) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:29] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 489) [Scale] (Scale) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:27:29] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 489) [Scale] (Scale) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.002688 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.00336 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.00336 [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.003488 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.003488 [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:29] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 490) [Shuffle] (Shuffle) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.003488 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.003488 [08/05/2021-07:27:29] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 490) [Shuffle] (Shuffle) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.002592 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.002592 [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:29] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_267 (PointWise) [08/05/2021-07:27:29] [V] [TRT] Tactic: 128 time 0.004096 [08/05/2021-07:27:29] [V] [TRT] Tactic: 256 time 0.003808 [08/05/2021-07:27:29] [V] [TRT] Tactic: 512 time 0.003936 [08/05/2021-07:27:29] [V] [TRT] Tactic: -32 time 0.013344 [08/05/2021-07:27:29] [V] [TRT] Tactic: -64 time 0.008576 [08/05/2021-07:27:29] [V] [TRT] Tactic: -128 time 0.006144 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 256 Time: 0.003808 [08/05/2021-07:27:29] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_267 (PointWise) [08/05/2021-07:27:29] [V] [TRT] Tactic: 128 time 0.006528 [08/05/2021-07:27:29] [V] [TRT] Tactic: 256 time 0.0048 [08/05/2021-07:27:29] [V] [TRT] Tactic: 512 time 0.005312 [08/05/2021-07:27:29] [V] [TRT] Tactic: -32 time 0.010976 [08/05/2021-07:27:29] [V] [TRT] Tactic: -64 time 0.007648 [08/05/2021-07:27:29] [V] [TRT] Tactic: -128 time 0.004736 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: -128 Time: 0.004736 [08/05/2021-07:27:29] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:27:29] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.003232 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.003232 [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.004032 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.004032 [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.003488 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.003488 [08/05/2021-07:27:29] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 494) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.004832 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.004832 [08/05/2021-07:27:29] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 494) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.01504 [08/05/2021-07:27:29] [V] [TRT] Tactic: 1 time 0.014784 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 1 Time: 0.014784 [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:29] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:29] [V] [TRT] Tactic: 0 time 0.002688 [08/05/2021-07:27:29] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [08/05/2021-07:27:29] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 495) [Constant] + (Unnamed Layer* 496) [Shuffle], (Unnamed Layer* 497) [ElementWise]), Sigmoid_269) (PointWise) [08/05/2021-07:27:30] [V] [TRT] Tactic: 128 time 0.00368 [08/05/2021-07:27:30] [V] [TRT] Tactic: 256 time 0.003744 [08/05/2021-07:27:30] [V] [TRT] Tactic: 512 time 0.00384 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 128 Time: 0.00368 [08/05/2021-07:27:30] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 495) [Constant] + (Unnamed Layer* 496) [Shuffle], (Unnamed Layer* 497) [ElementWise]), Sigmoid_269) (PointWise) [08/05/2021-07:27:30] [V] [TRT] Tactic: 128 time 0.00384 [08/05/2021-07:27:30] [V] [TRT] Tactic: 256 time 0.00384 [08/05/2021-07:27:30] [V] [TRT] Tactic: 512 time 0.004096 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 128 Time: 0.00384 [08/05/2021-07:27:30] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:30] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.026176 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.026176 [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.023296 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.023296 [08/05/2021-07:27:30] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 501) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.02352 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.02352 [08/05/2021-07:27:30] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 501) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.020928 [08/05/2021-07:27:30] [V] [TRT] Tactic: 1 time 0.01328 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 1 Time: 0.01328 [08/05/2021-07:27:30] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:30] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.003936 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.003936 [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:30] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 504) [ElementWise] (ElementWise) [08/05/2021-07:27:30] [V] [TRT] Tactic: 1 time 0.003168 [08/05/2021-07:27:30] [V] [TRT] Tactic: 2 time 0.008032 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 1 Time: 0.003168 [08/05/2021-07:27:30] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 504) [ElementWise] (ElementWise) [08/05/2021-07:27:30] [V] [TRT] Tactic: 1 time 0.003808 [08/05/2021-07:27:30] [V] [TRT] Tactic: 2 time 0.00592 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 1 Time: 0.003808 [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:27:30] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: BatchNormalization_271 (Shuffle) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:30] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: BatchNormalization_271 (Shuffle) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.00256 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.00256 [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.004544 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004544 [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.004864 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.002912 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.002912 [08/05/2021-07:27:30] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:30] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.004224 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.004224 [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:31] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 506) [Scale] (Scale) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:27:31] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 506) [Scale] (Scale) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.00288 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.00288 [08/05/2021-07:27:31] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 506) [Scale] (Scale) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.003936 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.003936 [08/05/2021-07:27:31] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 506) [Scale] (Scale) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.003392 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.003392 [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.003232 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.003232 [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.002944 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.002944 [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.00288 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.00288 [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:31] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 507) [Shuffle] (Shuffle) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.003296 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.003296 [08/05/2021-07:27:31] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 507) [Shuffle] (Shuffle) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.002976 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.002976 [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.003424 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.003424 [08/05/2021-07:27:31] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: LeakyRelu_272 (PointWise) [08/05/2021-07:27:31] [V] [TRT] Tactic: 128 time 0.00384 [08/05/2021-07:27:31] [V] [TRT] Tactic: 256 time 0.003936 [08/05/2021-07:27:31] [V] [TRT] Tactic: 512 time 0.003872 [08/05/2021-07:27:31] [V] [TRT] Tactic: -32 time 0.013056 [08/05/2021-07:27:31] [V] [TRT] Tactic: -64 time 0.008192 [08/05/2021-07:27:31] [V] [TRT] Tactic: -128 time 0.006144 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 128 Time: 0.00384 [08/05/2021-07:27:31] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: LeakyRelu_272 (PointWise) [08/05/2021-07:27:31] [V] [TRT] Tactic: 128 time 0.004608 [08/05/2021-07:27:31] [V] [TRT] Tactic: 256 time 0.00464 [08/05/2021-07:27:31] [V] [TRT] Tactic: 512 time 0.005376 [08/05/2021-07:27:31] [V] [TRT] Tactic: -32 time 0.012288 [08/05/2021-07:27:31] [V] [TRT] Tactic: -64 time 0.008192 [08/05/2021-07:27:31] [V] [TRT] Tactic: -128 time 0.006016 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 128 Time: 0.004608 [08/05/2021-07:27:31] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:27:31] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.0032 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.0032 [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.003488 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.003488 [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:27:31] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 511) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.005056 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.005056 [08/05/2021-07:27:31] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:31] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 511) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:31] [V] [TRT] Tactic: 0 time 0.014336 [08/05/2021-07:27:31] [V] [TRT] Tactic: 1 time 0.014336 [08/05/2021-07:27:31] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:32] [V] [TRT] Tactic: 0 time 0.002848 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 0 Time: 0.002848 [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:32] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:32] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 512) [Constant] + (Unnamed Layer* 513) [Shuffle], (Unnamed Layer* 514) [ElementWise]), Sigmoid_274) (PointWise) [08/05/2021-07:27:32] [V] [TRT] Tactic: 128 time 0.002784 [08/05/2021-07:27:32] [V] [TRT] Tactic: 256 time 0.003808 [08/05/2021-07:27:32] [V] [TRT] Tactic: 512 time 0.004096 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 128 Time: 0.002784 [08/05/2021-07:27:32] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 512) [Constant] + (Unnamed Layer* 513) [Shuffle], (Unnamed Layer* 514) [ElementWise]), Sigmoid_274) (PointWise) [08/05/2021-07:27:32] [V] [TRT] Tactic: 128 time 0.004 [08/05/2021-07:27:32] [V] [TRT] Tactic: 256 time 0.003008 [08/05/2021-07:27:32] [V] [TRT] Tactic: 512 time 0.003904 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 256 Time: 0.003008 [08/05/2021-07:27:32] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:32] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:32] [V] [TRT] Tactic: 0 time 0.004 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004 [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:32] [V] [TRT] Tactic: 0 time 0.00384 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 0 Time: 0.00384 [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:32] [V] [TRT] Tactic: 0 time 0.02624 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 0 Time: 0.02624 [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:32] [V] [TRT] Tactic: 0 time 0.023456 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 0 Time: 0.023456 [08/05/2021-07:27:32] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 518) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:32] [V] [TRT] Tactic: 0 time 0.023072 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 0 Time: 0.023072 [08/05/2021-07:27:32] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 518) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:32] [V] [TRT] Tactic: 0 time 0.020576 [08/05/2021-07:27:32] [V] [TRT] Tactic: 1 time 0.014368 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 1 Time: 0.014368 [08/05/2021-07:27:32] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:32] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:32] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:32] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:32] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:32] [V] [TRT] Tactic: 0 time 0.002912 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 0 Time: 0.002912 [08/05/2021-07:27:32] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 521) [ElementWise] (ElementWise) [08/05/2021-07:27:32] [V] [TRT] Tactic: 1 time 0.003776 [08/05/2021-07:27:32] [V] [TRT] Tactic: 2 time 0.008192 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 1 Time: 0.003776 [08/05/2021-07:27:32] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 521) [ElementWise] (ElementWise) [08/05/2021-07:27:32] [V] [TRT] Tactic: 1 time 0.004128 [08/05/2021-07:27:32] [V] [TRT] Tactic: 2 time 0.005952 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 1 Time: 0.004128 [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:32] [V] [TRT] Tactic: 0 time 0.003744 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 0 Time: 0.003744 [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:32] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:32] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: BatchNormalization_276 (Shuffle) [08/05/2021-07:27:32] [V] [TRT] Tactic: 0 time 0.003264 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 0 Time: 0.003264 [08/05/2021-07:27:32] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: BatchNormalization_276 (Shuffle) [08/05/2021-07:27:32] [V] [TRT] Tactic: 0 time 0.00256 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 0 Time: 0.00256 [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:32] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:32] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:32] [V] [TRT] Tactic: 0 time 0.005632 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 0 Time: 0.005632 [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:32] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:32] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:32] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:32] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.005664 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.005664 [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.003584 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.003584 [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.002976 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.002976 [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:33] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 523) [Scale] (Scale) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.004032 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.004032 [08/05/2021-07:27:33] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 523) [Scale] (Scale) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:27:33] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 523) [Scale] (Scale) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.004 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.004 [08/05/2021-07:27:33] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 523) [Scale] (Scale) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.003904 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.003904 [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.003808 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.003808 [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.002848 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.002848 [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.003136 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.003136 [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.004544 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.004544 [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.004576 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.004576 [08/05/2021-07:27:33] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 524) [Shuffle] (Shuffle) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:33] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 524) [Shuffle] (Shuffle) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.002976 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.002976 [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.002528 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.002528 [08/05/2021-07:27:33] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: LeakyRelu_277 (PointWise) [08/05/2021-07:27:33] [V] [TRT] Tactic: 128 time 0.003808 [08/05/2021-07:27:33] [V] [TRT] Tactic: 256 time 0.003712 [08/05/2021-07:27:33] [V] [TRT] Tactic: 512 time 0.00368 [08/05/2021-07:27:33] [V] [TRT] Tactic: -32 time 0.01392 [08/05/2021-07:27:33] [V] [TRT] Tactic: -64 time 0.008192 [08/05/2021-07:27:33] [V] [TRT] Tactic: -128 time 0.006112 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 512 Time: 0.00368 [08/05/2021-07:27:33] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: LeakyRelu_277 (PointWise) [08/05/2021-07:27:33] [V] [TRT] Tactic: 128 time 0.0048 [08/05/2021-07:27:33] [V] [TRT] Tactic: 256 time 0.005568 [08/05/2021-07:27:33] [V] [TRT] Tactic: 512 time 0.005056 [08/05/2021-07:27:33] [V] [TRT] Tactic: -32 time 0.01248 [08/05/2021-07:27:33] [V] [TRT] Tactic: -64 time 0.007936 [08/05/2021-07:27:33] [V] [TRT] Tactic: -128 time 0.004992 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 128 Time: 0.0048 [08/05/2021-07:27:33] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:27:33] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.002944 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.002944 [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:33] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:33] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:27:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:27:34] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 528) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.004768 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 0 Time: 0.004768 [08/05/2021-07:27:34] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 528) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.014336 [08/05/2021-07:27:34] [V] [TRT] Tactic: 1 time 0.014688 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:34] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 529) [Constant] + (Unnamed Layer* 530) [Shuffle], (Unnamed Layer* 531) [ElementWise]), Sigmoid_279) (PointWise) [08/05/2021-07:27:34] [V] [TRT] Tactic: 128 time 0.003392 [08/05/2021-07:27:34] [V] [TRT] Tactic: 256 time 0.004096 [08/05/2021-07:27:34] [V] [TRT] Tactic: 512 time 0.004096 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 128 Time: 0.003392 [08/05/2021-07:27:34] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 529) [Constant] + (Unnamed Layer* 530) [Shuffle], (Unnamed Layer* 531) [ElementWise]), Sigmoid_279) (PointWise) [08/05/2021-07:27:34] [V] [TRT] Tactic: 128 time 0.004096 [08/05/2021-07:27:34] [V] [TRT] Tactic: 256 time 0.002816 [08/05/2021-07:27:34] [V] [TRT] Tactic: 512 time 0.003072 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 256 Time: 0.002816 [08/05/2021-07:27:34] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:34] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.02528 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 0 Time: 0.02528 [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.023328 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 0 Time: 0.023328 [08/05/2021-07:27:34] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 535) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.02352 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 0 Time: 0.02352 [08/05/2021-07:27:34] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 535) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.020576 [08/05/2021-07:27:34] [V] [TRT] Tactic: 1 time 0.014336 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 1 Time: 0.014336 [08/05/2021-07:27:34] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:34] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.002944 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 0 Time: 0.002944 [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.00352 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00352 [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:34] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 538) [ElementWise] (ElementWise) [08/05/2021-07:27:34] [V] [TRT] Tactic: 1 time 0.003648 [08/05/2021-07:27:34] [V] [TRT] Tactic: 2 time 0.008064 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 1 Time: 0.003648 [08/05/2021-07:27:34] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 538) [ElementWise] (ElementWise) [08/05/2021-07:27:34] [V] [TRT] Tactic: 1 time 0.003648 [08/05/2021-07:27:34] [V] [TRT] Tactic: 2 time 0.006144 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 1 Time: 0.003648 [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.003488 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 0 Time: 0.003488 [08/05/2021-07:27:34] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: BatchNormalization_281 (Shuffle) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:34] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: BatchNormalization_281 (Shuffle) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.003584 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 0 Time: 0.003584 [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.0048 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0048 [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:34] [V] [TRT] Tactic: 0 time 0.003488 [08/05/2021-07:27:34] [V] [TRT] Fastest Tactic: 0 Time: 0.003488 [08/05/2021-07:27:34] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.005088 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.005088 [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.003488 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.003488 [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:35] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 540) [Scale] (Scale) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.003904 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.003904 [08/05/2021-07:27:35] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 540) [Scale] (Scale) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.003264 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.003264 [08/05/2021-07:27:35] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 540) [Scale] (Scale) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.003904 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.003904 [08/05/2021-07:27:35] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 540) [Scale] (Scale) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.003936 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.003936 [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.002688 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.003456 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.004864 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:35] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 541) [Shuffle] (Shuffle) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:35] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 541) [Shuffle] (Shuffle) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.00288 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00288 [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:35] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: LeakyRelu_282 (PointWise) [08/05/2021-07:27:35] [V] [TRT] Tactic: 128 time 0.004096 [08/05/2021-07:27:35] [V] [TRT] Tactic: 256 time 0.003872 [08/05/2021-07:27:35] [V] [TRT] Tactic: 512 time 0.002976 [08/05/2021-07:27:35] [V] [TRT] Tactic: -32 time 0.013216 [08/05/2021-07:27:35] [V] [TRT] Tactic: -64 time 0.008192 [08/05/2021-07:27:35] [V] [TRT] Tactic: -128 time 0.006016 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 512 Time: 0.002976 [08/05/2021-07:27:35] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: LeakyRelu_282 (PointWise) [08/05/2021-07:27:35] [V] [TRT] Tactic: 128 time 0.00464 [08/05/2021-07:27:35] [V] [TRT] Tactic: 256 time 0.005056 [08/05/2021-07:27:35] [V] [TRT] Tactic: 512 time 0.005088 [08/05/2021-07:27:35] [V] [TRT] Tactic: -32 time 0.012864 [08/05/2021-07:27:35] [V] [TRT] Tactic: -64 time 0.008 [08/05/2021-07:27:35] [V] [TRT] Tactic: -128 time 0.004832 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 128 Time: 0.00464 [08/05/2021-07:27:35] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:27:35] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.003744 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.003744 [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:35] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:35] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:27:35] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:36] [V] [TRT] Tactic: 0 time 0.003328 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 0 Time: 0.003328 [08/05/2021-07:27:36] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 545) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:36] [V] [TRT] Tactic: 0 time 0.004864 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [08/05/2021-07:27:36] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 545) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:36] [V] [TRT] Tactic: 0 time 0.014336 [08/05/2021-07:27:36] [V] [TRT] Tactic: 1 time 0.014336 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:36] [V] [TRT] Tactic: 0 time 0.00336 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 0 Time: 0.00336 [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:36] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:36] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 546) [Constant] + (Unnamed Layer* 547) [Shuffle], (Unnamed Layer* 548) [ElementWise]), Sigmoid_284) (PointWise) [08/05/2021-07:27:36] [V] [TRT] Tactic: 128 time 0.003744 [08/05/2021-07:27:36] [V] [TRT] Tactic: 256 time 0.004 [08/05/2021-07:27:36] [V] [TRT] Tactic: 512 time 0.00336 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 512 Time: 0.00336 [08/05/2021-07:27:36] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 546) [Constant] + (Unnamed Layer* 547) [Shuffle], (Unnamed Layer* 548) [ElementWise]), Sigmoid_284) (PointWise) [08/05/2021-07:27:36] [V] [TRT] Tactic: 128 time 0.003904 [08/05/2021-07:27:36] [V] [TRT] Tactic: 256 time 0.004096 [08/05/2021-07:27:36] [V] [TRT] Tactic: 512 time 0.002784 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 512 Time: 0.002784 [08/05/2021-07:27:36] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:36] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:36] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:36] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:36] [V] [TRT] Tactic: 0 time 0.025536 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 0 Time: 0.025536 [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:36] [V] [TRT] Tactic: 0 time 0.024128 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 0 Time: 0.024128 [08/05/2021-07:27:36] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 552) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:36] [V] [TRT] Tactic: 0 time 0.024192 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 0 Time: 0.024192 [08/05/2021-07:27:36] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 552) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:36] [V] [TRT] Tactic: 0 time 0.021248 [08/05/2021-07:27:36] [V] [TRT] Tactic: 1 time 0.01616 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 1 Time: 0.01616 [08/05/2021-07:27:36] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:36] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:36] [V] [TRT] Tactic: 0 time 0.004064 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 0 Time: 0.004064 [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:36] [V] [TRT] Tactic: 0 time 0.00352 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 0 Time: 0.00352 [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:36] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:36] [V] [TRT] Tactic: 0 time 0.003616 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 0 Time: 0.003616 [08/05/2021-07:27:36] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 555) [ElementWise] (ElementWise) [08/05/2021-07:27:36] [V] [TRT] Tactic: 1 time 0.00368 [08/05/2021-07:27:36] [V] [TRT] Tactic: 2 time 0.008096 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 1 Time: 0.00368 [08/05/2021-07:27:36] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 555) [ElementWise] (ElementWise) [08/05/2021-07:27:36] [V] [TRT] Tactic: 1 time 0.00368 [08/05/2021-07:27:36] [V] [TRT] Tactic: 2 time 0.006016 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 1 Time: 0.00368 [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:36] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:36] [V] [TRT] Tactic: 0 time 0.003744 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 0 Time: 0.003744 [08/05/2021-07:27:36] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: BatchNormalization_286 (Shuffle) [08/05/2021-07:27:36] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:36] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: BatchNormalization_286 (Shuffle) [08/05/2021-07:27:36] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:36] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:27:36] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:36] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:36] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.005344 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.005344 [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.002944 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.002944 [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.003584 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.003584 [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.004672 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004672 [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.003808 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.003808 [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.002304 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.002304 [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.004032 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004032 [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.004256 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004256 [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.004192 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004192 [08/05/2021-07:27:37] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 557) [Scale] (Scale) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:27:37] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 557) [Scale] (Scale) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:27:37] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 557) [Scale] (Scale) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.003904 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.003904 [08/05/2021-07:27:37] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 557) [Scale] (Scale) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.003904 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.003904 [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.003904 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.003904 [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.002848 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.002848 [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.002464 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.002464 [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.00336 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.00336 [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.004256 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004256 [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.00416 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.00416 [08/05/2021-07:27:37] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 558) [Shuffle] (Shuffle) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.003616 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.003616 [08/05/2021-07:27:37] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 558) [Shuffle] (Shuffle) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.003104 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.003104 [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.004032 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004032 [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:37] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:37] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: LeakyRelu_287 (PointWise) [08/05/2021-07:27:37] [V] [TRT] Tactic: 128 time 0.004096 [08/05/2021-07:27:37] [V] [TRT] Tactic: 256 time 0.004096 [08/05/2021-07:27:37] [V] [TRT] Tactic: 512 time 0.003872 [08/05/2021-07:27:37] [V] [TRT] Tactic: -32 time 0.010816 [08/05/2021-07:27:37] [V] [TRT] Tactic: -64 time 0.00672 [08/05/2021-07:27:37] [V] [TRT] Tactic: -128 time 0.004672 [08/05/2021-07:27:37] [V] [TRT] Fastest Tactic: 512 Time: 0.003872 [08/05/2021-07:27:37] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:37] [V] [TRT] --------------- Timing Runner: LeakyRelu_287 (PointWise) [08/05/2021-07:27:38] [V] [TRT] Tactic: 128 time 0.00464 [08/05/2021-07:27:38] [V] [TRT] Tactic: 256 time 0.005472 [08/05/2021-07:27:38] [V] [TRT] Tactic: 512 time 0.004992 [08/05/2021-07:27:38] [V] [TRT] Tactic: -32 time 0.012288 [08/05/2021-07:27:38] [V] [TRT] Tactic: -64 time 0.008544 [08/05/2021-07:27:38] [V] [TRT] Tactic: -128 time 0.005024 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 128 Time: 0.00464 [08/05/2021-07:27:38] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:27:38] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.002944 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 0 Time: 0.002944 [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.003424 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 0 Time: 0.003424 [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.002944 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 0 Time: 0.002944 [08/05/2021-07:27:38] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 562) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.005184 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 0 Time: 0.005184 [08/05/2021-07:27:38] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 562) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.014848 [08/05/2021-07:27:38] [V] [TRT] Tactic: 1 time 0.014464 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 1 Time: 0.014464 [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.003328 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 0 Time: 0.003328 [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.002592 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 0 Time: 0.002592 [08/05/2021-07:27:38] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 563) [Constant] + (Unnamed Layer* 564) [Shuffle], (Unnamed Layer* 565) [ElementWise]), Sigmoid_289) (PointWise) [08/05/2021-07:27:38] [V] [TRT] Tactic: 128 time 0.004096 [08/05/2021-07:27:38] [V] [TRT] Tactic: 256 time 0.003776 [08/05/2021-07:27:38] [V] [TRT] Tactic: 512 time 0.004096 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 256 Time: 0.003776 [08/05/2021-07:27:38] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 563) [Constant] + (Unnamed Layer* 564) [Shuffle], (Unnamed Layer* 565) [ElementWise]), Sigmoid_289) (PointWise) [08/05/2021-07:27:38] [V] [TRT] Tactic: 128 time 0.004096 [08/05/2021-07:27:38] [V] [TRT] Tactic: 256 time 0.004096 [08/05/2021-07:27:38] [V] [TRT] Tactic: 512 time 0.004032 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 512 Time: 0.004032 [08/05/2021-07:27:38] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:38] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.003744 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 0 Time: 0.003744 [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.003552 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 0 Time: 0.003552 [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.025152 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 0 Time: 0.025152 [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.0232 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 0 Time: 0.0232 [08/05/2021-07:27:38] [V] [TRT] *************** Autotuning format combination: Float(1,2048), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 569) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.024224 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 0 Time: 0.024224 [08/05/2021-07:27:38] [V] [TRT] *************** Autotuning format combination: Half(1,2048), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 569) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.02112 [08/05/2021-07:27:38] [V] [TRT] Tactic: 1 time 0.014176 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 1 Time: 0.014176 [08/05/2021-07:27:38] [V] [TRT] *************** Autotuning format combination: -> Float(1,512) *************** [08/05/2021-07:27:38] [V] [TRT] *************** Autotuning format combination: -> Half(1,512) *************** [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.003936 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 0 Time: 0.003936 [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:38] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 572) [ElementWise] (ElementWise) [08/05/2021-07:27:38] [V] [TRT] Tactic: 1 time 0.00304 [08/05/2021-07:27:38] [V] [TRT] Tactic: 2 time 0.008224 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 1 Time: 0.00304 [08/05/2021-07:27:38] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 572) [ElementWise] (ElementWise) [08/05/2021-07:27:38] [V] [TRT] Tactic: 1 time 0.003648 [08/05/2021-07:27:38] [V] [TRT] Tactic: 2 time 0.005952 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 1 Time: 0.003648 [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.002944 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 0 Time: 0.002944 [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.003616 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 0 Time: 0.003616 [08/05/2021-07:27:38] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: BatchNormalization_291 (Shuffle) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.0024 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 0 Time: 0.0024 [08/05/2021-07:27:38] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:38] [V] [TRT] --------------- Timing Runner: BatchNormalization_291 (Shuffle) [08/05/2021-07:27:38] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:38] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.0048 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.0048 [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.004864 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.002976 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.002976 [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.004032 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.004032 [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.004448 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.004448 [08/05/2021-07:27:39] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,1,1,512) *************** [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 574) [Scale] (Scale) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.003904 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.003904 [08/05/2021-07:27:39] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,1,1,512) *************** [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 574) [Scale] (Scale) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.003808 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.003808 [08/05/2021-07:27:39] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,256) -> Half(1,1,1:2,256) *************** [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 574) [Scale] (Scale) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.003904 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.003904 [08/05/2021-07:27:39] [V] [TRT] *************** Autotuning format combination: Half(64,64,1:8,64) -> Half(64,64,1:8,64) *************** [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 574) [Scale] (Scale) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.003936 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.003936 [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:39] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,512) -> Float(1,512) *************** [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 575) [Shuffle] (Shuffle) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:39] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,512) -> Half(1,512) *************** [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 575) [Shuffle] (Shuffle) [08/05/2021-07:27:39] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:39] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:39] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:40] [V] [TRT] *************** Autotuning format combination: Float(1,512) -> Float(1,512) *************** [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: LeakyRelu_292 (PointWise) [08/05/2021-07:27:40] [V] [TRT] Tactic: 128 time 0.003904 [08/05/2021-07:27:40] [V] [TRT] Tactic: 256 time 0.002976 [08/05/2021-07:27:40] [V] [TRT] Tactic: 512 time 0.003904 [08/05/2021-07:27:40] [V] [TRT] Tactic: -32 time 0.014112 [08/05/2021-07:27:40] [V] [TRT] Tactic: -64 time 0.008192 [08/05/2021-07:27:40] [V] [TRT] Tactic: -128 time 0.006112 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 256 Time: 0.002976 [08/05/2021-07:27:40] [V] [TRT] *************** Autotuning format combination: Half(1,512) -> Half(1,512) *************** [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: LeakyRelu_292 (PointWise) [08/05/2021-07:27:40] [V] [TRT] Tactic: 128 time 0.0048 [08/05/2021-07:27:40] [V] [TRT] Tactic: 256 time 0.004384 [08/05/2021-07:27:40] [V] [TRT] Tactic: 512 time 0.00512 [08/05/2021-07:27:40] [V] [TRT] Tactic: -32 time 0.012608 [08/05/2021-07:27:40] [V] [TRT] Tactic: -64 time 0.008192 [08/05/2021-07:27:40] [V] [TRT] Tactic: -128 time 0.005696 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 256 Time: 0.004384 [08/05/2021-07:27:40] [V] [TRT] *************** Autotuning format combination: -> Float(1,1) *************** [08/05/2021-07:27:40] [V] [TRT] *************** Autotuning format combination: -> Half(1,1) *************** [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.003456 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:40] [V] [TRT] *************** Autotuning format combination: Float(1,512), Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 579) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.004896 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004896 [08/05/2021-07:27:40] [V] [TRT] *************** Autotuning format combination: Half(1,512), Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 579) [Matrix Multiply] (MatrixMultiply) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.01456 [08/05/2021-07:27:40] [V] [TRT] Tactic: 1 time 0.014336 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 1 Time: 0.014336 [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.00272 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: (Reformat) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:40] [V] [TRT] *************** Autotuning format combination: Float(1,1) -> Float(1,1) *************** [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 580) [Constant] + (Unnamed Layer* 581) [Shuffle], (Unnamed Layer* 582) [ElementWise]), Sigmoid_294) (PointWise) [08/05/2021-07:27:40] [V] [TRT] Tactic: 128 time 0.00304 [08/05/2021-07:27:40] [V] [TRT] Tactic: 256 time 0.002976 [08/05/2021-07:27:40] [V] [TRT] Tactic: 512 time 0.003872 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 256 Time: 0.002976 [08/05/2021-07:27:40] [V] [TRT] *************** Autotuning format combination: Half(1,1) -> Half(1,1) *************** [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 580) [Constant] + (Unnamed Layer* 581) [Shuffle], (Unnamed Layer* 582) [ElementWise]), Sigmoid_294) (PointWise) [08/05/2021-07:27:40] [V] [TRT] Tactic: 128 time 0.002976 [08/05/2021-07:27:40] [V] [TRT] Tactic: 256 time 0.00336 [08/05/2021-07:27:40] [V] [TRT] Tactic: 512 time 0.003904 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 128 Time: 0.002976 [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: 712 copy (Reformat) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: 712 copy (Reformat) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: 717 copy (Reformat) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.004096 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: 717 copy (Reformat) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: 722 copy (Reformat) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.002976 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 0 Time: 0.002976 [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: 722 copy (Reformat) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: 727 copy (Reformat) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: 727 copy (Reformat) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: 732 copy (Reformat) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: 732 copy (Reformat) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.003456 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: 737 copy (Reformat) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: 737 copy (Reformat) [08/05/2021-07:27:40] [V] [TRT] Tactic: 0 time 0.003168 [08/05/2021-07:27:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003168 [08/05/2021-07:27:40] [V] [TRT] --------------- Timing Runner: 742 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.002976 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.002976 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 742 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.003488 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.003488 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 747 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.003808 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.003808 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 747 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 752 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 752 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 757 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.00368 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00368 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 757 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 762 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.002688 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 762 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 767 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.003296 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.003296 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 767 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.002592 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.002592 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 772 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.003072 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 772 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.002912 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.002912 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 777 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 777 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.002624 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 782 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.00352 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00352 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 782 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.003168 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.003168 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 787 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.003648 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.003648 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 787 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.00256 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00256 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 792 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 792 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 797 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.002752 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 797 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.002944 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.002944 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 802 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.003456 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [08/05/2021-07:27:41] [V] [TRT] --------------- Timing Runner: 802 copy (Reformat) [08/05/2021-07:27:41] [V] [TRT] Tactic: 0 time 0.002816 [08/05/2021-07:27:41] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [08/05/2021-07:27:42] [V] [TRT] --------------- Timing Runner: 807 copy (Reformat) [08/05/2021-07:27:42] [V] [TRT] Tactic: 0 time 0.003776 [08/05/2021-07:27:42] [V] [TRT] Fastest Tactic: 0 Time: 0.003776 [08/05/2021-07:27:42] [V] [TRT] --------------- Timing Runner: 807 copy (Reformat) [08/05/2021-07:27:42] [V] [TRT] Tactic: 0 time 0.003712 [08/05/2021-07:27:42] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [08/05/2021-07:27:42] [V] [TRT] --------------- Timing Runner: 812 copy (Reformat) [08/05/2021-07:27:42] [V] [TRT] Tactic: 0 time 0.002784 [08/05/2021-07:27:42] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [08/05/2021-07:27:42] [V] [TRT] --------------- Timing Runner: 812 copy (Reformat) [08/05/2021-07:27:42] [V] [TRT] Tactic: 0 time 0.002976 [08/05/2021-07:27:42] [V] [TRT] Fastest Tactic: 0 Time: 0.002976 [08/05/2021-07:27:42] [V] [TRT] --------------- Timing Runner: 817 copy (Reformat) [08/05/2021-07:27:42] [V] [TRT] Tactic: 0 time 0.00304 [08/05/2021-07:27:42] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [08/05/2021-07:27:42] [V] [TRT] --------------- Timing Runner: 817 copy (Reformat) [08/05/2021-07:27:42] [V] [TRT] Tactic: 0 time 0.003008 [08/05/2021-07:27:42] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [08/05/2021-07:27:42] [V] [TRT] --------------- Timing Runner: 822 copy (Reformat) [08/05/2021-07:27:42] [V] [TRT] Tactic: 0 time 0.002656 [08/05/2021-07:27:42] [V] [TRT] Fastest Tactic: 0 Time: 0.002656 [08/05/2021-07:27:42] [V] [TRT] --------------- Timing Runner: 822 copy (Reformat) [08/05/2021-07:27:42] [V] [TRT] Tactic: 0 time 0.002976 [08/05/2021-07:27:42] [V] [TRT] Fastest Tactic: 0 Time: 0.002976 [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: Conv_0 + Relu_2 reformatted input 0 (input) from Float(1,144,41472,124416) to Half(1,144,41472:2,82944) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: MaxPool_3 output to be reformatted 0 (529) from Half(8,288,1:8,20736) to Half(1,36,2592:2,82944) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 185) [Shuffle] + Reshape_179 reformatted input 0 (698) from Half(256,256,1:8,256) to Half(1,1,1,2048) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: BatchNormalization_181 reformatted input 0 (708) from Half(1,512) to Float(1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: LeakyRelu_187 reformatted input 0 (714) from Half(1,512) to Float(1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 235) [Shuffle] reformatted input 0 ((Unnamed Layer* 234) [Scale]_output) from Half(1,1,1,512) to Float(1,1,1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: BatchNormalization_196 reformatted input 0 (723) from Half(1,512) to Float(1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 266) [ElementWise] reformatted input 0 ((Unnamed Layer* 263) [Matrix Multiply]_output) from Half(1,512) to Float(1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 285) [Scale] reformatted input 0 ((Unnamed Layer* 284) [Shuffle]_output) from Half(1,1,1,512) to Float(1,1,1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 300) [ElementWise] reformatted input 0 ((Unnamed Layer* 297) [Matrix Multiply]_output) from Half(1,512) to Float(1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 319) [Scale] reformatted input 0 ((Unnamed Layer* 318) [Shuffle]_output) from Half(1,1,1,512) to Half(1,1,1:2,256) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 320) [Shuffle] reformatted input 0 ((Unnamed Layer* 319) [Scale]_output) from Half(1,1,1:2,256) to Float(1,1,1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: LeakyRelu_222 reformatted input 0 (749) from Half(1,512) to Float(1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 353) [Scale] reformatted input 0 ((Unnamed Layer* 352) [Shuffle]_output) from Half(1,1,1,512) to Half(64,64,1:8,64) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 354) [Shuffle] reformatted input 0 ((Unnamed Layer* 353) [Scale]_output) from Half(64,64,1:8,64) to Half(1,1,1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: LeakyRelu_227 reformatted input 0 (754) from Half(1,512) to Float(1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 368) [ElementWise] reformatted input 0 ((Unnamed Layer* 365) [Matrix Multiply]_output) from Half(1,512) to Float(1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: BatchNormalization_236 reformatted input 0 (763) from Half(1,512) to Float(1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: LeakyRelu_242 reformatted input 0 (769) from Half(1,512) to Float(1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 421) [Scale] reformatted input 0 ((Unnamed Layer* 420) [Shuffle]_output) from Half(1,1,1,512) to Float(1,1,1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 439) [Shuffle] reformatted input 0 ((Unnamed Layer* 438) [Scale]_output) from Half(1,1,1,512) to Float(1,1,1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 453) [ElementWise] reformatted input 0 ((Unnamed Layer* 450) [Matrix Multiply]_output) from Half(1,512) to Float(1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 472) [Scale] reformatted input 0 ((Unnamed Layer* 471) [Shuffle]_output) from Half(1,1,1,512) to Half(1,1,1:2,256) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 473) [Shuffle] reformatted input 0 ((Unnamed Layer* 472) [Scale]_output) from Half(1,1,1:2,256) to Float(1,1,1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 489) [Scale] reformatted input 0 ((Unnamed Layer* 488) [Shuffle]_output) from Half(1,1,1,512) to Half(64,64,1:8,64) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 490) [Shuffle] reformatted input 0 ((Unnamed Layer* 489) [Scale]_output) from Half(64,64,1:8,64) to Half(1,1,1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: LeakyRelu_267 reformatted input 0 (794) from Half(1,512) to Float(1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 507) [Shuffle] reformatted input 0 ((Unnamed Layer* 506) [Scale]_output) from Half(1,1,1,512) to Float(1,1,1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: LeakyRelu_277 reformatted input 0 (804) from Half(1,512) to Float(1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 540) [Scale] reformatted input 0 ((Unnamed Layer* 539) [Shuffle]_output) from Half(1,1,1,512) to Half(1,1,1:2,256) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 541) [Shuffle] reformatted input 0 ((Unnamed Layer* 540) [Scale]_output) from Half(1,1,1:2,256) to Float(1,1,1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 557) [Scale] reformatted input 0 ((Unnamed Layer* 556) [Shuffle]_output) from Half(1,1,1,512) to Half(1,1,1:2,256) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 558) [Shuffle] reformatted input 0 ((Unnamed Layer* 557) [Scale]_output) from Half(1,1,1:2,256) to Float(1,1,1,512) [08/05/2021-07:27:42] [V] [TRT] Adding reformat layer: (Unnamed Layer* 572) [ElementWise] reformatted input 0 ((Unnamed Layer* 569) [Matrix Multiply]_output) from Half(1,512) to Float(1,512) [08/05/2021-07:27:42] [V] [TRT] For layer BatchNormalization_181 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 200) [Scale] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 201) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_182 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 204) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 205) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 206) [Constant] + (Unnamed Layer* 207) [Shuffle], (Unnamed Layer* 208) [ElementWise]), Sigmoid_184) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_187 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 221) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 222) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 223) [Constant] + (Unnamed Layer* 224) [Shuffle], (Unnamed Layer* 225) [ElementWise]), Sigmoid_189) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 235) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_192 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 238) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 239) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 240) [Constant] + (Unnamed Layer* 241) [Shuffle], (Unnamed Layer* 242) [ElementWise]), Sigmoid_194) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer BatchNormalization_196 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 251) [Scale] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 252) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_197 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 255) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 256) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 257) [Constant] + (Unnamed Layer* 258) [Shuffle], (Unnamed Layer* 259) [ElementWise]), Sigmoid_199) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 264) [Constant] + (Unnamed Layer* 265) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 266) [ElementWise] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer BatchNormalization_201 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 268) [Scale] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 269) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_202 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 272) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 273) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 274) [Constant] + (Unnamed Layer* 275) [Shuffle], (Unnamed Layer* 276) [ElementWise]), Sigmoid_204) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 285) [Scale] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 286) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_207 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 289) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 290) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 291) [Constant] + (Unnamed Layer* 292) [Shuffle], (Unnamed Layer* 293) [ElementWise]), Sigmoid_209) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 298) [Constant] + (Unnamed Layer* 299) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 300) [ElementWise] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer BatchNormalization_211 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 302) [Scale] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 303) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_212 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 306) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 307) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 308) [Constant] + (Unnamed Layer* 309) [Shuffle], (Unnamed Layer* 310) [ElementWise]), Sigmoid_214) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 320) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_217 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 323) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 324) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 325) [Constant] + (Unnamed Layer* 326) [Shuffle], (Unnamed Layer* 327) [ElementWise]), Sigmoid_219) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_222 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 340) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 341) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 342) [Constant] + (Unnamed Layer* 343) [Shuffle], (Unnamed Layer* 344) [ElementWise]), Sigmoid_224) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_227 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 357) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 358) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 359) [Constant] + (Unnamed Layer* 360) [Shuffle], (Unnamed Layer* 361) [ElementWise]), Sigmoid_229) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 366) [Constant] + (Unnamed Layer* 367) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 368) [ElementWise] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer BatchNormalization_231 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 370) [Scale] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 371) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_232 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 374) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 375) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 376) [Constant] + (Unnamed Layer* 377) [Shuffle], (Unnamed Layer* 378) [ElementWise]), Sigmoid_234) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer BatchNormalization_236 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 387) [Scale] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 388) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_237 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 391) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 392) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 393) [Constant] + (Unnamed Layer* 394) [Shuffle], (Unnamed Layer* 395) [ElementWise]), Sigmoid_239) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_242 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 408) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 409) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 410) [Constant] + (Unnamed Layer* 411) [Shuffle], (Unnamed Layer* 412) [ElementWise]), Sigmoid_244) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 421) [Scale] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 422) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_247 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 425) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 426) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 427) [Constant] + (Unnamed Layer* 428) [Shuffle], (Unnamed Layer* 429) [ElementWise]), Sigmoid_249) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 439) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_252 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 442) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 443) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 444) [Constant] + (Unnamed Layer* 445) [Shuffle], (Unnamed Layer* 446) [ElementWise]), Sigmoid_254) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 451) [Constant] + (Unnamed Layer* 452) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 453) [ElementWise] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer BatchNormalization_256 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 455) [Scale] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 456) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_257 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 459) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 460) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 461) [Constant] + (Unnamed Layer* 462) [Shuffle], (Unnamed Layer* 463) [ElementWise]), Sigmoid_259) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 473) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_262 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 476) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 477) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 478) [Constant] + (Unnamed Layer* 479) [Shuffle], (Unnamed Layer* 480) [ElementWise]), Sigmoid_264) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_267 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 493) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 494) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 495) [Constant] + (Unnamed Layer* 496) [Shuffle], (Unnamed Layer* 497) [ElementWise]), Sigmoid_269) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 507) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_272 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 510) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 511) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 512) [Constant] + (Unnamed Layer* 513) [Shuffle], (Unnamed Layer* 514) [ElementWise]), Sigmoid_274) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_277 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 527) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 528) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 529) [Constant] + (Unnamed Layer* 530) [Shuffle], (Unnamed Layer* 531) [ElementWise]), Sigmoid_279) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 541) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_282 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 544) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 545) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 546) [Constant] + (Unnamed Layer* 547) [Shuffle], (Unnamed Layer* 548) [ElementWise]), Sigmoid_284) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 558) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_287 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 561) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 562) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 563) [Constant] + (Unnamed Layer* 564) [Shuffle], (Unnamed Layer* 565) [ElementWise]), Sigmoid_289) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 570) [Constant] + (Unnamed Layer* 571) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 572) [ElementWise] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer BatchNormalization_291 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 574) [Scale] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 575) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer LeakyRelu_292 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 578) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer (Unnamed Layer* 579) [Matrix Multiply] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 580) [Constant] + (Unnamed Layer* 581) [Shuffle], (Unnamed Layer* 582) [ElementWise]), Sigmoid_294) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [08/05/2021-07:27:42] [V] [TRT] Formats and tactics selection completed in 108.227 seconds. [08/05/2021-07:27:42] [V] [TRT] After reformat layers: 366 layers [08/05/2021-07:27:42] [V] [TRT] Block size 2097152000 [08/05/2021-07:27:42] [V] [TRT] Block size 39813120 [08/05/2021-07:27:42] [V] [TRT] Block size 39813120 [08/05/2021-07:27:42] [V] [TRT] Block size 19906560 [08/05/2021-07:27:42] [V] [TRT] Block size 9953280 [08/05/2021-07:27:42] [V] [TRT] Block size 512 [08/05/2021-07:27:42] [V] [TRT] Block size 512 [08/05/2021-07:27:42] [V] [TRT] Block size 512 [08/05/2021-07:27:42] [V] [TRT] Block size 512 [08/05/2021-07:27:42] [V] [TRT] Block size 512 [08/05/2021-07:27:42] [V] [TRT] Block size 512 [08/05/2021-07:27:42] [V] [TRT] Block size 512 [08/05/2021-07:27:42] [V] [TRT] Block size 512 [08/05/2021-07:27:42] [V] [TRT] Block size 512 [08/05/2021-07:27:42] [V] [TRT] Block size 512 [08/05/2021-07:27:42] [V] [TRT] Block size 512 [08/05/2021-07:27:42] [V] [TRT] Block size 512 [08/05/2021-07:27:42] [V] [TRT] Block size 512 [08/05/2021-07:27:42] [V] [TRT] Block size 512 [08/05/2021-07:27:42] [V] [TRT] Block size 512 [08/05/2021-07:27:42] [V] [TRT] Block size 512 [08/05/2021-07:27:42] [V] [TRT] Block size 512 [08/05/2021-07:27:42] [V] [TRT] Block size 512 [08/05/2021-07:27:42] [V] [TRT] Block size 512 [08/05/2021-07:27:42] [V] [TRT] Block size 512 [08/05/2021-07:27:42] [V] [TRT] Block size 512 [08/05/2021-07:27:42] [V] [TRT] Block size 0 [08/05/2021-07:27:42] [V] [TRT] Block size 0 [08/05/2021-07:27:42] [V] [TRT] Total Activation Memory: 2206648832 [08/05/2021-07:27:42] [I] [TRT] Detected 1 inputs and 24 output network tensors. [08/05/2021-07:27:42] [V] [TRT] Conv_0 + Relu_2 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_4 + Relu_6 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_7 + Relu_9 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_10 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_12 + Add_14 + Relu_15 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_16 + Relu_18 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_19 + Relu_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_22 + Add_24 + Relu_25 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_26 + Relu_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_29 + Relu_31 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_32 + Add_34 + Relu_35 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_36 + Relu_38 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_39 + Relu_41 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_42 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_44 + Add_46 + Relu_47 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_48 + Relu_50 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_51 + Relu_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_54 + Add_56 + Relu_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_58 + Relu_60 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_61 + Relu_63 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_64 + Add_66 + Relu_67 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_68 + Relu_70 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_71 + Relu_73 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_74 + Add_76 + Relu_77 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_78 + Relu_80 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_81 + Relu_83 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_84 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_86 + Add_88 + Relu_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_90 + Relu_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_93 + Relu_95 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_96 + Add_98 + Relu_99 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_100 + Relu_102 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_103 + Relu_105 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_106 + Add_108 + Relu_109 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_110 + Relu_112 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_113 + Relu_115 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_116 + Add_118 + Relu_119 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_120 + Relu_122 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_123 + Relu_125 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_126 + Add_128 + Relu_129 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_130 + Relu_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_133 + Relu_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_136 + Add_138 + Relu_139 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_140 + Relu_142 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_143 + Relu_145 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_146 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_148 + Add_150 + Relu_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_152 + Relu_154 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_155 + Relu_157 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_158 + Add_160 + Relu_161 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_162 + Relu_164 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_165 + Relu_167 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Conv_168 + Add_170 + Relu_171 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [08/05/2021-07:27:42] [V] [TRT] Engine generation completed in 109.585 seconds. [08/05/2021-07:27:42] [V] [TRT] Engine Layer Information: [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): Conv_0 + Relu_2 input reformatter 0, Tactic: 0, input[Float(3,288,144)] -> Conv_0 + Relu_2 reformatted input 0[Half(3,288,144)] [08/05/2021-07:27:42] [V] [TRT] Layer(hcudnn): Conv_0 + Relu_2, Tactic: 1651411198763708804, Conv_0 + Relu_2 reformatted input 0[Half(3,288,144)] -> 528[Half(64,144,72)] [08/05/2021-07:27:42] [V] [TRT] Layer(PoolingTiled): MaxPool_3, Tactic: 6947073, 528[Half(64,144,72)] -> MaxPool_3 output to be reformatted 0[Half(64,72,36)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): MaxPool_3 output reformatter 0, Tactic: 0, MaxPool_3 output to be reformatted 0[Half(64,72,36)] -> 529[Half(64,72,36)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_4 + Relu_6, Tactic: -8992262742606384444, 529[Half(64,72,36)] -> 532[Half(64,72,36)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_7 + Relu_9, Tactic: -8992262742606384444, 532[Half(64,72,36)] -> 535[Half(64,72,36)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_10, Tactic: -3136088851200285532, 535[Half(64,72,36)] -> 537[Half(256,72,36)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_12 + Add_14 + Relu_15, Tactic: 3041642431972138763, 529[Half(64,72,36)], 537[Half(256,72,36)] -> 541[Half(256,72,36)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_16 + Relu_18, Tactic: 4555462412611657028, 541[Half(256,72,36)] -> 544[Half(64,72,36)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_19 + Relu_21, Tactic: -8992262742606384444, 544[Half(64,72,36)] -> 547[Half(64,72,36)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_22 + Add_24 + Relu_25, Tactic: -229563042944049199, 547[Half(64,72,36)], 541[Half(256,72,36)] -> 551[Half(256,72,36)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_26 + Relu_28, Tactic: 3041642431972138763, 551[Half(256,72,36)] -> 554[Half(64,72,36)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_29 + Relu_31, Tactic: 2148106709480872763, 554[Half(64,72,36)] -> 557[Half(64,72,36)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_32 + Add_34 + Relu_35, Tactic: 3041642431972138763, 557[Half(64,72,36)], 551[Half(256,72,36)] -> 561[Half(256,72,36)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_36 + Relu_38, Tactic: -229563042944049199, 561[Half(256,72,36)] -> 564[Half(128,72,36)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_39 + Relu_41, Tactic: -3136088851200285532, 564[Half(128,72,36)] -> 567[Half(128,36,18)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_42, Tactic: -3136088851200285532, 567[Half(128,36,18)] -> 569[Half(512,36,18)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_44 + Add_46 + Relu_47, Tactic: 3041642431972138763, 561[Half(256,72,36)], 569[Half(512,36,18)] -> 573[Half(512,36,18)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_48 + Relu_50, Tactic: -3136088851200285532, 573[Half(512,36,18)] -> 576[Half(128,36,18)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_51 + Relu_53, Tactic: -3136088851200285532, 576[Half(128,36,18)] -> 579[Half(128,36,18)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_54 + Add_56 + Relu_57, Tactic: 3041642431972138763, 579[Half(128,36,18)], 573[Half(512,36,18)] -> 583[Half(512,36,18)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_58 + Relu_60, Tactic: -3136088851200285532, 583[Half(512,36,18)] -> 586[Half(128,36,18)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_61 + Relu_63, Tactic: -3136088851200285532, 586[Half(128,36,18)] -> 589[Half(128,36,18)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_64 + Add_66 + Relu_67, Tactic: 3041642431972138763, 589[Half(128,36,18)], 583[Half(512,36,18)] -> 593[Half(512,36,18)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_68 + Relu_70, Tactic: -3136088851200285532, 593[Half(512,36,18)] -> 596[Half(128,36,18)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_71 + Relu_73, Tactic: -229563042944049199, 596[Half(128,36,18)] -> 599[Half(128,36,18)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_74 + Add_76 + Relu_77, Tactic: 3041642431972138763, 599[Half(128,36,18)], 593[Half(512,36,18)] -> 603[Half(512,36,18)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_78 + Relu_80, Tactic: 3041642431972138763, 603[Half(512,36,18)] -> 606[Half(256,36,18)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_81 + Relu_83, Tactic: -3136088851200285532, 606[Half(256,36,18)] -> 609[Half(256,18,9)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_84, Tactic: -1216445540764179377, 609[Half(256,18,9)] -> 611[Half(1024,18,9)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_86 + Add_88 + Relu_89, Tactic: 3041642431972138763, 603[Half(512,36,18)], 611[Half(1024,18,9)] -> 615[Half(1024,18,9)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_90 + Relu_92, Tactic: -3136088851200285532, 615[Half(1024,18,9)] -> 618[Half(256,18,9)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_93 + Relu_95, Tactic: -3136088851200285532, 618[Half(256,18,9)] -> 621[Half(256,18,9)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_96 + Add_98 + Relu_99, Tactic: -1216445540764179377, 621[Half(256,18,9)], 615[Half(1024,18,9)] -> 625[Half(1024,18,9)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_100 + Relu_102, Tactic: -3136088851200285532, 625[Half(1024,18,9)] -> 628[Half(256,18,9)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_103 + Relu_105, Tactic: -3136088851200285532, 628[Half(256,18,9)] -> 631[Half(256,18,9)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_106 + Add_108 + Relu_109, Tactic: -1216445540764179377, 631[Half(256,18,9)], 625[Half(1024,18,9)] -> 635[Half(1024,18,9)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_110 + Relu_112, Tactic: -3136088851200285532, 635[Half(1024,18,9)] -> 638[Half(256,18,9)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_113 + Relu_115, Tactic: -3136088851200285532, 638[Half(256,18,9)] -> 641[Half(256,18,9)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_116 + Add_118 + Relu_119, Tactic: -1216445540764179377, 641[Half(256,18,9)], 635[Half(1024,18,9)] -> 645[Half(1024,18,9)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_120 + Relu_122, Tactic: -3136088851200285532, 645[Half(1024,18,9)] -> 648[Half(256,18,9)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_123 + Relu_125, Tactic: -3136088851200285532, 648[Half(256,18,9)] -> 651[Half(256,18,9)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_126 + Add_128 + Relu_129, Tactic: -1216445540764179377, 651[Half(256,18,9)], 645[Half(1024,18,9)] -> 655[Half(1024,18,9)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_130 + Relu_132, Tactic: -3136088851200285532, 655[Half(1024,18,9)] -> 658[Half(256,18,9)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_133 + Relu_135, Tactic: -3136088851200285532, 658[Half(256,18,9)] -> 661[Half(256,18,9)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_136 + Add_138 + Relu_139, Tactic: -2586046817576862066, 661[Half(256,18,9)], 655[Half(1024,18,9)] -> 665[Half(1024,18,9)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_140 + Relu_142, Tactic: -229563042944049199, 665[Half(1024,18,9)] -> 668[Half(512,18,9)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_143 + Relu_145, Tactic: -3136088851200285532, 668[Half(512,18,9)] -> 671[Half(512,9,5)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_146, Tactic: 3041642431972138763, 671[Half(512,9,5)] -> 673[Half(2048,9,5)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_148 + Add_150 + Relu_151, Tactic: -3136088851200285532, 665[Half(1024,18,9)], 673[Half(2048,9,5)] -> 677[Half(2048,9,5)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_152 + Relu_154, Tactic: -3136088851200285532, 677[Half(2048,9,5)] -> 680[Half(512,9,5)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_155 + Relu_157, Tactic: -3136088851200285532, 680[Half(512,9,5)] -> 683[Half(512,9,5)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_158 + Add_160 + Relu_161, Tactic: 3041642431972138763, 683[Half(512,9,5)], 677[Half(2048,9,5)] -> 687[Half(2048,9,5)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_162 + Relu_164, Tactic: -3136088851200285532, 687[Half(2048,9,5)] -> 690[Half(512,9,5)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_165 + Relu_167, Tactic: -3136088851200285532, 690[Half(512,9,5)] -> 693[Half(512,9,5)] [08/05/2021-07:27:42] [V] [TRT] Layer(h1688cudnn): Conv_168 + Add_170 + Relu_171, Tactic: -3136088851200285532, 693[Half(512,9,5)], 687[Half(2048,9,5)] -> 697[Half(2048,9,5)] [08/05/2021-07:27:42] [V] [TRT] Layer(Pooling): GlobalAveragePool_172, Tactic: -2, 697[Half(2048,9,5)] -> 698[Half(2048,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 194) [Constant], Tactic: 0, -> (Unnamed Layer* 194) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 195) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 194) [Constant]_output[Half(512)] -> (Unnamed Layer* 195) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 196) [Constant] + (Unnamed Layer* 197) [Shuffle], Tactic: 0, -> (Unnamed Layer* 197) [Shuffle]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 198) [ElementWise], Tactic: 1, (Unnamed Layer* 195) [Matrix Multiply]_output[Half(512)], (Unnamed Layer* 197) [Shuffle]_output[Half(512)] -> 708[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): BatchNormalization_181 input reformatter 0, Tactic: 0, 708[Half(512)] -> BatchNormalization_181 reformatted input 0[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 200) [Scale], Tactic: 0, (Unnamed Layer* 199) [Shuffle]_output[Float(512,1,1)] -> (Unnamed Layer* 200) [Scale]_output[Float(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_182, Tactic: 512, 709[Float(512)] -> 710[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 204) [Constant], Tactic: 0, -> (Unnamed Layer* 204) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 205) [Matrix Multiply], Tactic: 0, 710[Float(512)], (Unnamed Layer* 204) [Constant]_output[Float(1)] -> (Unnamed Layer* 205) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 206) [Constant] + (Unnamed Layer* 207) [Shuffle], (Unnamed Layer* 208) [ElementWise]), Sigmoid_184), Tactic: 128, (Unnamed Layer* 205) [Matrix Multiply]_output[Float(1)] -> 712[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 211) [Constant], Tactic: 0, -> (Unnamed Layer* 211) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 212) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 211) [Constant]_output[Half(512)] -> (Unnamed Layer* 212) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 213) [Constant] + (Unnamed Layer* 214) [Shuffle], Tactic: 0, -> (Unnamed Layer* 214) [Shuffle]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 215) [ElementWise], Tactic: 1, (Unnamed Layer* 212) [Matrix Multiply]_output[Half(512)], (Unnamed Layer* 214) [Shuffle]_output[Half(512)] -> 713[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 217) [Scale], Tactic: 0, (Unnamed Layer* 216) [Shuffle]_output[Half(512,1,1)] -> (Unnamed Layer* 217) [Scale]_output[Half(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): LeakyRelu_187 input reformatter 0, Tactic: 0, 714[Half(512)] -> LeakyRelu_187 reformatted input 0[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_187, Tactic: 512, LeakyRelu_187 reformatted input 0[Float(512)] -> 715[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 221) [Constant], Tactic: 0, -> (Unnamed Layer* 221) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 222) [Matrix Multiply], Tactic: 0, 715[Float(512)], (Unnamed Layer* 221) [Constant]_output[Float(1)] -> (Unnamed Layer* 222) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 223) [Constant] + (Unnamed Layer* 224) [Shuffle], (Unnamed Layer* 225) [ElementWise]), Sigmoid_189), Tactic: 512, (Unnamed Layer* 222) [Matrix Multiply]_output[Float(1)] -> 717[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 228) [Constant], Tactic: 0, -> (Unnamed Layer* 228) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 229) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 228) [Constant]_output[Half(512)] -> (Unnamed Layer* 229) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 230) [Constant] + (Unnamed Layer* 231) [Shuffle], Tactic: 0, -> (Unnamed Layer* 231) [Shuffle]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 232) [ElementWise], Tactic: 1, (Unnamed Layer* 229) [Matrix Multiply]_output[Half(512)], (Unnamed Layer* 231) [Shuffle]_output[Half(512)] -> 718[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 234) [Scale], Tactic: 0, (Unnamed Layer* 233) [Shuffle]_output[Half(512,1,1)] -> (Unnamed Layer* 234) [Scale]_output[Half(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): (Unnamed Layer* 235) [Shuffle] input reformatter 0, Tactic: 0, (Unnamed Layer* 234) [Scale]_output[Half(512,1,1)] -> (Unnamed Layer* 235) [Shuffle] reformatted input 0[Float(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_192, Tactic: 128, 719[Float(512)] -> 720[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 238) [Constant], Tactic: 0, -> (Unnamed Layer* 238) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 239) [Matrix Multiply], Tactic: 0, 720[Float(512)], (Unnamed Layer* 238) [Constant]_output[Float(1)] -> (Unnamed Layer* 239) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 240) [Constant] + (Unnamed Layer* 241) [Shuffle], (Unnamed Layer* 242) [ElementWise]), Sigmoid_194), Tactic: 256, (Unnamed Layer* 239) [Matrix Multiply]_output[Float(1)] -> 722[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 245) [Constant], Tactic: 0, -> (Unnamed Layer* 245) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 246) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 245) [Constant]_output[Half(512)] -> (Unnamed Layer* 246) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 247) [Constant] + (Unnamed Layer* 248) [Shuffle], Tactic: 0, -> (Unnamed Layer* 248) [Shuffle]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 249) [ElementWise], Tactic: 1, (Unnamed Layer* 246) [Matrix Multiply]_output[Half(512)], (Unnamed Layer* 248) [Shuffle]_output[Half(512)] -> 723[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): BatchNormalization_196 input reformatter 0, Tactic: 0, 723[Half(512)] -> BatchNormalization_196 reformatted input 0[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 251) [Scale], Tactic: 0, (Unnamed Layer* 250) [Shuffle]_output[Float(512,1,1)] -> (Unnamed Layer* 251) [Scale]_output[Float(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_197, Tactic: 128, 724[Float(512)] -> 725[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 255) [Constant], Tactic: 0, -> (Unnamed Layer* 255) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 256) [Matrix Multiply], Tactic: 0, 725[Float(512)], (Unnamed Layer* 255) [Constant]_output[Float(1)] -> (Unnamed Layer* 256) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 257) [Constant] + (Unnamed Layer* 258) [Shuffle], (Unnamed Layer* 259) [ElementWise]), Sigmoid_199), Tactic: 256, (Unnamed Layer* 256) [Matrix Multiply]_output[Float(1)] -> 727[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 262) [Constant], Tactic: 0, -> (Unnamed Layer* 262) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 263) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 262) [Constant]_output[Half(512)] -> (Unnamed Layer* 263) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 264) [Constant] + (Unnamed Layer* 265) [Shuffle], Tactic: 0, -> (Unnamed Layer* 265) [Shuffle]_output[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): (Unnamed Layer* 266) [ElementWise] input reformatter 0, Tactic: 0, (Unnamed Layer* 263) [Matrix Multiply]_output[Half(512)] -> (Unnamed Layer* 266) [ElementWise] reformatted input 0[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 266) [ElementWise], Tactic: 1, (Unnamed Layer* 266) [ElementWise] reformatted input 0[Float(512)], (Unnamed Layer* 265) [Shuffle]_output[Float(512)] -> 728[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 268) [Scale], Tactic: 0, (Unnamed Layer* 267) [Shuffle]_output[Float(512,1,1)] -> (Unnamed Layer* 268) [Scale]_output[Float(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_202, Tactic: 128, 729[Float(512)] -> 730[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 272) [Constant], Tactic: 0, -> (Unnamed Layer* 272) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 273) [Matrix Multiply], Tactic: 0, 730[Float(512)], (Unnamed Layer* 272) [Constant]_output[Float(1)] -> (Unnamed Layer* 273) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 274) [Constant] + (Unnamed Layer* 275) [Shuffle], (Unnamed Layer* 276) [ElementWise]), Sigmoid_204), Tactic: 512, (Unnamed Layer* 273) [Matrix Multiply]_output[Float(1)] -> 732[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 279) [Constant], Tactic: 0, -> (Unnamed Layer* 279) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 280) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 279) [Constant]_output[Half(512)] -> (Unnamed Layer* 280) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 281) [Constant] + (Unnamed Layer* 282) [Shuffle], Tactic: 0, -> (Unnamed Layer* 282) [Shuffle]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 283) [ElementWise], Tactic: 1, (Unnamed Layer* 280) [Matrix Multiply]_output[Half(512)], (Unnamed Layer* 282) [Shuffle]_output[Half(512)] -> 733[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): (Unnamed Layer* 285) [Scale] input reformatter 0, Tactic: 0, (Unnamed Layer* 284) [Shuffle]_output[Half(512,1,1)] -> (Unnamed Layer* 285) [Scale] reformatted input 0[Float(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 285) [Scale], Tactic: 0, (Unnamed Layer* 285) [Scale] reformatted input 0[Float(512,1,1)] -> (Unnamed Layer* 285) [Scale]_output[Float(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_207, Tactic: 128, 734[Float(512)] -> 735[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 289) [Constant], Tactic: 0, -> (Unnamed Layer* 289) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 290) [Matrix Multiply], Tactic: 0, 735[Float(512)], (Unnamed Layer* 289) [Constant]_output[Float(1)] -> (Unnamed Layer* 290) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 291) [Constant] + (Unnamed Layer* 292) [Shuffle], (Unnamed Layer* 293) [ElementWise]), Sigmoid_209), Tactic: 256, (Unnamed Layer* 290) [Matrix Multiply]_output[Float(1)] -> 737[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 296) [Constant], Tactic: 0, -> (Unnamed Layer* 296) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 297) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 296) [Constant]_output[Half(512)] -> (Unnamed Layer* 297) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 298) [Constant] + (Unnamed Layer* 299) [Shuffle], Tactic: 0, -> (Unnamed Layer* 299) [Shuffle]_output[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): (Unnamed Layer* 300) [ElementWise] input reformatter 0, Tactic: 0, (Unnamed Layer* 297) [Matrix Multiply]_output[Half(512)] -> (Unnamed Layer* 300) [ElementWise] reformatted input 0[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 300) [ElementWise], Tactic: 1, (Unnamed Layer* 300) [ElementWise] reformatted input 0[Float(512)], (Unnamed Layer* 299) [Shuffle]_output[Float(512)] -> 738[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 302) [Scale], Tactic: 0, (Unnamed Layer* 301) [Shuffle]_output[Float(512,1,1)] -> (Unnamed Layer* 302) [Scale]_output[Float(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_212, Tactic: 128, 739[Float(512)] -> 740[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 306) [Constant], Tactic: 0, -> (Unnamed Layer* 306) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 307) [Matrix Multiply], Tactic: 0, 740[Float(512)], (Unnamed Layer* 306) [Constant]_output[Float(1)] -> (Unnamed Layer* 307) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 308) [Constant] + (Unnamed Layer* 309) [Shuffle], (Unnamed Layer* 310) [ElementWise]), Sigmoid_214), Tactic: 512, (Unnamed Layer* 307) [Matrix Multiply]_output[Float(1)] -> 742[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 313) [Constant], Tactic: 0, -> (Unnamed Layer* 313) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 314) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 313) [Constant]_output[Half(512)] -> (Unnamed Layer* 314) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 315) [Constant] + (Unnamed Layer* 316) [Shuffle], Tactic: 0, -> (Unnamed Layer* 316) [Shuffle]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 317) [ElementWise], Tactic: 1, (Unnamed Layer* 314) [Matrix Multiply]_output[Half(512)], (Unnamed Layer* 316) [Shuffle]_output[Half(512)] -> 743[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 319) [Scale], Tactic: 0, (Unnamed Layer* 319) [Scale] reformatted input 0[Half(512,1,1)] -> (Unnamed Layer* 319) [Scale]_output[Half(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): (Unnamed Layer* 320) [Shuffle] input reformatter 0, Tactic: 0, (Unnamed Layer* 319) [Scale]_output[Half(512,1,1)] -> (Unnamed Layer* 320) [Shuffle] reformatted input 0[Float(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_217, Tactic: 256, 744[Float(512)] -> 745[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 323) [Constant], Tactic: 0, -> (Unnamed Layer* 323) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 324) [Matrix Multiply], Tactic: 0, 745[Float(512)], (Unnamed Layer* 323) [Constant]_output[Float(1)] -> (Unnamed Layer* 324) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 325) [Constant] + (Unnamed Layer* 326) [Shuffle], (Unnamed Layer* 327) [ElementWise]), Sigmoid_219), Tactic: 512, (Unnamed Layer* 324) [Matrix Multiply]_output[Float(1)] -> 747[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 330) [Constant], Tactic: 0, -> (Unnamed Layer* 330) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 331) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 330) [Constant]_output[Half(512)] -> (Unnamed Layer* 331) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 332) [Constant] + (Unnamed Layer* 333) [Shuffle], Tactic: 0, -> (Unnamed Layer* 333) [Shuffle]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 334) [ElementWise], Tactic: 1, (Unnamed Layer* 331) [Matrix Multiply]_output[Half(512)], (Unnamed Layer* 333) [Shuffle]_output[Half(512)] -> 748[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 336) [Scale], Tactic: 0, (Unnamed Layer* 335) [Shuffle]_output[Half(512,1,1)] -> (Unnamed Layer* 336) [Scale]_output[Half(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): LeakyRelu_222 input reformatter 0, Tactic: 0, 749[Half(512)] -> LeakyRelu_222 reformatted input 0[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_222, Tactic: 128, LeakyRelu_222 reformatted input 0[Float(512)] -> 750[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 340) [Constant], Tactic: 0, -> (Unnamed Layer* 340) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 341) [Matrix Multiply], Tactic: 0, 750[Float(512)], (Unnamed Layer* 340) [Constant]_output[Float(1)] -> (Unnamed Layer* 341) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 342) [Constant] + (Unnamed Layer* 343) [Shuffle], (Unnamed Layer* 344) [ElementWise]), Sigmoid_224), Tactic: 256, (Unnamed Layer* 341) [Matrix Multiply]_output[Float(1)] -> 752[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 347) [Constant], Tactic: 0, -> (Unnamed Layer* 347) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 348) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 347) [Constant]_output[Half(512)] -> (Unnamed Layer* 348) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 349) [Constant] + (Unnamed Layer* 350) [Shuffle], Tactic: 0, -> (Unnamed Layer* 350) [Shuffle]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 351) [ElementWise], Tactic: 1, (Unnamed Layer* 348) [Matrix Multiply]_output[Half(512)], (Unnamed Layer* 350) [Shuffle]_output[Half(512)] -> 753[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 353) [Scale], Tactic: 0, (Unnamed Layer* 353) [Scale] reformatted input 0[Half(512,1,1)] -> (Unnamed Layer* 353) [Scale]_output[Half(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): LeakyRelu_227 input reformatter 0, Tactic: 0, 754[Half(512)] -> LeakyRelu_227 reformatted input 0[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_227, Tactic: 256, LeakyRelu_227 reformatted input 0[Float(512)] -> 755[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 357) [Constant], Tactic: 0, -> (Unnamed Layer* 357) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 358) [Matrix Multiply], Tactic: 0, 755[Float(512)], (Unnamed Layer* 357) [Constant]_output[Float(1)] -> (Unnamed Layer* 358) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 359) [Constant] + (Unnamed Layer* 360) [Shuffle], (Unnamed Layer* 361) [ElementWise]), Sigmoid_229), Tactic: 128, (Unnamed Layer* 358) [Matrix Multiply]_output[Float(1)] -> 757[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 364) [Constant], Tactic: 0, -> (Unnamed Layer* 364) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 365) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 364) [Constant]_output[Half(512)] -> (Unnamed Layer* 365) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 366) [Constant] + (Unnamed Layer* 367) [Shuffle], Tactic: 0, -> (Unnamed Layer* 367) [Shuffle]_output[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): (Unnamed Layer* 368) [ElementWise] input reformatter 0, Tactic: 0, (Unnamed Layer* 365) [Matrix Multiply]_output[Half(512)] -> (Unnamed Layer* 368) [ElementWise] reformatted input 0[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 368) [ElementWise], Tactic: 1, (Unnamed Layer* 368) [ElementWise] reformatted input 0[Float(512)], (Unnamed Layer* 367) [Shuffle]_output[Float(512)] -> 758[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 370) [Scale], Tactic: 0, (Unnamed Layer* 369) [Shuffle]_output[Float(512,1,1)] -> (Unnamed Layer* 370) [Scale]_output[Float(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_232, Tactic: 128, 759[Float(512)] -> 760[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 374) [Constant], Tactic: 0, -> (Unnamed Layer* 374) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 375) [Matrix Multiply], Tactic: 0, 760[Float(512)], (Unnamed Layer* 374) [Constant]_output[Float(1)] -> (Unnamed Layer* 375) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 376) [Constant] + (Unnamed Layer* 377) [Shuffle], (Unnamed Layer* 378) [ElementWise]), Sigmoid_234), Tactic: 256, (Unnamed Layer* 375) [Matrix Multiply]_output[Float(1)] -> 762[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 381) [Constant], Tactic: 0, -> (Unnamed Layer* 381) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 382) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 381) [Constant]_output[Half(512)] -> (Unnamed Layer* 382) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 383) [Constant] + (Unnamed Layer* 384) [Shuffle], Tactic: 0, -> (Unnamed Layer* 384) [Shuffle]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 385) [ElementWise], Tactic: 1, (Unnamed Layer* 382) [Matrix Multiply]_output[Half(512)], (Unnamed Layer* 384) [Shuffle]_output[Half(512)] -> 763[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): BatchNormalization_236 input reformatter 0, Tactic: 0, 763[Half(512)] -> BatchNormalization_236 reformatted input 0[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 387) [Scale], Tactic: 0, (Unnamed Layer* 386) [Shuffle]_output[Float(512,1,1)] -> (Unnamed Layer* 387) [Scale]_output[Float(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_237, Tactic: 512, 764[Float(512)] -> 765[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 391) [Constant], Tactic: 0, -> (Unnamed Layer* 391) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 392) [Matrix Multiply], Tactic: 0, 765[Float(512)], (Unnamed Layer* 391) [Constant]_output[Float(1)] -> (Unnamed Layer* 392) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 393) [Constant] + (Unnamed Layer* 394) [Shuffle], (Unnamed Layer* 395) [ElementWise]), Sigmoid_239), Tactic: 256, (Unnamed Layer* 392) [Matrix Multiply]_output[Float(1)] -> 767[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 398) [Constant], Tactic: 0, -> (Unnamed Layer* 398) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 399) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 398) [Constant]_output[Half(512)] -> (Unnamed Layer* 399) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 400) [Constant] + (Unnamed Layer* 401) [Shuffle], Tactic: 0, -> (Unnamed Layer* 401) [Shuffle]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 402) [ElementWise], Tactic: 1, (Unnamed Layer* 399) [Matrix Multiply]_output[Half(512)], (Unnamed Layer* 401) [Shuffle]_output[Half(512)] -> 768[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 404) [Scale], Tactic: 0, (Unnamed Layer* 403) [Shuffle]_output[Half(512,1,1)] -> (Unnamed Layer* 404) [Scale]_output[Half(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): LeakyRelu_242 input reformatter 0, Tactic: 0, 769[Half(512)] -> LeakyRelu_242 reformatted input 0[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_242, Tactic: 256, LeakyRelu_242 reformatted input 0[Float(512)] -> 770[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 408) [Constant], Tactic: 0, -> (Unnamed Layer* 408) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 409) [Matrix Multiply], Tactic: 0, 770[Float(512)], (Unnamed Layer* 408) [Constant]_output[Float(1)] -> (Unnamed Layer* 409) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 410) [Constant] + (Unnamed Layer* 411) [Shuffle], (Unnamed Layer* 412) [ElementWise]), Sigmoid_244), Tactic: 512, (Unnamed Layer* 409) [Matrix Multiply]_output[Float(1)] -> 772[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 415) [Constant], Tactic: 0, -> (Unnamed Layer* 415) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 416) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 415) [Constant]_output[Half(512)] -> (Unnamed Layer* 416) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 417) [Constant] + (Unnamed Layer* 418) [Shuffle], Tactic: 0, -> (Unnamed Layer* 418) [Shuffle]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 419) [ElementWise], Tactic: 1, (Unnamed Layer* 416) [Matrix Multiply]_output[Half(512)], (Unnamed Layer* 418) [Shuffle]_output[Half(512)] -> 773[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): (Unnamed Layer* 421) [Scale] input reformatter 0, Tactic: 0, (Unnamed Layer* 420) [Shuffle]_output[Half(512,1,1)] -> (Unnamed Layer* 421) [Scale] reformatted input 0[Float(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 421) [Scale], Tactic: 0, (Unnamed Layer* 421) [Scale] reformatted input 0[Float(512,1,1)] -> (Unnamed Layer* 421) [Scale]_output[Float(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_247, Tactic: 256, 774[Float(512)] -> 775[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 425) [Constant], Tactic: 0, -> (Unnamed Layer* 425) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 426) [Matrix Multiply], Tactic: 0, 775[Float(512)], (Unnamed Layer* 425) [Constant]_output[Float(1)] -> (Unnamed Layer* 426) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 427) [Constant] + (Unnamed Layer* 428) [Shuffle], (Unnamed Layer* 429) [ElementWise]), Sigmoid_249), Tactic: 512, (Unnamed Layer* 426) [Matrix Multiply]_output[Float(1)] -> 777[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 432) [Constant], Tactic: 0, -> (Unnamed Layer* 432) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 433) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 432) [Constant]_output[Half(512)] -> (Unnamed Layer* 433) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 434) [Constant] + (Unnamed Layer* 435) [Shuffle], Tactic: 0, -> (Unnamed Layer* 435) [Shuffle]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 436) [ElementWise], Tactic: 1, (Unnamed Layer* 433) [Matrix Multiply]_output[Half(512)], (Unnamed Layer* 435) [Shuffle]_output[Half(512)] -> 778[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 438) [Scale], Tactic: 0, (Unnamed Layer* 437) [Shuffle]_output[Half(512,1,1)] -> (Unnamed Layer* 438) [Scale]_output[Half(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): (Unnamed Layer* 439) [Shuffle] input reformatter 0, Tactic: 0, (Unnamed Layer* 438) [Scale]_output[Half(512,1,1)] -> (Unnamed Layer* 439) [Shuffle] reformatted input 0[Float(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_252, Tactic: 256, 779[Float(512)] -> 780[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 442) [Constant], Tactic: 0, -> (Unnamed Layer* 442) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 443) [Matrix Multiply], Tactic: 0, 780[Float(512)], (Unnamed Layer* 442) [Constant]_output[Float(1)] -> (Unnamed Layer* 443) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 444) [Constant] + (Unnamed Layer* 445) [Shuffle], (Unnamed Layer* 446) [ElementWise]), Sigmoid_254), Tactic: 256, (Unnamed Layer* 443) [Matrix Multiply]_output[Float(1)] -> 782[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 449) [Constant], Tactic: 0, -> (Unnamed Layer* 449) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 450) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 449) [Constant]_output[Half(512)] -> (Unnamed Layer* 450) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 451) [Constant] + (Unnamed Layer* 452) [Shuffle], Tactic: 0, -> (Unnamed Layer* 452) [Shuffle]_output[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): (Unnamed Layer* 453) [ElementWise] input reformatter 0, Tactic: 0, (Unnamed Layer* 450) [Matrix Multiply]_output[Half(512)] -> (Unnamed Layer* 453) [ElementWise] reformatted input 0[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 453) [ElementWise], Tactic: 1, (Unnamed Layer* 453) [ElementWise] reformatted input 0[Float(512)], (Unnamed Layer* 452) [Shuffle]_output[Float(512)] -> 783[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 455) [Scale], Tactic: 0, (Unnamed Layer* 454) [Shuffle]_output[Float(512,1,1)] -> (Unnamed Layer* 455) [Scale]_output[Float(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_257, Tactic: 128, 784[Float(512)] -> 785[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 459) [Constant], Tactic: 0, -> (Unnamed Layer* 459) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 460) [Matrix Multiply], Tactic: 0, 785[Float(512)], (Unnamed Layer* 459) [Constant]_output[Float(1)] -> (Unnamed Layer* 460) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 461) [Constant] + (Unnamed Layer* 462) [Shuffle], (Unnamed Layer* 463) [ElementWise]), Sigmoid_259), Tactic: 512, (Unnamed Layer* 460) [Matrix Multiply]_output[Float(1)] -> 787[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 466) [Constant], Tactic: 0, -> (Unnamed Layer* 466) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 467) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 466) [Constant]_output[Half(512)] -> (Unnamed Layer* 467) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 468) [Constant] + (Unnamed Layer* 469) [Shuffle], Tactic: 0, -> (Unnamed Layer* 469) [Shuffle]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 470) [ElementWise], Tactic: 1, (Unnamed Layer* 467) [Matrix Multiply]_output[Half(512)], (Unnamed Layer* 469) [Shuffle]_output[Half(512)] -> 788[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 472) [Scale], Tactic: 0, (Unnamed Layer* 472) [Scale] reformatted input 0[Half(512,1,1)] -> (Unnamed Layer* 472) [Scale]_output[Half(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): (Unnamed Layer* 473) [Shuffle] input reformatter 0, Tactic: 0, (Unnamed Layer* 472) [Scale]_output[Half(512,1,1)] -> (Unnamed Layer* 473) [Shuffle] reformatted input 0[Float(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_262, Tactic: 256, 789[Float(512)] -> 790[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 476) [Constant], Tactic: 0, -> (Unnamed Layer* 476) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 477) [Matrix Multiply], Tactic: 0, 790[Float(512)], (Unnamed Layer* 476) [Constant]_output[Float(1)] -> (Unnamed Layer* 477) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 478) [Constant] + (Unnamed Layer* 479) [Shuffle], (Unnamed Layer* 480) [ElementWise]), Sigmoid_264), Tactic: 256, (Unnamed Layer* 477) [Matrix Multiply]_output[Float(1)] -> 792[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 483) [Constant], Tactic: 0, -> (Unnamed Layer* 483) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 484) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 483) [Constant]_output[Half(512)] -> (Unnamed Layer* 484) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 485) [Constant] + (Unnamed Layer* 486) [Shuffle], Tactic: 0, -> (Unnamed Layer* 486) [Shuffle]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 487) [ElementWise], Tactic: 1, (Unnamed Layer* 484) [Matrix Multiply]_output[Half(512)], (Unnamed Layer* 486) [Shuffle]_output[Half(512)] -> 793[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 489) [Scale], Tactic: 0, (Unnamed Layer* 489) [Scale] reformatted input 0[Half(512,1,1)] -> (Unnamed Layer* 489) [Scale]_output[Half(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): LeakyRelu_267 input reformatter 0, Tactic: 0, 794[Half(512)] -> LeakyRelu_267 reformatted input 0[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_267, Tactic: 256, LeakyRelu_267 reformatted input 0[Float(512)] -> 795[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 493) [Constant], Tactic: 0, -> (Unnamed Layer* 493) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 494) [Matrix Multiply], Tactic: 0, 795[Float(512)], (Unnamed Layer* 493) [Constant]_output[Float(1)] -> (Unnamed Layer* 494) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 495) [Constant] + (Unnamed Layer* 496) [Shuffle], (Unnamed Layer* 497) [ElementWise]), Sigmoid_269), Tactic: 128, (Unnamed Layer* 494) [Matrix Multiply]_output[Float(1)] -> 797[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 500) [Constant], Tactic: 0, -> (Unnamed Layer* 500) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 501) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 500) [Constant]_output[Half(512)] -> (Unnamed Layer* 501) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 502) [Constant] + (Unnamed Layer* 503) [Shuffle], Tactic: 0, -> (Unnamed Layer* 503) [Shuffle]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 504) [ElementWise], Tactic: 1, (Unnamed Layer* 501) [Matrix Multiply]_output[Half(512)], (Unnamed Layer* 503) [Shuffle]_output[Half(512)] -> 798[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 506) [Scale], Tactic: 0, (Unnamed Layer* 505) [Shuffle]_output[Half(512,1,1)] -> (Unnamed Layer* 506) [Scale]_output[Half(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): (Unnamed Layer* 507) [Shuffle] input reformatter 0, Tactic: 0, (Unnamed Layer* 506) [Scale]_output[Half(512,1,1)] -> (Unnamed Layer* 507) [Shuffle] reformatted input 0[Float(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_272, Tactic: 128, 799[Float(512)] -> 800[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 510) [Constant], Tactic: 0, -> (Unnamed Layer* 510) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 511) [Matrix Multiply], Tactic: 0, 800[Float(512)], (Unnamed Layer* 510) [Constant]_output[Float(1)] -> (Unnamed Layer* 511) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 512) [Constant] + (Unnamed Layer* 513) [Shuffle], (Unnamed Layer* 514) [ElementWise]), Sigmoid_274), Tactic: 128, (Unnamed Layer* 511) [Matrix Multiply]_output[Float(1)] -> 802[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 517) [Constant], Tactic: 0, -> (Unnamed Layer* 517) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 518) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 517) [Constant]_output[Half(512)] -> (Unnamed Layer* 518) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 519) [Constant] + (Unnamed Layer* 520) [Shuffle], Tactic: 0, -> (Unnamed Layer* 520) [Shuffle]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 521) [ElementWise], Tactic: 1, (Unnamed Layer* 518) [Matrix Multiply]_output[Half(512)], (Unnamed Layer* 520) [Shuffle]_output[Half(512)] -> 803[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 523) [Scale], Tactic: 0, (Unnamed Layer* 522) [Shuffle]_output[Half(512,1,1)] -> (Unnamed Layer* 523) [Scale]_output[Half(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): LeakyRelu_277 input reformatter 0, Tactic: 0, 804[Half(512)] -> LeakyRelu_277 reformatted input 0[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_277, Tactic: 512, LeakyRelu_277 reformatted input 0[Float(512)] -> 805[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 527) [Constant], Tactic: 0, -> (Unnamed Layer* 527) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 528) [Matrix Multiply], Tactic: 0, 805[Float(512)], (Unnamed Layer* 527) [Constant]_output[Float(1)] -> (Unnamed Layer* 528) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 529) [Constant] + (Unnamed Layer* 530) [Shuffle], (Unnamed Layer* 531) [ElementWise]), Sigmoid_279), Tactic: 128, (Unnamed Layer* 528) [Matrix Multiply]_output[Float(1)] -> 807[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 534) [Constant], Tactic: 0, -> (Unnamed Layer* 534) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 535) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 534) [Constant]_output[Half(512)] -> (Unnamed Layer* 535) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 536) [Constant] + (Unnamed Layer* 537) [Shuffle], Tactic: 0, -> (Unnamed Layer* 537) [Shuffle]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 538) [ElementWise], Tactic: 1, (Unnamed Layer* 535) [Matrix Multiply]_output[Half(512)], (Unnamed Layer* 537) [Shuffle]_output[Half(512)] -> 808[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 540) [Scale], Tactic: 0, (Unnamed Layer* 540) [Scale] reformatted input 0[Half(512,1,1)] -> (Unnamed Layer* 540) [Scale]_output[Half(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): (Unnamed Layer* 541) [Shuffle] input reformatter 0, Tactic: 0, (Unnamed Layer* 540) [Scale]_output[Half(512,1,1)] -> (Unnamed Layer* 541) [Shuffle] reformatted input 0[Float(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_282, Tactic: 512, 809[Float(512)] -> 810[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 544) [Constant], Tactic: 0, -> (Unnamed Layer* 544) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 545) [Matrix Multiply], Tactic: 0, 810[Float(512)], (Unnamed Layer* 544) [Constant]_output[Float(1)] -> (Unnamed Layer* 545) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 546) [Constant] + (Unnamed Layer* 547) [Shuffle], (Unnamed Layer* 548) [ElementWise]), Sigmoid_284), Tactic: 512, (Unnamed Layer* 545) [Matrix Multiply]_output[Float(1)] -> 812[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 551) [Constant], Tactic: 0, -> (Unnamed Layer* 551) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 552) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 551) [Constant]_output[Half(512)] -> (Unnamed Layer* 552) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 553) [Constant] + (Unnamed Layer* 554) [Shuffle], Tactic: 0, -> (Unnamed Layer* 554) [Shuffle]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 555) [ElementWise], Tactic: 1, (Unnamed Layer* 552) [Matrix Multiply]_output[Half(512)], (Unnamed Layer* 554) [Shuffle]_output[Half(512)] -> 813[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 557) [Scale], Tactic: 0, (Unnamed Layer* 557) [Scale] reformatted input 0[Half(512,1,1)] -> (Unnamed Layer* 557) [Scale]_output[Half(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): (Unnamed Layer* 558) [Shuffle] input reformatter 0, Tactic: 0, (Unnamed Layer* 557) [Scale]_output[Half(512,1,1)] -> (Unnamed Layer* 558) [Shuffle] reformatted input 0[Float(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_287, Tactic: 512, 814[Float(512)] -> 815[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 561) [Constant], Tactic: 0, -> (Unnamed Layer* 561) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 562) [Matrix Multiply], Tactic: 0, 815[Float(512)], (Unnamed Layer* 561) [Constant]_output[Float(1)] -> (Unnamed Layer* 562) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 563) [Constant] + (Unnamed Layer* 564) [Shuffle], (Unnamed Layer* 565) [ElementWise]), Sigmoid_289), Tactic: 256, (Unnamed Layer* 562) [Matrix Multiply]_output[Float(1)] -> 817[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 568) [Constant], Tactic: 0, -> (Unnamed Layer* 568) [Constant]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 569) [Matrix Multiply], Tactic: 1, 707[Half(2048)], (Unnamed Layer* 568) [Constant]_output[Half(512)] -> (Unnamed Layer* 569) [Matrix Multiply]_output[Half(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 570) [Constant] + (Unnamed Layer* 571) [Shuffle], Tactic: 0, -> (Unnamed Layer* 571) [Shuffle]_output[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): (Unnamed Layer* 572) [ElementWise] input reformatter 0, Tactic: 0, (Unnamed Layer* 569) [Matrix Multiply]_output[Half(512)] -> (Unnamed Layer* 572) [ElementWise] reformatted input 0[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 572) [ElementWise], Tactic: 1, (Unnamed Layer* 572) [ElementWise] reformatted input 0[Float(512)], (Unnamed Layer* 571) [Shuffle]_output[Float(512)] -> 818[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Scale): (Unnamed Layer* 574) [Scale], Tactic: 0, (Unnamed Layer* 573) [Shuffle]_output[Float(512,1,1)] -> (Unnamed Layer* 574) [Scale]_output[Float(512,1,1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): LeakyRelu_292, Tactic: 256, 819[Float(512)] -> 820[Float(512)] [08/05/2021-07:27:42] [V] [TRT] Layer(Constant): (Unnamed Layer* 578) [Constant], Tactic: 0, -> (Unnamed Layer* 578) [Constant]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(MatrixMultiply): (Unnamed Layer* 579) [Matrix Multiply], Tactic: 0, 820[Float(512)], (Unnamed Layer* 578) [Constant]_output[Float(1)] -> (Unnamed Layer* 579) [Matrix Multiply]_output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(PointWise): PWN(PWN((Unnamed Layer* 580) [Constant] + (Unnamed Layer* 581) [Shuffle], (Unnamed Layer* 582) [ElementWise]), Sigmoid_294), Tactic: 256, (Unnamed Layer* 579) [Matrix Multiply]_output[Float(1)] -> 822[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 712 copy, Tactic: 0, 712[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 717 copy, Tactic: 0, 717[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 722 copy, Tactic: 0, 722[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 727 copy, Tactic: 0, 727[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 732 copy, Tactic: 0, 732[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 737 copy, Tactic: 0, 737[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 742 copy, Tactic: 0, 742[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 747 copy, Tactic: 0, 747[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 752 copy, Tactic: 0, 752[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 757 copy, Tactic: 0, 757[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 762 copy, Tactic: 0, 762[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 767 copy, Tactic: 0, 767[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 772 copy, Tactic: 0, 772[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 777 copy, Tactic: 0, 777[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 782 copy, Tactic: 0, 782[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 787 copy, Tactic: 0, 787[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 792 copy, Tactic: 0, 792[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 797 copy, Tactic: 0, 797[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 802 copy, Tactic: 0, 802[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 807 copy, Tactic: 0, 807[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 812 copy, Tactic: 0, 812[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 817 copy, Tactic: 0, 817[Float(1)] -> output[Float(1)] [08/05/2021-07:27:42] [V] [TRT] Layer(Reformat): 822 copy, Tactic: 0, 822[Float(1)] -> output[Float(1)] [08/05/2021-07:27:47] [I] Warmup completed 0 queries over 200 ms [08/05/2021-07:27:47] [I] Timing trace has 0 queries over 3.00817 s [08/05/2021-07:27:47] [I] Trace averages of 10 runs: [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.82352 ms - Host latency: 3.03312 ms (end to end 5.5058 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.50417 ms - Host latency: 2.7108 ms (end to end 4.83609 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.4738 ms - Host latency: 2.68055 ms (end to end 4.78434 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.46896 ms - Host latency: 2.6757 ms (end to end 4.76125 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.46905 ms - Host latency: 2.67596 ms (end to end 4.76531 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.46761 ms - Host latency: 2.67436 ms (end to end 4.7549 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.46346 ms - Host latency: 2.66997 ms (end to end 4.74619 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.46393 ms - Host latency: 2.67044 ms (end to end 4.75557 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.46192 ms - Host latency: 2.66833 ms (end to end 4.74749 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.46396 ms - Host latency: 2.66999 ms (end to end 4.75373 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47553 ms - Host latency: 2.68095 ms (end to end 4.42448 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.48329 ms - Host latency: 2.68644 ms (end to end 4.79384 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.48386 ms - Host latency: 2.6874 ms (end to end 4.78949 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.48514 ms - Host latency: 2.68883 ms (end to end 4.78932 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.48552 ms - Host latency: 2.69082 ms (end to end 4.78848 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.52394 ms - Host latency: 2.72764 ms (end to end 4.82385 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.54537 ms - Host latency: 2.75332 ms (end to end 4.97069 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47422 ms - Host latency: 2.6813 ms (end to end 4.75892 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47713 ms - Host latency: 2.68378 ms (end to end 4.76353 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47201 ms - Host latency: 2.67944 ms (end to end 4.77148 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47238 ms - Host latency: 2.67903 ms (end to end 4.74725 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47551 ms - Host latency: 2.68289 ms (end to end 4.75483 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47479 ms - Host latency: 2.68231 ms (end to end 4.7806 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.61064 ms - Host latency: 2.81882 ms (end to end 5.00963 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47436 ms - Host latency: 2.68147 ms (end to end 4.79376 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.4726 ms - Host latency: 2.67936 ms (end to end 4.7574 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47273 ms - Host latency: 2.67994 ms (end to end 4.75909 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47349 ms - Host latency: 2.68102 ms (end to end 4.76199 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47325 ms - Host latency: 2.68025 ms (end to end 4.76336 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.51877 ms - Host latency: 2.72571 ms (end to end 4.85263 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.60421 ms - Host latency: 2.81231 ms (end to end 5.05321 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47618 ms - Host latency: 2.68323 ms (end to end 4.79916 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47271 ms - Host latency: 2.67957 ms (end to end 4.78978 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47411 ms - Host latency: 2.68153 ms (end to end 4.76497 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.4722 ms - Host latency: 2.67881 ms (end to end 4.75765 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47178 ms - Host latency: 2.68018 ms (end to end 4.76298 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47523 ms - Host latency: 2.68229 ms (end to end 4.76982 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47457 ms - Host latency: 2.68151 ms (end to end 4.76621 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47445 ms - Host latency: 2.68162 ms (end to end 4.76741 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47203 ms - Host latency: 2.67864 ms (end to end 4.75842 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.4757 ms - Host latency: 2.68396 ms (end to end 4.77744 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.49072 ms - Host latency: 2.69938 ms (end to end 4.79481 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47459 ms - Host latency: 2.6817 ms (end to end 4.76249 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47369 ms - Host latency: 2.68127 ms (end to end 4.76224 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47357 ms - Host latency: 2.68091 ms (end to end 4.75723 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47758 ms - Host latency: 2.68458 ms (end to end 4.76196 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47101 ms - Host latency: 2.67814 ms (end to end 4.75232 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47108 ms - Host latency: 2.67966 ms (end to end 4.74822 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.60962 ms - Host latency: 2.82166 ms (end to end 3.57924 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47145 ms - Host latency: 2.69086 ms (end to end 4.75729 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.60715 ms - Host latency: 2.85306 ms (end to end 5.04938 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47446 ms - Host latency: 2.72229 ms (end to end 4.76807 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47507 ms - Host latency: 2.72095 ms (end to end 4.77383 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.64864 ms - Host latency: 2.96219 ms (end to end 3.71031 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47048 ms - Host latency: 2.71704 ms (end to end 4.67419 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.4752 ms - Host latency: 2.70914 ms (end to end 4.76851 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47164 ms - Host latency: 2.71228 ms (end to end 4.75776 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.74537 ms - Host latency: 3.0762 ms (end to end 3.95653 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.4724 ms - Host latency: 2.72463 ms (end to end 4.32377 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47245 ms - Host latency: 2.70793 ms (end to end 4.75664 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.58593 ms - Host latency: 2.82242 ms (end to end 5.01351 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.50231 ms - Host latency: 2.73347 ms (end to end 4.8423 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47244 ms - Host latency: 2.70844 ms (end to end 4.75968 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47435 ms - Host latency: 2.71022 ms (end to end 4.77576 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47183 ms - Host latency: 2.69972 ms (end to end 4.78323 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.61392 ms - Host latency: 2.84852 ms (end to end 5.07112 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.51023 ms - Host latency: 2.74348 ms (end to end 4.61599 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.48231 ms - Host latency: 2.72162 ms (end to end 4.79155 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.48356 ms - Host latency: 2.72278 ms (end to end 4.78474 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.82308 ms - Host latency: 3.14504 ms (end to end 3.72178 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.59661 ms - Host latency: 2.848 ms (end to end 5.00703 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.50826 ms - Host latency: 2.737 ms (end to end 4.85601 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.57339 ms - Host latency: 2.81434 ms (end to end 4.97952 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.49634 ms - Host latency: 2.73594 ms (end to end 4.81514 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.80459 ms - Host latency: 3.13623 ms (end to end 3.73701 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47271 ms - Host latency: 2.724 ms (end to end 4.71118 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47832 ms - Host latency: 2.71743 ms (end to end 4.77205 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47515 ms - Host latency: 2.70886 ms (end to end 4.77991 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47454 ms - Host latency: 2.70696 ms (end to end 4.76541 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.57505 ms - Host latency: 2.81375 ms (end to end 4.96206 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.54688 ms - Host latency: 2.7833 ms (end to end 4.92883 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.55369 ms - Host latency: 2.79373 ms (end to end 4.9323 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47146 ms - Host latency: 2.71121 ms (end to end 4.75632 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47397 ms - Host latency: 2.71226 ms (end to end 4.76655 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47153 ms - Host latency: 2.7114 ms (end to end 4.76289 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.56355 ms - Host latency: 2.80249 ms (end to end 4.94102 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.49868 ms - Host latency: 2.73735 ms (end to end 4.83228 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47644 ms - Host latency: 2.71121 ms (end to end 4.77559 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47329 ms - Host latency: 2.68394 ms (end to end 4.77056 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47327 ms - Host latency: 2.67937 ms (end to end 4.75647 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47432 ms - Host latency: 2.68203 ms (end to end 4.7676 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.59412 ms - Host latency: 2.8022 ms (end to end 4.99773 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.5053 ms - Host latency: 2.71316 ms (end to end 4.84832 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47512 ms - Host latency: 2.68298 ms (end to end 4.77693 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.52527 ms - Host latency: 2.73306 ms (end to end 4.88345 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.54551 ms - Host latency: 2.75215 ms (end to end 4.9324 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.56914 ms - Host latency: 2.78159 ms (end to end 3.4781 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.52764 ms - Host latency: 2.73315 ms (end to end 4.88965 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.62563 ms - Host latency: 2.8301 ms (end to end 5.07097 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.59192 ms - Host latency: 2.80068 ms (end to end 4.5749 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.60784 ms - Host latency: 2.81785 ms (end to end 3.64705 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47415 ms - Host latency: 2.67856 ms (end to end 4.77681 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47451 ms - Host latency: 2.67844 ms (end to end 4.76284 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47585 ms - Host latency: 2.67964 ms (end to end 4.77588 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47588 ms - Host latency: 2.67983 ms (end to end 4.78101 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.4759 ms - Host latency: 2.67959 ms (end to end 4.77505 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.68257 ms - Host latency: 2.89641 ms (end to end 3.63977 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47207 ms - Host latency: 2.67917 ms (end to end 4.44907 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47437 ms - Host latency: 2.68027 ms (end to end 4.75798 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47622 ms - Host latency: 2.68066 ms (end to end 4.77158 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.61765 ms - Host latency: 2.83064 ms (end to end 3.79009 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47456 ms - Host latency: 2.67927 ms (end to end 4.55054 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47603 ms - Host latency: 2.68062 ms (end to end 4.77075 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47634 ms - Host latency: 2.68247 ms (end to end 4.77732 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47283 ms - Host latency: 2.67998 ms (end to end 4.76624 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47476 ms - Host latency: 2.68115 ms (end to end 4.7615 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47229 ms - Host latency: 2.67798 ms (end to end 4.77231 ms) [08/05/2021-07:27:47] [I] Average on 10 runs - GPU latency: 2.47629 ms - Host latency: 2.68184 ms (end to end 4.78062 ms) [08/05/2021-07:27:47] [I] Host latency [08/05/2021-07:27:47] [I] min: 2.65909 ms (end to end 2.68286 ms) [08/05/2021-07:27:47] [I] max: 4.67432 ms (end to end 6.15237 ms) [08/05/2021-07:27:47] [I] mean: 2.73102 ms (end to end 4.71326 ms) [08/05/2021-07:27:47] [I] median: 2.68488 ms (end to end 4.76257 ms) [08/05/2021-07:27:47] [I] percentile: 3.47876 ms at 99% (end to end 5.62271 ms at 99%) [08/05/2021-07:27:47] [I] throughput: 0 qps [08/05/2021-07:27:47] [I] walltime: 3.00817 s [08/05/2021-07:27:47] [I] GPU Compute [08/05/2021-07:27:47] [I] min: 2.45349 ms [08/05/2021-07:27:47] [I] max: 4.25952 ms [08/05/2021-07:27:47] [I] mean: 2.51082 ms [08/05/2021-07:27:47] [I] median: 2.47369 ms [08/05/2021-07:27:47] [I] percentile: 3.18364 ms at 99% [08/05/2021-07:27:47] [I] total compute time: 2.97532 s &&&& PASSED TensorRT.trtexec # ./trtexec --explicitBatch --onnx=/media/aya/Data/deepstream/tarfile/TensorRT-7.0.0.11/bin/duke_onnx_new.onnx --minShapes=input:1x3x288x144 --optShapes=input:5x3x288x144 --maxShapes=input:30x3x288x144 --saveEngine=duke_new_out_fp16_work2000.engine --fp16 --workspace=2000 --verbose root@885f829ad05c:/media/aya/Data/deepstream/tarfile/TensorRT-7.0.0.11/bin#