[11/14/2022-14:08:24] [V] [TRT] Fastest Tactic: 0 Time: 5.4157
[11/14/2022-14:08:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) (CaskConvolution)
[11/14/2022-14:08:24] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:08:25] [V] [TRT] Tactic: 1062367460111450758 Time: 24.659
[11/14/2022-14:08:25] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479
[11/14/2022-14:08:25] [V] [TRT] Tactic: 1754984623894446479 Time: 25.0101
[11/14/2022-14:08:25] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984
[11/14/2022-14:08:27] [V] [TRT] Tactic: 3611739942397549984 Time: 80.7739
[11/14/2022-14:08:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724
[11/14/2022-14:08:28] [V] [TRT] Tactic: 3827454225649558724 Time: 76.1565
[11/14/2022-14:08:28] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379
[11/14/2022-14:08:29] [V] [TRT] Tactic: 4337000649858996379 Time: 41.8798
[11/14/2022-14:08:29] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:08:30] [V] [TRT] Tactic: 4501471010995462441 Time: 78.0834
[11/14/2022-14:08:30] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:08:31] [V] [TRT] Tactic: 5137655947464784826 Time: 41.1769
[11/14/2022-14:08:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:08:32] [V] [TRT] Tactic: 5288347012147084929 Time: 81.8391
[11/14/2022-14:08:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896
[11/14/2022-14:08:33] [V] [TRT] Tactic: 5921334924264294896 Time: 49.0783
[11/14/2022-14:08:33] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:08:34] [V] [TRT] Tactic: 6645123197870846056 Time: 38.7562
[11/14/2022-14:08:34] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:08:34] [V] [TRT] Tactic: 7144526460361122478 Time: 21.9318
[11/14/2022-14:08:34] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038
[11/14/2022-14:08:36] [V] [TRT] Tactic: 7852627285308570038 Time: 79.3313
[11/14/2022-14:08:36] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713
[11/14/2022-14:08:37] [V] [TRT] Tactic: -9137461792520977713 Time: 84.8151
[11/14/2022-14:08:37] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509
[11/14/2022-14:08:38] [V] [TRT] Tactic: -8776506421218919509 Time: 71.8307
[11/14/2022-14:08:38] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:08:40] [V] [TRT] Tactic: -8262349710178828730 Time: 81.1417
[11/14/2022-14:08:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780
[11/14/2022-14:08:40] [V] [TRT] Tactic: -8133971918129952780 Time: 37.9989
[11/14/2022-14:08:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144
[11/14/2022-14:08:41] [V] [TRT] Tactic: -6092040395344634144 Time: 25.2596
[11/14/2022-14:08:41] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:08:41] [V] [TRT] Tactic: -4787320710726427159 Time: 24.4268
[11/14/2022-14:08:41] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:08:42] [V] [TRT] Tactic: -3456450830548107839 Time: 26.3688
[11/14/2022-14:08:42] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239
[11/14/2022-14:08:43] [V] [TRT] Tactic: -2318106587342035239 Time: 69.3803
[11/14/2022-14:08:43] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657
[11/14/2022-14:08:44] [V] [TRT] Tactic: -1343271414618805657 Time: 46.0185
[11/14/2022-14:08:44] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:08:44] [V] [TRT] Tactic: -1218658103698133241 Time: 36.7937
[11/14/2022-14:08:44] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:08:45] [V] [TRT] Tactic: -836875257600482091 Time: 36.3739
[11/14/2022-14:08:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:08:46] [V] [TRT] Tactic: -410470605513481746 Time: 75.7148
[11/14/2022-14:08:46] [V] [TRT] Fastest Tactic: 7144526460361122478 Time: 21.9318
[11/14/2022-14:08:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/14/2022-14:08:46] [V] [TRT] *************** Autotuning format combination: Float(3276800,1,10240,32) -> Float(3276800,1,10240,32) ***************
[11/14/2022-14:08:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:08:46] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:08:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) (CaskConvolution)
[11/14/2022-14:08:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/14/2022-14:08:46] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:08:46] [V] [TRT] *************** Autotuning format combination: Float(3276800,102400,320,1) -> Float(1638400,102400,320,1) ***************
[11/14/2022-14:08:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (FusedConvActConvolution)
[11/14/2022-14:08:46] [V] [TRT] Tactic: 589823 Time: 2.66536
[11/14/2022-14:08:47] [V] [TRT] Tactic: 655359 Time: 4.22738
[11/14/2022-14:08:47] [V] [TRT] Tactic: 786431 Time: 2.98804
[11/14/2022-14:08:47] [V] [TRT] Tactic: 851967 Time: 7.02275
[11/14/2022-14:08:47] [V] [TRT] Tactic: 1179647 Time: 4.08966
[11/14/2022-14:08:48] [V] [TRT] Tactic: 1310719 Time: 4.58894
[11/14/2022-14:08:48] [V] [TRT] Tactic: 1376255 Time: 2.32242
[11/14/2022-14:08:48] [V] [TRT] Tactic: 1441791 Time: 5.02591
[11/14/2022-14:08:48] [V] [TRT] Tactic: 1507327 Time: 6.80314
[11/14/2022-14:08:49] [V] [TRT] Tactic: 1638399 Time: 3.91596
[11/14/2022-14:08:49] [V] [TRT] Tactic: 1835007 Time: 3.44335
[11/14/2022-14:08:49] [V] [TRT] Tactic: 1900543 Time: 5.35632
[11/14/2022-14:08:49] [V] [TRT] Tactic: 2097151 Time: 3.58729
[11/14/2022-14:08:49] [V] [TRT] Tactic: 2162687 Time: 2.55914
[11/14/2022-14:08:49] [V] [TRT] Tactic: 2293759 Time: 2.52141
[11/14/2022-14:08:50] [V] [TRT] Tactic: 2359295 Time: 3.17367
[11/14/2022-14:08:50] [V] [TRT] Tactic: 2686975 Time: 2.32726
[11/14/2022-14:08:50] [V] [TRT] Tactic: 3080191 Time: 6.08706
[11/14/2022-14:08:50] [V] [TRT] Tactic: 3342335 Time: 5.88534
[11/14/2022-14:08:50] [V] [TRT] Tactic: 3407871 Time: 2.86159
[11/14/2022-14:08:51] [V] [TRT] Tactic: 3538943 Time: 2.83038
[11/14/2022-14:08:51] [V] [TRT] Tactic: 3670015 Time: 3.52719
[11/14/2022-14:08:51] [V] [TRT] Tactic: 3932159 Time: 4.30778
[11/14/2022-14:08:51] [V] [TRT] Tactic: 3997695 Time: 3.12729
[11/14/2022-14:08:52] [V] [TRT] Tactic: 4063231 Time: 7.14814
[11/14/2022-14:08:52] [V] [TRT] Tactic: 4194303 Time: 2.92378
[11/14/2022-14:08:52] [V] [TRT] Tactic: 4259839 Time: 3.59046
[11/14/2022-14:08:52] [V] [TRT] Tactic: 4325375 Time: 2.81599
[11/14/2022-14:08:52] [V] [TRT] Tactic: 4521983 Time: 2.62951
[11/14/2022-14:08:52] [V] [TRT] Tactic: 4587519 Time: 2.93876
[11/14/2022-14:08:53] [V] [TRT] Tactic: 4653055 Time: 4.78219
[11/14/2022-14:08:53] [V] [TRT] Tactic: 4915199 Time: 2.89756
[11/14/2022-14:08:53] [V] [TRT] Tactic: 4980735 Time: 2.57488
[11/14/2022-14:08:53] [V] [TRT] Tactic: 5177343 Time: 3.98609
[11/14/2022-14:08:53] [V] [TRT] Tactic: 5242879 Time: 3.15604
[11/14/2022-14:08:53] [V] [TRT] Tactic: 5373951 Time: 4.7633
[11/14/2022-14:08:54] [V] [TRT] Tactic: 5439487 Time: 5.22775
[11/14/2022-14:08:54] [V] [TRT] Tactic: 5570559 Time: 5.21941
[11/14/2022-14:08:54] [V] [TRT] Tactic: 5636095 Time: 7.1297
[11/14/2022-14:08:54] [V] [TRT] Tactic: 5701631 Time: 2.48903
[11/14/2022-14:08:55] [V] [TRT] Tactic: 5767167 Time: 9.58816
[11/14/2022-14:08:55] [V] [TRT] Tactic: 5832703 Time: 2.8081
[11/14/2022-14:08:55] [V] [TRT] Tactic: 5898239 Time: 3.45087
[11/14/2022-14:08:55] [V] [TRT] Tactic: 6029311 Time: 2.41796
[11/14/2022-14:08:55] [V] [TRT] Tactic: 6225919 Time: 2.98582
[11/14/2022-14:08:56] [V] [TRT] Tactic: 6291455 Time: 4.09102
[11/14/2022-14:08:56] [V] [TRT] Tactic: 6422527 Time: 4.84637
[11/14/2022-14:08:56] [V] [TRT] Tactic: 6750207 Time: 2.88103
[11/14/2022-14:08:56] [V] [TRT] Tactic: 6815743 Time: 4.97134
[11/14/2022-14:08:56] [V] [TRT] Tactic: 6946815 Time: 4.9577
[11/14/2022-14:08:57] [V] [TRT] Tactic: 7012351 Time: 3.59357
[11/14/2022-14:08:57] [V] [TRT] Tactic: 7077887 Time: 2.83627
[11/14/2022-14:08:57] [V] [TRT] Tactic: 7143423 Time: 3.41227
[11/14/2022-14:08:57] [V] [TRT] Tactic: 7208959 Time: 3.17401
[11/14/2022-14:08:57] [V] [TRT] Tactic: 7340031 Time: 3.4511
[11/14/2022-14:08:57] [V] [TRT] Tactic: 7405567 Time: 3.69703
[11/14/2022-14:08:58] [V] [TRT] Tactic: 7536639 Time: 3.2447
[11/14/2022-14:08:58] [V] [TRT] Tactic: 7602175 Time: 2.78346
[11/14/2022-14:08:58] [V] [TRT] Tactic: 7733247 Time: 3.59482
[11/14/2022-14:08:58] [V] [TRT] Tactic: 7798783 Time: 2.95861
[11/14/2022-14:08:58] [V] [TRT] Tactic: 8191999 Time: 3.46191
[11/14/2022-14:08:58] [V] [TRT] Tactic: 8257535 Time: 2.94349
[11/14/2022-14:08:59] [V] [TRT] Tactic: 8323071 Time: 3.23088
[11/14/2022-14:08:59] [V] [TRT] Tactic: 8650751 Time: 3.18976
[11/14/2022-14:08:59] [V] [TRT] Tactic: 8716287 Time: 4.64233
[11/14/2022-14:08:59] [V] [TRT] Tactic: 9109503 Time: 3.96672
[11/14/2022-14:08:59] [V] [TRT] Tactic: 9568255 Time: 2.90812
[11/14/2022-14:08:59] [V] [TRT] Tactic: 9895935 Time: 2.93176
[11/14/2022-14:09:00] [V] [TRT] Tactic: 10223615 Time: 2.32423
[11/14/2022-14:09:00] [V] [TRT] Tactic: 10354687 Time: 3.02766
[11/14/2022-14:09:00] [V] [TRT] Tactic: 10551295 Time: 2.70202
[11/14/2022-14:09:00] [V] [TRT] Tactic: 10747903 Time: 3.52735
[11/14/2022-14:09:00] [V] [TRT] Tactic: 10944511 Time: 2.62046
[11/14/2022-14:09:00] [V] [TRT] Fastest Tactic: 1376255 Time: 2.32242
[11/14/2022-14:09:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (CudaDepthwiseConvolution)
[11/14/2022-14:09:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:09:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (CudnnConvolution)
[11/14/2022-14:09:00] [V] [TRT] Tactic: 0 Time: 2.30793
[11/14/2022-14:09:00] [V] [TRT] Tactic: 1 Time: 1.94026
[11/14/2022-14:09:00] [V] [TRT] Tactic: 2 Time: 5.3202
[11/14/2022-14:09:00] [V] [TRT] Tactic: 5 skipped. Scratch requested: 32231424, available: 16777216
[11/14/2022-14:09:00] [I] [TRT] Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output.
[11/14/2022-14:09:00] [V] [TRT] Fastest Tactic: 1 Time: 1.94026
[11/14/2022-14:09:00] [V] [TRT] Setting workspace to 32231424enables more tactics for profiling
[11/14/2022-14:09:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (CublasConvolution)
[11/14/2022-14:09:00] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:09:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (CaskConvolution)
[11/14/2022-14:09:00] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:09:00] [V] [TRT] Tactic: 1062367460111450758 Time: 1.1462
[11/14/2022-14:09:00] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:09:00] [V] [TRT] Tactic: 1698681053543049347 Time: 1.16941
[11/14/2022-14:09:00] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:09:01] [V] [TRT] Tactic: 4501471010995462441 Time: 3.29738
[11/14/2022-14:09:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:09:01] [V] [TRT] Tactic: 5137655947464784826 Time: 1.81301
[11/14/2022-14:09:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:09:01] [V] [TRT] Tactic: 5288347012147084929 Time: 3.206
[11/14/2022-14:09:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:09:01] [V] [TRT] Tactic: 5326823351883942011 Time: 3.32076
[11/14/2022-14:09:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:09:01] [V] [TRT] Tactic: 5500448035057547314 Time: 1.89909
[11/14/2022-14:09:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:09:01] [V] [TRT] Tactic: 6645123197870846056 Time: 1.74037
[11/14/2022-14:09:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:09:01] [V] [TRT] Tactic: 7144526460361122478 Time: 1.58678
[11/14/2022-14:09:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:09:01] [V] [TRT] Tactic: -8262349710178828730 Time: 3.24142
[11/14/2022-14:09:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:09:01] [V] [TRT] Tactic: -6576203419454146580 Time: 1.33798
[11/14/2022-14:09:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:09:01] [V] [TRT] Tactic: -4787320710726427159 Time: 1.32
[11/14/2022-14:09:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:09:01] [V] [TRT] Tactic: -3456450830548107839 Time: 1.12451
[11/14/2022-14:09:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:09:01] [V] [TRT] Tactic: -1218658103698133241 Time: 2.28397
[11/14/2022-14:09:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:09:01] [V] [TRT] Tactic: -836875257600482091 Time: 2.29394
[11/14/2022-14:09:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:09:01] [V] [TRT] Tactic: -410470605513481746 Time: 3.74202
[11/14/2022-14:09:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:09:01] [V] [TRT] Tactic: -377491875521947884 Time: 3.17461
[11/14/2022-14:09:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:09:01] [V] [TRT] Tactic: -37215280111360163 Time: 1.71093
[11/14/2022-14:09:01] [V] [TRT] Fastest Tactic: -3456450830548107839 Time: 1.12451
[11/14/2022-14:09:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3456450830548107839
[11/14/2022-14:09:01] [V] [TRT] *************** Autotuning format combination: Float(3276800,1,10240,32) -> Float(1638400,1,5120,16) ***************
[11/14/2022-14:09:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (CudnnConvolution)
[11/14/2022-14:09:01] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:09:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (CublasConvolution)
[11/14/2022-14:09:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:09:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (CaskConvolution)
[11/14/2022-14:09:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:09:01] [V] [TRT] Tactic: 3886731678879822788 Time: 2.31485
[11/14/2022-14:09:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:09:02] [V] [TRT] Tactic: 6629944304117643200 Time: 3.162
[11/14/2022-14:09:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:09:02] [V] [TRT] Tactic: -9153228964338181824 Time: 3.93001
[11/14/2022-14:09:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:09:02] [V] [TRT] Tactic: -7394439838318485025 Time: 2.03552
[11/14/2022-14:09:02] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 2.03552
[11/14/2022-14:09:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025
[11/14/2022-14:09:02] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:09:02] [V] [TRT] *************** Autotuning format combination: Float(1638400,102400,320,1) -> Float(9830400,102400,320,1) ***************
[11/14/2022-14:09:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) (FusedConvActConvolution)
[11/14/2022-14:09:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/14/2022-14:09:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) (CudaDepthwiseConvolution)
[11/14/2022-14:09:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:09:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:09:02] [V] [TRT] Tactic: 0 Time: 14.5487
[11/14/2022-14:09:02] [V] [TRT] Tactic: 1 Time: 9.7108
[11/14/2022-14:09:02] [V] [TRT] Tactic: 2 Time: 13.4523
[11/14/2022-14:09:02] [V] [TRT] Tactic: 5 skipped. Scratch requested: 75558912, available: 16777216
[11/14/2022-14:09:02] [V] [TRT] Fastest Tactic: 1 Time: 9.7108
[11/14/2022-14:09:02] [V] [TRT] Setting workspace to 75558912enables more tactics for profiling
[11/14/2022-14:09:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) (CublasConvolution)
[11/14/2022-14:09:02] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:09:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) (CaskConvolution)
[11/14/2022-14:09:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:09:03] [V] [TRT] Tactic: 1062367460111450758 Time: 2.97684
[11/14/2022-14:09:03] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:09:03] [V] [TRT] Tactic: 1698681053543049347 Time: 2.55626
[11/14/2022-14:09:03] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:09:03] [V] [TRT] Tactic: 4501471010995462441 Time: 3.2446
[11/14/2022-14:09:03] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:09:03] [V] [TRT] Tactic: 5137655947464784826 Time: 2.84776
[11/14/2022-14:09:03] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:09:03] [V] [TRT] Tactic: 5288347012147084929 Time: 2.92656
[11/14/2022-14:09:03] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:09:03] [V] [TRT] Tactic: 5326823351883942011 Time: 2.70137
[11/14/2022-14:09:03] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:09:03] [V] [TRT] Tactic: 5500448035057547314 Time: 3.11852
[11/14/2022-14:09:03] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:09:03] [V] [TRT] Tactic: 6645123197870846056 Time: 3.07553
[11/14/2022-14:09:03] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:09:03] [V] [TRT] Tactic: 7144526460361122478 Time: 3.03629
[11/14/2022-14:09:03] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:09:03] [V] [TRT] Tactic: -8262349710178828730 Time: 3.21397
[11/14/2022-14:09:03] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:09:03] [V] [TRT] Tactic: -6576203419454146580 Time: 2.59302
[11/14/2022-14:09:03] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:09:04] [V] [TRT] Tactic: -4787320710726427159 Time: 2.83588
[11/14/2022-14:09:04] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:09:04] [V] [TRT] Tactic: -3456450830548107839 Time: 3.1403
[11/14/2022-14:09:04] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:09:04] [V] [TRT] Tactic: -1218658103698133241 Time: 2.98152
[11/14/2022-14:09:04] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:09:04] [V] [TRT] Tactic: -836875257600482091 Time: 2.93318
[11/14/2022-14:09:04] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:09:04] [V] [TRT] Tactic: -410470605513481746 Time: 2.83046
[11/14/2022-14:09:04] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:09:04] [V] [TRT] Tactic: -377491875521947884 Time: 3.06232
[11/14/2022-14:09:04] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:09:04] [V] [TRT] Tactic: -37215280111360163 Time: 2.79851
[11/14/2022-14:09:04] [V] [TRT] Fastest Tactic: 1698681053543049347 Time: 2.55626
[11/14/2022-14:09:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1698681053543049347
[11/14/2022-14:09:04] [V] [TRT] *************** Autotuning format combination: Float(1638400,1,5120,16) -> Float(9830400,1,30720,96) ***************
[11/14/2022-14:09:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:09:04] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:09:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) (CublasConvolution)
[11/14/2022-14:09:04] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:09:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) (CaskConvolution)
[11/14/2022-14:09:04] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:09:04] [V] [TRT] Tactic: 3886731678879822788 Time: 3.92498
[11/14/2022-14:09:04] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:09:04] [V] [TRT] Tactic: 6629944304117643200 Time: 9.82542
[11/14/2022-14:09:04] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:09:05] [V] [TRT] Tactic: -9153228964338181824 Time: 8.95622
[11/14/2022-14:09:05] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:09:05] [V] [TRT] Tactic: -7394439838318485025 Time: 4.07941
[11/14/2022-14:09:05] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 3.92498
[11/14/2022-14:09:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788
[11/14/2022-14:09:05] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:09:05] [V] [TRT] *************** Autotuning format combination: Float(9830400,102400,320,1) -> Float(2457600,25600,160,1) ***************
[11/14/2022-14:09:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) (CudaDepthwiseConvolution)
[11/14/2022-14:09:05] [V] [TRT] Tactic: -1 Time: 3.06812
[11/14/2022-14:09:05] [V] [TRT] Fastest Tactic: -1 Time: 3.06812
[11/14/2022-14:09:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:09:05] [V] [TRT] Tactic: 0 skipped. Scratch requested: 39567872, available: 16777216
[11/14/2022-14:09:05] [V] [TRT] Tactic: 1 skipped. Scratch requested: 39567872, available: 16777216
[11/14/2022-14:09:05] [V] [TRT] Tactic: 2 skipped. Scratch requested: 39567872, available: 16777216
[11/14/2022-14:09:05] [V] [TRT] Tactic: 5 skipped. Scratch requested: 39741952, available: 16777216
[11/14/2022-14:09:05] [V] [TRT] Fastest Tactic: -3360065831133338131 Time: inf
[11/14/2022-14:09:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) (CaskConvolution)
[11/14/2022-14:09:05] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:09:05] [V] [TRT] Tactic: 1062367460111450758 Time: 18.9865
[11/14/2022-14:09:05] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479
[11/14/2022-14:09:06] [V] [TRT] Tactic: 1754984623894446479 Time: 17.4464
[11/14/2022-14:09:06] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984
[11/14/2022-14:09:07] [V] [TRT] Tactic: 3611739942397549984 Time: 62.0315
[11/14/2022-14:09:07] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379
[11/14/2022-14:09:07] [V] [TRT] Tactic: 4337000649858996379 Time: 30.2973
[11/14/2022-14:09:07] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:09:08] [V] [TRT] Tactic: 4501471010995462441 Time: 58.6427
[11/14/2022-14:09:08] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:09:09] [V] [TRT] Tactic: 5137655947464784826 Time: 28.4209
[11/14/2022-14:09:09] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:09:10] [V] [TRT] Tactic: 5288347012147084929 Time: 61.7304
[11/14/2022-14:09:10] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:09:10] [V] [TRT] Tactic: 6645123197870846056 Time: 29.1956
[11/14/2022-14:09:10] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:09:11] [V] [TRT] Tactic: 7144526460361122478 Time: 17.1674
[11/14/2022-14:09:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713
[11/14/2022-14:09:12] [V] [TRT] Tactic: -9137461792520977713 Time: 58.0013
[11/14/2022-14:09:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:09:13] [V] [TRT] Tactic: -8262349710178828730 Time: 63.5923
[11/14/2022-14:09:13] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780
[11/14/2022-14:09:14] [V] [TRT] Tactic: -8133971918129952780 Time: 29.9572
[11/14/2022-14:09:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144
[11/14/2022-14:09:14] [V] [TRT] Tactic: -6092040395344634144 Time: 19.2189
[11/14/2022-14:09:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:09:14] [V] [TRT] Tactic: -4787320710726427159 Time: 18.8682
[11/14/2022-14:09:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:09:15] [V] [TRT] Tactic: -3456450830548107839 Time: 19.6451
[11/14/2022-14:09:15] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:09:15] [V] [TRT] Tactic: -1218658103698133241 Time: 30.7476
[11/14/2022-14:09:15] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:09:16] [V] [TRT] Tactic: -836875257600482091 Time: 28.7515
[11/14/2022-14:09:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:09:17] [V] [TRT] Tactic: -410470605513481746 Time: 58.594
[11/14/2022-14:09:17] [V] [TRT] Fastest Tactic: 7144526460361122478 Time: 17.1674
[11/14/2022-14:09:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/14/2022-14:09:17] [V] [TRT] *************** Autotuning format combination: Float(9830400,1,30720,96) -> Float(2457600,1,15360,96) ***************
[11/14/2022-14:09:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:09:17] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:09:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) (CaskConvolution)
[11/14/2022-14:09:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/14/2022-14:09:17] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:09:17] [V] [TRT] *************** Autotuning format combination: Float(2457600,25600,160,1) -> Float(614400,25600,160,1) ***************
[11/14/2022-14:09:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D (FusedConvActConvolution)
[11/14/2022-14:09:17] [V] [TRT] Tactic: 589823 Time: 1.45555
[11/14/2022-14:09:17] [V] [TRT] Tactic: 655359 Time: 2.05598
[11/14/2022-14:09:17] [V] [TRT] Tactic: 786431 Time: 1.54924
[11/14/2022-14:09:17] [V] [TRT] Tactic: 851967 Time: 3.41632
[11/14/2022-14:09:18] [V] [TRT] Tactic: 1179647 Time: 1.85411
[11/14/2022-14:09:18] [V] [TRT] Tactic: 1310719 Time: 2.38675
[11/14/2022-14:09:18] [V] [TRT] Tactic: 1376255 Time: 1.34926
[11/14/2022-14:09:18] [V] [TRT] Tactic: 1441791 Time: 2.23736
[11/14/2022-14:09:18] [V] [TRT] Tactic: 1507327 Time: 3.15054
[11/14/2022-14:09:18] [V] [TRT] Tactic: 1638399 Time: 1.77642
[11/14/2022-14:09:18] [V] [TRT] Tactic: 1835007 Time: 1.8716
[11/14/2022-14:09:18] [V] [TRT] Tactic: 1900543 Time: 3.10744
[11/14/2022-14:09:19] [V] [TRT] Tactic: 2097151 Time: 1.76976
[11/14/2022-14:09:19] [V] [TRT] Tactic: 2162687 Time: 1.55716
[11/14/2022-14:09:19] [V] [TRT] Tactic: 2293759 Time: 1.29565
[11/14/2022-14:09:19] [V] [TRT] Tactic: 2359295 Time: 1.67411
[11/14/2022-14:09:19] [V] [TRT] Tactic: 2686975 Time: 1.28924
[11/14/2022-14:09:19] [V] [TRT] Tactic: 3080191 Time: 2.93008
[11/14/2022-14:09:20] [V] [TRT] Tactic: 3342335 Time: 3.3236
[11/14/2022-14:09:20] [V] [TRT] Tactic: 3407871 Time: 1.37829
[11/14/2022-14:09:20] [V] [TRT] Tactic: 3538943 Time: 1.41494
[11/14/2022-14:09:20] [V] [TRT] Tactic: 3670015 Time: 2.08203
[11/14/2022-14:09:20] [V] [TRT] Tactic: 3932159 Time: 2.99882
[11/14/2022-14:09:20] [V] [TRT] Tactic: 3997695 Time: 1.5423
[11/14/2022-14:09:20] [V] [TRT] Tactic: 4063231 Time: 3.46948
[11/14/2022-14:09:21] [V] [TRT] Tactic: 4194303 Time: 1.59189
[11/14/2022-14:09:21] [V] [TRT] Tactic: 4259839 Time: 1.65416
[11/14/2022-14:09:21] [V] [TRT] Tactic: 4325375 Time: 1.47484
[11/14/2022-14:09:21] [V] [TRT] Tactic: 4521983 Time: 1.45532
[11/14/2022-14:09:21] [V] [TRT] Tactic: 4587519 Time: 1.47821
[11/14/2022-14:09:21] [V] [TRT] Tactic: 4653055 Time: 2.29742
[11/14/2022-14:09:21] [V] [TRT] Tactic: 4915199 Time: 1.42832
[11/14/2022-14:09:21] [V] [TRT] Tactic: 4980735 Time: 1.3827
[11/14/2022-14:09:22] [V] [TRT] Tactic: 5177343 Time: 2.04892
[11/14/2022-14:09:22] [V] [TRT] Tactic: 5242879 Time: 1.62096
[11/14/2022-14:09:22] [V] [TRT] Tactic: 5373951 Time: 2.63952
[11/14/2022-14:09:22] [V] [TRT] Tactic: 5439487 Time: 3.20713
[11/14/2022-14:09:22] [V] [TRT] Tactic: 5570559 Time: 2.34577
[11/14/2022-14:09:22] [V] [TRT] Tactic: 5636095 Time: 3.36988
[11/14/2022-14:09:22] [V] [TRT] Tactic: 5701631 Time: 1.62364
[11/14/2022-14:09:23] [V] [TRT] Tactic: 5767167 Time: 7.23519
[11/14/2022-14:09:23] [V] [TRT] Tactic: 5832703 Time: 1.39773
[11/14/2022-14:09:23] [V] [TRT] Tactic: 5898239 Time: 1.5375
[11/14/2022-14:09:23] [V] [TRT] Tactic: 6029311 Time: 1.49018
[11/14/2022-14:09:23] [V] [TRT] Tactic: 6225919 Time: 1.63246
[11/14/2022-14:09:23] [V] [TRT] Tactic: 6291455 Time: 1.94486
[11/14/2022-14:09:23] [V] [TRT] Tactic: 6422527 Time: 2.96242
[11/14/2022-14:09:23] [V] [TRT] Tactic: 6750207 Time: 1.55818
[11/14/2022-14:09:24] [V] [TRT] Tactic: 6815743 Time: 2.85307
[11/14/2022-14:09:24] [V] [TRT] Tactic: 6946815 Time: 2.85217
[11/14/2022-14:09:24] [V] [TRT] Tactic: 7012351 Time: 1.72917
[11/14/2022-14:09:24] [V] [TRT] Tactic: 7077887 Time: 1.51536
[11/14/2022-14:09:24] [V] [TRT] Tactic: 7143423 Time: 2.14553
[11/14/2022-14:09:24] [V] [TRT] Tactic: 7208959 Time: 1.78599
[11/14/2022-14:09:24] [V] [TRT] Tactic: 7340031 Time: 1.58365
[11/14/2022-14:09:24] [V] [TRT] Tactic: 7405567 Time: 1.86806
[11/14/2022-14:09:24] [V] [TRT] Tactic: 7536639 Time: 2.1537
[11/14/2022-14:09:25] [V] [TRT] Tactic: 7602175 Time: 1.36164
[11/14/2022-14:09:25] [V] [TRT] Tactic: 7733247 Time: 1.83936
[11/14/2022-14:09:25] [V] [TRT] Tactic: 7798783 Time: 1.53364
[11/14/2022-14:09:25] [V] [TRT] Tactic: 8191999 Time: 1.89578
[11/14/2022-14:09:25] [V] [TRT] Tactic: 8257535 Time: 1.4749
[11/14/2022-14:09:25] [V] [TRT] Tactic: 8323071 Time: 1.68363
[11/14/2022-14:09:25] [V] [TRT] Tactic: 8650751 Time: 1.8183
[11/14/2022-14:09:25] [V] [TRT] Tactic: 8716287 Time: 2.76757
[11/14/2022-14:09:25] [V] [TRT] Tactic: 9109503 Time: 1.87802
[11/14/2022-14:09:25] [V] [TRT] Tactic: 9568255 Time: 1.39196
[11/14/2022-14:09:26] [V] [TRT] Tactic: 9895935 Time: 1.41643
[11/14/2022-14:09:26] [V] [TRT] Tactic: 10223615 Time: 1.37988
[11/14/2022-14:09:26] [V] [TRT] Tactic: 10354687 Time: 1.52125
[11/14/2022-14:09:26] [V] [TRT] Tactic: 10551295 Time: 1.51398
[11/14/2022-14:09:26] [V] [TRT] Tactic: 10747903 Time: 1.69355
[11/14/2022-14:09:26] [V] [TRT] Tactic: 10944511 Time: 1.38886
[11/14/2022-14:09:26] [V] [TRT] Fastest Tactic: 2686975 Time: 1.28924
[11/14/2022-14:09:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D (CudaDepthwiseConvolution)
[11/14/2022-14:09:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:09:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D (CudnnConvolution)
[11/14/2022-14:09:26] [V] [TRT] Tactic: 0 Time: 1.2043
[11/14/2022-14:09:26] [V] [TRT] Tactic: 1 Time: 1.017
[11/14/2022-14:09:26] [V] [TRT] Tactic: 2 Time: 3.39345
[11/14/2022-14:09:26] [V] [TRT] Tactic: 4 skipped. Scratch requested: 1268130816, available: 16777216
[11/14/2022-14:09:26] [V] [TRT] Tactic: 5 Time: 3.74921
[11/14/2022-14:09:26] [V] [TRT] Fastest Tactic: 1 Time: 1.017
[11/14/2022-14:09:26] [V] [TRT] Setting workspace to 1268130816enables more tactics for profiling
[11/14/2022-14:09:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D (CublasConvolution)
[11/14/2022-14:09:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:09:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D (CaskConvolution)
[11/14/2022-14:09:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:09:27] [V] [TRT] Tactic: 1062367460111450758 Time: 0.608072
[11/14/2022-14:09:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:09:27] [V] [TRT] Tactic: 1698681053543049347 Time: 0.638908
[11/14/2022-14:09:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:09:27] [V] [TRT] Tactic: 4501471010995462441 Time: 1.85551
[11/14/2022-14:09:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:09:27] [V] [TRT] Tactic: 5137655947464784826 Time: 0.921828
[11/14/2022-14:09:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:09:27] [V] [TRT] Tactic: 5288347012147084929 Time: 1.56345
[11/14/2022-14:09:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:09:27] [V] [TRT] Tactic: 5326823351883942011 Time: 1.91037
[11/14/2022-14:09:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:09:27] [V] [TRT] Tactic: 5500448035057547314 Time: 1.15113
[11/14/2022-14:09:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:09:27] [V] [TRT] Tactic: 6645123197870846056 Time: 0.910324
[11/14/2022-14:09:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:09:27] [V] [TRT] Tactic: 7144526460361122478 Time: 0.6372
[11/14/2022-14:09:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:09:27] [V] [TRT] Tactic: -8262349710178828730 Time: 1.89712
[11/14/2022-14:09:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:09:27] [V] [TRT] Tactic: -6576203419454146580 Time: 0.550972
[11/14/2022-14:09:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:09:27] [V] [TRT] Tactic: -4787320710726427159 Time: 0.650592
[11/14/2022-14:09:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:09:27] [V] [TRT] Tactic: -3456450830548107839 Time: 0.571804
[11/14/2022-14:09:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:09:27] [V] [TRT] Tactic: -1218658103698133241 Time: 1.05783
[11/14/2022-14:09:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:09:27] [V] [TRT] Tactic: -836875257600482091 Time: 1.04218
[11/14/2022-14:09:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:09:27] [V] [TRT] Tactic: -410470605513481746 Time: 1.82797
[11/14/2022-14:09:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:09:27] [V] [TRT] Tactic: -377491875521947884 Time: 2.13677
[11/14/2022-14:09:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:09:27] [V] [TRT] Tactic: -37215280111360163 Time: 0.9438
[11/14/2022-14:09:27] [V] [TRT] Fastest Tactic: -6576203419454146580 Time: 0.550972
[11/14/2022-14:09:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580
[11/14/2022-14:09:27] [V] [TRT] *************** Autotuning format combination: Float(2457600,1,15360,96) -> Float(614400,1,3840,24) ***************
[11/14/2022-14:09:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D (CudnnConvolution)
[11/14/2022-14:09:27] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:09:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D (CublasConvolution)
[11/14/2022-14:09:27] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:09:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D (CaskConvolution)
[11/14/2022-14:09:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:09:27] [V] [TRT] Tactic: 3886731678879822788 Time: 0.90176
[11/14/2022-14:09:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:09:27] [V] [TRT] Tactic: 6629944304117643200 Time: 1.41413
[11/14/2022-14:09:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:09:27] [V] [TRT] Tactic: -9153228964338181824 Time: 1.31498
[11/14/2022-14:09:28] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:09:28] [V] [TRT] Tactic: -7394439838318485025 Time: 1.00362
[11/14/2022-14:09:28] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.90176
[11/14/2022-14:09:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788
[11/14/2022-14:09:28] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:09:28] [V] [TRT] *************** Autotuning format combination: Float(614400,25600,160,1) -> Float(3686400,25600,160,1) ***************
[11/14/2022-14:09:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) (FusedConvActConvolution)
[11/14/2022-14:09:28] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/14/2022-14:09:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) (CudaDepthwiseConvolution)
[11/14/2022-14:09:28] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:09:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:09:28] [V] [TRT] Tactic: 0 Time: 6.21884
[11/14/2022-14:09:28] [V] [TRT] Tactic: 1 Time: 4.89098
[11/14/2022-14:09:28] [V] [TRT] Tactic: 2 Time: 6.44049
[11/14/2022-14:09:28] [V] [TRT] Tactic: 4 skipped. Scratch requested: 1838790144, available: 16777216
[11/14/2022-14:09:28] [V] [TRT] Tactic: 5 Time: 6.54676
[11/14/2022-14:09:28] [V] [TRT] Fastest Tactic: 1 Time: 4.89098
[11/14/2022-14:09:28] [V] [TRT] Setting workspace to 1838790144enables more tactics for profiling
[11/14/2022-14:09:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) (CublasConvolution)
[11/14/2022-14:09:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:09:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) (CaskConvolution)
[11/14/2022-14:09:28] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:09:28] [V] [TRT] Tactic: 1062367460111450758 Time: 1.5554
[11/14/2022-14:09:28] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:09:28] [V] [TRT] Tactic: 1698681053543049347 Time: 1.60841
[11/14/2022-14:09:28] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:09:28] [V] [TRT] Tactic: 4501471010995462441 Time: 1.81382
[11/14/2022-14:09:28] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:09:28] [V] [TRT] Tactic: 5137655947464784826 Time: 1.22109
[11/14/2022-14:09:28] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:09:28] [V] [TRT] Tactic: 5288347012147084929 Time: 1.86048
[11/14/2022-14:09:28] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:09:28] [V] [TRT] Tactic: 5326823351883942011 Time: 1.64086
[11/14/2022-14:09:28] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:09:29] [V] [TRT] Tactic: 5500448035057547314 Time: 1.43706
[11/14/2022-14:09:29] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:09:29] [V] [TRT] Tactic: 6645123197870846056 Time: 1.25059
[11/14/2022-14:09:29] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:09:29] [V] [TRT] Tactic: 7144526460361122478 Time: 1.86378
[11/14/2022-14:09:29] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:09:29] [V] [TRT] Tactic: -8262349710178828730 Time: 2.039
[11/14/2022-14:09:29] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:09:29] [V] [TRT] Tactic: -6576203419454146580 Time: 1.47926
[11/14/2022-14:09:29] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:09:29] [V] [TRT] Tactic: -4787320710726427159 Time: 1.58448
[11/14/2022-14:09:29] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:09:29] [V] [TRT] Tactic: -3456450830548107839 Time: 1.43783
[11/14/2022-14:09:29] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:09:29] [V] [TRT] Tactic: -1218658103698133241 Time: 1.70955
[11/14/2022-14:09:29] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:09:29] [V] [TRT] Tactic: -836875257600482091 Time: 1.74013
[11/14/2022-14:09:29] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:09:29] [V] [TRT] Tactic: -410470605513481746 Time: 1.82149
[11/14/2022-14:09:29] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:09:29] [V] [TRT] Tactic: -377491875521947884 Time: 1.6712
[11/14/2022-14:09:29] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:09:29] [V] [TRT] Tactic: -37215280111360163 Time: 1.39949
[11/14/2022-14:09:29] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 1.22109
[11/14/2022-14:09:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826
[11/14/2022-14:09:29] [V] [TRT] *************** Autotuning format combination: Float(614400,1,3840,24) -> Float(3686400,1,23040,144) ***************
[11/14/2022-14:09:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:09:29] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:09:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) (CublasConvolution)
[11/14/2022-14:09:29] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:09:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) (CaskConvolution)
[11/14/2022-14:09:29] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:09:29] [V] [TRT] Tactic: 3886731678879822788 Time: 1.8749
[11/14/2022-14:09:29] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:09:29] [V] [TRT] Tactic: 6629944304117643200 Time: 4.42835
[11/14/2022-14:09:29] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:09:30] [V] [TRT] Tactic: -9153228964338181824 Time: 4.81078
[11/14/2022-14:09:30] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:09:30] [V] [TRT] Tactic: -7394439838318485025 Time: 1.81516
[11/14/2022-14:09:30] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 1.81516
[11/14/2022-14:09:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025
[11/14/2022-14:09:30] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:09:30] [V] [TRT] *************** Autotuning format combination: Float(3686400,25600,160,1) -> Float(3686400,25600,160,1) ***************
[11/14/2022-14:09:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) (CudaDepthwiseConvolution)
[11/14/2022-14:09:30] [V] [TRT] Tactic: -1 Time: 2.0402
[11/14/2022-14:09:30] [V] [TRT] Fastest Tactic: -1 Time: 2.0402
[11/14/2022-14:09:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:09:30] [V] [TRT] Tactic: 0 Time: 6.44178
[11/14/2022-14:09:30] [V] [TRT] Tactic: 1 Time: 5.77865
[11/14/2022-14:09:30] [V] [TRT] Tactic: 2 Time: 7.39062
[11/14/2022-14:09:40] [V] [TRT] Tactic: 4 Time: 594.912
[11/14/2022-14:09:54] [V] [TRT] Tactic: 5 Time: 818.747
[11/14/2022-14:09:54] [V] [TRT] Tactic: 6 Time: 54.0836
[11/14/2022-14:09:54] [V] [TRT] Fastest Tactic: 1 Time: 5.77865
[11/14/2022-14:09:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) (CaskConvolution)
[11/14/2022-14:09:55] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:09:55] [V] [TRT] Tactic: 1062367460111450758 Time: 28.2994
[11/14/2022-14:09:55] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479
[11/14/2022-14:09:56] [V] [TRT] Tactic: 1754984623894446479 Time: 25.4441
[11/14/2022-14:09:56] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984
[11/14/2022-14:09:57] [V] [TRT] Tactic: 3611739942397549984 Time: 90.9204
[11/14/2022-14:09:57] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724
[11/14/2022-14:09:59] [V] [TRT] Tactic: 3827454225649558724 Time: 75.9397
[11/14/2022-14:09:59] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379
[11/14/2022-14:09:59] [V] [TRT] Tactic: 4337000649858996379 Time: 43.6176
[11/14/2022-14:09:59] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:10:01] [V] [TRT] Tactic: 4501471010995462441 Time: 85.7371
[11/14/2022-14:10:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:10:02] [V] [TRT] Tactic: 5137655947464784826 Time: 42.6851
[11/14/2022-14:10:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:10:03] [V] [TRT] Tactic: 5288347012147084929 Time: 91.6908
[11/14/2022-14:10:03] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896
[11/14/2022-14:10:04] [V] [TRT] Tactic: 5921334924264294896 Time: 51.6425
[11/14/2022-14:10:04] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:10:05] [V] [TRT] Tactic: 6645123197870846056 Time: 42.874
[11/14/2022-14:10:05] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:10:05] [V] [TRT] Tactic: 7144526460361122478 Time: 24.7876
[11/14/2022-14:10:05] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038
[11/14/2022-14:10:07] [V] [TRT] Tactic: 7852627285308570038 Time: 83.0735
[11/14/2022-14:10:07] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713
[11/14/2022-14:10:08] [V] [TRT] Tactic: -9137461792520977713 Time: 86.1662
[11/14/2022-14:10:08] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509
[11/14/2022-14:10:10] [V] [TRT] Tactic: -8776506421218919509 Time: 75.9635
[11/14/2022-14:10:10] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:10:11] [V] [TRT] Tactic: -8262349710178828730 Time: 97.8043
[11/14/2022-14:10:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780
[11/14/2022-14:10:12] [V] [TRT] Tactic: -8133971918129952780 Time: 42.5218
[11/14/2022-14:10:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144
[11/14/2022-14:10:13] [V] [TRT] Tactic: -6092040395344634144 Time: 28.2834
[11/14/2022-14:10:13] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:10:13] [V] [TRT] Tactic: -4787320710726427159 Time: 28.2985
[11/14/2022-14:10:13] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:10:14] [V] [TRT] Tactic: -3456450830548107839 Time: 28.799
[11/14/2022-14:10:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239
[11/14/2022-14:10:15] [V] [TRT] Tactic: -2318106587342035239 Time: 83.1726
[11/14/2022-14:10:15] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657
[11/14/2022-14:10:16] [V] [TRT] Tactic: -1343271414618805657 Time: 53.9754
[11/14/2022-14:10:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:10:17] [V] [TRT] Tactic: -1218658103698133241 Time: 44.5782
[11/14/2022-14:10:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:10:18] [V] [TRT] Tactic: -836875257600482091 Time: 43.1333
[11/14/2022-14:10:18] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:10:19] [V] [TRT] Tactic: -410470605513481746 Time: 89.9563
[11/14/2022-14:10:19] [V] [TRT] Fastest Tactic: 7144526460361122478 Time: 24.7876
[11/14/2022-14:10:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/14/2022-14:10:19] [V] [TRT] *************** Autotuning format combination: Float(3686400,1,23040,144) -> Float(3686400,1,23040,144) ***************
[11/14/2022-14:10:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:10:19] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) (CaskConvolution)
[11/14/2022-14:10:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:19] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:10:19] [V] [TRT] *************** Autotuning format combination: Float(3686400,25600,160,1), Float(614400,25600,160,1) -> Float(614400,25600,160,1) ***************
[11/14/2022-14:10:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add (FusedConvActConvolution)
[11/14/2022-14:10:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add (CudaDepthwiseConvolution)
[11/14/2022-14:10:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add (CudnnConvolution)
[11/14/2022-14:10:19] [V] [TRT] Tactic: 0 Time: 1.59694
[11/14/2022-14:10:19] [V] [TRT] Tactic: 1 Time: 1.4419
[11/14/2022-14:10:20] [V] [TRT] Tactic: 2 Time: 4.17013
[11/14/2022-14:10:20] [V] [TRT] Tactic: 4 skipped. Scratch requested: 1902196224, available: 16777216
[11/14/2022-14:10:20] [V] [TRT] Tactic: 5 Time: 5.21612
[11/14/2022-14:10:20] [V] [TRT] Fastest Tactic: 1 Time: 1.4419
[11/14/2022-14:10:20] [V] [TRT] Setting workspace to 1902196224enables more tactics for profiling
[11/14/2022-14:10:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add (CublasConvolution)
[11/14/2022-14:10:20] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add (CaskConvolution)
[11/14/2022-14:10:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:10:20] [V] [TRT] Tactic: 1062367460111450758 Time: 0.838704
[11/14/2022-14:10:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:10:20] [V] [TRT] Tactic: 1698681053543049347 Time: 0.878236
[11/14/2022-14:10:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:10:20] [V] [TRT] Tactic: 4501471010995462441 Time: 2.67438
[11/14/2022-14:10:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:10:20] [V] [TRT] Tactic: 5137655947464784826 Time: 1.29112
[11/14/2022-14:10:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:10:20] [V] [TRT] Tactic: 5288347012147084929 Time: 2.8203
[11/14/2022-14:10:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:10:20] [V] [TRT] Tactic: 5326823351883942011 Time: 2.73939
[11/14/2022-14:10:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:10:20] [V] [TRT] Tactic: 5500448035057547314 Time: 1.61784
[11/14/2022-14:10:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:10:20] [V] [TRT] Tactic: 6645123197870846056 Time: 1.34087
[11/14/2022-14:10:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:10:20] [V] [TRT] Tactic: 7144526460361122478 Time: 0.955984
[11/14/2022-14:10:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:10:20] [V] [TRT] Tactic: -8262349710178828730 Time: 2.58324
[11/14/2022-14:10:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:10:20] [V] [TRT] Tactic: -6576203419454146580 Time: 0.765052
[11/14/2022-14:10:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:10:20] [V] [TRT] Tactic: -4787320710726427159 Time: 1.0378
[11/14/2022-14:10:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:10:20] [V] [TRT] Tactic: -3456450830548107839 Time: 0.789208
[11/14/2022-14:10:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:10:20] [V] [TRT] Tactic: -1218658103698133241 Time: 1.71688
[11/14/2022-14:10:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:10:20] [V] [TRT] Tactic: -836875257600482091 Time: 1.42787
[11/14/2022-14:10:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:10:20] [V] [TRT] Tactic: -410470605513481746 Time: 2.71657
[11/14/2022-14:10:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:10:21] [V] [TRT] Tactic: -377491875521947884 Time: 2.69707
[11/14/2022-14:10:21] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:10:21] [V] [TRT] Tactic: -37215280111360163 Time: 1.27187
[11/14/2022-14:10:21] [V] [TRT] Fastest Tactic: -6576203419454146580 Time: 0.765052
[11/14/2022-14:10:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580
[11/14/2022-14:10:21] [V] [TRT] *************** Autotuning format combination: Float(3686400,1,23040,144), Float(614400,1,3840,24) -> Float(614400,1,3840,24) ***************
[11/14/2022-14:10:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add (CudnnConvolution)
[11/14/2022-14:10:21] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add (CublasConvolution)
[11/14/2022-14:10:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add (CaskConvolution)
[11/14/2022-14:10:21] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:10:21] [V] [TRT] Tactic: 3886731678879822788 Time: 1.93746
[11/14/2022-14:10:21] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:10:21] [V] [TRT] Tactic: 6629944304117643200 Time: 1.90969
[11/14/2022-14:10:21] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:10:21] [V] [TRT] Tactic: -9153228964338181824 Time: 2.07144
[11/14/2022-14:10:21] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:10:21] [V] [TRT] Tactic: -7394439838318485025 Time: 1.33121
[11/14/2022-14:10:21] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 1.33121
[11/14/2022-14:10:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025
[11/14/2022-14:10:21] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:10:21] [V] [TRT] *************** Autotuning format combination: Float(614400,25600,160,1) -> Float(3686400,25600,160,1) ***************
[11/14/2022-14:10:21] [V] [TRT] *************** Autotuning format combination: Float(614400,1,3840,24) -> Float(3686400,1,23040,144) ***************
[11/14/2022-14:10:21] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:10:21] [V] [TRT] *************** Autotuning format combination: Float(3686400,25600,160,1) -> Float(921600,6400,80,1) ***************
[11/14/2022-14:10:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) (CudaDepthwiseConvolution)
[11/14/2022-14:10:21] [V] [TRT] Tactic: -1 Time: 1.38691
[11/14/2022-14:10:21] [V] [TRT] Fastest Tactic: -1 Time: 1.38691
[11/14/2022-14:10:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:10:21] [V] [TRT] Tactic: 0 Time: 2.84476
[11/14/2022-14:10:21] [V] [TRT] Tactic: 1 Time: 3.2678
[11/14/2022-14:10:21] [V] [TRT] Tactic: 2 Time: 2.97086
[11/14/2022-14:10:34] [V] [TRT] Tactic: 5 Time: 793.801
[11/14/2022-14:10:34] [V] [TRT] Fastest Tactic: 0 Time: 2.84476
[11/14/2022-14:10:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) (CaskConvolution)
[11/14/2022-14:10:34] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:10:34] [V] [TRT] Tactic: 1062367460111450758 Time: 8.16874
[11/14/2022-14:10:34] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479
[11/14/2022-14:10:34] [V] [TRT] Tactic: 1754984623894446479 Time: 6.79468
[11/14/2022-14:10:34] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984
[11/14/2022-14:10:35] [V] [TRT] Tactic: 3611739942397549984 Time: 23.9088
[11/14/2022-14:10:35] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379
[11/14/2022-14:10:35] [V] [TRT] Tactic: 4337000649858996379 Time: 11.5062
[11/14/2022-14:10:35] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:10:35] [V] [TRT] Tactic: 4501471010995462441 Time: 22.061
[11/14/2022-14:10:36] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:10:36] [V] [TRT] Tactic: 5137655947464784826 Time: 11.5726
[11/14/2022-14:10:36] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:10:36] [V] [TRT] Tactic: 5288347012147084929 Time: 23.5258
[11/14/2022-14:10:36] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:10:36] [V] [TRT] Tactic: 6645123197870846056 Time: 11.4174
[11/14/2022-14:10:37] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:10:37] [V] [TRT] Tactic: 7144526460361122478 Time: 6.64459
[11/14/2022-14:10:37] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713
[11/14/2022-14:10:37] [V] [TRT] Tactic: -9137461792520977713 Time: 22.3283
[11/14/2022-14:10:37] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:10:38] [V] [TRT] Tactic: -8262349710178828730 Time: 23.6467
[11/14/2022-14:10:38] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780
[11/14/2022-14:10:38] [V] [TRT] Tactic: -8133971918129952780 Time: 11.5975
[11/14/2022-14:10:38] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144
[11/14/2022-14:10:38] [V] [TRT] Tactic: -6092040395344634144 Time: 8.1183
[11/14/2022-14:10:38] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:10:38] [V] [TRT] Tactic: -4787320710726427159 Time: 6.7705
[11/14/2022-14:10:38] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:10:38] [V] [TRT] Tactic: -3456450830548107839 Time: 7.61439
[11/14/2022-14:10:38] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:10:39] [V] [TRT] Tactic: -1218658103698133241 Time: 11.3016
[11/14/2022-14:10:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:10:39] [V] [TRT] Tactic: -836875257600482091 Time: 11.5152
[11/14/2022-14:10:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:10:39] [V] [TRT] Tactic: -410470605513481746 Time: 22.0761
[11/14/2022-14:10:39] [V] [TRT] Fastest Tactic: 7144526460361122478 Time: 6.64459
[11/14/2022-14:10:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/14/2022-14:10:39] [V] [TRT] *************** Autotuning format combination: Float(3686400,1,23040,144) -> Float(921600,1,11520,144) ***************
[11/14/2022-14:10:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:10:39] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) (CaskConvolution)
[11/14/2022-14:10:39] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:39] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:10:39] [V] [TRT] *************** Autotuning format combination: Float(921600,6400,80,1) -> Float(204800,6400,80,1) ***************
[11/14/2022-14:10:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D (FusedConvActConvolution)
[11/14/2022-14:10:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D (CudaDepthwiseConvolution)
[11/14/2022-14:10:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D (CudnnConvolution)
[11/14/2022-14:10:39] [V] [TRT] Tactic: 0 Time: 0.380532
[11/14/2022-14:10:39] [V] [TRT] Tactic: 1 Time: 0.374012
[11/14/2022-14:10:39] [V] [TRT] Tactic: 2 Time: 1.2423
[11/14/2022-14:10:39] [V] [TRT] Tactic: 4 skipped. Scratch requested: 632604672, available: 16777216
[11/14/2022-14:10:39] [V] [TRT] Tactic: 5 Time: 1.63074
[11/14/2022-14:10:39] [V] [TRT] Fastest Tactic: 1 Time: 0.374012
[11/14/2022-14:10:39] [V] [TRT] Setting workspace to 632604672enables more tactics for profiling
[11/14/2022-14:10:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D (CublasConvolution)
[11/14/2022-14:10:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D (CaskConvolution)
[11/14/2022-14:10:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:10:39] [V] [TRT] Tactic: 1062367460111450758 Time: 0.221452
[11/14/2022-14:10:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:10:39] [V] [TRT] Tactic: 1698681053543049347 Time: 0.214096
[11/14/2022-14:10:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:10:40] [V] [TRT] Tactic: 4501471010995462441 Time: 0.531188
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:10:40] [V] [TRT] Tactic: 5137655947464784826 Time: 0.273868
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:10:40] [V] [TRT] Tactic: 5288347012147084929 Time: 0.529552
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:10:40] [V] [TRT] Tactic: 5326823351883942011 Time: 0.50164
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:10:40] [V] [TRT] Tactic: 5500448035057547314 Time: 0.323876
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:10:40] [V] [TRT] Tactic: 6645123197870846056 Time: 0.27922
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:10:40] [V] [TRT] Tactic: 7144526460361122478 Time: 0.225812
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:10:40] [V] [TRT] Tactic: -8262349710178828730 Time: 0.529948
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:10:40] [V] [TRT] Tactic: -6576203419454146580 Time: 0.19236
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:10:40] [V] [TRT] Tactic: -4787320710726427159 Time: 0.22952
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:10:40] [V] [TRT] Tactic: -3456450830548107839 Time: 0.19756
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:10:40] [V] [TRT] Tactic: -1218658103698133241 Time: 0.337328
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:10:40] [V] [TRT] Tactic: -836875257600482091 Time: 0.351496
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:10:40] [V] [TRT] Tactic: -410470605513481746 Time: 0.507884
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:10:40] [V] [TRT] Tactic: -377491875521947884 Time: 0.589896
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:10:40] [V] [TRT] Tactic: -37215280111360163 Time: 0.27352
[11/14/2022-14:10:40] [V] [TRT] Fastest Tactic: -6576203419454146580 Time: 0.19236
[11/14/2022-14:10:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580
[11/14/2022-14:10:40] [V] [TRT] *************** Autotuning format combination: Float(921600,1,11520,144) -> Float(204800,1,2560,32) ***************
[11/14/2022-14:10:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D (CudnnConvolution)
[11/14/2022-14:10:40] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D (CublasConvolution)
[11/14/2022-14:10:40] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D (CaskConvolution)
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:10:40] [V] [TRT] Tactic: 3886731678879822788 Time: 0.306364
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:10:40] [V] [TRT] Tactic: 6629944304117643200 Time: 0.366408
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:10:40] [V] [TRT] Tactic: -9153228964338181824 Time: 0.35358
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:10:40] [V] [TRT] Tactic: -7394439838318485025 Time: 0.308416
[11/14/2022-14:10:40] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.306364
[11/14/2022-14:10:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788
[11/14/2022-14:10:40] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:10:40] [V] [TRT] *************** Autotuning format combination: Float(204800,6400,80,1) -> Float(1228800,6400,80,1) ***************
[11/14/2022-14:10:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) (FusedConvActConvolution)
[11/14/2022-14:10:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) (CudaDepthwiseConvolution)
[11/14/2022-14:10:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:10:40] [V] [TRT] Tactic: 0 Time: 1.79017
[11/14/2022-14:10:40] [V] [TRT] Tactic: 1 Time: 1.2601
[11/14/2022-14:10:40] [V] [TRT] Tactic: 2 Time: 2.06268
[11/14/2022-14:10:40] [V] [TRT] Tactic: 4 skipped. Scratch requested: 822173696, available: 16777216
[11/14/2022-14:10:40] [V] [TRT] Tactic: 5 Time: 2.57382
[11/14/2022-14:10:40] [V] [TRT] Fastest Tactic: 1 Time: 1.2601
[11/14/2022-14:10:40] [V] [TRT] Setting workspace to 822173696enables more tactics for profiling
[11/14/2022-14:10:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) (CublasConvolution)
[11/14/2022-14:10:40] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) (CaskConvolution)
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:10:40] [V] [TRT] Tactic: 1062367460111450758 Time: 0.459604
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:10:40] [V] [TRT] Tactic: 1698681053543049347 Time: 0.411588
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:10:40] [V] [TRT] Tactic: 4501471010995462441 Time: 0.446572
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:10:40] [V] [TRT] Tactic: 5137655947464784826 Time: 0.337664
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:10:40] [V] [TRT] Tactic: 5288347012147084929 Time: 0.461104
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:10:40] [V] [TRT] Tactic: 5326823351883942011 Time: 0.436784
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:10:40] [V] [TRT] Tactic: 5500448035057547314 Time: 0.370496
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:10:40] [V] [TRT] Tactic: 6645123197870846056 Time: 0.428852
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:10:40] [V] [TRT] Tactic: 7144526460361122478 Time: 0.448696
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:10:40] [V] [TRT] Tactic: -8262349710178828730 Time: 0.446252
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:10:40] [V] [TRT] Tactic: -6576203419454146580 Time: 0.436016
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:10:40] [V] [TRT] Tactic: -4787320710726427159 Time: 0.462156
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:10:40] [V] [TRT] Tactic: -3456450830548107839 Time: 0.45026
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:10:40] [V] [TRT] Tactic: -1218658103698133241 Time: 0.40088
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:10:40] [V] [TRT] Tactic: -836875257600482091 Time: 0.37826
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:10:40] [V] [TRT] Tactic: -410470605513481746 Time: 0.438136
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:10:40] [V] [TRT] Tactic: -377491875521947884 Time: 0.434288
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:10:40] [V] [TRT] Tactic: -37215280111360163 Time: 0.345732
[11/14/2022-14:10:40] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.337664
[11/14/2022-14:10:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826
[11/14/2022-14:10:40] [V] [TRT] *************** Autotuning format combination: Float(204800,1,2560,32) -> Float(1228800,1,15360,192) ***************
[11/14/2022-14:10:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:10:40] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) (CublasConvolution)
[11/14/2022-14:10:40] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) (CaskConvolution)
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:10:40] [V] [TRT] Tactic: 3886731678879822788 Time: 0.399352
[11/14/2022-14:10:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:10:40] [V] [TRT] Tactic: 6629944304117643200 Time: 1.41512
[11/14/2022-14:10:41] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:10:41] [V] [TRT] Tactic: -9153228964338181824 Time: 1.50948
[11/14/2022-14:10:41] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:10:41] [V] [TRT] Tactic: -7394439838318485025 Time: 0.406328
[11/14/2022-14:10:41] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.399352
[11/14/2022-14:10:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788
[11/14/2022-14:10:41] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:10:41] [V] [TRT] *************** Autotuning format combination: Float(1228800,6400,80,1) -> Float(1228800,6400,80,1) ***************
[11/14/2022-14:10:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) (CudaDepthwiseConvolution)
[11/14/2022-14:10:41] [V] [TRT] Tactic: -1 Time: 0.61794
[11/14/2022-14:10:41] [V] [TRT] Fastest Tactic: -1 Time: 0.61794
[11/14/2022-14:10:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:10:41] [V] [TRT] Tactic: 0 Time: 2.28628
[11/14/2022-14:10:41] [V] [TRT] Tactic: 1 Time: 1.79864
[11/14/2022-14:10:41] [V] [TRT] Tactic: 2 Time: 1.94782
[11/14/2022-14:10:44] [V] [TRT] Tactic: 4 Time: 171.699
[11/14/2022-14:10:48] [V] [TRT] Tactic: 5 Time: 266.5
[11/14/2022-14:10:48] [V] [TRT] Tactic: 6 Time: 19.7625
[11/14/2022-14:10:48] [V] [TRT] Fastest Tactic: 1 Time: 1.79864
[11/14/2022-14:10:48] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) (CaskConvolution)
[11/14/2022-14:10:48] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:10:49] [V] [TRT] Tactic: 1062367460111450758 Time: 10.7966
[11/14/2022-14:10:49] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479
[11/14/2022-14:10:49] [V] [TRT] Tactic: 1754984623894446479 Time: 9.70988
[11/14/2022-14:10:49] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984
[11/14/2022-14:10:49] [V] [TRT] Tactic: 3611739942397549984 Time: 34.8747
[11/14/2022-14:10:50] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724
[11/14/2022-14:10:50] [V] [TRT] Tactic: 3827454225649558724 Time: 27.7784
[11/14/2022-14:10:50] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379
[11/14/2022-14:10:50] [V] [TRT] Tactic: 4337000649858996379 Time: 17.0869
[11/14/2022-14:10:50] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:10:51] [V] [TRT] Tactic: 4501471010995462441 Time: 31.6959
[11/14/2022-14:10:51] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:10:51] [V] [TRT] Tactic: 5137655947464784826 Time: 15.6706
[11/14/2022-14:10:51] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:10:52] [V] [TRT] Tactic: 5288347012147084929 Time: 33.9476
[11/14/2022-14:10:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896
[11/14/2022-14:10:52] [V] [TRT] Tactic: 5921334924264294896 Time: 19.2308
[11/14/2022-14:10:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:10:53] [V] [TRT] Tactic: 6645123197870846056 Time: 17.3231
[11/14/2022-14:10:53] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:10:53] [V] [TRT] Tactic: 7144526460361122478 Time: 9.14234
[11/14/2022-14:10:53] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038
[11/14/2022-14:10:54] [V] [TRT] Tactic: 7852627285308570038 Time: 30.109
[11/14/2022-14:10:54] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713
[11/14/2022-14:10:54] [V] [TRT] Tactic: -9137461792520977713 Time: 32.6345
[11/14/2022-14:10:54] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509
[11/14/2022-14:10:55] [V] [TRT] Tactic: -8776506421218919509 Time: 26.3822
[11/14/2022-14:10:55] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:10:55] [V] [TRT] Tactic: -8262349710178828730 Time: 34.9833
[11/14/2022-14:10:55] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780
[11/14/2022-14:10:56] [V] [TRT] Tactic: -8133971918129952780 Time: 15.1379
[11/14/2022-14:10:56] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144
[11/14/2022-14:10:56] [V] [TRT] Tactic: -6092040395344634144 Time: 12.7443
[11/14/2022-14:10:56] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:10:56] [V] [TRT] Tactic: -4787320710726427159 Time: 8.86371
[11/14/2022-14:10:56] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:10:57] [V] [TRT] Tactic: -3456450830548107839 Time: 10.8942
[11/14/2022-14:10:57] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239
[11/14/2022-14:10:57] [V] [TRT] Tactic: -2318106587342035239 Time: 27.831
[11/14/2022-14:10:57] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657
[11/14/2022-14:10:58] [V] [TRT] Tactic: -1343271414618805657 Time: 17.576
[11/14/2022-14:10:58] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:10:58] [V] [TRT] Tactic: -1218658103698133241 Time: 16.9936
[11/14/2022-14:10:58] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:10:58] [V] [TRT] Tactic: -836875257600482091 Time: 16.0176
[11/14/2022-14:10:58] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:10:59] [V] [TRT] Tactic: -410470605513481746 Time: 30.8924
[11/14/2022-14:10:59] [V] [TRT] Fastest Tactic: -4787320710726427159 Time: 8.86371
[11/14/2022-14:10:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/14/2022-14:10:59] [V] [TRT] *************** Autotuning format combination: Float(1228800,1,15360,192) -> Float(1228800,1,15360,192) ***************
[11/14/2022-14:10:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:10:59] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) (CaskConvolution)
[11/14/2022-14:10:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:59] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:10:59] [V] [TRT] *************** Autotuning format combination: Float(1228800,6400,80,1), Float(204800,6400,80,1) -> Float(204800,6400,80,1) ***************
[11/14/2022-14:10:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add (FusedConvActConvolution)
[11/14/2022-14:10:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add (CudaDepthwiseConvolution)
[11/14/2022-14:10:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add (CudnnConvolution)
[11/14/2022-14:10:59] [V] [TRT] Tactic: 0 Time: 0.545568
[11/14/2022-14:10:59] [V] [TRT] Tactic: 1 Time: 0.493496
[11/14/2022-14:10:59] [V] [TRT] Tactic: 2 Time: 2.03861
[11/14/2022-14:10:59] [V] [TRT] Tactic: 4 skipped. Scratch requested: 843472896, available: 16777216
[11/14/2022-14:10:59] [V] [TRT] Tactic: 5 Time: 2.12403
[11/14/2022-14:10:59] [V] [TRT] Fastest Tactic: 1 Time: 0.493496
[11/14/2022-14:10:59] [V] [TRT] Setting workspace to 843472896enables more tactics for profiling
[11/14/2022-14:10:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add (CublasConvolution)
[11/14/2022-14:10:59] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:10:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add (CaskConvolution)
[11/14/2022-14:10:59] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:10:59] [V] [TRT] Tactic: 1062367460111450758 Time: 0.271828
[11/14/2022-14:10:59] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:10:59] [V] [TRT] Tactic: 1698681053543049347 Time: 0.27496
[11/14/2022-14:10:59] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:10:59] [V] [TRT] Tactic: 4501471010995462441 Time: 0.683216
[11/14/2022-14:10:59] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:10:59] [V] [TRT] Tactic: 5137655947464784826 Time: 0.369112
[11/14/2022-14:10:59] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:10:59] [V] [TRT] Tactic: 5288347012147084929 Time: 0.678152
[11/14/2022-14:10:59] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:10:59] [V] [TRT] Tactic: 5326823351883942011 Time: 0.66428
[11/14/2022-14:10:59] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:10:59] [V] [TRT] Tactic: 5500448035057547314 Time: 0.434864
[11/14/2022-14:10:59] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:10:59] [V] [TRT] Tactic: 6645123197870846056 Time: 0.369044
[11/14/2022-14:10:59] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:10:59] [V] [TRT] Tactic: 7144526460361122478 Time: 0.312236
[11/14/2022-14:10:59] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:10:59] [V] [TRT] Tactic: -8262349710178828730 Time: 0.695028
[11/14/2022-14:10:59] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:10:59] [V] [TRT] Tactic: -6576203419454146580 Time: 0.258824
[11/14/2022-14:10:59] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:10:59] [V] [TRT] Tactic: -4787320710726427159 Time: 0.312548
[11/14/2022-14:10:59] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:10:59] [V] [TRT] Tactic: -3456450830548107839 Time: 0.269128
[11/14/2022-14:10:59] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:10:59] [V] [TRT] Tactic: -1218658103698133241 Time: 0.475156
[11/14/2022-14:10:59] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:10:59] [V] [TRT] Tactic: -836875257600482091 Time: 0.463192
[11/14/2022-14:10:59] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:11:00] [V] [TRT] Tactic: -410470605513481746 Time: 0.974764
[11/14/2022-14:11:00] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:11:00] [V] [TRT] Tactic: -377491875521947884 Time: 0.669676
[11/14/2022-14:11:00] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:11:00] [V] [TRT] Tactic: -37215280111360163 Time: 0.368704
[11/14/2022-14:11:00] [V] [TRT] Fastest Tactic: -6576203419454146580 Time: 0.258824
[11/14/2022-14:11:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580
[11/14/2022-14:11:00] [V] [TRT] *************** Autotuning format combination: Float(1228800,1,15360,192), Float(204800,1,2560,32) -> Float(204800,1,2560,32) ***************
[11/14/2022-14:11:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add (CudnnConvolution)
[11/14/2022-14:11:00] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add (CublasConvolution)
[11/14/2022-14:11:00] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add (CaskConvolution)
[11/14/2022-14:11:00] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:11:00] [V] [TRT] Tactic: 3886731678879822788 Time: 0.451232
[11/14/2022-14:11:00] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:11:00] [V] [TRT] Tactic: 6629944304117643200 Time: 0.484788
[11/14/2022-14:11:00] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:11:00] [V] [TRT] Tactic: -9153228964338181824 Time: 0.506404
[11/14/2022-14:11:00] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:11:00] [V] [TRT] Tactic: -7394439838318485025 Time: 0.43548
[11/14/2022-14:11:00] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.43548
[11/14/2022-14:11:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025
[11/14/2022-14:11:00] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:00] [V] [TRT] *************** Autotuning format combination: Float(204800,6400,80,1) -> Float(1228800,6400,80,1) ***************
[11/14/2022-14:11:00] [V] [TRT] *************** Autotuning format combination: Float(204800,1,2560,32) -> Float(1228800,1,15360,192) ***************
[11/14/2022-14:11:00] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:00] [V] [TRT] *************** Autotuning format combination: Float(1228800,6400,80,1) -> Float(1228800,6400,80,1) ***************
[11/14/2022-14:11:00] [V] [TRT] *************** Autotuning format combination: Float(1228800,1,15360,192) -> Float(1228800,1,15360,192) ***************
[11/14/2022-14:11:00] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:00] [V] [TRT] *************** Autotuning format combination: Float(1228800,6400,80,1), Float(204800,6400,80,1) -> Float(204800,6400,80,1) ***************
[11/14/2022-14:11:00] [V] [TRT] *************** Autotuning format combination: Float(1228800,1,15360,192), Float(204800,1,2560,32) -> Float(204800,1,2560,32) ***************
[11/14/2022-14:11:00] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:00] [V] [TRT] *************** Autotuning format combination: Float(204800,6400,80,1) -> Float(1228800,6400,80,1) ***************
[11/14/2022-14:11:00] [V] [TRT] *************** Autotuning format combination: Float(204800,1,2560,32) -> Float(1228800,1,15360,192) ***************
[11/14/2022-14:11:00] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:00] [V] [TRT] *************** Autotuning format combination: Float(1228800,6400,80,1) -> Float(307200,1600,40,1) ***************
[11/14/2022-14:11:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) (CudaDepthwiseConvolution)
[11/14/2022-14:11:00] [V] [TRT] Tactic: -1 Time: 0.462408
[11/14/2022-14:11:00] [V] [TRT] Fastest Tactic: -1 Time: 0.462408
[11/14/2022-14:11:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:11:00] [V] [TRT] Tactic: 0 Time: 1.17907
[11/14/2022-14:11:00] [V] [TRT] Tactic: 1 Time: 0.989212
[11/14/2022-14:11:00] [V] [TRT] Tactic: 2 Time: 1.26209
[11/14/2022-14:11:05] [V] [TRT] Tactic: 5 Time: 289.901
[11/14/2022-14:11:05] [V] [TRT] Fastest Tactic: 1 Time: 0.989212
[11/14/2022-14:11:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) (CaskConvolution)
[11/14/2022-14:11:05] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:11:05] [V] [TRT] Tactic: 1062367460111450758 Time: 4.75865
[11/14/2022-14:11:05] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479
[11/14/2022-14:11:05] [V] [TRT] Tactic: 1754984623894446479 Time: 5.02878
[11/14/2022-14:11:05] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984
[11/14/2022-14:11:05] [V] [TRT] Tactic: 3611739942397549984 Time: 9.37367
[11/14/2022-14:11:05] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379
[11/14/2022-14:11:05] [V] [TRT] Tactic: 4337000649858996379 Time: 4.69898
[11/14/2022-14:11:05] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:11:06] [V] [TRT] Tactic: 4501471010995462441 Time: 9.86807
[11/14/2022-14:11:06] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:11:06] [V] [TRT] Tactic: 5137655947464784826 Time: 4.9872
[11/14/2022-14:11:06] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:11:06] [V] [TRT] Tactic: 5288347012147084929 Time: 10.493
[11/14/2022-14:11:06] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:11:06] [V] [TRT] Tactic: 6645123197870846056 Time: 5.16042
[11/14/2022-14:11:06] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:11:06] [V] [TRT] Tactic: 7144526460361122478 Time: 3.74753
[11/14/2022-14:11:06] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713
[11/14/2022-14:11:07] [V] [TRT] Tactic: -9137461792520977713 Time: 10.0868
[11/14/2022-14:11:07] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:11:07] [V] [TRT] Tactic: -8262349710178828730 Time: 10.8019
[11/14/2022-14:11:07] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780
[11/14/2022-14:11:07] [V] [TRT] Tactic: -8133971918129952780 Time: 5.49569
[11/14/2022-14:11:07] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144
[11/14/2022-14:11:07] [V] [TRT] Tactic: -6092040395344634144 Time: 4.956
[11/14/2022-14:11:07] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:11:08] [V] [TRT] Tactic: -4787320710726427159 Time: 4.61795
[11/14/2022-14:11:08] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:11:08] [V] [TRT] Tactic: -3456450830548107839 Time: 4.11894
[11/14/2022-14:11:08] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:11:08] [V] [TRT] Tactic: -1218658103698133241 Time: 4.74544
[11/14/2022-14:11:08] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:11:08] [V] [TRT] Tactic: -836875257600482091 Time: 4.49365
[11/14/2022-14:11:08] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:11:08] [V] [TRT] Tactic: -410470605513481746 Time: 10.3476
[11/14/2022-14:11:08] [V] [TRT] Fastest Tactic: 7144526460361122478 Time: 3.74753
[11/14/2022-14:11:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/14/2022-14:11:08] [V] [TRT] *************** Autotuning format combination: Float(1228800,1,15360,192) -> Float(307200,1,7680,192) ***************
[11/14/2022-14:11:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:11:08] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) (CaskConvolution)
[11/14/2022-14:11:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:08] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:08] [V] [TRT] *************** Autotuning format combination: Float(307200,1600,40,1) -> Float(102400,1600,40,1) ***************
[11/14/2022-14:11:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D (FusedConvActConvolution)
[11/14/2022-14:11:08] [V] [TRT] Tactic: 589823 Time: 0.35522
[11/14/2022-14:11:08] [V] [TRT] Tactic: 655359 Time: 0.298212
[11/14/2022-14:11:08] [V] [TRT] Tactic: 786431 Time: 0.320132
[11/14/2022-14:11:08] [V] [TRT] Tactic: 851967 Time: 0.446452
[11/14/2022-14:11:09] [V] [TRT] Tactic: 1179647 Time: 0.264152
[11/14/2022-14:11:09] [V] [TRT] Tactic: 1310719 Time: 0.50486
[11/14/2022-14:11:09] [V] [TRT] Tactic: 1376255 Time: 0.284932
[11/14/2022-14:11:09] [V] [TRT] Tactic: 1441791 Time: 0.32466
[11/14/2022-14:11:09] [V] [TRT] Tactic: 1507327 Time: 0.433944
[11/14/2022-14:11:09] [V] [TRT] Tactic: 1638399 Time: 0.337948
[11/14/2022-14:11:09] [V] [TRT] Tactic: 1835007 Time: 0.334344
[11/14/2022-14:11:09] [V] [TRT] Tactic: 1900543 Time: 0.47888
[11/14/2022-14:11:09] [V] [TRT] Tactic: 2097151 Time: 0.344904
[11/14/2022-14:11:09] [V] [TRT] Tactic: 2162687 Time: 0.293864
[11/14/2022-14:11:09] [V] [TRT] Tactic: 2293759 Time: 0.27756
[11/14/2022-14:11:09] [V] [TRT] Tactic: 2359295 Time: 0.283232
[11/14/2022-14:11:09] [V] [TRT] Tactic: 2686975 Time: 0.275428
[11/14/2022-14:11:09] [V] [TRT] Tactic: 3080191 Time: 0.409468
[11/14/2022-14:11:09] [V] [TRT] Tactic: 3342335 Time: 0.444832
[11/14/2022-14:11:09] [V] [TRT] Tactic: 3407871 Time: 0.268004
[11/14/2022-14:11:09] [V] [TRT] Tactic: 3538943 Time: 0.24568
[11/14/2022-14:11:09] [V] [TRT] Tactic: 3670015 Time: 0.309708
[11/14/2022-14:11:09] [V] [TRT] Tactic: 3932159 Time: 0.406744
[11/14/2022-14:11:09] [V] [TRT] Tactic: 3997695 Time: 0.317324
[11/14/2022-14:11:09] [V] [TRT] Tactic: 4063231 Time: 0.44182
[11/14/2022-14:11:09] [V] [TRT] Tactic: 4194303 Time: 0.294352
[11/14/2022-14:11:09] [V] [TRT] Tactic: 4259839 Time: 0.29434
[11/14/2022-14:11:09] [V] [TRT] Tactic: 4325375 Time: 0.293932
[11/14/2022-14:11:09] [V] [TRT] Tactic: 4521983 Time: 0.313708
[11/14/2022-14:11:09] [V] [TRT] Tactic: 4587519 Time: 0.311936
[11/14/2022-14:11:09] [V] [TRT] Tactic: 4653055 Time: 0.297816
[11/14/2022-14:11:09] [V] [TRT] Tactic: 4915199 Time: 0.297828
[11/14/2022-14:11:09] [V] [TRT] Tactic: 4980735 Time: 0.3113
[11/14/2022-14:11:10] [V] [TRT] Tactic: 5177343 Time: 0.313312
[11/14/2022-14:11:10] [V] [TRT] Tactic: 5242879 Time: 0.281016
[11/14/2022-14:11:10] [V] [TRT] Tactic: 5373951 Time: 0.458204
[11/14/2022-14:11:10] [V] [TRT] Tactic: 5439487 Time: 0.554224
[11/14/2022-14:11:10] [V] [TRT] Tactic: 5570559 Time: 0.336348
[11/14/2022-14:11:10] [V] [TRT] Tactic: 5636095 Time: 0.439108
[11/14/2022-14:11:10] [V] [TRT] Tactic: 5701631 Time: 0.343072
[11/14/2022-14:11:10] [V] [TRT] Tactic: 5767167 Time: 1.16262
[11/14/2022-14:11:10] [V] [TRT] Tactic: 5832703 Time: 0.26328
[11/14/2022-14:11:10] [V] [TRT] Tactic: 5898239 Time: 0.246276
[11/14/2022-14:11:10] [V] [TRT] Tactic: 6029311 Time: 0.311772
[11/14/2022-14:11:10] [V] [TRT] Tactic: 6225919 Time: 0.27178
[11/14/2022-14:11:10] [V] [TRT] Tactic: 6291455 Time: 0.265272
[11/14/2022-14:11:10] [V] [TRT] Tactic: 6422527 Time: 0.394588
[11/14/2022-14:11:10] [V] [TRT] Tactic: 6750207 Time: 0.351092
[11/14/2022-14:11:10] [V] [TRT] Tactic: 6815743 Time: 0.385556
[11/14/2022-14:11:10] [V] [TRT] Tactic: 6946815 Time: 0.532368
[11/14/2022-14:11:10] [V] [TRT] Tactic: 7012351 Time: 0.343776
[11/14/2022-14:11:10] [V] [TRT] Tactic: 7077887 Time: 0.241972
[11/14/2022-14:11:10] [V] [TRT] Tactic: 7143423 Time: 0.459008
[11/14/2022-14:11:10] [V] [TRT] Tactic: 7208959 Time: 0.296472
[11/14/2022-14:11:10] [V] [TRT] Tactic: 7340031 Time: 0.256948
[11/14/2022-14:11:10] [V] [TRT] Tactic: 7405567 Time: 0.2973
[11/14/2022-14:11:10] [V] [TRT] Tactic: 7536639 Time: 0.35016
[11/14/2022-14:11:10] [V] [TRT] Tactic: 7602175 Time: 0.334376
[11/14/2022-14:11:10] [V] [TRT] Tactic: 7733247 Time: 0.2732
[11/14/2022-14:11:10] [V] [TRT] Tactic: 7798783 Time: 0.318444
[11/14/2022-14:11:10] [V] [TRT] Tactic: 8191999 Time: 0.389608
[11/14/2022-14:11:11] [V] [TRT] Tactic: 8257535 Time: 0.311972
[11/14/2022-14:11:11] [V] [TRT] Tactic: 8323071 Time: 0.343104
[11/14/2022-14:11:11] [V] [TRT] Tactic: 8650751 Time: 0.374892
[11/14/2022-14:11:11] [V] [TRT] Tactic: 8716287 Time: 0.416444
[11/14/2022-14:11:11] [V] [TRT] Tactic: 9109503 Time: 0.34666
[11/14/2022-14:11:11] [V] [TRT] Tactic: 9568255 Time: 0.29472
[11/14/2022-14:11:11] [V] [TRT] Tactic: 9895935 Time: 0.294144
[11/14/2022-14:11:11] [V] [TRT] Tactic: 10223615 Time: 0.27586
[11/14/2022-14:11:11] [V] [TRT] Tactic: 10354687 Time: 0.290792
[11/14/2022-14:11:11] [V] [TRT] Tactic: 10551295 Time: 0.335804
[11/14/2022-14:11:11] [V] [TRT] Tactic: 10747903 Time: 0.271636
[11/14/2022-14:11:11] [V] [TRT] Tactic: 10944511 Time: 0.308628
[11/14/2022-14:11:11] [V] [TRT] Fastest Tactic: 7077887 Time: 0.241972
[11/14/2022-14:11:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D (CudaDepthwiseConvolution)
[11/14/2022-14:11:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D (CudnnConvolution)
[11/14/2022-14:11:11] [V] [TRT] Tactic: 0 Time: 0.318312
[11/14/2022-14:11:11] [V] [TRT] Tactic: 1 Time: 0.244116
[11/14/2022-14:11:11] [V] [TRT] Tactic: 2 Time: 0.4436
[11/14/2022-14:11:11] [V] [TRT] Tactic: 4 skipped. Scratch requested: 421773312, available: 16777216
[11/14/2022-14:11:11] [V] [TRT] Tactic: 5 Time: 1.22775
[11/14/2022-14:11:11] [V] [TRT] Fastest Tactic: 1 Time: 0.244116
[11/14/2022-14:11:11] [V] [TRT] Setting workspace to 421773312enables more tactics for profiling
[11/14/2022-14:11:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D (CublasConvolution)
[11/14/2022-14:11:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D (CaskConvolution)
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:11:11] [V] [TRT] Tactic: 1062367460111450758 Time: 0.147608
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:11:11] [V] [TRT] Tactic: 1698681053543049347 Time: 0.165108
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:11:11] [V] [TRT] Tactic: 4501471010995462441 Time: 0.187784
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:11:11] [V] [TRT] Tactic: 5137655947464784826 Time: 0.106492
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:11:11] [V] [TRT] Tactic: 5288347012147084929 Time: 0.1931
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:11:11] [V] [TRT] Tactic: 5326823351883942011 Time: 0.184612
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:11:11] [V] [TRT] Tactic: 5500448035057547314 Time: 0.1387
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:11:11] [V] [TRT] Tactic: 6645123197870846056 Time: 0.103456
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:11:11] [V] [TRT] Tactic: 7144526460361122478 Time: 0.169836
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:11:11] [V] [TRT] Tactic: -8262349710178828730 Time: 0.192948
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:11:11] [V] [TRT] Tactic: -6576203419454146580 Time: 0.153212
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:11:11] [V] [TRT] Tactic: -4787320710726427159 Time: 0.15842
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:11:11] [V] [TRT] Tactic: -3456450830548107839 Time: 0.136628
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:11:11] [V] [TRT] Tactic: -1218658103698133241 Time: 0.140516
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:11:11] [V] [TRT] Tactic: -836875257600482091 Time: 0.127748
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:11:11] [V] [TRT] Tactic: -410470605513481746 Time: 0.200108
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:11:11] [V] [TRT] Tactic: -377491875521947884 Time: 0.192112
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:11:11] [V] [TRT] Tactic: -37215280111360163 Time: 0.10086
[11/14/2022-14:11:11] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.10086
[11/14/2022-14:11:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163
[11/14/2022-14:11:11] [V] [TRT] *************** Autotuning format combination: Float(307200,1,7680,192) -> Float(102400,1,2560,64) ***************
[11/14/2022-14:11:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D (CudnnConvolution)
[11/14/2022-14:11:11] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D (CublasConvolution)
[11/14/2022-14:11:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D (CaskConvolution)
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:11:11] [V] [TRT] Tactic: 3886731678879822788 Time: 0.115156
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:11:11] [V] [TRT] Tactic: 6629944304117643200 Time: 0.199084
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:11:11] [V] [TRT] Tactic: -9153228964338181824 Time: 0.228452
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:11:11] [V] [TRT] Tactic: -7394439838318485025 Time: 0.10978
[11/14/2022-14:11:11] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.10978
[11/14/2022-14:11:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025
[11/14/2022-14:11:11] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:11] [V] [TRT] *************** Autotuning format combination: Float(102400,1600,40,1) -> Float(614400,1600,40,1) ***************
[11/14/2022-14:11:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) (FusedConvActConvolution)
[11/14/2022-14:11:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) (CudaDepthwiseConvolution)
[11/14/2022-14:11:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:11:11] [V] [TRT] Tactic: 0 Time: 1.12816
[11/14/2022-14:11:11] [V] [TRT] Tactic: 1 Time: 0.749628
[11/14/2022-14:11:11] [V] [TRT] Tactic: 2 Time: 1.02199
[11/14/2022-14:11:11] [V] [TRT] Tactic: 4 skipped. Scratch requested: 832733184, available: 16777216
[11/14/2022-14:11:11] [V] [TRT] Tactic: 5 Time: 2.62919
[11/14/2022-14:11:11] [V] [TRT] Fastest Tactic: 1 Time: 0.749628
[11/14/2022-14:11:11] [V] [TRT] Setting workspace to 832733184enables more tactics for profiling
[11/14/2022-14:11:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) (CublasConvolution)
[11/14/2022-14:11:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) (CaskConvolution)
[11/14/2022-14:11:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:11:12] [V] [TRT] Tactic: 1062367460111450758 Time: 0.332992
[11/14/2022-14:11:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:11:12] [V] [TRT] Tactic: 1698681053543049347 Time: 0.319748
[11/14/2022-14:11:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:11:12] [V] [TRT] Tactic: 4501471010995462441 Time: 0.246928
[11/14/2022-14:11:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:11:12] [V] [TRT] Tactic: 5137655947464784826 Time: 0.260264
[11/14/2022-14:11:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:11:12] [V] [TRT] Tactic: 5288347012147084929 Time: 0.263844
[11/14/2022-14:11:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:11:12] [V] [TRT] Tactic: 5326823351883942011 Time: 0.258944
[11/14/2022-14:11:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:11:12] [V] [TRT] Tactic: 5500448035057547314 Time: 0.275684
[11/14/2022-14:11:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:11:12] [V] [TRT] Tactic: 6645123197870846056 Time: 0.255776
[11/14/2022-14:11:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:11:12] [V] [TRT] Tactic: 7144526460361122478 Time: 0.345068
[11/14/2022-14:11:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:11:12] [V] [TRT] Tactic: -8262349710178828730 Time: 0.27202
[11/14/2022-14:11:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:11:12] [V] [TRT] Tactic: -6576203419454146580 Time: 0.309796
[11/14/2022-14:11:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:11:12] [V] [TRT] Tactic: -4787320710726427159 Time: 0.3487
[11/14/2022-14:11:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:11:12] [V] [TRT] Tactic: -3456450830548107839 Time: 0.320596
[11/14/2022-14:11:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:11:12] [V] [TRT] Tactic: -1218658103698133241 Time: 0.27866
[11/14/2022-14:11:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:11:12] [V] [TRT] Tactic: -836875257600482091 Time: 0.287208
[11/14/2022-14:11:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:11:12] [V] [TRT] Tactic: -410470605513481746 Time: 0.243404
[11/14/2022-14:11:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:11:12] [V] [TRT] Tactic: -377491875521947884 Time: 0.246236
[11/14/2022-14:11:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:11:12] [V] [TRT] Tactic: -37215280111360163 Time: 0.243368
[11/14/2022-14:11:12] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.243368
[11/14/2022-14:11:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163
[11/14/2022-14:11:12] [V] [TRT] *************** Autotuning format combination: Float(102400,1,2560,64) -> Float(614400,1,15360,384) ***************
[11/14/2022-14:11:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:11:12] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) (CublasConvolution)
[11/14/2022-14:11:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) (CaskConvolution)
[11/14/2022-14:11:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:11:12] [V] [TRT] Tactic: 3886731678879822788 Time: 0.277788
[11/14/2022-14:11:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:11:12] [V] [TRT] Tactic: 6629944304117643200 Time: 0.681532
[11/14/2022-14:11:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:11:12] [V] [TRT] Tactic: -9153228964338181824 Time: 0.675324
[11/14/2022-14:11:12] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:11:12] [V] [TRT] Tactic: -7394439838318485025 Time: 0.294372
[11/14/2022-14:11:12] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.277788
[11/14/2022-14:11:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788
[11/14/2022-14:11:12] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:12] [V] [TRT] *************** Autotuning format combination: Float(614400,1600,40,1) -> Float(614400,1600,40,1) ***************
[11/14/2022-14:11:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) (CudaDepthwiseConvolution)
[11/14/2022-14:11:12] [V] [TRT] Tactic: -1 Time: 0.280412
[11/14/2022-14:11:12] [V] [TRT] Fastest Tactic: -1 Time: 0.280412
[11/14/2022-14:11:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:11:12] [V] [TRT] Tactic: 0 Time: 0.88464
[11/14/2022-14:11:12] [V] [TRT] Tactic: 1 Time: 0.74772
[11/14/2022-14:11:12] [V] [TRT] Tactic: 2 Time: 1.10725
[11/14/2022-14:11:14] [V] [TRT] Tactic: 4 Time: 87.5951
[11/14/2022-14:11:18] [V] [TRT] Tactic: 5 Time: 240.23
[11/14/2022-14:11:18] [V] [TRT] Tactic: 6 Time: 14.6116
[11/14/2022-14:11:18] [V] [TRT] Fastest Tactic: 1 Time: 0.74772
[11/14/2022-14:11:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) (CaskConvolution)
[11/14/2022-14:11:18] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:11:18] [V] [TRT] Tactic: 1062367460111450758 Time: 8.86406
[11/14/2022-14:11:18] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479
[11/14/2022-14:11:18] [V] [TRT] Tactic: 1754984623894446479 Time: 8.56084
[11/14/2022-14:11:19] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984
[11/14/2022-14:11:19] [V] [TRT] Tactic: 3611739942397549984 Time: 18.6563
[11/14/2022-14:11:19] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724
[11/14/2022-14:11:19] [V] [TRT] Tactic: 3827454225649558724 Time: 16.6093
[11/14/2022-14:11:19] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379
[11/14/2022-14:11:20] [V] [TRT] Tactic: 4337000649858996379 Time: 9.2929
[11/14/2022-14:11:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:11:20] [V] [TRT] Tactic: 4501471010995462441 Time: 18.0671
[11/14/2022-14:11:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:11:20] [V] [TRT] Tactic: 5137655947464784826 Time: 9.04177
[11/14/2022-14:11:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:11:21] [V] [TRT] Tactic: 5288347012147084929 Time: 18.3849
[11/14/2022-14:11:21] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896
[11/14/2022-14:11:21] [V] [TRT] Tactic: 5921334924264294896 Time: 11.5602
[11/14/2022-14:11:21] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:11:21] [V] [TRT] Tactic: 6645123197870846056 Time: 9.27804
[11/14/2022-14:11:21] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:11:21] [V] [TRT] Tactic: 7144526460361122478 Time: 7.61226
[11/14/2022-14:11:21] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038
[11/14/2022-14:11:22] [V] [TRT] Tactic: 7852627285308570038 Time: 17.8023
[11/14/2022-14:11:22] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713
[11/14/2022-14:11:22] [V] [TRT] Tactic: -9137461792520977713 Time: 17.8567
[11/14/2022-14:11:22] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509
[11/14/2022-14:11:23] [V] [TRT] Tactic: -8776506421218919509 Time: 16.2361
[11/14/2022-14:11:23] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:11:23] [V] [TRT] Tactic: -8262349710178828730 Time: 18.8134
[11/14/2022-14:11:23] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780
[11/14/2022-14:11:23] [V] [TRT] Tactic: -8133971918129952780 Time: 9.39945
[11/14/2022-14:11:23] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144
[11/14/2022-14:11:24] [V] [TRT] Tactic: -6092040395344634144 Time: 8.64496
[11/14/2022-14:11:24] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:11:24] [V] [TRT] Tactic: -4787320710726427159 Time: 7.91767
[11/14/2022-14:11:24] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:11:24] [V] [TRT] Tactic: -3456450830548107839 Time: 8.10377
[11/14/2022-14:11:24] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239
[11/14/2022-14:11:24] [V] [TRT] Tactic: -2318106587342035239 Time: 16.8756
[11/14/2022-14:11:25] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657
[11/14/2022-14:11:25] [V] [TRT] Tactic: -1343271414618805657 Time: 11.3145
[11/14/2022-14:11:25] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:11:25] [V] [TRT] Tactic: -1218658103698133241 Time: 9.14436
[11/14/2022-14:11:25] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:11:25] [V] [TRT] Tactic: -836875257600482091 Time: 8.99719
[11/14/2022-14:11:25] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:11:26] [V] [TRT] Tactic: -410470605513481746 Time: 17.4607
[11/14/2022-14:11:26] [V] [TRT] Fastest Tactic: 7144526460361122478 Time: 7.61226
[11/14/2022-14:11:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/14/2022-14:11:26] [V] [TRT] *************** Autotuning format combination: Float(614400,1,15360,384) -> Float(614400,1,15360,384) ***************
[11/14/2022-14:11:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:11:26] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) (CaskConvolution)
[11/14/2022-14:11:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:26] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:26] [V] [TRT] *************** Autotuning format combination: Float(614400,1600,40,1), Float(102400,1600,40,1) -> Float(102400,1600,40,1) ***************
[11/14/2022-14:11:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add (FusedConvActConvolution)
[11/14/2022-14:11:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add (CudaDepthwiseConvolution)
[11/14/2022-14:11:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add (CudnnConvolution)
[11/14/2022-14:11:26] [V] [TRT] Tactic: 0 Time: 0.444732
[11/14/2022-14:11:26] [V] [TRT] Tactic: 1 Time: 0.389692
[11/14/2022-14:11:26] [V] [TRT] Tactic: 2 Time: 0.7476
[11/14/2022-14:11:26] [V] [TRT] Tactic: 4 skipped. Scratch requested: 843546624, available: 16777216
[11/14/2022-14:11:26] [V] [TRT] Tactic: 5 Time: 2.4969
[11/14/2022-14:11:26] [V] [TRT] Fastest Tactic: 1 Time: 0.389692
[11/14/2022-14:11:26] [V] [TRT] Setting workspace to 843546624enables more tactics for profiling
[11/14/2022-14:11:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add (CublasConvolution)
[11/14/2022-14:11:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add (CaskConvolution)
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:11:26] [V] [TRT] Tactic: 1062367460111450758 Time: 0.282256
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:11:26] [V] [TRT] Tactic: 1698681053543049347 Time: 0.293724
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:11:26] [V] [TRT] Tactic: 4501471010995462441 Time: 0.35248
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:11:26] [V] [TRT] Tactic: 5137655947464784826 Time: 0.193152
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:11:26] [V] [TRT] Tactic: 5288347012147084929 Time: 0.355948
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:11:26] [V] [TRT] Tactic: 5326823351883942011 Time: 0.35768
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:11:26] [V] [TRT] Tactic: 5500448035057547314 Time: 0.22808
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:11:26] [V] [TRT] Tactic: 6645123197870846056 Time: 0.20692
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:11:26] [V] [TRT] Tactic: 7144526460361122478 Time: 0.292596
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:11:26] [V] [TRT] Tactic: -8262349710178828730 Time: 0.382172
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:11:26] [V] [TRT] Tactic: -6576203419454146580 Time: 0.240912
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:11:26] [V] [TRT] Tactic: -4787320710726427159 Time: 0.300664
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:11:26] [V] [TRT] Tactic: -3456450830548107839 Time: 0.2771
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:11:26] [V] [TRT] Tactic: -1218658103698133241 Time: 0.262352
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:11:26] [V] [TRT] Tactic: -836875257600482091 Time: 0.239136
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:11:26] [V] [TRT] Tactic: -410470605513481746 Time: 0.358968
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:11:26] [V] [TRT] Tactic: -377491875521947884 Time: 0.355728
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:11:26] [V] [TRT] Tactic: -37215280111360163 Time: 0.196576
[11/14/2022-14:11:26] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.193152
[11/14/2022-14:11:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826
[11/14/2022-14:11:26] [V] [TRT] *************** Autotuning format combination: Float(614400,1,15360,384), Float(102400,1,2560,64) -> Float(102400,1,2560,64) ***************
[11/14/2022-14:11:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add (CudnnConvolution)
[11/14/2022-14:11:26] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add (CublasConvolution)
[11/14/2022-14:11:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add (CaskConvolution)
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:11:26] [V] [TRT] Tactic: 3886731678879822788 Time: 0.22116
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:11:26] [V] [TRT] Tactic: 6629944304117643200 Time: 0.387092
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:11:26] [V] [TRT] Tactic: -9153228964338181824 Time: 0.424236
[11/14/2022-14:11:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:11:26] [V] [TRT] Tactic: -7394439838318485025 Time: 0.21652
[11/14/2022-14:11:26] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.21652
[11/14/2022-14:11:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025
[11/14/2022-14:11:26] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:26] [V] [TRT] *************** Autotuning format combination: Float(102400,1600,40,1) -> Float(614400,1600,40,1) ***************
[11/14/2022-14:11:26] [V] [TRT] *************** Autotuning format combination: Float(102400,1,2560,64) -> Float(614400,1,15360,384) ***************
[11/14/2022-14:11:26] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:26] [V] [TRT] *************** Autotuning format combination: Float(614400,1600,40,1) -> Float(614400,1600,40,1) ***************
[11/14/2022-14:11:26] [V] [TRT] *************** Autotuning format combination: Float(614400,1,15360,384) -> Float(614400,1,15360,384) ***************
[11/14/2022-14:11:26] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:26] [V] [TRT] *************** Autotuning format combination: Float(614400,1600,40,1), Float(102400,1600,40,1) -> Float(102400,1600,40,1) ***************
[11/14/2022-14:11:26] [V] [TRT] *************** Autotuning format combination: Float(614400,1,15360,384), Float(102400,1,2560,64) -> Float(102400,1,2560,64) ***************
[11/14/2022-14:11:26] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:26] [V] [TRT] *************** Autotuning format combination: Float(102400,1600,40,1) -> Float(614400,1600,40,1) ***************
[11/14/2022-14:11:26] [V] [TRT] *************** Autotuning format combination: Float(102400,1,2560,64) -> Float(614400,1,15360,384) ***************
[11/14/2022-14:11:26] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:26] [V] [TRT] *************** Autotuning format combination: Float(614400,1600,40,1) -> Float(614400,1600,40,1) ***************
[11/14/2022-14:11:26] [V] [TRT] *************** Autotuning format combination: Float(614400,1,15360,384) -> Float(614400,1,15360,384) ***************
[11/14/2022-14:11:26] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:26] [V] [TRT] *************** Autotuning format combination: Float(614400,1600,40,1), Float(102400,1600,40,1) -> Float(102400,1600,40,1) ***************
[11/14/2022-14:11:26] [V] [TRT] *************** Autotuning format combination: Float(614400,1,15360,384), Float(102400,1,2560,64) -> Float(102400,1,2560,64) ***************
[11/14/2022-14:11:26] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:26] [V] [TRT] *************** Autotuning format combination: Float(102400,1600,40,1) -> Float(614400,1600,40,1) ***************
[11/14/2022-14:11:26] [V] [TRT] *************** Autotuning format combination: Float(102400,1,2560,64) -> Float(614400,1,15360,384) ***************
[11/14/2022-14:11:26] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:26] [V] [TRT] *************** Autotuning format combination: Float(614400,1600,40,1) -> Float(614400,1600,40,1) ***************
[11/14/2022-14:11:26] [V] [TRT] *************** Autotuning format combination: Float(614400,1,15360,384) -> Float(614400,1,15360,384) ***************
[11/14/2022-14:11:26] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:26] [V] [TRT] *************** Autotuning format combination: Float(614400,1600,40,1) -> Float(153600,1600,40,1) ***************
[11/14/2022-14:11:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D (FusedConvActConvolution)
[11/14/2022-14:11:26] [V] [TRT] Tactic: 589823 Time: 0.786392
[11/14/2022-14:11:26] [V] [TRT] Tactic: 655359 Time: 0.56946
[11/14/2022-14:11:26] [V] [TRT] Tactic: 786431 Time: 0.767836
[11/14/2022-14:11:26] [V] [TRT] Tactic: 851967 Time: 0.901784
[11/14/2022-14:11:27] [V] [TRT] Tactic: 1179647 Time: 0.751208
[11/14/2022-14:11:27] [V] [TRT] Tactic: 1310719 Time: 1.24917
[11/14/2022-14:11:27] [V] [TRT] Tactic: 1376255 Time: 0.705996
[11/14/2022-14:11:27] [V] [TRT] Tactic: 1441791 Time: 0.871012
[11/14/2022-14:11:27] [V] [TRT] Tactic: 1507327 Time: 0.84158
[11/14/2022-14:11:27] [V] [TRT] Tactic: 1638399 Time: 0.840712
[11/14/2022-14:11:27] [V] [TRT] Tactic: 1835007 Time: 0.845208
[11/14/2022-14:11:27] [V] [TRT] Tactic: 1900543 Time: 0.878784
[11/14/2022-14:11:27] [V] [TRT] Tactic: 2097151 Time: 0.921876
[11/14/2022-14:11:27] [V] [TRT] Tactic: 2162687 Time: 0.776308
[11/14/2022-14:11:27] [V] [TRT] Tactic: 2293759 Time: 0.704304
[11/14/2022-14:11:27] [V] [TRT] Tactic: 2359295 Time: 0.708224
[11/14/2022-14:11:27] [V] [TRT] Tactic: 2686975 Time: 0.686524
[11/14/2022-14:11:27] [V] [TRT] Tactic: 3080191 Time: 0.774868
[11/14/2022-14:11:27] [V] [TRT] Tactic: 3342335 Time: 0.911368
[11/14/2022-14:11:27] [V] [TRT] Tactic: 3407871 Time: 0.691316
[11/14/2022-14:11:27] [V] [TRT] Tactic: 3538943 Time: 0.68352
[11/14/2022-14:11:28] [V] [TRT] Tactic: 3670015 Time: 0.572028
[11/14/2022-14:11:28] [V] [TRT] Tactic: 3932159 Time: 0.79424
[11/14/2022-14:11:28] [V] [TRT] Tactic: 3997695 Time: 0.863952
[11/14/2022-14:11:28] [V] [TRT] Tactic: 4063231 Time: 0.908884
[11/14/2022-14:11:28] [V] [TRT] Tactic: 4194303 Time: 0.70298
[11/14/2022-14:11:28] [V] [TRT] Tactic: 4259839 Time: 0.695392
[11/14/2022-14:11:28] [V] [TRT] Tactic: 4325375 Time: 0.682912
[11/14/2022-14:11:28] [V] [TRT] Tactic: 4521983 Time: 0.70074
[11/14/2022-14:11:28] [V] [TRT] Tactic: 4587519 Time: 0.731872
[11/14/2022-14:11:28] [V] [TRT] Tactic: 4653055 Time: 0.880804
[11/14/2022-14:11:28] [V] [TRT] Tactic: 4915199 Time: 0.721328
[11/14/2022-14:11:28] [V] [TRT] Tactic: 4980735 Time: 0.725068
[11/14/2022-14:11:28] [V] [TRT] Tactic: 5177343 Time: 1.04337
[11/14/2022-14:11:28] [V] [TRT] Tactic: 5242879 Time: 0.7984
[11/14/2022-14:11:28] [V] [TRT] Tactic: 5373951 Time: 1.57846
[11/14/2022-14:11:28] [V] [TRT] Tactic: 5439487 Time: 1.44966
[11/14/2022-14:11:29] [V] [TRT] Tactic: 5570559 Time: 0.607144
[11/14/2022-14:11:29] [V] [TRT] Tactic: 5636095 Time: 0.893884
[11/14/2022-14:11:29] [V] [TRT] Tactic: 5701631 Time: 0.863072
[11/14/2022-14:11:29] [V] [TRT] Tactic: 5767167 Time: 3.62603
[11/14/2022-14:11:29] [V] [TRT] Tactic: 5832703 Time: 0.679156
[11/14/2022-14:11:29] [V] [TRT] Tactic: 5898239 Time: 0.700668
[11/14/2022-14:11:29] [V] [TRT] Tactic: 6029311 Time: 0.81856
[11/14/2022-14:11:29] [V] [TRT] Tactic: 6225919 Time: 0.826664
[11/14/2022-14:11:29] [V] [TRT] Tactic: 6291455 Time: 0.753384
[11/14/2022-14:11:29] [V] [TRT] Tactic: 6422527 Time: 0.781452
[11/14/2022-14:11:29] [V] [TRT] Tactic: 6750207 Time: 0.87946
[11/14/2022-14:11:29] [V] [TRT] Tactic: 6815743 Time: 1.19205
[11/14/2022-14:11:29] [V] [TRT] Tactic: 6946815 Time: 1.38189
[11/14/2022-14:11:30] [V] [TRT] Tactic: 7012351 Time: 0.896376
[11/14/2022-14:11:30] [V] [TRT] Tactic: 7077887 Time: 0.66876
[11/14/2022-14:11:30] [V] [TRT] Tactic: 7143423 Time: 1.49488
[11/14/2022-14:11:30] [V] [TRT] Tactic: 7208959 Time: 0.82772
[11/14/2022-14:11:30] [V] [TRT] Tactic: 7340031 Time: 0.81036
[11/14/2022-14:11:30] [V] [TRT] Tactic: 7405567 Time: 0.906452
[11/14/2022-14:11:30] [V] [TRT] Tactic: 7536639 Time: 1.15082
[11/14/2022-14:11:30] [V] [TRT] Tactic: 7602175 Time: 0.830468
[11/14/2022-14:11:30] [V] [TRT] Tactic: 7733247 Time: 0.784648
[11/14/2022-14:11:30] [V] [TRT] Tactic: 7798783 Time: 0.774816
[11/14/2022-14:11:30] [V] [TRT] Tactic: 8191999 Time: 1.04006
[11/14/2022-14:11:30] [V] [TRT] Tactic: 8257535 Time: 0.80148
[11/14/2022-14:11:30] [V] [TRT] Tactic: 8323071 Time: 0.870768
[11/14/2022-14:11:30] [V] [TRT] Tactic: 8650751 Time: 0.987992
[11/14/2022-14:11:30] [V] [TRT] Tactic: 8716287 Time: 1.23394
[11/14/2022-14:11:31] [V] [TRT] Tactic: 9109503 Time: 1.02119
[11/14/2022-14:11:31] [V] [TRT] Tactic: 9568255 Time: 0.715936
[11/14/2022-14:11:31] [V] [TRT] Tactic: 9895935 Time: 0.700252
[11/14/2022-14:11:31] [V] [TRT] Tactic: 10223615 Time: 0.67856
[11/14/2022-14:11:31] [V] [TRT] Tactic: 10354687 Time: 0.694664
[11/14/2022-14:11:31] [V] [TRT] Tactic: 10551295 Time: 0.840736
[11/14/2022-14:11:31] [V] [TRT] Tactic: 10747903 Time: 0.754212
[11/14/2022-14:11:31] [V] [TRT] Tactic: 10944511 Time: 0.723568
[11/14/2022-14:11:31] [V] [TRT] Fastest Tactic: 655359 Time: 0.56946
[11/14/2022-14:11:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D (CudaDepthwiseConvolution)
[11/14/2022-14:11:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D (CudnnConvolution)
[11/14/2022-14:11:31] [V] [TRT] Tactic: 0 Time: 0.698088
[11/14/2022-14:11:31] [V] [TRT] Tactic: 1 Time: 0.64006
[11/14/2022-14:11:31] [V] [TRT] Tactic: 2 Time: 0.759432
[11/14/2022-14:11:31] [V] [TRT] Tactic: 4 skipped. Scratch requested: 1258831872, available: 16777216
[11/14/2022-14:11:31] [V] [TRT] Tactic: 5 Time: 2.58066
[11/14/2022-14:11:31] [V] [TRT] Fastest Tactic: 1 Time: 0.64006
[11/14/2022-14:11:31] [V] [TRT] Setting workspace to 1258831872enables more tactics for profiling
[11/14/2022-14:11:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D (CublasConvolution)
[11/14/2022-14:11:31] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D (CaskConvolution)
[11/14/2022-14:11:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:11:31] [V] [TRT] Tactic: 1062367460111450758 Time: 0.3783
[11/14/2022-14:11:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:11:31] [V] [TRT] Tactic: 1698681053543049347 Time: 0.41158
[11/14/2022-14:11:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:11:31] [V] [TRT] Tactic: 4501471010995462441 Time: 0.35668
[11/14/2022-14:11:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:11:31] [V] [TRT] Tactic: 5137655947464784826 Time: 0.350128
[11/14/2022-14:11:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:11:31] [V] [TRT] Tactic: 5288347012147084929 Time: 0.371104
[11/14/2022-14:11:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:11:31] [V] [TRT] Tactic: 5326823351883942011 Time: 0.345888
[11/14/2022-14:11:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:11:31] [V] [TRT] Tactic: 5500448035057547314 Time: 0.452124
[11/14/2022-14:11:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:11:31] [V] [TRT] Tactic: 6645123197870846056 Time: 0.368464
[11/14/2022-14:11:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:11:31] [V] [TRT] Tactic: 7144526460361122478 Time: 0.433528
[11/14/2022-14:11:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:11:31] [V] [TRT] Tactic: -8262349710178828730 Time: 0.37918
[11/14/2022-14:11:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:11:31] [V] [TRT] Tactic: -6576203419454146580 Time: 0.339768
[11/14/2022-14:11:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:11:31] [V] [TRT] Tactic: -4787320710726427159 Time: 0.436468
[11/14/2022-14:11:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:11:31] [V] [TRT] Tactic: -3456450830548107839 Time: 0.355624
[11/14/2022-14:11:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:11:31] [V] [TRT] Tactic: -1218658103698133241 Time: 0.459872
[11/14/2022-14:11:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:11:31] [V] [TRT] Tactic: -836875257600482091 Time: 0.467352
[11/14/2022-14:11:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:11:31] [V] [TRT] Tactic: -410470605513481746 Time: 0.356268
[11/14/2022-14:11:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:11:31] [V] [TRT] Tactic: -377491875521947884 Time: 0.359252
[11/14/2022-14:11:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:11:32] [V] [TRT] Tactic: -37215280111360163 Time: 0.383888
[11/14/2022-14:11:32] [V] [TRT] Fastest Tactic: -6576203419454146580 Time: 0.339768
[11/14/2022-14:11:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580
[11/14/2022-14:11:32] [V] [TRT] *************** Autotuning format combination: Float(614400,1,15360,384) -> Float(153600,1,3840,96) ***************
[11/14/2022-14:11:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D (CudnnConvolution)
[11/14/2022-14:11:32] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D (CublasConvolution)
[11/14/2022-14:11:32] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D (CaskConvolution)
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:11:32] [V] [TRT] Tactic: 3886731678879822788 Time: 0.357884
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:11:32] [V] [TRT] Tactic: 6629944304117643200 Time: 0.546364
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:11:32] [V] [TRT] Tactic: -9153228964338181824 Time: 0.550912
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:11:32] [V] [TRT] Tactic: -7394439838318485025 Time: 0.33834
[11/14/2022-14:11:32] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.33834
[11/14/2022-14:11:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025
[11/14/2022-14:11:32] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:32] [V] [TRT] *************** Autotuning format combination: Float(153600,1600,40,1) -> Float(921600,1600,40,1) ***************
[11/14/2022-14:11:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) (FusedConvActConvolution)
[11/14/2022-14:11:32] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) (CudaDepthwiseConvolution)
[11/14/2022-14:11:32] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:11:32] [V] [TRT] Tactic: 0 Time: 1.86542
[11/14/2022-14:11:32] [V] [TRT] Tactic: 1 Time: 1.24791
[11/14/2022-14:11:32] [V] [TRT] Tactic: 2 Time: 1.71557
[11/14/2022-14:11:32] [V] [TRT] Tactic: 4 skipped. Scratch requested: 1872027648, available: 16777216
[11/14/2022-14:11:32] [V] [TRT] Tactic: 5 Time: 3.5158
[11/14/2022-14:11:32] [V] [TRT] Fastest Tactic: 1 Time: 1.24791
[11/14/2022-14:11:32] [V] [TRT] Setting workspace to 1872027648enables more tactics for profiling
[11/14/2022-14:11:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) (CublasConvolution)
[11/14/2022-14:11:32] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) (CaskConvolution)
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:11:32] [V] [TRT] Tactic: 1062367460111450758 Time: 0.67156
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:11:32] [V] [TRT] Tactic: 1698681053543049347 Time: 0.663616
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:11:32] [V] [TRT] Tactic: 4501471010995462441 Time: 0.528748
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:11:32] [V] [TRT] Tactic: 5137655947464784826 Time: 0.493864
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:11:32] [V] [TRT] Tactic: 5288347012147084929 Time: 0.534336
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:11:32] [V] [TRT] Tactic: 5326823351883942011 Time: 0.508992
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:11:32] [V] [TRT] Tactic: 5500448035057547314 Time: 0.539492
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:11:32] [V] [TRT] Tactic: 6645123197870846056 Time: 0.484876
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:11:32] [V] [TRT] Tactic: 7144526460361122478 Time: 0.711204
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:11:32] [V] [TRT] Tactic: -8262349710178828730 Time: 0.53268
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:11:32] [V] [TRT] Tactic: -6576203419454146580 Time: 0.690392
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:11:32] [V] [TRT] Tactic: -4787320710726427159 Time: 0.731984
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:11:32] [V] [TRT] Tactic: -3456450830548107839 Time: 0.649772
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:11:32] [V] [TRT] Tactic: -1218658103698133241 Time: 0.585244
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:11:32] [V] [TRT] Tactic: -836875257600482091 Time: 0.570704
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:11:32] [V] [TRT] Tactic: -410470605513481746 Time: 0.51652
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:11:32] [V] [TRT] Tactic: -377491875521947884 Time: 0.522576
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:11:32] [V] [TRT] Tactic: -37215280111360163 Time: 0.538852
[11/14/2022-14:11:32] [V] [TRT] Fastest Tactic: 6645123197870846056 Time: 0.484876
[11/14/2022-14:11:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6645123197870846056
[11/14/2022-14:11:32] [V] [TRT] *************** Autotuning format combination: Float(153600,1,3840,96) -> Float(921600,1,23040,576) ***************
[11/14/2022-14:11:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:11:32] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) (CublasConvolution)
[11/14/2022-14:11:32] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) (CaskConvolution)
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:11:32] [V] [TRT] Tactic: 3886731678879822788 Time: 0.542128
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:11:32] [V] [TRT] Tactic: 6629944304117643200 Time: 1.48216
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:11:32] [V] [TRT] Tactic: -9153228964338181824 Time: 1.65818
[11/14/2022-14:11:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:11:32] [V] [TRT] Tactic: -7394439838318485025 Time: 0.534872
[11/14/2022-14:11:32] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.534872
[11/14/2022-14:11:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025
[11/14/2022-14:11:32] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:32] [V] [TRT] *************** Autotuning format combination: Float(921600,1600,40,1) -> Float(921600,1600,40,1) ***************
[11/14/2022-14:11:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) (CudaDepthwiseConvolution)
[11/14/2022-14:11:32] [V] [TRT] Tactic: -1 Time: 0.461732
[11/14/2022-14:11:32] [V] [TRT] Fastest Tactic: -1 Time: 0.461732
[11/14/2022-14:11:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:11:33] [V] [TRT] Tactic: 0 Time: 1.36856
[11/14/2022-14:11:33] [V] [TRT] Tactic: 1 Time: 1.26981
[11/14/2022-14:11:33] [V] [TRT] Tactic: 2 Time: 1.39657
[11/14/2022-14:11:35] [V] [TRT] Tactic: 4 Time: 130.261
[11/14/2022-14:11:41] [V] [TRT] Tactic: 5 Time: 375.588
[11/14/2022-14:11:41] [V] [TRT] Tactic: 6 Time: 21.762
[11/14/2022-14:11:41] [V] [TRT] Fastest Tactic: 1 Time: 1.26981
[11/14/2022-14:11:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) (CaskConvolution)
[11/14/2022-14:11:42] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:11:42] [V] [TRT] Tactic: 1062367460111450758 Time: 12.8884
[11/14/2022-14:11:42] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479
[11/14/2022-14:11:42] [V] [TRT] Tactic: 1754984623894446479 Time: 13.8493
[11/14/2022-14:11:42] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984
[11/14/2022-14:11:43] [V] [TRT] Tactic: 3611739942397549984 Time: 28.9436
[11/14/2022-14:11:43] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724
[11/14/2022-14:11:44] [V] [TRT] Tactic: 3827454225649558724 Time: 25.1744
[11/14/2022-14:11:44] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379
[11/14/2022-14:11:44] [V] [TRT] Tactic: 4337000649858996379 Time: 13.9142
[11/14/2022-14:11:44] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:11:45] [V] [TRT] Tactic: 4501471010995462441 Time: 27.3761
[11/14/2022-14:11:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:11:45] [V] [TRT] Tactic: 5137655947464784826 Time: 13.9167
[11/14/2022-14:11:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:11:46] [V] [TRT] Tactic: 5288347012147084929 Time: 27.6113
[11/14/2022-14:11:46] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896
[11/14/2022-14:11:46] [V] [TRT] Tactic: 5921334924264294896 Time: 17.4028
[11/14/2022-14:11:46] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:11:46] [V] [TRT] Tactic: 6645123197870846056 Time: 13.8809
[11/14/2022-14:11:47] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:11:47] [V] [TRT] Tactic: 7144526460361122478 Time: 11.1094
[11/14/2022-14:11:47] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038
[11/14/2022-14:11:47] [V] [TRT] Tactic: 7852627285308570038 Time: 26.7663
[11/14/2022-14:11:48] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713
[11/14/2022-14:11:48] [V] [TRT] Tactic: -9137461792520977713 Time: 26.7349
[11/14/2022-14:11:48] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509
[11/14/2022-14:11:49] [V] [TRT] Tactic: -8776506421218919509 Time: 24.3615
[11/14/2022-14:11:49] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:11:49] [V] [TRT] Tactic: -8262349710178828730 Time: 28.214
[11/14/2022-14:11:49] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780
[11/14/2022-14:11:50] [V] [TRT] Tactic: -8133971918129952780 Time: 13.4891
[11/14/2022-14:11:50] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144
[11/14/2022-14:11:50] [V] [TRT] Tactic: -6092040395344634144 Time: 14.9024
[11/14/2022-14:11:50] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:11:50] [V] [TRT] Tactic: -4787320710726427159 Time: 12.3968
[11/14/2022-14:11:51] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:11:51] [V] [TRT] Tactic: -3456450830548107839 Time: 11.9536
[11/14/2022-14:11:51] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239
[11/14/2022-14:11:51] [V] [TRT] Tactic: -2318106587342035239 Time: 25.5921
[11/14/2022-14:11:51] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657
[11/14/2022-14:11:52] [V] [TRT] Tactic: -1343271414618805657 Time: 17.2517
[11/14/2022-14:11:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:11:52] [V] [TRT] Tactic: -1218658103698133241 Time: 13.7766
[11/14/2022-14:11:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:11:53] [V] [TRT] Tactic: -836875257600482091 Time: 13.1692
[11/14/2022-14:11:53] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:11:53] [V] [TRT] Tactic: -410470605513481746 Time: 26.3573
[11/14/2022-14:11:53] [V] [TRT] Fastest Tactic: 7144526460361122478 Time: 11.1094
[11/14/2022-14:11:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/14/2022-14:11:53] [V] [TRT] *************** Autotuning format combination: Float(921600,1,23040,576) -> Float(921600,1,23040,576) ***************
[11/14/2022-14:11:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:11:53] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) (CaskConvolution)
[11/14/2022-14:11:53] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:53] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:53] [V] [TRT] *************** Autotuning format combination: Float(921600,1600,40,1), Float(153600,1600,40,1) -> Float(153600,1600,40,1) ***************
[11/14/2022-14:11:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add (FusedConvActConvolution)
[11/14/2022-14:11:53] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add (CudaDepthwiseConvolution)
[11/14/2022-14:11:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add (CudnnConvolution)
[11/14/2022-14:11:53] [V] [TRT] Tactic: 0 Time: 0.882472
[11/14/2022-14:11:53] [V] [TRT] Tactic: 1 Time: 0.807324
[11/14/2022-14:11:53] [V] [TRT] Tactic: 2 Time: 1.47772
[11/14/2022-14:11:53] [V] [TRT] Tactic: 4 skipped. Scratch requested: 1888247808, available: 16777216
[11/14/2022-14:11:53] [V] [TRT] Tactic: 5 Time: 3.67978
[11/14/2022-14:11:53] [V] [TRT] Fastest Tactic: 1 Time: 0.807324
[11/14/2022-14:11:53] [V] [TRT] Setting workspace to 1888247808enables more tactics for profiling
[11/14/2022-14:11:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add (CublasConvolution)
[11/14/2022-14:11:53] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add (CaskConvolution)
[11/14/2022-14:11:53] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:11:53] [V] [TRT] Tactic: 1062367460111450758 Time: 0.530708
[11/14/2022-14:11:53] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:11:53] [V] [TRT] Tactic: 1698681053543049347 Time: 0.614268
[11/14/2022-14:11:53] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:11:53] [V] [TRT] Tactic: 4501471010995462441 Time: 0.522304
[11/14/2022-14:11:53] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:11:53] [V] [TRT] Tactic: 5137655947464784826 Time: 0.516664
[11/14/2022-14:11:53] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:11:53] [V] [TRT] Tactic: 5288347012147084929 Time: 0.5307
[11/14/2022-14:11:53] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:11:53] [V] [TRT] Tactic: 5326823351883942011 Time: 0.511304
[11/14/2022-14:11:53] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:11:53] [V] [TRT] Tactic: 5500448035057547314 Time: 0.671488
[11/14/2022-14:11:53] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:11:53] [V] [TRT] Tactic: 6645123197870846056 Time: 0.551876
[11/14/2022-14:11:53] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:11:54] [V] [TRT] Tactic: 7144526460361122478 Time: 0.619048
[11/14/2022-14:11:54] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:11:54] [V] [TRT] Tactic: -8262349710178828730 Time: 0.537444
[11/14/2022-14:11:54] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:11:54] [V] [TRT] Tactic: -6576203419454146580 Time: 0.501724
[11/14/2022-14:11:54] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:11:54] [V] [TRT] Tactic: -4787320710726427159 Time: 0.605168
[11/14/2022-14:11:54] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:11:54] [V] [TRT] Tactic: -3456450830548107839 Time: 0.529856
[11/14/2022-14:11:54] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:11:54] [V] [TRT] Tactic: -1218658103698133241 Time: 0.682164
[11/14/2022-14:11:54] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:11:54] [V] [TRT] Tactic: -836875257600482091 Time: 0.685388
[11/14/2022-14:11:54] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:11:54] [V] [TRT] Tactic: -410470605513481746 Time: 0.534892
[11/14/2022-14:11:54] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:11:54] [V] [TRT] Tactic: -377491875521947884 Time: 0.551084
[11/14/2022-14:11:54] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:11:54] [V] [TRT] Tactic: -37215280111360163 Time: 0.50454
[11/14/2022-14:11:54] [V] [TRT] Fastest Tactic: -6576203419454146580 Time: 0.501724
[11/14/2022-14:11:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580
[11/14/2022-14:11:54] [V] [TRT] *************** Autotuning format combination: Float(921600,1,23040,576), Float(153600,1,3840,96) -> Float(153600,1,3840,96) ***************
[11/14/2022-14:11:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add (CudnnConvolution)
[11/14/2022-14:11:54] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add (CublasConvolution)
[11/14/2022-14:11:54] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:11:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add (CaskConvolution)
[11/14/2022-14:11:54] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:11:54] [V] [TRT] Tactic: 3886731678879822788 Time: 0.536272
[11/14/2022-14:11:54] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:11:54] [V] [TRT] Tactic: 6629944304117643200 Time: 0.856276
[11/14/2022-14:11:54] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:11:54] [V] [TRT] Tactic: -9153228964338181824 Time: 0.90322
[11/14/2022-14:11:54] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:11:54] [V] [TRT] Tactic: -7394439838318485025 Time: 0.519972
[11/14/2022-14:11:54] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.519972
[11/14/2022-14:11:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025
[11/14/2022-14:11:54] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:54] [V] [TRT] *************** Autotuning format combination: Float(153600,1600,40,1) -> Float(921600,1600,40,1) ***************
[11/14/2022-14:11:54] [V] [TRT] *************** Autotuning format combination: Float(153600,1,3840,96) -> Float(921600,1,23040,576) ***************
[11/14/2022-14:11:54] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:54] [V] [TRT] *************** Autotuning format combination: Float(921600,1600,40,1) -> Float(921600,1600,40,1) ***************
[11/14/2022-14:11:54] [V] [TRT] *************** Autotuning format combination: Float(921600,1,23040,576) -> Float(921600,1,23040,576) ***************
[11/14/2022-14:11:54] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:54] [V] [TRT] *************** Autotuning format combination: Float(921600,1600,40,1), Float(153600,1600,40,1) -> Float(153600,1600,40,1) ***************
[11/14/2022-14:11:54] [V] [TRT] *************** Autotuning format combination: Float(921600,1,23040,576), Float(153600,1,3840,96) -> Float(153600,1,3840,96) ***************
[11/14/2022-14:11:54] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:54] [V] [TRT] *************** Autotuning format combination: Float(153600,1600,40,1) -> Float(921600,1600,40,1) ***************
[11/14/2022-14:11:54] [V] [TRT] *************** Autotuning format combination: Float(153600,1,3840,96) -> Float(921600,1,23040,576) ***************
[11/14/2022-14:11:54] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:11:54] [V] [TRT] *************** Autotuning format combination: Float(921600,1600,40,1) -> Float(230400,400,20,1) ***************
[11/14/2022-14:11:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) (CudaDepthwiseConvolution)
[11/14/2022-14:11:54] [V] [TRT] Tactic: -1 Time: 0.249864
[11/14/2022-14:11:54] [V] [TRT] Fastest Tactic: -1 Time: 0.249864
[11/14/2022-14:11:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:11:54] [V] [TRT] Tactic: 0 Time: 1.10055
[11/14/2022-14:11:54] [V] [TRT] Tactic: 1 Time: 1.03207
[11/14/2022-14:11:54] [V] [TRT] Tactic: 2 Time: 0.836904
[11/14/2022-14:12:00] [V] [TRT] Tactic: 5 Time: 355.039
[11/14/2022-14:12:00] [V] [TRT] Fastest Tactic: 2 Time: 0.836904
[11/14/2022-14:12:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) (CaskConvolution)
[11/14/2022-14:12:00] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:12:00] [V] [TRT] Tactic: 1062367460111450758 Time: 12.0481
[11/14/2022-14:12:00] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479
[11/14/2022-14:12:00] [V] [TRT] Tactic: 1754984623894446479 Time: 13.0666
[11/14/2022-14:12:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984
[11/14/2022-14:12:01] [V] [TRT] Tactic: 3611739942397549984 Time: 12.5291
[11/14/2022-14:12:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379
[11/14/2022-14:12:01] [V] [TRT] Tactic: 4337000649858996379 Time: 12.5316
[11/14/2022-14:12:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:12:02] [V] [TRT] Tactic: 4501471010995462441 Time: 12.4172
[11/14/2022-14:12:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:12:02] [V] [TRT] Tactic: 5137655947464784826 Time: 10.8675
[11/14/2022-14:12:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:12:02] [V] [TRT] Tactic: 5288347012147084929 Time: 10.8297
[11/14/2022-14:12:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:12:03] [V] [TRT] Tactic: 6645123197870846056 Time: 11.7602
[11/14/2022-14:12:03] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:12:03] [V] [TRT] Tactic: 7144526460361122478 Time: 11.188
[11/14/2022-14:12:03] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713
[11/14/2022-14:12:03] [V] [TRT] Tactic: -9137461792520977713 Time: 13.1028
[11/14/2022-14:12:04] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:12:04] [V] [TRT] Tactic: -8262349710178828730 Time: 12.2275
[11/14/2022-14:12:04] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780
[11/14/2022-14:12:04] [V] [TRT] Tactic: -8133971918129952780 Time: 13.3493
[11/14/2022-14:12:04] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144
[11/14/2022-14:12:05] [V] [TRT] Tactic: -6092040395344634144 Time: 12.5283
[11/14/2022-14:12:05] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:12:05] [V] [TRT] Tactic: -4787320710726427159 Time: 12.4237
[11/14/2022-14:12:05] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:12:05] [V] [TRT] Tactic: -3456450830548107839 Time: 11.0695
[11/14/2022-14:12:06] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:12:06] [V] [TRT] Tactic: -1218658103698133241 Time: 11.9845
[11/14/2022-14:12:06] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:12:06] [V] [TRT] Tactic: -836875257600482091 Time: 11.59
[11/14/2022-14:12:06] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:12:07] [V] [TRT] Tactic: -410470605513481746 Time: 10.8914
[11/14/2022-14:12:07] [V] [TRT] Fastest Tactic: 5288347012147084929 Time: 10.8297
[11/14/2022-14:12:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/14/2022-14:12:07] [V] [TRT] *************** Autotuning format combination: Float(921600,1,23040,576) -> Float(230400,1,11520,576) ***************
[11/14/2022-14:12:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:12:07] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) (CaskConvolution)
[11/14/2022-14:12:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:07] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:07] [V] [TRT] *************** Autotuning format combination: Float(230400,400,20,1) -> Float(64000,400,20,1) ***************
[11/14/2022-14:12:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D (FusedConvActConvolution)
[11/14/2022-14:12:07] [V] [TRT] Tactic: 589823 Time: 0.48348
[11/14/2022-14:12:07] [V] [TRT] Tactic: 655359 Time: 0.4441
[11/14/2022-14:12:07] [V] [TRT] Tactic: 786431 Time: 0.37444
[11/14/2022-14:12:07] [V] [TRT] Tactic: 851967 Time: 0.59418
[11/14/2022-14:12:07] [V] [TRT] Tactic: 1179647 Time: 0.527352
[11/14/2022-14:12:07] [V] [TRT] Tactic: 1310719 Time: 0.875892
[11/14/2022-14:12:07] [V] [TRT] Tactic: 1376255 Time: 0.479216
[11/14/2022-14:12:07] [V] [TRT] Tactic: 1441791 Time: 0.514948
[11/14/2022-14:12:07] [V] [TRT] Tactic: 1507327 Time: 0.56462
[11/14/2022-14:12:07] [V] [TRT] Tactic: 1638399 Time: 0.51532
[11/14/2022-14:12:07] [V] [TRT] Tactic: 1835007 Time: 0.397484
[11/14/2022-14:12:07] [V] [TRT] Tactic: 1900543 Time: 0.660328
[11/14/2022-14:12:07] [V] [TRT] Tactic: 2097151 Time: 0.5025
[11/14/2022-14:12:07] [V] [TRT] Tactic: 2162687 Time: 0.514944
[11/14/2022-14:12:07] [V] [TRT] Tactic: 2293759 Time: 0.469052
[11/14/2022-14:12:07] [V] [TRT] Tactic: 2359295 Time: 0.411812
[11/14/2022-14:12:07] [V] [TRT] Tactic: 2686975 Time: 0.451352
[11/14/2022-14:12:07] [V] [TRT] Tactic: 3080191 Time: 0.534668
[11/14/2022-14:12:07] [V] [TRT] Tactic: 3342335 Time: 0.690324
[11/14/2022-14:12:08] [V] [TRT] Tactic: 3407871 Time: 0.459408
[11/14/2022-14:12:08] [V] [TRT] Tactic: 3538943 Time: 0.440732
[11/14/2022-14:12:08] [V] [TRT] Tactic: 3670015 Time: 0.42876
[11/14/2022-14:12:08] [V] [TRT] Tactic: 3932159 Time: 0.59122
[11/14/2022-14:12:08] [V] [TRT] Tactic: 3997695 Time: 0.412608
[11/14/2022-14:12:08] [V] [TRT] Tactic: 4063231 Time: 0.633456
[11/14/2022-14:12:08] [V] [TRT] Tactic: 4194303 Time: 0.397192
[11/14/2022-14:12:08] [V] [TRT] Tactic: 4259839 Time: 0.483332
[11/14/2022-14:12:08] [V] [TRT] Tactic: 4325375 Time: 0.40962
[11/14/2022-14:12:08] [V] [TRT] Tactic: 4521983 Time: 0.513212
[11/14/2022-14:12:08] [V] [TRT] Tactic: 4587519 Time: 0.501276
[11/14/2022-14:12:08] [V] [TRT] Tactic: 4653055 Time: 0.59028
[11/14/2022-14:12:08] [V] [TRT] Tactic: 4915199 Time: 0.40356
[11/14/2022-14:12:08] [V] [TRT] Tactic: 4980735 Time: 0.459164
[11/14/2022-14:12:08] [V] [TRT] Tactic: 5177343 Time: 0.51854
[11/14/2022-14:12:08] [V] [TRT] Tactic: 5242879 Time: 0.396684
[11/14/2022-14:12:08] [V] [TRT] Tactic: 5373951 Time: 0.676056
[11/14/2022-14:12:08] [V] [TRT] Tactic: 5439487 Time: 0.622992
[11/14/2022-14:12:08] [V] [TRT] Tactic: 5570559 Time: 0.404664
[11/14/2022-14:12:08] [V] [TRT] Tactic: 5636095 Time: 0.639264
[11/14/2022-14:12:09] [V] [TRT] Tactic: 5701631 Time: 0.486388
[11/14/2022-14:12:09] [V] [TRT] Tactic: 5767167 Time: 1.04146
[11/14/2022-14:12:09] [V] [TRT] Tactic: 5832703 Time: 0.44758
[11/14/2022-14:12:09] [V] [TRT] Tactic: 5898239 Time: 0.377884
[11/14/2022-14:12:09] [V] [TRT] Tactic: 6029311 Time: 0.46158
[11/14/2022-14:12:09] [V] [TRT] Tactic: 6225919 Time: 0.40104
[11/14/2022-14:12:09] [V] [TRT] Tactic: 6291455 Time: 0.520568
[11/14/2022-14:12:09] [V] [TRT] Tactic: 6422527 Time: 0.530296
[11/14/2022-14:12:09] [V] [TRT] Tactic: 6750207 Time: 0.474452
[11/14/2022-14:12:09] [V] [TRT] Tactic: 6815743 Time: 0.46442
[11/14/2022-14:12:09] [V] [TRT] Tactic: 6946815 Time: 0.68702
[11/14/2022-14:12:09] [V] [TRT] Tactic: 7012351 Time: 0.506804
[11/14/2022-14:12:09] [V] [TRT] Tactic: 7077887 Time: 0.439156
[11/14/2022-14:12:09] [V] [TRT] Tactic: 7143423 Time: 0.68266
[11/14/2022-14:12:09] [V] [TRT] Tactic: 7208959 Time: 0.412008
[11/14/2022-14:12:09] [V] [TRT] Tactic: 7340031 Time: 0.410396
[11/14/2022-14:12:09] [V] [TRT] Tactic: 7405567 Time: 0.492584
[11/14/2022-14:12:09] [V] [TRT] Tactic: 7536639 Time: 0.5751
[11/14/2022-14:12:09] [V] [TRT] Tactic: 7602175 Time: 0.58504
[11/14/2022-14:12:09] [V] [TRT] Tactic: 7733247 Time: 0.4466
[11/14/2022-14:12:09] [V] [TRT] Tactic: 7798783 Time: 0.376624
[11/14/2022-14:12:10] [V] [TRT] Tactic: 8191999 Time: 0.6437
[11/14/2022-14:12:10] [V] [TRT] Tactic: 8257535 Time: 0.436492
[11/14/2022-14:12:10] [V] [TRT] Tactic: 8323071 Time: 0.461588
[11/14/2022-14:12:10] [V] [TRT] Tactic: 8650751 Time: 0.554136
[11/14/2022-14:12:10] [V] [TRT] Tactic: 8716287 Time: 0.533076
[11/14/2022-14:12:10] [V] [TRT] Tactic: 9109503 Time: 0.54288
[11/14/2022-14:12:10] [V] [TRT] Tactic: 9568255 Time: 0.406492
[11/14/2022-14:12:10] [V] [TRT] Tactic: 9895935 Time: 0.394576
[11/14/2022-14:12:10] [V] [TRT] Tactic: 10223615 Time: 0.452204
[11/14/2022-14:12:10] [V] [TRT] Tactic: 10354687 Time: 0.50988
[11/14/2022-14:12:10] [V] [TRT] Tactic: 10551295 Time: 0.451424
[11/14/2022-14:12:10] [V] [TRT] Tactic: 10747903 Time: 0.42526
[11/14/2022-14:12:10] [V] [TRT] Tactic: 10944511 Time: 0.45952
[11/14/2022-14:12:10] [V] [TRT] Fastest Tactic: 786431 Time: 0.37444
[11/14/2022-14:12:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D (CudaDepthwiseConvolution)
[11/14/2022-14:12:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D (CudnnConvolution)
[11/14/2022-14:12:10] [V] [TRT] Tactic: 0 Time: 0.406348
[11/14/2022-14:12:10] [V] [TRT] Tactic: 1 Time: 0.324504
[11/14/2022-14:12:10] [V] [TRT] Tactic: 2 Time: 0.618736
[11/14/2022-14:12:10] [V] [TRT] Tactic: 4 skipped. Scratch requested: 807542784, available: 16777216
[11/14/2022-14:12:10] [V] [TRT] Tactic: 5 Time: 2.95826
[11/14/2022-14:12:10] [V] [TRT] Fastest Tactic: 1 Time: 0.324504
[11/14/2022-14:12:10] [V] [TRT] Setting workspace to 807542784enables more tactics for profiling
[11/14/2022-14:12:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D (CublasConvolution)
[11/14/2022-14:12:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D (CaskConvolution)
[11/14/2022-14:12:10] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:12:10] [V] [TRT] Tactic: 1062367460111450758 Time: 0.271652
[11/14/2022-14:12:10] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:12:10] [V] [TRT] Tactic: 1698681053543049347 Time: 0.264708
[11/14/2022-14:12:10] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:12:10] [V] [TRT] Tactic: 4501471010995462441 Time: 0.281876
[11/14/2022-14:12:10] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:12:10] [V] [TRT] Tactic: 5137655947464784826 Time: 0.251412
[11/14/2022-14:12:10] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:12:10] [V] [TRT] Tactic: 5288347012147084929 Time: 0.298984
[11/14/2022-14:12:10] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:12:10] [V] [TRT] Tactic: 5326823351883942011 Time: 0.278584
[11/14/2022-14:12:10] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:12:10] [V] [TRT] Tactic: 5500448035057547314 Time: 0.306984
[11/14/2022-14:12:10] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:12:10] [V] [TRT] Tactic: 6645123197870846056 Time: 0.25336
[11/14/2022-14:12:10] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:12:10] [V] [TRT] Tactic: 7144526460361122478 Time: 0.265
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:12:11] [V] [TRT] Tactic: -8262349710178828730 Time: 0.28638
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:12:11] [V] [TRT] Tactic: -6576203419454146580 Time: 0.228688
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:12:11] [V] [TRT] Tactic: -4787320710726427159 Time: 0.267764
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:12:11] [V] [TRT] Tactic: -3456450830548107839 Time: 0.235196
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:12:11] [V] [TRT] Tactic: -1218658103698133241 Time: 0.317316
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:12:11] [V] [TRT] Tactic: -836875257600482091 Time: 0.31284
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:12:11] [V] [TRT] Tactic: -410470605513481746 Time: 0.288596
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:12:11] [V] [TRT] Tactic: -377491875521947884 Time: 0.276696
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:12:11] [V] [TRT] Tactic: -37215280111360163 Time: 0.261444
[11/14/2022-14:12:11] [V] [TRT] Fastest Tactic: -6576203419454146580 Time: 0.228688
[11/14/2022-14:12:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580
[11/14/2022-14:12:11] [V] [TRT] *************** Autotuning format combination: Float(230400,1,11520,576) -> Float(64000,1,3200,160) ***************
[11/14/2022-14:12:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D (CudnnConvolution)
[11/14/2022-14:12:11] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D (CublasConvolution)
[11/14/2022-14:12:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D (CaskConvolution)
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:12:11] [V] [TRT] Tactic: 3886731678879822788 Time: 0.219556
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:12:11] [V] [TRT] Tactic: 6629944304117643200 Time: 0.356152
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:12:11] [V] [TRT] Tactic: -9153228964338181824 Time: 0.342792
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:12:11] [V] [TRT] Tactic: -7394439838318485025 Time: 0.239532
[11/14/2022-14:12:11] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.219556
[11/14/2022-14:12:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788
[11/14/2022-14:12:11] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:11] [V] [TRT] *************** Autotuning format combination: Float(64000,400,20,1) -> Float(384000,400,20,1) ***************
[11/14/2022-14:12:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) (FusedConvActConvolution)
[11/14/2022-14:12:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) (CudaDepthwiseConvolution)
[11/14/2022-14:12:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:12:11] [V] [TRT] Tactic: 0 Time: 0.797444
[11/14/2022-14:12:11] [V] [TRT] Tactic: 1 Time: 0.811448
[11/14/2022-14:12:11] [V] [TRT] Tactic: 2 Time: 0.934956
[11/14/2022-14:12:11] [V] [TRT] Tactic: 4 skipped. Scratch requested: 1338941440, available: 16777216
[11/14/2022-14:12:11] [V] [TRT] Tactic: 5 skipped. Scratch requested: 23936000, available: 16777216
[11/14/2022-14:12:11] [V] [TRT] Fastest Tactic: 0 Time: 0.797444
[11/14/2022-14:12:11] [V] [TRT] Setting workspace to 23936000enables more tactics for profiling
[11/14/2022-14:12:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) (CublasConvolution)
[11/14/2022-14:12:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) (CaskConvolution)
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:12:11] [V] [TRT] Tactic: 1062367460111450758 Time: 0.447464
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:12:11] [V] [TRT] Tactic: 1698681053543049347 Time: 0.388908
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:12:11] [V] [TRT] Tactic: 4501471010995462441 Time: 0.368356
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:12:11] [V] [TRT] Tactic: 5137655947464784826 Time: 0.34276
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:12:11] [V] [TRT] Tactic: 5288347012147084929 Time: 0.388108
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:12:11] [V] [TRT] Tactic: 5326823351883942011 Time: 0.3594
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:12:11] [V] [TRT] Tactic: 5500448035057547314 Time: 0.3982
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:12:11] [V] [TRT] Tactic: 6645123197870846056 Time: 0.352216
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:12:11] [V] [TRT] Tactic: 7144526460361122478 Time: 0.438552
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:12:11] [V] [TRT] Tactic: -8262349710178828730 Time: 0.378524
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:12:11] [V] [TRT] Tactic: -6576203419454146580 Time: 0.39564
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:12:11] [V] [TRT] Tactic: -4787320710726427159 Time: 0.463212
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:12:11] [V] [TRT] Tactic: -3456450830548107839 Time: 0.437528
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:12:11] [V] [TRT] Tactic: -1218658103698133241 Time: 0.424584
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:12:11] [V] [TRT] Tactic: -836875257600482091 Time: 0.400628
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:12:11] [V] [TRT] Tactic: -410470605513481746 Time: 0.413064
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:12:11] [V] [TRT] Tactic: -377491875521947884 Time: 0.427748
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:12:11] [V] [TRT] Tactic: -37215280111360163 Time: 0.3418
[11/14/2022-14:12:11] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.3418
[11/14/2022-14:12:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163
[11/14/2022-14:12:11] [V] [TRT] *************** Autotuning format combination: Float(64000,1,3200,160) -> Float(384000,1,19200,960) ***************
[11/14/2022-14:12:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:12:11] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) (CublasConvolution)
[11/14/2022-14:12:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) (CaskConvolution)
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:12:11] [V] [TRT] Tactic: 3886731678879822788 Time: 0.37836
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:12:11] [V] [TRT] Tactic: 6629944304117643200 Time: 0.685456
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:12:11] [V] [TRT] Tactic: -9153228964338181824 Time: 0.686808
[11/14/2022-14:12:11] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:12:11] [V] [TRT] Tactic: -7394439838318485025 Time: 0.372412
[11/14/2022-14:12:11] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.372412
[11/14/2022-14:12:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025
[11/14/2022-14:12:11] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:11] [V] [TRT] *************** Autotuning format combination: Float(384000,400,20,1) -> Float(384000,400,20,1) ***************
[11/14/2022-14:12:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) (CudaDepthwiseConvolution)
[11/14/2022-14:12:11] [V] [TRT] Tactic: -1 Time: 0.24196
[11/14/2022-14:12:11] [V] [TRT] Fastest Tactic: -1 Time: 0.24196
[11/14/2022-14:12:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:12:11] [V] [TRT] Tactic: 0 Time: 0.586176
[11/14/2022-14:12:11] [V] [TRT] Tactic: 1 Time: 0.823868
[11/14/2022-14:12:11] [V] [TRT] Tactic: 2 Time: 1.00572
[11/14/2022-14:12:13] [V] [TRT] Tactic: 4 Time: 94.0801
[11/14/2022-14:12:16] [V] [TRT] Tactic: 5 Time: 163.503
[11/14/2022-14:12:16] [V] [TRT] Tactic: 6 Time: 35.3337
[11/14/2022-14:12:16] [V] [TRT] Fastest Tactic: 0 Time: 0.586176
[11/14/2022-14:12:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) (CaskConvolution)
[11/14/2022-14:12:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:12:17] [V] [TRT] Tactic: 1062367460111450758 Time: 20.7929
[11/14/2022-14:12:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479
[11/14/2022-14:12:17] [V] [TRT] Tactic: 1754984623894446479 Time: 21.1485
[11/14/2022-14:12:18] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984
[11/14/2022-14:12:18] [V] [TRT] Tactic: 3611739942397549984 Time: 20.9083
[11/14/2022-14:12:18] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724
[11/14/2022-14:12:18] [V] [TRT] Tactic: 3827454225649558724 Time: 16.8281
[11/14/2022-14:12:19] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379
[11/14/2022-14:12:19] [V] [TRT] Tactic: 4337000649858996379 Time: 20.4992
[11/14/2022-14:12:19] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:12:20] [V] [TRT] Tactic: 4501471010995462441 Time: 20.8683
[11/14/2022-14:12:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:12:20] [V] [TRT] Tactic: 5137655947464784826 Time: 18.4829
[11/14/2022-14:12:20] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:12:21] [V] [TRT] Tactic: 5288347012147084929 Time: 18.3856
[11/14/2022-14:12:21] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896
[11/14/2022-14:12:21] [V] [TRT] Tactic: 5921334924264294896 Time: 16.0228
[11/14/2022-14:12:21] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:12:22] [V] [TRT] Tactic: 6645123197870846056 Time: 21.4694
[11/14/2022-14:12:22] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:12:22] [V] [TRT] Tactic: 7144526460361122478 Time: 18.4054
[11/14/2022-14:12:23] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038
[11/14/2022-14:12:23] [V] [TRT] Tactic: 7852627285308570038 Time: 18.162
[11/14/2022-14:12:23] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713
[11/14/2022-14:12:24] [V] [TRT] Tactic: -9137461792520977713 Time: 21.3153
[11/14/2022-14:12:24] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509
[11/14/2022-14:12:24] [V] [TRT] Tactic: -8776506421218919509 Time: 16.987
[11/14/2022-14:12:24] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:12:25] [V] [TRT] Tactic: -8262349710178828730 Time: 22.1919
[11/14/2022-14:12:25] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780
[11/14/2022-14:12:26] [V] [TRT] Tactic: -8133971918129952780 Time: 21.7659
[11/14/2022-14:12:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144
[11/14/2022-14:12:26] [V] [TRT] Tactic: -6092040395344634144 Time: 21.8167
[11/14/2022-14:12:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:12:27] [V] [TRT] Tactic: -4787320710726427159 Time: 21.1371
[11/14/2022-14:12:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:12:28] [V] [TRT] Tactic: -3456450830548107839 Time: 18.2617
[11/14/2022-14:12:28] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239
[11/14/2022-14:12:28] [V] [TRT] Tactic: -2318106587342035239 Time: 17.1389
[11/14/2022-14:12:28] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657
[11/14/2022-14:12:28] [V] [TRT] Tactic: -1343271414618805657 Time: 15.7679
[11/14/2022-14:12:29] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:12:29] [V] [TRT] Tactic: -1218658103698133241 Time: 21.2618
[11/14/2022-14:12:29] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:12:30] [V] [TRT] Tactic: -836875257600482091 Time: 19.7818
[11/14/2022-14:12:30] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:12:30] [V] [TRT] Tactic: -410470605513481746 Time: 18.2788
[11/14/2022-14:12:30] [V] [TRT] Fastest Tactic: -1343271414618805657 Time: 15.7679
[11/14/2022-14:12:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/14/2022-14:12:30] [V] [TRT] *************** Autotuning format combination: Float(384000,1,19200,960) -> Float(384000,1,19200,960) ***************
[11/14/2022-14:12:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:12:30] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) (CaskConvolution)
[11/14/2022-14:12:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:30] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:30] [V] [TRT] *************** Autotuning format combination: Float(384000,400,20,1), Float(64000,400,20,1) -> Float(64000,400,20,1) ***************
[11/14/2022-14:12:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add (FusedConvActConvolution)
[11/14/2022-14:12:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add (CudaDepthwiseConvolution)
[11/14/2022-14:12:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add (CudnnConvolution)
[11/14/2022-14:12:30] [V] [TRT] Tactic: 0 Time: 0.702144
[11/14/2022-14:12:30] [V] [TRT] Tactic: 1 Time: 0.532964
[11/14/2022-14:12:31] [V] [TRT] Tactic: 2 Time: 0.900704
[11/14/2022-14:12:31] [V] [TRT] Tactic: 4 skipped. Scratch requested: 1345904640, available: 16777216
[11/14/2022-14:12:31] [V] [TRT] Tactic: 5 skipped. Scratch requested: 23936000, available: 16777216
[11/14/2022-14:12:31] [V] [TRT] Fastest Tactic: 1 Time: 0.532964
[11/14/2022-14:12:31] [V] [TRT] Setting workspace to 23936000enables more tactics for profiling
[11/14/2022-14:12:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add (CublasConvolution)
[11/14/2022-14:12:31] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add (CaskConvolution)
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:12:31] [V] [TRT] Tactic: 1062367460111450758 Time: 0.410284
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:12:31] [V] [TRT] Tactic: 1698681053543049347 Time: 0.439228
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:12:31] [V] [TRT] Tactic: 4501471010995462441 Time: 0.472156
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:12:31] [V] [TRT] Tactic: 5137655947464784826 Time: 0.399352
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:12:31] [V] [TRT] Tactic: 5288347012147084929 Time: 0.459728
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:12:31] [V] [TRT] Tactic: 5326823351883942011 Time: 0.464048
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:12:31] [V] [TRT] Tactic: 5500448035057547314 Time: 0.521968
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:12:31] [V] [TRT] Tactic: 6645123197870846056 Time: 0.416612
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:12:31] [V] [TRT] Tactic: 7144526460361122478 Time: 0.450972
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:12:31] [V] [TRT] Tactic: -8262349710178828730 Time: 0.47356
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:12:31] [V] [TRT] Tactic: -6576203419454146580 Time: 0.410652
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:12:31] [V] [TRT] Tactic: -4787320710726427159 Time: 0.525596
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:12:31] [V] [TRT] Tactic: -3456450830548107839 Time: 0.391232
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:12:31] [V] [TRT] Tactic: -1218658103698133241 Time: 0.540448
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:12:31] [V] [TRT] Tactic: -836875257600482091 Time: 0.69116
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:12:31] [V] [TRT] Tactic: -410470605513481746 Time: 0.467216
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:12:31] [V] [TRT] Tactic: -377491875521947884 Time: 0.463332
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:12:31] [V] [TRT] Tactic: -37215280111360163 Time: 0.394636
[11/14/2022-14:12:31] [V] [TRT] Fastest Tactic: -3456450830548107839 Time: 0.391232
[11/14/2022-14:12:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3456450830548107839
[11/14/2022-14:12:31] [V] [TRT] *************** Autotuning format combination: Float(384000,1,19200,960), Float(64000,1,3200,160) -> Float(64000,1,3200,160) ***************
[11/14/2022-14:12:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add (CudnnConvolution)
[11/14/2022-14:12:31] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add (CublasConvolution)
[11/14/2022-14:12:31] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add (CaskConvolution)
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:12:31] [V] [TRT] Tactic: 3886731678879822788 Time: 0.370068
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:12:31] [V] [TRT] Tactic: 6629944304117643200 Time: 0.60006
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:12:31] [V] [TRT] Tactic: -9153228964338181824 Time: 0.56636
[11/14/2022-14:12:31] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:12:31] [V] [TRT] Tactic: -7394439838318485025 Time: 0.378912
[11/14/2022-14:12:31] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.370068
[11/14/2022-14:12:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788
[11/14/2022-14:12:31] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:31] [V] [TRT] *************** Autotuning format combination: Float(64000,400,20,1) -> Float(384000,400,20,1) ***************
[11/14/2022-14:12:31] [V] [TRT] *************** Autotuning format combination: Float(64000,1,3200,160) -> Float(384000,1,19200,960) ***************
[11/14/2022-14:12:31] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:31] [V] [TRT] *************** Autotuning format combination: Float(384000,400,20,1) -> Float(384000,400,20,1) ***************
[11/14/2022-14:12:31] [V] [TRT] *************** Autotuning format combination: Float(384000,1,19200,960) -> Float(384000,1,19200,960) ***************
[11/14/2022-14:12:31] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:31] [V] [TRT] *************** Autotuning format combination: Float(384000,400,20,1), Float(64000,400,20,1) -> Float(64000,400,20,1) ***************
[11/14/2022-14:12:31] [V] [TRT] *************** Autotuning format combination: Float(384000,1,19200,960), Float(64000,1,3200,160) -> Float(64000,1,3200,160) ***************
[11/14/2022-14:12:31] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:31] [V] [TRT] *************** Autotuning format combination: Float(64000,400,20,1) -> Float(384000,400,20,1) ***************
[11/14/2022-14:12:31] [V] [TRT] *************** Autotuning format combination: Float(64000,1,3200,160) -> Float(384000,1,19200,960) ***************
[11/14/2022-14:12:31] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:31] [V] [TRT] *************** Autotuning format combination: Float(384000,400,20,1) -> Float(384000,400,20,1) ***************
[11/14/2022-14:12:31] [V] [TRT] *************** Autotuning format combination: Float(384000,1,19200,960) -> Float(384000,1,19200,960) ***************
[11/14/2022-14:12:31] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:31] [V] [TRT] *************** Autotuning format combination: Float(384000,400,20,1) -> Float(128000,400,20,1) ***************
[11/14/2022-14:12:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D (FusedConvActConvolution)
[11/14/2022-14:12:31] [V] [TRT] Tactic: 589823 Time: 1.36946
[11/14/2022-14:12:31] [V] [TRT] Tactic: 655359 Time: 1.20666
[11/14/2022-14:12:32] [V] [TRT] Tactic: 786431 Time: 1.27176
[11/14/2022-14:12:32] [V] [TRT] Tactic: 851967 Time: 1.61777
[11/14/2022-14:12:32] [V] [TRT] Tactic: 1179647 Time: 1.94808
[11/14/2022-14:12:32] [V] [TRT] Tactic: 1310719 Time: 2.68933
[11/14/2022-14:12:32] [V] [TRT] Tactic: 1376255 Time: 1.19057
[11/14/2022-14:12:32] [V] [TRT] Tactic: 1441791 Time: 1.52907
[11/14/2022-14:12:32] [V] [TRT] Tactic: 1507327 Time: 1.34853
[11/14/2022-14:12:32] [V] [TRT] Tactic: 1638399 Time: 1.72924
[11/14/2022-14:12:32] [V] [TRT] Tactic: 1835007 Time: 1.45574
[11/14/2022-14:12:33] [V] [TRT] Tactic: 1900543 Time: 1.51282
[11/14/2022-14:12:33] [V] [TRT] Tactic: 2097151 Time: 1.58388
[11/14/2022-14:12:33] [V] [TRT] Tactic: 2162687 Time: 0.925412
[11/14/2022-14:12:33] [V] [TRT] Tactic: 2293759 Time: 1.19135
[11/14/2022-14:12:33] [V] [TRT] Tactic: 2359295 Time: 1.2054
[11/14/2022-14:12:33] [V] [TRT] Tactic: 2686975 Time: 1.19631
[11/14/2022-14:12:33] [V] [TRT] Tactic: 3080191 Time: 1.56135
[11/14/2022-14:12:33] [V] [TRT] Tactic: 3342335 Time: 1.57536
[11/14/2022-14:12:33] [V] [TRT] Tactic: 3407871 Time: 1.23852
[11/14/2022-14:12:33] [V] [TRT] Tactic: 3538943 Time: 1.45239
[11/14/2022-14:12:33] [V] [TRT] Tactic: 3670015 Time: 0.824656
[11/14/2022-14:12:33] [V] [TRT] Tactic: 3932159 Time: 1.36811
[11/14/2022-14:12:34] [V] [TRT] Tactic: 3997695 Time: 1.42754
[11/14/2022-14:12:34] [V] [TRT] Tactic: 4063231 Time: 1.71316
[11/14/2022-14:12:34] [V] [TRT] Tactic: 4194303 Time: 1.33665
[11/14/2022-14:12:34] [V] [TRT] Tactic: 4259839 Time: 1.60356
[11/14/2022-14:12:34] [V] [TRT] Tactic: 4325375 Time: 1.2105
[11/14/2022-14:12:34] [V] [TRT] Tactic: 4521983 Time: 1.29782
[11/14/2022-14:12:34] [V] [TRT] Tactic: 4587519 Time: 1.70122
[11/14/2022-14:12:34] [V] [TRT] Tactic: 4653055 Time: 1.89278
[11/14/2022-14:12:34] [V] [TRT] Tactic: 4915199 Time: 1.3834
[11/14/2022-14:12:35] [V] [TRT] Tactic: 4980735 Time: 1.28846
[11/14/2022-14:12:35] [V] [TRT] Tactic: 5177343 Time: 1.59178
[11/14/2022-14:12:35] [V] [TRT] Tactic: 5242879 Time: 1.08085
[11/14/2022-14:12:35] [V] [TRT] Tactic: 5373951 Time: 2.20208
[11/14/2022-14:12:35] [V] [TRT] Tactic: 5439487 Time: 2.14854
[11/14/2022-14:12:35] [V] [TRT] Tactic: 5570559 Time: 1.21606
[11/14/2022-14:12:35] [V] [TRT] Tactic: 5636095 Time: 1.77665
[11/14/2022-14:12:35] [V] [TRT] Tactic: 5701631 Time: 1.2475
[11/14/2022-14:12:36] [V] [TRT] Tactic: 5767167 Time: 3.66731
[11/14/2022-14:12:36] [V] [TRT] Tactic: 5832703 Time: 1.24936
[11/14/2022-14:12:36] [V] [TRT] Tactic: 5898239 Time: 1.08782
[11/14/2022-14:12:36] [V] [TRT] Tactic: 6029311 Time: 1.16551
[11/14/2022-14:12:36] [V] [TRT] Tactic: 6225919 Time: 1.3284
[11/14/2022-14:12:36] [V] [TRT] Tactic: 6291455 Time: 1.80049
[11/14/2022-14:12:36] [V] [TRT] Tactic: 6422527 Time: 1.45517
[11/14/2022-14:12:36] [V] [TRT] Tactic: 6750207 Time: 1.6366
[11/14/2022-14:12:36] [V] [TRT] Tactic: 6815743 Time: 1.38661
[11/14/2022-14:12:36] [V] [TRT] Tactic: 6946815 Time: 2.23299
[11/14/2022-14:12:37] [V] [TRT] Tactic: 7012351 Time: 1.55396
[11/14/2022-14:12:37] [V] [TRT] Tactic: 7077887 Time: 1.45792
[11/14/2022-14:12:37] [V] [TRT] Tactic: 7143423 Time: 2.43926
[11/14/2022-14:12:37] [V] [TRT] Tactic: 7208959 Time: 1.12768
[11/14/2022-14:12:37] [V] [TRT] Tactic: 7340031 Time: 1.18678
[11/14/2022-14:12:37] [V] [TRT] Tactic: 7405567 Time: 1.4981
[11/14/2022-14:12:37] [V] [TRT] Tactic: 7536639 Time: 1.7848
[11/14/2022-14:12:37] [V] [TRT] Tactic: 7602175 Time: 1.88261
[11/14/2022-14:12:37] [V] [TRT] Tactic: 7733247 Time: 1.24304
[11/14/2022-14:12:37] [V] [TRT] Tactic: 7798783 Time: 1.21908
[11/14/2022-14:12:38] [V] [TRT] Tactic: 8191999 Time: 2.24518
[11/14/2022-14:12:38] [V] [TRT] Tactic: 8257535 Time: 1.39744
[11/14/2022-14:12:38] [V] [TRT] Tactic: 8323071 Time: 1.43336
[11/14/2022-14:12:38] [V] [TRT] Tactic: 8650751 Time: 1.68104
[11/14/2022-14:12:38] [V] [TRT] Tactic: 8716287 Time: 1.7046
[11/14/2022-14:12:38] [V] [TRT] Tactic: 9109503 Time: 1.62671
[11/14/2022-14:12:38] [V] [TRT] Tactic: 9568255 Time: 1.31392
[11/14/2022-14:12:38] [V] [TRT] Tactic: 9895935 Time: 1.25248
[11/14/2022-14:12:38] [V] [TRT] Tactic: 10223615 Time: 1.15102
[11/14/2022-14:12:38] [V] [TRT] Tactic: 10354687 Time: 1.67948
[11/14/2022-14:12:38] [V] [TRT] Tactic: 10551295 Time: 1.4506
[11/14/2022-14:12:39] [V] [TRT] Tactic: 10747903 Time: 1.16866
[11/14/2022-14:12:39] [V] [TRT] Tactic: 10944511 Time: 1.26806
[11/14/2022-14:12:39] [V] [TRT] Fastest Tactic: 3670015 Time: 0.824656
[11/14/2022-14:12:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D (CudaDepthwiseConvolution)
[11/14/2022-14:12:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D (CudnnConvolution)
[11/14/2022-14:12:39] [V] [TRT] Tactic: 0 Time: 1.26092
[11/14/2022-14:12:39] [V] [TRT] Tactic: 1 Time: 1.1098
[11/14/2022-14:12:39] [V] [TRT] Tactic: 2 Time: 1.31148
[11/14/2022-14:12:39] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2683453440, available: 16777216
[11/14/2022-14:12:39] [V] [TRT] Tactic: 5 skipped. Scratch requested: 45260800, available: 16777216
[11/14/2022-14:12:39] [V] [TRT] Fastest Tactic: 1 Time: 1.1098
[11/14/2022-14:12:39] [V] [TRT] Setting workspace to 45260800enables more tactics for profiling
[11/14/2022-14:12:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D (CublasConvolution)
[11/14/2022-14:12:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D (CaskConvolution)
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:12:39] [V] [TRT] Tactic: 1062367460111450758 Time: 0.817152
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:12:39] [V] [TRT] Tactic: 1698681053543049347 Time: 0.84612
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:12:39] [V] [TRT] Tactic: 4501471010995462441 Time: 0.682
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:12:39] [V] [TRT] Tactic: 5137655947464784826 Time: 0.626404
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:12:39] [V] [TRT] Tactic: 5288347012147084929 Time: 0.683132
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:12:39] [V] [TRT] Tactic: 5326823351883942011 Time: 0.68216
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:12:39] [V] [TRT] Tactic: 5500448035057547314 Time: 0.754196
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:12:39] [V] [TRT] Tactic: 6645123197870846056 Time: 0.63694
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:12:39] [V] [TRT] Tactic: 7144526460361122478 Time: 0.837592
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:12:39] [V] [TRT] Tactic: -8262349710178828730 Time: 0.726776
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:12:39] [V] [TRT] Tactic: -6576203419454146580 Time: 0.719632
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:12:39] [V] [TRT] Tactic: -4787320710726427159 Time: 0.898108
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:12:39] [V] [TRT] Tactic: -3456450830548107839 Time: 0.829532
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:12:39] [V] [TRT] Tactic: -1218658103698133241 Time: 0.797212
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:12:39] [V] [TRT] Tactic: -836875257600482091 Time: 0.788312
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:12:39] [V] [TRT] Tactic: -410470605513481746 Time: 0.70604
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:12:39] [V] [TRT] Tactic: -377491875521947884 Time: 0.677172
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:12:39] [V] [TRT] Tactic: -37215280111360163 Time: 0.60842
[11/14/2022-14:12:39] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.60842
[11/14/2022-14:12:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163
[11/14/2022-14:12:39] [V] [TRT] *************** Autotuning format combination: Float(384000,1,19200,960) -> Float(128000,1,6400,320) ***************
[11/14/2022-14:12:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D (CudnnConvolution)
[11/14/2022-14:12:39] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D (CublasConvolution)
[11/14/2022-14:12:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D (CaskConvolution)
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:12:39] [V] [TRT] Tactic: 3886731678879822788 Time: 0.592496
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:12:39] [V] [TRT] Tactic: 6629944304117643200 Time: 1.27104
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:12:39] [V] [TRT] Tactic: -9153228964338181824 Time: 1.27486
[11/14/2022-14:12:39] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:12:39] [V] [TRT] Tactic: -7394439838318485025 Time: 0.596776
[11/14/2022-14:12:39] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.592496
[11/14/2022-14:12:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788
[11/14/2022-14:12:39] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:39] [V] [TRT] *************** Autotuning format combination: Float(128000,400,20,1) -> Float(512000,400,20,1) ***************
[11/14/2022-14:12:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) (FusedConvActConvolution)
[11/14/2022-14:12:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) (CudaDepthwiseConvolution)
[11/14/2022-14:12:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:12:39] [V] [TRT] Tactic: 0 Time: 1.89299
[11/14/2022-14:12:39] [V] [TRT] Tactic: 1 Time: 1.51858
[11/14/2022-14:12:40] [V] [TRT] Tactic: 2 Time: 1.57393
[11/14/2022-14:12:40] [V] [TRT] Tactic: 4 skipped. Scratch requested: 3569582080, available: 16777216
[11/14/2022-14:12:40] [V] [TRT] Tactic: 5 skipped. Scratch requested: 60057600, available: 16777216
[11/14/2022-14:12:40] [V] [TRT] Fastest Tactic: 1 Time: 1.51858
[11/14/2022-14:12:40] [V] [TRT] Setting workspace to 60057600enables more tactics for profiling
[11/14/2022-14:12:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) (CublasConvolution)
[11/14/2022-14:12:40] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) (CaskConvolution)
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:12:40] [V] [TRT] Tactic: 1062367460111450758 Time: 1.23925
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:12:40] [V] [TRT] Tactic: 1698681053543049347 Time: 1.40766
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:12:40] [V] [TRT] Tactic: 4501471010995462441 Time: 0.837604
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:12:40] [V] [TRT] Tactic: 5137655947464784826 Time: 0.944184
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:12:40] [V] [TRT] Tactic: 5288347012147084929 Time: 1.0179
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:12:40] [V] [TRT] Tactic: 5326823351883942011 Time: 0.860884
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:12:40] [V] [TRT] Tactic: 5500448035057547314 Time: 1.18032
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:12:40] [V] [TRT] Tactic: 6645123197870846056 Time: 1.09306
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:12:40] [V] [TRT] Tactic: 7144526460361122478 Time: 1.5811
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:12:40] [V] [TRT] Tactic: -8262349710178828730 Time: 0.84856
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:12:40] [V] [TRT] Tactic: -6576203419454146580 Time: 0.959904
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:12:40] [V] [TRT] Tactic: -4787320710726427159 Time: 1.36156
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:12:40] [V] [TRT] Tactic: -3456450830548107839 Time: 1.28253
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:12:40] [V] [TRT] Tactic: -1218658103698133241 Time: 1.06781
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:12:40] [V] [TRT] Tactic: -836875257600482091 Time: 0.999984
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:12:40] [V] [TRT] Tactic: -410470605513481746 Time: 0.828128
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:12:40] [V] [TRT] Tactic: -377491875521947884 Time: 0.883368
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:12:40] [V] [TRT] Tactic: -37215280111360163 Time: 0.857788
[11/14/2022-14:12:40] [V] [TRT] Fastest Tactic: -410470605513481746 Time: 0.828128
[11/14/2022-14:12:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -410470605513481746
[11/14/2022-14:12:40] [V] [TRT] *************** Autotuning format combination: Float(128000,1,6400,320) -> Float(512000,1,25600,1280) ***************
[11/14/2022-14:12:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) (CudnnConvolution)
[11/14/2022-14:12:40] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) (CublasConvolution)
[11/14/2022-14:12:40] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) (CaskConvolution)
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:12:40] [V] [TRT] Tactic: 3886731678879822788 Time: 0.884488
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:12:40] [V] [TRT] Tactic: 6629944304117643200 Time: 1.60608
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:12:40] [V] [TRT] Tactic: -9153228964338181824 Time: 1.6746
[11/14/2022-14:12:40] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:12:40] [V] [TRT] Tactic: -7394439838318485025 Time: 1.06645
[11/14/2022-14:12:40] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.884488
[11/14/2022-14:12:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788
[11/14/2022-14:12:40] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:40] [V] [TRT] *************** Autotuning format combination: Float(512000,400,20,1) -> Float(51200,400,20,1) ***************
[11/14/2022-14:12:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (FusedConvActConvolution)
[11/14/2022-14:12:41] [V] [TRT] Tactic: 589823 Time: 1.06573
[11/14/2022-14:12:41] [V] [TRT] Tactic: 655359 Time: 0.49596
[11/14/2022-14:12:41] [V] [TRT] Tactic: 786431 Time: 0.709204
[11/14/2022-14:12:41] [V] [TRT] Tactic: 851967 Time: 0.619452
[11/14/2022-14:12:41] [V] [TRT] Tactic: 1179647 Time: 0.714012
[11/14/2022-14:12:41] [V] [TRT] Tactic: 1310719 Time: 1.71756
[11/14/2022-14:12:41] [V] [TRT] Tactic: 1376255 Time: 0.93796
[11/14/2022-14:12:41] [V] [TRT] Tactic: 1441791 Time: 0.657892
[11/14/2022-14:12:41] [V] [TRT] Tactic: 1507327 Time: 0.74302
[11/14/2022-14:12:41] [V] [TRT] Tactic: 1638399 Time: 0.79064
[11/14/2022-14:12:41] [V] [TRT] Tactic: 1835007 Time: 0.598016
[11/14/2022-14:12:41] [V] [TRT] Tactic: 1900543 Time: 0.959028
[11/14/2022-14:12:41] [V] [TRT] Tactic: 2097151 Time: 0.77098
[11/14/2022-14:12:41] [V] [TRT] Tactic: 2162687 Time: 0.550156
[11/14/2022-14:12:41] [V] [TRT] Tactic: 2293759 Time: 0.942376
[11/14/2022-14:12:42] [V] [TRT] Tactic: 2359295 Time: 0.5536
[11/14/2022-14:12:42] [V] [TRT] Tactic: 2686975 Time: 0.506
[11/14/2022-14:12:42] [V] [TRT] Tactic: 3080191 Time: 0.64122
[11/14/2022-14:12:42] [V] [TRT] Tactic: 3342335 Time: 0.752328
[11/14/2022-14:12:42] [V] [TRT] Tactic: 3407871 Time: 0.734488
[11/14/2022-14:12:42] [V] [TRT] Tactic: 3538943 Time: 0.664652
[11/14/2022-14:12:42] [V] [TRT] Tactic: 3670015 Time: 0.49024
[11/14/2022-14:12:42] [V] [TRT] Tactic: 3932159 Time: 0.882408
[11/14/2022-14:12:42] [V] [TRT] Tactic: 3997695 Time: 0.736996
[11/14/2022-14:12:42] [V] [TRT] Tactic: 4063231 Time: 0.757864
[11/14/2022-14:12:42] [V] [TRT] Tactic: 4194303 Time: 0.601704
[11/14/2022-14:12:42] [V] [TRT] Tactic: 4259839 Time: 0.7916
[11/14/2022-14:12:42] [V] [TRT] Tactic: 4325375 Time: 0.633296
[11/14/2022-14:12:42] [V] [TRT] Tactic: 4521983 Time: 0.595724
[11/14/2022-14:12:42] [V] [TRT] Tactic: 4587519 Time: 0.82122
[11/14/2022-14:12:42] [V] [TRT] Tactic: 4653055 Time: 0.83186
[11/14/2022-14:12:42] [V] [TRT] Tactic: 4915199 Time: 0.60226
[11/14/2022-14:12:43] [V] [TRT] Tactic: 4980735 Time: 0.64716
[11/14/2022-14:12:43] [V] [TRT] Tactic: 5177343 Time: 0.703496
[11/14/2022-14:12:43] [V] [TRT] Tactic: 5242879 Time: 0.53794
[11/14/2022-14:12:43] [V] [TRT] Tactic: 5373951 Time: 0.89912
[11/14/2022-14:12:43] [V] [TRT] Tactic: 5439487 Time: 0.975628
[11/14/2022-14:12:43] [V] [TRT] Tactic: 5570559 Time: 0.503884
[11/14/2022-14:12:43] [V] [TRT] Tactic: 5636095 Time: 0.747144
[11/14/2022-14:12:43] [V] [TRT] Tactic: 5701631 Time: 0.963976
[11/14/2022-14:12:43] [V] [TRT] Tactic: 5767167 Time: 1.80008
[11/14/2022-14:12:43] [V] [TRT] Tactic: 5832703 Time: 0.723316
[11/14/2022-14:12:43] [V] [TRT] Tactic: 5898239 Time: 0.452796
[11/14/2022-14:12:43] [V] [TRT] Tactic: 6029311 Time: 0.92308
[11/14/2022-14:12:43] [V] [TRT] Tactic: 6225919 Time: 0.557936
[11/14/2022-14:12:43] [V] [TRT] Tactic: 6291455 Time: 0.714512
[11/14/2022-14:12:43] [V] [TRT] Tactic: 6422527 Time: 0.689984
[11/14/2022-14:12:43] [V] [TRT] Tactic: 6750207 Time: 0.732576
[11/14/2022-14:12:43] [V] [TRT] Tactic: 6815743 Time: 0.606084
[11/14/2022-14:12:44] [V] [TRT] Tactic: 6946815 Time: 0.967636
[11/14/2022-14:12:44] [V] [TRT] Tactic: 7012351 Time: 0.820708
[11/14/2022-14:12:44] [V] [TRT] Tactic: 7077887 Time: 0.655656
[11/14/2022-14:12:44] [V] [TRT] Tactic: 7143423 Time: 1.1968
[11/14/2022-14:12:44] [V] [TRT] Tactic: 7208959 Time: 0.555812
[11/14/2022-14:12:44] [V] [TRT] Tactic: 7340031 Time: 0.510468
[11/14/2022-14:12:44] [V] [TRT] Tactic: 7405567 Time: 0.758096
[11/14/2022-14:12:44] [V] [TRT] Tactic: 7536639 Time: 0.84416
[11/14/2022-14:12:44] [V] [TRT] Tactic: 7602175 Time: 0.885044
[11/14/2022-14:12:44] [V] [TRT] Tactic: 7733247 Time: 0.587232
[11/14/2022-14:12:44] [V] [TRT] Tactic: 7798783 Time: 0.702204
[11/14/2022-14:12:44] [V] [TRT] Tactic: 8191999 Time: 1.05894
[11/14/2022-14:12:44] [V] [TRT] Tactic: 8257535 Time: 0.619708
[11/14/2022-14:12:44] [V] [TRT] Tactic: 8323071 Time: 0.74006
[11/14/2022-14:12:45] [V] [TRT] Tactic: 8650751 Time: 0.920452
[11/14/2022-14:12:45] [V] [TRT] Tactic: 8716287 Time: 0.701596
[11/14/2022-14:12:45] [V] [TRT] Tactic: 9109503 Time: 0.789956
[11/14/2022-14:12:45] [V] [TRT] Tactic: 9568255 Time: 0.60674
[11/14/2022-14:12:45] [V] [TRT] Tactic: 9895935 Time: 0.59608
[11/14/2022-14:12:45] [V] [TRT] Tactic: 10223615 Time: 0.508104
[11/14/2022-14:12:45] [V] [TRT] Tactic: 10354687 Time: 0.773536
[11/14/2022-14:12:45] [V] [TRT] Tactic: 10551295 Time: 0.848152
[11/14/2022-14:12:45] [V] [TRT] Tactic: 10747903 Time: 0.565472
[11/14/2022-14:12:45] [V] [TRT] Tactic: 10944511 Time: 0.650736
[11/14/2022-14:12:45] [V] [TRT] Fastest Tactic: 5898239 Time: 0.452796
[11/14/2022-14:12:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (CudaDepthwiseConvolution)
[11/14/2022-14:12:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (CudnnConvolution)
[11/14/2022-14:12:45] [V] [TRT] Tactic: 0 Time: 0.636736
[11/14/2022-14:12:45] [V] [TRT] Tactic: 1 Time: 0.51024
[11/14/2022-14:12:45] [V] [TRT] Tactic: 2 Time: 0.746608
[11/14/2022-14:12:45] [V] [TRT] Tactic: 4 skipped. Scratch requested: 1437859840, available: 16777216
[11/14/2022-14:12:45] [V] [TRT] Tactic: 5 skipped. Scratch requested: 26112000, available: 16777216
[11/14/2022-14:12:45] [V] [TRT] Fastest Tactic: 1 Time: 0.51024
[11/14/2022-14:12:45] [V] [TRT] Setting workspace to 26112000enables more tactics for profiling
[11/14/2022-14:12:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (CublasConvolution)
[11/14/2022-14:12:45] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (CaskConvolution)
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:12:45] [V] [TRT] Tactic: 1062367460111450758 Time: 0.4998
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:12:45] [V] [TRT] Tactic: 1698681053543049347 Time: 0.556712
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:12:45] [V] [TRT] Tactic: 4501471010995462441 Time: 0.307696
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:12:45] [V] [TRT] Tactic: 5137655947464784826 Time: 0.309896
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:12:45] [V] [TRT] Tactic: 5288347012147084929 Time: 0.308636
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:12:45] [V] [TRT] Tactic: 5326823351883942011 Time: 0.295488
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:12:45] [V] [TRT] Tactic: 5500448035057547314 Time: 0.339748
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:12:45] [V] [TRT] Tactic: 6645123197870846056 Time: 0.31652
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:12:45] [V] [TRT] Tactic: 7144526460361122478 Time: 0.544096
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:12:45] [V] [TRT] Tactic: -8262349710178828730 Time: 0.3086
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:12:45] [V] [TRT] Tactic: -6576203419454146580 Time: 0.45194
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:12:45] [V] [TRT] Tactic: -4787320710726427159 Time: 0.542984
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:12:45] [V] [TRT] Tactic: -3456450830548107839 Time: 0.461444
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:12:45] [V] [TRT] Tactic: -1218658103698133241 Time: 0.368768
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:12:45] [V] [TRT] Tactic: -836875257600482091 Time: 0.355904
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:12:45] [V] [TRT] Tactic: -410470605513481746 Time: 0.300996
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:12:45] [V] [TRT] Tactic: -377491875521947884 Time: 0.319964
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:12:45] [V] [TRT] Tactic: -37215280111360163 Time: 0.305144
[11/14/2022-14:12:45] [V] [TRT] Fastest Tactic: 5326823351883942011 Time: 0.295488
[11/14/2022-14:12:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5326823351883942011
[11/14/2022-14:12:45] [V] [TRT] *************** Autotuning format combination: Float(512000,1,25600,1280) -> Float(51200,1,2560,128) ***************
[11/14/2022-14:12:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (CudnnConvolution)
[11/14/2022-14:12:45] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (CublasConvolution)
[11/14/2022-14:12:45] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (CaskConvolution)
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:12:45] [V] [TRT] Tactic: 3886731678879822788 Time: 0.309728
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:12:45] [V] [TRT] Tactic: 6629944304117643200 Time: 0.64362
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:12:45] [V] [TRT] Tactic: -9153228964338181824 Time: 0.56956
[11/14/2022-14:12:45] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:12:45] [V] [TRT] Tactic: -7394439838318485025 Time: 0.359928
[11/14/2022-14:12:45] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.309728
[11/14/2022-14:12:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788
[11/14/2022-14:12:45] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:45] [V] [TRT] *************** Autotuning format combination: Float(51200,400,20,1) -> Float(12800,100,10,1) ***************
[11/14/2022-14:12:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise (CudaDepthwiseConvolution)
[11/14/2022-14:12:46] [V] [TRT] Tactic: -1 Time: 0.02224
[11/14/2022-14:12:46] [V] [TRT] Fastest Tactic: -1 Time: 0.02224
[11/14/2022-14:12:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise (CudnnConvolution)
[11/14/2022-14:12:46] [V] [TRT] Tactic: 0 Time: 0.04408
[11/14/2022-14:12:46] [V] [TRT] Tactic: 1 Time: 0.043196
[11/14/2022-14:12:46] [V] [TRT] Tactic: 2 Time: 0.04294
[11/14/2022-14:12:46] [V] [TRT] Tactic: 5 Time: 21.5632
[11/14/2022-14:12:46] [V] [TRT] Fastest Tactic: 2 Time: 0.04294
[11/14/2022-14:12:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise (CaskConvolution)
[11/14/2022-14:12:46] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:12:46] [V] [TRT] Tactic: 1062367460111450758 Time: 2.49271
[11/14/2022-14:12:46] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479
[11/14/2022-14:12:46] [V] [TRT] Tactic: 1754984623894446479 Time: 2.72231
[11/14/2022-14:12:46] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984
[11/14/2022-14:12:46] [V] [TRT] Tactic: 3611739942397549984 Time: 2.46214
[11/14/2022-14:12:46] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379
[11/14/2022-14:12:46] [V] [TRT] Tactic: 4337000649858996379 Time: 2.3609
[11/14/2022-14:12:46] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:12:46] [V] [TRT] Tactic: 4501471010995462441 Time: 2.47082
[11/14/2022-14:12:46] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:12:46] [V] [TRT] Tactic: 5137655947464784826 Time: 2.4028
[11/14/2022-14:12:46] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:12:47] [V] [TRT] Tactic: 5288347012147084929 Time: 2.38822
[11/14/2022-14:12:47] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:12:47] [V] [TRT] Tactic: 6645123197870846056 Time: 2.52762
[11/14/2022-14:12:47] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:12:47] [V] [TRT] Tactic: 7144526460361122478 Time: 2.25273
[11/14/2022-14:12:47] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713
[11/14/2022-14:12:47] [V] [TRT] Tactic: -9137461792520977713 Time: 2.41484
[11/14/2022-14:12:47] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:12:47] [V] [TRT] Tactic: -8262349710178828730 Time: 2.68997
[11/14/2022-14:12:47] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780
[11/14/2022-14:12:47] [V] [TRT] Tactic: -8133971918129952780 Time: 2.49711
[11/14/2022-14:12:47] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144
[11/14/2022-14:12:47] [V] [TRT] Tactic: -6092040395344634144 Time: 2.71999
[11/14/2022-14:12:47] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:12:47] [V] [TRT] Tactic: -4787320710726427159 Time: 2.64539
[11/14/2022-14:12:47] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:12:47] [V] [TRT] Tactic: -3456450830548107839 Time: 2.46728
[11/14/2022-14:12:47] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:12:47] [V] [TRT] Tactic: -1218658103698133241 Time: 2.26653
[11/14/2022-14:12:47] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:12:47] [V] [TRT] Tactic: -836875257600482091 Time: 2.43978
[11/14/2022-14:12:47] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:12:47] [V] [TRT] Tactic: -410470605513481746 Time: 2.31018
[11/14/2022-14:12:47] [V] [TRT] Fastest Tactic: 7144526460361122478 Time: 2.25273
[11/14/2022-14:12:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/14/2022-14:12:47] [V] [TRT] *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(12800,1,1280,128) ***************
[11/14/2022-14:12:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise (CudnnConvolution)
[11/14/2022-14:12:47] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise (CaskConvolution)
[11/14/2022-14:12:47] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:47] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:47] [V] [TRT] *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,51200,400,20,1) ***************
[11/14/2022-14:12:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__421 (Shuffle)
[11/14/2022-14:12:47] [V] [TRT] Tactic: 0 Time: 0.007496
[11/14/2022-14:12:47] [V] [TRT] Fastest Tactic: 0 Time: 0.007496
[11/14/2022-14:12:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:12:47] [V] [TRT] *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,51200,1,2560,128) ***************
[11/14/2022-14:12:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__421 (Shuffle)
[11/14/2022-14:12:47] [V] [TRT] Tactic: 0 Time: 0.050748
[11/14/2022-14:12:47] [V] [TRT] Fastest Tactic: 0 Time: 0.050748
[11/14/2022-14:12:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:12:47] [V] [TRT] *************** Autotuning format combination: Float(1600,400:32,20,1) -> Float(1600,1600,400:32,20,1) ***************
[11/14/2022-14:12:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__421 (Shuffle)
[11/14/2022-14:12:47] [V] [TRT] Tactic: 0 Time: 0.056984
[11/14/2022-14:12:47] [V] [TRT] Fastest Tactic: 0 Time: 0.056984
[11/14/2022-14:12:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:12:47] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:47] [V] [TRT] *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) ***************
[11/14/2022-14:12:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise (CudaDepthwiseConvolution)
[11/14/2022-14:12:47] [V] [TRT] Tactic: -1 Time: 0.037608
[11/14/2022-14:12:47] [V] [TRT] Fastest Tactic: -1 Time: 0.037608
[11/14/2022-14:12:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise (CudnnConvolution)
[11/14/2022-14:12:47] [V] [TRT] Tactic: 0 Time: 0.038732
[11/14/2022-14:12:47] [V] [TRT] Tactic: 1 Time: 0.036768
[11/14/2022-14:12:47] [V] [TRT] Tactic: 2 Time: 0.090528
[11/14/2022-14:12:48] [V] [TRT] Tactic: 4 Time: 11.6664
[11/14/2022-14:12:48] [V] [TRT] Tactic: 5 Time: 21.236
[11/14/2022-14:12:48] [V] [TRT] Tactic: 6 Time: 3.90727
[11/14/2022-14:12:48] [V] [TRT] Fastest Tactic: 1 Time: 0.036768
[11/14/2022-14:12:48] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise (CaskConvolution)
[11/14/2022-14:12:48] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:12:48] [V] [TRT] Tactic: 1062367460111450758 Time: 2.47001
[11/14/2022-14:12:48] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479
[11/14/2022-14:12:48] [V] [TRT] Tactic: 1754984623894446479 Time: 2.46701
[11/14/2022-14:12:48] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984
[11/14/2022-14:12:48] [V] [TRT] Tactic: 3611739942397549984 Time: 2.67886
[11/14/2022-14:12:48] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724
[11/14/2022-14:12:48] [V] [TRT] Tactic: 3827454225649558724 Time: 2.59637
[11/14/2022-14:12:48] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379
[11/14/2022-14:12:48] [V] [TRT] Tactic: 4337000649858996379 Time: 2.40049
[11/14/2022-14:12:48] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:12:49] [V] [TRT] Tactic: 4501471010995462441 Time: 2.7878
[11/14/2022-14:12:49] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:12:49] [V] [TRT] Tactic: 5137655947464784826 Time: 2.1391
[11/14/2022-14:12:49] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:12:49] [V] [TRT] Tactic: 5288347012147084929 Time: 2.42306
[11/14/2022-14:12:49] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896
[11/14/2022-14:12:49] [V] [TRT] Tactic: 5921334924264294896 Time: 2.05281
[11/14/2022-14:12:49] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:12:49] [V] [TRT] Tactic: 6645123197870846056 Time: 2.45682
[11/14/2022-14:12:49] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:12:49] [V] [TRT] Tactic: 7144526460361122478 Time: 2.2395
[11/14/2022-14:12:49] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038
[11/14/2022-14:12:49] [V] [TRT] Tactic: 7852627285308570038 Time: 2.6476
[11/14/2022-14:12:49] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713
[11/14/2022-14:12:49] [V] [TRT] Tactic: -9137461792520977713 Time: 2.60008
[11/14/2022-14:12:49] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509
[11/14/2022-14:12:49] [V] [TRT] Tactic: -8776506421218919509 Time: 2.46874
[11/14/2022-14:12:49] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:12:49] [V] [TRT] Tactic: -8262349710178828730 Time: 2.67892
[11/14/2022-14:12:49] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780
[11/14/2022-14:12:49] [V] [TRT] Tactic: -8133971918129952780 Time: 2.31211
[11/14/2022-14:12:49] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144
[11/14/2022-14:12:49] [V] [TRT] Tactic: -6092040395344634144 Time: 2.54255
[11/14/2022-14:12:49] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:12:49] [V] [TRT] Tactic: -4787320710726427159 Time: 2.30992
[11/14/2022-14:12:49] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:12:49] [V] [TRT] Tactic: -3456450830548107839 Time: 2.10252
[11/14/2022-14:12:49] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239
[11/14/2022-14:12:50] [V] [TRT] Tactic: -2318106587342035239 Time: 2.76238
[11/14/2022-14:12:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657
[11/14/2022-14:12:50] [V] [TRT] Tactic: -1343271414618805657 Time: 2.03759
[11/14/2022-14:12:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:12:50] [V] [TRT] Tactic: -1218658103698133241 Time: 2.48881
[11/14/2022-14:12:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:12:50] [V] [TRT] Tactic: -836875257600482091 Time: 2.23693
[11/14/2022-14:12:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:12:50] [V] [TRT] Tactic: -410470605513481746 Time: 2.46435
[11/14/2022-14:12:50] [V] [TRT] Fastest Tactic: -1343271414618805657 Time: 2.03759
[11/14/2022-14:12:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[11/14/2022-14:12:50] [V] [TRT] *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) ***************
[11/14/2022-14:12:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise (CudnnConvolution)
[11/14/2022-14:12:50] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise (CaskConvolution)
[11/14/2022-14:12:50] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:50] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:50] [V] [TRT] *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,100,10,1) ***************
[11/14/2022-14:12:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) (FusedConvActConvolution)
[11/14/2022-14:12:50] [V] [TRT] Tactic: 589823 Time: 0.03866
[11/14/2022-14:12:50] [V] [TRT] Tactic: 655359 Time: 0.032856
[11/14/2022-14:12:50] [V] [TRT] Tactic: 786431 Time: 0.026944
[11/14/2022-14:12:50] [V] [TRT] Tactic: 851967 Time: 0.029352
[11/14/2022-14:12:50] [V] [TRT] Tactic: 1179647 Time: 0.032104
[11/14/2022-14:12:50] [V] [TRT] Tactic: 1310719 Time: 0.064876
[11/14/2022-14:12:50] [V] [TRT] Tactic: 1376255 Time: 0.040304
[11/14/2022-14:12:50] [V] [TRT] Tactic: 1441791 Time: 0.026344
[11/14/2022-14:12:50] [V] [TRT] Tactic: 1507327 Time: 0.037504
[11/14/2022-14:12:50] [V] [TRT] Tactic: 1638399 Time: 0.038344
[11/14/2022-14:12:50] [V] [TRT] Tactic: 1835007 Time: 0.029536
[11/14/2022-14:12:50] [V] [TRT] Tactic: 1900543 Time: 0.035004
[11/14/2022-14:12:50] [V] [TRT] Tactic: 2097151 Time: 0.04052
[11/14/2022-14:12:50] [V] [TRT] Tactic: 2162687 Time: 0.034824
[11/14/2022-14:12:50] [V] [TRT] Tactic: 2293759 Time: 0.036528
[11/14/2022-14:12:50] [V] [TRT] Tactic: 2359295 Time: 0.027224
[11/14/2022-14:12:50] [V] [TRT] Tactic: 2686975 Time: 0.032908
[11/14/2022-14:12:50] [V] [TRT] Tactic: 3080191 Time: 0.02764
[11/14/2022-14:12:50] [V] [TRT] Tactic: 3342335 Time: 0.025876
[11/14/2022-14:12:50] [V] [TRT] Tactic: 3407871 Time: 0.029972
[11/14/2022-14:12:50] [V] [TRT] Tactic: 3538943 Time: 0.028956
[11/14/2022-14:12:50] [V] [TRT] Tactic: 3670015 Time: 0.0341
[11/14/2022-14:12:50] [V] [TRT] Tactic: 3932159 Time: 0.031248
[11/14/2022-14:12:50] [V] [TRT] Tactic: 3997695 Time: 0.027776
[11/14/2022-14:12:50] [V] [TRT] Tactic: 4063231 Time: 0.029172
[11/14/2022-14:12:50] [V] [TRT] Tactic: 4194303 Time: 0.042788
[11/14/2022-14:12:50] [V] [TRT] Tactic: 4259839 Time: 0.044356
[11/14/2022-14:12:50] [V] [TRT] Tactic: 4325375 Time: 0.02928
[11/14/2022-14:12:50] [V] [TRT] Tactic: 4521983 Time: 0.038
[11/14/2022-14:12:50] [V] [TRT] Tactic: 4587519 Time: 0.045456
[11/14/2022-14:12:50] [V] [TRT] Tactic: 4653055 Time: 0.038636
[11/14/2022-14:12:51] [V] [TRT] Tactic: 4915199 Time: 0.039028
[11/14/2022-14:12:51] [V] [TRT] Tactic: 4980735 Time: 0.029176
[11/14/2022-14:12:51] [V] [TRT] Tactic: 5177343 Time: 0.029236
[11/14/2022-14:12:51] [V] [TRT] Tactic: 5242879 Time: 0.027716
[11/14/2022-14:12:51] [V] [TRT] Tactic: 5373951 Time: 0.031324
[11/14/2022-14:12:51] [V] [TRT] Tactic: 5439487 Time: 0.03834
[11/14/2022-14:12:51] [V] [TRT] Tactic: 5570559 Time: 0.027492
[11/14/2022-14:12:51] [V] [TRT] Tactic: 5636095 Time: 0.029224
[11/14/2022-14:12:51] [V] [TRT] Tactic: 5701631 Time: 0.035544
[11/14/2022-14:12:51] [V] [TRT] Tactic: 5767167 Time: 0.043692
[11/14/2022-14:12:51] [V] [TRT] Tactic: 5832703 Time: 0.029392
[11/14/2022-14:12:51] [V] [TRT] Tactic: 5898239 Time: 0.028172
[11/14/2022-14:12:51] [V] [TRT] Tactic: 6029311 Time: 0.033848
[11/14/2022-14:12:51] [V] [TRT] Tactic: 6225919 Time: 0.02726
[11/14/2022-14:12:51] [V] [TRT] Tactic: 6291455 Time: 0.030944
[11/14/2022-14:12:51] [V] [TRT] Tactic: 6422527 Time: 0.029148
[11/14/2022-14:12:51] [V] [TRT] Tactic: 6750207 Time: 0.0345
[11/14/2022-14:12:51] [V] [TRT] Tactic: 6815743 Time: 0.028684
[11/14/2022-14:12:51] [V] [TRT] Tactic: 6946815 Time: 0.0402
[11/14/2022-14:12:51] [V] [TRT] Tactic: 7012351 Time: 0.04094
[11/14/2022-14:12:51] [V] [TRT] Tactic: 7077887 Time: 0.027788
[11/14/2022-14:12:51] [V] [TRT] Tactic: 7143423 Time: 0.047256
[11/14/2022-14:12:51] [V] [TRT] Tactic: 7208959 Time: 0.030276
[11/14/2022-14:12:51] [V] [TRT] Tactic: 7340031 Time: 0.027928
[11/14/2022-14:12:51] [V] [TRT] Tactic: 7405567 Time: 0.032116
[11/14/2022-14:12:51] [V] [TRT] Tactic: 7536639 Time: 0.030924
[11/14/2022-14:12:51] [V] [TRT] Tactic: 7602175 Time: 0.039748
[11/14/2022-14:12:51] [V] [TRT] Tactic: 7733247 Time: 0.029296
[11/14/2022-14:12:51] [V] [TRT] Tactic: 7798783 Time: 0.026984
[11/14/2022-14:12:51] [V] [TRT] Tactic: 8191999 Time: 0.04326
[11/14/2022-14:12:51] [V] [TRT] Tactic: 8257535 Time: 0.03902
[11/14/2022-14:12:51] [V] [TRT] Tactic: 8323071 Time: 0.038164
[11/14/2022-14:12:51] [V] [TRT] Tactic: 8650751 Time: 0.038512
[11/14/2022-14:12:51] [V] [TRT] Tactic: 8716287 Time: 0.029612
[11/14/2022-14:12:51] [V] [TRT] Tactic: 9109503 Time: 0.04068
[11/14/2022-14:12:51] [V] [TRT] Tactic: 9568255 Time: 0.042376
[11/14/2022-14:12:51] [V] [TRT] Tactic: 9895935 Time: 0.042656
[11/14/2022-14:12:51] [V] [TRT] Tactic: 10223615 Time: 0.037356
[11/14/2022-14:12:51] [V] [TRT] Tactic: 10354687 Time: 0.042168
[11/14/2022-14:12:51] [V] [TRT] Tactic: 10551295 Time: 0.031328
[11/14/2022-14:12:51] [V] [TRT] Tactic: 10747903 Time: 0.029104
[11/14/2022-14:12:51] [V] [TRT] Tactic: 10944511 Time: 0.031544
[11/14/2022-14:12:51] [V] [TRT] Fastest Tactic: 3342335 Time: 0.025876
[11/14/2022-14:12:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) (CudaDepthwiseConvolution)
[11/14/2022-14:12:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) (CudnnConvolution)
[11/14/2022-14:12:51] [V] [TRT] Tactic: 0 Time: 0.102984
[11/14/2022-14:12:51] [V] [TRT] Tactic: 1 Time: 1.2132
[11/14/2022-14:12:51] [V] [TRT] Tactic: 2 Time: 0.09106
[11/14/2022-14:12:51] [V] [TRT] Tactic: 4 skipped. Scratch requested: 38109184, available: 16777216
[11/14/2022-14:12:52] [V] [TRT] Tactic: 5 Time: 0.56558
[11/14/2022-14:12:52] [V] [TRT] Fastest Tactic: 2 Time: 0.09106
[11/14/2022-14:12:52] [V] [TRT] Setting workspace to 38109184enables more tactics for profiling
[11/14/2022-14:12:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) (CublasConvolution)
[11/14/2022-14:12:52] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) (CaskConvolution)
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:12:52] [V] [TRT] Tactic: 1062367460111450758 Time: 0.030932
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:12:52] [V] [TRT] Tactic: 1698681053543049347 Time: 0.019884
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:12:52] [V] [TRT] Tactic: 4501471010995462441 Time: 0.025784
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:12:52] [V] [TRT] Tactic: 5137655947464784826 Time: 0.019192
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:12:52] [V] [TRT] Tactic: 5288347012147084929 Time: 0.027304
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:12:52] [V] [TRT] Tactic: 5326823351883942011 Time: 0.024324
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:12:52] [V] [TRT] Tactic: 5500448035057547314 Time: 0.022884
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:12:52] [V] [TRT] Tactic: 6645123197870846056 Time: 0.043388
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:12:52] [V] [TRT] Tactic: 7144526460361122478 Time: 0.02246
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:12:52] [V] [TRT] Tactic: -8262349710178828730 Time: 0.040876
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:12:52] [V] [TRT] Tactic: -6576203419454146580 Time: 0.020784
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:12:52] [V] [TRT] Tactic: -4787320710726427159 Time: 0.033204
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:12:52] [V] [TRT] Tactic: -3456450830548107839 Time: 0.024108
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:12:52] [V] [TRT] Tactic: -1218658103698133241 Time: 0.02428
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:12:52] [V] [TRT] Tactic: -836875257600482091 Time: 0.061924
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:12:52] [V] [TRT] Tactic: -410470605513481746 Time: 0.026884
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:12:52] [V] [TRT] Tactic: -377491875521947884 Time: 0.024296
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:12:52] [V] [TRT] Tactic: -37215280111360163 Time: 0.02824
[11/14/2022-14:12:52] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.019192
[11/14/2022-14:12:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826
[11/14/2022-14:12:52] [V] [TRT] *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1,1280,128) ***************
[11/14/2022-14:12:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) (CudnnConvolution)
[11/14/2022-14:12:52] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) (CublasConvolution)
[11/14/2022-14:12:52] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) (CaskConvolution)
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:12:52] [V] [TRT] Tactic: 3886731678879822788 Time: 0.015452
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:12:52] [V] [TRT] Tactic: 6629944304117643200 Time: 0.032856
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:12:52] [V] [TRT] Tactic: -9153228964338181824 Time: 0.033784
[11/14/2022-14:12:52] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:12:52] [V] [TRT] Tactic: -7394439838318485025 Time: 0.01866
[11/14/2022-14:12:52] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.015452
[11/14/2022-14:12:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788
[11/14/2022-14:12:52] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:52] [V] [TRT] *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) ***************
[11/14/2022-14:12:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) (FusedConvActConvolution)
[11/14/2022-14:12:52] [V] [TRT] Tactic: 589823 Time: 0.135044
[11/14/2022-14:12:52] [V] [TRT] Tactic: 655359 Time: 0.119152
[11/14/2022-14:12:52] [V] [TRT] Tactic: 786431 Time: 0.103048
[11/14/2022-14:12:52] [V] [TRT] Tactic: 851967 Time: 0.093912
[11/14/2022-14:12:52] [V] [TRT] Tactic: 1179647 Time: 0.096444
[11/14/2022-14:12:52] [V] [TRT] Tactic: 1310719 Time: 0.2445
[11/14/2022-14:12:52] [V] [TRT] Tactic: 1376255 Time: 0.1013
[11/14/2022-14:12:52] [V] [TRT] Tactic: 1441791 Time: 0.1005
[11/14/2022-14:12:52] [V] [TRT] Tactic: 1507327 Time: 0.0787
[11/14/2022-14:12:52] [V] [TRT] Tactic: 1638399 Time: 0.101436
[11/14/2022-14:12:52] [V] [TRT] Tactic: 1835007 Time: 0.098476
[11/14/2022-14:12:52] [V] [TRT] Tactic: 1900543 Time: 0.091448
[11/14/2022-14:12:52] [V] [TRT] Tactic: 2097151 Time: 0.111244
[11/14/2022-14:12:52] [V] [TRT] Tactic: 2162687 Time: 0.089456
[11/14/2022-14:12:53] [V] [TRT] Tactic: 2293759 Time: 0.097996
[11/14/2022-14:12:53] [V] [TRT] Tactic: 2359295 Time: 0.117776
[11/14/2022-14:12:53] [V] [TRT] Tactic: 2686975 Time: 0.108748
[11/14/2022-14:12:53] [V] [TRT] Tactic: 3080191 Time: 0.077488
[11/14/2022-14:12:53] [V] [TRT] Tactic: 3342335 Time: 0.083696
[11/14/2022-14:12:53] [V] [TRT] Tactic: 3407871 Time: 0.101744
[11/14/2022-14:12:53] [V] [TRT] Tactic: 3538943 Time: 0.086484
[11/14/2022-14:12:53] [V] [TRT] Tactic: 3670015 Time: 0.080752
[11/14/2022-14:12:53] [V] [TRT] Tactic: 3932159 Time: 0.087804
[11/14/2022-14:12:53] [V] [TRT] Tactic: 3997695 Time: 0.099808
[11/14/2022-14:12:53] [V] [TRT] Tactic: 4063231 Time: 0.088084
[11/14/2022-14:12:53] [V] [TRT] Tactic: 4194303 Time: 0.098972
[11/14/2022-14:12:53] [V] [TRT] Tactic: 4259839 Time: 0.119864
[11/14/2022-14:12:53] [V] [TRT] Tactic: 4325375 Time: 0.10212
[11/14/2022-14:12:53] [V] [TRT] Tactic: 4521983 Time: 0.09532
[11/14/2022-14:12:53] [V] [TRT] Tactic: 4587519 Time: 0.119156
[11/14/2022-14:12:53] [V] [TRT] Tactic: 4653055 Time: 0.107808
[11/14/2022-14:12:53] [V] [TRT] Tactic: 4915199 Time: 0.09976
[11/14/2022-14:12:53] [V] [TRT] Tactic: 4980735 Time: 0.107816
[11/14/2022-14:12:53] [V] [TRT] Tactic: 5177343 Time: 0.08604
[11/14/2022-14:12:53] [V] [TRT] Tactic: 5242879 Time: 0.083632
[11/14/2022-14:12:53] [V] [TRT] Tactic: 5373951 Time: 0.104696
[11/14/2022-14:12:53] [V] [TRT] Tactic: 5439487 Time: 0.119344
[11/14/2022-14:12:53] [V] [TRT] Tactic: 5570559 Time: 0.076376
[11/14/2022-14:12:53] [V] [TRT] Tactic: 5636095 Time: 0.086288
[11/14/2022-14:12:53] [V] [TRT] Tactic: 5701631 Time: 0.089824
[11/14/2022-14:12:53] [V] [TRT] Tactic: 5767167 Time: 0.155044
[11/14/2022-14:12:53] [V] [TRT] Tactic: 5832703 Time: 0.085108
[11/14/2022-14:12:53] [V] [TRT] Tactic: 5898239 Time: 0.075596
[11/14/2022-14:12:53] [V] [TRT] Tactic: 6029311 Time: 0.08902
[11/14/2022-14:12:53] [V] [TRT] Tactic: 6225919 Time: 0.08222
[11/14/2022-14:12:53] [V] [TRT] Tactic: 6291455 Time: 0.092076
[11/14/2022-14:12:53] [V] [TRT] Tactic: 6422527 Time: 0.07746
[11/14/2022-14:12:53] [V] [TRT] Tactic: 6750207 Time: 0.104856
[11/14/2022-14:12:53] [V] [TRT] Tactic: 6815743 Time: 0.094304
[11/14/2022-14:12:54] [V] [TRT] Tactic: 6946815 Time: 0.125948
[11/14/2022-14:12:54] [V] [TRT] Tactic: 7012351 Time: 0.110936
[11/14/2022-14:12:54] [V] [TRT] Tactic: 7077887 Time: 0.081152
[11/14/2022-14:12:54] [V] [TRT] Tactic: 7143423 Time: 0.129396
[11/14/2022-14:12:54] [V] [TRT] Tactic: 7208959 Time: 0.084076
[11/14/2022-14:12:54] [V] [TRT] Tactic: 7340031 Time: 0.078448
[11/14/2022-14:12:54] [V] [TRT] Tactic: 7405567 Time: 0.085044
[11/14/2022-14:12:54] [V] [TRT] Tactic: 7536639 Time: 0.101408
[11/14/2022-14:12:54] [V] [TRT] Tactic: 7602175 Time: 0.113508
[11/14/2022-14:12:54] [V] [TRT] Tactic: 7733247 Time: 0.077156
[11/14/2022-14:12:54] [V] [TRT] Tactic: 7798783 Time: 0.1073
[11/14/2022-14:12:54] [V] [TRT] Tactic: 8191999 Time: 0.13968
[11/14/2022-14:12:54] [V] [TRT] Tactic: 8257535 Time: 0.0992
[11/14/2022-14:12:54] [V] [TRT] Tactic: 8323071 Time: 0.104128
[11/14/2022-14:12:54] [V] [TRT] Tactic: 8650751 Time: 0.110692
[11/14/2022-14:12:54] [V] [TRT] Tactic: 8716287 Time: 0.09594
[11/14/2022-14:12:54] [V] [TRT] Tactic: 9109503 Time: 0.10976
[11/14/2022-14:12:54] [V] [TRT] Tactic: 9568255 Time: 0.100308
[11/14/2022-14:12:54] [V] [TRT] Tactic: 9895935 Time: 0.099444
[11/14/2022-14:12:54] [V] [TRT] Tactic: 10223615 Time: 0.077184
[11/14/2022-14:12:54] [V] [TRT] Tactic: 10354687 Time: 0.111072
[11/14/2022-14:12:54] [V] [TRT] Tactic: 10551295 Time: 0.098408
[11/14/2022-14:12:54] [V] [TRT] Tactic: 10747903 Time: 0.07612
[11/14/2022-14:12:54] [V] [TRT] Tactic: 10944511 Time: 0.103116
[11/14/2022-14:12:54] [V] [TRT] Fastest Tactic: 5898239 Time: 0.075596
[11/14/2022-14:12:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) (CudaDepthwiseConvolution)
[11/14/2022-14:12:54] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) (CudnnConvolution)
[11/14/2022-14:12:54] [V] [TRT] Tactic: 0 Time: 0.10682
[11/14/2022-14:12:54] [V] [TRT] Tactic: 1 Time: 0.1007
[11/14/2022-14:12:54] [V] [TRT] Tactic: 2 Time: 0.231728
[11/14/2022-14:12:54] [V] [TRT] Tactic: 4 skipped. Scratch requested: 143785984, available: 16777216
[11/14/2022-14:12:54] [V] [TRT] Tactic: 5 Time: 0.53662
[11/14/2022-14:12:54] [V] [TRT] Fastest Tactic: 1 Time: 0.1007
[11/14/2022-14:12:54] [V] [TRT] Setting workspace to 143785984enables more tactics for profiling
[11/14/2022-14:12:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) (CublasConvolution)
[11/14/2022-14:12:54] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) (CaskConvolution)
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:12:54] [V] [TRT] Tactic: 1062367460111450758 Time: 0.084744
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:12:54] [V] [TRT] Tactic: 1698681053543049347 Time: 0.04628
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:12:54] [V] [TRT] Tactic: 4501471010995462441 Time: 0.042076
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:12:54] [V] [TRT] Tactic: 5137655947464784826 Time: 0.044876
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:12:54] [V] [TRT] Tactic: 5288347012147084929 Time: 0.03998
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:12:54] [V] [TRT] Tactic: 5326823351883942011 Time: 0.040684
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:12:54] [V] [TRT] Tactic: 5500448035057547314 Time: 0.049692
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:12:54] [V] [TRT] Tactic: 6645123197870846056 Time: 0.045316
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:12:54] [V] [TRT] Tactic: 7144526460361122478 Time: 0.050956
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:12:54] [V] [TRT] Tactic: -8262349710178828730 Time: 0.042312
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:12:54] [V] [TRT] Tactic: -6576203419454146580 Time: 0.05246
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:12:54] [V] [TRT] Tactic: -4787320710726427159 Time: 0.05404
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:12:54] [V] [TRT] Tactic: -3456450830548107839 Time: 0.054604
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:12:54] [V] [TRT] Tactic: -1218658103698133241 Time: 0.043184
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:12:54] [V] [TRT] Tactic: -836875257600482091 Time: 0.05352
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:12:54] [V] [TRT] Tactic: -410470605513481746 Time: 0.039664
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:12:54] [V] [TRT] Tactic: -377491875521947884 Time: 0.0406
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:12:54] [V] [TRT] Tactic: -37215280111360163 Time: 0.053056
[11/14/2022-14:12:54] [V] [TRT] Fastest Tactic: -410470605513481746 Time: 0.039664
[11/14/2022-14:12:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -410470605513481746
[11/14/2022-14:12:54] [V] [TRT] *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) ***************
[11/14/2022-14:12:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) (CudnnConvolution)
[11/14/2022-14:12:54] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) (CublasConvolution)
[11/14/2022-14:12:54] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) (CaskConvolution)
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:12:54] [V] [TRT] Tactic: 3886731678879822788 Time: 0.04278
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:12:54] [V] [TRT] Tactic: 6629944304117643200 Time: 0.079712
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:12:54] [V] [TRT] Tactic: -9153228964338181824 Time: 0.095072
[11/14/2022-14:12:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:12:54] [V] [TRT] Tactic: -7394439838318485025 Time: 0.042912
[11/14/2022-14:12:54] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.04278
[11/14/2022-14:12:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788
[11/14/2022-14:12:54] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:54] [V] [TRT] *************** Autotuning format combination: Float(102400,51200,400,20,1) -> Float(102400,51200,400,20,20,1) ***************
[11/14/2022-14:12:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__425 (Shuffle)
[11/14/2022-14:12:54] [V] [TRT] Tactic: 0 Time: 0.02754
[11/14/2022-14:12:54] [V] [TRT] Fastest Tactic: 0 Time: 0.02754
[11/14/2022-14:12:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:12:54] [V] [TRT] *************** Autotuning format combination: Float(102400,51200,1,2560,128) -> Float(102400,51200,400,1,400,20) ***************
[11/14/2022-14:12:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__425 (Shuffle)
[11/14/2022-14:12:54] [V] [TRT] Tactic: 0 Time: 0.082112
[11/14/2022-14:12:54] [V] [TRT] Fastest Tactic: 0 Time: 0.082112
[11/14/2022-14:12:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:12:54] [V] [TRT] *************** Autotuning format combination: Float(3200,1600,400:32,20,1) -> Float(5120,2560,20,20:32,20,1) ***************
[11/14/2022-14:12:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__425 (Shuffle)
[11/14/2022-14:12:54] [V] [TRT] Tactic: 0 Time: 0.342896
[11/14/2022-14:12:54] [V] [TRT] Fastest Tactic: 0 Time: 0.342896
[11/14/2022-14:12:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:12:54] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:54] [V] [TRT] *************** Autotuning format combination: Float(12800,100,10,1) -> Float(3200,25,5,1) ***************
[11/14/2022-14:12:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise (CudaDepthwiseConvolution)
[11/14/2022-14:12:54] [V] [TRT] Tactic: -1 Time: 0.020472
[11/14/2022-14:12:54] [V] [TRT] Fastest Tactic: -1 Time: 0.020472
[11/14/2022-14:12:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise (CudnnConvolution)
[11/14/2022-14:12:54] [V] [TRT] Tactic: 0 Time: 0.017552
[11/14/2022-14:12:55] [V] [TRT] Tactic: 1 Time: 0.016028
[11/14/2022-14:12:55] [V] [TRT] Tactic: 2 Time: 0.017124
[11/14/2022-14:12:55] [V] [TRT] Tactic: 5 Time: 21.1585
[11/14/2022-14:12:55] [V] [TRT] Fastest Tactic: 1 Time: 0.016028
[11/14/2022-14:12:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise (CaskConvolution)
[11/14/2022-14:12:55] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:12:55] [V] [TRT] Tactic: 1062367460111450758 Time: 3.18416
[11/14/2022-14:12:55] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479
[11/14/2022-14:12:55] [V] [TRT] Tactic: 1754984623894446479 Time: 2.79535
[11/14/2022-14:12:55] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984
[11/14/2022-14:12:55] [V] [TRT] Tactic: 3611739942397549984 Time: 2.66035
[11/14/2022-14:12:55] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379
[11/14/2022-14:12:55] [V] [TRT] Tactic: 4337000649858996379 Time: 2.68061
[11/14/2022-14:12:55] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:12:55] [V] [TRT] Tactic: 4501471010995462441 Time: 2.46742
[11/14/2022-14:12:55] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:12:55] [V] [TRT] Tactic: 5137655947464784826 Time: 2.14044
[11/14/2022-14:12:55] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:12:55] [V] [TRT] Tactic: 5288347012147084929 Time: 2.20147
[11/14/2022-14:12:55] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:12:56] [V] [TRT] Tactic: 6645123197870846056 Time: 2.20902
[11/14/2022-14:12:56] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:12:56] [V] [TRT] Tactic: 7144526460361122478 Time: 2.47278
[11/14/2022-14:12:56] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713
[11/14/2022-14:12:56] [V] [TRT] Tactic: -9137461792520977713 Time: 2.61806
[11/14/2022-14:12:56] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:12:56] [V] [TRT] Tactic: -8262349710178828730 Time: 2.53257
[11/14/2022-14:12:56] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780
[11/14/2022-14:12:56] [V] [TRT] Tactic: -8133971918129952780 Time: 2.81595
[11/14/2022-14:12:56] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144
[11/14/2022-14:12:56] [V] [TRT] Tactic: -6092040395344634144 Time: 2.46166
[11/14/2022-14:12:56] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:12:56] [V] [TRT] Tactic: -4787320710726427159 Time: 2.32936
[11/14/2022-14:12:56] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:12:56] [V] [TRT] Tactic: -3456450830548107839 Time: 2.32476
[11/14/2022-14:12:56] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:12:56] [V] [TRT] Tactic: -1218658103698133241 Time: 2.46482
[11/14/2022-14:12:56] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:12:56] [V] [TRT] Tactic: -836875257600482091 Time: 2.23676
[11/14/2022-14:12:56] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:12:56] [V] [TRT] Tactic: -410470605513481746 Time: 2.63608
[11/14/2022-14:12:56] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 2.14044
[11/14/2022-14:12:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[11/14/2022-14:12:56] [V] [TRT] *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(3200,1,640,128) ***************
[11/14/2022-14:12:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise (CudnnConvolution)
[11/14/2022-14:12:56] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise (CaskConvolution)
[11/14/2022-14:12:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:56] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:56] [V] [TRT] *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,100,10,1) ***************
[11/14/2022-14:12:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise (CudaDepthwiseConvolution)
[11/14/2022-14:12:56] [V] [TRT] Tactic: -1 Time: 0.022752
[11/14/2022-14:12:56] [V] [TRT] Fastest Tactic: -1 Time: 0.022752
[11/14/2022-14:12:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise (CudnnConvolution)
[11/14/2022-14:12:56] [V] [TRT] Tactic: 0 Time: 0.015476
[11/14/2022-14:12:56] [V] [TRT] Tactic: 1 Time: 0.014856
[11/14/2022-14:12:56] [V] [TRT] Tactic: 2 Time: 0.01476
[11/14/2022-14:12:57] [V] [TRT] Tactic: 4 Time: 12.9318
[11/14/2022-14:12:57] [V] [TRT] Tactic: 5 Time: 22.0377
[11/14/2022-14:12:57] [V] [TRT] Tactic: 6 Time: 4.17384
[11/14/2022-14:12:57] [V] [TRT] Fastest Tactic: 2 Time: 0.01476
[11/14/2022-14:12:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise (CaskConvolution)
[11/14/2022-14:12:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:12:57] [V] [TRT] Tactic: 1062367460111450758 Time: 2.30918
[11/14/2022-14:12:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479
[11/14/2022-14:12:57] [V] [TRT] Tactic: 1754984623894446479 Time: 2.62581
[11/14/2022-14:12:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984
[11/14/2022-14:12:57] [V] [TRT] Tactic: 3611739942397549984 Time: 2.60963
[11/14/2022-14:12:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724
[11/14/2022-14:12:57] [V] [TRT] Tactic: 3827454225649558724 Time: 1.98084
[11/14/2022-14:12:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379
[11/14/2022-14:12:58] [V] [TRT] Tactic: 4337000649858996379 Time: 2.53417
[11/14/2022-14:12:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:12:58] [V] [TRT] Tactic: 4501471010995462441 Time: 2.58188
[11/14/2022-14:12:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:12:58] [V] [TRT] Tactic: 5137655947464784826 Time: 2.40584
[11/14/2022-14:12:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:12:58] [V] [TRT] Tactic: 5288347012147084929 Time: 2.55958
[11/14/2022-14:12:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896
[11/14/2022-14:12:58] [V] [TRT] Tactic: 5921334924264294896 Time: 1.99071
[11/14/2022-14:12:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:12:58] [V] [TRT] Tactic: 6645123197870846056 Time: 2.89598
[11/14/2022-14:12:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:12:58] [V] [TRT] Tactic: 7144526460361122478 Time: 2.97306
[11/14/2022-14:12:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038
[11/14/2022-14:12:58] [V] [TRT] Tactic: 7852627285308570038 Time: 1.8295
[11/14/2022-14:12:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713
[11/14/2022-14:12:58] [V] [TRT] Tactic: -9137461792520977713 Time: 1.8857
[11/14/2022-14:12:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509
[11/14/2022-14:12:58] [V] [TRT] Tactic: -8776506421218919509 Time: 1.92938
[11/14/2022-14:12:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:12:58] [V] [TRT] Tactic: -8262349710178828730 Time: 2.4865
[11/14/2022-14:12:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780
[11/14/2022-14:12:58] [V] [TRT] Tactic: -8133971918129952780 Time: 2.46451
[11/14/2022-14:12:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144
[11/14/2022-14:12:59] [V] [TRT] Tactic: -6092040395344634144 Time: 2.60881
[11/14/2022-14:12:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:12:59] [V] [TRT] Tactic: -4787320710726427159 Time: 2.33571
[11/14/2022-14:12:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:12:59] [V] [TRT] Tactic: -3456450830548107839 Time: 2.29278
[11/14/2022-14:12:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239
[11/14/2022-14:12:59] [V] [TRT] Tactic: -2318106587342035239 Time: 1.95196
[11/14/2022-14:12:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657
[11/14/2022-14:12:59] [V] [TRT] Tactic: -1343271414618805657 Time: 2.10089
[11/14/2022-14:12:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:12:59] [V] [TRT] Tactic: -1218658103698133241 Time: 2.92818
[11/14/2022-14:12:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:12:59] [V] [TRT] Tactic: -836875257600482091 Time: 2.30191
[11/14/2022-14:12:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:12:59] [V] [TRT] Tactic: -410470605513481746 Time: 2.68932
[11/14/2022-14:12:59] [V] [TRT] Fastest Tactic: 7852627285308570038 Time: 1.8295
[11/14/2022-14:12:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 2
[11/14/2022-14:12:59] [V] [TRT] *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1,1280,128) ***************
[11/14/2022-14:12:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise (CudnnConvolution)
[11/14/2022-14:12:59] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise (CaskConvolution)
[11/14/2022-14:12:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/14/2022-14:12:59] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:59] [V] [TRT] *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) ***************
[11/14/2022-14:12:59] [V] [TRT] *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) ***************
[11/14/2022-14:12:59] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:12:59] [V] [TRT] *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) ***************
[11/14/2022-14:12:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) (FusedConvActConvolution)
[11/14/2022-14:12:59] [V] [TRT] Tactic: 589823 Time: 0.021
[11/14/2022-14:12:59] [V] [TRT] Tactic: 655359 Time: 0.018088
[11/14/2022-14:12:59] [V] [TRT] Tactic: 786431 Time: 0.020584
[11/14/2022-14:12:59] [V] [TRT] Tactic: 851967 Time: 0.013568
[11/14/2022-14:12:59] [V] [TRT] Tactic: 1179647 Time: 0.0106
[11/14/2022-14:12:59] [V] [TRT] Tactic: 1310719 Time: 0.046532
[11/14/2022-14:12:59] [V] [TRT] Tactic: 1376255 Time: 0.025192
[11/14/2022-14:12:59] [V] [TRT] Tactic: 1441791 Time: 0.013184
[11/14/2022-14:12:59] [V] [TRT] Tactic: 1507327 Time: 0.0172
[11/14/2022-14:12:59] [V] [TRT] Tactic: 1638399 Time: 0.013488
[11/14/2022-14:12:59] [V] [TRT] Tactic: 1835007 Time: 0.013188
[11/14/2022-14:12:59] [V] [TRT] Tactic: 1900543 Time: 0.028484
[11/14/2022-14:12:59] [V] [TRT] Tactic: 2097151 Time: 0.015888
[11/14/2022-14:12:59] [V] [TRT] Tactic: 2162687 Time: 0.028184
[11/14/2022-14:12:59] [V] [TRT] Tactic: 2293759 Time: 0.027572
[11/14/2022-14:12:59] [V] [TRT] Tactic: 2359295 Time: 0.01874
[11/14/2022-14:12:59] [V] [TRT] Tactic: 2686975 Time: 0.024064
[11/14/2022-14:13:00] [V] [TRT] Tactic: 3080191 Time: 0.012428
[11/14/2022-14:13:00] [V] [TRT] Tactic: 3342335 Time: 0.0189
[11/14/2022-14:13:00] [V] [TRT] Tactic: 3407871 Time: 0.021556
[11/14/2022-14:13:00] [V] [TRT] Tactic: 3538943 Time: 0.01346
[11/14/2022-14:13:00] [V] [TRT] Tactic: 3670015 Time: 0.028932
[11/14/2022-14:13:00] [V] [TRT] Tactic: 3932159 Time: 0.02272
[11/14/2022-14:13:00] [V] [TRT] Tactic: 3997695 Time: 0.012472
[11/14/2022-14:13:00] [V] [TRT] Tactic: 4063231 Time: 0.01208
[11/14/2022-14:13:00] [V] [TRT] Tactic: 4194303 Time: 0.016428
[11/14/2022-14:13:00] [V] [TRT] Tactic: 4259839 Time: 0.015656
[11/14/2022-14:13:00] [V] [TRT] Tactic: 4325375 Time: 0.013704
[11/14/2022-14:13:00] [V] [TRT] Tactic: 4521983 Time: 0.025436
[11/14/2022-14:13:00] [V] [TRT] Tactic: 4587519 Time: 0.01216
[11/14/2022-14:13:00] [V] [TRT] Tactic: 4653055 Time: 0.010696
[11/14/2022-14:13:00] [V] [TRT] Tactic: 4915199 Time: 0.012744
[11/14/2022-14:13:00] [V] [TRT] Tactic: 4980735 Time: 0.020604
[11/14/2022-14:13:00] [V] [TRT] Tactic: 5177343 Time: 0.013324
[11/14/2022-14:13:00] [V] [TRT] Tactic: 5242879 Time: 0.01506
[11/14/2022-14:13:00] [V] [TRT] Tactic: 5373951 Time: 0.010428
[11/14/2022-14:13:00] [V] [TRT] Tactic: 5439487 Time: 0.013392
[11/14/2022-14:13:00] [V] [TRT] Tactic: 5570559 Time: 0.014908
[11/14/2022-14:13:00] [V] [TRT] Tactic: 5636095 Time: 0.012228
[11/14/2022-14:13:00] [V] [TRT] Tactic: 5701631 Time: 0.024532
[11/14/2022-14:13:00] [V] [TRT] Tactic: 5767167 Time: 0.01514
[11/14/2022-14:13:00] [V] [TRT] Tactic: 5832703 Time: 0.0163
[11/14/2022-14:13:00] [V] [TRT] Tactic: 5898239 Time: 0.010588
[11/14/2022-14:13:00] [V] [TRT] Tactic: 6029311 Time: 0.023908
[11/14/2022-14:13:00] [V] [TRT] Tactic: 6225919 Time: 0.011152
[11/14/2022-14:13:00] [V] [TRT] Tactic: 6291455 Time: 0.010504
[11/14/2022-14:13:00] [V] [TRT] Tactic: 6422527 Time: 0.015844
[11/14/2022-14:13:00] [V] [TRT] Tactic: 6750207 Time: 0.012744
[11/14/2022-14:13:00] [V] [TRT] Tactic: 6815743 Time: 0.017248
[11/14/2022-14:13:00] [V] [TRT] Tactic: 6946815 Time: 0.015876
[11/14/2022-14:13:00] [V] [TRT] Tactic: 7012351 Time: 0.016176
[11/14/2022-14:13:00] [V] [TRT] Tactic: 7077887 Time: 0.011956
[11/14/2022-14:13:00] [V] [TRT] Tactic: 7143423 Time: 0.015112
[11/14/2022-14:13:00] [V] [TRT] Tactic: 7208959 Time: 0.020064
[11/14/2022-14:13:00] [V] [TRT] Tactic: 7340031 Time: 0.0121
[11/14/2022-14:13:00] [V] [TRT] Tactic: 7405567 Time: 0.01182
[11/14/2022-14:13:01] [V] [TRT] Tactic: 7536639 Time: 0.014936
[11/14/2022-14:13:01] [V] [TRT] Tactic: 7602175 Time: 0.016816
[11/14/2022-14:13:01] [V] [TRT] Tactic: 7733247 Time: 0.011864
[11/14/2022-14:13:01] [V] [TRT] Tactic: 7798783 Time: 0.0163
[11/14/2022-14:13:01] [V] [TRT] Tactic: 8191999 Time: 0.014832
[11/14/2022-14:13:01] [V] [TRT] Tactic: 8257535 Time: 0.013956
[11/14/2022-14:13:01] [V] [TRT] Tactic: 8323071 Time: 0.01624
[11/14/2022-14:13:01] [V] [TRT] Tactic: 8650751 Time: 0.016528
[11/14/2022-14:13:01] [V] [TRT] Tactic: 8716287 Time: 0.011544
[11/14/2022-14:13:01] [V] [TRT] Tactic: 9109503 Time: 0.014872
[11/14/2022-14:13:01] [V] [TRT] Tactic: 9568255 Time: 0.012724
[11/14/2022-14:13:01] [V] [TRT] Tactic: 9895935 Time: 0.018484
[11/14/2022-14:13:01] [V] [TRT] Tactic: 10223615 Time: 0.024144
[11/14/2022-14:13:01] [V] [TRT] Tactic: 10354687 Time: 0.016424
[11/14/2022-14:13:01] [V] [TRT] Tactic: 10551295 Time: 0.017132
[11/14/2022-14:13:01] [V] [TRT] Tactic: 10747903 Time: 0.012016
[11/14/2022-14:13:01] [V] [TRT] Tactic: 10944511 Time: 0.020656
[11/14/2022-14:13:01] [V] [TRT] Fastest Tactic: 5373951 Time: 0.010428
[11/14/2022-14:13:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) (CudaDepthwiseConvolution)
[11/14/2022-14:13:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) (CudnnConvolution)
[11/14/2022-14:13:01] [V] [TRT] Tactic: 0 Time: 0.031784
[11/14/2022-14:13:01] [V] [TRT] Tactic: 1 Time: 0.03976
[11/14/2022-14:13:01] [V] [TRT] Tactic: 2 Time: 0.08604
[11/14/2022-14:13:01] [V] [TRT] Tactic: 4 skipped. Scratch requested: 38109184, available: 16777216
[11/14/2022-14:13:01] [V] [TRT] Tactic: 5 Time: 0.472224
[11/14/2022-14:13:01] [V] [TRT] Fastest Tactic: 0 Time: 0.031784
[11/14/2022-14:13:01] [V] [TRT] Setting workspace to 38109184enables more tactics for profiling
[11/14/2022-14:13:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) (CublasConvolution)
[11/14/2022-14:13:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) (CaskConvolution)
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:13:01] [V] [TRT] Tactic: 1062367460111450758 Time: 0.024128
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:13:01] [V] [TRT] Tactic: 1698681053543049347 Time: 0.019704
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:13:01] [V] [TRT] Tactic: 4501471010995462441 Time: 0.02464
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:13:01] [V] [TRT] Tactic: 5137655947464784826 Time: 0.019576
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:13:01] [V] [TRT] Tactic: 5288347012147084929 Time: 0.031268
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:13:01] [V] [TRT] Tactic: 5326823351883942011 Time: 0.024296
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:13:01] [V] [TRT] Tactic: 5500448035057547314 Time: 0.027756
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:13:01] [V] [TRT] Tactic: 6645123197870846056 Time: 0.020164
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:13:01] [V] [TRT] Tactic: 7144526460361122478 Time: 0.02126
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:13:01] [V] [TRT] Tactic: -8262349710178828730 Time: 0.024732
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:13:01] [V] [TRT] Tactic: -6576203419454146580 Time: 0.03766
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:13:01] [V] [TRT] Tactic: -4787320710726427159 Time: 0.0233
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:13:01] [V] [TRT] Tactic: -3456450830548107839 Time: 0.021004
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:13:01] [V] [TRT] Tactic: -1218658103698133241 Time: 0.02894
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:13:01] [V] [TRT] Tactic: -836875257600482091 Time: 0.02236
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:13:01] [V] [TRT] Tactic: -410470605513481746 Time: 0.02404
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:13:01] [V] [TRT] Tactic: -377491875521947884 Time: 0.066848
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:13:01] [V] [TRT] Tactic: -37215280111360163 Time: 0.019552
[11/14/2022-14:13:01] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.019552
[11/14/2022-14:13:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5373951
[11/14/2022-14:13:01] [V] [TRT] *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) ***************
[11/14/2022-14:13:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) (CudnnConvolution)
[11/14/2022-14:13:01] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) (CublasConvolution)
[11/14/2022-14:13:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) (CaskConvolution)
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:13:01] [V] [TRT] Tactic: 3886731678879822788 Time: 0.025812
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:13:01] [V] [TRT] Tactic: 6629944304117643200 Time: 0.02112
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:13:01] [V] [TRT] Tactic: -9153228964338181824 Time: 0.021528
[11/14/2022-14:13:01] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:13:01] [V] [TRT] Tactic: -7394439838318485025 Time: 0.02616
[11/14/2022-14:13:01] [V] [TRT] Fastest Tactic: 6629944304117643200 Time: 0.02112
[11/14/2022-14:13:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6629944304117643200
[11/14/2022-14:13:01] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:01] [V] [TRT] *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,100,10,1) ***************
[11/14/2022-14:13:01] [V] [TRT] *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1,1280,128) ***************
[11/14/2022-14:13:01] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:01] [V] [TRT] *************** Autotuning format combination: Float(204800,102400,800,40,20,1) -> Float(204800,1600,40,1) ***************
[11/14/2022-14:13:01] [V] [TRT] --------------- Timing Runner: Transpose__1277 + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape + Transpose__1257 (Shuffle)
[11/14/2022-14:13:01] [V] [TRT] Tactic: 0 Time: 0.1551
[11/14/2022-14:13:01] [V] [TRT] Fastest Tactic: 0 Time: 0.1551
[11/14/2022-14:13:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:01] [V] [TRT] *************** Autotuning format combination: Float(204800,102400,800,1,400,20) -> Float(204800,1,5120,128) ***************
[11/14/2022-14:13:01] [V] [TRT] --------------- Timing Runner: Transpose__1277 + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape + Transpose__1257 (Shuffle)
[11/14/2022-14:13:01] [V] [TRT] Tactic: 0 Time: 0.205996
[11/14/2022-14:13:01] [V] [TRT] Fastest Tactic: 0 Time: 0.205996
[11/14/2022-14:13:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:01] [V] [TRT] *************** Autotuning format combination: Float(10240,5120,40,40:32,20,1) -> Float(6400,1600:32,40,1) ***************
[11/14/2022-14:13:01] [V] [TRT] --------------- Timing Runner: Transpose__1277 + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape + Transpose__1257 (Shuffle)
[11/14/2022-14:13:01] [V] [TRT] Tactic: 0 Time: 0.269484
[11/14/2022-14:13:01] [V] [TRT] Fastest Tactic: 0 Time: 0.269484
[11/14/2022-14:13:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:01] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:01] [V] [TRT] *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) ***************
[11/14/2022-14:13:01] [V] [TRT] *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) ***************
[11/14/2022-14:13:01] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:01] [V] [TRT] *************** Autotuning format combination: Float(153600,1600,40,1), Float(204800,1600,40,1) -> Float(204800,1600,40,1) ***************
[11/14/2022-14:13:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add (FusedConvActConvolution)
[11/14/2022-14:13:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add (CudaDepthwiseConvolution)
[11/14/2022-14:13:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add (CudnnConvolution)
[11/14/2022-14:13:01] [V] [TRT] Tactic: 0 Time: 0.376224
[11/14/2022-14:13:01] [V] [TRT] Tactic: 1 Time: 0.42404
[11/14/2022-14:13:01] [V] [TRT] Tactic: 2 Time: 0.445024
[11/14/2022-14:13:01] [V] [TRT] Tactic: 4 skipped. Scratch requested: 418529280, available: 16777216
[11/14/2022-14:13:02] [V] [TRT] Tactic: 5 Time: 1.24088
[11/14/2022-14:13:02] [V] [TRT] Fastest Tactic: 0 Time: 0.376224
[11/14/2022-14:13:02] [V] [TRT] Setting workspace to 418529280enables more tactics for profiling
[11/14/2022-14:13:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add (CublasConvolution)
[11/14/2022-14:13:02] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add (CaskConvolution)
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:13:02] [V] [TRT] Tactic: 1062367460111450758 Time: 0.169916
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:13:02] [V] [TRT] Tactic: 1698681053543049347 Time: 0.1889
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:13:02] [V] [TRT] Tactic: 4501471010995462441 Time: 0.136048
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:13:02] [V] [TRT] Tactic: 5137655947464784826 Time: 0.144904
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:13:02] [V] [TRT] Tactic: 5288347012147084929 Time: 0.135684
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:13:02] [V] [TRT] Tactic: 5326823351883942011 Time: 0.134332
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:13:02] [V] [TRT] Tactic: 5500448035057547314 Time: 0.171356
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:13:02] [V] [TRT] Tactic: 6645123197870846056 Time: 0.131264
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:13:02] [V] [TRT] Tactic: 7144526460361122478 Time: 0.210332
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:13:02] [V] [TRT] Tactic: -8262349710178828730 Time: 0.133816
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:13:02] [V] [TRT] Tactic: -6576203419454146580 Time: 0.165716
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:13:02] [V] [TRT] Tactic: -4787320710726427159 Time: 0.194256
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:13:02] [V] [TRT] Tactic: -3456450830548107839 Time: 0.161036
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:13:02] [V] [TRT] Tactic: -1218658103698133241 Time: 0.16016
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:13:02] [V] [TRT] Tactic: -836875257600482091 Time: 0.175116
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:13:02] [V] [TRT] Tactic: -410470605513481746 Time: 0.135596
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:13:02] [V] [TRT] Tactic: -377491875521947884 Time: 0.135156
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:13:02] [V] [TRT] Tactic: -37215280111360163 Time: 0.129072
[11/14/2022-14:13:02] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.129072
[11/14/2022-14:13:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163
[11/14/2022-14:13:02] [V] [TRT] *************** Autotuning format combination: Float(153600,1,3840,96), Float(204800,1,5120,128) -> Float(204800,1,5120,128) ***************
[11/14/2022-14:13:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add (CudnnConvolution)
[11/14/2022-14:13:02] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add (CublasConvolution)
[11/14/2022-14:13:02] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add (CaskConvolution)
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:13:02] [V] [TRT] Tactic: 3886731678879822788 Time: 0.158664
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:13:02] [V] [TRT] Tactic: 6629944304117643200 Time: 0.386264
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:13:02] [V] [TRT] Tactic: -9153228964338181824 Time: 0.378708
[11/14/2022-14:13:02] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:13:02] [V] [TRT] Tactic: -7394439838318485025 Time: 0.167888
[11/14/2022-14:13:02] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.158664
[11/14/2022-14:13:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788
[11/14/2022-14:13:02] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:02] [V] [TRT] *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) ***************
[11/14/2022-14:13:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise (CudaDepthwiseConvolution)
[11/14/2022-14:13:02] [V] [TRT] Tactic: -1 Time: 0.017632
[11/14/2022-14:13:02] [V] [TRT] Fastest Tactic: -1 Time: 0.017632
[11/14/2022-14:13:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise (CudnnConvolution)
[11/14/2022-14:13:02] [V] [TRT] Tactic: 0 Time: 0.005964
[11/14/2022-14:13:02] [V] [TRT] Tactic: 1 Time: 0.005812
[11/14/2022-14:13:02] [V] [TRT] Tactic: 2 Time: 0.007456
[11/14/2022-14:13:02] [V] [TRT] Tactic: 4 Time: 14.4276
[11/14/2022-14:13:03] [V] [TRT] Tactic: 5 Time: 20.2496
[11/14/2022-14:13:03] [V] [TRT] Tactic: 6 Time: 3.67377
[11/14/2022-14:13:03] [V] [TRT] Fastest Tactic: 1 Time: 0.005812
[11/14/2022-14:13:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise (CaskConvolution)
[11/14/2022-14:13:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:13:03] [V] [TRT] Tactic: 1062367460111450758 Time: 2.73268
[11/14/2022-14:13:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479
[11/14/2022-14:13:03] [V] [TRT] Tactic: 1754984623894446479 Time: 2.38062
[11/14/2022-14:13:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984
[11/14/2022-14:13:03] [V] [TRT] Tactic: 3611739942397549984 Time: 2.83609
[11/14/2022-14:13:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724
[11/14/2022-14:13:03] [V] [TRT] Tactic: 3827454225649558724 Time: 1.94865
[11/14/2022-14:13:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379
[11/14/2022-14:13:03] [V] [TRT] Tactic: 4337000649858996379 Time: 2.62068
[11/14/2022-14:13:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:13:03] [V] [TRT] Tactic: 4501471010995462441 Time: 2.7517
[11/14/2022-14:13:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:13:03] [V] [TRT] Tactic: 5137655947464784826 Time: 2.66209
[11/14/2022-14:13:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:13:03] [V] [TRT] Tactic: 5288347012147084929 Time: 2.4584
[11/14/2022-14:13:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896
[11/14/2022-14:13:04] [V] [TRT] Tactic: 5921334924264294896 Time: 2.10102
[11/14/2022-14:13:04] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:13:04] [V] [TRT] Tactic: 6645123197870846056 Time: 2.91806
[11/14/2022-14:13:04] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:13:04] [V] [TRT] Tactic: 7144526460361122478 Time: 2.24826
[11/14/2022-14:13:04] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038
[11/14/2022-14:13:04] [V] [TRT] Tactic: 7852627285308570038 Time: 2.30925
[11/14/2022-14:13:04] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713
[11/14/2022-14:13:04] [V] [TRT] Tactic: -9137461792520977713 Time: 2.54529
[11/14/2022-14:13:04] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509
[11/14/2022-14:13:04] [V] [TRT] Tactic: -8776506421218919509 Time: 2.0069
[11/14/2022-14:13:04] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:13:04] [V] [TRT] Tactic: -8262349710178828730 Time: 2.93194
[11/14/2022-14:13:04] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780
[11/14/2022-14:13:04] [V] [TRT] Tactic: -8133971918129952780 Time: 2.78004
[11/14/2022-14:13:04] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144
[11/14/2022-14:13:04] [V] [TRT] Tactic: -6092040395344634144 Time: 2.71248
[11/14/2022-14:13:04] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:13:04] [V] [TRT] Tactic: -4787320710726427159 Time: 2.58376
[11/14/2022-14:13:04] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:13:04] [V] [TRT] Tactic: -3456450830548107839 Time: 2.33974
[11/14/2022-14:13:04] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239
[11/14/2022-14:13:04] [V] [TRT] Tactic: -2318106587342035239 Time: 1.7182
[11/14/2022-14:13:04] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657
[11/14/2022-14:13:05] [V] [TRT] Tactic: -1343271414618805657 Time: 1.73649
[11/14/2022-14:13:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:13:05] [V] [TRT] Tactic: -1218658103698133241 Time: 2.34474
[11/14/2022-14:13:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:13:05] [V] [TRT] Tactic: -836875257600482091 Time: 2.38891
[11/14/2022-14:13:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:13:05] [V] [TRT] Tactic: -410470605513481746 Time: 2.48588
[11/14/2022-14:13:05] [V] [TRT] Fastest Tactic: -2318106587342035239 Time: 1.7182
[11/14/2022-14:13:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[11/14/2022-14:13:05] [V] [TRT] *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) ***************
[11/14/2022-14:13:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise (CudnnConvolution)
[11/14/2022-14:13:05] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise (CaskConvolution)
[11/14/2022-14:13:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:05] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:05] [V] [TRT] *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,100,10,1) ***************
[11/14/2022-14:13:05] [V] [TRT] *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1,1280,128) ***************
[11/14/2022-14:13:05] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:05] [V] [TRT] *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) ***************
[11/14/2022-14:13:05] [V] [TRT] *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) ***************
[11/14/2022-14:13:05] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:05] [V] [TRT] *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) ***************
[11/14/2022-14:13:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise (CudaDepthwiseConvolution)
[11/14/2022-14:13:05] [V] [TRT] Tactic: -1 Time: 0.096476
[11/14/2022-14:13:05] [V] [TRT] Fastest Tactic: -1 Time: 0.096476
[11/14/2022-14:13:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise (CudnnConvolution)
[11/14/2022-14:13:05] [V] [TRT] Tactic: 0 Time: 0.155068
[11/14/2022-14:13:05] [V] [TRT] Tactic: 1 Time: 0.11096
[11/14/2022-14:13:05] [V] [TRT] Tactic: 2 Time: 0.2055
[11/14/2022-14:13:05] [V] [TRT] Tactic: 4 Time: 28.9999
[11/14/2022-14:13:07] [V] [TRT] Tactic: 5 Time: 79.8554
[11/14/2022-14:13:07] [V] [TRT] Tactic: 6 Time: 4.67928
[11/14/2022-14:13:07] [V] [TRT] Fastest Tactic: 1 Time: 0.11096
[11/14/2022-14:13:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise (CaskConvolution)
[11/14/2022-14:13:07] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:13:07] [V] [TRT] Tactic: 1062367460111450758 Time: 2.86868
[11/14/2022-14:13:07] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479
[11/14/2022-14:13:07] [V] [TRT] Tactic: 1754984623894446479 Time: 2.8372
[11/14/2022-14:13:07] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984
[11/14/2022-14:13:07] [V] [TRT] Tactic: 3611739942397549984 Time: 7.53709
[11/14/2022-14:13:07] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724
[11/14/2022-14:13:07] [V] [TRT] Tactic: 3827454225649558724 Time: 5.79149
[11/14/2022-14:13:07] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379
[11/14/2022-14:13:07] [V] [TRT] Tactic: 4337000649858996379 Time: 3.55076
[11/14/2022-14:13:07] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:13:08] [V] [TRT] Tactic: 4501471010995462441 Time: 6.03116
[11/14/2022-14:13:08] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:13:08] [V] [TRT] Tactic: 5137655947464784826 Time: 3.07822
[11/14/2022-14:13:08] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:13:08] [V] [TRT] Tactic: 5288347012147084929 Time: 6.8108
[11/14/2022-14:13:08] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896
[11/14/2022-14:13:08] [V] [TRT] Tactic: 5921334924264294896 Time: 4.41736
[11/14/2022-14:13:08] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:13:08] [V] [TRT] Tactic: 6645123197870846056 Time: 3.13166
[11/14/2022-14:13:08] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:13:08] [V] [TRT] Tactic: 7144526460361122478 Time: 2.81695
[11/14/2022-14:13:08] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038
[11/14/2022-14:13:08] [V] [TRT] Tactic: 7852627285308570038 Time: 6.43385
[11/14/2022-14:13:08] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713
[11/14/2022-14:13:08] [V] [TRT] Tactic: -9137461792520977713 Time: 6.62384
[11/14/2022-14:13:08] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509
[11/14/2022-14:13:09] [V] [TRT] Tactic: -8776506421218919509 Time: 5.90651
[11/14/2022-14:13:09] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:13:09] [V] [TRT] Tactic: -8262349710178828730 Time: 6.25532
[11/14/2022-14:13:09] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780
[11/14/2022-14:13:09] [V] [TRT] Tactic: -8133971918129952780 Time: 3.836
[11/14/2022-14:13:09] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144
[11/14/2022-14:13:09] [V] [TRT] Tactic: -6092040395344634144 Time: 3.98304
[11/14/2022-14:13:09] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:13:09] [V] [TRT] Tactic: -4787320710726427159 Time: 3.28846
[11/14/2022-14:13:09] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:13:09] [V] [TRT] Tactic: -3456450830548107839 Time: 3.05506
[11/14/2022-14:13:09] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239
[11/14/2022-14:13:09] [V] [TRT] Tactic: -2318106587342035239 Time: 5.60644
[11/14/2022-14:13:09] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657
[11/14/2022-14:13:09] [V] [TRT] Tactic: -1343271414618805657 Time: 4.1437
[11/14/2022-14:13:09] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:13:10] [V] [TRT] Tactic: -1218658103698133241 Time: 3.73458
[11/14/2022-14:13:10] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:13:10] [V] [TRT] Tactic: -836875257600482091 Time: 2.94926
[11/14/2022-14:13:10] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:13:10] [V] [TRT] Tactic: -410470605513481746 Time: 6.76904
[11/14/2022-14:13:10] [V] [TRT] Fastest Tactic: 7144526460361122478 Time: 2.81695
[11/14/2022-14:13:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/14/2022-14:13:10] [V] [TRT] *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) ***************
[11/14/2022-14:13:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise (CudnnConvolution)
[11/14/2022-14:13:10] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise (CaskConvolution)
[11/14/2022-14:13:10] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:10] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:10] [V] [TRT] *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) ***************
[11/14/2022-14:13:10] [V] [TRT] *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) ***************
[11/14/2022-14:13:10] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:10] [V] [TRT] *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,100,10,1) ***************
[11/14/2022-14:13:10] [V] [TRT] *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1,1280,128) ***************
[11/14/2022-14:13:10] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:10] [V] [TRT] *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) ***************
[11/14/2022-14:13:10] [V] [TRT] *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) ***************
[11/14/2022-14:13:10] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:10] [V] [TRT] *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) ***************
[11/14/2022-14:13:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) (FusedConvActConvolution)
[11/14/2022-14:13:10] [V] [TRT] Tactic: 589823 Time: 0.544468
[11/14/2022-14:13:10] [V] [TRT] Tactic: 655359 Time: 0.39694
[11/14/2022-14:13:10] [V] [TRT] Tactic: 786431 Time: 0.5259
[11/14/2022-14:13:10] [V] [TRT] Tactic: 851967 Time: 0.493356
[11/14/2022-14:13:10] [V] [TRT] Tactic: 1179647 Time: 0.439984
[11/14/2022-14:13:10] [V] [TRT] Tactic: 1310719 Time: 0.784796
[11/14/2022-14:13:10] [V] [TRT] Tactic: 1376255 Time: 0.467376
[11/14/2022-14:13:10] [V] [TRT] Tactic: 1441791 Time: 0.51162
[11/14/2022-14:13:10] [V] [TRT] Tactic: 1507327 Time: 0.4767
[11/14/2022-14:13:10] [V] [TRT] Tactic: 1638399 Time: 0.561472
[11/14/2022-14:13:10] [V] [TRT] Tactic: 1835007 Time: 0.528336
[11/14/2022-14:13:11] [V] [TRT] Tactic: 1900543 Time: 0.513632
[11/14/2022-14:13:11] [V] [TRT] Tactic: 2097151 Time: 0.592908
[11/14/2022-14:13:11] [V] [TRT] Tactic: 2162687 Time: 0.499608
[11/14/2022-14:13:11] [V] [TRT] Tactic: 2293759 Time: 0.436964
[11/14/2022-14:13:11] [V] [TRT] Tactic: 2359295 Time: 0.446552
[11/14/2022-14:13:11] [V] [TRT] Tactic: 2686975 Time: 0.440624
[11/14/2022-14:13:11] [V] [TRT] Tactic: 3080191 Time: 0.461344
[11/14/2022-14:13:11] [V] [TRT] Tactic: 3342335 Time: 0.498592
[11/14/2022-14:13:11] [V] [TRT] Tactic: 3407871 Time: 0.422268
[11/14/2022-14:13:11] [V] [TRT] Tactic: 3538943 Time: 0.405044
[11/14/2022-14:13:11] [V] [TRT] Tactic: 3670015 Time: 0.397008
[11/14/2022-14:13:11] [V] [TRT] Tactic: 3932159 Time: 0.449852
[11/14/2022-14:13:11] [V] [TRT] Tactic: 3997695 Time: 0.508188
[11/14/2022-14:13:11] [V] [TRT] Tactic: 4063231 Time: 0.481168
[11/14/2022-14:13:11] [V] [TRT] Tactic: 4194303 Time: 0.49112
[11/14/2022-14:13:11] [V] [TRT] Tactic: 4259839 Time: 0.490364
[11/14/2022-14:13:11] [V] [TRT] Tactic: 4325375 Time: 0.487516
[11/14/2022-14:13:11] [V] [TRT] Tactic: 4521983 Time: 0.509076
[11/14/2022-14:13:11] [V] [TRT] Tactic: 4587519 Time: 0.528956
[11/14/2022-14:13:12] [V] [TRT] Tactic: 4653055 Time: 0.50362
[11/14/2022-14:13:12] [V] [TRT] Tactic: 4915199 Time: 0.502696
[11/14/2022-14:13:12] [V] [TRT] Tactic: 4980735 Time: 0.494412
[11/14/2022-14:13:12] [V] [TRT] Tactic: 5177343 Time: 0.496964
[11/14/2022-14:13:12] [V] [TRT] Tactic: 5242879 Time: 0.451376
[11/14/2022-14:13:12] [V] [TRT] Tactic: 5373951 Time: 0.717648
[11/14/2022-14:13:12] [V] [TRT] Tactic: 5439487 Time: 0.835396
[11/14/2022-14:13:12] [V] [TRT] Tactic: 5570559 Time: 0.405756
[11/14/2022-14:13:12] [V] [TRT] Tactic: 5636095 Time: 0.48192
[11/14/2022-14:13:12] [V] [TRT] Tactic: 5701631 Time: 0.521004
[11/14/2022-14:13:12] [V] [TRT] Tactic: 5767167 Time: 1.53962
[11/14/2022-14:13:12] [V] [TRT] Tactic: 5832703 Time: 0.416708
[11/14/2022-14:13:12] [V] [TRT] Tactic: 5898239 Time: 0.432008
[11/14/2022-14:13:12] [V] [TRT] Tactic: 6029311 Time: 0.458868
[11/14/2022-14:13:12] [V] [TRT] Tactic: 6225919 Time: 0.439696
[11/14/2022-14:13:12] [V] [TRT] Tactic: 6291455 Time: 0.445448
[11/14/2022-14:13:12] [V] [TRT] Tactic: 6422527 Time: 0.438216
[11/14/2022-14:13:12] [V] [TRT] Tactic: 6750207 Time: 0.548608
[11/14/2022-14:13:12] [V] [TRT] Tactic: 6815743 Time: 0.62218
[11/14/2022-14:13:13] [V] [TRT] Tactic: 6946815 Time: 0.815416
[11/14/2022-14:13:13] [V] [TRT] Tactic: 7012351 Time: 0.594
[11/14/2022-14:13:13] [V] [TRT] Tactic: 7077887 Time: 0.4008
[11/14/2022-14:13:13] [V] [TRT] Tactic: 7143423 Time: 0.67616
[11/14/2022-14:13:13] [V] [TRT] Tactic: 7208959 Time: 0.483032
[11/14/2022-14:13:13] [V] [TRT] Tactic: 7340031 Time: 0.469072
[11/14/2022-14:13:13] [V] [TRT] Tactic: 7405567 Time: 0.495268
[11/14/2022-14:13:13] [V] [TRT] Tactic: 7536639 Time: 0.544288
[11/14/2022-14:13:13] [V] [TRT] Tactic: 7602175 Time: 0.508544
[11/14/2022-14:13:13] [V] [TRT] Tactic: 7733247 Time: 0.47546
[11/14/2022-14:13:13] [V] [TRT] Tactic: 7798783 Time: 0.516328
[11/14/2022-14:13:13] [V] [TRT] Tactic: 8191999 Time: 0.59428
[11/14/2022-14:13:13] [V] [TRT] Tactic: 8257535 Time: 0.524236
[11/14/2022-14:13:13] [V] [TRT] Tactic: 8323071 Time: 0.544044
[11/14/2022-14:13:13] [V] [TRT] Tactic: 8650751 Time: 0.574648
[11/14/2022-14:13:13] [V] [TRT] Tactic: 8716287 Time: 0.631964
[11/14/2022-14:13:13] [V] [TRT] Tactic: 9109503 Time: 0.574888
[11/14/2022-14:13:13] [V] [TRT] Tactic: 9568255 Time: 0.496004
[11/14/2022-14:13:14] [V] [TRT] Tactic: 9895935 Time: 0.49354
[11/14/2022-14:13:14] [V] [TRT] Tactic: 10223615 Time: 0.430416
[11/14/2022-14:13:14] [V] [TRT] Tactic: 10354687 Time: 0.461224
[11/14/2022-14:13:14] [V] [TRT] Tactic: 10551295 Time: 0.501052
[11/14/2022-14:13:14] [V] [TRT] Tactic: 10747903 Time: 0.440272
[11/14/2022-14:13:14] [V] [TRT] Tactic: 10944511 Time: 0.4919
[11/14/2022-14:13:14] [V] [TRT] Fastest Tactic: 655359 Time: 0.39694
[11/14/2022-14:13:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) (CudaDepthwiseConvolution)
[11/14/2022-14:13:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) (CudnnConvolution)
[11/14/2022-14:13:14] [V] [TRT] Tactic: 0 Time: 0.573684
[11/14/2022-14:13:14] [V] [TRT] Tactic: 1 Time: 0.392292
[11/14/2022-14:13:14] [V] [TRT] Tactic: 2 Time: 0.489828
[11/14/2022-14:13:14] [V] [TRT] Tactic: 4 skipped. Scratch requested: 558039040, available: 16777216
[11/14/2022-14:13:14] [V] [TRT] Tactic: 5 Time: 1.29192
[11/14/2022-14:13:14] [V] [TRT] Fastest Tactic: 1 Time: 0.392292
[11/14/2022-14:13:14] [V] [TRT] Setting workspace to 558039040enables more tactics for profiling
[11/14/2022-14:13:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) (CublasConvolution)
[11/14/2022-14:13:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) (CaskConvolution)
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:13:14] [V] [TRT] Tactic: 1062367460111450758 Time: 0.192
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:13:14] [V] [TRT] Tactic: 1698681053543049347 Time: 0.205084
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:13:14] [V] [TRT] Tactic: 4501471010995462441 Time: 0.145124
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:13:14] [V] [TRT] Tactic: 5137655947464784826 Time: 0.144052
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:13:14] [V] [TRT] Tactic: 5288347012147084929 Time: 0.159728
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:13:14] [V] [TRT] Tactic: 5326823351883942011 Time: 0.140084
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:13:14] [V] [TRT] Tactic: 5500448035057547314 Time: 0.190764
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:13:14] [V] [TRT] Tactic: 6645123197870846056 Time: 0.143316
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:13:14] [V] [TRT] Tactic: 7144526460361122478 Time: 0.222136
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:13:14] [V] [TRT] Tactic: -8262349710178828730 Time: 0.149496
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:13:14] [V] [TRT] Tactic: -6576203419454146580 Time: 0.173712
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:13:14] [V] [TRT] Tactic: -4787320710726427159 Time: 0.229464
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:13:14] [V] [TRT] Tactic: -3456450830548107839 Time: 0.189576
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:13:14] [V] [TRT] Tactic: -1218658103698133241 Time: 0.18878
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:13:14] [V] [TRT] Tactic: -836875257600482091 Time: 0.191496
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:13:14] [V] [TRT] Tactic: -410470605513481746 Time: 0.142404
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:13:14] [V] [TRT] Tactic: -377491875521947884 Time: 0.157892
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:13:14] [V] [TRT] Tactic: -37215280111360163 Time: 0.142852
[11/14/2022-14:13:14] [V] [TRT] Fastest Tactic: 5326823351883942011 Time: 0.140084
[11/14/2022-14:13:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5326823351883942011
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) ***************
[11/14/2022-14:13:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) (CudnnConvolution)
[11/14/2022-14:13:14] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) (CublasConvolution)
[11/14/2022-14:13:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) (CaskConvolution)
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:13:14] [V] [TRT] Tactic: 3886731678879822788 Time: 0.146064
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:13:14] [V] [TRT] Tactic: 6629944304117643200 Time: 0.31214
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:13:14] [V] [TRT] Tactic: -9153228964338181824 Time: 0.31584
[11/14/2022-14:13:14] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:13:14] [V] [TRT] Tactic: -7394439838318485025 Time: 0.189708
[11/14/2022-14:13:14] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.146064
[11/14/2022-14:13:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788
[11/14/2022-14:13:14] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) ***************
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) ***************
[11/14/2022-14:13:14] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,100,10,1) ***************
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1,1280,128) ***************
[11/14/2022-14:13:14] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) ***************
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) ***************
[11/14/2022-14:13:14] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,204800,1600,40,1) ***************
[11/14/2022-14:13:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__442 (Shuffle)
[11/14/2022-14:13:14] [V] [TRT] Tactic: 0 Time: 0.052108
[11/14/2022-14:13:14] [V] [TRT] Fastest Tactic: 0 Time: 0.052108
[11/14/2022-14:13:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,204800,1,5120,128) ***************
[11/14/2022-14:13:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__442 (Shuffle)
[11/14/2022-14:13:14] [V] [TRT] Tactic: 0 Time: 0.241692
[11/14/2022-14:13:14] [V] [TRT] Fastest Tactic: 0 Time: 0.241692
[11/14/2022-14:13:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(6400,1600:32,40,1) -> Float(6400,6400,1600:32,40,1) ***************
[11/14/2022-14:13:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__442 (Shuffle)
[11/14/2022-14:13:14] [V] [TRT] Tactic: 0 Time: 0.309548
[11/14/2022-14:13:14] [V] [TRT] Fastest Tactic: 0 Time: 0.309548
[11/14/2022-14:13:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:14] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) ***************
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) ***************
[11/14/2022-14:13:14] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) ***************
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) ***************
[11/14/2022-14:13:14] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,100,10,1) ***************
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1,1280,128) ***************
[11/14/2022-14:13:14] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) ***************
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) ***************
[11/14/2022-14:13:14] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) ***************
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) ***************
[11/14/2022-14:13:14] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(409600,204800,1600,40,1) -> Float(409600,204800,1600,40,40,1) ***************
[11/14/2022-14:13:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__444 (Shuffle)
[11/14/2022-14:13:14] [V] [TRT] Tactic: 0 Time: 0.091936
[11/14/2022-14:13:14] [V] [TRT] Fastest Tactic: 0 Time: 0.091936
[11/14/2022-14:13:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(409600,204800,1,5120,128) -> Float(409600,204800,1600,1,1600,40) ***************
[11/14/2022-14:13:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__444 (Shuffle)
[11/14/2022-14:13:14] [V] [TRT] Tactic: 0 Time: 0.37042
[11/14/2022-14:13:14] [V] [TRT] Fastest Tactic: 0 Time: 0.37042
[11/14/2022-14:13:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(12800,6400,1600:32,40,1) -> Float(20480,10240,80,40:32,40,1) ***************
[11/14/2022-14:13:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__444 (Shuffle)
[11/14/2022-14:13:14] [V] [TRT] Tactic: 0 Time: 0.81674
[11/14/2022-14:13:14] [V] [TRT] Fastest Tactic: 0 Time: 0.81674
[11/14/2022-14:13:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:14] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) ***************
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) ***************
[11/14/2022-14:13:14] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,100,10,1) ***************
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1,1280,128) ***************
[11/14/2022-14:13:14] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) ***************
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) ***************
[11/14/2022-14:13:14] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) ***************
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) ***************
[11/14/2022-14:13:14] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) ***************
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) ***************
[11/14/2022-14:13:14] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) ***************
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) ***************
[11/14/2022-14:13:14] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,100,10,1) ***************
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1,1280,128) ***************
[11/14/2022-14:13:14] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:14] [V] [TRT] *************** Autotuning format combination: Float(51200,400,20,1) -> Float(9600,400,20,1) ***************
[11/14/2022-14:13:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (FusedConvActConvolution)
[11/14/2022-14:13:14] [V] [TRT] Tactic: 589823 Time: 0.027888
[11/14/2022-14:13:14] [V] [TRT] Tactic: 655359 Time: 0.05268
[11/14/2022-14:13:14] [V] [TRT] Tactic: 786431 Time: 0.025404
[11/14/2022-14:13:14] [V] [TRT] Tactic: 851967 Time: 0.05236
[11/14/2022-14:13:14] [V] [TRT] Tactic: 1179647 Time: 0.037536
[11/14/2022-14:13:14] [V] [TRT] Tactic: 1310719 Time: 0.050284
[11/14/2022-14:13:14] [V] [TRT] Tactic: 1376255 Time: 0.03746
[11/14/2022-14:13:14] [V] [TRT] Tactic: 1441791 Time: 0.035272
[11/14/2022-14:13:15] [V] [TRT] Tactic: 1507327 Time: 0.050624
[11/14/2022-14:13:15] [V] [TRT] Tactic: 1638399 Time: 0.025292
[11/14/2022-14:13:15] [V] [TRT] Tactic: 1835007 Time: 0.024444
[11/14/2022-14:13:15] [V] [TRT] Tactic: 1900543 Time: 0.059008
[11/14/2022-14:13:15] [V] [TRT] Tactic: 2097151 Time: 0.02872
[11/14/2022-14:13:15] [V] [TRT] Tactic: 2162687 Time: 0.035004
[11/14/2022-14:13:15] [V] [TRT] Tactic: 2293759 Time: 0.038296
[11/14/2022-14:13:15] [V] [TRT] Tactic: 2359295 Time: 0.03384
[11/14/2022-14:13:15] [V] [TRT] Tactic: 2686975 Time: 0.03506
[11/14/2022-14:13:15] [V] [TRT] Tactic: 3080191 Time: 0.047564
[11/14/2022-14:13:15] [V] [TRT] Tactic: 3342335 Time: 0.053328
[11/14/2022-14:13:15] [V] [TRT] Tactic: 3407871 Time: 0.038928
[11/14/2022-14:13:15] [V] [TRT] Tactic: 3538943 Time: 0.034436
[11/14/2022-14:13:15] [V] [TRT] Tactic: 3670015 Time: 0.046004
[11/14/2022-14:13:15] [V] [TRT] Tactic: 3932159 Time: 0.056992
[11/14/2022-14:13:15] [V] [TRT] Tactic: 3997695 Time: 0.025564
[11/14/2022-14:13:15] [V] [TRT] Tactic: 4063231 Time: 0.058764
[11/14/2022-14:13:15] [V] [TRT] Tactic: 4194303 Time: 0.027396
[11/14/2022-14:13:15] [V] [TRT] Tactic: 4259839 Time: 0.036512
[11/14/2022-14:13:15] [V] [TRT] Tactic: 4325375 Time: 0.02462
[11/14/2022-14:13:15] [V] [TRT] Tactic: 4521983 Time: 0.03106
[11/14/2022-14:13:15] [V] [TRT] Tactic: 4587519 Time: 0.033616
[11/14/2022-14:13:15] [V] [TRT] Tactic: 4653055 Time: 0.046592
[11/14/2022-14:13:15] [V] [TRT] Tactic: 4915199 Time: 0.026296
[11/14/2022-14:13:15] [V] [TRT] Tactic: 4980735 Time: 0.025968
[11/14/2022-14:13:15] [V] [TRT] Tactic: 5177343 Time: 0.033396
[11/14/2022-14:13:15] [V] [TRT] Tactic: 5242879 Time: 0.03324
[11/14/2022-14:13:15] [V] [TRT] Tactic: 5373951 Time: 0.03992
[11/14/2022-14:13:15] [V] [TRT] Tactic: 5439487 Time: 0.029072
[11/14/2022-14:13:15] [V] [TRT] Tactic: 5570559 Time: 0.044568
[11/14/2022-14:13:15] [V] [TRT] Tactic: 5636095 Time: 0.058392
[11/14/2022-14:13:15] [V] [TRT] Tactic: 5701631 Time: 0.03692
[11/14/2022-14:13:15] [V] [TRT] Tactic: 5767167 Time: 0.03986
[11/14/2022-14:13:15] [V] [TRT] Tactic: 5832703 Time: 0.037792
[11/14/2022-14:13:15] [V] [TRT] Tactic: 5898239 Time: 0.030464
[11/14/2022-14:13:15] [V] [TRT] Tactic: 6029311 Time: 0.036848
[11/14/2022-14:13:16] [V] [TRT] Tactic: 6225919 Time: 0.032004
[11/14/2022-14:13:16] [V] [TRT] Tactic: 6291455 Time: 0.038732
[11/14/2022-14:13:16] [V] [TRT] Tactic: 6422527 Time: 0.046936
[11/14/2022-14:13:16] [V] [TRT] Tactic: 6750207 Time: 0.02678
[11/14/2022-14:13:16] [V] [TRT] Tactic: 6815743 Time: 0.03564
[11/14/2022-14:13:16] [V] [TRT] Tactic: 6946815 Time: 0.037628
[11/14/2022-14:13:16] [V] [TRT] Tactic: 7012351 Time: 0.028852
[11/14/2022-14:13:16] [V] [TRT] Tactic: 7077887 Time: 0.032684
[11/14/2022-14:13:16] [V] [TRT] Tactic: 7143423 Time: 0.0332
[11/14/2022-14:13:16] [V] [TRT] Tactic: 7208959 Time: 0.033176
[11/14/2022-14:13:16] [V] [TRT] Tactic: 7340031 Time: 0.030232
[11/14/2022-14:13:16] [V] [TRT] Tactic: 7405567 Time: 0.03582
[11/14/2022-14:13:16] [V] [TRT] Tactic: 7536639 Time: 0.036272
[11/14/2022-14:13:16] [V] [TRT] Tactic: 7602175 Time: 0.034744
[11/14/2022-14:13:16] [V] [TRT] Tactic: 7733247 Time: 0.030864
[11/14/2022-14:13:16] [V] [TRT] Tactic: 7798783 Time: 0.02438
[11/14/2022-14:13:16] [V] [TRT] Tactic: 8191999 Time: 0.0372
[11/14/2022-14:13:16] [V] [TRT] Tactic: 8257535 Time: 0.02606
[11/14/2022-14:13:16] [V] [TRT] Tactic: 8323071 Time: 0.025852
[11/14/2022-14:13:16] [V] [TRT] Tactic: 8650751 Time: 0.03518
[11/14/2022-14:13:16] [V] [TRT] Tactic: 8716287 Time: 0.0359
[11/14/2022-14:13:16] [V] [TRT] Tactic: 9109503 Time: 0.028696
[11/14/2022-14:13:16] [V] [TRT] Tactic: 9568255 Time: 0.026192
[11/14/2022-14:13:16] [V] [TRT] Tactic: 9895935 Time: 0.025892
[11/14/2022-14:13:16] [V] [TRT] Tactic: 10223615 Time: 0.035332
[11/14/2022-14:13:16] [V] [TRT] Tactic: 10354687 Time: 0.031556
[11/14/2022-14:13:16] [V] [TRT] Tactic: 10551295 Time: 0.026508
[11/14/2022-14:13:16] [V] [TRT] Tactic: 10747903 Time: 0.033644
[11/14/2022-14:13:16] [V] [TRT] Tactic: 10944511 Time: 0.02604
[11/14/2022-14:13:16] [V] [TRT] Fastest Tactic: 7798783 Time: 0.02438
[11/14/2022-14:13:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CudaDepthwiseConvolution)
[11/14/2022-14:13:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CudnnConvolution)
[11/14/2022-14:13:16] [V] [TRT] Tactic: 0 Time: 0.050984
[11/14/2022-14:13:16] [V] [TRT] Tactic: 1 Time: 0.032476
[11/14/2022-14:13:16] [V] [TRT] Tactic: 2 Time: 0.137096
[11/14/2022-14:13:16] [V] [TRT] Tactic: 4 skipped. Scratch requested: 27865088, available: 16777216
[11/14/2022-14:13:16] [V] [TRT] Tactic: 5 Time: 0.208916
[11/14/2022-14:13:16] [V] [TRT] Fastest Tactic: 1 Time: 0.032476
[11/14/2022-14:13:16] [V] [TRT] Setting workspace to 27865088enables more tactics for profiling
[11/14/2022-14:13:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CublasConvolution)
[11/14/2022-14:13:16] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CaskConvolution)
[11/14/2022-14:13:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:13:16] [V] [TRT] Tactic: 1062367460111450758 Time: 0.0254
[11/14/2022-14:13:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:13:16] [V] [TRT] Tactic: 1698681053543049347 Time: 0.02046
[11/14/2022-14:13:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:13:16] [V] [TRT] Tactic: 4501471010995462441 Time: 0.040376
[11/14/2022-14:13:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:13:16] [V] [TRT] Tactic: 5137655947464784826 Time: 0.027036
[11/14/2022-14:13:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:13:16] [V] [TRT] Tactic: 5288347012147084929 Time: 0.041784
[11/14/2022-14:13:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:13:16] [V] [TRT] Tactic: 5326823351883942011 Time: 0.051268
[11/14/2022-14:13:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:13:16] [V] [TRT] Tactic: 5500448035057547314 Time: 0.027616
[11/14/2022-14:13:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:13:16] [V] [TRT] Tactic: 6645123197870846056 Time: 0.044084
[11/14/2022-14:13:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:13:16] [V] [TRT] Tactic: 7144526460361122478 Time: 0.021076
[11/14/2022-14:13:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:13:16] [V] [TRT] Tactic: -8262349710178828730 Time: 0.041128
[11/14/2022-14:13:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:13:16] [V] [TRT] Tactic: -6576203419454146580 Time: 0.043888
[11/14/2022-14:13:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:13:16] [V] [TRT] Tactic: -4787320710726427159 Time: 0.020796
[11/14/2022-14:13:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:13:16] [V] [TRT] Tactic: -3456450830548107839 Time: 0.04742
[11/14/2022-14:13:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:13:16] [V] [TRT] Tactic: -1218658103698133241 Time: 0.028908
[11/14/2022-14:13:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:13:16] [V] [TRT] Tactic: -836875257600482091 Time: 0.033836
[11/14/2022-14:13:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:13:16] [V] [TRT] Tactic: -410470605513481746 Time: 0.039684
[11/14/2022-14:13:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:13:17] [V] [TRT] Tactic: -377491875521947884 Time: 0.041584
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:13:17] [V] [TRT] Tactic: -37215280111360163 Time: 0.041736
[11/14/2022-14:13:17] [V] [TRT] Fastest Tactic: 1698681053543049347 Time: 0.02046
[11/14/2022-14:13:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1698681053543049347
[11/14/2022-14:13:17] [V] [TRT] *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(9600,1,480,24) ***************
[11/14/2022-14:13:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CudnnConvolution)
[11/14/2022-14:13:17] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CublasConvolution)
[11/14/2022-14:13:17] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CaskConvolution)
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:13:17] [V] [TRT] Tactic: 3886731678879822788 Time: 0.022724
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:13:17] [V] [TRT] Tactic: 6629944304117643200 Time: 0.04264
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:13:17] [V] [TRT] Tactic: -9153228964338181824 Time: 0.0216
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:13:17] [V] [TRT] Tactic: -7394439838318485025 Time: 0.024576
[11/14/2022-14:13:17] [V] [TRT] Fastest Tactic: -9153228964338181824 Time: 0.0216
[11/14/2022-14:13:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824
[11/14/2022-14:13:17] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:17] [V] [TRT] *************** Autotuning format combination: Float(51200,400,20,1) -> Float(9600,400,20,1) ***************
[11/14/2022-14:13:17] [V] [TRT] *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(9600,1,480,24) ***************
[11/14/2022-14:13:17] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:17] [V] [TRT] *************** Autotuning format combination: Float(819200,409600,3200,80,40,1) -> Float(819200,6400,80,1) ***************
[11/14/2022-14:13:17] [V] [TRT] --------------- Timing Runner: Transpose__1279 + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape + Transpose__1264 (Shuffle)
[11/14/2022-14:13:17] [V] [TRT] Tactic: 0 Time: 0.653712
[11/14/2022-14:13:17] [V] [TRT] Fastest Tactic: 0 Time: 0.653712
[11/14/2022-14:13:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:17] [V] [TRT] *************** Autotuning format combination: Float(819200,409600,3200,1,1600,40) -> Float(819200,1,10240,128) ***************
[11/14/2022-14:13:17] [V] [TRT] --------------- Timing Runner: Transpose__1279 + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape + Transpose__1264 (Shuffle)
[11/14/2022-14:13:17] [V] [TRT] Tactic: 0 Time: 0.719208
[11/14/2022-14:13:17] [V] [TRT] Fastest Tactic: 0 Time: 0.719208
[11/14/2022-14:13:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:17] [V] [TRT] *************** Autotuning format combination: Float(40960,20480,160,80:32,40,1) -> Float(25600,6400:32,80,1) ***************
[11/14/2022-14:13:17] [V] [TRT] --------------- Timing Runner: Transpose__1279 + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape + Transpose__1264 (Shuffle)
[11/14/2022-14:13:17] [V] [TRT] Tactic: 0 Time: 3.64542
[11/14/2022-14:13:17] [V] [TRT] Fastest Tactic: 0 Time: 3.64542
[11/14/2022-14:13:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:17] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:17] [V] [TRT] *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) ***************
[11/14/2022-14:13:17] [V] [TRT] *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) ***************
[11/14/2022-14:13:17] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:17] [V] [TRT] *************** Autotuning format combination: Float(9600,400,20,1) -> Float(9600,4,1) ***************
[11/14/2022-14:13:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__647 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5 (Shuffle)
[11/14/2022-14:13:17] [V] [TRT] Tactic: 0 Time: 0.009396
[11/14/2022-14:13:17] [V] [TRT] Fastest Tactic: 0 Time: 0.009396
[11/14/2022-14:13:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:17] [V] [TRT] *************** Autotuning format combination: Float(9600,1,480,24) -> Float(1,4,1) ***************
[11/14/2022-14:13:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__647 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5 (Shuffle)
[11/14/2022-14:13:17] [V] [TRT] Tactic: 0 Time: 0.007764
[11/14/2022-14:13:17] [V] [TRT] Fastest Tactic: 0 Time: 0.007764
[11/14/2022-14:13:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:17] [V] [TRT] *************** Autotuning format combination: Float(400,400:32,20,1) -> Float(9600:32,4,1) ***************
[11/14/2022-14:13:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__647 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5 (Shuffle)
[11/14/2022-14:13:17] [V] [TRT] Tactic: 0 Time: 0.400356
[11/14/2022-14:13:17] [V] [TRT] Fastest Tactic: 0 Time: 0.400356
[11/14/2022-14:13:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:17] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:17] [V] [TRT] *************** Autotuning format combination: Float(9600,400,20,1) -> Float(9600,4,1) ***************
[11/14/2022-14:13:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__656 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 (Shuffle)
[11/14/2022-14:13:17] [V] [TRT] Tactic: 0 Time: 0.01044
[11/14/2022-14:13:17] [V] [TRT] Fastest Tactic: 0 Time: 0.01044
[11/14/2022-14:13:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:17] [V] [TRT] *************** Autotuning format combination: Float(9600,1,480,24) -> Float(1,4,1) ***************
[11/14/2022-14:13:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__656 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 (Shuffle)
[11/14/2022-14:13:17] [V] [TRT] Tactic: 0 Time: 0.007412
[11/14/2022-14:13:17] [V] [TRT] Fastest Tactic: 0 Time: 0.007412
[11/14/2022-14:13:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:17] [V] [TRT] *************** Autotuning format combination: Float(400,400:32,20,1) -> Float(9600:32,4,1) ***************
[11/14/2022-14:13:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__656 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 (Shuffle)
[11/14/2022-14:13:17] [V] [TRT] Tactic: 0 Time: 0.404632
[11/14/2022-14:13:17] [V] [TRT] Fastest Tactic: 0 Time: 0.404632
[11/14/2022-14:13:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:17] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:17] [V] [TRT] *************** Autotuning format combination: Float(204800,6400,80,1), Float(819200,6400,80,1) -> Float(819200,6400,80,1) ***************
[11/14/2022-14:13:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (FusedConvActConvolution)
[11/14/2022-14:13:17] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (CudaDepthwiseConvolution)
[11/14/2022-14:13:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (CudnnConvolution)
[11/14/2022-14:13:17] [V] [TRT] Tactic: 0 Time: 1.4417
[11/14/2022-14:13:17] [V] [TRT] Tactic: 1 Time: 0.930592
[11/14/2022-14:13:17] [V] [TRT] Tactic: 2 Time: 1.5107
[11/14/2022-14:13:17] [V] [TRT] Tactic: 4 skipped. Scratch requested: 549535744, available: 16777216
[11/14/2022-14:13:17] [V] [TRT] Tactic: 5 Time: 1.79772
[11/14/2022-14:13:17] [V] [TRT] Fastest Tactic: 1 Time: 0.930592
[11/14/2022-14:13:17] [V] [TRT] Setting workspace to 549535744enables more tactics for profiling
[11/14/2022-14:13:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (CublasConvolution)
[11/14/2022-14:13:17] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (CaskConvolution)
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:13:17] [V] [TRT] Tactic: 1062367460111450758 Time: 0.46998
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:13:17] [V] [TRT] Tactic: 1698681053543049347 Time: 0.342628
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:13:17] [V] [TRT] Tactic: 4501471010995462441 Time: 0.318856
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:13:17] [V] [TRT] Tactic: 5137655947464784826 Time: 0.288092
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:13:17] [V] [TRT] Tactic: 5288347012147084929 Time: 0.369144
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:13:17] [V] [TRT] Tactic: 5326823351883942011 Time: 0.317024
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:13:17] [V] [TRT] Tactic: 5500448035057547314 Time: 0.319572
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:13:17] [V] [TRT] Tactic: 6645123197870846056 Time: 0.321484
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:13:17] [V] [TRT] Tactic: 7144526460361122478 Time: 0.370392
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:13:17] [V] [TRT] Tactic: -8262349710178828730 Time: 0.305924
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:13:17] [V] [TRT] Tactic: -6576203419454146580 Time: 0.37056
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:13:17] [V] [TRT] Tactic: -4787320710726427159 Time: 0.377572
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:13:17] [V] [TRT] Tactic: -3456450830548107839 Time: 0.426712
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:13:17] [V] [TRT] Tactic: -1218658103698133241 Time: 0.32526
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:13:17] [V] [TRT] Tactic: -836875257600482091 Time: 0.367232
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:13:17] [V] [TRT] Tactic: -410470605513481746 Time: 0.30786
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:13:17] [V] [TRT] Tactic: -377491875521947884 Time: 0.32732
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:13:17] [V] [TRT] Tactic: -37215280111360163 Time: 0.295836
[11/14/2022-14:13:17] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.288092
[11/14/2022-14:13:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826
[11/14/2022-14:13:17] [V] [TRT] *************** Autotuning format combination: Float(204800,1,2560,32), Float(819200,1,10240,128) -> Float(819200,1,10240,128) ***************
[11/14/2022-14:13:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (CudnnConvolution)
[11/14/2022-14:13:17] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (CublasConvolution)
[11/14/2022-14:13:17] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (CaskConvolution)
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:13:17] [V] [TRT] Tactic: 3886731678879822788 Time: 0.397396
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:13:17] [V] [TRT] Tactic: 6629944304117643200 Time: 1.40773
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:13:17] [V] [TRT] Tactic: -9153228964338181824 Time: 1.58262
[11/14/2022-14:13:17] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:13:18] [V] [TRT] Tactic: -7394439838318485025 Time: 0.428648
[11/14/2022-14:13:18] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.397396
[11/14/2022-14:13:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788
[11/14/2022-14:13:18] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:18] [V] [TRT] *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) ***************
[11/14/2022-14:13:18] [V] [TRT] *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) ***************
[11/14/2022-14:13:18] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:18] [V] [TRT] *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,100,10,1) ***************
[11/14/2022-14:13:18] [V] [TRT] *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1,1280,128) ***************
[11/14/2022-14:13:18] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:18] [V] [TRT] *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,100,10,1) ***************
[11/14/2022-14:13:18] [V] [TRT] *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1,1280,128) ***************
[11/14/2022-14:13:18] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:18] [V] [TRT] *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) ***************
[11/14/2022-14:13:18] [V] [TRT] *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) ***************
[11/14/2022-14:13:18] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:18] [V] [TRT] *************** Autotuning format combination: Float(819200,6400,80,1) -> Float(819200,6400,80,1) ***************
[11/14/2022-14:13:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise (CudaDepthwiseConvolution)
[11/14/2022-14:13:18] [V] [TRT] Tactic: -1 Time: 0.431636
[11/14/2022-14:13:18] [V] [TRT] Fastest Tactic: -1 Time: 0.431636
[11/14/2022-14:13:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise (CudnnConvolution)
[11/14/2022-14:13:18] [V] [TRT] Tactic: 0 Time: 0.7206
[11/14/2022-14:13:18] [V] [TRT] Tactic: 1 Time: 0.639828
[11/14/2022-14:13:18] [V] [TRT] Tactic: 2 Time: 1.06461
[11/14/2022-14:13:20] [V] [TRT] Tactic: 4 Time: 121.414
[11/14/2022-14:13:23] [V] [TRT] Tactic: 5 Time: 178.05
[11/14/2022-14:13:23] [V] [TRT] Tactic: 6 Time: 11.5274
[11/14/2022-14:13:23] [V] [TRT] Fastest Tactic: 1 Time: 0.639828
[11/14/2022-14:13:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise (CaskConvolution)
[11/14/2022-14:13:23] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:13:23] [V] [TRT] Tactic: 1062367460111450758 Time: 7.03831
[11/14/2022-14:13:23] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479
[11/14/2022-14:13:23] [V] [TRT] Tactic: 1754984623894446479 Time: 5.91589
[11/14/2022-14:13:23] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984
[11/14/2022-14:13:24] [V] [TRT] Tactic: 3611739942397549984 Time: 20.8133
[11/14/2022-14:13:24] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724
[11/14/2022-14:13:24] [V] [TRT] Tactic: 3827454225649558724 Time: 17.4408
[11/14/2022-14:13:24] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379
[11/14/2022-14:13:24] [V] [TRT] Tactic: 4337000649858996379 Time: 10.2045
[11/14/2022-14:13:24] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:13:24] [V] [TRT] Tactic: 4501471010995462441 Time: 19.7303
[11/14/2022-14:13:24] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:13:25] [V] [TRT] Tactic: 5137655947464784826 Time: 9.9132
[11/14/2022-14:13:25] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:13:25] [V] [TRT] Tactic: 5288347012147084929 Time: 21.0141
[11/14/2022-14:13:25] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896
[11/14/2022-14:13:25] [V] [TRT] Tactic: 5921334924264294896 Time: 11.766
[11/14/2022-14:13:25] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:13:25] [V] [TRT] Tactic: 6645123197870846056 Time: 10.3405
[11/14/2022-14:13:25] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:13:26] [V] [TRT] Tactic: 7144526460361122478 Time: 5.76718
[11/14/2022-14:13:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038
[11/14/2022-14:13:26] [V] [TRT] Tactic: 7852627285308570038 Time: 18.7163
[11/14/2022-14:13:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713
[11/14/2022-14:13:26] [V] [TRT] Tactic: -9137461792520977713 Time: 19.6445
[11/14/2022-14:13:26] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509
[11/14/2022-14:13:27] [V] [TRT] Tactic: -8776506421218919509 Time: 16.8682
[11/14/2022-14:13:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:13:27] [V] [TRT] Tactic: -8262349710178828730 Time: 21.1587
[11/14/2022-14:13:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780
[11/14/2022-14:13:27] [V] [TRT] Tactic: -8133971918129952780 Time: 9.86474
[11/14/2022-14:13:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144
[11/14/2022-14:13:27] [V] [TRT] Tactic: -6092040395344634144 Time: 7.11477
[11/14/2022-14:13:27] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:13:28] [V] [TRT] Tactic: -4787320710726427159 Time: 5.9309
[11/14/2022-14:13:28] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:13:28] [V] [TRT] Tactic: -3456450830548107839 Time: 6.75398
[11/14/2022-14:13:28] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239
[11/14/2022-14:13:28] [V] [TRT] Tactic: -2318106587342035239 Time: 17.8058
[11/14/2022-14:13:28] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657
[11/14/2022-14:13:28] [V] [TRT] Tactic: -1343271414618805657 Time: 11.3647
[11/14/2022-14:13:28] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:13:28] [V] [TRT] Tactic: -1218658103698133241 Time: 10.4068
[11/14/2022-14:13:28] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:13:29] [V] [TRT] Tactic: -836875257600482091 Time: 10.5871
[11/14/2022-14:13:29] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:13:29] [V] [TRT] Tactic: -410470605513481746 Time: 19.7341
[11/14/2022-14:13:29] [V] [TRT] Fastest Tactic: 7144526460361122478 Time: 5.76718
[11/14/2022-14:13:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/14/2022-14:13:29] [V] [TRT] *************** Autotuning format combination: Float(819200,1,10240,128) -> Float(819200,1,10240,128) ***************
[11/14/2022-14:13:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise (CudnnConvolution)
[11/14/2022-14:13:29] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise (CaskConvolution)
[11/14/2022-14:13:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:29] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:29] [V] [TRT] *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) ***************
[11/14/2022-14:13:29] [V] [TRT] *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) ***************
[11/14/2022-14:13:29] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:29] [V] [TRT] *************** Autotuning format combination: Float(12800,100,10,1) -> Float(2400,100,10,1) ***************
[11/14/2022-14:13:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (FusedConvActConvolution)
[11/14/2022-14:13:29] [V] [TRT] Tactic: 589823 Time: 0.037944
[11/14/2022-14:13:29] [V] [TRT] Tactic: 655359 Time: 0.028176
[11/14/2022-14:13:29] [V] [TRT] Tactic: 786431 Time: 0.01464
[11/14/2022-14:13:29] [V] [TRT] Tactic: 851967 Time: 0.019488
[11/14/2022-14:13:29] [V] [TRT] Tactic: 1179647 Time: 0.014912
[11/14/2022-14:13:29] [V] [TRT] Tactic: 1310719 Time: 0.041652
[11/14/2022-14:13:29] [V] [TRT] Tactic: 1376255 Time: 0.028292
[11/14/2022-14:13:29] [V] [TRT] Tactic: 1441791 Time: 0.01186
[11/14/2022-14:13:29] [V] [TRT] Tactic: 1507327 Time: 0.018076
[11/14/2022-14:13:29] [V] [TRT] Tactic: 1638399 Time: 0.010312
[11/14/2022-14:13:29] [V] [TRT] Tactic: 1835007 Time: 0.013376
[11/14/2022-14:13:29] [V] [TRT] Tactic: 1900543 Time: 0.028708
[11/14/2022-14:13:29] [V] [TRT] Tactic: 2097151 Time: 0.01496
[11/14/2022-14:13:29] [V] [TRT] Tactic: 2162687 Time: 0.02854
[11/14/2022-14:13:29] [V] [TRT] Tactic: 2293759 Time: 0.028588
[11/14/2022-14:13:29] [V] [TRT] Tactic: 2359295 Time: 0.01938
[11/14/2022-14:13:29] [V] [TRT] Tactic: 2686975 Time: 0.04484
[11/14/2022-14:13:29] [V] [TRT] Tactic: 3080191 Time: 0.021384
[11/14/2022-14:13:29] [V] [TRT] Tactic: 3342335 Time: 0.02106
[11/14/2022-14:13:30] [V] [TRT] Tactic: 3407871 Time: 0.019184
[11/14/2022-14:13:30] [V] [TRT] Tactic: 3538943 Time: 0.019372
[11/14/2022-14:13:30] [V] [TRT] Tactic: 3670015 Time: 0.02832
[11/14/2022-14:13:30] [V] [TRT] Tactic: 3932159 Time: 0.023452
[11/14/2022-14:13:30] [V] [TRT] Tactic: 3997695 Time: 0.013448
[11/14/2022-14:13:30] [V] [TRT] Tactic: 4063231 Time: 0.023004
[11/14/2022-14:13:30] [V] [TRT] Tactic: 4194303 Time: 0.016092
[11/14/2022-14:13:30] [V] [TRT] Tactic: 4259839 Time: 0.01498
[11/14/2022-14:13:30] [V] [TRT] Tactic: 4325375 Time: 0.011728
[11/14/2022-14:13:30] [V] [TRT] Tactic: 4521983 Time: 0.025592
[11/14/2022-14:13:30] [V] [TRT] Tactic: 4587519 Time: 0.018472
[11/14/2022-14:13:30] [V] [TRT] Tactic: 4653055 Time: 0.01964
[11/14/2022-14:13:30] [V] [TRT] Tactic: 4915199 Time: 0.01158
[11/14/2022-14:13:30] [V] [TRT] Tactic: 4980735 Time: 0.021252
[11/14/2022-14:13:30] [V] [TRT] Tactic: 5177343 Time: 0.01522
[11/14/2022-14:13:30] [V] [TRT] Tactic: 5242879 Time: 0.017724
[11/14/2022-14:13:30] [V] [TRT] Tactic: 5373951 Time: 0.014796
[11/14/2022-14:13:30] [V] [TRT] Tactic: 5439487 Time: 0.013232
[11/14/2022-14:13:30] [V] [TRT] Tactic: 5570559 Time: 0.019988
[11/14/2022-14:13:30] [V] [TRT] Tactic: 5636095 Time: 0.022696
[11/14/2022-14:13:30] [V] [TRT] Tactic: 5701631 Time: 0.025276
[11/14/2022-14:13:30] [V] [TRT] Tactic: 5767167 Time: 0.015048
[11/14/2022-14:13:30] [V] [TRT] Tactic: 5832703 Time: 0.020216
[11/14/2022-14:13:30] [V] [TRT] Tactic: 5898239 Time: 0.013376
[11/14/2022-14:13:30] [V] [TRT] Tactic: 6029311 Time: 0.024044
[11/14/2022-14:13:30] [V] [TRT] Tactic: 6225919 Time: 0.015836
[11/14/2022-14:13:30] [V] [TRT] Tactic: 6291455 Time: 0.014572
[11/14/2022-14:13:30] [V] [TRT] Tactic: 6422527 Time: 0.019728
[11/14/2022-14:13:30] [V] [TRT] Tactic: 6750207 Time: 0.016024
[11/14/2022-14:13:30] [V] [TRT] Tactic: 6815743 Time: 0.016308
[11/14/2022-14:13:30] [V] [TRT] Tactic: 6946815 Time: 0.015316
[11/14/2022-14:13:30] [V] [TRT] Tactic: 7012351 Time: 0.016324
[11/14/2022-14:13:30] [V] [TRT] Tactic: 7077887 Time: 0.015624
[11/14/2022-14:13:31] [V] [TRT] Tactic: 7143423 Time: 0.015336
[11/14/2022-14:13:31] [V] [TRT] Tactic: 7208959 Time: 0.017052
[11/14/2022-14:13:31] [V] [TRT] Tactic: 7340031 Time: 0.016144
[11/14/2022-14:13:31] [V] [TRT] Tactic: 7405567 Time: 0.014912
[11/14/2022-14:13:31] [V] [TRT] Tactic: 7536639 Time: 0.02136
[11/14/2022-14:13:31] [V] [TRT] Tactic: 7602175 Time: 0.016444
[11/14/2022-14:13:31] [V] [TRT] Tactic: 7733247 Time: 0.020064
[11/14/2022-14:13:31] [V] [TRT] Tactic: 7798783 Time: 0.019252
[11/14/2022-14:13:31] [V] [TRT] Tactic: 8191999 Time: 0.015472
[11/14/2022-14:13:31] [V] [TRT] Tactic: 8257535 Time: 0.01066
[11/14/2022-14:13:31] [V] [TRT] Tactic: 8323071 Time: 0.013456
[11/14/2022-14:13:31] [V] [TRT] Tactic: 8650751 Time: 0.01522
[11/14/2022-14:13:31] [V] [TRT] Tactic: 8716287 Time: 0.013224
[11/14/2022-14:13:31] [V] [TRT] Tactic: 9109503 Time: 0.01494
[11/14/2022-14:13:31] [V] [TRT] Tactic: 9568255 Time: 0.013364
[11/14/2022-14:13:31] [V] [TRT] Tactic: 9895935 Time: 0.016076
[11/14/2022-14:13:31] [V] [TRT] Tactic: 10223615 Time: 0.029464
[11/14/2022-14:13:31] [V] [TRT] Tactic: 10354687 Time: 0.012892
[11/14/2022-14:13:31] [V] [TRT] Tactic: 10551295 Time: 0.017208
[11/14/2022-14:13:31] [V] [TRT] Tactic: 10747903 Time: 0.0141
[11/14/2022-14:13:31] [V] [TRT] Tactic: 10944511 Time: 0.018292
[11/14/2022-14:13:31] [V] [TRT] Fastest Tactic: 1638399 Time: 0.010312
[11/14/2022-14:13:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CudaDepthwiseConvolution)
[11/14/2022-14:13:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CudnnConvolution)
[11/14/2022-14:13:31] [V] [TRT] Tactic: 0 Time: 0.04644
[11/14/2022-14:13:31] [V] [TRT] Tactic: 1 Time: 0.059384
[11/14/2022-14:13:31] [V] [TRT] Tactic: 2 Time: 0.080976
[11/14/2022-14:13:31] [V] [TRT] Tactic: 4 Time: 0.36984
[11/14/2022-14:13:31] [V] [TRT] Tactic: 5 Time: 0.173884
[11/14/2022-14:13:31] [V] [TRT] Fastest Tactic: 0 Time: 0.04644
[11/14/2022-14:13:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CublasConvolution)
[11/14/2022-14:13:31] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CaskConvolution)
[11/14/2022-14:13:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:13:31] [V] [TRT] Tactic: 1062367460111450758 Time: 0.027092
[11/14/2022-14:13:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:13:31] [V] [TRT] Tactic: 1698681053543049347 Time: 0.019684
[11/14/2022-14:13:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:13:31] [V] [TRT] Tactic: 4501471010995462441 Time: 0.0252
[11/14/2022-14:13:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:13:31] [V] [TRT] Tactic: 5137655947464784826 Time: 0.093916
[11/14/2022-14:13:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:13:31] [V] [TRT] Tactic: 5288347012147084929 Time: 0.024996
[11/14/2022-14:13:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:13:31] [V] [TRT] Tactic: 5326823351883942011 Time: 0.027372
[11/14/2022-14:13:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:13:31] [V] [TRT] Tactic: 5500448035057547314 Time: 0.025548
[11/14/2022-14:13:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:13:31] [V] [TRT] Tactic: 6645123197870846056 Time: 0.02012
[11/14/2022-14:13:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:13:31] [V] [TRT] Tactic: 7144526460361122478 Time: 0.03366
[11/14/2022-14:13:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:13:31] [V] [TRT] Tactic: -8262349710178828730 Time: 0.032184
[11/14/2022-14:13:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:13:32] [V] [TRT] Tactic: -6576203419454146580 Time: 0.030208
[11/14/2022-14:13:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:13:32] [V] [TRT] Tactic: -4787320710726427159 Time: 0.024716
[11/14/2022-14:13:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:13:32] [V] [TRT] Tactic: -3456450830548107839 Time: 0.031404
[11/14/2022-14:13:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:13:32] [V] [TRT] Tactic: -1218658103698133241 Time: 0.027244
[11/14/2022-14:13:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:13:32] [V] [TRT] Tactic: -836875257600482091 Time: 0.024992
[11/14/2022-14:13:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:13:32] [V] [TRT] Tactic: -410470605513481746 Time: 0.026388
[11/14/2022-14:13:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:13:32] [V] [TRT] Tactic: -377491875521947884 Time: 0.075628
[11/14/2022-14:13:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:13:32] [V] [TRT] Tactic: -37215280111360163 Time: 0.030336
[11/14/2022-14:13:32] [V] [TRT] Fastest Tactic: 1698681053543049347 Time: 0.019684
[11/14/2022-14:13:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 1638399
[11/14/2022-14:13:32] [V] [TRT] *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(2400,1,240,24) ***************
[11/14/2022-14:13:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CudnnConvolution)
[11/14/2022-14:13:32] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CublasConvolution)
[11/14/2022-14:13:32] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CaskConvolution)
[11/14/2022-14:13:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:13:32] [V] [TRT] Tactic: 3886731678879822788 Time: 0.026016
[11/14/2022-14:13:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:13:32] [V] [TRT] Tactic: 6629944304117643200 Time: 0.019328
[11/14/2022-14:13:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:13:32] [V] [TRT] Tactic: -9153228964338181824 Time: 0.018408
[11/14/2022-14:13:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:13:32] [V] [TRT] Tactic: -7394439838318485025 Time: 0.018108
[11/14/2022-14:13:32] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.018108
[11/14/2022-14:13:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025
[11/14/2022-14:13:32] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:32] [V] [TRT] *************** Autotuning format combination: Float(12800,100,10,1) -> Float(2400,100,10,1) ***************
[11/14/2022-14:13:32] [V] [TRT] *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(2400,1,240,24) ***************
[11/14/2022-14:13:32] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:32] [V] [TRT] *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) ***************
[11/14/2022-14:13:32] [V] [TRT] *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) ***************
[11/14/2022-14:13:32] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:32] [V] [TRT] *************** Autotuning format combination: Float(819200,6400,80,1) -> Float(819200,6400,80,1) ***************
[11/14/2022-14:13:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) (FusedConvActConvolution)
[11/14/2022-14:13:32] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) (CudaDepthwiseConvolution)
[11/14/2022-14:13:32] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) (CudnnConvolution)
[11/14/2022-14:13:32] [V] [TRT] Tactic: 0 Time: 2.0915
[11/14/2022-14:13:32] [V] [TRT] Tactic: 1 Time: 1.62878
[11/14/2022-14:13:32] [V] [TRT] Tactic: 2 Time: 2.05132
[11/14/2022-14:13:32] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2198142976, available: 16777216
[11/14/2022-14:13:32] [V] [TRT] Tactic: 5 Time: 3.64431
[11/14/2022-14:13:32] [V] [TRT] Fastest Tactic: 1 Time: 1.62878
[11/14/2022-14:13:32] [V] [TRT] Setting workspace to 2198142976enables more tactics for profiling
[11/14/2022-14:13:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) (CublasConvolution)
[11/14/2022-14:13:32] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) (CaskConvolution)
[11/14/2022-14:13:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:13:32] [V] [TRT] Tactic: 1062367460111450758 Time: 0.710044
[11/14/2022-14:13:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:13:32] [V] [TRT] Tactic: 1698681053543049347 Time: 0.715588
[11/14/2022-14:13:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:13:32] [V] [TRT] Tactic: 4501471010995462441 Time: 0.5019
[11/14/2022-14:13:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:13:32] [V] [TRT] Tactic: 5137655947464784826 Time: 0.578124
[11/14/2022-14:13:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:13:32] [V] [TRT] Tactic: 5288347012147084929 Time: 0.5148
[11/14/2022-14:13:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:13:32] [V] [TRT] Tactic: 5326823351883942011 Time: 0.496372
[11/14/2022-14:13:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:13:32] [V] [TRT] Tactic: 5500448035057547314 Time: 0.598948
[11/14/2022-14:13:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:13:32] [V] [TRT] Tactic: 6645123197870846056 Time: 0.525732
[11/14/2022-14:13:32] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:13:33] [V] [TRT] Tactic: 7144526460361122478 Time: 0.805072
[11/14/2022-14:13:33] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:13:33] [V] [TRT] Tactic: -8262349710178828730 Time: 0.59942
[11/14/2022-14:13:33] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:13:33] [V] [TRT] Tactic: -6576203419454146580 Time: 0.654936
[11/14/2022-14:13:33] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:13:33] [V] [TRT] Tactic: -4787320710726427159 Time: 0.8639
[11/14/2022-14:13:33] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:13:33] [V] [TRT] Tactic: -3456450830548107839 Time: 0.701392
[11/14/2022-14:13:33] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:13:33] [V] [TRT] Tactic: -1218658103698133241 Time: 0.639916
[11/14/2022-14:13:33] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:13:33] [V] [TRT] Tactic: -836875257600482091 Time: 0.61318
[11/14/2022-14:13:33] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:13:33] [V] [TRT] Tactic: -410470605513481746 Time: 0.49644
[11/14/2022-14:13:33] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:13:33] [V] [TRT] Tactic: -377491875521947884 Time: 0.51232
[11/14/2022-14:13:33] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:13:33] [V] [TRT] Tactic: -37215280111360163 Time: 0.519484
[11/14/2022-14:13:33] [V] [TRT] Fastest Tactic: 5326823351883942011 Time: 0.496372
[11/14/2022-14:13:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5326823351883942011
[11/14/2022-14:13:33] [V] [TRT] *************** Autotuning format combination: Float(819200,1,10240,128) -> Float(819200,1,10240,128) ***************
[11/14/2022-14:13:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) (CudnnConvolution)
[11/14/2022-14:13:33] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) (CublasConvolution)
[11/14/2022-14:13:33] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) (CaskConvolution)
[11/14/2022-14:13:33] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:13:33] [V] [TRT] Tactic: 3886731678879822788 Time: 0.54304
[11/14/2022-14:13:33] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:13:33] [V] [TRT] Tactic: 6629944304117643200 Time: 1.5636
[11/14/2022-14:13:33] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:13:33] [V] [TRT] Tactic: -9153228964338181824 Time: 1.57679
[11/14/2022-14:13:33] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:13:33] [V] [TRT] Tactic: -7394439838318485025 Time: 0.54446
[11/14/2022-14:13:33] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.54304
[11/14/2022-14:13:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788
[11/14/2022-14:13:33] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:33] [V] [TRT] *************** Autotuning format combination: Float(2400,100,10,1) -> Float(2400,4,1) ***************
[11/14/2022-14:13:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__593 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7 (Shuffle)
[11/14/2022-14:13:33] [V] [TRT] Tactic: 0 Time: 0.005244
[11/14/2022-14:13:33] [V] [TRT] Fastest Tactic: 0 Time: 0.005244
[11/14/2022-14:13:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:33] [V] [TRT] *************** Autotuning format combination: Float(2400,1,240,24) -> Float(1,4,1) ***************
[11/14/2022-14:13:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__593 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7 (Shuffle)
[11/14/2022-14:13:33] [V] [TRT] Tactic: 0 Time: 0.0056
[11/14/2022-14:13:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0056
[11/14/2022-14:13:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:33] [V] [TRT] *************** Autotuning format combination: Float(100,100:32,10,1) -> Float(2400:32,4,1) ***************
[11/14/2022-14:13:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__593 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7 (Shuffle)
[11/14/2022-14:13:33] [V] [TRT] Tactic: 0 Time: 0.11748
[11/14/2022-14:13:33] [V] [TRT] Fastest Tactic: 0 Time: 0.11748
[11/14/2022-14:13:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:33] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:33] [V] [TRT] *************** Autotuning format combination: Float(2400,100,10,1) -> Float(2400,4,1) ***************
[11/14/2022-14:13:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__602 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 (Shuffle)
[11/14/2022-14:13:33] [V] [TRT] Tactic: 0 Time: 0.005544
[11/14/2022-14:13:33] [V] [TRT] Fastest Tactic: 0 Time: 0.005544
[11/14/2022-14:13:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:33] [V] [TRT] *************** Autotuning format combination: Float(2400,1,240,24) -> Float(1,4,1) ***************
[11/14/2022-14:13:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__602 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 (Shuffle)
[11/14/2022-14:13:33] [V] [TRT] Tactic: 0 Time: 0.005604
[11/14/2022-14:13:33] [V] [TRT] Fastest Tactic: 0 Time: 0.005604
[11/14/2022-14:13:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:33] [V] [TRT] *************** Autotuning format combination: Float(100,100:32,10,1) -> Float(2400:32,4,1) ***************
[11/14/2022-14:13:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__602 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 (Shuffle)
[11/14/2022-14:13:33] [V] [TRT] Tactic: 0 Time: 0.079768
[11/14/2022-14:13:33] [V] [TRT] Fastest Tactic: 0 Time: 0.079768
[11/14/2022-14:13:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:33] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:33] [V] [TRT] *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) ***************
[11/14/2022-14:13:33] [V] [TRT] *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) ***************
[11/14/2022-14:13:33] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:33] [V] [TRT] *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) ***************
[11/14/2022-14:13:33] [V] [TRT] *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) ***************
[11/14/2022-14:13:33] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:33] [V] [TRT] *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) ***************
[11/14/2022-14:13:33] [V] [TRT] *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) ***************
[11/14/2022-14:13:33] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:33] [V] [TRT] *************** Autotuning format combination: Float(819200,6400,80,1) -> Float(819200,6400,80,1) ***************
[11/14/2022-14:13:33] [V] [TRT] *************** Autotuning format combination: Float(819200,1,10240,128) -> Float(819200,1,10240,128) ***************
[11/14/2022-14:13:33] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:33] [V] [TRT] *************** Autotuning format combination: Float(3200,25,5,1) -> Float(600,25,5,1) ***************
[11/14/2022-14:13:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (FusedConvActConvolution)
[11/14/2022-14:13:33] [V] [TRT] Tactic: 589823 Time: 0.025384
[11/14/2022-14:13:33] [V] [TRT] Tactic: 655359 Time: 0.027312
[11/14/2022-14:13:33] [V] [TRT] Tactic: 786431 Time: 0.018592
[11/14/2022-14:13:33] [V] [TRT] Tactic: 851967 Time: 0.014804
[11/14/2022-14:13:33] [V] [TRT] Tactic: 1179647 Time: 0.010108
[11/14/2022-14:13:33] [V] [TRT] Tactic: 1310719 Time: 0.053164
[11/14/2022-14:13:33] [V] [TRT] Tactic: 1376255 Time: 0.038968
[11/14/2022-14:13:33] [V] [TRT] Tactic: 1441791 Time: 0.014984
[11/14/2022-14:13:33] [V] [TRT] Tactic: 1507327 Time: 0.016732
[11/14/2022-14:13:34] [V] [TRT] Tactic: 1638399 Time: 0.008656
[11/14/2022-14:13:34] [V] [TRT] Tactic: 1835007 Time: 0.0138
[11/14/2022-14:13:34] [V] [TRT] Tactic: 1900543 Time: 0.028588
[11/14/2022-14:13:34] [V] [TRT] Tactic: 2097151 Time: 0.0072
[11/14/2022-14:13:34] [V] [TRT] Tactic: 2162687 Time: 0.028124
[11/14/2022-14:13:34] [V] [TRT] Tactic: 2293759 Time: 0.027176
[11/14/2022-14:13:34] [V] [TRT] Tactic: 2359295 Time: 0.01916
[11/14/2022-14:13:34] [V] [TRT] Tactic: 2686975 Time: 0.026996
[11/14/2022-14:13:34] [V] [TRT] Tactic: 3080191 Time: 0.01184
[11/14/2022-14:13:34] [V] [TRT] Tactic: 3342335 Time: 0.016988
[11/14/2022-14:13:34] [V] [TRT] Tactic: 3407871 Time: 0.01778
[11/14/2022-14:13:34] [V] [TRT] Tactic: 3538943 Time: 0.01034
[11/14/2022-14:13:34] [V] [TRT] Tactic: 3670015 Time: 0.028544
[11/14/2022-14:13:34] [V] [TRT] Tactic: 3932159 Time: 0.022048
[11/14/2022-14:13:34] [V] [TRT] Tactic: 3997695 Time: 0.010544
[11/14/2022-14:13:34] [V] [TRT] Tactic: 4063231 Time: 0.0103
[11/14/2022-14:13:34] [V] [TRT] Tactic: 4194303 Time: 0.014728
[11/14/2022-14:13:34] [V] [TRT] Tactic: 4259839 Time: 0.007256
[11/14/2022-14:13:34] [V] [TRT] Tactic: 4325375 Time: 0.010316
[11/14/2022-14:13:34] [V] [TRT] Tactic: 4521983 Time: 0.02562
[11/14/2022-14:13:34] [V] [TRT] Tactic: 4587519 Time: 0.008732
[11/14/2022-14:13:34] [V] [TRT] Tactic: 4653055 Time: 0.008624
[11/14/2022-14:13:34] [V] [TRT] Tactic: 4915199 Time: 0.008736
[11/14/2022-14:13:34] [V] [TRT] Tactic: 4980735 Time: 0.018064
[11/14/2022-14:13:34] [V] [TRT] Tactic: 5177343 Time: 0.007684
[11/14/2022-14:13:34] [V] [TRT] Tactic: 5242879 Time: 0.013992
[11/14/2022-14:13:34] [V] [TRT] Tactic: 5373951 Time: 0.0075
[11/14/2022-14:13:34] [V] [TRT] Tactic: 5439487 Time: 0.011764
[11/14/2022-14:13:34] [V] [TRT] Tactic: 5570559 Time: 0.01332
[11/14/2022-14:13:34] [V] [TRT] Tactic: 5636095 Time: 0.010316
[11/14/2022-14:13:34] [V] [TRT] Tactic: 5701631 Time: 0.023864
[11/14/2022-14:13:34] [V] [TRT] Tactic: 5767167 Time: 0.018816
[11/14/2022-14:13:34] [V] [TRT] Tactic: 5832703 Time: 0.014708
[11/14/2022-14:13:34] [V] [TRT] Tactic: 5898239 Time: 0.011524
[11/14/2022-14:13:34] [V] [TRT] Tactic: 6029311 Time: 0.023396
[11/14/2022-14:13:34] [V] [TRT] Tactic: 6225919 Time: 0.010436
[11/14/2022-14:13:34] [V] [TRT] Tactic: 6291455 Time: 0.007584
[11/14/2022-14:13:34] [V] [TRT] Tactic: 6422527 Time: 0.018088
[11/14/2022-14:13:34] [V] [TRT] Tactic: 6750207 Time: 0.008564
[11/14/2022-14:13:34] [V] [TRT] Tactic: 6815743 Time: 0.01366
[11/14/2022-14:13:34] [V] [TRT] Tactic: 6946815 Time: 0.013852
[11/14/2022-14:13:34] [V] [TRT] Tactic: 7012351 Time: 0.00728
[11/14/2022-14:13:34] [V] [TRT] Tactic: 7077887 Time: 0.010056
[11/14/2022-14:13:34] [V] [TRT] Tactic: 7143423 Time: 0.013376
[11/14/2022-14:13:35] [V] [TRT] Tactic: 7208959 Time: 0.014708
[11/14/2022-14:13:35] [V] [TRT] Tactic: 7340031 Time: 0.010328
[11/14/2022-14:13:35] [V] [TRT] Tactic: 7405567 Time: 0.010784
[11/14/2022-14:13:35] [V] [TRT] Tactic: 7536639 Time: 0.01322
[11/14/2022-14:13:35] [V] [TRT] Tactic: 7602175 Time: 0.01602
[11/14/2022-14:13:35] [V] [TRT] Tactic: 7733247 Time: 0.010416
[11/14/2022-14:13:35] [V] [TRT] Tactic: 7798783 Time: 0.014268
[11/14/2022-14:13:35] [V] [TRT] Tactic: 8191999 Time: 0.011604
[11/14/2022-14:13:35] [V] [TRT] Tactic: 8257535 Time: 0.008612
[11/14/2022-14:13:35] [V] [TRT] Tactic: 8323071 Time: 0.011756
[11/14/2022-14:13:35] [V] [TRT] Tactic: 8650751 Time: 0.014372
[11/14/2022-14:13:35] [V] [TRT] Tactic: 8716287 Time: 0.009236
[11/14/2022-14:13:35] [V] [TRT] Tactic: 9109503 Time: 0.008516
[11/14/2022-14:13:35] [V] [TRT] Tactic: 9568255 Time: 0.00868
[11/14/2022-14:13:35] [V] [TRT] Tactic: 9895935 Time: 0.014864
[11/14/2022-14:13:35] [V] [TRT] Tactic: 10223615 Time: 0.024096
[11/14/2022-14:13:35] [V] [TRT] Tactic: 10354687 Time: 0.0079
[11/14/2022-14:13:35] [V] [TRT] Tactic: 10551295 Time: 0.016064
[11/14/2022-14:13:35] [V] [TRT] Tactic: 10747903 Time: 0.01118
[11/14/2022-14:13:35] [V] [TRT] Tactic: 10944511 Time: 0.01774
[11/14/2022-14:13:35] [V] [TRT] Fastest Tactic: 2097151 Time: 0.0072
[11/14/2022-14:13:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CudaDepthwiseConvolution)
[11/14/2022-14:13:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CudnnConvolution)
[11/14/2022-14:13:35] [V] [TRT] Tactic: 0 Time: 0.023864
[11/14/2022-14:13:35] [V] [TRT] Tactic: 1 Time: 0.030984
[11/14/2022-14:13:35] [V] [TRT] Tactic: 2 Time: 0.070268
[11/14/2022-14:13:35] [V] [TRT] Tactic: 4 Time: 0.386276
[11/14/2022-14:13:35] [V] [TRT] Tactic: 5 Time: 0.16328
[11/14/2022-14:13:35] [V] [TRT] Fastest Tactic: 0 Time: 0.023864
[11/14/2022-14:13:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CublasConvolution)
[11/14/2022-14:13:35] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CaskConvolution)
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:13:35] [V] [TRT] Tactic: 1062367460111450758 Time: 0.024132
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:13:35] [V] [TRT] Tactic: 1698681053543049347 Time: 0.016568
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:13:35] [V] [TRT] Tactic: 4501471010995462441 Time: 0.03394
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:13:35] [V] [TRT] Tactic: 5137655947464784826 Time: 0.030796
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:13:35] [V] [TRT] Tactic: 5288347012147084929 Time: 0.024284
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:13:35] [V] [TRT] Tactic: 5326823351883942011 Time: 0.02454
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:13:35] [V] [TRT] Tactic: 5500448035057547314 Time: 0.021512
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:13:35] [V] [TRT] Tactic: 6645123197870846056 Time: 0.025828
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:13:35] [V] [TRT] Tactic: 7144526460361122478 Time: 0.03342
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:13:35] [V] [TRT] Tactic: -8262349710178828730 Time: 0.0297
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:13:35] [V] [TRT] Tactic: -6576203419454146580 Time: 0.022568
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:13:35] [V] [TRT] Tactic: -4787320710726427159 Time: 0.021328
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:13:35] [V] [TRT] Tactic: -3456450830548107839 Time: 0.021368
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:13:35] [V] [TRT] Tactic: -1218658103698133241 Time: 0.044104
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:13:35] [V] [TRT] Tactic: -836875257600482091 Time: 0.021968
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:13:35] [V] [TRT] Tactic: -410470605513481746 Time: 0.024044
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:13:35] [V] [TRT] Tactic: -377491875521947884 Time: 0.024196
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:13:35] [V] [TRT] Tactic: -37215280111360163 Time: 0.019084
[11/14/2022-14:13:35] [V] [TRT] Fastest Tactic: 1698681053543049347 Time: 0.016568
[11/14/2022-14:13:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2097151
[11/14/2022-14:13:35] [V] [TRT] *************** Autotuning format combination: Float(3200,1,640,128) -> Float(600,1,120,24) ***************
[11/14/2022-14:13:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CudnnConvolution)
[11/14/2022-14:13:35] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CublasConvolution)
[11/14/2022-14:13:35] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CaskConvolution)
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:13:35] [V] [TRT] Tactic: 3886731678879822788 Time: 0.01702
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:13:35] [V] [TRT] Tactic: 6629944304117643200 Time: 0.016936
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:13:35] [V] [TRT] Tactic: -9153228964338181824 Time: 0.01172
[11/14/2022-14:13:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:13:35] [V] [TRT] Tactic: -7394439838318485025 Time: 0.018196
[11/14/2022-14:13:35] [V] [TRT] Fastest Tactic: -9153228964338181824 Time: 0.01172
[11/14/2022-14:13:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824
[11/14/2022-14:13:35] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:35] [V] [TRT] *************** Autotuning format combination: Float(3200,25,5,1) -> Float(600,25,5,1) ***************
[11/14/2022-14:13:35] [V] [TRT] *************** Autotuning format combination: Float(3200,1,640,128) -> Float(600,1,120,24) ***************
[11/14/2022-14:13:35] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:35] [V] [TRT] *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) ***************
[11/14/2022-14:13:35] [V] [TRT] *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) ***************
[11/14/2022-14:13:35] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:35] [V] [TRT] *************** Autotuning format combination: Float(819200,6400,80,1) -> Float(819200,6400,80,1) ***************
[11/14/2022-14:13:35] [V] [TRT] *************** Autotuning format combination: Float(819200,1,10240,128) -> Float(819200,1,10240,128) ***************
[11/14/2022-14:13:35] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:35] [V] [TRT] *************** Autotuning format combination: Float(600,25,5,1) -> Float(600,4,1) ***************
[11/14/2022-14:13:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__539 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9 (Shuffle)
[11/14/2022-14:13:35] [V] [TRT] Tactic: 0 Time: 0.004532
[11/14/2022-14:13:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004532
[11/14/2022-14:13:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:35] [V] [TRT] *************** Autotuning format combination: Float(600,1,120,24) -> Float(1,4,1) ***************
[11/14/2022-14:13:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__539 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9 (Shuffle)
[11/14/2022-14:13:35] [V] [TRT] Tactic: 0 Time: 0.003196
[11/14/2022-14:13:35] [V] [TRT] Fastest Tactic: 0 Time: 0.003196
[11/14/2022-14:13:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:35] [V] [TRT] *************** Autotuning format combination: Float(25,25:32,5,1) -> Float(600:32,4,1) ***************
[11/14/2022-14:13:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__539 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9 (Shuffle)
[11/14/2022-14:13:36] [V] [TRT] Tactic: 0 Time: 0.019296
[11/14/2022-14:13:36] [V] [TRT] Fastest Tactic: 0 Time: 0.019296
[11/14/2022-14:13:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:36] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:36] [V] [TRT] *************** Autotuning format combination: Float(600,25,5,1) -> Float(600,4,1) ***************
[11/14/2022-14:13:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__548 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 (Shuffle)
[11/14/2022-14:13:36] [V] [TRT] Tactic: 0 Time: 0.00428
[11/14/2022-14:13:36] [V] [TRT] Fastest Tactic: 0 Time: 0.00428
[11/14/2022-14:13:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:36] [V] [TRT] *************** Autotuning format combination: Float(600,1,120,24) -> Float(1,4,1) ***************
[11/14/2022-14:13:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__548 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 (Shuffle)
[11/14/2022-14:13:36] [V] [TRT] Tactic: 0 Time: 0.00342
[11/14/2022-14:13:36] [V] [TRT] Fastest Tactic: 0 Time: 0.00342
[11/14/2022-14:13:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:36] [V] [TRT] *************** Autotuning format combination: Float(25,25:32,5,1) -> Float(600:32,4,1) ***************
[11/14/2022-14:13:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__548 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 (Shuffle)
[11/14/2022-14:13:36] [V] [TRT] Tactic: 0 Time: 0.018812
[11/14/2022-14:13:36] [V] [TRT] Fastest Tactic: 0 Time: 0.018812
[11/14/2022-14:13:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:36] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:36] [V] [TRT] *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) ***************
[11/14/2022-14:13:36] [V] [TRT] *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) ***************
[11/14/2022-14:13:36] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:36] [V] [TRT] *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) ***************
[11/14/2022-14:13:36] [V] [TRT] *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) ***************
[11/14/2022-14:13:36] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:36] [V] [TRT] *************** Autotuning format combination: Float(819200,6400,80,1) -> Float(819200,6400,80,1) ***************
[11/14/2022-14:13:36] [V] [TRT] *************** Autotuning format combination: Float(819200,1,10240,128) -> Float(819200,1,10240,128) ***************
[11/14/2022-14:13:36] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:36] [V] [TRT] *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(38400,1600,40,1) ***************
[11/14/2022-14:13:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (FusedConvActConvolution)
[11/14/2022-14:13:36] [V] [TRT] Tactic: 589823 Time: 0.143464
[11/14/2022-14:13:36] [V] [TRT] Tactic: 655359 Time: 0.176548
[11/14/2022-14:13:36] [V] [TRT] Tactic: 786431 Time: 0.11814
[11/14/2022-14:13:36] [V] [TRT] Tactic: 851967 Time: 0.269564
[11/14/2022-14:13:36] [V] [TRT] Tactic: 1179647 Time: 0.1449
[11/14/2022-14:13:36] [V] [TRT] Tactic: 1310719 Time: 0.173216
[11/14/2022-14:13:36] [V] [TRT] Tactic: 1376255 Time: 0.139044
[11/14/2022-14:13:36] [V] [TRT] Tactic: 1441791 Time: 0.16898
[11/14/2022-14:13:36] [V] [TRT] Tactic: 1507327 Time: 0.2543
[11/14/2022-14:13:36] [V] [TRT] Tactic: 1638399 Time: 0.126644
[11/14/2022-14:13:36] [V] [TRT] Tactic: 1835007 Time: 0.116308
[11/14/2022-14:13:36] [V] [TRT] Tactic: 1900543 Time: 0.26534
[11/14/2022-14:13:36] [V] [TRT] Tactic: 2097151 Time: 0.127644
[11/14/2022-14:13:36] [V] [TRT] Tactic: 2162687 Time: 0.1475
[11/14/2022-14:13:36] [V] [TRT] Tactic: 2293759 Time: 0.139476
[11/14/2022-14:13:36] [V] [TRT] Tactic: 2359295 Time: 0.14406
[11/14/2022-14:13:36] [V] [TRT] Tactic: 2686975 Time: 0.137436
[11/14/2022-14:13:36] [V] [TRT] Tactic: 3080191 Time: 0.243884
[11/14/2022-14:13:36] [V] [TRT] Tactic: 3342335 Time: 0.254028
[11/14/2022-14:13:36] [V] [TRT] Tactic: 3407871 Time: 0.1404
[11/14/2022-14:13:36] [V] [TRT] Tactic: 3538943 Time: 0.130396
[11/14/2022-14:13:36] [V] [TRT] Tactic: 3670015 Time: 0.174544
[11/14/2022-14:13:36] [V] [TRT] Tactic: 3932159 Time: 0.232388
[11/14/2022-14:13:36] [V] [TRT] Tactic: 3997695 Time: 0.119576
[11/14/2022-14:13:36] [V] [TRT] Tactic: 4063231 Time: 0.282244
[11/14/2022-14:13:36] [V] [TRT] Tactic: 4194303 Time: 0.105004
[11/14/2022-14:13:36] [V] [TRT] Tactic: 4259839 Time: 0.115936
[11/14/2022-14:13:36] [V] [TRT] Tactic: 4325375 Time: 0.10992
[11/14/2022-14:13:36] [V] [TRT] Tactic: 4521983 Time: 0.113576
[11/14/2022-14:13:36] [V] [TRT] Tactic: 4587519 Time: 0.11614
[11/14/2022-14:13:37] [V] [TRT] Tactic: 4653055 Time: 0.180656
[11/14/2022-14:13:37] [V] [TRT] Tactic: 4915199 Time: 0.109172
[11/14/2022-14:13:37] [V] [TRT] Tactic: 4980735 Time: 0.1117
[11/14/2022-14:13:37] [V] [TRT] Tactic: 5177343 Time: 0.15262
[11/14/2022-14:13:37] [V] [TRT] Tactic: 5242879 Time: 0.146696
[11/14/2022-14:13:37] [V] [TRT] Tactic: 5373951 Time: 0.207668
[11/14/2022-14:13:37] [V] [TRT] Tactic: 5439487 Time: 0.198592
[11/14/2022-14:13:37] [V] [TRT] Tactic: 5570559 Time: 0.194628
[11/14/2022-14:13:37] [V] [TRT] Tactic: 5636095 Time: 0.288528
[11/14/2022-14:13:37] [V] [TRT] Tactic: 5701631 Time: 0.165396
[11/14/2022-14:13:37] [V] [TRT] Tactic: 5767167 Time: 0.376692
[11/14/2022-14:13:37] [V] [TRT] Tactic: 5832703 Time: 0.131852
[11/14/2022-14:13:37] [V] [TRT] Tactic: 5898239 Time: 0.129436
[11/14/2022-14:13:37] [V] [TRT] Tactic: 6029311 Time: 0.151936
[11/14/2022-14:13:37] [V] [TRT] Tactic: 6225919 Time: 0.132156
[11/14/2022-14:13:37] [V] [TRT] Tactic: 6291455 Time: 0.144252
[11/14/2022-14:13:37] [V] [TRT] Tactic: 6422527 Time: 0.23504
[11/14/2022-14:13:37] [V] [TRT] Tactic: 6750207 Time: 0.127872
[11/14/2022-14:13:37] [V] [TRT] Tactic: 6815743 Time: 0.198288
[11/14/2022-14:13:37] [V] [TRT] Tactic: 6946815 Time: 0.1867
[11/14/2022-14:13:37] [V] [TRT] Tactic: 7012351 Time: 0.130692
[11/14/2022-14:13:37] [V] [TRT] Tactic: 7077887 Time: 0.122836
[11/14/2022-14:13:37] [V] [TRT] Tactic: 7143423 Time: 0.151816
[11/14/2022-14:13:37] [V] [TRT] Tactic: 7208959 Time: 0.142084
[11/14/2022-14:13:37] [V] [TRT] Tactic: 7340031 Time: 0.131104
[11/14/2022-14:13:37] [V] [TRT] Tactic: 7405567 Time: 0.165088
[11/14/2022-14:13:37] [V] [TRT] Tactic: 7536639 Time: 0.16432
[11/14/2022-14:13:37] [V] [TRT] Tactic: 7602175 Time: 0.135556
[11/14/2022-14:13:37] [V] [TRT] Tactic: 7733247 Time: 0.140188
[11/14/2022-14:13:38] [V] [TRT] Tactic: 7798783 Time: 0.118756
[11/14/2022-14:13:38] [V] [TRT] Tactic: 8191999 Time: 0.135076
[11/14/2022-14:13:38] [V] [TRT] Tactic: 8257535 Time: 0.10692
[11/14/2022-14:13:38] [V] [TRT] Tactic: 8323071 Time: 0.13024
[11/14/2022-14:13:38] [V] [TRT] Tactic: 8650751 Time: 0.132844
[11/14/2022-14:13:38] [V] [TRT] Tactic: 8716287 Time: 0.207596
[11/14/2022-14:13:38] [V] [TRT] Tactic: 9109503 Time: 0.126304
[11/14/2022-14:13:38] [V] [TRT] Tactic: 9568255 Time: 0.109356
[11/14/2022-14:13:38] [V] [TRT] Tactic: 9895935 Time: 0.104996
[11/14/2022-14:13:38] [V] [TRT] Tactic: 10223615 Time: 0.13828
[11/14/2022-14:13:38] [V] [TRT] Tactic: 10354687 Time: 0.113048
[11/14/2022-14:13:38] [V] [TRT] Tactic: 10551295 Time: 0.127508
[11/14/2022-14:13:38] [V] [TRT] Tactic: 10747903 Time: 0.146224
[11/14/2022-14:13:38] [V] [TRT] Tactic: 10944511 Time: 0.110728
[11/14/2022-14:13:38] [V] [TRT] Fastest Tactic: 9895935 Time: 0.104996
[11/14/2022-14:13:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CudaDepthwiseConvolution)
[11/14/2022-14:13:38] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CudnnConvolution)
[11/14/2022-14:13:38] [V] [TRT] Tactic: 0 Time: 0.437172
[11/14/2022-14:13:38] [V] [TRT] Tactic: 1 Time: 0.101076
[11/14/2022-14:13:38] [V] [TRT] Tactic: 2 Time: 0.280372
[11/14/2022-14:13:38] [V] [TRT] Tactic: 4 skipped. Scratch requested: 108146688, available: 16777216
[11/14/2022-14:13:38] [V] [TRT] Tactic: 5 Time: 0.48246
[11/14/2022-14:13:38] [V] [TRT] Fastest Tactic: 1 Time: 0.101076
[11/14/2022-14:13:38] [V] [TRT] Setting workspace to 108146688enables more tactics for profiling
[11/14/2022-14:13:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CublasConvolution)
[11/14/2022-14:13:38] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CaskConvolution)
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:13:38] [V] [TRT] Tactic: 1062367460111450758 Time: 0.090576
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:13:38] [V] [TRT] Tactic: 1698681053543049347 Time: 0.06638
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:13:38] [V] [TRT] Tactic: 4501471010995462441 Time: 0.13648
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:13:38] [V] [TRT] Tactic: 5137655947464784826 Time: 0.075612
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:13:38] [V] [TRT] Tactic: 5288347012147084929 Time: 0.137712
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:13:38] [V] [TRT] Tactic: 5326823351883942011 Time: 0.132756
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:13:38] [V] [TRT] Tactic: 5500448035057547314 Time: 0.086112
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:13:38] [V] [TRT] Tactic: 6645123197870846056 Time: 0.077576
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:13:38] [V] [TRT] Tactic: 7144526460361122478 Time: 0.085756
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:13:38] [V] [TRT] Tactic: -8262349710178828730 Time: 0.137196
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:13:38] [V] [TRT] Tactic: -6576203419454146580 Time: 0.059444
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:13:38] [V] [TRT] Tactic: -4787320710726427159 Time: 0.08332
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:13:38] [V] [TRT] Tactic: -3456450830548107839 Time: 0.063924
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:13:38] [V] [TRT] Tactic: -1218658103698133241 Time: 0.088976
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:13:38] [V] [TRT] Tactic: -836875257600482091 Time: 0.086408
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:13:38] [V] [TRT] Tactic: -410470605513481746 Time: 0.1501
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:13:38] [V] [TRT] Tactic: -377491875521947884 Time: 0.13594
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:13:38] [V] [TRT] Tactic: -37215280111360163 Time: 0.073716
[11/14/2022-14:13:38] [V] [TRT] Fastest Tactic: -6576203419454146580 Time: 0.059444
[11/14/2022-14:13:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580
[11/14/2022-14:13:38] [V] [TRT] *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(38400,1,960,24) ***************
[11/14/2022-14:13:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CudnnConvolution)
[11/14/2022-14:13:38] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CublasConvolution)
[11/14/2022-14:13:38] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CaskConvolution)
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:13:38] [V] [TRT] Tactic: 3886731678879822788 Time: 0.091712
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:13:38] [V] [TRT] Tactic: 6629944304117643200 Time: 0.085528
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:13:38] [V] [TRT] Tactic: -9153228964338181824 Time: 0.104408
[11/14/2022-14:13:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:13:38] [V] [TRT] Tactic: -7394439838318485025 Time: 0.081724
[11/14/2022-14:13:38] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.081724
[11/14/2022-14:13:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025
[11/14/2022-14:13:38] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:38] [V] [TRT] *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(38400,1600,40,1) ***************
[11/14/2022-14:13:38] [V] [TRT] *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(38400,1,960,24) ***************
[11/14/2022-14:13:38] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:38] [V] [TRT] *************** Autotuning format combination: Float(819200,6400,80,1) -> Float(819200,6400,80,1) ***************
[11/14/2022-14:13:38] [V] [TRT] *************** Autotuning format combination: Float(819200,1,10240,128) -> Float(819200,1,10240,128) ***************
[11/14/2022-14:13:38] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:38] [V] [TRT] *************** Autotuning format combination: Float(38400,1600,40,1) -> Float(38400,4,1) ***************
[11/14/2022-14:13:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__701 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 (Shuffle)
[11/14/2022-14:13:38] [V] [TRT] Tactic: 0 Time: 0.022876
[11/14/2022-14:13:38] [V] [TRT] Fastest Tactic: 0 Time: 0.022876
[11/14/2022-14:13:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:38] [V] [TRT] *************** Autotuning format combination: Float(38400,1,960,24) -> Float(1,4,1) ***************
[11/14/2022-14:13:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__701 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 (Shuffle)
[11/14/2022-14:13:39] [V] [TRT] Tactic: 0 Time: 0.025044
[11/14/2022-14:13:39] [V] [TRT] Fastest Tactic: 0 Time: 0.025044
[11/14/2022-14:13:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:39] [V] [TRT] *************** Autotuning format combination: Float(1600,1600:32,40,1) -> Float(38400:32,4,1) ***************
[11/14/2022-14:13:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__701 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 (Shuffle)
[11/14/2022-14:13:39] [V] [TRT] Tactic: 0 Time: 8.52219
[11/14/2022-14:13:39] [V] [TRT] Fastest Tactic: 0 Time: 8.52219
[11/14/2022-14:13:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:39] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:39] [V] [TRT] *************** Autotuning format combination: Float(38400,1600,40,1) -> Float(38400,4,1) ***************
[11/14/2022-14:13:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__710 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 (Shuffle)
[11/14/2022-14:13:39] [V] [TRT] Tactic: 0 Time: 0.021576
[11/14/2022-14:13:39] [V] [TRT] Fastest Tactic: 0 Time: 0.021576
[11/14/2022-14:13:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:39] [V] [TRT] *************** Autotuning format combination: Float(38400,1,960,24) -> Float(1,4,1) ***************
[11/14/2022-14:13:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__710 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 (Shuffle)
[11/14/2022-14:13:39] [V] [TRT] Tactic: 0 Time: 0.023076
[11/14/2022-14:13:39] [V] [TRT] Fastest Tactic: 0 Time: 0.023076
[11/14/2022-14:13:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:39] [V] [TRT] *************** Autotuning format combination: Float(1600,1600:32,40,1) -> Float(38400:32,4,1) ***************
[11/14/2022-14:13:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__710 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 (Shuffle)
[11/14/2022-14:13:39] [V] [TRT] Tactic: 0 Time: 6.89826
[11/14/2022-14:13:39] [V] [TRT] Fastest Tactic: 0 Time: 6.89826
[11/14/2022-14:13:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:39] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:39] [V] [TRT] *************** Autotuning format combination: Float(819200,6400,80,1) -> Float(819200,6400,80,1) ***************
[11/14/2022-14:13:39] [V] [TRT] *************** Autotuning format combination: Float(819200,1,10240,128) -> Float(819200,1,10240,128) ***************
[11/14/2022-14:13:39] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:39] [V] [TRT] *************** Autotuning format combination: Float(819200,6400,80,1) -> Float(819200,6400,80,1) ***************
[11/14/2022-14:13:39] [V] [TRT] *************** Autotuning format combination: Float(819200,1,10240,128) -> Float(819200,1,10240,128) ***************
[11/14/2022-14:13:39] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:39] [V] [TRT] *************** Autotuning format combination: Float(819200,6400,80,1) -> Float(819200,6400,80,1) ***************
[11/14/2022-14:13:39] [V] [TRT] *************** Autotuning format combination: Float(819200,1,10240,128) -> Float(819200,1,10240,128) ***************
[11/14/2022-14:13:39] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:39] [V] [TRT] *************** Autotuning format combination: Float(819200,6400,80,1) -> Float(819200,6400,80,1) ***************
[11/14/2022-14:13:39] [V] [TRT] *************** Autotuning format combination: Float(819200,1,10240,128) -> Float(819200,1,10240,128) ***************
[11/14/2022-14:13:39] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:39] [V] [TRT] *************** Autotuning format combination: Float(819200,6400,80,1) -> Float(819200,6400,80,1) ***************
[11/14/2022-14:13:39] [V] [TRT] *************** Autotuning format combination: Float(819200,1,10240,128) -> Float(819200,1,10240,128) ***************
[11/14/2022-14:13:39] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:39] [V] [TRT] *************** Autotuning format combination: Float(819200,6400,80,1) -> Float(819200,6400,80,1) ***************
[11/14/2022-14:13:39] [V] [TRT] *************** Autotuning format combination: Float(819200,1,10240,128) -> Float(819200,1,10240,128) ***************
[11/14/2022-14:13:39] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:39] [V] [TRT] *************** Autotuning format combination: Float(819200,6400,80,1) -> Float(153600,6400,80,1) ***************
[11/14/2022-14:13:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (FusedConvActConvolution)
[11/14/2022-14:13:39] [V] [TRT] Tactic: 589823 Time: 0.445904
[11/14/2022-14:13:39] [V] [TRT] Tactic: 655359 Time: 0.639248
[11/14/2022-14:13:39] [V] [TRT] Tactic: 786431 Time: 0.452992
[11/14/2022-14:13:39] [V] [TRT] Tactic: 851967 Time: 1.0426
[11/14/2022-14:13:39] [V] [TRT] Tactic: 1179647 Time: 0.555572
[11/14/2022-14:13:39] [V] [TRT] Tactic: 1310719 Time: 0.703428
[11/14/2022-14:13:39] [V] [TRT] Tactic: 1376255 Time: 0.482152
[11/14/2022-14:13:39] [V] [TRT] Tactic: 1441791 Time: 0.697096
[11/14/2022-14:13:39] [V] [TRT] Tactic: 1507327 Time: 1.01176
[11/14/2022-14:13:40] [V] [TRT] Tactic: 1638399 Time: 0.476712
[11/14/2022-14:13:40] [V] [TRT] Tactic: 1835007 Time: 0.498332
[11/14/2022-14:13:40] [V] [TRT] Tactic: 1900543 Time: 0.977996
[11/14/2022-14:13:40] [V] [TRT] Tactic: 2097151 Time: 0.497304
[11/14/2022-14:13:40] [V] [TRT] Tactic: 2162687 Time: 0.514772
[11/14/2022-14:13:40] [V] [TRT] Tactic: 2293759 Time: 0.442896
[11/14/2022-14:13:40] [V] [TRT] Tactic: 2359295 Time: 0.48148
[11/14/2022-14:13:40] [V] [TRT] Tactic: 2686975 Time: 0.446036
[11/14/2022-14:13:40] [V] [TRT] Tactic: 3080191 Time: 0.921816
[11/14/2022-14:13:40] [V] [TRT] Tactic: 3342335 Time: 0.968236
[11/14/2022-14:13:40] [V] [TRT] Tactic: 3407871 Time: 0.451856
[11/14/2022-14:13:40] [V] [TRT] Tactic: 3538943 Time: 0.442728
[11/14/2022-14:13:40] [V] [TRT] Tactic: 3670015 Time: 0.61964
[11/14/2022-14:13:40] [V] [TRT] Tactic: 3932159 Time: 0.88008
[11/14/2022-14:13:40] [V] [TRT] Tactic: 3997695 Time: 0.43542
[11/14/2022-14:13:40] [V] [TRT] Tactic: 4063231 Time: 1.05032
[11/14/2022-14:13:40] [V] [TRT] Tactic: 4194303 Time: 0.410596
[11/14/2022-14:13:40] [V] [TRT] Tactic: 4259839 Time: 0.443
[11/14/2022-14:13:40] [V] [TRT] Tactic: 4325375 Time: 0.399948
[11/14/2022-14:13:40] [V] [TRT] Tactic: 4521983 Time: 0.424524
[11/14/2022-14:13:41] [V] [TRT] Tactic: 4587519 Time: 0.408864
[11/14/2022-14:13:41] [V] [TRT] Tactic: 4653055 Time: 0.610508
[11/14/2022-14:13:41] [V] [TRT] Tactic: 4915199 Time: 0.410588
[11/14/2022-14:13:41] [V] [TRT] Tactic: 4980735 Time: 0.41772
[11/14/2022-14:13:41] [V] [TRT] Tactic: 5177343 Time: 0.58606
[11/14/2022-14:13:41] [V] [TRT] Tactic: 5242879 Time: 0.5251
[11/14/2022-14:13:41] [V] [TRT] Tactic: 5373951 Time: 0.840916
[11/14/2022-14:13:41] [V] [TRT] Tactic: 5439487 Time: 0.86348
[11/14/2022-14:13:41] [V] [TRT] Tactic: 5570559 Time: 0.744212
[11/14/2022-14:13:41] [V] [TRT] Tactic: 5636095 Time: 1.05697
[11/14/2022-14:13:41] [V] [TRT] Tactic: 5701631 Time: 0.539336
[11/14/2022-14:13:41] [V] [TRT] Tactic: 5767167 Time: 1.88358
[11/14/2022-14:13:41] [V] [TRT] Tactic: 5832703 Time: 0.446924
[11/14/2022-14:13:41] [V] [TRT] Tactic: 5898239 Time: 0.486608
[11/14/2022-14:13:41] [V] [TRT] Tactic: 6029311 Time: 0.510724
[11/14/2022-14:13:41] [V] [TRT] Tactic: 6225919 Time: 0.508904
[11/14/2022-14:13:41] [V] [TRT] Tactic: 6291455 Time: 0.564516
[11/14/2022-14:13:42] [V] [TRT] Tactic: 6422527 Time: 0.90422
[11/14/2022-14:13:42] [V] [TRT] Tactic: 6750207 Time: 0.49774
[11/14/2022-14:13:42] [V] [TRT] Tactic: 6815743 Time: 0.83858
[11/14/2022-14:13:42] [V] [TRT] Tactic: 6946815 Time: 0.755464
[11/14/2022-14:13:42] [V] [TRT] Tactic: 7012351 Time: 0.497412
[11/14/2022-14:13:42] [V] [TRT] Tactic: 7077887 Time: 0.452564
[11/14/2022-14:13:42] [V] [TRT] Tactic: 7143423 Time: 0.657852
[11/14/2022-14:13:42] [V] [TRT] Tactic: 7208959 Time: 0.5317
[11/14/2022-14:13:42] [V] [TRT] Tactic: 7340031 Time: 0.4806
[11/14/2022-14:13:42] [V] [TRT] Tactic: 7405567 Time: 0.595556
[11/14/2022-14:13:42] [V] [TRT] Tactic: 7536639 Time: 0.676876
[11/14/2022-14:13:42] [V] [TRT] Tactic: 7602175 Time: 0.43882
[11/14/2022-14:13:42] [V] [TRT] Tactic: 7733247 Time: 0.552464
[11/14/2022-14:13:42] [V] [TRT] Tactic: 7798783 Time: 0.443676
[11/14/2022-14:13:42] [V] [TRT] Tactic: 8191999 Time: 0.576792
[11/14/2022-14:13:42] [V] [TRT] Tactic: 8257535 Time: 0.427584
[11/14/2022-14:13:42] [V] [TRT] Tactic: 8323071 Time: 0.508592
[11/14/2022-14:13:42] [V] [TRT] Tactic: 8650751 Time: 0.523056
[11/14/2022-14:13:42] [V] [TRT] Tactic: 8716287 Time: 0.81266
[11/14/2022-14:13:42] [V] [TRT] Tactic: 9109503 Time: 0.500172
[11/14/2022-14:13:42] [V] [TRT] Tactic: 9568255 Time: 0.411116
[11/14/2022-14:13:43] [V] [TRT] Tactic: 9895935 Time: 0.40478
[11/14/2022-14:13:43] [V] [TRT] Tactic: 10223615 Time: 0.437448
[11/14/2022-14:13:43] [V] [TRT] Tactic: 10354687 Time: 0.4207
[11/14/2022-14:13:43] [V] [TRT] Tactic: 10551295 Time: 0.447464
[11/14/2022-14:13:43] [V] [TRT] Tactic: 10747903 Time: 0.527604
[11/14/2022-14:13:43] [V] [TRT] Tactic: 10944511 Time: 0.402784
[11/14/2022-14:13:43] [V] [TRT] Fastest Tactic: 4325375 Time: 0.399948
[11/14/2022-14:13:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CudaDepthwiseConvolution)
[11/14/2022-14:13:43] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CudnnConvolution)
[11/14/2022-14:13:43] [V] [TRT] Tactic: 0 Time: 0.318564
[11/14/2022-14:13:43] [V] [TRT] Tactic: 1 Time: 0.345776
[11/14/2022-14:13:43] [V] [TRT] Tactic: 2 Time: 1.03611
[11/14/2022-14:13:43] [V] [TRT] Tactic: 4 skipped. Scratch requested: 425996288, available: 16777216
[11/14/2022-14:13:43] [V] [TRT] Tactic: 5 Time: 1.68753
[11/14/2022-14:13:43] [V] [TRT] Fastest Tactic: 0 Time: 0.318564
[11/14/2022-14:13:43] [V] [TRT] Setting workspace to 425996288enables more tactics for profiling
[11/14/2022-14:13:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CublasConvolution)
[11/14/2022-14:13:43] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CaskConvolution)
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:13:43] [V] [TRT] Tactic: 1062367460111450758 Time: 0.188548
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:13:43] [V] [TRT] Tactic: 1698681053543049347 Time: 0.203652
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441
[11/14/2022-14:13:43] [V] [TRT] Tactic: 4501471010995462441 Time: 0.474644
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:13:43] [V] [TRT] Tactic: 5137655947464784826 Time: 0.25432
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929
[11/14/2022-14:13:43] [V] [TRT] Tactic: 5288347012147084929 Time: 0.493208
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:13:43] [V] [TRT] Tactic: 5326823351883942011 Time: 0.460812
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314
[11/14/2022-14:13:43] [V] [TRT] Tactic: 5500448035057547314 Time: 0.3111
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:13:43] [V] [TRT] Tactic: 6645123197870846056 Time: 0.25728
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478
[11/14/2022-14:13:43] [V] [TRT] Tactic: 7144526460361122478 Time: 0.224192
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730
[11/14/2022-14:13:43] [V] [TRT] Tactic: -8262349710178828730 Time: 0.48564
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:13:43] [V] [TRT] Tactic: -6576203419454146580 Time: 0.17712
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159
[11/14/2022-14:13:43] [V] [TRT] Tactic: -4787320710726427159 Time: 0.220456
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:13:43] [V] [TRT] Tactic: -3456450830548107839 Time: 0.18368
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241
[11/14/2022-14:13:43] [V] [TRT] Tactic: -1218658103698133241 Time: 0.319972
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091
[11/14/2022-14:13:43] [V] [TRT] Tactic: -836875257600482091 Time: 0.340476
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:13:43] [V] [TRT] Tactic: -410470605513481746 Time: 0.470676
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884
[11/14/2022-14:13:43] [V] [TRT] Tactic: -377491875521947884 Time: 0.47622
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:13:43] [V] [TRT] Tactic: -37215280111360163 Time: 0.258996
[11/14/2022-14:13:43] [V] [TRT] Fastest Tactic: -6576203419454146580 Time: 0.17712
[11/14/2022-14:13:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580
[11/14/2022-14:13:43] [V] [TRT] *************** Autotuning format combination: Float(819200,1,10240,128) -> Float(153600,1,1920,24) ***************
[11/14/2022-14:13:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CudnnConvolution)
[11/14/2022-14:13:43] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CublasConvolution)
[11/14/2022-14:13:43] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/14/2022-14:13:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CaskConvolution)
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788
[11/14/2022-14:13:43] [V] [TRT] Tactic: 3886731678879822788 Time: 0.285964
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200
[11/14/2022-14:13:43] [V] [TRT] Tactic: 6629944304117643200 Time: 0.32178
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824
[11/14/2022-14:13:43] [V] [TRT] Tactic: -9153228964338181824 Time: 0.315452
[11/14/2022-14:13:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025
[11/14/2022-14:13:43] [V] [TRT] Tactic: -7394439838318485025 Time: 0.290764
[11/14/2022-14:13:43] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.285964
[11/14/2022-14:13:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788
[11/14/2022-14:13:43] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:43] [V] [TRT] *************** Autotuning format combination: Float(819200,6400,80,1) -> Float(153600,6400,80,1) ***************
[11/14/2022-14:13:43] [V] [TRT] *************** Autotuning format combination: Float(819200,1,10240,128) -> Float(153600,1,1920,24) ***************
[11/14/2022-14:13:43] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:43] [V] [TRT] *************** Autotuning format combination: Float(153600,6400,80,1) -> Float(153600,4,1) ***************
[11/14/2022-14:13:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__755 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 (Shuffle)
[11/14/2022-14:13:43] [V] [TRT] Tactic: 0 Time: 0.144056
[11/14/2022-14:13:43] [V] [TRT] Fastest Tactic: 0 Time: 0.144056
[11/14/2022-14:13:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:43] [V] [TRT] *************** Autotuning format combination: Float(153600,1,1920,24) -> Float(1,4,1) ***************
[11/14/2022-14:13:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__755 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 (Shuffle)
[11/14/2022-14:13:44] [V] [TRT] Tactic: 0 Time: 0.083396
[11/14/2022-14:13:44] [V] [TRT] Fastest Tactic: 0 Time: 0.083396
[11/14/2022-14:13:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:44] [V] [TRT] *************** Autotuning format combination: Float(6400,6400:32,80,1) -> Float(153600:32,4,1) ***************
[11/14/2022-14:13:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__755 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 (Shuffle)
[11/14/2022-14:13:44] [V] [TRT] Tactic: 0 Time: 32.0358
[11/14/2022-14:13:44] [V] [TRT] Fastest Tactic: 0 Time: 32.0358
[11/14/2022-14:13:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:44] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:44] [V] [TRT] *************** Autotuning format combination: Float(153600,6400,80,1) -> Float(153600,4,1) ***************
[11/14/2022-14:13:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__764 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape (Shuffle)
[11/14/2022-14:13:44] [V] [TRT] Tactic: 0 Time: 0.081452
[11/14/2022-14:13:44] [V] [TRT] Fastest Tactic: 0 Time: 0.081452
[11/14/2022-14:13:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:44] [V] [TRT] *************** Autotuning format combination: Float(153600,1,1920,24) -> Float(1,4,1) ***************
[11/14/2022-14:13:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__764 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape (Shuffle)
[11/14/2022-14:13:44] [V] [TRT] Tactic: 0 Time: 0.08484
[11/14/2022-14:13:44] [V] [TRT] Fastest Tactic: 0 Time: 0.08484
[11/14/2022-14:13:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:44] [V] [TRT] *************** Autotuning format combination: Float(6400,6400:32,80,1) -> Float(153600:32,4,1) ***************
[11/14/2022-14:13:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__764 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape (Shuffle)
[11/14/2022-14:13:45] [V] [TRT] Tactic: 0 Time: 31.8447
[11/14/2022-14:13:45] [V] [TRT] Fastest Tactic: 0 Time: 31.8447
[11/14/2022-14:13:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:45] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:45] [V] [TRT] *************** Autotuning format combination: Float(204600,4,1) -> Float(51150,1) ***************
[11/14/2022-14:13:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Reshape_1 + StatefulPartitionedCall/Postprocessor/Decode/transpose (Shuffle)
[11/14/2022-14:13:45] [V] [TRT] Tactic: 0 Time: 0.103416
[11/14/2022-14:13:45] [V] [TRT] Fastest Tactic: 0 Time: 0.103416
[11/14/2022-14:13:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:45] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:45] [V] [TRT] *************** Autotuning format combination: Float(153450,3,1) -> Float(153450,3,1) ***************
[11/14/2022-14:13:45] [V] [TRT] --------------- Timing Runner: PWN(nms/class_net_sigmoid) (PointWiseV2)
[11/14/2022-14:13:46] [V] [TRT] Tactic: 0 Time: 0.059292
[11/14/2022-14:13:46] [V] [TRT] Tactic: 1 Time: 0.047164
[11/14/2022-14:13:47] [V] [TRT] Tactic: 2 Time: 0.046924
[11/14/2022-14:13:48] [V] [TRT] Tactic: 3 Time: 0.050076
[11/14/2022-14:13:49] [V] [TRT] Tactic: 4 Time: 0.057244
[11/14/2022-14:13:50] [V] [TRT] Tactic: 5 Time: 0.071028
[11/14/2022-14:13:51] [V] [TRT] Tactic: 6 Time: 0.084884
[11/14/2022-14:13:51] [V] [TRT] Tactic: 7 Time: 0.090792
[11/14/2022-14:13:52] [V] [TRT] Tactic: 8 Time: 0.08606
[11/14/2022-14:13:53] [V] [TRT] Tactic: 9 Time: 0.09434
[11/14/2022-14:13:54] [V] [TRT] Tactic: 28 Time: 0.216528
[11/14/2022-14:13:54] [V] [TRT] Fastest Tactic: 2 Time: 0.046924
[11/14/2022-14:13:54] [V] [TRT] --------------- Timing Runner: PWN(nms/class_net_sigmoid) (PointWise)
[11/14/2022-14:13:54] [V] [TRT] Tactic: 128 Time: 0.343896
[11/14/2022-14:13:54] [V] [TRT] Tactic: 256 Time: 0.344156
[11/14/2022-14:13:54] [V] [TRT] Tactic: 512 Time: 0.264668
[11/14/2022-14:13:54] [V] [TRT] Tactic: -32 Time: 0.28888
[11/14/2022-14:13:54] [V] [TRT] Tactic: -64 Time: 0.269964
[11/14/2022-14:13:54] [V] [TRT] Tactic: -128 Time: 0.263216
[11/14/2022-14:13:54] [V] [TRT] Fastest Tactic: -128 Time: 0.263216
[11/14/2022-14:13:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2
[11/14/2022-14:13:54] [V] [TRT] *************** Autotuning format combination: Float(1,3,1) -> Float(1,3,1) ***************
[11/14/2022-14:13:54] [V] [TRT] --------------- Timing Runner: PWN(nms/class_net_sigmoid) (PointWiseV2)
[11/14/2022-14:13:54] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping
[11/14/2022-14:13:54] [V] [TRT] --------------- Timing Runner: PWN(nms/class_net_sigmoid) (PointWise)
[11/14/2022-14:13:54] [V] [TRT] Tactic: 128 Time: 0.276416
[11/14/2022-14:13:54] [V] [TRT] Tactic: 256 Time: 0.273056
[11/14/2022-14:13:54] [V] [TRT] Tactic: 512 Time: 0.28012
[11/14/2022-14:13:54] [V] [TRT] Tactic: -32 Time: 0.239264
[11/14/2022-14:13:54] [V] [TRT] Tactic: -64 Time: 0.225336
[11/14/2022-14:13:54] [V] [TRT] Tactic: -128 Time: 0.221848
[11/14/2022-14:13:54] [V] [TRT] Fastest Tactic: -128 Time: 0.221848
[11/14/2022-14:13:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: -128
[11/14/2022-14:13:54] [V] [TRT] *************** Autotuning format combination: Float(153450:32,3,1) -> Float(153450:32,3,1) ***************
[11/14/2022-14:13:54] [V] [TRT] --------------- Timing Runner: PWN(nms/class_net_sigmoid) (PointWiseV2)
[11/14/2022-14:13:55] [V] [TRT] Tactic: 24 Time: 2.2016
[11/14/2022-14:13:56] [V] [TRT] Tactic: 25 Time: 1.6127
[11/14/2022-14:13:56] [V] [TRT] Tactic: 26 Time: 1.61056
[11/14/2022-14:13:57] [V] [TRT] Tactic: 27 Time: 1.58853
[11/14/2022-14:13:58] [V] [TRT] Tactic: 31 Time: 1.83984
[11/14/2022-14:13:58] [V] [TRT] Fastest Tactic: 27 Time: 1.58853
[11/14/2022-14:13:58] [V] [TRT] --------------- Timing Runner: PWN(nms/class_net_sigmoid) (PointWise)
[11/14/2022-14:13:58] [V] [TRT] Tactic: 128 Time: 4.3464
[11/14/2022-14:13:58] [V] [TRT] Tactic: 256 Time: 4.11056
[11/14/2022-14:13:58] [V] [TRT] Tactic: 512 Time: 4.15554
[11/14/2022-14:13:58] [V] [TRT] Tactic: -32 Time: 3.18995
[11/14/2022-14:13:58] [V] [TRT] Tactic: -64 Time: 2.98134
[11/14/2022-14:13:59] [V] [TRT] Tactic: -128 Time: 2.92075
[11/14/2022-14:13:59] [V] [TRT] Fastest Tactic: -128 Time: 2.92075
[11/14/2022-14:13:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27
[11/14/2022-14:13:59] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:59] [V] [TRT] *************** Autotuning format combination: Float(51150,1) -> Float(1) ***************
[11/14/2022-14:13:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack__772 (Shuffle)
[11/14/2022-14:13:59] [V] [TRT] Tactic: 0 Time: 0.007496
[11/14/2022-14:13:59] [V] [TRT] Fastest Tactic: 0 Time: 0.007496
[11/14/2022-14:13:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:59] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:59] [V] [TRT] *************** Autotuning format combination: Float(51150,1) -> Float(1) ***************
[11/14/2022-14:13:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack__771 (Shuffle)
[11/14/2022-14:13:59] [V] [TRT] Tactic: 0 Time: 0.007284
[11/14/2022-14:13:59] [V] [TRT] Fastest Tactic: 0 Time: 0.007284
[11/14/2022-14:13:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:59] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:59] [V] [TRT] *************** Autotuning format combination: Float(51150,1) -> Float(1) ***************
[11/14/2022-14:13:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack__770 (Shuffle)
[11/14/2022-14:13:59] [V] [TRT] Tactic: 0 Time: 0.01492
[11/14/2022-14:13:59] [V] [TRT] Fastest Tactic: 0 Time: 0.01492
[11/14/2022-14:13:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:59] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:59] [V] [TRT] *************** Autotuning format combination: Float(51150,1) -> Float(1) ***************
[11/14/2022-14:13:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack__769 (Shuffle)
[11/14/2022-14:13:59] [V] [TRT] Tactic: 0 Time: 0.007236
[11/14/2022-14:13:59] [V] [TRT] Fastest Tactic: 0 Time: 0.007236
[11/14/2022-14:13:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:13:59] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:59] [V] [TRT] *************** Autotuning format combination:  -> Float(1) ***************
[11/14/2022-14:13:59] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:59] [V] [TRT] *************** Autotuning format combination:  -> Float(1) ***************
[11/14/2022-14:13:59] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:59] [V] [TRT] *************** Autotuning format combination:  -> Float(1) ***************
[11/14/2022-14:13:59] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:13:59] [V] [TRT] *************** Autotuning format combination: Float(1), Float(1), Float(1) -> Float(1) ***************
[11/14/2022-14:13:59] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_recip:0 + (Unnamed Layer* 279) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_1), StatefulPartitionedCall/Postprocessor/Decode/mul_3), StatefulPartitionedCall/Postprocessor/Decode/add_1) (PointWiseV2)
[11/14/2022-14:13:59] [V] [TRT] Tactic: 0 Time: 0.02408
[11/14/2022-14:14:00] [V] [TRT] Tactic: 1 Time: 0.0237
[11/14/2022-14:14:01] [V] [TRT] Tactic: 2 Time: 0.023168
[11/14/2022-14:14:02] [V] [TRT] Tactic: 3 Time: 0.025144
[11/14/2022-14:14:02] [V] [TRT] Tactic: 4 Time: 0.028868
[11/14/2022-14:14:03] [V] [TRT] Tactic: 5 Time: 0.033
[11/14/2022-14:14:04] [V] [TRT] Tactic: 6 Time: 0.03906
[11/14/2022-14:14:05] [V] [TRT] Tactic: 7 Time: 0.037884
[11/14/2022-14:14:06] [V] [TRT] Tactic: 8 Time: 0.03564
[11/14/2022-14:14:07] [V] [TRT] Tactic: 9 Time: 0.048004
[11/14/2022-14:14:07] [V] [TRT] Tactic: 28 Time: 0.057092
[11/14/2022-14:14:07] [V] [TRT] Fastest Tactic: 2 Time: 0.023168
[11/14/2022-14:14:07] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_recip:0 + (Unnamed Layer* 279) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_1), StatefulPartitionedCall/Postprocessor/Decode/mul_3), StatefulPartitionedCall/Postprocessor/Decode/add_1) (PointWise)
[11/14/2022-14:14:07] [V] [TRT] Tactic: 128 Time: 0.151524
[11/14/2022-14:14:07] [V] [TRT] Tactic: 256 Time: 0.152356
[11/14/2022-14:14:07] [V] [TRT] Tactic: 512 Time: 0.152928
[11/14/2022-14:14:07] [V] [TRT] Tactic: -32 Time: 0.19022
[11/14/2022-14:14:07] [V] [TRT] Tactic: -64 Time: 0.202948
[11/14/2022-14:14:07] [V] [TRT] Tactic: -128 Time: 0.171224
[11/14/2022-14:14:07] [V] [TRT] Fastest Tactic: 128 Time: 0.151524
[11/14/2022-14:14:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2
[11/14/2022-14:14:07] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:14:07] [V] [TRT] *************** Autotuning format combination:  -> Float(1) ***************
[11/14/2022-14:14:07] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:14:07] [V] [TRT] *************** Autotuning format combination: Float(1), Float(1), Float(1) -> Float(1) ***************
[11/14/2022-14:14:07] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:14:07] [V] [TRT] *************** Autotuning format combination:  -> Float(1) ***************
[11/14/2022-14:14:07] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:14:07] [V] [TRT] *************** Autotuning format combination:  -> Float(1) ***************
[11/14/2022-14:14:07] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:14:07] [V] [TRT] *************** Autotuning format combination: Float(1), Float(1) -> Float(1) ***************
[11/14/2022-14:14:07] [V] [TRT] --------------- Timing Runner: PWN(ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_4_recip:0 + (Unnamed Layer* 305) [Shuffle], PWN(PWN(PWN(PWN(ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_3_recip:0 + (Unnamed Layer* 285) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_3), StatefulPartitionedCall/Postprocessor/Decode/Exp), StatefulPartitionedCall/Postprocessor/Decode/mul), StatefulPartitionedCall/Postprocessor/Decode/truediv_5)) (PointWiseV2)
[11/14/2022-14:14:08] [V] [TRT] Tactic: 0 Time: 0.046172
[11/14/2022-14:14:09] [V] [TRT] Tactic: 1 Time: 0.03558
[11/14/2022-14:14:10] [V] [TRT] Tactic: 2 Time: 0.033652
[11/14/2022-14:14:10] [V] [TRT] Tactic: 3 Time: 0.030216
[11/14/2022-14:14:11] [V] [TRT] Tactic: 4 Time: 0.031884
[11/14/2022-14:14:12] [V] [TRT] Tactic: 5 Time: 0.031124
[11/14/2022-14:14:13] [V] [TRT] Tactic: 6 Time: 0.033068
[11/14/2022-14:14:14] [V] [TRT] Tactic: 7 Time: 0.036968
[11/14/2022-14:14:14] [V] [TRT] Tactic: 8 Time: 0.036492
[11/14/2022-14:14:15] [V] [TRT] Tactic: 9 Time: 0.037388
[11/14/2022-14:14:16] [V] [TRT] Tactic: 28 Time: 0.072912
[11/14/2022-14:14:16] [V] [TRT] Fastest Tactic: 3 Time: 0.030216
[11/14/2022-14:14:16] [V] [TRT] --------------- Timing Runner: PWN(ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_4_recip:0 + (Unnamed Layer* 305) [Shuffle], PWN(PWN(PWN(PWN(ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_3_recip:0 + (Unnamed Layer* 285) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_3), StatefulPartitionedCall/Postprocessor/Decode/Exp), StatefulPartitionedCall/Postprocessor/Decode/mul), StatefulPartitionedCall/Postprocessor/Decode/truediv_5)) (PointWise)
[11/14/2022-14:14:16] [V] [TRT] Tactic: 128 Time: 0.238324
[11/14/2022-14:14:16] [V] [TRT] Tactic: 256 Time: 0.239832
[11/14/2022-14:14:16] [V] [TRT] Tactic: 512 Time: 0.180432
[11/14/2022-14:14:16] [V] [TRT] Tactic: -32 Time: 0.22418
[11/14/2022-14:14:16] [V] [TRT] Tactic: -64 Time: 0.2345
[11/14/2022-14:14:16] [V] [TRT] Tactic: -128 Time: 0.201884
[11/14/2022-14:14:16] [V] [TRT] Fastest Tactic: 512 Time: 0.180432
[11/14/2022-14:14:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3
[11/14/2022-14:14:16] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:14:16] [V] [TRT] *************** Autotuning format combination: Float(1), Float(1) -> Float(1) ***************
[11/14/2022-14:14:16] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:14:16] [V] [TRT] *************** Autotuning format combination: Float(1), Float(1) -> Float(1) ***************
[11/14/2022-14:14:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/sub_1 (ElementWise)
[11/14/2022-14:14:16] [V] [TRT] Tactic: 1 Time: 0.033444
[11/14/2022-14:14:16] [V] [TRT] Fastest Tactic: 1 Time: 0.033444
[11/14/2022-14:14:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1
[11/14/2022-14:14:16] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:14:16] [V] [TRT] *************** Autotuning format combination: Float(1), Float(1) -> Float(1) ***************
[11/14/2022-14:14:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/add_3 (ElementWise)
[11/14/2022-14:14:16] [V] [TRT] Tactic: 1 Time: 0.03298
[11/14/2022-14:14:16] [V] [TRT] Fastest Tactic: 1 Time: 0.03298
[11/14/2022-14:14:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1
[11/14/2022-14:14:16] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:14:16] [V] [TRT] *************** Autotuning format combination: Float(1), Float(1) -> Float(1) ***************
[11/14/2022-14:14:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/sub (ElementWise)
[11/14/2022-14:14:16] [V] [TRT] Tactic: 1 Time: 0.032748
[11/14/2022-14:14:16] [V] [TRT] Fastest Tactic: 1 Time: 0.032748
[11/14/2022-14:14:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1
[11/14/2022-14:14:16] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:14:16] [V] [TRT] *************** Autotuning format combination: Float(1), Float(1) -> Float(1) ***************
[11/14/2022-14:14:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/add_2 (ElementWise)
[11/14/2022-14:14:16] [V] [TRT] Tactic: 1 Time: 0.03404
[11/14/2022-14:14:16] [V] [TRT] Fastest Tactic: 1 Time: 0.03404
[11/14/2022-14:14:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1
[11/14/2022-14:14:16] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:14:16] [V] [TRT] *************** Autotuning format combination: Float(1) -> Float(51150,1) ***************
[11/14/2022-14:14:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__852 (Shuffle)
[11/14/2022-14:14:16] [V] [TRT] Tactic: 0 Time: 0.028464
[11/14/2022-14:14:16] [V] [TRT] Fastest Tactic: 0 Time: 0.028464
[11/14/2022-14:14:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:14:16] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:14:16] [V] [TRT] *************** Autotuning format combination: Float(1) -> Float(51150,1) ***************
[11/14/2022-14:14:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__854 (Shuffle)
[11/14/2022-14:14:16] [V] [TRT] Tactic: 0 Time: 0.02096
[11/14/2022-14:14:16] [V] [TRT] Fastest Tactic: 0 Time: 0.02096
[11/14/2022-14:14:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:14:16] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:14:16] [V] [TRT] *************** Autotuning format combination: Float(1) -> Float(51150,1) ***************
[11/14/2022-14:14:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__851 (Shuffle)
[11/14/2022-14:14:16] [V] [TRT] Tactic: 0 Time: 0.016992
[11/14/2022-14:14:16] [V] [TRT] Fastest Tactic: 0 Time: 0.016992
[11/14/2022-14:14:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:14:16] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:14:16] [V] [TRT] *************** Autotuning format combination: Float(1) -> Float(51150,1) ***************
[11/14/2022-14:14:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__853 (Shuffle)
[11/14/2022-14:14:16] [V] [TRT] Tactic: 0 Time: 0.02374
[11/14/2022-14:14:16] [V] [TRT] Fastest Tactic: 0 Time: 0.02374
[11/14/2022-14:14:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:14:16] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:14:16] [V] [TRT] *************** Autotuning format combination: Float(51150,1) -> Float(204600,4,4,1) ***************
[11/14/2022-14:14:16] [V] [TRT] --------------- Timing Runner: nms/box_decoder_transpose + nms/box_decoder_reshape (Shuffle)
[11/14/2022-14:14:16] [V] [TRT] Tactic: 0 Time: 0.256208
[11/14/2022-14:14:16] [V] [TRT] Fastest Tactic: 0 Time: 0.256208
[11/14/2022-14:14:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[11/14/2022-14:14:16] [V] [TRT] =============== Computing costs for 
[11/14/2022-14:14:16] [V] [TRT] *************** Autotuning format combination: Float(204600,4,4,1), Float(153450,3,1) -> Int32(1), Float(400,4,1), Float(100,1), Float(100,1) ***************
[11/14/2022-14:14:16] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to PWN(nms/class_net_sigmoid) (StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer:0_0) from Float(1,3,1) to Float(153450,3,1)
[11/14/2022-14:14:16] [V] [TRT] Formats and tactics selection completed in 389.909 seconds.
[11/14/2022-14:14:16] [V] [TRT] After reformat layers: 191 layers
[11/14/2022-14:14:16] [V] [TRT] Pre-optimized block assignment.
[11/14/2022-14:14:16] [V] [TRT] Block size 4915200
[11/14/2022-14:14:16] [V] [TRT] Block size 4915200
[11/14/2022-14:14:16] [V] [TRT] Block size 4915200
[11/14/2022-14:14:16] [V] [TRT] Block size 13107200
[11/14/2022-14:14:16] [V] [TRT] Block size 13107200
[11/14/2022-14:14:16] [V] [TRT] Block size 6553600
[11/14/2022-14:14:16] [V] [TRT] Block size 39321600
[11/14/2022-14:14:16] [V] [TRT] Block size 9830400
[11/14/2022-14:14:16] [V] [TRT] Block size 2457600
[11/14/2022-14:14:16] [V] [TRT] Block size 14745600
[11/14/2022-14:14:16] [V] [TRT] Block size 14745600
[11/14/2022-14:14:16] [V] [TRT] Block size 2457600
[11/14/2022-14:14:16] [V] [TRT] Block size 14745600
[11/14/2022-14:14:16] [V] [TRT] Block size 3686400
[11/14/2022-14:14:16] [V] [TRT] Block size 819200
[11/14/2022-14:14:16] [V] [TRT] Block size 4915200
[11/14/2022-14:14:16] [V] [TRT] Block size 4915200
[11/14/2022-14:14:16] [V] [TRT] Block size 819200
[11/14/2022-14:14:16] [V] [TRT] Block size 4915200
[11/14/2022-14:14:16] [V] [TRT] Block size 4915200
[11/14/2022-14:14:16] [V] [TRT] Block size 819200
[11/14/2022-14:14:16] [V] [TRT] Block size 4915200
[11/14/2022-14:14:16] [V] [TRT] Block size 1228800
[11/14/2022-14:14:16] [V] [TRT] Block size 409600
[11/14/2022-14:14:16] [V] [TRT] Block size 2457600
[11/14/2022-14:14:16] [V] [TRT] Block size 2457600
[11/14/2022-14:14:16] [V] [TRT] Block size 409600
[11/14/2022-14:14:16] [V] [TRT] Block size 2457600
[11/14/2022-14:14:16] [V] [TRT] Block size 2457600
[11/14/2022-14:14:16] [V] [TRT] Block size 409600
[11/14/2022-14:14:16] [V] [TRT] Block size 2457600
[11/14/2022-14:14:16] [V] [TRT] Block size 2457600
[11/14/2022-14:14:16] [V] [TRT] Block size 409600
[11/14/2022-14:14:16] [V] [TRT] Block size 2457600
[11/14/2022-14:14:16] [V] [TRT] Block size 2457600
[11/14/2022-14:14:16] [V] [TRT] Block size 614400
[11/14/2022-14:14:16] [V] [TRT] Block size 3686400
[11/14/2022-14:14:16] [V] [TRT] Block size 3686400
[11/14/2022-14:14:16] [V] [TRT] Block size 614400
[11/14/2022-14:14:16] [V] [TRT] Block size 3686400
[11/14/2022-14:14:16] [V] [TRT] Block size 3686400
[11/14/2022-14:14:16] [V] [TRT] Block size 614400
[11/14/2022-14:14:16] [V] [TRT] Block size 3686400
[11/14/2022-14:14:16] [V] [TRT] Block size 921600
[11/14/2022-14:14:16] [V] [TRT] Block size 256000
[11/14/2022-14:14:16] [V] [TRT] Block size 1536000
[11/14/2022-14:14:16] [V] [TRT] Block size 1536000
[11/14/2022-14:14:16] [V] [TRT] Block size 256000
[11/14/2022-14:14:16] [V] [TRT] Block size 1536000
[11/14/2022-14:14:16] [V] [TRT] Block size 1536000
[11/14/2022-14:14:16] [V] [TRT] Block size 256000
[11/14/2022-14:14:16] [V] [TRT] Block size 1536000
[11/14/2022-14:14:16] [V] [TRT] Block size 1536000
[11/14/2022-14:14:16] [V] [TRT] Block size 512000
[11/14/2022-14:14:16] [V] [TRT] Block size 2048000
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 51200
[11/14/2022-14:14:16] [V] [TRT] Block size 1
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 409600
[11/14/2022-14:14:16] [V] [TRT] Block size 1
[11/14/2022-14:14:16] [V] [TRT] Block size 51200
[11/14/2022-14:14:16] [V] [TRT] Block size 819200
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 12800
[11/14/2022-14:14:16] [V] [TRT] Block size 51200
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 819200
[11/14/2022-14:14:16] [V] [TRT] Block size 12800
[11/14/2022-14:14:16] [V] [TRT] Block size 51200
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 819200
[11/14/2022-14:14:16] [V] [TRT] Block size 12800
[11/14/2022-14:14:16] [V] [TRT] Block size 51200
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 819200
[11/14/2022-14:14:16] [V] [TRT] Block size 12800
[11/14/2022-14:14:16] [V] [TRT] Block size 51200
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 819200
[11/14/2022-14:14:16] [V] [TRT] Block size 12800
[11/14/2022-14:14:16] [V] [TRT] Block size 51200
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 1
[11/14/2022-14:14:16] [V] [TRT] Block size 819200
[11/14/2022-14:14:16] [V] [TRT] Block size 1638400
[11/14/2022-14:14:16] [V] [TRT] Block size 1
[11/14/2022-14:14:16] [V] [TRT] Block size 12800
[11/14/2022-14:14:16] [V] [TRT] Block size 51200
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 3276800
[11/14/2022-14:14:16] [V] [TRT] Block size 819200
[11/14/2022-14:14:16] [V] [TRT] Block size 12800
[11/14/2022-14:14:16] [V] [TRT] Block size 51200
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 819200
[11/14/2022-14:14:16] [V] [TRT] Block size 38400
[11/14/2022-14:14:16] [V] [TRT] Block size 38400
[11/14/2022-14:14:16] [V] [TRT] Block size 3276800
[11/14/2022-14:14:16] [V] [TRT] Block size 12800
[11/14/2022-14:14:16] [V] [TRT] Block size 51200
[11/14/2022-14:14:16] [V] [TRT] Block size 38400
[11/14/2022-14:14:16] [V] [TRT] Block size 38400
[11/14/2022-14:14:16] [V] [TRT] Block size 819200
[11/14/2022-14:14:16] [V] [TRT] Block size 3276800
[11/14/2022-14:14:16] [V] [TRT] Block size 12800
[11/14/2022-14:14:16] [V] [TRT] Block size 51200
[11/14/2022-14:14:16] [V] [TRT] Block size 51200
[11/14/2022-14:14:16] [V] [TRT] Block size 819200
[11/14/2022-14:14:16] [V] [TRT] Block size 3276800
[11/14/2022-14:14:16] [V] [TRT] Block size 9728
[11/14/2022-14:14:16] [V] [TRT] Block size 9728
[11/14/2022-14:14:16] [V] [TRT] Block size 12800
[11/14/2022-14:14:16] [V] [TRT] Block size 9728
[11/14/2022-14:14:16] [V] [TRT] Block size 9728
[11/14/2022-14:14:16] [V] [TRT] Block size 819200
[11/14/2022-14:14:16] [V] [TRT] Block size 3276800
[11/14/2022-14:14:16] [V] [TRT] Block size 12800
[11/14/2022-14:14:16] [V] [TRT] Block size 12800
[11/14/2022-14:14:16] [V] [TRT] Block size 819200
[11/14/2022-14:14:16] [V] [TRT] Block size 3276800
[11/14/2022-14:14:16] [V] [TRT] Block size 2560
[11/14/2022-14:14:16] [V] [TRT] Block size 2560
[11/14/2022-14:14:16] [V] [TRT] Block size 2560
[11/14/2022-14:14:16] [V] [TRT] Block size 2560
[11/14/2022-14:14:16] [V] [TRT] Block size 819200
[11/14/2022-14:14:16] [V] [TRT] Block size 3276800
[11/14/2022-14:14:16] [V] [TRT] Block size 819200
[11/14/2022-14:14:16] [V] [TRT] Block size 819200
[11/14/2022-14:14:16] [V] [TRT] Block size 3276800
[11/14/2022-14:14:16] [V] [TRT] Block size 153600
[11/14/2022-14:14:16] [V] [TRT] Block size 153600
[11/14/2022-14:14:16] [V] [TRT] Block size 153600
[11/14/2022-14:14:16] [V] [TRT] Block size 153600
[11/14/2022-14:14:16] [V] [TRT] Block size 3276800
[11/14/2022-14:14:16] [V] [TRT] Block size 3276800
[11/14/2022-14:14:16] [V] [TRT] Block size 3276800
[11/14/2022-14:14:16] [V] [TRT] Block size 3276800
[11/14/2022-14:14:16] [V] [TRT] Block size 3276800
[11/14/2022-14:14:16] [V] [TRT] Block size 3276800
[11/14/2022-14:14:16] [V] [TRT] Block size 3276800
[11/14/2022-14:14:16] [V] [TRT] Block size 614400
[11/14/2022-14:14:16] [V] [TRT] Block size 614400
[11/14/2022-14:14:16] [V] [TRT] Block size 614400
[11/14/2022-14:14:16] [V] [TRT] Block size 614400
[11/14/2022-14:14:16] [V] [TRT] Block size 818688
[11/14/2022-14:14:16] [V] [TRT] Block size 818688
[11/14/2022-14:14:16] [V] [TRT] Block size 613888
[11/14/2022-14:14:16] [V] [TRT] Block size 818688
[11/14/2022-14:14:16] [V] [TRT] Block size 613888
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 204800
[11/14/2022-14:14:16] [V] [TRT] Block size 1
[11/14/2022-14:14:16] [V] [TRT] Block size 1
[11/14/2022-14:14:16] [V] [TRT] Block size 818688
[11/14/2022-14:14:16] [V] [TRT] Block size 818688
[11/14/2022-14:14:16] [V] [TRT] Block size 1
[11/14/2022-14:14:16] [V] [TRT] Block size 16777216
[11/14/2022-14:14:16] [V] [TRT] Total Activation Memory: 327145991
[11/14/2022-14:14:16] [I] [TRT] Detected 1 inputs and 4 output network tensors.
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv1/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv1_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_expand_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_3/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_3/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_3/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_2/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_1/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_3/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_1/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_1/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_1/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_0/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_0/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_0/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:14:16] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580
[11/14/2022-14:14:17] [V] [TRT] Layer: preprocessor/transpose Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: preprocessor/scale_value:0 + preprocessor/scale Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: preprocessor/mean_value:0 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: preprocessor/mean Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv1/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv1_relu/Relu6) Host Persistent: 2176 Device Persistent: 618496 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Host Persistent: 1664 Device Persistent: 616960 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6) Host Persistent: 3200 Device Persistent: 621056 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D Host Persistent: 3200 Device Persistent: 163328 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6) Host Persistent: 1664 Device Persistent: 168448 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add Host Persistent: 3200 Device Persistent: 167936 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_expand_relu/Relu6) Host Persistent: 1664 Device Persistent: 168448 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D Host Persistent: 3200 Device Persistent: 57344 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6) Host Persistent: 1664 Device Persistent: 64000 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add Host Persistent: 3200 Device Persistent: 63488 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_expand_relu/Relu6) Host Persistent: 1664 Device Persistent: 64000 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_depthwise_relu/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_add/add Host Persistent: 3200 Device Persistent: 63488 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_expand_relu/Relu6) Host Persistent: 1664 Device Persistent: 64000 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D Host Persistent: 3200 Device Persistent: 59392 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6) Host Persistent: 3200 Device Persistent: 109568 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add Host Persistent: 1664 Device Persistent: 108544 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_expand_relu/Relu6) Host Persistent: 3200 Device Persistent: 109568 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_depthwise_relu/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_add/add Host Persistent: 1664 Device Persistent: 108544 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_expand_relu/Relu6) Host Persistent: 3200 Device Persistent: 109568 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_depthwise_relu/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_add/add Host Persistent: 1664 Device Persistent: 108544 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_expand_relu/Relu6) Host Persistent: 3200 Device Persistent: 109568 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_depthwise_relu/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D Host Persistent: 3200 Device Persistent: 157696 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6) Host Persistent: 2176 Device Persistent: 233472 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add Host Persistent: 3200 Device Persistent: 231424 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_expand_relu/Relu6) Host Persistent: 2176 Device Persistent: 233472 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_depthwise_relu/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_add/add Host Persistent: 3200 Device Persistent: 231424 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_expand_relu/Relu6) Host Persistent: 2176 Device Persistent: 233472 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D Host Persistent: 3200 Device Persistent: 371712 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6) Host Persistent: 3200 Device Persistent: 621056 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add Host Persistent: 1664 Device Persistent: 617472 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_expand_relu/Relu6) Host Persistent: 3200 Device Persistent: 621056 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_depthwise_relu/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_add/add Host Persistent: 1664 Device Persistent: 617472 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_expand_relu/Relu6) Host Persistent: 3200 Device Persistent: 621056 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_depthwise_relu/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D Host Persistent: 3200 Device Persistent: 1232896 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6) Host Persistent: 1664 Device Persistent: 1646080 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Host Persistent: 3200 Device Persistent: 658432 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__421 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6) Host Persistent: 1664 Device Persistent: 67072 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__421:0 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__421:0 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6) Host Persistent: 1664 Device Persistent: 68608 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__425 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__425:0 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__425:0 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Host Persistent: 32 Device Persistent: 0 Scratch Memory: 61952
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2/depthwise Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6) Host Persistent: 2192 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_3/Relu6) Host Persistent: 1664 Device Persistent: 67072 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: Transpose__1277 + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape + Transpose__1257 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_2/Relu6) Host Persistent: 1664 Device Persistent: 68608 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add Host Persistent: 3200 Device Persistent: 59392 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3/depthwise Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/depthwise Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_4/Relu6) Host Persistent: 2192 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_3/Relu6) Host Persistent: 1664 Device Persistent: 67072 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_2/Relu6) Host Persistent: 1664 Device Persistent: 68608 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6) Host Persistent: 3200 Device Persistent: 75776 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4/depthwise Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3/depthwise Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/depthwise Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__442 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1/depthwise Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_4/Relu6) Host Persistent: 2192 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_3/Relu6) Host Persistent: 1664 Device Persistent: 67072 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_2/Relu6) Host Persistent: 1664 Device Persistent: 68608 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__442:0 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__442:0 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_1/Relu6) Host Persistent: 3200 Device Persistent: 75776 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__444 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__444:0 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__444:0 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/depthwise Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/depthwise Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_2/depthwise Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_2/depthwise Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1/depthwise Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_4/Relu6) Host Persistent: 2192 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_3/Relu6) Host Persistent: 1664 Device Persistent: 67072 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Host Persistent: 3200 Device Persistent: 14848 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 Host Persistent: 3200 Device Persistent: 14848 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: Transpose__1279 + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape + Transpose__1264 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_1/Relu6) Host Persistent: 3200 Device Persistent: 75776 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__647 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__656 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Host Persistent: 1664 Device Persistent: 55808 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4/depthwise Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_3/depthwise Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/depthwise Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1/depthwise Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_4/Relu6) Host Persistent: 2192 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Host Persistent: 2192 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 Host Persistent: 2192 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_1/Relu6) Host Persistent: 3200 Device Persistent: 75776 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6) Host Persistent: 3200 Device Persistent: 104960 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__593 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__602 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_4/depthwise Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/depthwise Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1/depthwise Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d/depthwise Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Host Persistent: 2192 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 Host Persistent: 2192 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_1/Relu6) Host Persistent: 3200 Device Persistent: 75776 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6) Host Persistent: 3200 Device Persistent: 104960 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__539 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__548 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/depthwise Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_1/depthwise Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/depthwise Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Host Persistent: 3200 Device Persistent: 22528 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 Host Persistent: 3200 Device Persistent: 22528 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_0/Relu6) Host Persistent: 3200 Device Persistent: 104960 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__701 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__710 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d/depthwise Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_0/Relu6) Host Persistent: 3200 Device Persistent: 104960 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d/depthwise Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_0/Relu6) Host Persistent: 3200 Device Persistent: 104960 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d/depthwise Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d/depthwise Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Host Persistent: 3200 Device Persistent: 51200 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd Host Persistent: 3200 Device Persistent: 51200 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__755 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__764 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5:0 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7:0 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9:0 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/Postprocessor/Reshape_1 + StatefulPartitionedCall/Postprocessor/Decode/transpose Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to PWN(nms/class_net_sigmoid) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: PWN(nms/class_net_sigmoid) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/Postprocessor/Decode/unstack__772 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/Postprocessor/Decode/unstack__771 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/Postprocessor/Decode/unstack__770 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/Postprocessor/Decode/unstack__769 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/sub:0 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/sub_1:0 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/add_1:0 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: PWN(PWN(PWN(ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_recip:0 + (Unnamed Layer* 279) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_1), StatefulPartitionedCall/Postprocessor/Decode/mul_3), StatefulPartitionedCall/Postprocessor/Decode/add_1) Host Persistent: 436 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/add:0 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: PWN(PWN(PWN(ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_recip:0_3 + (Unnamed Layer* 282) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv), StatefulPartitionedCall/Postprocessor/Decode/mul_2), StatefulPartitionedCall/Postprocessor/Decode/add) Host Persistent: 436 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/sub:0_5 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/sub_1:0_6 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: PWN(ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_4_recip:0 + (Unnamed Layer* 305) [Shuffle], PWN(PWN(PWN(PWN(ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_3_recip:0 + (Unnamed Layer* 285) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_3), StatefulPartitionedCall/Postprocessor/Decode/Exp), StatefulPartitionedCall/Postprocessor/Decode/mul), StatefulPartitionedCall/Postprocessor/Decode/truediv_5)) Host Persistent: 340 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: PWN(ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_4_recip:0_7 + (Unnamed Layer* 308) [Shuffle], PWN(PWN(PWN(PWN(ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_3_recip:0_4 + (Unnamed Layer* 288) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_2), StatefulPartitionedCall/Postprocessor/Decode/Exp_1), StatefulPartitionedCall/Postprocessor/Decode/mul_1), StatefulPartitionedCall/Postprocessor/Decode/truediv_4)) Host Persistent: 340 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/Postprocessor/Decode/sub_1 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/Postprocessor/Decode/add_3 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/Postprocessor/Decode/sub Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/Postprocessor/Decode/add_2 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__852 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__854 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__851 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__853 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__851:0 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__853:0 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: nms/box_decoder_transpose + nms/box_decoder_reshape Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/14/2022-14:14:17] [V] [TRT] Layer: nms/non_maximum_suppression_first Host Persistent: 48 Device Persistent: 0 Scratch Memory: 4526848
[11/14/2022-14:14:17] [I] [TRT] Total Host Persistent Memory: 185952
[11/14/2022-14:14:17] [I] [TRT] Total Device Persistent Memory: 13858304
[11/14/2022-14:14:17] [I] [TRT] Total Scratch Memory: 4526848
[11/14/2022-14:14:17] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 12 MiB, GPU 104 MiB
[11/14/2022-14:14:17] [I] [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 150.518ms to assign 12 blocks to 170 nodes requiring 61232128 bytes.
[11/14/2022-14:14:17] [V] [TRT] Optimized block assignment.
[11/14/2022-14:14:17] [V] [TRT] Block size 39321600
[11/14/2022-14:14:17] [V] [TRT] Block size 14745600
[11/14/2022-14:14:17] [V] [TRT] Block size 3276800
[11/14/2022-14:14:17] [V] [TRT] Block size 2457600
[11/14/2022-14:14:17] [V] [TRT] Block size 819200
[11/14/2022-14:14:17] [V] [TRT] Block size 256000
[11/14/2022-14:14:17] [V] [TRT] Block size 204800
[11/14/2022-14:14:17] [V] [TRT] Block size 51200
[11/14/2022-14:14:17] [V] [TRT] Block size 38400
[11/14/2022-14:14:17] [V] [TRT] Block size 38400
[11/14/2022-14:14:17] [V] [TRT] Block size 12800
[11/14/2022-14:14:17] [V] [TRT] Block size 9728
[11/14/2022-14:14:17] [I] [TRT] Total Activation Memory: 61232128
[11/14/2022-14:14:17] [V] [TRT] Using cublas as a tactic source
[11/14/2022-14:14:17] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +1, GPU +0, now: CPU 1012, GPU 7557 (MiB)
[11/14/2022-14:14:17] [V] [TRT] Using cuDNN as a tactic source
[11/14/2022-14:14:17] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1012, GPU 7557 (MiB)
[11/14/2022-14:14:17] [V] [TRT] Engine generation completed in 392.496 seconds.
[11/14/2022-14:14:17] [V] [TRT] Deleting timing cache: 282 entries, 438 hits
[11/14/2022-14:14:17] [V] [TRT] Engine Layer Information:
Layer(Shuffle): preprocessor/transpose, Tactic: 0, input_tensor:0[Float(1,640,640,3)] -> preprocessor/transpose:0_0[Float(1,3,640,640)]
Layer(Scale): preprocessor/scale_value:0 + preprocessor/scale, Tactic: 0, preprocessor/transpose:0_0[Float(1,3,640,640)] -> preprocessor/scale:0_1[Float(1,3,640,640)]
Layer(Constant): preprocessor/mean_value:0, Tactic: 0,  -> (Unnamed Layer* 3) [Constant]_output[Float(1,3,1,1)]
Layer(ElementWise): preprocessor/mean, Tactic: 1, preprocessor/scale:0_1[Float(1,3,640,640)], (Unnamed Layer* 3) [Constant]_output[Float(1,3,1,1)] -> preprocessor/mean:0_2[Float(1,3,640,640)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv1/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv1_relu/Relu6), Tactic: 1062367460111450758, preprocessor/mean:0_2[Float(1,3,640,640)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv1_relu/Relu6:0[Float(1,32,320,320)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6), Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv1_relu/Relu6:0[Float(1,32,320,320)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6:0[Float(1,32,320,320)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D, Tactic: -3456450830548107839, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6:0[Float(1,32,320,320)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project_BN/FusedBatchNormV3:0[Float(1,16,320,320)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6), Tactic: 1698681053543049347, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/expanded_conv_project_BN/FusedBatchNormV3:0[Float(1,16,320,320)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6:0[Float(1,96,320,320)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6), Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6:0[Float(1,96,320,320)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6:0[Float(1,96,160,160)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project/Conv2D, Tactic: -6576203419454146580, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6:0[Float(1,96,160,160)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project_BN/FusedBatchNormV3:0[Float(1,24,160,160)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6), Tactic: 5137655947464784826, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project_BN/FusedBatchNormV3:0[Float(1,24,160,160)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6:0[Float(1,144,160,160)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6), Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6:0[Float(1,144,160,160)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6:0[Float(1,144,160,160)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add, Tactic: -6576203419454146580, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6:0[Float(1,144,160,160)], StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_1_project_BN/FusedBatchNormV3:0[Float(1,24,160,160)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add:0[Float(1,24,160,160)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_expand_relu/Relu6), Tactic: 5137655947464784826, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_2_add/add:0[Float(1,24,160,160)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_expand_relu/Relu6:0[Float(1,144,160,160)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6), Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_expand_relu/Relu6:0[Float(1,144,160,160)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6:0[Float(1,144,80,80)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project/Conv2D, Tactic: -6576203419454146580, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6:0[Float(1,144,80,80)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project_BN/FusedBatchNormV3:0[Float(1,32,80,80)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6), Tactic: 5137655947464784826, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project_BN/FusedBatchNormV3:0[Float(1,32,80,80)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6:0[Float(1,192,80,80)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6), Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6:0[Float(1,192,80,80)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6:0[Float(1,192,80,80)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add, Tactic: -6576203419454146580, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6:0[Float(1,192,80,80)], StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_3_project_BN/FusedBatchNormV3:0[Float(1,32,80,80)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add:0[Float(1,32,80,80)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_expand_relu/Relu6), Tactic: 5137655947464784826, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add:0[Float(1,32,80,80)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_expand_relu/Relu6:0[Float(1,192,80,80)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_depthwise_relu/Relu6), Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_expand_relu/Relu6:0[Float(1,192,80,80)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_depthwise_relu/Relu6:0[Float(1,192,80,80)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_add/add, Tactic: -6576203419454146580, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_depthwise_relu/Relu6:0[Float(1,192,80,80)], StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_4_add/add:0[Float(1,32,80,80)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_add/add:0[Float(1,32,80,80)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_expand_relu/Relu6), Tactic: 5137655947464784826, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_add/add:0[Float(1,32,80,80)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_expand_relu/Relu6:0[Float(1,192,80,80)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6), Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_expand_relu/Relu6:0[Float(1,192,80,80)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6:0[Float(1,192,40,40)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project/Conv2D, Tactic: -37215280111360163, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6:0[Float(1,192,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project_BN/FusedBatchNormV3:0[Float(1,64,40,40)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6), Tactic: -37215280111360163, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project_BN/FusedBatchNormV3:0[Float(1,64,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6:0[Float(1,384,40,40)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6), Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6:0[Float(1,384,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6:0[Float(1,384,40,40)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add, Tactic: 5137655947464784826, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6:0[Float(1,384,40,40)], StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_6_project_BN/FusedBatchNormV3:0[Float(1,64,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add:0[Float(1,64,40,40)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_expand_relu/Relu6), Tactic: -37215280111360163, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add:0[Float(1,64,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_expand_relu/Relu6:0[Float(1,384,40,40)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_depthwise_relu/Relu6), Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_expand_relu/Relu6:0[Float(1,384,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_depthwise_relu/Relu6:0[Float(1,384,40,40)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_add/add, Tactic: 5137655947464784826, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_depthwise_relu/Relu6:0[Float(1,384,40,40)], StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_7_add/add:0[Float(1,64,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_add/add:0[Float(1,64,40,40)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_expand_relu/Relu6), Tactic: -37215280111360163, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_add/add:0[Float(1,64,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_expand_relu/Relu6:0[Float(1,384,40,40)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_depthwise_relu/Relu6), Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_expand_relu/Relu6:0[Float(1,384,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_depthwise_relu/Relu6:0[Float(1,384,40,40)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_add/add, Tactic: 5137655947464784826, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_depthwise_relu/Relu6:0[Float(1,384,40,40)], StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_8_add/add:0[Float(1,64,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_add/add:0[Float(1,64,40,40)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_expand_relu/Relu6), Tactic: -37215280111360163, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_9_add/add:0[Float(1,64,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_expand_relu/Relu6:0[Float(1,384,40,40)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_depthwise_relu/Relu6), Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_expand_relu/Relu6:0[Float(1,384,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_depthwise_relu/Relu6:0[Float(1,384,40,40)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project/Conv2D, Tactic: -6576203419454146580, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_depthwise_relu/Relu6:0[Float(1,384,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project_BN/FusedBatchNormV3:0[Float(1,96,40,40)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6), Tactic: 6645123197870846056, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project_BN/FusedBatchNormV3:0[Float(1,96,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6:0[Float(1,576,40,40)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6), Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6:0[Float(1,576,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6:0[Float(1,576,40,40)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add, Tactic: -6576203419454146580, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6:0[Float(1,576,40,40)], StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_10_project_BN/FusedBatchNormV3:0[Float(1,96,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add:0[Float(1,96,40,40)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_expand_relu/Relu6), Tactic: 6645123197870846056, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add:0[Float(1,96,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_expand_relu/Relu6:0[Float(1,576,40,40)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_depthwise_relu/Relu6), Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_expand_relu/Relu6:0[Float(1,576,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_depthwise_relu/Relu6:0[Float(1,576,40,40)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_add/add, Tactic: -6576203419454146580, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_depthwise_relu/Relu6:0[Float(1,576,40,40)], StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_11_add/add:0[Float(1,96,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_add/add:0[Float(1,96,40,40)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_expand_relu/Relu6), Tactic: 6645123197870846056, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_add/add:0[Float(1,96,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_expand_relu/Relu6:0[Float(1,576,40,40)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6), Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_expand_relu/Relu6:0[Float(1,576,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6:0[Float(1,576,20,20)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project/Conv2D, Tactic: -6576203419454146580, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6:0[Float(1,576,20,20)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project_BN/FusedBatchNormV3:0[Float(1,160,20,20)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6), Tactic: -37215280111360163, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project_BN/FusedBatchNormV3:0[Float(1,160,20,20)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6:0[Float(1,960,20,20)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6), Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6:0[Float(1,960,20,20)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6:0[Float(1,960,20,20)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add, Tactic: -3456450830548107839, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6:0[Float(1,960,20,20)], StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_13_project_BN/FusedBatchNormV3:0[Float(1,160,20,20)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add:0[Float(1,160,20,20)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_expand_relu/Relu6), Tactic: -37215280111360163, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add:0[Float(1,160,20,20)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_expand_relu/Relu6:0[Float(1,960,20,20)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_depthwise_relu/Relu6), Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_expand_relu/Relu6:0[Float(1,960,20,20)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_depthwise_relu/Relu6:0[Float(1,960,20,20)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_add/add, Tactic: -3456450830548107839, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_depthwise_relu/Relu6:0[Float(1,960,20,20)], StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_14_add/add:0[Float(1,160,20,20)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_add/add:0[Float(1,160,20,20)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_expand/Conv2D + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_expand_relu/Relu6), Tactic: -37215280111360163, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_15_add/add:0[Float(1,160,20,20)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_expand_relu/Relu6:0[Float(1,960,20,20)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_depthwise/depthwise + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_depthwise_relu/Relu6), Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_expand_relu/Relu6:0[Float(1,960,20,20)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_depthwise_relu/Relu6:0[Float(1,960,20,20)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project/Conv2D, Tactic: -37215280111360163, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_depthwise_relu/Relu6:0[Float(1,960,20,20)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project_BN/FusedBatchNormV3:0[Float(1,320,20,20)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6), Tactic: -410470605513481746, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_16_project_BN/FusedBatchNormV3:0[Float(1,320,20,20)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6:0[Float(1,1280,20,20)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd, Tactic: 5326823351883942011, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/out_relu/Relu6:0[Float(1,1280,20,20)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd:0[Float(1,128,20,20)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise, Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd:0[Float(1,128,20,20)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise:0[Float(1,128,10,10)]
Layer(NoOp): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__421, Tactic: 0, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd:0[Float(1,128,20,20)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__421:0[Float(1,1,128,20,20)]
Layer(CudnnConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise, Tactic: 1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd:0[Float(1,128,20,20)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise:0[Float(1,128,20,20)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6), Tactic: 5137655947464784826, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise:0[Float(1,128,10,10)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6:0[Float(1,128,10,10)]
Layer(Reformat): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__421:0 copy, Tactic: 0, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__421:0[Float(1,1,128,20,20)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Concat__423:0[Float(1,1,128,20,20)]
Layer(Reformat): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__421:0 copy, Tactic: 0, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__421:0[Float(1,1,128,20,20)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Concat__423:0[Float(1,1,128,20,20)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6), Tactic: -410470605513481746, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise:0[Float(1,128,20,20)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6:0[Float(1,128,20,20)]
Layer(NoOp): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__425, Tactic: 0, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Concat__423:0[Float(1,2,128,20,20)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__425:0[Float(1,2,128,20,1,20)]
Layer(Reformat): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__425:0 copy, Tactic: 0, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__425:0[Float(1,2,128,20,1,20)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Concat__426:0[Float(1,2,128,20,1,20)]
Layer(Reformat): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__425:0 copy, Tactic: 0, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__425:0[Float(1,2,128,20,1,20)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Concat__426:0[Float(1,2,128,20,1,20)]
Layer(CudnnConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise, Tactic: 1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6:0[Float(1,128,10,10)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise:0[Float(1,128,5,5)]
Layer(CudnnConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise, Tactic: 2, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6:0[Float(1,128,10,10)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise:0[Float(1,128,10,10)]
Layer(CudnnConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2/depthwise, Tactic: 1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6:0[Float(1,128,20,20)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2/depthwise:0[Float(1,128,20,20)]
Layer(FusedConvActConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6), Tactic: 5373951, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise:0[Float(1,128,5,5)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6:0[Float(1,128,5,5)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_3/Relu6), Tactic: 5137655947464784826, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise:0[Float(1,128,10,10)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_3/Relu6:0[Float(1,128,10,10)]
Layer(Shuffle): Transpose__1277 + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape + Transpose__1257, Tactic: 0, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Concat__426:0[Float(1,2,128,20,2,20)] -> Transpose__1257:0[Float(1,128,40,40)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_2/Relu6), Tactic: -410470605513481746, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2/depthwise:0[Float(1,128,20,20)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_2/Relu6:0[Float(1,128,20,20)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add, Tactic: -37215280111360163, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_12_add/add:0[Float(1,96,40,40)], Transpose__1257:0[Float(1,128,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add:0[Float(1,128,40,40)]
Layer(CudnnConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise, Tactic: 1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6:0[Float(1,128,5,5)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise:0[Float(1,128,5,5)]
Layer(CudnnConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3/depthwise, Tactic: 2, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_3/Relu6:0[Float(1,128,10,10)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3/depthwise:0[Float(1,128,10,10)]
Layer(CudnnConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/depthwise, Tactic: 1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_2/Relu6:0[Float(1,128,20,20)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/depthwise:0[Float(1,128,20,20)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise, Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add:0[Float(1,128,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise:0[Float(1,128,40,40)]
Layer(FusedConvActConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_4/Relu6), Tactic: 5373951, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise:0[Float(1,128,5,5)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_4/Relu6:0[Float(1,128,5,5)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_3/Relu6), Tactic: 5137655947464784826, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3/depthwise:0[Float(1,128,10,10)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_3/Relu6:0[Float(1,128,10,10)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_2/Relu6), Tactic: -410470605513481746, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/depthwise:0[Float(1,128,20,20)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_2/Relu6:0[Float(1,128,20,20)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6), Tactic: 5326823351883942011, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise:0[Float(1,128,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6:0[Float(1,128,40,40)]
Layer(CudnnConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4/depthwise, Tactic: 1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_4/Relu6:0[Float(1,128,5,5)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4/depthwise:0[Float(1,128,5,5)]
Layer(CudnnConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3/depthwise, Tactic: 2, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_3/Relu6:0[Float(1,128,10,10)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3/depthwise:0[Float(1,128,10,10)]
Layer(CudnnConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/depthwise, Tactic: 1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_2/Relu6:0[Float(1,128,20,20)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/depthwise:0[Float(1,128,20,20)]
Layer(NoOp): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__442, Tactic: 0, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6:0[Float(1,128,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__442:0[Float(1,1,128,40,40)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1/depthwise, Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6:0[Float(1,128,40,40)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1/depthwise:0[Float(1,128,40,40)]
Layer(FusedConvActConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_4/Relu6), Tactic: 5373951, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4/depthwise:0[Float(1,128,5,5)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_4/Relu6:0[Float(1,128,5,5)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_3/Relu6), Tactic: 5137655947464784826, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3/depthwise:0[Float(1,128,10,10)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_3/Relu6:0[Float(1,128,10,10)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_2/Relu6), Tactic: -410470605513481746, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/depthwise:0[Float(1,128,20,20)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_2/Relu6:0[Float(1,128,20,20)]
Layer(Reformat): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__442:0 copy, Tactic: 0, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__442:0[Float(1,1,128,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Concat__443:0[Float(1,1,128,40,40)]
Layer(Reformat): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__442:0 copy, Tactic: 0, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__442:0[Float(1,1,128,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Concat__443:0[Float(1,1,128,40,40)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_1/Relu6), Tactic: 5326823351883942011, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1/depthwise:0[Float(1,128,40,40)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_1/Relu6:0[Float(1,128,40,40)]
Layer(NoOp): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__444, Tactic: 0, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Concat__443:0[Float(1,2,128,40,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__444:0[Float(1,2,128,40,1,40)]
Layer(Reformat): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__444:0 copy, Tactic: 0, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__444:0[Float(1,2,128,40,1,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Concat__446:0[Float(1,2,128,40,1,40)]
Layer(Reformat): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__444:0 copy, Tactic: 0, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__444:0[Float(1,2,128,40,1,40)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Concat__446:0[Float(1,2,128,40,1,40)]
Layer(CudnnConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/depthwise, Tactic: 1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_4/Relu6:0[Float(1,128,5,5)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/depthwise:0[Float(1,128,5,5)]
Layer(CudnnConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/depthwise, Tactic: 2, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_3/Relu6:0[Float(1,128,10,10)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/depthwise:0[Float(1,128,10,10)]
Layer(CudnnConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_2/depthwise, Tactic: 1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_2/Relu6:0[Float(1,128,20,20)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_2/depthwise:0[Float(1,128,20,20)]
Layer(CudnnConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_2/depthwise, Tactic: 1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_2/Relu6:0[Float(1,128,20,20)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_2/depthwise:0[Float(1,128,20,20)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1/depthwise, Tactic: -1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_1/Relu6:0[Float(1,128,40,40)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1/depthwise:0[Float(1,128,40,40)]
Layer(FusedConvActConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_4/Relu6), Tactic: 5373951, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/depthwise:0[Float(1,128,5,5)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_4/Relu6:0[Float(1,128,5,5)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_3/Relu6), Tactic: 5137655947464784826, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/depthwise:0[Float(1,128,10,10)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_3/Relu6:0[Float(1,128,10,10)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2, Tactic: 1698681053543049347, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_2/depthwise:0[Float(1,128,20,20)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2:0[Float(1,24,20,20)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2, Tactic: 1698681053543049347, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_2/depthwise:0[Float(1,128,20,20)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2:0[Float(1,24,20,20)]
Layer(Shuffle): Transpose__1279 + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape + Transpose__1264, Tactic: 0, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Concat__446:0[Float(1,2,128,40,2,40)] -> Transpose__1264:0[Float(1,128,80,80)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_1/Relu6), Tactic: 5326823351883942011, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1/depthwise:0[Float(1,128,40,40)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_1/Relu6:0[Float(1,128,40,40)]
Layer(Shuffle): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__647 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5, Tactic: 0, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2:0[Float(1,24,20,20)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5:0[Float(1,2400,4)]
Layer(Shuffle): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__656 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2, Tactic: 0, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2:0[Float(1,24,20,20)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0[Float(1,2400,4)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1, Tactic: 5137655947464784826, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/model/block_5_add/add:0[Float(1,32,80,80)], Transpose__1264:0[Float(1,128,80,80)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1:0[Float(1,128,80,80)]
Layer(CudnnConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4/depthwise, Tactic: 1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_4/Relu6:0[Float(1,128,5,5)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4/depthwise:0[Float(1,128,5,5)]
Layer(CudnnConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_3/depthwise, Tactic: 2, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_3/Relu6:0[Float(1,128,10,10)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_3/depthwise:0[Float(1,128,10,10)]
Layer(CudnnConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/depthwise, Tactic: 2, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_3/Relu6:0[Float(1,128,10,10)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/depthwise:0[Float(1,128,10,10)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1/depthwise, Tactic: -1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_1/Relu6:0[Float(1,128,40,40)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1/depthwise:0[Float(1,128,40,40)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise, Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/add_1:0[Float(1,128,80,80)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise:0[Float(1,128,80,80)]
Layer(FusedConvActConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_4/Relu6), Tactic: 5373951, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4/depthwise:0[Float(1,128,5,5)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_4/Relu6:0[Float(1,128,5,5)]
Layer(FusedConvActConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3, Tactic: 1638399, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_3/depthwise:0[Float(1,128,10,10)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3:0[Float(1,24,10,10)]
Layer(FusedConvActConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3, Tactic: 1638399, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/depthwise:0[Float(1,128,10,10)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3:0[Float(1,24,10,10)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_1/Relu6), Tactic: 5326823351883942011, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1/depthwise:0[Float(1,128,40,40)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_1/Relu6:0[Float(1,128,40,40)]
Layer(CaskConvolution): StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 + PWN(StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6), Tactic: 5326823351883942011, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise:0[Float(1,128,80,80)] -> StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6:0[Float(1,128,80,80)]
Layer(Shuffle): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__593 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7, Tactic: 0, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3:0[Float(1,24,10,10)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7:0[Float(1,600,4)]
Layer(Shuffle): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__602 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3, Tactic: 0, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3:0[Float(1,24,10,10)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0[Float(1,600,4)]
Layer(CudnnConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_4/depthwise, Tactic: 1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_4/Relu6:0[Float(1,128,5,5)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_4/depthwise:0[Float(1,128,5,5)]
Layer(CudnnConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/depthwise, Tactic: 1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_4/Relu6:0[Float(1,128,5,5)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/depthwise:0[Float(1,128,5,5)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1/depthwise, Tactic: -1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_1/Relu6:0[Float(1,128,40,40)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1/depthwise:0[Float(1,128,40,40)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d/depthwise, Tactic: -1, StatefulPartitionedCall/ssd_mobile_net_v2_fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6:0[Float(1,128,80,80)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d/depthwise:0[Float(1,128,80,80)]
Layer(FusedConvActConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4, Tactic: 2097151, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_4/depthwise:0[Float(1,128,5,5)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4:0[Float(1,24,5,5)]
Layer(FusedConvActConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4, Tactic: 2097151, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/depthwise:0[Float(1,128,5,5)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4:0[Float(1,24,5,5)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_1/Relu6), Tactic: 5326823351883942011, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1/depthwise:0[Float(1,128,40,40)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_1/Relu6:0[Float(1,128,40,40)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6), Tactic: 5326823351883942011, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d/depthwise:0[Float(1,128,80,80)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6:0[Float(1,128,80,80)]
Layer(Shuffle): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__539 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9, Tactic: 0, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4:0[Float(1,24,5,5)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9:0[Float(1,150,4)]
Layer(Shuffle): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__548 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4, Tactic: 0, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4:0[Float(1,24,5,5)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0[Float(1,150,4)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/depthwise, Tactic: -1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_1/Relu6:0[Float(1,128,40,40)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/depthwise:0[Float(1,128,40,40)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_1/depthwise, Tactic: -1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_1/Relu6:0[Float(1,128,40,40)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_1/depthwise:0[Float(1,128,40,40)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/depthwise, Tactic: -1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6:0[Float(1,128,80,80)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/depthwise:0[Float(1,128,80,80)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1, Tactic: -6576203419454146580, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/depthwise:0[Float(1,128,40,40)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1:0[Float(1,24,40,40)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1, Tactic: -6576203419454146580, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_1/depthwise:0[Float(1,128,40,40)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1:0[Float(1,24,40,40)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_0/Relu6), Tactic: 5326823351883942011, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/depthwise:0[Float(1,128,80,80)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_0/Relu6:0[Float(1,128,80,80)]
Layer(Shuffle): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__701 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3, Tactic: 0, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1:0[Float(1,24,40,40)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0[Float(1,9600,4)]
Layer(Shuffle): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__710 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1, Tactic: 0, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1:0[Float(1,24,40,40)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0[Float(1,9600,4)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d/depthwise, Tactic: -1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_0/Relu6:0[Float(1,128,80,80)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d/depthwise:0[Float(1,128,80,80)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_0/Relu6), Tactic: 5326823351883942011, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d/depthwise:0[Float(1,128,80,80)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_0/Relu6:0[Float(1,128,80,80)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d/depthwise, Tactic: -1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_0/Relu6:0[Float(1,128,80,80)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d/depthwise:0[Float(1,128,80,80)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3 + PWN(StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_0/Relu6), Tactic: 5326823351883942011, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d/depthwise:0[Float(1,128,80,80)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_0/Relu6:0[Float(1,128,80,80)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d/depthwise, Tactic: -1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_0/Relu6:0[Float(1,128,80,80)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d/depthwise:0[Float(1,128,80,80)]
Layer(CudaDepthwiseConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d/depthwise, Tactic: -1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_0/Relu6:0[Float(1,128,80,80)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d/depthwise:0[Float(1,128,80,80)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd, Tactic: -6576203419454146580, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d/depthwise:0[Float(1,128,80,80)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd:0[Float(1,24,80,80)]
Layer(CaskConvolution): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd, Tactic: -6576203419454146580, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d/depthwise:0[Float(1,128,80,80)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd:0[Float(1,24,80,80)]
Layer(Shuffle): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__755 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1, Tactic: 0, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd:0[Float(1,24,80,80)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0[Float(1,38400,4)]
Layer(Shuffle): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__764 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape, Tactic: 0, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd:0[Float(1,24,80,80)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0[Float(1,38400,4)]
Layer(Reformat): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 copy, Tactic: 1002, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0[Float(1,38400,4)] -> StatefulPartitionedCall/concat_1:0[Float(1,38400,4)]
Layer(Reformat): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 copy, Tactic: 1002, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0[Float(1,9600,4)] -> StatefulPartitionedCall/concat_1:0[Float(1,9600,4)]
Layer(Reformat): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5:0 copy, Tactic: 0, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5:0[Float(1,2400,4)] -> StatefulPartitionedCall/concat_1:0[Float(1,2400,4)]
Layer(Reformat): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7:0 copy, Tactic: 0, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7:0[Float(1,600,4)] -> StatefulPartitionedCall/concat_1:0[Float(1,600,4)]
Layer(Reformat): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9:0 copy, Tactic: 0, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9:0[Float(1,150,4)] -> StatefulPartitionedCall/concat_1:0[Float(1,150,4)]
Layer(Reformat): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy, Tactic: 1002, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0[Float(1,38400,4)] -> StatefulPartitionedCall/concat:0[Float(1,38400,4)]
Layer(Reformat): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy, Tactic: 1002, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0[Float(1,9600,4)] -> StatefulPartitionedCall/concat:0[Float(1,9600,4)]
Layer(Reformat): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy, Tactic: 0, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0[Float(1,2400,4)] -> StatefulPartitionedCall/concat:0[Float(1,2400,4)]
Layer(Reformat): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy, Tactic: 0, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0[Float(1,600,4)] -> StatefulPartitionedCall/concat:0[Float(1,600,4)]
Layer(Reformat): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy, Tactic: 1002, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0[Float(1,150,4)] -> StatefulPartitionedCall/concat:0[Float(1,150,4)]
Layer(Shuffle): StatefulPartitionedCall/Postprocessor/Reshape_1 + StatefulPartitionedCall/Postprocessor/Decode/transpose, Tactic: 0, StatefulPartitionedCall/concat:0[Float(1,51150,4)] -> StatefulPartitionedCall/Postprocessor/Decode/transpose:0[Float(4,51150)]
Layer(Reformat): StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer, Tactic: 0, StatefulPartitionedCall/concat_1:0[Float(1,51150,3)] -> StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer:0_0[Float(1,51150,3)]
Layer(NoOp): Reformatting CopyNode for Input Tensor 0 to PWN(nms/class_net_sigmoid), Tactic: 0, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer:0_0[Float(1,51150,3)] -> Reformatted Input Tensor 0 to PWN(nms/class_net_sigmoid)[Float(1,51150,3)]
Layer(PointWiseV2): PWN(nms/class_net_sigmoid), Tactic: 2, Reformatted Input Tensor 0 to PWN(nms/class_net_sigmoid)[Float(1,51150,3)] -> nms/class_net_sigmoid:0_4[Float(1,51150,3)]
Layer(Shuffle): StatefulPartitionedCall/Postprocessor/Decode/unstack__772, Tactic: 0, StatefulPartitionedCall/Postprocessor/Decode/transpose:0[Float(1,51150)] -> StatefulPartitionedCall/Postprocessor/Decode/unstack__772:0[Float(51150)]
Layer(Shuffle): StatefulPartitionedCall/Postprocessor/Decode/unstack__771, Tactic: 0, StatefulPartitionedCall/Postprocessor/Decode/transpose:0[Float(1,51150)] -> StatefulPartitionedCall/Postprocessor/Decode/unstack__771:0[Float(51150)]
Layer(Shuffle): StatefulPartitionedCall/Postprocessor/Decode/unstack__770, Tactic: 0, StatefulPartitionedCall/Postprocessor/Decode/transpose:0[Float(1,51150)] -> StatefulPartitionedCall/Postprocessor/Decode/unstack__770:0[Float(51150)]
Layer(Shuffle): StatefulPartitionedCall/Postprocessor/Decode/unstack__769, Tactic: 0, StatefulPartitionedCall/Postprocessor/Decode/transpose:0[Float(1,51150)] -> StatefulPartitionedCall/Postprocessor/Decode/unstack__769:0[Float(51150)]
Layer(Constant): StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/sub:0, Tactic: 0,  -> (Unnamed Layer* 290) [Constant]_output[Float(51150)]
Layer(Constant): StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/sub_1:0, Tactic: 0,  -> (Unnamed Layer* 292) [Constant]_output[Float(51150)]
Layer(Constant): StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/add_1:0, Tactic: 0,  -> (Unnamed Layer* 296) [Constant]_output[Float(51150)]
Layer(PointWiseV2): PWN(PWN(PWN(ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_recip:0 + (Unnamed Layer* 279) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_1), StatefulPartitionedCall/Postprocessor/Decode/mul_3), StatefulPartitionedCall/Postprocessor/Decode/add_1), Tactic: 2, StatefulPartitionedCall/Postprocessor/Decode/unstack__770:0[Float(51150)], (Unnamed Layer* 290) [Constant]_output[Float(51150)], (Unnamed Layer* 296) [Constant]_output[Float(51150)] -> StatefulPartitionedCall/Postprocessor/Decode/add_1:0[Float(51150)]
Layer(Constant): StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/add:0, Tactic: 0,  -> (Unnamed Layer* 298) [Constant]_output[Float(51150)]
Layer(PointWiseV2): PWN(PWN(PWN(ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_recip:0_3 + (Unnamed Layer* 282) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv), StatefulPartitionedCall/Postprocessor/Decode/mul_2), StatefulPartitionedCall/Postprocessor/Decode/add), Tactic: 2, StatefulPartitionedCall/Postprocessor/Decode/unstack__769:0[Float(51150)], (Unnamed Layer* 292) [Constant]_output[Float(51150)], (Unnamed Layer* 298) [Constant]_output[Float(51150)] -> StatefulPartitionedCall/Postprocessor/Decode/add:0[Float(51150)]
Layer(Constant): StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/sub:0_5, Tactic: 0,  -> (Unnamed Layer* 300) [Constant]_output[Float(51150)]
Layer(Constant): StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/sub_1:0_6, Tactic: 0,  -> (Unnamed Layer* 302) [Constant]_output[Float(51150)]
Layer(PointWiseV2): PWN(ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_4_recip:0 + (Unnamed Layer* 305) [Shuffle], PWN(PWN(PWN(PWN(ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_3_recip:0 + (Unnamed Layer* 285) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_3), StatefulPartitionedCall/Postprocessor/Decode/Exp), StatefulPartitionedCall/Postprocessor/Decode/mul), StatefulPartitionedCall/Postprocessor/Decode/truediv_5)), Tactic: 3, StatefulPartitionedCall/Postprocessor/Decode/unstack__772:0[Float(51150)], (Unnamed Layer* 300) [Constant]_output[Float(51150)] -> StatefulPartitionedCall/Postprocessor/Decode/truediv_5:0[Float(51150)]
Layer(PointWiseV2): PWN(ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_4_recip:0_7 + (Unnamed Layer* 308) [Shuffle], PWN(PWN(PWN(PWN(ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_3_recip:0_4 + (Unnamed Layer* 288) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_2), StatefulPartitionedCall/Postprocessor/Decode/Exp_1), StatefulPartitionedCall/Postprocessor/Decode/mul_1), StatefulPartitionedCall/Postprocessor/Decode/truediv_4)), Tactic: 3, StatefulPartitionedCall/Postprocessor/Decode/unstack__771:0[Float(51150)], (Unnamed Layer* 302) [Constant]_output[Float(51150)] -> StatefulPartitionedCall/Postprocessor/Decode/truediv_4:0[Float(51150)]
Layer(ElementWise): StatefulPartitionedCall/Postprocessor/Decode/sub_1, Tactic: 1, StatefulPartitionedCall/Postprocessor/Decode/add_1:0[Float(51150)], StatefulPartitionedCall/Postprocessor/Decode/truediv_5:0[Float(51150)] -> StatefulPartitionedCall/Postprocessor/Decode/sub_1:0[Float(51150)]
Layer(ElementWise): StatefulPartitionedCall/Postprocessor/Decode/add_3, Tactic: 1, StatefulPartitionedCall/Postprocessor/Decode/add_1:0[Float(51150)], StatefulPartitionedCall/Postprocessor/Decode/truediv_5:0[Float(51150)] -> StatefulPartitionedCall/Postprocessor/Decode/add_3:0[Float(51150)]
Layer(ElementWise): StatefulPartitionedCall/Postprocessor/Decode/sub, Tactic: 1, StatefulPartitionedCall/Postprocessor/Decode/add:0[Float(51150)], StatefulPartitionedCall/Postprocessor/Decode/truediv_4:0[Float(51150)] -> StatefulPartitionedCall/Postprocessor/Decode/sub:0[Float(51150)]
Layer(ElementWise): StatefulPartitionedCall/Postprocessor/Decode/add_2, Tactic: 1, StatefulPartitionedCall/Postprocessor/Decode/add:0[Float(51150)], StatefulPartitionedCall/Postprocessor/Decode/truediv_4:0[Float(51150)] -> StatefulPartitionedCall/Postprocessor/Decode/add_2:0[Float(51150)]
Layer(Shuffle): StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__852, Tactic: 0, StatefulPartitionedCall/Postprocessor/Decode/sub_1:0[Float(51150)] -> StatefulPartitionedCall/Postprocessor/Decode/stack_Concat__855:0[Float(1,51150)]
Layer(Shuffle): StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__854, Tactic: 0, StatefulPartitionedCall/Postprocessor/Decode/add_3:0[Float(51150)] -> StatefulPartitionedCall/Postprocessor/Decode/stack_Concat__855:0[Float(1,51150)]
Layer(NoOp): StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__851, Tactic: 0, StatefulPartitionedCall/Postprocessor/Decode/sub:0[Float(51150)] -> StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__851:0[Float(1,51150)]
Layer(NoOp): StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__853, Tactic: 0, StatefulPartitionedCall/Postprocessor/Decode/add_2:0[Float(51150)] -> StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__853:0[Float(1,51150)]
Layer(Reformat): StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__851:0 copy, Tactic: 0, StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__851:0[Float(1,51150)] -> StatefulPartitionedCall/Postprocessor/Decode/stack_Concat__855:0[Float(1,51150)]
Layer(Reformat): StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__853:0 copy, Tactic: 0, StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__853:0[Float(1,51150)] -> StatefulPartitionedCall/Postprocessor/Decode/stack_Concat__855:0[Float(1,51150)]
Layer(Shuffle): nms/box_decoder_transpose + nms/box_decoder_reshape, Tactic: 0, StatefulPartitionedCall/Postprocessor/Decode/stack_Concat__855:0[Float(4,51150)] -> nms/box_decoder_reshape:0_3[Float(1,51150,1,4)]
Layer(PluginV2): nms/non_maximum_suppression_first, Tactic: 0, nms/box_decoder_reshape:0_3[Float(1,51150,1,4)], nms/class_net_sigmoid:0_4[Float(1,51150,3)] -> num_detections[Int32(1)], detection_boxes[Float(1,100,4)], detection_scores[Float(1,100)], detection_classes[Float(1,100)]
[11/14/2022-14:14:17] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +4, GPU +16, now: CPU 4, GPU 16 (MiB)
[11/14/2022-14:14:17] [I] [TRT] [MemUsageChange] Init CUDA: CPU +0, GPU +0, now: CPU 1021, GPU 7572 (MiB)
[11/14/2022-14:14:17] [I] [TRT] Loaded engine size: 15 MiB
[11/14/2022-14:14:17] [V] [TRT] Using cublas as a tactic source
[11/14/2022-14:14:17] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 1022, GPU 7572 (MiB)
[11/14/2022-14:14:17] [V] [TRT] Using cuDNN as a tactic source
[11/14/2022-14:14:17] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1022, GPU 7572 (MiB)
[11/14/2022-14:14:17] [V] [TRT] Deserialization required 29516 microseconds.
[11/14/2022-14:14:17] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +14, now: CPU 0, GPU 14 (MiB)
[11/14/2022-14:14:17] [I] Engine built in 395.347 sec.
[11/14/2022-14:14:17] [V] [TRT] Using cublas as a tactic source
[11/14/2022-14:14:17] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 965, GPU 7573 (MiB)
[11/14/2022-14:14:17] [V] [TRT] Using cuDNN as a tactic source
[11/14/2022-14:14:17] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 965, GPU 7573 (MiB)
[11/14/2022-14:14:17] [V] [TRT] Total per-runner device persistent memory is 13858304
[11/14/2022-14:14:17] [V] [TRT] Total per-runner host persistent memory is 185952
[11/14/2022-14:14:17] [V] [TRT] Allocated activation device memory of size 61232128
[11/14/2022-14:14:17] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +72, now: CPU 0, GPU 86 (MiB)
[11/14/2022-14:14:17] [I] Using random values for input input_tensor:0
[11/14/2022-14:14:17] [I] Created input binding for input_tensor:0 with dimensions 1x640x640x3
[11/14/2022-14:14:17] [I] Using random values for output num_detections
[11/14/2022-14:14:17] [I] Created output binding for num_detections with dimensions 1
[11/14/2022-14:14:17] [I] Using random values for output detection_boxes
[11/14/2022-14:14:17] [I] Created output binding for detection_boxes with dimensions 1x100x4
[11/14/2022-14:14:17] [I] Using random values for output detection_scores
[11/14/2022-14:14:17] [I] Created output binding for detection_scores with dimensions 1x100
[11/14/2022-14:14:17] [I] Using random values for output detection_classes
[11/14/2022-14:14:17] [I] Created output binding for detection_classes with dimensions 1x100
[11/14/2022-14:14:17] [I] Starting inference
[11/14/2022-14:14:20] [I] Warmup completed 3 queries over 200 ms
[11/14/2022-14:14:20] [I] Timing trace has 66 queries over 3.10454 s
[11/14/2022-14:14:20] [I] 
[11/14/2022-14:14:20] [I] === Trace details ===
[11/14/2022-14:14:20] [I] Trace averages of 10 runs:
[11/14/2022-14:14:20] [I] Average on 10 runs - GPU latency: 45.7836 ms - Host latency: 46.043 ms (end to end 46.0507 ms, enqueue 8.36146 ms)
[11/14/2022-14:14:20] [I] Average on 10 runs - GPU latency: 45.9495 ms - Host latency: 46.2134 ms (end to end 46.2209 ms, enqueue 9.83177 ms)
[11/14/2022-14:14:20] [I] Average on 10 runs - GPU latency: 47.5596 ms - Host latency: 47.8212 ms (end to end 47.8292 ms, enqueue 8.31304 ms)
[11/14/2022-14:14:20] [I] Average on 10 runs - GPU latency: 46.6236 ms - Host latency: 46.8883 ms (end to end 46.9071 ms, enqueue 8.56881 ms)
[11/14/2022-14:14:20] [I] Average on 10 runs - GPU latency: 49.2032 ms - Host latency: 49.4673 ms (end to end 49.4753 ms, enqueue 9.22172 ms)
[11/14/2022-14:14:20] [I] Average on 10 runs - GPU latency: 46.2323 ms - Host latency: 46.4916 ms (end to end 46.4995 ms, enqueue 8.07258 ms)
[11/14/2022-14:14:20] [I] 
[11/14/2022-14:14:20] [I] === Performance summary ===
[11/14/2022-14:14:20] [I] Throughput: 21.2592 qps
[11/14/2022-14:14:20] [I] Latency: min = 45.2538 ms, max = 54.1655 ms, mean = 47.0286 ms, median = 45.7331 ms, percentile(99%) = 54.1655 ms
[11/14/2022-14:14:20] [I] End-to-End Host Latency: min = 45.261 ms, max = 54.1731 ms, mean = 47.038 ms, median = 45.7408 ms, percentile(99%) = 54.1731 ms
[11/14/2022-14:14:20] [I] Enqueue Time: min = 6.45456 ms, max = 16.519 ms, mean = 8.63974 ms, median = 8.2549 ms, percentile(99%) = 16.519 ms
[11/14/2022-14:14:20] [I] H2D Latency: min = 0.246582 ms, max = 0.272949 ms, mean = 0.255815 ms, median = 0.254791 ms, percentile(99%) = 0.272949 ms
[11/14/2022-14:14:20] [I] GPU Compute Time: min = 44.9987 ms, max = 53.8923 ms, mean = 46.7667 ms, median = 45.4743 ms, percentile(99%) = 53.8923 ms
[11/14/2022-14:14:20] [I] D2H Latency: min = 0.00463867 ms, max = 0.0078125 ms, mean = 0.00609334 ms, median = 0.00610352 ms, percentile(99%) = 0.0078125 ms
[11/14/2022-14:14:20] [I] Total Host Walltime: 3.10454 s
[11/14/2022-14:14:20] [I] Total GPU Compute Time: 3.0866 s
[11/14/2022-14:14:20] [I] Explanations of the performance metrics are printed in the verbose logs.
[11/14/2022-14:14:20] [V] 
[11/14/2022-14:14:20] [V] === Explanations of the performance metrics ===
[11/14/2022-14:14:20] [V] Total Host Walltime: the host walltime from when the first query (after warmups) is enqueued to when the last query is completed.
[11/14/2022-14:14:20] [V] GPU Compute Time: the GPU latency to execute the kernels for a query.
[11/14/2022-14:14:20] [V] Total GPU Compute Time: the summation of the GPU Compute Time of all the queries. If this is significantly shorter than Total Host Walltime, the GPU may be under-utilized because of host-side overheads or data transfers.
[11/14/2022-14:14:20] [V] Throughput: the observed throughput computed by dividing the number of queries by the Total Host Walltime. If this is significantly lower than the reciprocal of GPU Compute Time, the GPU may be under-utilized because of host-side overheads or data transfers.
[11/14/2022-14:14:20] [V] Enqueue Time: the host latency to enqueue a query. If this is longer than GPU Compute Time, the GPU may be under-utilized.
[11/14/2022-14:14:20] [V] H2D Latency: the latency for host-to-device data transfers for input tensors of a single query.
[11/14/2022-14:14:20] [V] D2H Latency: the latency for device-to-host data transfers for output tensors of a single query.
[11/14/2022-14:14:20] [V] Latency: the summation of H2D Latency, GPU Compute Time, and D2H Latency. This is the latency to infer a single query.
[11/14/2022-14:14:20] [V] End-to-End Host Latency: the duration from when the H2D of a query is called to when the D2H of the same query is completed, which includes the latency to wait for the completion of the previous query. This is the latency of a query if multiple queries are enqueued consecutively.
[11/14/2022-14:14:20] [I] 
&&&& PASSED TensorRT.trtexec [TensorRT v8201] # ./trtexec --onnx=/home/kookmin-uav/tftrt/onnx-modify/model.onnx --saveEngine=/home/kookmin-uav/tftrt/trtengine/engine.trt --verbose