[08/05/2021-11:46:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [08/05/2021-11:46:45] [V] [TRT] *************** Autotuning format combination: Float(131072,1,8192,512) -> Float(131072,1,8192,512) *************** [08/05/2021-11:46:45] [V] [TRT] --------------- Timing Runner: Conv_31 + Relu_33 (CudnnConvolution) [08/05/2021-11:46:45] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [08/05/2021-11:46:45] [V] [TRT] --------------- Timing Runner: Conv_31 + Relu_33 (CaskConvolution) [08/05/2021-11:46:45] [V] [TRT] Conv_31 + Relu_33 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 861694390046228376 [08/05/2021-11:46:45] [V] [TRT] Tactic: 861694390046228376 Time: 0.884104 [08/05/2021-11:46:45] [V] [TRT] Conv_31 + Relu_33 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 1017870653102653567 [08/05/2021-11:46:45] [V] [TRT] Tactic: 1017870653102653567 Time: 0.883968 [08/05/2021-11:46:45] [V] [TRT] Conv_31 + Relu_33 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 5258189349241541167 [08/05/2021-11:46:45] [V] [TRT] Tactic: 5258189349241541167 Time: 0.455304 [08/05/2021-11:46:45] [V] [TRT] Conv_31 + Relu_33 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5821621277990374316 [08/05/2021-11:46:45] [V] [TRT] Tactic: 5821621277990374316 Time: 0.88192 [08/05/2021-11:46:45] [V] [TRT] Conv_31 + Relu_33 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 5863767799113001648 [08/05/2021-11:46:45] [V] [TRT] Tactic: 5863767799113001648 Time: 0.235652 [08/05/2021-11:46:45] [V] [TRT] Conv_31 + Relu_33 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -9147980667639709536 [08/05/2021-11:46:45] [V] [TRT] Tactic: -9147980667639709536 Time: 0.877952 [08/05/2021-11:46:45] [V] [TRT] Conv_31 + Relu_33 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -8850904373104590857 [08/05/2021-11:46:45] [V] [TRT] Tactic: -8850904373104590857 Time: 0.459648 [08/05/2021-11:46:45] [V] [TRT] Conv_31 + Relu_33 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7751035352149795660 [08/05/2021-11:46:45] [V] [TRT] Tactic: -7751035352149795660 Time: 0.881276 [08/05/2021-11:46:45] [V] [TRT] Conv_31 + Relu_33 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3853827649136781465 [08/05/2021-11:46:45] [V] [TRT] Tactic: -3853827649136781465 Time: 0.88998 [08/05/2021-11:46:45] [V] [TRT] Conv_31 + Relu_33 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -3263369460438823196 [08/05/2021-11:46:45] [V] [TRT] Tactic: -3263369460438823196 Time: 0.456832 [08/05/2021-11:46:45] [V] [TRT] Conv_31 + Relu_33 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -423878181466897819 [08/05/2021-11:46:45] [V] [TRT] Tactic: -423878181466897819 Time: 0.23874 [08/05/2021-11:46:45] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.235652 [08/05/2021-11:46:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648 [08/05/2021-11:46:45] [V] [TRT] *************** Autotuning Reformat:Float(131072,256,16,1) -> Float(131072,1,8192,512) *************** [08/05/2021-11:46:45] [V] [TRT] *************** Autotuning Reformat:Float(131072,1,8192,512) -> Float(131072,256,16,1) *************** [08/05/2021-11:46:45] [V] [TRT] *************** Autotuning format combination: Float(131072,256,16,1) -> Float(262144,1024,32,1) *************** [08/05/2021-11:46:45] [V] [TRT] --------------- Timing Runner: ConvTranspose_34 (CudnnDeconvolution) [08/05/2021-11:46:45] [V] [TRT] Tactic: 0 Time: 0.089988 [08/05/2021-11:46:45] [V] [TRT] Tactic: 1 Time: 0.730496 [08/05/2021-11:46:45] [V] [TRT] Tactic: 3 Time: 3.53574 [08/05/2021-11:46:45] [V] [TRT] Fastest Tactic: 0 Time: 0.089988 [08/05/2021-11:46:45] [V] [TRT] --------------- Timing Runner: ConvTranspose_34 (GemmDeconvolution) [08/05/2021-11:46:45] [V] [TRT] Deleting timing cache: 59 entries, 2 hits [08/05/2021-11:46:45] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 894, GPU 1305 (MiB) [08/05/2021-11:46:45] [E] Error[2]: [ltWrapper.cpp::setupHeuristic::327] Error Code 2: Internal Error (Assertion cublasStatus == CUBLAS_STATUS_SUCCESS failed.) [08/05/2021-11:46:45] [E] Error[2]: [builder.cpp::buildSerializedNetwork::417] Error Code 2: Internal Error (Assertion enginePtr != nullptr failed.) Segmentation fault (core dumped)