&&&& RUNNING TensorRT.trtexec [TensorRT v8001] # /usr/src/tensorrt/bin/trtexec --loadEngine=yolov4-csp_4_3_512_512_trtexec.engine --dumpProfile [04/11/2022-15:05:43] [I] === Model Options === [04/11/2022-15:05:43] [I] Format: * [04/11/2022-15:05:43] [I] Model: [04/11/2022-15:05:43] [I] Output: [04/11/2022-15:05:43] [I] === Build Options === [04/11/2022-15:05:43] [I] Max batch: 1 [04/11/2022-15:05:43] [I] Workspace: 16 MiB [04/11/2022-15:05:43] [I] minTiming: 1 [04/11/2022-15:05:43] [I] avgTiming: 8 [04/11/2022-15:05:43] [I] Precision: FP32 [04/11/2022-15:05:43] [I] Calibration: [04/11/2022-15:05:43] [I] Refit: Disabled [04/11/2022-15:05:43] [I] Sparsity: Disabled [04/11/2022-15:05:43] [I] Safe mode: Disabled [04/11/2022-15:05:43] [I] Restricted mode: Disabled [04/11/2022-15:05:43] [I] Save engine: [04/11/2022-15:05:43] [I] Load engine: yolov4-csp_4_3_512_512_trtexec.engine [04/11/2022-15:05:43] [I] NVTX verbosity: 0 [04/11/2022-15:05:43] [I] Tactic sources: Using default tactic sources [04/11/2022-15:05:43] [I] timingCacheMode: local [04/11/2022-15:05:43] [I] timingCacheFile: [04/11/2022-15:05:43] [I] Input(s)s format: fp32:CHW [04/11/2022-15:05:43] [I] Output(s)s format: fp32:CHW [04/11/2022-15:05:43] [I] Input build shapes: model [04/11/2022-15:05:43] [I] Input calibration shapes: model [04/11/2022-15:05:43] [I] === System Options === [04/11/2022-15:05:43] [I] Device: 0 [04/11/2022-15:05:43] [I] DLACore: [04/11/2022-15:05:43] [I] Plugins: [04/11/2022-15:05:43] [I] === Inference Options === [04/11/2022-15:05:43] [I] Batch: 1 [04/11/2022-15:05:43] [I] Input inference shapes: model [04/11/2022-15:05:43] [I] Iterations: 10 [04/11/2022-15:05:43] [I] Duration: 3s (+ 200ms warm up) [04/11/2022-15:05:43] [I] Sleep time: 0ms [04/11/2022-15:05:43] [I] Streams: 1 [04/11/2022-15:05:43] [I] ExposeDMA: Disabled [04/11/2022-15:05:43] [I] Data transfers: Enabled [04/11/2022-15:05:43] [I] Spin-wait: Disabled [04/11/2022-15:05:43] [I] Multithreading: Disabled [04/11/2022-15:05:43] [I] CUDA Graph: Disabled [04/11/2022-15:05:43] [I] Separate profiling: Disabled [04/11/2022-15:05:43] [I] Time Deserialize: Disabled [04/11/2022-15:05:43] [I] Time Refit: Disabled [04/11/2022-15:05:43] [I] Skip inference: Disabled [04/11/2022-15:05:43] [I] Inputs: [04/11/2022-15:05:43] [I] === Reporting Options === [04/11/2022-15:05:43] [I] Verbose: Disabled [04/11/2022-15:05:43] [I] Averages: 10 inferences [04/11/2022-15:05:43] [I] Percentile: 99 [04/11/2022-15:05:43] [I] Dump refittable layers:Disabled [04/11/2022-15:05:43] [I] Dump output: Disabled [04/11/2022-15:05:43] [I] Profile: Enabled [04/11/2022-15:05:43] [I] Export timing to JSON file: [04/11/2022-15:05:43] [I] Export output to JSON file: [04/11/2022-15:05:43] [I] Export profile to JSON file: [04/11/2022-15:05:43] [I] [04/11/2022-15:05:43] [I] === Device Information === [04/11/2022-15:05:43] [I] Selected Device: NVIDIA GeForce RTX 3090 [04/11/2022-15:05:43] [I] Compute Capability: 8.6 [04/11/2022-15:05:43] [I] SMs: 82 [04/11/2022-15:05:43] [I] Compute Clock Rate: 1.725 GHz [04/11/2022-15:05:43] [I] Device Global Memory: 24268 MiB [04/11/2022-15:05:43] [I] Shared Memory per SM: 100 KiB [04/11/2022-15:05:43] [I] Memory Bus Width: 384 bits (ECC disabled) [04/11/2022-15:05:43] [I] Memory Clock Rate: 9.751 GHz [04/11/2022-15:05:43] [I] [04/11/2022-15:05:43] [I] TensorRT version: 8001 [04/11/2022-15:05:43] [I] [TRT] [MemUsageChange] Init CUDA: CPU +534, GPU +0, now: CPU 685, GPU 1485 (MiB) [04/11/2022-15:05:43] [I] [TRT] Loaded engine size: 143 MB [04/11/2022-15:05:43] [I] [TRT] [MemUsageSnapshot] deserializeCudaEngine begin: CPU 685 MiB, GPU 1485 MiB [04/11/2022-15:05:44] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +790, GPU +340, now: CPU 1505, GPU 1933 (MiB) [04/11/2022-15:05:45] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +126, GPU +58, now: CPU 1631, GPU 1991 (MiB) [04/11/2022-15:05:45] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 1631, GPU 1973 (MiB) [04/11/2022-15:05:45] [I] [TRT] [MemUsageSnapshot] deserializeCudaEngine end: CPU 1631 MiB, GPU 1973 MiB [04/11/2022-15:05:45] [I] Engine loaded in 1.81855 sec. [04/11/2022-15:05:45] [I] [TRT] [MemUsageSnapshot] ExecutionContext creation begin: CPU 1488 MiB, GPU 1973 MiB [04/11/2022-15:05:45] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +10, now: CPU 1488, GPU 1983 (MiB) [04/11/2022-15:05:45] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +8, now: CPU 1488, GPU 1991 (MiB) [04/11/2022-15:05:45] [I] [TRT] [MemUsageSnapshot] ExecutionContext creation end: CPU 1489 MiB, GPU 2269 MiB [04/11/2022-15:05:45] [I] Created input binding for input with dimensions 4x3x512x512 [04/11/2022-15:05:45] [I] Created output binding for num_detections with dimensions 4x1 [04/11/2022-15:05:45] [I] Created output binding for nmsed_boxes with dimensions 4x1000x4 [04/11/2022-15:05:45] [I] Created output binding for nmsed_scores with dimensions 4x1000 [04/11/2022-15:05:45] [I] Created output binding for nmsed_classes with dimensions 4x1000 [04/11/2022-15:05:45] [I] Starting inference [04/11/2022-15:05:48] [I] Warmup completed 20 queries over 200 ms [04/11/2022-15:05:48] [I] Timing trace has 331 queries over 3.02054 s [04/11/2022-15:05:48] [I] [04/11/2022-15:05:48] [I] === Trace details === [04/11/2022-15:05:48] [I] Trace averages of 10 runs: [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 7.87161 ms - Host latency: 8.84804 ms (end to end 8.86053 ms, enqueue 8.82732 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 8.23645 ms - Host latency: 9.2134 ms (end to end 9.22573 ms, enqueue 9.19132 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 7.9173 ms - Host latency: 8.89541 ms (end to end 8.90695 ms, enqueue 8.8713 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 8.49687 ms - Host latency: 9.47875 ms (end to end 9.49158 ms, enqueue 9.4411 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 8.79852 ms - Host latency: 9.77731 ms (end to end 9.78975 ms, enqueue 9.75255 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 7.89954 ms - Host latency: 8.87589 ms (end to end 8.88775 ms, enqueue 8.85433 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 7.93693 ms - Host latency: 8.9125 ms (end to end 8.92436 ms, enqueue 8.89351 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 7.90356 ms - Host latency: 8.87914 ms (end to end 8.89106 ms, enqueue 8.8597 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 7.89515 ms - Host latency: 8.87189 ms (end to end 8.88397 ms, enqueue 8.85057 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 8.01538 ms - Host latency: 8.99665 ms (end to end 9.01701 ms, enqueue 8.97814 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 8.04591 ms - Host latency: 9.02872 ms (end to end 9.04186 ms, enqueue 8.99758 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 8.19379 ms - Host latency: 9.17465 ms (end to end 9.18765 ms, enqueue 9.14603 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 7.92527 ms - Host latency: 8.90439 ms (end to end 8.91812 ms, enqueue 8.87996 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 7.94614 ms - Host latency: 8.92495 ms (end to end 8.9381 ms, enqueue 8.89985 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 8.4579 ms - Host latency: 9.44155 ms (end to end 9.47358 ms, enqueue 9.2755 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 7.91688 ms - Host latency: 8.8965 ms (end to end 8.90789 ms, enqueue 8.86825 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 8.10826 ms - Host latency: 9.09019 ms (end to end 9.10312 ms, enqueue 9.06185 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 7.97911 ms - Host latency: 8.95837 ms (end to end 8.97013 ms, enqueue 8.93121 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 8.04028 ms - Host latency: 9.0198 ms (end to end 9.03156 ms, enqueue 8.99263 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 8.00277 ms - Host latency: 8.98259 ms (end to end 8.99396 ms, enqueue 8.95427 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 7.90225 ms - Host latency: 8.88071 ms (end to end 8.89434 ms, enqueue 8.85621 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 8.05322 ms - Host latency: 9.03464 ms (end to end 9.04785 ms, enqueue 9.00581 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 7.9967 ms - Host latency: 8.97722 ms (end to end 8.98994 ms, enqueue 8.93069 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 8.16011 ms - Host latency: 9.14324 ms (end to end 9.17229 ms, enqueue 9.12952 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 8.26382 ms - Host latency: 9.24565 ms (end to end 9.25723 ms, enqueue 9.21406 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 8.34856 ms - Host latency: 9.33232 ms (end to end 9.37427 ms, enqueue 9.21057 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 9.57202 ms - Host latency: 10.557 ms (end to end 10.5709 ms, enqueue 10.53 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 8.19204 ms - Host latency: 9.17354 ms (end to end 9.18638 ms, enqueue 9.14429 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 7.92822 ms - Host latency: 8.90735 ms (end to end 8.92065 ms, enqueue 8.8822 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 8.00962 ms - Host latency: 8.99084 ms (end to end 9.01902 ms, enqueue 8.97847 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 7.99453 ms - Host latency: 8.97336 ms (end to end 8.98579 ms, enqueue 8.94817 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 8.1853 ms - Host latency: 9.16768 ms (end to end 9.18154 ms, enqueue 9.13762 ms) [04/11/2022-15:05:48] [I] Average on 10 runs - GPU latency: 8.01099 ms - Host latency: 8.99246 ms (end to end 9.0053 ms, enqueue 8.96416 ms) [04/11/2022-15:05:48] [I] [04/11/2022-15:05:48] [I] === Performance summary === [04/11/2022-15:05:48] [I] Throughput: 109.583 qps [04/11/2022-15:05:48] [I] Latency: min = 8.78711 ms, max = 22.4097 ms, mean = 9.10935 ms, median = 8.89136 ms, percentile(99%) = 12.1527 ms [04/11/2022-15:05:48] [I] End-to-End Host Latency: min = 8.79932 ms, max = 22.4207 ms, mean = 9.12462 ms, median = 8.90405 ms, percentile(99%) = 12.1676 ms [04/11/2022-15:05:48] [I] Enqueue Time: min = 8.76576 ms, max = 22.3757 ms, mean = 9.07634 ms, median = 8.86551 ms, percentile(99%) = 12.1354 ms [04/11/2022-15:05:48] [I] H2D Latency: min = 0.960449 ms, max = 0.98999 ms, mean = 0.962172 ms, median = 0.961304 ms, percentile(99%) = 0.975586 ms [04/11/2022-15:05:48] [I] GPU Compute Time: min = 7.81219 ms, max = 21.4282 ms, mean = 8.12925 ms, median = 7.91235 ms, percentile(99%) = 11.177 ms [04/11/2022-15:05:48] [I] D2H Latency: min = 0.013916 ms, max = 0.0427246 ms, mean = 0.0179356 ms, median = 0.0166016 ms, percentile(99%) = 0.0368652 ms [04/11/2022-15:05:48] [I] Total Host Walltime: 3.02054 s [04/11/2022-15:05:48] [I] Total GPU Compute Time: 2.69078 s [04/11/2022-15:05:48] [04/11/2022-15:05:48] [04/11/2022-15:05:48] [I] Explanations of the performance metrics are printed in the verbose logs. [04/11/2022-15:05:48] [I] [04/11/2022-15:05:48] [I] [04/11/2022-15:05:48] [I] === Profile (351 iterations ) === [04/11/2022-15:05:48] [I] Layer Time (ms) Avg. Time (ms) Time % [04/11/2022-15:05:48] [I] 2017[Constant] 0.83 0.0024 0.0 [04/11/2022-15:05:48] [I] 1680[Constant] 0.94 0.0027 0.0 [04/11/2022-15:05:48] [I] 1343[Constant] 0.66 0.0019 0.0 [04/11/2022-15:05:48] [I] Reformatting CopyNode for Input Tensor 0 to Conv_0 14.08 0.0401 0.5 [04/11/2022-15:05:48] [I] Conv_0 38.99 0.1111 1.4 [04/11/2022-15:05:48] [I] PWN(PWN(Softplus_1, PWN(Tanh_2)), Mul_3) 58.33 0.1662 2.1 [04/11/2022-15:05:48] [I] Conv_4 + PWN(PWN(Softplus_5, PWN(Tanh_6)), Mul_7) 66.28 0.1888 2.3 [04/11/2022-15:05:48] [I] Conv_8 + PWN(PWN(Softplus_9, PWN(Tanh_10)), Mul_11) 24.00 0.0684 0.8 [04/11/2022-15:05:48] [I] Conv_12 37.49 0.1068 1.3 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_13, PWN(Tanh_14)), Mul_15), Add_16) 43.25 0.1232 1.5 [04/11/2022-15:05:48] [I] Conv_17 + PWN(PWN(Softplus_18, PWN(Tanh_19)), Mul_20) 42.12 0.1200 1.5 [04/11/2022-15:05:48] [I] Conv_21 || Conv_25 17.19 0.0490 0.6 [04/11/2022-15:05:48] [I] PWN(PWN(Softplus_22, PWN(Tanh_23)), Mul_24) 9.33 0.0266 0.3 [04/11/2022-15:05:48] [I] PWN(PWN(Softplus_26, PWN(Tanh_27)), Mul_28) 8.98 0.0256 0.3 [04/11/2022-15:05:48] [I] Conv_29 + PWN(PWN(Softplus_30, PWN(Tanh_31)), Mul_32) 10.65 0.0303 0.4 [04/11/2022-15:05:48] [I] Conv_33 23.99 0.0683 0.8 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_34, PWN(Tanh_35)), Mul_36), Add_37) 12.48 0.0355 0.4 [04/11/2022-15:05:48] [I] Conv_38 + PWN(PWN(Softplus_39, PWN(Tanh_40)), Mul_41) 10.43 0.0297 0.4 [04/11/2022-15:05:48] [I] Conv_42 23.77 0.0677 0.8 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_43, PWN(Tanh_44)), Mul_45), Add_46) 12.50 0.0356 0.4 [04/11/2022-15:05:48] [I] Conv_47 + PWN(PWN(Softplus_48, PWN(Tanh_49)), Mul_50) 10.57 0.0301 0.4 [04/11/2022-15:05:48] [I] Conv_52 + PWN(PWN(Softplus_53, PWN(Tanh_54)), Mul_55) 23.19 0.0661 0.8 [04/11/2022-15:05:48] [I] Conv_56 + PWN(PWN(Softplus_57, PWN(Tanh_58)), Mul_59) 36.15 0.1030 1.3 [04/11/2022-15:05:48] [I] Conv_60 || Conv_64 12.06 0.0344 0.4 [04/11/2022-15:05:48] [I] PWN(PWN(Softplus_61, PWN(Tanh_62)), Mul_63) 6.07 0.0173 0.2 [04/11/2022-15:05:48] [I] PWN(PWN(Softplus_65, PWN(Tanh_66)), Mul_67) 5.50 0.0157 0.2 [04/11/2022-15:05:48] [I] Conv_68 + PWN(PWN(Softplus_69, PWN(Tanh_70)), Mul_71) 6.75 0.0192 0.2 [04/11/2022-15:05:48] [I] Conv_72 18.26 0.0520 0.6 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_73, PWN(Tanh_74)), Mul_75), Add_76) 7.32 0.0208 0.3 [04/11/2022-15:05:48] [I] Conv_77 + PWN(PWN(Softplus_78, PWN(Tanh_79)), Mul_80) 6.96 0.0198 0.2 [04/11/2022-15:05:48] [I] Conv_81 17.81 0.0507 0.6 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_82, PWN(Tanh_83)), Mul_84), Add_85) 7.29 0.0208 0.3 [04/11/2022-15:05:48] [I] Conv_86 + PWN(PWN(Softplus_87, PWN(Tanh_88)), Mul_89) 6.93 0.0198 0.2 [04/11/2022-15:05:48] [I] Conv_90 17.94 0.0511 0.6 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_91, PWN(Tanh_92)), Mul_93), Add_94) 7.34 0.0209 0.3 [04/11/2022-15:05:48] [I] Conv_95 + PWN(PWN(Softplus_96, PWN(Tanh_97)), Mul_98) 6.93 0.0198 0.2 [04/11/2022-15:05:48] [I] Conv_99 17.92 0.0511 0.6 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_100, PWN(Tanh_101)), Mul_102), Add_103) 7.27 0.0207 0.3 [04/11/2022-15:05:48] [I] Conv_104 + PWN(PWN(Softplus_105, PWN(Tanh_106)), Mul_107) 6.88 0.0196 0.2 [04/11/2022-15:05:48] [I] Conv_108 17.90 0.0510 0.6 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_109, PWN(Tanh_110)), Mul_111), Add_112) 7.34 0.0209 0.3 [04/11/2022-15:05:48] [I] Conv_113 + PWN(PWN(Softplus_114, PWN(Tanh_115)), Mul_116) 6.91 0.0197 0.2 [04/11/2022-15:05:48] [I] Conv_117 19.99 0.0569 0.7 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_118, PWN(Tanh_119)), Mul_120), Add_121) 12.92 0.0368 0.5 [04/11/2022-15:05:48] [I] Conv_122 + PWN(PWN(Softplus_123, PWN(Tanh_124)), Mul_125) 6.90 0.0197 0.2 [04/11/2022-15:05:48] [I] Conv_126 17.88 0.0509 0.6 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_127, PWN(Tanh_128)), Mul_129), Add_130) 7.36 0.0210 0.3 [04/11/2022-15:05:48] [I] Conv_131 + PWN(PWN(Softplus_132, PWN(Tanh_133)), Mul_134) 6.93 0.0197 0.2 [04/11/2022-15:05:48] [I] Conv_135 17.88 0.0509 0.6 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_136, PWN(Tanh_137)), Mul_138), Add_139) 7.30 0.0208 0.3 [04/11/2022-15:05:48] [I] Conv_140 + PWN(PWN(Softplus_141, PWN(Tanh_142)), Mul_143) 6.95 0.0198 0.2 [04/11/2022-15:05:48] [I] Conv_145 + PWN(PWN(Softplus_146, PWN(Tanh_147)), Mul_148) 14.62 0.0416 0.5 [04/11/2022-15:05:48] [I] Conv_149 + PWN(PWN(Softplus_150, PWN(Tanh_151)), Mul_152) 32.94 0.0939 1.2 [04/11/2022-15:05:48] [I] Conv_506 + PWN(PWN(Softplus_507, PWN(Tanh_508)), Mul_509) 9.67 0.0275 0.3 [04/11/2022-15:05:48] [I] Conv_153 || Conv_157 16.90 0.0481 0.6 [04/11/2022-15:05:48] [I] PWN(PWN(Softplus_154, PWN(Tanh_155)), Mul_156) 3.32 0.0095 0.1 [04/11/2022-15:05:48] [I] PWN(PWN(Softplus_158, PWN(Tanh_159)), Mul_160) 3.41 0.0097 0.1 [04/11/2022-15:05:48] [I] Conv_161 + PWN(PWN(Softplus_162, PWN(Tanh_163)), Mul_164) 5.87 0.0167 0.2 [04/11/2022-15:05:48] [I] Conv_165 17.34 0.0494 0.6 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_166, PWN(Tanh_167)), Mul_168), Add_169) 3.79 0.0108 0.1 [04/11/2022-15:05:48] [I] Conv_170 + PWN(PWN(Softplus_171, PWN(Tanh_172)), Mul_173) 5.89 0.0168 0.2 [04/11/2022-15:05:48] [I] Conv_174 17.00 0.0484 0.6 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_175, PWN(Tanh_176)), Mul_177), Add_178) 3.93 0.0112 0.1 [04/11/2022-15:05:48] [I] Conv_179 + PWN(PWN(Softplus_180, PWN(Tanh_181)), Mul_182) 5.86 0.0167 0.2 [04/11/2022-15:05:48] [I] Conv_183 16.90 0.0482 0.6 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_184, PWN(Tanh_185)), Mul_186), Add_187) 3.94 0.0112 0.1 [04/11/2022-15:05:48] [I] Conv_188 + PWN(PWN(Softplus_189, PWN(Tanh_190)), Mul_191) 5.76 0.0164 0.2 [04/11/2022-15:05:48] [I] Conv_192 16.97 0.0483 0.6 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_193, PWN(Tanh_194)), Mul_195), Add_196) 3.90 0.0111 0.1 [04/11/2022-15:05:48] [I] Conv_197 + PWN(PWN(Softplus_198, PWN(Tanh_199)), Mul_200) 5.87 0.0167 0.2 [04/11/2022-15:05:48] [I] Conv_201 17.01 0.0485 0.6 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_202, PWN(Tanh_203)), Mul_204), Add_205) 3.93 0.0112 0.1 [04/11/2022-15:05:48] [I] Conv_206 + PWN(PWN(Softplus_207, PWN(Tanh_208)), Mul_209) 5.75 0.0164 0.2 [04/11/2022-15:05:48] [I] Conv_210 16.97 0.0483 0.6 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_211, PWN(Tanh_212)), Mul_213), Add_214) 3.93 0.0112 0.1 [04/11/2022-15:05:48] [I] Conv_215 + PWN(PWN(Softplus_216, PWN(Tanh_217)), Mul_218) 5.79 0.0165 0.2 [04/11/2022-15:05:48] [I] Conv_219 16.95 0.0483 0.6 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_220, PWN(Tanh_221)), Mul_222), Add_223) 3.96 0.0113 0.1 [04/11/2022-15:05:48] [I] Conv_224 + PWN(PWN(Softplus_225, PWN(Tanh_226)), Mul_227) 5.75 0.0164 0.2 [04/11/2022-15:05:48] [I] Conv_228 17.02 0.0485 0.6 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_229, PWN(Tanh_230)), Mul_231), Add_232) 3.86 0.0110 0.1 [04/11/2022-15:05:48] [I] Conv_233 + PWN(PWN(Softplus_234, PWN(Tanh_235)), Mul_236) 5.90 0.0168 0.2 [04/11/2022-15:05:48] [I] Conv_238 + PWN(PWN(Softplus_239, PWN(Tanh_240)), Mul_241) 11.22 0.0320 0.4 [04/11/2022-15:05:48] [I] Conv_242 + PWN(PWN(Softplus_243, PWN(Tanh_244)), Mul_245) 32.22 0.0918 1.1 [04/11/2022-15:05:48] [I] Conv_402 + PWN(PWN(Softplus_403, PWN(Tanh_404)), Mul_405) 7.45 0.0212 0.3 [04/11/2022-15:05:48] [I] Conv_246 || Conv_250 9.53 0.0272 0.3 [04/11/2022-15:05:48] [I] PWN(PWN(Softplus_247, PWN(Tanh_248)), Mul_249) 2.24 0.0064 0.1 [04/11/2022-15:05:48] [I] PWN(PWN(Softplus_251, PWN(Tanh_252)), Mul_253) 2.13 0.0061 0.1 [04/11/2022-15:05:48] [I] Conv_254 + PWN(PWN(Softplus_255, PWN(Tanh_256)), Mul_257) 4.91 0.0140 0.2 [04/11/2022-15:05:48] [I] Conv_258 17.12 0.0488 0.6 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_259, PWN(Tanh_260)), Mul_261), Add_262) 2.59 0.0074 0.1 [04/11/2022-15:05:48] [I] Conv_263 + PWN(PWN(Softplus_264, PWN(Tanh_265)), Mul_266) 4.84 0.0138 0.2 [04/11/2022-15:05:48] [I] Conv_267 17.05 0.0486 0.6 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_268, PWN(Tanh_269)), Mul_270), Add_271) 2.58 0.0074 0.1 [04/11/2022-15:05:48] [I] Conv_272 + PWN(PWN(Softplus_273, PWN(Tanh_274)), Mul_275) 4.87 0.0139 0.2 [04/11/2022-15:05:48] [I] Conv_276 17.04 0.0486 0.6 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_277, PWN(Tanh_278)), Mul_279), Add_280) 2.60 0.0074 0.1 [04/11/2022-15:05:48] [I] Conv_281 + PWN(PWN(Softplus_282, PWN(Tanh_283)), Mul_284) 4.89 0.0139 0.2 [04/11/2022-15:05:48] [I] Conv_285 17.02 0.0485 0.6 [04/11/2022-15:05:48] [I] PWN(PWN(PWN(Softplus_286, PWN(Tanh_287)), Mul_288), Add_289) 2.59 0.0074 0.1 [04/11/2022-15:05:48] [I] Conv_290 + PWN(PWN(Softplus_291, PWN(Tanh_292)), Mul_293) 4.94 0.0141 0.2 [04/11/2022-15:05:48] [I] Conv_295 + PWN(PWN(Softplus_296, PWN(Tanh_297)), Mul_298) 10.51 0.0299 0.4 [04/11/2022-15:05:48] [I] Conv_299 || Conv_303 9.43 0.0269 0.3 [04/11/2022-15:05:48] [I] PWN(PWN(Softplus_300, PWN(Tanh_301)), Mul_302) 2.32 0.0066 0.1 [04/11/2022-15:05:48] [I] PWN(PWN(Softplus_304, PWN(Tanh_305)), Mul_306) 2.13 0.0061 0.1 [04/11/2022-15:05:48] [I] Conv_307 + PWN(PWN(Softplus_308, PWN(Tanh_309)), Mul_310) 17.88 0.0509 0.6 [04/11/2022-15:05:48] [I] Conv_311 + PWN(PWN(Softplus_312, PWN(Tanh_313)), Mul_314) 4.91 0.0140 0.2 [04/11/2022-15:05:48] [I] MaxPool_315 4.10 0.0117 0.1 [04/11/2022-15:05:48] [I] MaxPool_316 7.72 0.0220 0.3 [04/11/2022-15:05:48] [I] MaxPool_317 13.96 0.0398 0.5 [04/11/2022-15:05:48] [I] 1065 copy 2.63 0.0075 0.1 [04/11/2022-15:05:48] [I] Conv_319 + PWN(PWN(Softplus_320, PWN(Tanh_321)), Mul_322) 10.23 0.0292 0.4 [04/11/2022-15:05:48] [I] Conv_323 + PWN(PWN(Softplus_324, PWN(Tanh_325)), Mul_326) 17.99 0.0512 0.6 [04/11/2022-15:05:48] [I] Conv_328 + PWN(PWN(Softplus_329, PWN(Tanh_330)), Mul_331) 6.78 0.0193 0.2 [04/11/2022-15:05:48] [I] Conv_332 + PWN(PWN(Softplus_333, PWN(Tanh_334)), Mul_335) 3.97 0.0113 0.1 [04/11/2022-15:05:48] [I] Reformatting CopyNode for Input Tensor 0 to Reshape_353 1.83 0.0052 0.1 [04/11/2022-15:05:48] [I] Expand_379 6.22 0.0177 0.2 [04/11/2022-15:05:48] [I] Reformatting CopyNode for Output Tensor 0 to Reshape_401 3.18 0.0091 0.1 [04/11/2022-15:05:48] [I] Conv_407 + PWN(PWN(Softplus_408, PWN(Tanh_409)), Mul_410) 7.49 0.0213 0.3 [04/11/2022-15:05:48] [I] Conv_411 || Conv_415 7.19 0.0205 0.3 [04/11/2022-15:05:48] [I] PWN(PWN(Softplus_412, PWN(Tanh_413)), Mul_414) 3.29 0.0094 0.1 [04/11/2022-15:05:48] [I] PWN(PWN(Softplus_416, PWN(Tanh_417)), Mul_418) 3.36 0.0096 0.1 [04/11/2022-15:05:48] [I] Conv_419 + PWN(PWN(Softplus_420, PWN(Tanh_421)), Mul_422) 18.81 0.0536 0.7 [04/11/2022-15:05:48] [I] Conv_423 + PWN(PWN(Softplus_424, PWN(Tanh_425)), Mul_426) 6.05 0.0172 0.2 [04/11/2022-15:05:48] [I] Conv_427 + PWN(PWN(Softplus_428, PWN(Tanh_429)), Mul_430) 20.64 0.0588 0.7 [04/11/2022-15:05:48] [I] Conv_432 + PWN(PWN(Softplus_433, PWN(Tanh_434)), Mul_435) 7.96 0.0227 0.3 [04/11/2022-15:05:48] [I] Conv_436 + PWN(PWN(Softplus_437, PWN(Tanh_438)), Mul_439) 4.45 0.0127 0.2 [04/11/2022-15:05:48] [I] Reformatting CopyNode for Input Tensor 0 to Reshape_457 2.50 0.0071 0.1 [04/11/2022-15:05:48] [I] Expand_483 11.05 0.0315 0.4 [04/11/2022-15:05:48] [I] Reformatting CopyNode for Output Tensor 0 to Reshape_505 5.30 0.0151 0.2 [04/11/2022-15:05:48] [I] Conv_511 + PWN(PWN(Softplus_512, PWN(Tanh_513)), Mul_514) 9.14 0.0260 0.3 [04/11/2022-15:05:48] [I] Conv_515 || Conv_519 9.31 0.0265 0.3 [04/11/2022-15:05:48] [I] PWN(PWN(Softplus_516, PWN(Tanh_517)), Mul_518) 6.05 0.0172 0.2 [04/11/2022-15:05:48] [I] PWN(PWN(Softplus_520, PWN(Tanh_521)), Mul_522) 5.50 0.0157 0.2 [04/11/2022-15:05:48] [I] Conv_523 + PWN(PWN(Softplus_524, PWN(Tanh_525)), Mul_526) 19.27 0.0549 0.7 [04/11/2022-15:05:48] [I] Conv_527 + PWN(PWN(Softplus_528, PWN(Tanh_529)), Mul_530) 6.63 0.0189 0.2 [04/11/2022-15:05:48] [I] Conv_531 + PWN(PWN(Softplus_532, PWN(Tanh_533)), Mul_534) 19.10 0.0544 0.7 [04/11/2022-15:05:48] [I] Conv_536 + PWN(PWN(Softplus_537, PWN(Tanh_538)), Mul_539) 8.75 0.0249 0.3 [04/11/2022-15:05:48] [I] Conv_540 + PWN(PWN(Softplus_541, PWN(Tanh_542)), Mul_543) 35.55 0.1013 1.3 [04/11/2022-15:05:48] [I] Conv_812 + PWN(PWN(Softplus_813, PWN(Tanh_814)), Mul_815) 11.49 0.0327 0.4 [04/11/2022-15:05:48] [I] Conv_544 + PWN(Sigmoid_545) 12.78 0.0364 0.4 [04/11/2022-15:05:48] [I] Reformatting CopyNode for Output Tensor 0 to Conv_544 + PWN(Sigmoid_545) 8.85 0.0252 0.3 [04/11/2022-15:05:48] [I] Conv_817 + PWN(PWN(Softplus_818, PWN(Tanh_819)), Mul_820) 7.67 0.0218 0.3 [04/11/2022-15:05:48] [I] Slice_559 1.67 0.0048 0.1 [04/11/2022-15:05:48] [I] Slice_564 1.94 0.0055 0.1 [04/11/2022-15:05:48] [I] Slice_569 13.43 0.0383 0.5 [04/11/2022-15:05:48] [I] Slice_574 3.56 0.0101 0.1 [04/11/2022-15:05:48] [I] Slice_579 1.62 0.0046 0.1 [04/11/2022-15:05:48] [I] Slice_584 1.90 0.0054 0.1 [04/11/2022-15:05:48] [I] Slice_589 1.66 0.0047 0.1 [04/11/2022-15:05:48] [I] Slice_594 3.68 0.0105 0.1 [04/11/2022-15:05:48] [I] Slice_599 1.63 0.0046 0.1 [04/11/2022-15:05:48] [I] Slice_604 1.99 0.0057 0.1 [04/11/2022-15:05:48] [I] Slice_609 1.65 0.0047 0.1 [04/11/2022-15:05:48] [I] Slice_614 3.69 0.0105 0.1 [04/11/2022-15:05:48] [I] Cast_738 1.62 0.0046 0.1 [04/11/2022-15:05:48] [I] Cast_736 1.53 0.0044 0.1 [04/11/2022-15:05:48] [I] PWN(1434 + (Unnamed Layer* 614) [Shuffle] + Mul_640, PWN(1436 + (Unnamed Layer* 644) [Shuffle], Sub_642)) 1.89 0.0054 0.1 [04/11/2022-15:05:48] [I] PWN(1438 + (Unnamed Layer* 617) [Shuffle] + Mul_644, PWN(2646 + (Unnamed Layer* 647) [Shuffle], Pow_645)) 1.86 0.0053 0.1 [04/11/2022-15:05:48] [I] Conv_821 || Conv_825 7.15 0.0204 0.3 [04/11/2022-15:05:48] [I] Slice_650 1.69 0.0048 0.1 [04/11/2022-15:05:48] [I] Slice_657 1.77 0.0050 0.1 [04/11/2022-15:05:48] [I] Slice_678 1.67 0.0048 0.1 [04/11/2022-15:05:48] [I] Slice_685 1.71 0.0049 0.1 [04/11/2022-15:05:48] [I] Slice_706 1.66 0.0047 0.1 [04/11/2022-15:05:48] [I] Slice_713 1.73 0.0049 0.1 [04/11/2022-15:05:48] [I] Slice_664 1.67 0.0048 0.1 [04/11/2022-15:05:48] [I] Slice_671 1.78 0.0051 0.1 [04/11/2022-15:05:48] [I] Slice_692 1.67 0.0048 0.1 [04/11/2022-15:05:48] [I] Slice_699 1.64 0.0047 0.1 [04/11/2022-15:05:48] [I] Slice_720 1.70 0.0048 0.1 [04/11/2022-15:05:48] [I] Slice_727 1.64 0.0047 0.1 [04/11/2022-15:05:48] [I] Reshape_630 + Transpose_631 14.59 0.0416 0.5 [04/11/2022-15:05:48] [I] 1448 + Add_652 1.88 0.0053 0.1 [04/11/2022-15:05:48] [I] 1455 + Add_659 2.05 0.0058 0.1 [04/11/2022-15:05:48] [I] 1476 + Add_680 1.79 0.0051 0.1 [04/11/2022-15:05:48] [I] 1483 + Add_687 1.79 0.0051 0.1 [04/11/2022-15:05:48] [I] 1504 + Add_708 1.78 0.0051 0.1 [04/11/2022-15:05:48] [I] 1511 + Add_715 1.82 0.0052 0.1 [04/11/2022-15:05:48] [I] 1462 + (Unnamed Layer* 691) [Shuffle] + Mul_666 1.76 0.0050 0.1 [04/11/2022-15:05:48] [I] 1469 + (Unnamed Layer* 694) [Shuffle] + Mul_673 1.78 0.0051 0.1 [04/11/2022-15:05:48] [I] 1490 + (Unnamed Layer* 701) [Shuffle] + Mul_694 1.78 0.0051 0.1 [04/11/2022-15:05:48] [I] 1497 + (Unnamed Layer* 704) [Shuffle] + Mul_701 1.90 0.0054 0.1 [04/11/2022-15:05:48] [I] 1518 + (Unnamed Layer* 711) [Shuffle] + Mul_722 1.75 0.0050 0.1 [04/11/2022-15:05:48] [I] 1525 + (Unnamed Layer* 714) [Shuffle] + Mul_729 1.83 0.0052 0.1 [04/11/2022-15:05:48] [I] PWN(PWN(Softplus_822, PWN(Tanh_823)), Mul_824) 4.07 0.0116 0.1 [04/11/2022-15:05:48] [I] PWN(PWN(Softplus_826, PWN(Tanh_827)), Mul_828) 3.50 0.0100 0.1 [04/11/2022-15:05:48] [I] 1527 copy 2.07 0.0059 0.1 [04/11/2022-15:05:48] [I] 1529 copy 1.85 0.0053 0.1 [04/11/2022-15:05:48] [I] 1528 copy 1.77 0.0050 0.1 [04/11/2022-15:05:48] [I] 1530 copy 1.68 0.0048 0.1 [04/11/2022-15:05:48] [I] Conv_829 + PWN(PWN(Softplus_830, PWN(Tanh_831)), Mul_832) 18.39 0.0524 0.6 [04/11/2022-15:05:48] [I] Mul_811 8.71 0.0248 0.3 [04/11/2022-15:05:48] [I] Div_737 2.09 0.0060 0.1 [04/11/2022-15:05:48] [I] Div_739 2.15 0.0061 0.1 [04/11/2022-15:05:48] [I] Slice_744 1.62 0.0046 0.1 [04/11/2022-15:05:48] [I] Slice_768 1.72 0.0049 0.1 [04/11/2022-15:05:48] [I] Slice_756 1.62 0.0046 0.1 [04/11/2022-15:05:48] [I] Slice_780 1.58 0.0045 0.1 [04/11/2022-15:05:48] [I] Conv_833 + PWN(PWN(Softplus_834, PWN(Tanh_835)), Mul_836) 6.06 0.0173 0.2 [04/11/2022-15:05:48] [I] PWN(PWN(1593 + (Unnamed Layer* 761) [Shuffle], Mul_789), Sub_790) 1.70 0.0048 0.1 [04/11/2022-15:05:48] [I] PWN(PWN(1596 + (Unnamed Layer* 764) [Shuffle], Mul_792), Sub_793) 1.76 0.0050 0.1 [04/11/2022-15:05:48] [I] Add_794 1.80 0.0051 0.1 [04/11/2022-15:05:48] [I] Add_795 1.72 0.0049 0.1 [04/11/2022-15:05:48] [I] 1595 copy 1.80 0.0051 0.1 [04/11/2022-15:05:48] [I] 1598 copy 1.76 0.0050 0.1 [04/11/2022-15:05:48] [I] 1599 copy 1.75 0.0050 0.1 [04/11/2022-15:05:48] [I] 1600 copy 1.76 0.0050 0.1 [04/11/2022-15:05:48] [I] Reshape_803 1.73 0.0049 0.1 [04/11/2022-15:05:48] [I] Conv_837 + PWN(PWN(Softplus_838, PWN(Tanh_839)), Mul_840) 18.43 0.0525 0.6 [04/11/2022-15:05:48] [I] Conv_842 + PWN(PWN(Softplus_843, PWN(Tanh_844)), Mul_845) 7.38 0.0210 0.3 [04/11/2022-15:05:48] [I] Conv_846 + PWN(PWN(Softplus_847, PWN(Tanh_848)), Mul_849) 32.67 0.0931 1.1 [04/11/2022-15:05:48] [I] Conv_1118 + PWN(PWN(Softplus_1119, PWN(Tanh_1120)), Mul_1121) 11.34 0.0323 0.4 [04/11/2022-15:05:48] [I] Conv_850 + PWN(Sigmoid_851) 6.92 0.0197 0.2 [04/11/2022-15:05:48] [I] Reformatting CopyNode for Output Tensor 0 to Conv_850 + PWN(Sigmoid_851) 2.72 0.0077 0.1 [04/11/2022-15:05:48] [I] Conv_1123 + PWN(PWN(Softplus_1124, PWN(Tanh_1125)), Mul_1126) 6.80 0.0194 0.2 [04/11/2022-15:05:48] [I] Slice_865 1.68 0.0048 0.1 [04/11/2022-15:05:48] [I] Slice_870 1.63 0.0047 0.1 [04/11/2022-15:05:48] [I] Slice_875 1.60 0.0046 0.1 [04/11/2022-15:05:48] [I] Slice_880 2.01 0.0057 0.1 [04/11/2022-15:05:48] [I] Slice_885 1.61 0.0046 0.1 [04/11/2022-15:05:48] [I] Slice_890 1.62 0.0046 0.1 [04/11/2022-15:05:48] [I] Slice_895 1.59 0.0045 0.1 [04/11/2022-15:05:48] [I] Slice_900 2.06 0.0059 0.1 [04/11/2022-15:05:48] [I] Slice_905 1.65 0.0047 0.1 [04/11/2022-15:05:48] [I] Slice_910 1.62 0.0046 0.1 [04/11/2022-15:05:48] [I] Slice_915 1.63 0.0046 0.1 [04/11/2022-15:05:48] [I] Slice_920 2.02 0.0058 0.1 [04/11/2022-15:05:48] [I] Cast_1044 1.62 0.0046 0.1 [04/11/2022-15:05:48] [I] Cast_1042 1.52 0.0043 0.1 [04/11/2022-15:05:48] [I] PWN(1771 + (Unnamed Layer* 833) [Shuffle] + Mul_946, PWN(1773 + (Unnamed Layer* 863) [Shuffle], Sub_948)) 1.69 0.0048 0.1 [04/11/2022-15:05:48] [I] PWN(1775 + (Unnamed Layer* 836) [Shuffle] + Mul_950, PWN(2657 + (Unnamed Layer* 866) [Shuffle], Pow_951)) 1.61 0.0046 0.1 [04/11/2022-15:05:48] [I] Conv_1127 || Conv_1131 6.39 0.0182 0.2 [04/11/2022-15:05:48] [I] Slice_956 1.55 0.0044 0.1 [04/11/2022-15:05:48] [I] Slice_963 1.55 0.0044 0.1 [04/11/2022-15:05:48] [I] Slice_984 1.55 0.0044 0.1 [04/11/2022-15:05:48] [I] Slice_991 1.51 0.0043 0.1 [04/11/2022-15:05:48] [I] Slice_1012 1.51 0.0043 0.1 [04/11/2022-15:05:48] [I] Slice_1019 1.54 0.0044 0.1 [04/11/2022-15:05:48] [I] Slice_970 1.52 0.0043 0.1 [04/11/2022-15:05:48] [I] Slice_977 1.53 0.0044 0.1 [04/11/2022-15:05:48] [I] Slice_998 1.54 0.0044 0.1 [04/11/2022-15:05:48] [I] Slice_1005 1.54 0.0044 0.1 [04/11/2022-15:05:48] [I] Slice_1026 1.54 0.0044 0.1 [04/11/2022-15:05:48] [I] Slice_1033 1.54 0.0044 0.1 [04/11/2022-15:05:48] [I] Reshape_936 + Transpose_937 5.00 0.0143 0.2 [04/11/2022-15:05:48] [I] 1785 + Add_958 1.93 0.0055 0.1 [04/11/2022-15:05:48] [I] 1792 + Add_965 5.06 0.0144 0.2 [04/11/2022-15:05:48] [I] 1813 + Add_986 1.78 0.0051 0.1 [04/11/2022-15:05:48] [I] 1820 + Add_993 1.81 0.0051 0.1 [04/11/2022-15:05:48] [I] 1841 + Add_1014 1.76 0.0050 0.1 [04/11/2022-15:05:48] [I] 1848 + Add_1021 1.77 0.0050 0.1 [04/11/2022-15:05:48] [I] 1799 + (Unnamed Layer* 910) [Shuffle] + Mul_972 2.06 0.0059 0.1 [04/11/2022-15:05:48] [I] 1806 + (Unnamed Layer* 913) [Shuffle] + Mul_979 1.92 0.0055 0.1 [04/11/2022-15:05:48] [I] 1827 + (Unnamed Layer* 920) [Shuffle] + Mul_1000 1.81 0.0051 0.1 [04/11/2022-15:05:48] [I] 1834 + (Unnamed Layer* 923) [Shuffle] + Mul_1007 1.83 0.0052 0.1 [04/11/2022-15:05:48] [I] 1855 + (Unnamed Layer* 930) [Shuffle] + Mul_1028 1.83 0.0052 0.1 [04/11/2022-15:05:48] [I] 1862 + (Unnamed Layer* 933) [Shuffle] + Mul_1035 1.84 0.0052 0.1 [04/11/2022-15:05:48] [I] PWN(PWN(Softplus_1128, PWN(Tanh_1129)), Mul_1130) 2.74 0.0078 0.1 [04/11/2022-15:05:48] [I] PWN(PWN(Softplus_1132, PWN(Tanh_1133)), Mul_1134) 2.78 0.0079 0.1 [04/11/2022-15:05:48] [I] 1864 copy 2.04 0.0058 0.1 [04/11/2022-15:05:48] [I] 1866 copy 1.98 0.0056 0.1 [04/11/2022-15:05:48] [I] 1865 copy 1.96 0.0056 0.1 [04/11/2022-15:05:48] [I] 1867 copy 1.99 0.0057 0.1 [04/11/2022-15:05:48] [I] Conv_1135 + PWN(PWN(Softplus_1136, PWN(Tanh_1137)), Mul_1138) 18.18 0.0518 0.6 [04/11/2022-15:05:48] [I] Mul_1117 10.70 0.0305 0.4 [04/11/2022-15:05:48] [I] Div_1043 1.85 0.0053 0.1 [04/11/2022-15:05:48] [I] Div_1045 1.77 0.0050 0.1 [04/11/2022-15:05:48] [I] Slice_1050 1.58 0.0045 0.1 [04/11/2022-15:05:48] [I] Slice_1074 1.62 0.0046 0.1 [04/11/2022-15:05:48] [I] Slice_1062 1.70 0.0048 0.1 [04/11/2022-15:05:48] [I] Slice_1086 1.79 0.0051 0.1 [04/11/2022-15:05:48] [I] Conv_1139 + PWN(PWN(Softplus_1140, PWN(Tanh_1141)), Mul_1142) 5.33 0.0152 0.2 [04/11/2022-15:05:48] [I] PWN(PWN(1930 + (Unnamed Layer* 980) [Shuffle], Mul_1095), Sub_1096) 1.74 0.0050 0.1 [04/11/2022-15:05:48] [I] PWN(PWN(1933 + (Unnamed Layer* 983) [Shuffle], Mul_1098), Sub_1099) 1.79 0.0051 0.1 [04/11/2022-15:05:48] [I] Add_1100 1.88 0.0053 0.1 [04/11/2022-15:05:48] [I] Add_1101 1.83 0.0052 0.1 [04/11/2022-15:05:48] [I] 1932 copy 2.06 0.0059 0.1 [04/11/2022-15:05:48] [I] 1935 copy 1.93 0.0055 0.1 [04/11/2022-15:05:48] [I] 1936 copy 1.97 0.0056 0.1 [04/11/2022-15:05:48] [I] 1937 copy 1.93 0.0055 0.1 [04/11/2022-15:05:48] [I] Reshape_1109 2.07 0.0059 0.1 [04/11/2022-15:05:48] [I] Conv_1143 + PWN(PWN(Softplus_1144, PWN(Tanh_1145)), Mul_1146) 18.31 0.0522 0.6 [04/11/2022-15:05:48] [I] Conv_1148 + PWN(PWN(Softplus_1149, PWN(Tanh_1150)), Mul_1151) 6.74 0.0192 0.2 [04/11/2022-15:05:48] [I] Conv_1152 + PWN(PWN(Softplus_1153, PWN(Tanh_1154)), Mul_1155) 31.94 0.0910 1.1 [04/11/2022-15:05:48] [I] Conv_1156 + PWN(Sigmoid_1157) 4.99 0.0142 0.2 [04/11/2022-15:05:48] [I] Reformatting CopyNode for Output Tensor 0 to Conv_1156 + PWN(Sigmoid_1157) 1.88 0.0054 0.1 [04/11/2022-15:05:48] [I] Slice_1171 1.54 0.0044 0.1 [04/11/2022-15:05:48] [I] Slice_1176 1.51 0.0043 0.1 [04/11/2022-15:05:48] [I] Slice_1181 1.46 0.0042 0.1 [04/11/2022-15:05:48] [I] Slice_1186 1.64 0.0047 0.1 [04/11/2022-15:05:48] [I] Slice_1191 1.47 0.0042 0.1 [04/11/2022-15:05:48] [I] Slice_1196 1.50 0.0043 0.1 [04/11/2022-15:05:48] [I] Slice_1201 1.50 0.0043 0.1 [04/11/2022-15:05:48] [I] Slice_1206 1.76 0.0050 0.1 [04/11/2022-15:05:48] [I] Slice_1211 1.61 0.0046 0.1 [04/11/2022-15:05:48] [I] Slice_1216 1.84 0.0052 0.1 [04/11/2022-15:05:48] [I] Slice_1221 1.80 0.0051 0.1 [04/11/2022-15:05:48] [I] Slice_1226 2.04 0.0058 0.1 [04/11/2022-15:05:48] [I] Cast_1350 1.86 0.0053 0.1 [04/11/2022-15:05:48] [I] Cast_1348 1.71 0.0049 0.1 [04/11/2022-15:05:48] [I] PWN(2108 + (Unnamed Layer* 1044) [Shuffle] + Mul_1252, PWN(2110 + (Unnamed Layer* 1073) [Shuffle], Sub_1254)) 1.85 0.0053 0.1 [04/11/2022-15:05:48] [I] PWN(2112 + (Unnamed Layer* 1047) [Shuffle] + Mul_1256, PWN(2668 + (Unnamed Layer* 1076) [Shuffle], Pow_1257)) 1.77 0.0051 0.1 [04/11/2022-15:05:48] [I] Slice_1262 1.88 0.0054 0.1 [04/11/2022-15:05:48] [I] Slice_1269 1.83 0.0052 0.1 [04/11/2022-15:05:48] [I] Slice_1290 1.83 0.0052 0.1 [04/11/2022-15:05:48] [I] Slice_1297 1.81 0.0052 0.1 [04/11/2022-15:05:48] [I] Slice_1318 1.82 0.0052 0.1 [04/11/2022-15:05:48] [I] Slice_1325 1.82 0.0052 0.1 [04/11/2022-15:05:48] [I] Slice_1276 1.99 0.0057 0.1 [04/11/2022-15:05:48] [I] Slice_1283 1.89 0.0054 0.1 [04/11/2022-15:05:48] [I] Slice_1304 1.84 0.0052 0.1 [04/11/2022-15:05:48] [I] Slice_1311 2.07 0.0059 0.1 [04/11/2022-15:05:48] [I] Slice_1332 1.83 0.0052 0.1 [04/11/2022-15:05:48] [I] Slice_1339 1.82 0.0052 0.1 [04/11/2022-15:05:48] [I] Reshape_1242 + Transpose_1243 2.77 0.0079 0.1 [04/11/2022-15:05:48] [I] 2122 + Add_1264 2.20 0.0063 0.1 [04/11/2022-15:05:48] [I] 2129 + Add_1271 1.96 0.0056 0.1 [04/11/2022-15:05:48] [I] 2150 + Add_1292 1.96 0.0056 0.1 [04/11/2022-15:05:48] [I] 2157 + Add_1299 2.15 0.0061 0.1 [04/11/2022-15:05:48] [I] 2178 + Add_1320 1.92 0.0055 0.1 [04/11/2022-15:05:48] [I] 2185 + Add_1327 1.94 0.0055 0.1 [04/11/2022-15:05:48] [I] 2136 + (Unnamed Layer* 1116) [Shuffle] + Mul_1278 1.95 0.0055 0.1 [04/11/2022-15:05:48] [I] 2143 + (Unnamed Layer* 1119) [Shuffle] + Mul_1285 1.91 0.0054 0.1 [04/11/2022-15:05:48] [I] 2164 + (Unnamed Layer* 1126) [Shuffle] + Mul_1306 1.88 0.0054 0.1 [04/11/2022-15:05:48] [I] 2171 + (Unnamed Layer* 1129) [Shuffle] + Mul_1313 1.93 0.0055 0.1 [04/11/2022-15:05:48] [I] 2192 + (Unnamed Layer* 1136) [Shuffle] + Mul_1334 2.06 0.0059 0.1 [04/11/2022-15:05:48] [I] 2199 + (Unnamed Layer* 1139) [Shuffle] + Mul_1341 1.92 0.0055 0.1 [04/11/2022-15:05:48] [I] 2201 copy 1.96 0.0056 0.1 [04/11/2022-15:05:48] [I] 2203 copy 1.85 0.0053 0.1 [04/11/2022-15:05:48] [I] 2202 copy 1.86 0.0053 0.1 [04/11/2022-15:05:48] [I] 2204 copy 1.89 0.0054 0.1 [04/11/2022-15:05:48] [I] Mul_1423 2.43 0.0069 0.1 [04/11/2022-15:05:48] [I] Div_1349 1.91 0.0054 0.1 [04/11/2022-15:05:48] [I] Div_1351 1.92 0.0055 0.1 [04/11/2022-15:05:48] [I] 1622 copy 11.68 0.0333 0.4 [04/11/2022-15:05:48] [I] 1959 copy 4.23 0.0120 0.1 [04/11/2022-15:05:48] [I] 2296 copy 2.78 0.0079 0.1 [04/11/2022-15:05:48] [I] Slice_1356 2.12 0.0060 0.1 [04/11/2022-15:05:48] [I] Slice_1380 1.96 0.0056 0.1 [04/11/2022-15:05:48] [I] Slice_1368 2.01 0.0057 0.1 [04/11/2022-15:05:48] [I] Slice_1392 1.94 0.0055 0.1 [04/11/2022-15:05:48] [I] PWN(PWN(2267 + (Unnamed Layer* 1179) [Shuffle], Mul_1401), Sub_1402) 2.08 0.0059 0.1 [04/11/2022-15:05:48] [I] PWN(PWN(2270 + (Unnamed Layer* 1182) [Shuffle], Mul_1404), Sub_1405) 1.83 0.0052 0.1 [04/11/2022-15:05:48] [I] Add_1406 1.82 0.0052 0.1 [04/11/2022-15:05:48] [I] Add_1407 1.75 0.0050 0.1 [04/11/2022-15:05:48] [I] 2269 copy 3.29 0.0094 0.1 [04/11/2022-15:05:48] [I] 2272 copy 1.92 0.0055 0.1 [04/11/2022-15:05:48] [I] 2273 copy 1.95 0.0055 0.1 [04/11/2022-15:05:48] [I] 2274 copy 2.11 0.0060 0.1 [04/11/2022-15:05:48] [I] Reformatting CopyNode for Output Tensor 0 to Reshape_1415 2.07 0.0059 0.1 [04/11/2022-15:05:48] [I] node_of_num_detections 537.95 1.5326 18.9 [04/11/2022-15:05:48] [I] Reformatting CopyNode for Output Tensor 3 to node_of_num_detections 1.64 0.0047 0.1 [04/11/2022-15:05:48] [I] Reformatting CopyNode for Output Tensor 2 to node_of_num_detections 1.57 0.0045 0.1 [04/11/2022-15:05:48] [I] Reformatting CopyNode for Output Tensor 1 to node_of_num_detections 1.63 0.0046 0.1 [04/11/2022-15:05:48] [I] Total 2843.83 8.1021 100.0 [04/11/2022-15:05:48] [I] &&&& PASSED TensorRT.trtexec [TensorRT v8001] # /usr/src/tensorrt/bin/trtexec --loadEngine=yolov4-csp_4_3_512_512_trtexec.engine --dumpProfile [04/11/2022-15:05:48] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 1505, GPU 2155 (MiB)