&&&& RUNNING TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --loadEngine=yolov5s6.engine --dumpProfile --best [06/28/2021-11:59:01] [I] === Model Options === [06/28/2021-11:59:01] [I] Format: * [06/28/2021-11:59:01] [I] Model: [06/28/2021-11:59:01] [I] Output: [06/28/2021-11:59:01] [I] === Build Options === [06/28/2021-11:59:01] [I] Max batch: 1 [06/28/2021-11:59:01] [I] Workspace: 16 MB [06/28/2021-11:59:01] [I] minTiming: 1 [06/28/2021-11:59:01] [I] avgTiming: 8 [06/28/2021-11:59:01] [I] Precision: FP32+FP16+INT8 [06/28/2021-11:59:01] [I] Calibration: Dynamic [06/28/2021-11:59:01] [I] Safe mode: Disabled [06/28/2021-11:59:01] [I] Save engine: [06/28/2021-11:59:01] [I] Load engine: yolov5s6.engine [06/28/2021-11:59:01] [I] Builder Cache: Enabled [06/28/2021-11:59:01] [I] NVTX verbosity: 0 [06/28/2021-11:59:01] [I] Inputs format: fp32:CHW [06/28/2021-11:59:01] [I] Outputs format: fp32:CHW [06/28/2021-11:59:01] [I] Input build shapes: model [06/28/2021-11:59:01] [I] Input calibration shapes: model [06/28/2021-11:59:01] [I] === System Options === [06/28/2021-11:59:01] [I] Device: 0 [06/28/2021-11:59:01] [I] DLACore: [06/28/2021-11:59:01] [I] Plugins: [06/28/2021-11:59:01] [I] === Inference Options === [06/28/2021-11:59:01] [I] Batch: 1 [06/28/2021-11:59:01] [I] Input inference shapes: model [06/28/2021-11:59:01] [I] Iterations: 10 [06/28/2021-11:59:01] [I] Duration: 3s (+ 200ms warm up) [06/28/2021-11:59:01] [I] Sleep time: 0ms [06/28/2021-11:59:01] [I] Streams: 1 [06/28/2021-11:59:01] [I] ExposeDMA: Disabled [06/28/2021-11:59:01] [I] Spin-wait: Disabled [06/28/2021-11:59:01] [I] Multithreading: Disabled [06/28/2021-11:59:01] [I] CUDA Graph: Disabled [06/28/2021-11:59:01] [I] Skip inference: Disabled [06/28/2021-11:59:01] [I] Inputs: [06/28/2021-11:59:01] [I] === Reporting Options === [06/28/2021-11:59:01] [I] Verbose: Disabled [06/28/2021-11:59:01] [I] Averages: 10 inferences [06/28/2021-11:59:01] [I] Percentile: 99 [06/28/2021-11:59:01] [I] Dump output: Disabled [06/28/2021-11:59:01] [I] Profile: Enabled [06/28/2021-11:59:01] [I] Export timing to JSON file: [06/28/2021-11:59:01] [I] Export output to JSON file: [06/28/2021-11:59:01] [I] Export profile to JSON file: [06/28/2021-11:59:01] [I] [06/28/2021-11:59:03] [I] Starting inference threads [06/28/2021-11:59:06] [I] Warmup completed 8 queries over 200 ms [06/28/2021-11:59:06] [I] Timing trace has 114 queries over 3.05521 s [06/28/2021-11:59:06] [I] Trace averages of 10 runs: [06/28/2021-11:59:06] [I] Average on 10 runs - GPU latency: 26.1512 ms - Host latency: 26.7937 ms (end to end 26.8054 ms, enqueue 26.7253 ms) [06/28/2021-11:59:06] [I] Average on 10 runs - GPU latency: 26.132 ms - Host latency: 26.7744 ms (end to end 26.7861 ms, enqueue 26.7191 ms) [06/28/2021-11:59:06] [I] Average on 10 runs - GPU latency: 26.1414 ms - Host latency: 26.7843 ms (end to end 26.7961 ms, enqueue 26.7333 ms) [06/28/2021-11:59:06] [I] Average on 10 runs - GPU latency: 26.1469 ms - Host latency: 26.7884 ms (end to end 26.7995 ms, enqueue 26.7371 ms) [06/28/2021-11:59:06] [I] Average on 10 runs - GPU latency: 26.1415 ms - Host latency: 26.7827 ms (end to end 26.793 ms, enqueue 26.7342 ms) [06/28/2021-11:59:06] [I] Average on 10 runs - GPU latency: 26.152 ms - Host latency: 26.7941 ms (end to end 26.8045 ms, enqueue 26.7438 ms) [06/28/2021-11:59:06] [I] Average on 10 runs - GPU latency: 26.1547 ms - Host latency: 26.7963 ms (end to end 26.8073 ms, enqueue 26.7436 ms) [06/28/2021-11:59:06] [I] Average on 10 runs - GPU latency: 26.1485 ms - Host latency: 26.7928 ms (end to end 26.8042 ms, enqueue 26.741 ms) [06/28/2021-11:59:06] [I] Average on 10 runs - GPU latency: 26.1494 ms - Host latency: 26.7902 ms (end to end 26.8062 ms, enqueue 26.7415 ms) [06/28/2021-11:59:06] [I] Average on 10 runs - GPU latency: 26.1553 ms - Host latency: 26.7962 ms (end to end 26.8066 ms, enqueue 26.7472 ms) [06/28/2021-11:59:06] [I] Average on 10 runs - GPU latency: 26.1436 ms - Host latency: 26.7863 ms (end to end 26.7966 ms, enqueue 26.7301 ms) [06/28/2021-11:59:06] [I] Host Latency [06/28/2021-11:59:06] [I] min: 26.7211 ms (end to end 26.7299 ms) [06/28/2021-11:59:06] [I] max: 26.8633 ms (end to end 26.873 ms) [06/28/2021-11:59:06] [I] mean: 26.7886 ms (end to end 26.8 ms) [06/28/2021-11:59:06] [I] median: 26.7875 ms (end to end 26.7981 ms) [06/28/2021-11:59:06] [I] percentile: 26.8627 ms at 99% (end to end 26.8723 ms at 99%) [06/28/2021-11:59:06] [I] throughput: 37.3133 qps [06/28/2021-11:59:06] [I] walltime: 3.05521 s [06/28/2021-11:59:06] [I] Enqueue Time [06/28/2021-11:59:06] [I] min: 26.6714 ms [06/28/2021-11:59:06] [I] max: 26.8168 ms [06/28/2021-11:59:06] [I] median: 26.735 ms [06/28/2021-11:59:06] [I] GPU Compute [06/28/2021-11:59:06] [I] min: 26.0816 ms [06/28/2021-11:59:06] [I] max: 26.2219 ms [06/28/2021-11:59:06] [I] mean: 26.1465 ms [06/28/2021-11:59:06] [I] median: 26.1456 ms [06/28/2021-11:59:06] [I] percentile: 26.2167 ms at 99% [06/28/2021-11:59:06] [I] total compute time: 2.9807 s [06/28/2021-11:59:06] [I] [06/28/2021-11:59:06] [I] === Profile (122 iterations ) === [06/28/2021-11:59:06] [I] Layer Time (ms) Avg. Time (ms) Time % [06/28/2021-11:59:06] [I] Slice_4 53.72 0.44 1.7 [06/28/2021-11:59:06] [I] Slice_9 27.17 0.22 0.9 [06/28/2021-11:59:06] [I] Slice_14 51.05 0.42 1.6 [06/28/2021-11:59:06] [I] Slice_19 27.22 0.22 0.9 [06/28/2021-11:59:06] [I] Slice_24 51.11 0.42 1.6 [06/28/2021-11:59:06] [I] Slice_29 27.25 0.22 0.9 [06/28/2021-11:59:06] [I] Slice_34 51.18 0.42 1.6 [06/28/2021-11:59:06] [I] Slice_39 27.35 0.22 0.9 [06/28/2021-11:59:06] [I] Conv_41 + Relu_42 input reformatter 0 24.11 0.20 0.8 [06/28/2021-11:59:06] [I] Conv_41 + Relu_42 175.68 1.44 5.5 [06/28/2021-11:59:06] [I] Conv_43 + Relu_44 118.46 0.97 3.7 [06/28/2021-11:59:06] [I] Conv_52 + Relu_53 || Conv_45 + Relu_46 47.78 0.39 1.5 [06/28/2021-11:59:06] [I] Conv_47 + Relu_48 input reformatter 0 46.29 0.38 1.5 [06/28/2021-11:59:06] [I] Conv_47 + Relu_48 30.25 0.25 0.9 [06/28/2021-11:59:06] [I] Conv_49 + Relu_50 60.85 0.50 1.9 [06/28/2021-11:59:06] [I] Add_51 input reformatter 0 46.24 0.38 1.4 [06/28/2021-11:59:06] [I] Add_51 input reformatter 1 24.97 0.20 0.8 [06/28/2021-11:59:06] [I] Add_51 20.08 0.16 0.6 [06/28/2021-11:59:06] [I] 226 copy 46.10 0.38 1.4 [06/28/2021-11:59:06] [I] Conv_55 + Relu_56 64.94 0.53 2.0 [06/28/2021-11:59:06] [I] Conv_57 + Relu_58 71.85 0.59 2.3 [06/28/2021-11:59:06] [I] Conv_81 + Relu_82 || Conv_59 + Relu_60 26.75 0.22 0.8 [06/28/2021-11:59:06] [I] Conv_61 + Relu_62 13.74 0.11 0.4 [06/28/2021-11:59:06] [I] Conv_63 + Relu_64 41.43 0.34 1.3 [06/28/2021-11:59:06] [I] Add_65 14.23 0.12 0.4 [06/28/2021-11:59:06] [I] Conv_66 + Relu_67 13.17 0.11 0.4 [06/28/2021-11:59:06] [I] Conv_68 + Relu_69 41.72 0.34 1.3 [06/28/2021-11:59:06] [I] Add_70 13.98 0.11 0.4 [06/28/2021-11:59:06] [I] Conv_71 + Relu_72 13.25 0.11 0.4 [06/28/2021-11:59:06] [I] Conv_73 + Relu_74 41.93 0.34 1.3 [06/28/2021-11:59:06] [I] Add_75 13.97 0.11 0.4 [06/28/2021-11:59:06] [I] Conv_76 + Relu_77 13.24 0.11 0.4 [06/28/2021-11:59:06] [I] Conv_78 + Relu_79 41.72 0.34 1.3 [06/28/2021-11:59:06] [I] Add_80 13.99 0.11 0.4 [06/28/2021-11:59:06] [I] 255 copy 6.81 0.06 0.2 [06/28/2021-11:59:06] [I] Conv_84 + Relu_85 26.26 0.22 0.8 [06/28/2021-11:59:06] [I] Conv_86 + Relu_87 57.90 0.47 1.8 [06/28/2021-11:59:06] [I] Conv_110 + Relu_111 || Conv_88 + Relu_89 19.02 0.16 0.6 [06/28/2021-11:59:06] [I] Conv_90 + Relu_91 8.61 0.07 0.3 [06/28/2021-11:59:06] [I] Conv_92 + Relu_93 29.24 0.24 0.9 [06/28/2021-11:59:06] [I] Add_94 7.60 0.06 0.2 [06/28/2021-11:59:06] [I] Conv_95 + Relu_96 8.02 0.07 0.3 [06/28/2021-11:59:06] [I] Conv_97 + Relu_98 29.21 0.24 0.9 [06/28/2021-11:59:06] [I] Add_99 7.41 0.06 0.2 [06/28/2021-11:59:06] [I] Conv_100 + Relu_101 8.05 0.07 0.3 [06/28/2021-11:59:06] [I] Conv_102 + Relu_103 29.26 0.24 0.9 [06/28/2021-11:59:06] [I] Add_104 7.39 0.06 0.2 [06/28/2021-11:59:06] [I] Conv_105 + Relu_106 8.07 0.07 0.3 [06/28/2021-11:59:06] [I] Conv_107 + Relu_108 29.23 0.24 0.9 [06/28/2021-11:59:06] [I] Add_109 7.38 0.06 0.2 [06/28/2021-11:59:06] [I] 284 copy 3.86 0.03 0.1 [06/28/2021-11:59:06] [I] Conv_113 + Relu_114 19.22 0.16 0.6 [06/28/2021-11:59:06] [I] Conv_115 + Relu_116 45.48 0.37 1.4 [06/28/2021-11:59:06] [I] Conv_124 + Relu_125 || Conv_117 + Relu_118 11.78 0.10 0.4 [06/28/2021-11:59:06] [I] Conv_119 + Relu_120 5.14 0.04 0.2 [06/28/2021-11:59:06] [I] Conv_121 + Relu_122 22.61 0.19 0.7 [06/28/2021-11:59:06] [I] Add_123 3.16 0.03 0.1 [06/28/2021-11:59:06] [I] 298 copy 1.94 0.02 0.1 [06/28/2021-11:59:06] [I] Conv_127 + Relu_128 12.93 0.11 0.4 [06/28/2021-11:59:06] [I] Conv_129 + Relu_130 28.13 0.23 0.9 [06/28/2021-11:59:06] [I] Conv_131 + Relu_132 3.58 0.03 0.1 [06/28/2021-11:59:06] [I] MaxPool_135 6.06 0.05 0.2 [06/28/2021-11:59:06] [I] MaxPool_134 3.60 0.03 0.1 [06/28/2021-11:59:06] [I] MaxPool_133 2.03 0.02 0.1 [06/28/2021-11:59:06] [I] 305 copy 0.97 0.01 0.0 [06/28/2021-11:59:06] [I] Conv_137 + Relu_138 9.87 0.08 0.3 [06/28/2021-11:59:06] [I] Conv_145 + Relu_146 || Conv_139 + Relu_140 6.07 0.05 0.2 [06/28/2021-11:59:06] [I] Conv_141 + Relu_142 2.96 0.02 0.1 [06/28/2021-11:59:06] [I] Conv_143 + Relu_144 11.65 0.10 0.4 [06/28/2021-11:59:06] [I] 319 copy 1.08 0.01 0.0 [06/28/2021-11:59:06] [I] Conv_148 + Relu_149 6.34 0.05 0.2 [06/28/2021-11:59:06] [I] Conv_150 + Relu_151 5.73 0.05 0.2 [06/28/2021-11:59:06] [I] Conv_150 + Relu_151 output reformatter 0 1.50 0.01 0.0 [06/28/2021-11:59:06] [I] Resize_153 input reformatter 0 2.07 0.02 0.1 [06/28/2021-11:59:06] [I] Resize_153 27.06 0.22 0.8 [06/28/2021-11:59:06] [I] 329 copy 25.12 0.21 0.8 [06/28/2021-11:59:06] [I] Conv_161 + Relu_162 || Conv_155 + Relu_156 19.85 0.16 0.6 [06/28/2021-11:59:06] [I] Conv_157 + Relu_158 5.63 0.05 0.2 [06/28/2021-11:59:06] [I] Conv_159 + Relu_160 22.75 0.19 0.7 [06/28/2021-11:59:06] [I] 338 copy 1.94 0.02 0.1 [06/28/2021-11:59:06] [I] Conv_164 + Relu_165 11.67 0.10 0.4 [06/28/2021-11:59:06] [I] Conv_166 + Relu_167 7.65 0.06 0.2 [06/28/2021-11:59:06] [I] Conv_166 + Relu_167 output reformatter 0 2.80 0.02 0.1 [06/28/2021-11:59:06] [I] Resize_169 input reformatter 0 3.60 0.03 0.1 [06/28/2021-11:59:06] [I] Resize_169 70.84 0.58 2.2 [06/28/2021-11:59:06] [I] 348 copy 60.34 0.49 1.9 [06/28/2021-11:59:06] [I] Conv_177 + Relu_178 || Conv_171 + Relu_172 30.67 0.25 1.0 [06/28/2021-11:59:06] [I] Conv_173 + Relu_174 8.65 0.07 0.3 [06/28/2021-11:59:06] [I] Conv_175 + Relu_176 29.22 0.24 0.9 [06/28/2021-11:59:06] [I] 357 copy 3.91 0.03 0.1 [06/28/2021-11:59:06] [I] Conv_180 + Relu_181 19.14 0.16 0.6 [06/28/2021-11:59:06] [I] Conv_182 + Relu_183 13.07 0.11 0.4 [06/28/2021-11:59:06] [I] Conv_182 + Relu_183 output reformatter 0 4.92 0.04 0.2 [06/28/2021-11:59:06] [I] Resize_185 input reformatter 0 8.45 0.07 0.3 [06/28/2021-11:59:06] [I] Resize_185 140.29 1.15 4.4 [06/28/2021-11:59:06] [I] 367 copy 117.01 0.96 3.7 [06/28/2021-11:59:06] [I] Conv_193 + Relu_194 || Conv_187 + Relu_188 43.51 0.36 1.4 [06/28/2021-11:59:06] [I] Conv_189 + Relu_190 13.65 0.11 0.4 [06/28/2021-11:59:06] [I] Conv_191 + Relu_192 41.44 0.34 1.3 [06/28/2021-11:59:06] [I] 376 copy 6.83 0.06 0.2 [06/28/2021-11:59:06] [I] Conv_196 + Relu_197 26.19 0.21 0.8 [06/28/2021-11:59:06] [I] Conv_240 input reformatter 0 17.23 0.14 0.5 [06/28/2021-11:59:06] [I] Conv_240 20.05 0.16 0.6 [06/28/2021-11:59:06] [I] Reshape_254 + Transpose_255 input reformatter 0 6.11 0.05 0.2 [06/28/2021-11:59:06] [I] Reshape_254 + Transpose_255 10.70 0.09 0.3 [06/28/2021-11:59:06] [I] Sigmoid_256 6.76 0.06 0.2 [06/28/2021-11:59:06] [I] Slice_284 15.47 0.13 0.5 [06/28/2021-11:59:06] [I] Slice_274 4.92 0.04 0.2 [06/28/2021-11:59:06] [I] Slice_261 4.94 0.04 0.2 [06/28/2021-11:59:06] [I] Conv_198 + Relu_199 33.00 0.27 1.0 [06/28/2021-11:59:06] [I] 362 copy 32.69 0.27 1.0 [06/28/2021-11:59:06] [I] Conv_207 + Relu_208 || Conv_201 + Relu_202 19.67 0.16 0.6 [06/28/2021-11:59:06] [I] Conv_203 + Relu_204 8.40 0.07 0.3 [06/28/2021-11:59:06] [I] (Unnamed Layer* 216) [Constant] 0.08 0.00 0.0 [06/28/2021-11:59:06] [I] (Unnamed Layer* 228) [Constant] 0.08 0.00 0.0 [06/28/2021-11:59:06] [I] Conv_205 + Relu_206 29.23 0.24 0.9 [06/28/2021-11:59:06] [I] PWN(PWN((Unnamed Layer* 225) [Constant] + (Unnamed Layer* 226) [Shuffle], PWN((Unnamed Layer* 222) [Constant] + (Unnamed Layer* 223) [Shuffle] + Mul_276, Pow_278)), Mul_279) 3.26 0.03 0.1 [06/28/2021-11:59:06] [I] 390 copy 3.94 0.03 0.1 [06/28/2021-11:59:06] [I] Conv_210 + Relu_211 19.14 0.16 0.6 [06/28/2021-11:59:06] [I] PWN(PWN(PWN((Unnamed Layer* 213) [Constant] + (Unnamed Layer* 214) [Shuffle], PWN((Unnamed Layer* 210) [Constant] + (Unnamed Layer* 211) [Shuffle] + Mul_263, Sub_265)), Add_267), (Unnamed Layer* 218) [Constant] + (Unnamed Layer* 219) [Shuffle] + Mul_269) 1.64 0.01 0.1 [06/28/2021-11:59:06] [I] 455 copy 3.50 0.03 0.1 [06/28/2021-11:59:06] [I] 469 copy 3.43 0.03 0.1 [06/28/2021-11:59:06] [I] 474 copy 6.35 0.05 0.2 [06/28/2021-11:59:06] [I] Conv_289 input reformatter 0 9.37 0.08 0.3 [06/28/2021-11:59:06] [I] Conv_289 10.40 0.09 0.3 [06/28/2021-11:59:06] [I] Reshape_303 + Transpose_304 input reformatter 0 2.01 0.02 0.1 [06/28/2021-11:59:06] [I] Reshape_303 + Transpose_304 3.31 0.03 0.1 [06/28/2021-11:59:06] [I] Sigmoid_305 2.17 0.02 0.1 [06/28/2021-11:59:06] [I] Slice_333 4.81 0.04 0.2 [06/28/2021-11:59:06] [I] Slice_323 1.64 0.01 0.1 [06/28/2021-11:59:06] [I] Slice_310 1.62 0.01 0.1 [06/28/2021-11:59:06] [I] Conv_212 + Relu_213 31.80 0.26 1.0 [06/28/2021-11:59:06] [I] 395 copy 2.28 0.02 0.1 [06/28/2021-11:59:06] [I] 343 copy 17.28 0.14 0.5 [06/28/2021-11:59:06] [I] Conv_221 + Relu_222 || Conv_215 + Relu_216 15.49 0.13 0.5 [06/28/2021-11:59:06] [I] Conv_217 + Relu_218 5.54 0.05 0.2 [06/28/2021-11:59:06] [I] (Unnamed Layer* 244) [Constant] 0.08 0.00 0.0 [06/28/2021-11:59:06] [I] (Unnamed Layer* 256) [Constant] 0.10 0.00 0.0 [06/28/2021-11:59:06] [I] Conv_219 + Relu_220 22.54 0.18 0.7 [06/28/2021-11:59:06] [I] PWN(PWN((Unnamed Layer* 253) [Constant] + (Unnamed Layer* 254) [Shuffle], PWN((Unnamed Layer* 250) [Constant] + (Unnamed Layer* 251) [Shuffle] + Mul_325, Pow_327)), Mul_328) 1.34 0.01 0.0 [06/28/2021-11:59:06] [I] 402 copy 1.89 0.02 0.1 [06/28/2021-11:59:06] [I] 404 copy 1.82 0.01 0.1 [06/28/2021-11:59:06] [I] Conv_224 + Relu_225 12.79 0.10 0.4 [06/28/2021-11:59:06] [I] PWN(PWN(PWN((Unnamed Layer* 241) [Constant] + (Unnamed Layer* 242) [Shuffle], PWN((Unnamed Layer* 238) [Constant] + (Unnamed Layer* 239) [Shuffle] + Mul_312, Sub_314)), Add_316), (Unnamed Layer* 246) [Constant] + (Unnamed Layer* 247) [Shuffle] + Mul_318) 1.22 0.01 0.0 [06/28/2021-11:59:06] [I] 516 copy 1.22 0.01 0.0 [06/28/2021-11:59:06] [I] 530 copy 1.30 0.01 0.0 [06/28/2021-11:59:06] [I] 535 copy 2.05 0.02 0.1 [06/28/2021-11:59:06] [I] Conv_338 input reformatter 0 4.05 0.03 0.1 [06/28/2021-11:59:06] [I] Conv_338 4.30 0.04 0.1 [06/28/2021-11:59:06] [I] Reshape_352 + Transpose_353 input reformatter 0 0.76 0.01 0.0 [06/28/2021-11:59:06] [I] Reshape_352 + Transpose_353 1.28 0.01 0.0 [06/28/2021-11:59:06] [I] Sigmoid_354 0.96 0.01 0.0 [06/28/2021-11:59:06] [I] Slice_382 1.88 0.02 0.1 [06/28/2021-11:59:06] [I] Slice_372 0.75 0.01 0.0 [06/28/2021-11:59:06] [I] Slice_359 0.74 0.01 0.0 [06/28/2021-11:59:06] [I] Conv_226 + Relu_227 27.61 0.23 0.9 [06/28/2021-11:59:06] [I] 409 copy 1.30 0.01 0.0 [06/28/2021-11:59:06] [I] 324 copy 7.66 0.06 0.2 [06/28/2021-11:59:06] [I] Conv_235 + Relu_236 || Conv_229 + Relu_230 8.06 0.07 0.3 [06/28/2021-11:59:06] [I] Conv_231 + Relu_232 2.96 0.02 0.1 [06/28/2021-11:59:06] [I] (Unnamed Layer* 272) [Constant] 0.06 0.00 0.0 [06/28/2021-11:59:06] [I] (Unnamed Layer* 284) [Constant] 0.09 0.00 0.0 [06/28/2021-11:59:06] [I] Conv_233 + Relu_234 11.68 0.10 0.4 [06/28/2021-11:59:06] [I] PWN(PWN((Unnamed Layer* 281) [Constant] + (Unnamed Layer* 282) [Shuffle], PWN((Unnamed Layer* 278) [Constant] + (Unnamed Layer* 279) [Shuffle] + Mul_374, Pow_376)), Mul_377) 0.78 0.01 0.0 [06/28/2021-11:59:06] [I] 416 copy 1.01 0.01 0.0 [06/28/2021-11:59:06] [I] 418 copy 0.94 0.01 0.0 [06/28/2021-11:59:06] [I] Conv_238 + Relu_239 6.32 0.05 0.2 [06/28/2021-11:59:06] [I] PWN(PWN(PWN((Unnamed Layer* 269) [Constant] + (Unnamed Layer* 270) [Shuffle], PWN((Unnamed Layer* 266) [Constant] + (Unnamed Layer* 267) [Shuffle] + Mul_361, Sub_363)), Add_365), (Unnamed Layer* 274) [Constant] + (Unnamed Layer* 275) [Shuffle] + Mul_367) 0.81 0.01 0.0 [06/28/2021-11:59:06] [I] 577 copy 1.02 0.01 0.0 [06/28/2021-11:59:06] [I] 591 copy 0.81 0.01 0.0 [06/28/2021-11:59:06] [I] 596 copy 0.98 0.01 0.0 [06/28/2021-11:59:06] [I] Conv_387 input reformatter 0 1.89 0.02 0.1 [06/28/2021-11:59:06] [I] Conv_387 4.32 0.04 0.1 [06/28/2021-11:59:06] [I] Reshape_401 + Transpose_402 input reformatter 0 0.63 0.01 0.0 [06/28/2021-11:59:06] [I] Reshape_401 + Transpose_402 0.80 0.01 0.0 [06/28/2021-11:59:06] [I] Sigmoid_403 0.78 0.01 0.0 [06/28/2021-11:59:06] [I] Slice_431 1.07 0.01 0.0 [06/28/2021-11:59:06] [I] Slice_421 0.55 0.00 0.0 [06/28/2021-11:59:06] [I] Slice_408 0.54 0.00 0.0 [06/28/2021-11:59:06] [I] (Unnamed Layer* 300) [Constant] 0.05 0.00 0.0 [06/28/2021-11:59:06] [I] (Unnamed Layer* 312) [Constant] 0.07 0.00 0.0 [06/28/2021-11:59:06] [I] PWN(PWN((Unnamed Layer* 309) [Constant] + (Unnamed Layer* 310) [Shuffle], PWN((Unnamed Layer* 306) [Constant] + (Unnamed Layer* 307) [Shuffle] + Mul_423, Pow_425)), Mul_426) 0.69 0.01 0.0 [06/28/2021-11:59:06] [I] PWN(PWN(PWN((Unnamed Layer* 297) [Constant] + (Unnamed Layer* 298) [Shuffle], PWN((Unnamed Layer* 294) [Constant] + (Unnamed Layer* 295) [Shuffle] + Mul_410, Sub_412)), Add_414), (Unnamed Layer* 302) [Constant] + (Unnamed Layer* 303) [Shuffle] + Mul_416) 0.81 0.01 0.0 [06/28/2021-11:59:06] [I] 638 copy 0.55 0.00 0.0 [06/28/2021-11:59:06] [I] 652 copy 0.55 0.00 0.0 [06/28/2021-11:59:06] [I] 657 copy 0.59 0.00 0.0 [06/28/2021-11:59:06] [I] 482 copy 9.13 0.07 0.3 [06/28/2021-11:59:06] [I] 543 copy 2.78 0.02 0.1 [06/28/2021-11:59:06] [I] 604 copy 1.33 0.01 0.0 [06/28/2021-11:59:06] [I] 665 copy 0.73 0.01 0.0 [06/28/2021-11:59:06] [I] Total 3189.54 26.14 100.0 [06/28/2021-11:59:06] [I] &&&& PASSED TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --loadEngine=yolov5s6.engine --dumpProfile --best