&&&& RUNNING TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --deploy=/usr/src/tensorrt/data/googlenet/googlenet.prototxt --output=prob --verbose --useDLACore=0 --allowGPUFallback
[06/30/2022-06:21:00] [I] === Model Options ===
[06/30/2022-06:21:00] [I] Format: Caffe
[06/30/2022-06:21:00] [I] Model: 
[06/30/2022-06:21:00] [I] Prototxt: /usr/src/tensorrt/data/googlenet/googlenet.prototxt
[06/30/2022-06:21:00] [I] Output: prob
[06/30/2022-06:21:00] [I] === Build Options ===
[06/30/2022-06:21:00] [I] Max batch: 1
[06/30/2022-06:21:00] [I] Workspace: 16 MB
[06/30/2022-06:21:00] [I] minTiming: 1
[06/30/2022-06:21:00] [I] avgTiming: 8
[06/30/2022-06:21:00] [I] Precision: FP32
[06/30/2022-06:21:00] [I] Calibration: 
[06/30/2022-06:21:00] [I] Safe mode: Disabled
[06/30/2022-06:21:00] [I] Save engine: 
[06/30/2022-06:21:00] [I] Load engine: 
[06/30/2022-06:21:00] [I] Builder Cache: Enabled
[06/30/2022-06:21:00] [I] NVTX verbosity: 0
[06/30/2022-06:21:00] [I] Inputs format: fp32:CHW
[06/30/2022-06:21:00] [I] Outputs format: fp32:CHW
[06/30/2022-06:21:00] [I] Input build shapes: model
[06/30/2022-06:21:00] [I] Input calibration shapes: model
[06/30/2022-06:21:00] [I] === System Options ===
[06/30/2022-06:21:00] [I] Device: 0
[06/30/2022-06:21:00] [I] DLACore: 0(With GPU fallback)
[06/30/2022-06:21:00] [I] Plugins:
[06/30/2022-06:21:00] [I] === Inference Options ===
[06/30/2022-06:21:00] [I] Batch: 1
[06/30/2022-06:21:00] [I] Input inference shapes: model
[06/30/2022-06:21:00] [I] Iterations: 10
[06/30/2022-06:21:00] [I] Duration: 3s (+ 200ms warm up)
[06/30/2022-06:21:00] [I] Sleep time: 0ms
[06/30/2022-06:21:00] [I] Streams: 1
[06/30/2022-06:21:00] [I] ExposeDMA: Disabled
[06/30/2022-06:21:00] [I] Spin-wait: Disabled
[06/30/2022-06:21:00] [I] Multithreading: Disabled
[06/30/2022-06:21:00] [I] CUDA Graph: Disabled
[06/30/2022-06:21:00] [I] Skip inference: Disabled
[06/30/2022-06:21:00] [I] Inputs:
[06/30/2022-06:21:00] [I] === Reporting Options ===
[06/30/2022-06:21:00] [I] Verbose: Enabled
[06/30/2022-06:21:00] [I] Averages: 10 inferences
[06/30/2022-06:21:00] [I] Percentile: 99
[06/30/2022-06:21:00] [I] Dump output: Disabled
[06/30/2022-06:21:00] [I] Profile: Disabled
[06/30/2022-06:21:00] [I] Export timing to JSON file: 
[06/30/2022-06:21:00] [I] Export output to JSON file: 
[06/30/2022-06:21:00] [I] Export profile to JSON file: 
[06/30/2022-06:21:00] [I] 
[06/30/2022-06:21:00] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1
[06/30/2022-06:21:00] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1
[06/30/2022-06:21:00] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1
[06/30/2022-06:21:00] [V] [TRT] Registered plugin creator - ::Region_TRT version 1
[06/30/2022-06:21:00] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1
[06/30/2022-06:21:00] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1
[06/30/2022-06:21:00] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1
[06/30/2022-06:21:00] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1
[06/30/2022-06:21:00] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1
[06/30/2022-06:21:00] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1
[06/30/2022-06:21:00] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1
[06/30/2022-06:21:00] [V] [TRT] Registered plugin creator - ::CropAndResize version 1
[06/30/2022-06:21:00] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1
[06/30/2022-06:21:00] [V] [TRT] Registered plugin creator - ::Proposal version 1
[06/30/2022-06:21:00] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1
[06/30/2022-06:21:00] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1
[06/30/2022-06:21:00] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1
[06/30/2022-06:21:00] [V] [TRT] Registered plugin creator - ::Split version 1
[06/30/2022-06:21:00] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1
[06/30/2022-06:21:00] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1
[06/30/2022-06:21:02] [06/30/2022-06:21:02] [V] [TRT] Applying generic optimizations to the graph for inference.
[06/30/2022-06:21:02] [V] [TRT] Original: 141 layers
[06/30/2022-06:21:02] [V] [TRT] After dead-layer removal: 141 layers
[06/30/2022-06:21:02] [V] [TRT] After DLA optimization: 3 layers
[06/30/2022-06:21:02] [V] [TRT] After Myelin optimization: 3 layers
[06/30/2022-06:21:02] [V] [TRT] After scale fusion: 3 layers
[06/30/2022-06:21:02] [V] [TRT] After vertical fusions: 3 layers
[06/30/2022-06:21:02] [V] [TRT] After final dead-layer removal: 3 layers
[06/30/2022-06:21:02] [V] [TRT] After tensor merging: 3 layers
[06/30/2022-06:21:02] [V] [TRT] After concat removal: 3 layers
[06/30/2022-06:21:02] [V] [TRT] Graph construction and optimization completed in 0.259744 seconds.
[06/30/2022-06:21:02] [I] [TRT] 
[06/30/2022-06:21:02] [I] [TRT] --------------- Layers running on DLA: 
[06/30/2022-06:21:02] [I] [TRT] {conv1/7x7_s2,conv1/relu_7x7,pool1/3x3_s2,pool1/norm1,conv2/3x3_reduce,conv2/relu_3x3_reduce,conv2/3x3,conv2/relu_3x3,conv2/norm2,pool2/3x3_s2,inception_3a/1x1,inception_3a/relu_1x1,inception_3a/3x3_reduce,inception_3a/relu_3x3_reduce,inception_3a/3x3,inception_3a/relu_3x3,inception_3a/5x5_reduce,inception_3a/relu_5x5_reduce,inception_3a/5x5,inception_3a/relu_5x5,inception_3a/pool,inception_3a/pool_proj,inception_3a/relu_pool_proj,inception_3a/output,inception_3b/1x1,inception_3b/relu_1x1,inception_3b/3x3_reduce,inception_3b/relu_3x3_reduce,inception_3b/3x3,inception_3b/relu_3x3,inception_3b/5x5_reduce,inception_3b/relu_5x5_reduce,inception_3b/5x5,inception_3b/relu_5x5,inception_3b/pool,inception_3b/pool_proj,inception_3b/relu_pool_proj,inception_3b/output,pool3/3x3_s2,inception_4a/1x1,inception_4a/relu_1x1,inception_4a/3x3_reduce,inception_4a/relu_3x3_reduce,inception_4a/3x3,inception_4a/relu_3x3,inception_4a/5x5_reduce,inception_4a/relu_5x5_reduce,inception_4a/5x5,inception_4a/relu_5x5,inception_4a/pool,inception_4a/pool_proj,inception_4a/relu_pool_proj,inception_4a/output,inception_4b/1x1,inception_4b/relu_1x1,inception_4b/3x3_reduce,inception_4b/relu_3x3_reduce,inception_4b/3x3,inception_4b/relu_3x3,inception_4b/5x5_reduce,inception_4b/relu_5x5_reduce,inception_4b/5x5,inception_4b/relu_5x5,inception_4b/pool,inception_4b/pool_proj,inception_4b/relu_pool_proj,inception_4b/output,inception_4c/1x1,inception_4c/relu_1x1,inception_4c/3x3_reduce,inception_4c/relu_3x3_reduce,inception_4c/3x3,inception_4c/relu_3x3,inception_4c/5x5_reduce,inception_4c/relu_5x5_reduce,inception_4c/5x5,inception_4c/relu_5x5,inception_4c/pool,inception_4c/pool_proj,inception_4c/relu_pool_proj,inception_4c/output,inception_4d/1x1,inception_4d/relu_1x1,inception_4d/3x3_reduce,inception_4d/relu_3x3_reduce,inception_4d/3x3,inception_4d/relu_3x3,inception_4d/5x5_reduce,inception_4d/relu_5x5_reduce,inception_4d/5x5,inception_4d/relu_5x5,inception_4d/pool,inception_4d/pool_proj,inception_4d/relu_pool_proj,inception_4d/output,inception_4e/1x1,inception_4e/relu_1x1,inception_4e/3x3_reduce,inception_4e/relu_3x3_reduce,inception_4e/3x3,inception_4e/relu_3x3,inception_4e/5x5_reduce,inception_4e/relu_5x5_reduce,inception_4e/5x5,inception_4e/relu_5x5,inception_4e/pool,inception_4e/pool_proj,inception_4e/relu_pool_proj,inception_4e/output,pool4/3x3_s2,inception_5a/1x1,inception_5a/relu_1x1,inception_5a/3x3_reduce,inception_5a/relu_3x3_reduce,inception_5a/3x3,inception_5a/relu_3x3,inception_5a/5x5_reduce,inception_5a/relu_5x5_reduce,inception_5a/5x5,inception_5a/relu_5x5,inception_5a/pool,inception_5a/pool_proj,inception_5a/relu_pool_proj,inception_5a/output,inception_5b/1x1,inception_5b/relu_1x1,inception_5b/3x3_reduce,inception_5b/relu_3x3_reduce,inception_5b/3x3,inception_5b/relu_3x3,inception_5b/5x5_reduce,inception_5b/relu_5x5_reduce,inception_5b/5x5,inception_5b/relu_5x5,inception_5b/pool,inception_5b/pool_proj,inception_5b/relu_pool_proj,inception_5b/output,pool5/7x7_s1,loss3/classifier}, 
[06/30/2022-06:21:02] [I] [TRT] --------------- Layers running on GPU: 
[06/30/2022-06:21:02] [I] [TRT] prob, 
[06/30/2022-06:21:03] [V] [TRT] Constructing optimization profile number 0 [1/1].
[06/30/2022-06:21:03] [V] [TRT] --------------- Timing Runner: data to nvm (Reformat)
[06/30/2022-06:21:03] [V] [TRT] Tactic: 1002 time 1.1438
[06/30/2022-06:21:03] [V] [TRT] Tactic: 0 time 0.081928
[06/30/2022-06:21:03] [V] [TRT] Fastest Tactic: 0 Time: 0.081928
[06/30/2022-06:21:03] [V] [TRT] --------------- Timing Runner: data to nvm (Reformat)
[06/30/2022-06:21:04] [V] [TRT] Tactic: 1002 time 0.922096
[06/30/2022-06:21:04] [V] [TRT] Tactic: 0 time 0.978052
[06/30/2022-06:21:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.922096
[06/30/2022-06:21:04] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/30/2022-06:21:04] [V] [TRT] Tactic: 1002 time 0.930188
[06/30/2022-06:21:04] [V] [TRT] Tactic: 0 time 1.00326
[06/30/2022-06:21:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.930188
[06/30/2022-06:21:04] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/30/2022-06:21:04] [V] [TRT] Tactic: 1002 time 0.930572
[06/30/2022-06:21:04] [V] [TRT] Tactic: 0 time 0.110708
[06/30/2022-06:21:04] [V] [TRT] Fastest Tactic: 0 Time: 0.110708
[06/30/2022-06:21:04] [V] [TRT] *************** Autotuning format combination: Half(1,224,1:4,50176) -> Half(1,1,1:16,63) ***************
[06/30/2022-06:21:04] [V] [TRT] --------------- Timing Runner: {conv1/7x7_s2,conv1/relu_7x7,pool1/3x3_s2,pool1/norm1,conv2/3x3_reduce,conv2/relu_3x3_reduce,conv2/3x3,conv2/relu_3x3,conv2/norm2,pool2/3x3_s2,inception_3a/1x1,inception_3a/relu_1x1,inception_3a/3x3_reduce,inception_3a/relu_3x3_reduce,inception_3a/3x3,inception_3a/relu_3x3,inception_3a/5x5_reduce,inception_3a/relu_5x5_reduce,inception_3a/5x5,inception_3a/relu_5x5,inception_3a/pool,inception_3a/pool_proj,inception_3a/relu_pool_proj,inception_3a/output,inception_3b/1x1,inception_3b/relu_1x1,inception_3b/3x3_reduce,inception_3b/relu_3x3_reduce,inception_3b/3x3,inception_3b/relu_3x3,inception_3b/5x5_reduce,inception_3b/relu_5x5_reduce,inception_3b/5x5,inception_3b/relu_5x5,inception_3b/pool,inception_3b/pool_proj,inception_3b/relu_pool_proj,inception_3b/output,pool3/3x3_s2,inception_4a/1x1,inception_4a/relu_1x1,inception_4a/3x3_reduce,inception_4a/relu_3x3_reduce,inception_4a/3x3,inception_4a/relu_3x3,inception_4a/5x5_reduce,inception_4a/relu_5x5_reduce,inception_4a/5x5,inception_4a/relu_5x5,inception_4a/pool,inception_4a/pool_proj,inception_4a/relu_pool_proj,inception_4a/output,inception_4b/1x1,inception_4b/relu_1x1,inception_4b/3x3_reduce,inception_4b/relu_3x3_reduce,inception_4b/3x3,inception_4b/relu_3x3,inception_4b/5x5_reduce,inception_4b/relu_5x5_reduce,inception_4b/5x5,inception_4b/relu_5x5,inception_4b/pool,inception_4b/pool_proj,inception_4b/relu_pool_proj,inception_4b/output,inception_4c/1x1,inception_4c/relu_1x1,inception_4c/3x3_reduce,inception_4c/relu_3x3_reduce,inception_4c/3x3,inception_4c/relu_3x3,inception_4c/5x5_reduce,inception_4c/relu_5x5_reduce,inception_4c/5x5,inception_4c/relu_5x5,inception_4c/pool,inception_4c/pool_proj,inception_4c/relu_pool_proj,inception_4c/output,inception_4d/1x1,inception_4d/relu_1x1,inception_4d/3x3_reduce,inception_4d/relu_3x3_reduce,inception_4d/3x3,inception_4d/relu_3x3,inception_4d/5x5_reduce,inception_4d/relu_5x5_reduce,inception_4d/5x5,inception_4d/relu_5x5,inception_4d/pool,inception_4d/pool_proj,inception_4d/relu_pool_proj,inception_4d/output,inception_4e/1x1,inception_4e/relu_1x1,inception_4e/3x3_reduce,inception_4e/relu_3x3_reduce,inception_4e/3x3,inception_4e/relu_3x3,inception_4e/5x5_reduce,inception_4e/relu_5x5_reduce,inception_4e/5x5,inception_4e/relu_5x5,inception_4e/pool,inception_4e/pool_proj,inception_4e/relu_pool_proj,inception_4e/output,pool4/3x3_s2,inception_5a/1x1,inception_5a/relu_1x1,inception_5a/3x3_reduce,inception_5a/relu_3x3_reduce,inception_5a/3x3,inception_5a/relu_3x3,inception_5a/5x5_reduce,inception_5a/relu_5x5_reduce,inception_5a/5x5,inception_5a/relu_5x5,inception_5a/pool,inception_5a/pool_proj,inception_5a/relu_pool_proj,inception_5a/output,inception_5b/1x1,inception_5b/relu_1x1,inception_5b/3x3_reduce,inception_5b/relu_3x3_reduce,inception_5b/3x3,inception_5b/relu_3x3,inception_5b/5x5_reduce,inception_5b/relu_5x5_reduce,inception_5b/5x5,inception_5b/relu_5x5,inception_5b/pool,inception_5b/pool_proj,inception_5b/relu_pool_proj,inception_5b/output,pool5/7x7_s1,loss3/classifier} (DLA)
[06/30/2022-06:21:06] [V] [TRT] Tactic: 549567495827 time 0.187644
[06/30/2022-06:21:06] [V] [TRT] Fastest Tactic: 549567495827 Time: 0.187644
[06/30/2022-06:21:06] [V] [TRT] *************** Autotuning format combination: Half(1,224,50176:16,50176) -> Half(1,1,1:16,63) ***************
[06/30/2022-06:21:06] [V] [TRT] --------------- Timing Runner: {conv1/7x7_s2,conv1/relu_7x7,pool1/3x3_s2,pool1/norm1,conv2/3x3_reduce,conv2/relu_3x3_reduce,conv2/3x3,conv2/relu_3x3,conv2/norm2,pool2/3x3_s2,inception_3a/1x1,inception_3a/relu_1x1,inception_3a/3x3_reduce,inception_3a/relu_3x3_reduce,inception_3a/3x3,inception_3a/relu_3x3,inception_3a/5x5_reduce,inception_3a/relu_5x5_reduce,inception_3a/5x5,inception_3a/relu_5x5,inception_3a/pool,inception_3a/pool_proj,inception_3a/relu_pool_proj,inception_3a/output,inception_3b/1x1,inception_3b/relu_1x1,inception_3b/3x3_reduce,inception_3b/relu_3x3_reduce,inception_3b/3x3,inception_3b/relu_3x3,inception_3b/5x5_reduce,inception_3b/relu_5x5_reduce,inception_3b/5x5,inception_3b/relu_5x5,inception_3b/pool,inception_3b/pool_proj,inception_3b/relu_pool_proj,inception_3b/output,pool3/3x3_s2,inception_4a/1x1,inception_4a/relu_1x1,inception_4a/3x3_reduce,inception_4a/relu_3x3_reduce,inception_4a/3x3,inception_4a/relu_3x3,inception_4a/5x5_reduce,inception_4a/relu_5x5_reduce,inception_4a/5x5,inception_4a/relu_5x5,inception_4a/pool,inception_4a/pool_proj,inception_4a/relu_pool_proj,inception_4a/output,inception_4b/1x1,inception_4b/relu_1x1,inception_4b/3x3_reduce,inception_4b/relu_3x3_reduce,inception_4b/3x3,inception_4b/relu_3x3,inception_4b/5x5_reduce,inception_4b/relu_5x5_reduce,inception_4b/5x5,inception_4b/relu_5x5,inception_4b/pool,inception_4b/pool_proj,inception_4b/relu_pool_proj,inception_4b/output,inception_4c/1x1,inception_4c/relu_1x1,inception_4c/3x3_reduce,inception_4c/relu_3x3_reduce,inception_4c/3x3,inception_4c/relu_3x3,inception_4c/5x5_reduce,inception_4c/relu_5x5_reduce,inception_4c/5x5,inception_4c/relu_5x5,inception_4c/pool,inception_4c/pool_proj,inception_4c/relu_pool_proj,inception_4c/output,inception_4d/1x1,inception_4d/relu_1x1,inception_4d/3x3_reduce,inception_4d/relu_3x3_reduce,inception_4d/3x3,inception_4d/relu_3x3,inception_4d/5x5_reduce,inception_4d/relu_5x5_reduce,inception_4d/5x5,inception_4d/relu_5x5,inception_4d/pool,inception_4d/pool_proj,inception_4d/relu_pool_proj,inception_4d/output,inception_4e/1x1,inception_4e/relu_1x1,inception_4e/3x3_reduce,inception_4e/relu_3x3_reduce,inception_4e/3x3,inception_4e/relu_3x3,inception_4e/5x5_reduce,inception_4e/relu_5x5_reduce,inception_4e/5x5,inception_4e/relu_5x5,inception_4e/pool,inception_4e/pool_proj,inception_4e/relu_pool_proj,inception_4e/output,pool4/3x3_s2,inception_5a/1x1,inception_5a/relu_1x1,inception_5a/3x3_reduce,inception_5a/relu_3x3_reduce,inception_5a/3x3,inception_5a/relu_3x3,inception_5a/5x5_reduce,inception_5a/relu_5x5_reduce,inception_5a/5x5,inception_5a/relu_5x5,inception_5a/pool,inception_5a/pool_proj,inception_5a/relu_pool_proj,inception_5a/output,inception_5b/1x1,inception_5b/relu_1x1,inception_5b/3x3_reduce,inception_5b/relu_3x3_reduce,inception_5b/3x3,inception_5b/relu_3x3,inception_5b/5x5_reduce,inception_5b/relu_5x5_reduce,inception_5b/5x5,inception_5b/relu_5x5,inception_5b/pool,inception_5b/pool_proj,inception_5b/relu_pool_proj,inception_5b/output,pool5/7x7_s1,loss3/classifier} (DLA)
[06/30/2022-06:21:09] [V] [TRT] Tactic: 549567495827 time 0.170364
[06/30/2022-06:21:09] [V] [TRT] Fastest Tactic: 549567495827 Time: 0.170364
[06/30/2022-06:21:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/30/2022-06:21:09] [V] [TRT] Tactic: 1002 time 0.02688
[06/30/2022-06:21:09] [V] [TRT] Tactic: 0 time 0.015108
[06/30/2022-06:21:09] [V] [TRT] Fastest Tactic: 0 Time: 0.015108
[06/30/2022-06:21:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/30/2022-06:21:09] [V] [TRT] Tactic: 1002 time 0.026632
[06/30/2022-06:21:09] [V] [TRT] Tactic: 0 time 0.015096
[06/30/2022-06:21:09] [V] [TRT] Fastest Tactic: 0 Time: 0.015096
[06/30/2022-06:21:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/30/2022-06:21:09] [V] [TRT] Tactic: 1002 time 0.028028
[06/30/2022-06:21:09] [V] [TRT] Tactic: 0 time 0.014844
[06/30/2022-06:21:09] [V] [TRT] Fastest Tactic: 0 Time: 0.014844
[06/30/2022-06:21:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/30/2022-06:21:09] [V] [TRT] Tactic: 1002 time 0.019864
[06/30/2022-06:21:09] [V] [TRT] Tactic: 0 time 0.014728
[06/30/2022-06:21:09] [V] [TRT] Fastest Tactic: 0 Time: 0.014728
[06/30/2022-06:21:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/30/2022-06:21:09] [V] [TRT] Tactic: 1002 time 0.03034
[06/30/2022-06:21:09] [V] [TRT] Tactic: 0 time 0.014848
[06/30/2022-06:21:09] [V] [TRT] Fastest Tactic: 0 Time: 0.014848
[06/30/2022-06:21:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/30/2022-06:21:10] [V] [TRT] Tactic: 1002 time 0.020084
[06/30/2022-06:21:10] [V] [TRT] Tactic: 0 time 0.014968
[06/30/2022-06:21:10] [V] [TRT] Fastest Tactic: 0 Time: 0.014968
[06/30/2022-06:21:10] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/30/2022-06:21:10] [V] [TRT] Tactic: 1002 time 0.029988
[06/30/2022-06:21:10] [V] [TRT] Tactic: 0 time 0.01498
[06/30/2022-06:21:10] [V] [TRT] Fastest Tactic: 0 Time: 0.01498
[06/30/2022-06:21:10] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/30/2022-06:21:10] [V] [TRT] Tactic: 1002 time 0.029948
[06/30/2022-06:21:10] [V] [TRT] Tactic: 0 time 0.014604
[06/30/2022-06:21:10] [V] [TRT] Fastest Tactic: 0 Time: 0.014604
[06/30/2022-06:21:10] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/30/2022-06:21:10] [V] [TRT] Tactic: 1002 time 0.030084
[06/30/2022-06:21:10] [V] [TRT] Tactic: 0 time 0.014724
[06/30/2022-06:21:10] [V] [TRT] Fastest Tactic: 0 Time: 0.014724
[06/30/2022-06:21:10] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/30/2022-06:21:10] [V] [TRT] Tactic: 1002 time 0.030092
[06/30/2022-06:21:10] [V] [TRT] Tactic: 0 time 0.014852
[06/30/2022-06:21:10] [V] [TRT] Fastest Tactic: 0 Time: 0.014852
[06/30/2022-06:21:10] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/30/2022-06:21:10] [V] [TRT] Tactic: 1002 time 0.030056
[06/30/2022-06:21:10] [V] [TRT] Tactic: 0 time 0.014976
[06/30/2022-06:21:10] [V] [TRT] Fastest Tactic: 0 Time: 0.014976
[06/30/2022-06:21:10] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/30/2022-06:21:10] [V] [TRT] Tactic: 1002 time 0.030208
[06/30/2022-06:21:10] [V] [TRT] Tactic: 0 time 0.014976
[06/30/2022-06:21:10] [V] [TRT] Fastest Tactic: 0 Time: 0.014976
[06/30/2022-06:21:10] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,1000) -> Float(1,1,1,1000) ***************
[06/30/2022-06:21:10] [V] [TRT] --------------- Timing Runner: prob (SoftMax)
[06/30/2022-06:21:10] [V] [TRT] Tactic: 1001 time 0.024956
[06/30/2022-06:21:10] [V] [TRT] Fastest Tactic: 1001 Time: 0.024956
[06/30/2022-06:21:10] [V] [TRT] --------------- Timing Runner: prob (ExtSoftMax)
[06/30/2022-06:21:10] [V] [TRT] ExtSoftMax has no valid tactics for this config, skipping
[06/30/2022-06:21:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: SoftMax Tactic: 1001
[06/30/2022-06:21:10] [V] [TRT] 
[06/30/2022-06:21:10] [V] [TRT] *************** Autotuning format combination: Half(1,1,1,1000) -> Half(1,1,1,1000) ***************
[06/30/2022-06:21:10] [V] [TRT] --------------- Timing Runner: prob (SoftMax)
[06/30/2022-06:21:10] [V] [TRT] Tactic: 1001 time 0.02892
[06/30/2022-06:21:10] [V] [TRT] Fastest Tactic: 1001 Time: 0.02892
[06/30/2022-06:21:10] [V] [TRT] --------------- Timing Runner: prob (ExtSoftMax)
[06/30/2022-06:21:10] [V] [TRT] ExtSoftMax has no valid tactics for this config, skipping
[06/30/2022-06:21:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: SoftMax Tactic: 1001
[06/30/2022-06:21:10] [V] [TRT] 
[06/30/2022-06:21:10] [V] [TRT] *************** Autotuning format combination: Half(1,1,1:2,500) -> Half(1,1,1:2,500) ***************
[06/30/2022-06:21:10] [V] [TRT] --------------- Timing Runner: prob (SoftMax)
[06/30/2022-06:21:10] [V] [TRT] Tactic: 18 time 0.019968
[06/30/2022-06:21:10] [V] [TRT] Fastest Tactic: 18 Time: 0.019968
[06/30/2022-06:21:10] [V] [TRT] --------------- Timing Runner: prob (ExtSoftMax)
[06/30/2022-06:21:10] [V] [TRT] ExtSoftMax has no valid tactics for this config, skipping
[06/30/2022-06:21:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: SoftMax Tactic: 18
[06/30/2022-06:21:10] [V] [TRT] 
[06/30/2022-06:21:10] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/30/2022-06:21:10] [V] [TRT] Tactic: 1002 time 0.019988
[06/30/2022-06:21:10] [V] [TRT] Tactic: 0 time 0.014708
[06/30/2022-06:21:10] [V] [TRT] Fastest Tactic: 0 Time: 0.014708
[06/30/2022-06:21:10] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/30/2022-06:21:10] [V] [TRT] Tactic: 1002 time 0.030208
[06/30/2022-06:21:10] [V] [TRT] Tactic: 0 time 0.014732
[06/30/2022-06:21:10] [V] [TRT] Fastest Tactic: 0 Time: 0.014732
[06/30/2022-06:21:10] [V] [TRT] Reformatting format: [in] Half(1,1,1:2,500), [out] Float(1,1,1,1000)
[06/30/2022-06:21:10] [06/30/2022-06:21:10] [V] [TRT] --------------- Timing Runner: data to nvm (Reformat)
[06/30/2022-06:21:10] [V] [TRT] Tactic: 1002 time 1.13676
[06/30/2022-06:21:10] [V] [TRT] Tactic: 0 time 0.08484
[06/30/2022-06:21:10] [V] [TRT] Fastest Tactic: 0 Time: 0.08484
[06/30/2022-06:21:10] [V] [TRT] --------------- Timing Runner: data to nvm (Reformat)
[06/30/2022-06:21:10] [V] [TRT] Tactic: 1002 time 0.9385
[06/30/2022-06:21:10] [V] [TRT] Tactic: 0 time 0.981132
[06/30/2022-06:21:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.9385
[06/30/2022-06:21:10] [V] [TRT] Adding reformat layer: {conv1/7x7_s2,conv1/relu_7x7,pool1/3x3_s2,pool1/norm1,conv2/3x3_reduce,conv2/relu_3x3_reduce,conv2/3x3,conv2/relu_3x3,conv2/norm2,pool2/3x3_s2,inception_3a/1x1,inception_3a/relu_1x1,inception_3a/3x3_reduce,inception_3a/relu_3x3_reduce,inception_3a/3x3,inception_3a/relu_3x3,inception_3a/5x5_reduce,inception_3a/relu_5x5_reduce,inception_3a/5x5,inception_3a/relu_5x5,inception_3a/pool,inception_3a/pool_proj,inception_3a/relu_pool_proj,inception_3a/output,inception_3b/1x1,inception_3b/relu_1x1,inception_3b/3x3_reduce,inception_3b/relu_3x3_reduce,inception_3b/3x3,inception_3b/relu_3x3,inception_3b/5x5_reduce,inception_3b/relu_5x5_reduce,inception_3b/5x5,inception_3b/relu_5x5,inception_3b/pool,inception_3b/pool_proj,inception_3b/relu_pool_proj,inception_3b/output,pool3/3x3_s2,inception_4a/1x1,inception_4a/relu_1x1,inception_4a/3x3_reduce,inception_4a/relu_3x3_reduce,inception_4a/3x3,inception_4a/relu_3x3,inception_4a/5x5_reduce,inception_4a/relu_5x5_reduce,inception_4a/5x5,inception_4a/relu_5x5,inception_4a/pool,inception_4a/pool_proj,inception_4a/relu_pool_proj,inception_4a/output,inception_4b/1x1,inception_4b/relu_1x1,inception_4b/3x3_reduce,inception_4b/relu_3x3_reduce,inception_4b/3x3,inception_4b/relu_3x3,inception_4b/5x5_reduce,inception_4b/relu_5x5_reduce,inception_4b/5x5,inception_4b/relu_5x5,inception_4b/pool,inception_4b/pool_proj,inception_4b/relu_pool_proj,inception_4b/output,inception_4c/1x1,inception_4c/relu_1x1,inception_4c/3x3_reduce,inception_4c/relu_3x3_reduce,inception_4c/3x3,inception_4c/relu_3x3,inception_4c/5x5_reduce,inception_4c/relu_5x5_reduce,inception_4c/5x5,inception_4c/relu_5x5,inception_4c/pool,inception_4c/pool_proj,inception_4c/relu_pool_proj,inception_4c/output,inception_4d/1x1,inception_4d/relu_1x1,inception_4d/3x3_reduce,inception_4d/relu_3x3_reduce,inception_4d/3x3,inception_4d/relu_3x3,inception_4d/5x5_reduce,inception_4d/relu_5x5_reduce,inception_4d/5x5,inception_4d/relu_5x5,inception_4d/pool,inception_4d/pool_proj,inception_4d/relu_pool_proj,inception_4d/output,inception_4e/1x1,inception_4e/relu_1x1,inception_4e/3x3_reduce,inception_4e/relu_3x3_reduce,inception_4e/3x3,inception_4e/relu_3x3,inception_4e/5x5_reduce,inception_4e/relu_5x5_reduce,inception_4e/5x5,inception_4e/relu_5x5,inception_4e/pool,inception_4e/pool_proj,inception_4e/relu_pool_proj,inception_4e/output,pool4/3x3_s2,inception_5a/1x1,inception_5a/relu_1x1,inception_5a/3x3_reduce,inception_5a/relu_3x3_reduce,inception_5a/3x3,inception_5a/relu_3x3,inception_5a/5x5_reduce,inception_5a/relu_5x5_reduce,inception_5a/5x5,inception_5a/relu_5x5,inception_5a/pool,inception_5a/pool_proj,inception_5a/relu_pool_proj,inception_5a/output,inception_5b/1x1,inception_5b/relu_1x1,inception_5b/3x3_reduce,inception_5b/relu_3x3_reduce,inception_5b/3x3,inception_5b/relu_3x3,inception_5b/5x5_reduce,inception_5b/relu_5x5_reduce,inception_5b/5x5,inception_5b/relu_5x5,inception_5b/pool,inception_5b/pool_proj,inception_5b/relu_pool_proj,inception_5b/output,pool5/7x7_s1,loss3/classifier} output to be reformatted 0 (loss3/classifier) from Half(1,1,1:2,500) to Half(1,1,1:16,63)
[06/30/2022-06:21:10] [V] [TRT] Adding reformat layer: prob output to be reformatted 0 (prob) from Float(1,1,1,1000) to Half(1,1,1:2,500)
[06/30/2022-06:21:10] [V] [TRT] Formats and tactics selection completed in 6.40327 seconds.
[06/30/2022-06:21:10] [V] [TRT] After reformat layers: 7 layers
[06/30/2022-06:21:10] [V] [TRT] Block size 16777216
[06/30/2022-06:21:10] [V] [TRT] Block size 401408
[06/30/2022-06:21:10] [V] [TRT] Block size 2048
[06/30/2022-06:21:10] [V] [TRT] Total Activation Memory: 17180672
[06/30/2022-06:21:10] [I] [TRT] Detected 1 inputs and 1 output network tensors.
[06/30/2022-06:21:11] [V] [TRT] Layer: data to nvm Weights: 0 HostPersistent: 0 DevicePersistent: 0
[06/30/2022-06:21:11] [V] [TRT] Layer: {conv1/7x7_s2,conv1/relu_7x7,pool1/3x3_s2,pool1/norm1,conv2/3x3_reduce,conv2/relu_3x3_reduce,conv2/3x3,conv2/relu_3x3,conv2/norm2,pool2/3x3_s2,inception_3a/1x1,inception_3a/relu_1x1,inception_3a/3x3_reduce,inception_3a/relu_3x3_reduce,inception_3a/3x3,inception_3a/relu_3x3,inception_3a/5x5_reduce,inception_3a/relu_5x5_reduce,inception_3a/5x5,inception_3a/relu_5x5,inception_3a/pool,inception_3a/pool_proj,inception_3a/relu_pool_proj,inception_3a/output,inception_3b/1x1,inception_3b/relu_1x1,inception_3b/3x3_reduce,inception_3b/relu_3x3_reduce,inception_3b/3x3,inception_3b/relu_3x3,inception_3b/5x5_reduce,inception_3b/relu_5x5_reduce,inception_3b/5x5,inception_3b/relu_5x5,inception_3b/pool,inception_3b/pool_proj,inception_3b/relu_pool_proj,inception_3b/output,pool3/3x3_s2,inception_4a/1x1,inception_4a/relu_1x1,inception_4a/3x3_reduce,inception_4a/relu_3x3_reduce,inception_4a/3x3,inception_4a/relu_3x3,inception_4a/5x5_reduce,inception_4a/relu_5x5_reduce,inception_4a/5x5,inception_4a/relu_5x5,inception_4a/pool,inception_4a/pool_proj,inception_4a/relu_pool_proj,inception_4a/output,inception_4b/1x1,inception_4b/relu_1x1,inception_4b/3x3_reduce,inception_4b/relu_3x3_reduce,inception_4b/3x3,inception_4b/relu_3x3,inception_4b/5x5_reduce,inception_4b/relu_5x5_reduce,inception_4b/5x5,inception_4b/relu_5x5,inception_4b/pool,inception_4b/pool_proj,inception_4b/relu_pool_proj,inception_4b/output,inception_4c/1x1,inception_4c/relu_1x1,inception_4c/3x3_reduce,inception_4c/relu_3x3_reduce,inception_4c/3x3,inception_4c/relu_3x3,inception_4c/5x5_reduce,inception_4c/relu_5x5_reduce,inception_4c/5x5,inception_4c/relu_5x5,inception_4c/pool,inception_4c/pool_proj,inception_4c/relu_pool_proj,inception_4c/output,inception_4d/1x1,inception_4d/relu_1x1,inception_4d/3x3_reduce,inception_4d/relu_3x3_reduce,inception_4d/3x3,inception_4d/relu_3x3,inception_4d/5x5_reduce,inception_4d/relu_5x5_reduce,inception_4d/5x5,inception_4d/relu_5x5,inception_4d/pool,inception_4d/pool_proj,inception_4d/relu_pool_proj,inception_4d/output,inception_4e/1x1,inception_4e/relu_1x1,inception_4e/3x3_reduce,inception_4e/relu_3x3_reduce,inception_4e/3x3,inception_4e/relu_3x3,inception_4e/5x5_reduce,inception_4e/relu_5x5_reduce,inception_4e/5x5,inception_4e/relu_5x5,inception_4e/pool,inception_4e/pool_proj,inception_4e/relu_pool_proj,inception_4e/output,pool4/3x3_s2,inception_5a/1x1,inception_5a/relu_1x1,inception_5a/3x3_reduce,inception_5a/relu_3x3_reduce,inception_5a/3x3,inception_5a/relu_3x3,inception_5a/5x5_reduce,inception_5a/relu_5x5_reduce,inception_5a/5x5,inception_5a/relu_5x5,inception_5a/pool,inception_5a/pool_proj,inception_5a/relu_pool_proj,inception_5a/output,inception_5b/1x1,inception_5b/relu_1x1,inception_5b/3x3_reduce,inception_5b/relu_3x3_reduce,inception_5b/3x3,inception_5b/relu_3x3,inception_5b/5x5_reduce,inception_5b/relu_5x5_reduce,inception_5b/5x5,inception_5b/relu_5x5,inception_5b/pool,inception_5b/pool_proj,inception_5b/relu_pool_proj,inception_5b/output,pool5/7x7_s1,loss3/classifier} Weights: 0 HostPersistent: 864 DevicePersistent: 0
[06/30/2022-06:21:11] [V] [TRT] Layer: data copy finish Weights: 0 HostPersistent: 0 DevicePersistent: 0
[06/30/2022-06:21:11] [V] [TRT] Layer: {conv1/7x7_s2,conv1/relu_7x7,pool1/3x3_s2,pool1/norm1,conv2/3x3_reduce,conv2/relu_3x3_reduce,conv2/3x3,conv2/relu_3x3,conv2/norm2,pool2/3x3_s2,inception_3a/1x1,inception_3a/relu_1x1,inception_3a/3x3_reduce,inception_3a/relu_3x3_reduce,inception_3a/3x3,inception_3a/relu_3x3,inception_3a/5x5_reduce,inception_3a/relu_5x5_reduce,inception_3a/5x5,inception_3a/relu_5x5,inception_3a/pool,inception_3a/pool_proj,inception_3a/relu_pool_proj,inception_3a/output,inception_3b/1x1,inception_3b/relu_1x1,inception_3b/3x3_reduce,inception_3b/relu_3x3_reduce,inception_3b/3x3,inception_3b/relu_3x3,inception_3b/5x5_reduce,inception_3b/relu_5x5_reduce,inception_3b/5x5,inception_3b/relu_5x5,inception_3b/pool,inception_3b/pool_proj,inception_3b/relu_pool_proj,inception_3b/output,pool3/3x3_s2,inception_4a/1x1,inception_4a/relu_1x1,inception_4a/3x3_reduce,inception_4a/relu_3x3_reduce,inception_4a/3x3,inception_4a/relu_3x3,inception_4a/5x5_reduce,inception_4a/relu_5x5_reduce,inception_4a/5x5,inception_4a/relu_5x5,inception_4a/pool,inception_4a/pool_proj,inception_4a/relu_pool_proj,inception_4a/output,inception_4b/1x1,inception_4b/relu_1x1,inception_4b/3x3_reduce,inception_4b/relu_3x3_reduce,inception_4b/3x3,inception_4b/relu_3x3,inception_4b/5x5_reduce,inception_4b/relu_5x5_reduce,inception_4b/5x5,inception_4b/relu_5x5,inception_4b/pool,inception_4b/pool_proj,inception_4b/relu_pool_proj,inception_4b/output,inception_4c/1x1,inception_4c/relu_1x1,inception_4c/3x3_reduce,inception_4c/relu_3x3_reduce,inception_4c/3x3,inception_4c/relu_3x3,inception_4c/5x5_reduce,inception_4c/relu_5x5_reduce,inception_4c/5x5,inception_4c/relu_5x5,inception_4c/pool,inception_4c/pool_proj,inception_4c/relu_pool_proj,inception_4c/output,inception_4d/1x1,inception_4d/relu_1x1,inception_4d/3x3_reduce,inception_4d/relu_3x3_reduce,inception_4d/3x3,inception_4d/relu_3x3,inception_4d/5x5_reduce,inception_4d/relu_5x5_reduce,inception_4d/5x5,inception_4d/relu_5x5,inception_4d/pool,inception_4d/pool_proj,inception_4d/relu_pool_proj,inception_4d/output,inception_4e/1x1,inception_4e/relu_1x1,inception_4e/3x3_reduce,inception_4e/relu_3x3_reduce,inception_4e/3x3,inception_4e/relu_3x3,inception_4e/5x5_reduce,inception_4e/relu_5x5_reduce,inception_4e/5x5,inception_4e/relu_5x5,inception_4e/pool,inception_4e/pool_proj,inception_4e/relu_pool_proj,inception_4e/output,pool4/3x3_s2,inception_5a/1x1,inception_5a/relu_1x1,inception_5a/3x3_reduce,inception_5a/relu_3x3_reduce,inception_5a/3x3,inception_5a/relu_3x3,inception_5a/5x5_reduce,inception_5a/relu_5x5_reduce,inception_5a/5x5,inception_5a/relu_5x5,inception_5a/pool,inception_5a/pool_proj,inception_5a/relu_pool_proj,inception_5a/output,inception_5b/1x1,inception_5b/relu_1x1,inception_5b/3x3_reduce,inception_5b/relu_3x3_reduce,inception_5b/3x3,inception_5b/relu_3x3,inception_5b/5x5_reduce,inception_5b/relu_5x5_reduce,inception_5b/5x5,inception_5b/relu_5x5,inception_5b/pool,inception_5b/pool_proj,inception_5b/relu_pool_proj,inception_5b/output,pool5/7x7_s1,loss3/classifier} output reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0
[06/30/2022-06:21:11] [V] [TRT] Layer: {conv1/7x7_s2,conv1/relu_7x7,pool1/3x3_s2,pool1/norm1,conv2/3x3_reduce,conv2/relu_3x3_reduce,conv2/3x3,conv2/relu_3x3,conv2/norm2,pool2/3x3_s2,inception_3a/1x1,inception_3a/relu_1x1,inception_3a/3x3_reduce,inception_3a/relu_3x3_reduce,inception_3a/3x3,inception_3a/relu_3x3,inception_3a/5x5_reduce,inception_3a/relu_5x5_reduce,inception_3a/5x5,inception_3a/relu_5x5,inception_3a/pool,inception_3a/pool_proj,inception_3a/relu_pool_proj,inception_3a/output,inception_3b/1x1,inception_3b/relu_1x1,inception_3b/3x3_reduce,inception_3b/relu_3x3_reduce,inception_3b/3x3,inception_3b/relu_3x3,inception_3b/5x5_reduce,inception_3b/relu_5x5_reduce,inception_3b/5x5,inception_3b/relu_5x5,inception_3b/pool,inception_3b/pool_proj,inception_3b/relu_pool_proj,inception_3b/output,pool3/3x3_s2,inception_4a/1x1,inception_4a/relu_1x1,inception_4a/3x3_reduce,inception_4a/relu_3x3_reduce,inception_4a/3x3,inception_4a/relu_3x3,inception_4a/5x5_reduce,inception_4a/relu_5x5_reduce,inception_4a/5x5,inception_4a/relu_5x5,inception_4a/pool,inception_4a/pool_proj,inception_4a/relu_pool_proj,inception_4a/output,inception_4b/1x1,inception_4b/relu_1x1,inception_4b/3x3_reduce,inception_4b/relu_3x3_reduce,inception_4b/3x3,inception_4b/relu_3x3,inception_4b/5x5_reduce,inception_4b/relu_5x5_reduce,inception_4b/5x5,inception_4b/relu_5x5,inception_4b/pool,inception_4b/pool_proj,inception_4b/relu_pool_proj,inception_4b/output,inception_4c/1x1,inception_4c/relu_1x1,inception_4c/3x3_reduce,inception_4c/relu_3x3_reduce,inception_4c/3x3,inception_4c/relu_3x3,inception_4c/5x5_reduce,inception_4c/relu_5x5_reduce,inception_4c/5x5,inception_4c/relu_5x5,inception_4c/pool,inception_4c/pool_proj,inception_4c/relu_pool_proj,inception_4c/output,inception_4d/1x1,inception_4d/relu_1x1,inception_4d/3x3_reduce,inception_4d/relu_3x3_reduce,inception_4d/3x3,inception_4d/relu_3x3,inception_4d/5x5_reduce,inception_4d/relu_5x5_reduce,inception_4d/5x5,inception_4d/relu_5x5,inception_4d/pool,inception_4d/pool_proj,inception_4d/relu_pool_proj,inception_4d/output,inception_4e/1x1,inception_4e/relu_1x1,inception_4e/3x3_reduce,inception_4e/relu_3x3_reduce,inception_4e/3x3,inception_4e/relu_3x3,inception_4e/5x5_reduce,inception_4e/relu_5x5_reduce,inception_4e/5x5,inception_4e/relu_5x5,inception_4e/pool,inception_4e/pool_proj,inception_4e/relu_pool_proj,inception_4e/output,pool4/3x3_s2,inception_5a/1x1,inception_5a/relu_1x1,inception_5a/3x3_reduce,inception_5a/relu_3x3_reduce,inception_5a/3x3,inception_5a/relu_3x3,inception_5a/5x5_reduce,inception_5a/relu_5x5_reduce,inception_5a/5x5,inception_5a/relu_5x5,inception_5a/pool,inception_5a/pool_proj,inception_5a/relu_pool_proj,inception_5a/output,inception_5b/1x1,inception_5b/relu_1x1,inception_5b/3x3_reduce,inception_5b/relu_3x3_reduce,inception_5b/3x3,inception_5b/relu_3x3,inception_5b/5x5_reduce,inception_5b/relu_5x5_reduce,inception_5b/5x5,inception_5b/relu_5x5,inception_5b/pool,inception_5b/pool_proj,inception_5b/relu_pool_proj,inception_5b/output,pool5/7x7_s1,loss3/classifier} output to be reformatted 0 finish Weights: 0 HostPersistent: 0 DevicePersistent: 0
[06/30/2022-06:21:11] [V] [TRT] Layer: prob Weights: 0 HostPersistent: 0 DevicePersistent: 0
[06/30/2022-06:21:11] [V] [TRT] Layer: prob output reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0
[06/30/2022-06:21:11] [V] [TRT] Total Host Persistent Memory: 864
[06/30/2022-06:21:11] [V] [TRT] Total Device Persistent Memory: 0
[06/30/2022-06:21:11] [V] [TRT] Total Weight Memory: 0
[06/30/2022-06:21:11] [V] [TRT] Builder timing cache: created 16 entries, 16 hit(s)
[06/30/2022-06:21:11] [V] [TRT] Engine generation completed in 9.15134 seconds.
[06/30/2022-06:21:11] [V] [TRT] Engine Layer Information:
[06/30/2022-06:21:11] [V] [TRT] Layer(Reformat): data to nvm, Tactic: 0, data[Float(3,224,224)] -> data copy[Half(3,224,224)]
[06/30/2022-06:21:11] [V] [TRT] Layer(DLANative): {conv1/7x7_s2,conv1/relu_7x7,pool1/3x3_s2,pool1/norm1,conv2/3x3_reduce,conv2/relu_3x3_reduce,conv2/3x3,conv2/relu_3x3,conv2/norm2,pool2/3x3_s2,inception_3a/1x1,inception_3a/relu_1x1,inception_3a/3x3_reduce,inception_3a/relu_3x3_reduce,inception_3a/3x3,inception_3a/relu_3x3,inception_3a/5x5_reduce,inception_3a/relu_5x5_reduce,inception_3a/5x5,inception_3a/relu_5x5,inception_3a/pool,inception_3a/pool_proj,inception_3a/relu_pool_proj,inception_3a/output,inception_3b/1x1,inception_3b/relu_1x1,inception_3b/3x3_reduce,inception_3b/relu_3x3_reduce,inception_3b/3x3,inception_3b/relu_3x3,inception_3b/5x5_reduce,inception_3b/relu_5x5_reduce,inception_3b/5x5,inception_3b/relu_5x5,inception_3b/pool,inception_3b/pool_proj,inception_3b/relu_pool_proj,inception_3b/output,pool3/3x3_s2,inception_4a/1x1,inception_4a/relu_1x1,inception_4a/3x3_reduce,inception_4a/relu_3x3_reduce,inception_4a/3x3,inception_4a/relu_3x3,inception_4a/5x5_reduce,inception_4a/relu_5x5_reduce,inception_4a/5x5,inception_4a/relu_5x5,inception_4a/pool,inception_4a/pool_proj,inception_4a/relu_pool_proj,inception_4a/output,inception_4b/1x1,inception_4b/relu_1x1,inception_4b/3x3_reduce,inception_4b/relu_3x3_reduce,inception_4b/3x3,inception_4b/relu_3x3,inception_4b/5x5_reduce,inception_4b/relu_5x5_reduce,inception_4b/5x5,inception_4b/relu_5x5,inception_4b/pool,inception_4b/pool_proj,inception_4b/relu_pool_proj,inception_4b/output,inception_4c/1x1,inception_4c/relu_1x1,inception_4c/3x3_reduce,inception_4c/relu_3x3_reduce,inception_4c/3x3,inception_4c/relu_3x3,inception_4c/5x5_reduce,inception_4c/relu_5x5_reduce,inception_4c/5x5,inception_4c/relu_5x5,inception_4c/pool,inception_4c/pool_proj,inception_4c/relu_pool_proj,inception_4c/output,inception_4d/1x1,inception_4d/relu_1x1,inception_4d/3x3_reduce,inception_4d/relu_3x3_reduce,inception_4d/3x3,inception_4d/relu_3x3,inception_4d/5x5_reduce,inception_4d/relu_5x5_reduce,inception_4d/5x5,inception_4d/relu_5x5,inception_4d/pool,inception_4d/pool_proj,inception_4d/relu_pool_proj,inception_4d/output,inception_4e/1x1,inception_4e/relu_1x1,inception_4e/3x3_reduce,inception_4e/relu_3x3_reduce,inception_4e/3x3,inception_4e/relu_3x3,inception_4e/5x5_reduce,inception_4e/relu_5x5_reduce,inception_4e/5x5,inception_4e/relu_5x5,inception_4e/pool,inception_4e/pool_proj,inception_4e/relu_pool_proj,inception_4e/output,pool4/3x3_s2,inception_5a/1x1,inception_5a/relu_1x1,inception_5a/3x3_reduce,inception_5a/relu_3x3_reduce,inception_5a/3x3,inception_5a/relu_3x3,inception_5a/5x5_reduce,inception_5a/relu_5x5_reduce,inception_5a/5x5,inception_5a/relu_5x5,inception_5a/pool,inception_5a/pool_proj,inception_5a/relu_pool_proj,inception_5a/output,inception_5b/1x1,inception_5b/relu_1x1,inception_5b/3x3_reduce,inception_5b/relu_3x3_reduce,inception_5b/3x3,inception_5b/relu_3x3,inception_5b/5x5_reduce,inception_5b/relu_5x5_reduce,inception_5b/5x5,inception_5b/relu_5x5,inception_5b/pool,inception_5b/pool_proj,inception_5b/relu_pool_proj,inception_5b/output,pool5/7x7_s1,loss3/classifier}, Tactic: 549567495827, data copy[Half(3,224,224)] -> {conv1/7x7_s2,conv1/relu_7x7,pool1/3x3_s2,pool1/norm1,conv2/3x3_reduce,conv2/relu_3x3_reduce,conv2/3x3,conv2/relu_3x3,conv2/norm2,pool2/3x3_s2,inception_3a/1x1,inception_3a/relu_1x1,inception_3a/3x3_reduce,inception_3a/relu_3x3_reduce,inception_3a/3x3,inception_3a/relu_3x3,inception_3a/5x5_reduce,inception_3a/relu_5x5_reduce,inception_3a/5x5,inception_3a/relu_5x5,inception_3a/pool,inception_3a/pool_proj,inception_3a/relu_pool_proj,inception_3a/output,inception_3b/1x1,inception_3b/relu_1x1,inception_3b/3x3_reduce,inception_3b/relu_3x3_reduce,inception_3b/3x3,inception_3b/relu_3x3,inception_3b/5x5_reduce,inception_3b/relu_5x5_reduce,inception_3b/5x5,inception_3b/relu_5x5,inception_3b/pool,inception_3b/pool_proj,inception_3b/relu_pool_proj,inception_3b/output,pool3/3x3_s2,inception_4a/1x1,inception_4a/relu_1x1,inception_4a/3x3_reduce,inception_4a/relu_3x3_reduce,inception_4a/3x3,inception_4a/relu_3x3,inception_4a/5x5_reduce,inception_4a/relu_5x5_reduce,inception_4a/5x5,inception_4a/relu_5x5,inception_4a/pool,inception_4a/pool_proj,inception_4a/relu_pool_proj,inception_4a/output,inception_4b/1x1,inception_4b/relu_1x1,inception_4b/3x3_reduce,inception_4b/relu_3x3_reduce,inception_4b/3x3,inception_4b/relu_3x3,inception_4b/5x5_reduce,inception_4b/relu_5x5_reduce,inception_4b/5x5,inception_4b/relu_5x5,inception_4b/pool,inception_4b/pool_proj,inception_4b/relu_pool_proj,inception_4b/output,inception_4c/1x1,inception_4c/relu_1x1,inception_4c/3x3_reduce,inception_4c/relu_3x3_reduce,inception_4c/3x3,inception_4c/relu_3x3,inception_4c/5x5_reduce,inception_4c/relu_5x5_reduce,inception_4c/5x5,inception_4c/relu_5x5,inception_4c/pool,inception_4c/pool_proj,inception_4c/relu_pool_proj,inception_4c/output,inception_4d/1x1,inception_4d/relu_1x1,inception_4d/3x3_reduce,inception_4d/relu_3x3_reduce,inception_4d/3x3,inception_4d/relu_3x3,inception_4d/5x5_reduce,inception_4d/relu_5x5_reduce,inception_4d/5x5,inception_4d/relu_5x5,inception_4d/pool,inception_4d/pool_proj,inception_4d/relu_pool_proj,inception_4d/output,inception_4e/1x1,inception_4e/relu_1x1,inception_4e/3x3_reduce,inception_4e/relu_3x3_reduce,inception_4e/3x3,inception_4e/relu_3x3,inception_4e/5x5_reduce,inception_4e/relu_5x5_reduce,inception_4e/5x5,inception_4e/relu_5x5,inception_4e/pool,inception_4e/pool_proj,inception_4e/relu_pool_proj,inception_4e/output,pool4/3x3_s2,inception_5a/1x1,inception_5a/relu_1x1,inception_5a/3x3_reduce,inception_5a/relu_3x3_reduce,inception_5a/3x3,inception_5a/relu_3x3,inception_5a/5x5_reduce,inception_5a/relu_5x5_reduce,inception_5a/5x5,inception_5a/relu_5x5,inception_5a/pool,inception_5a/pool_proj,inception_5a/relu_pool_proj,inception_5a/output,inception_5b/1x1,inception_5b/relu_1x1,inception_5b/3x3_reduce,inception_5b/relu_3x3_reduce,inception_5b/3x3,inception_5b/relu_3x3,inception_5b/5x5_reduce,inception_5b/relu_5x5_reduce,inception_5b/5x5,inception_5b/relu_5x5,inception_5b/pool,inception_5b/pool_proj,inception_5b/relu_pool_proj,inception_5b/output,pool5/7x7_s1,loss3/classifier} output to be reformatted 0[Half(1000,1,1)]
[06/30/2022-06:21:11] [V] [TRT] Layer(FinishNvmRegion): data copy finish, Tactic: 0, data copy[Half(3,224,224)] -> 
[06/30/2022-06:21:11] [V] [TRT] Layer(Reformat): {conv1/7x7_s2,conv1/relu_7x7,pool1/3x3_s2,pool1/norm1,conv2/3x3_reduce,conv2/relu_3x3_reduce,conv2/3x3,conv2/relu_3x3,conv2/norm2,pool2/3x3_s2,inception_3a/1x1,inception_3a/relu_1x1,inception_3a/3x3_reduce,inception_3a/relu_3x3_reduce,inception_3a/3x3,inception_3a/relu_3x3,inception_3a/5x5_reduce,inception_3a/relu_5x5_reduce,inception_3a/5x5,inception_3a/relu_5x5,inception_3a/pool,inception_3a/pool_proj,inception_3a/relu_pool_proj,inception_3a/output,inception_3b/1x1,inception_3b/relu_1x1,inception_3b/3x3_reduce,inception_3b/relu_3x3_reduce,inception_3b/3x3,inception_3b/relu_3x3,inception_3b/5x5_reduce,inception_3b/relu_5x5_reduce,inception_3b/5x5,inception_3b/relu_5x5,inception_3b/pool,inception_3b/pool_proj,inception_3b/relu_pool_proj,inception_3b/output,pool3/3x3_s2,inception_4a/1x1,inception_4a/relu_1x1,inception_4a/3x3_reduce,inception_4a/relu_3x3_reduce,inception_4a/3x3,inception_4a/relu_3x3,inception_4a/5x5_reduce,inception_4a/relu_5x5_reduce,inception_4a/5x5,inception_4a/relu_5x5,inception_4a/pool,inception_4a/pool_proj,inception_4a/relu_pool_proj,inception_4a/output,inception_4b/1x1,inception_4b/relu_1x1,inception_4b/3x3_reduce,inception_4b/relu_3x3_reduce,inception_4b/3x3,inception_4b/relu_3x3,inception_4b/5x5_reduce,inception_4b/relu_5x5_reduce,inception_4b/5x5,inception_4b/relu_5x5,inception_4b/pool,inception_4b/pool_proj,inception_4b/relu_pool_proj,inception_4b/output,inception_4c/1x1,inception_4c/relu_1x1,inception_4c/3x3_reduce,inception_4c/relu_3x3_reduce,inception_4c/3x3,inception_4c/relu_3x3,inception_4c/5x5_reduce,inception_4c/relu_5x5_reduce,inception_4c/5x5,inception_4c/relu_5x5,inception_4c/pool,inception_4c/pool_proj,inception_4c/relu_pool_proj,inception_4c/output,inception_4d/1x1,inception_4d/relu_1x1,inception_4d/3x3_reduce,inception_4d/relu_3x3_reduce,inception_4d/3x3,inception_4d/relu_3x3,inception_4d/5x5_reduce,inception_4d/relu_5x5_reduce,inception_4d/5x5,inception_4d/relu_5x5,inception_4d/pool,inception_4d/pool_proj,inception_4d/relu_pool_proj,inception_4d/output,inception_4e/1x1,inception_4e/relu_1x1,inception_4e/3x3_reduce,inception_4e/relu_3x3_reduce,inception_4e/3x3,inception_4e/relu_3x3,inception_4e/5x5_reduce,inception_4e/relu_5x5_reduce,inception_4e/5x5,inception_4e/relu_5x5,inception_4e/pool,inception_4e/pool_proj,inception_4e/relu_pool_proj,inception_4e/output,pool4/3x3_s2,inception_5a/1x1,inception_5a/relu_1x1,inception_5a/3x3_reduce,inception_5a/relu_3x3_reduce,inception_5a/3x3,inception_5a/relu_3x3,inception_5a/5x5_reduce,inception_5a/relu_5x5_reduce,inception_5a/5x5,inception_5a/relu_5x5,inception_5a/pool,inception_5a/pool_proj,inception_5a/relu_pool_proj,inception_5a/output,inception_5b/1x1,inception_5b/relu_1x1,inception_5b/3x3_reduce,inception_5b/relu_3x3_reduce,inception_5b/3x3,inception_5b/relu_3x3,inception_5b/5x5_reduce,inception_5b/relu_5x5_reduce,inception_5b/5x5,inception_5b/relu_5x5,inception_5b/pool,inception_5b/pool_proj,inception_5b/relu_pool_proj,inception_5b/output,pool5/7x7_s1,loss3/classifier} output reformatter 0, Tactic: 0, {conv1/7x7_s2,conv1/relu_7x7,pool1/3x3_s2,pool1/norm1,conv2/3x3_reduce,conv2/relu_3x3_reduce,conv2/3x3,conv2/relu_3x3,conv2/norm2,pool2/3x3_s2,inception_3a/1x1,inception_3a/relu_1x1,inception_3a/3x3_reduce,inception_3a/relu_3x3_reduce,inception_3a/3x3,inception_3a/relu_3x3,inception_3a/5x5_reduce,inception_3a/relu_5x5_reduce,inception_3a/5x5,inception_3a/relu_5x5,inception_3a/pool,inception_3a/pool_proj,inception_3a/relu_pool_proj,inception_3a/output,inception_3b/1x1,inception_3b/relu_1x1,inception_3b/3x3_reduce,inception_3b/relu_3x3_reduce,inception_3b/3x3,inception_3b/relu_3x3,inception_3b/5x5_reduce,inception_3b/relu_5x5_reduce,inception_3b/5x5,inception_3b/relu_5x5,inception_3b/pool,inception_3b/pool_proj,inception_3b/relu_pool_proj,inception_3b/output,pool3/3x3_s2,inception_4a/1x1,inception_4a/relu_1x1,inception_4a/3x3_reduce,inception_4a/relu_3x3_reduce,inception_4a/3x3,inception_4a/relu_3x3,inception_4a/5x5_reduce,inception_4a/relu_5x5_reduce,inception_4a/5x5,inception_4a/relu_5x5,inception_4a/pool,inception_4a/pool_proj,inception_4a/relu_pool_proj,inception_4a/output,inception_4b/1x1,inception_4b/relu_1x1,inception_4b/3x3_reduce,inception_4b/relu_3x3_reduce,inception_4b/3x3,inception_4b/relu_3x3,inception_4b/5x5_reduce,inception_4b/relu_5x5_reduce,inception_4b/5x5,inception_4b/relu_5x5,inception_4b/pool,inception_4b/pool_proj,inception_4b/relu_pool_proj,inception_4b/output,inception_4c/1x1,inception_4c/relu_1x1,inception_4c/3x3_reduce,inception_4c/relu_3x3_reduce,inception_4c/3x3,inception_4c/relu_3x3,inception_4c/5x5_reduce,inception_4c/relu_5x5_reduce,inception_4c/5x5,inception_4c/relu_5x5,inception_4c/pool,inception_4c/pool_proj,inception_4c/relu_pool_proj,inception_4c/output,inception_4d/1x1,inception_4d/relu_1x1,inception_4d/3x3_reduce,inception_4d/relu_3x3_reduce,inception_4d/3x3,inception_4d/relu_3x3,inception_4d/5x5_reduce,inception_4d/relu_5x5_reduce,inception_4d/5x5,inception_4d/relu_5x5,inception_4d/pool,inception_4d/pool_proj,inception_4d/relu_pool_proj,inception_4d/output,inception_4e/1x1,inception_4e/relu_1x1,inception_4e/3x3_reduce,inception_4e/relu_3x3_reduce,inception_4e/3x3,inception_4e/relu_3x3,inception_4e/5x5_reduce,inception_4e/relu_5x5_reduce,inception_4e/5x5,inception_4e/relu_5x5,inception_4e/pool,inception_4e/pool_proj,inception_4e/relu_pool_proj,inception_4e/output,pool4/3x3_s2,inception_5a/1x1,inception_5a/relu_1x1,inception_5a/3x3_reduce,inception_5a/relu_3x3_reduce,inception_5a/3x3,inception_5a/relu_3x3,inception_5a/5x5_reduce,inception_5a/relu_5x5_reduce,inception_5a/5x5,inception_5a/relu_5x5,inception_5a/pool,inception_5a/pool_proj,inception_5a/relu_pool_proj,inception_5a/output,inception_5b/1x1,inception_5b/relu_1x1,inception_5b/3x3_reduce,inception_5b/relu_3x3_reduce,inception_5b/3x3,inception_5b/relu_3x3,inception_5b/5x5_reduce,inception_5b/relu_5x5_reduce,inception_5b/5x5,inception_5b/relu_5x5,inception_5b/pool,inception_5b/pool_proj,inception_5b/relu_pool_proj,inception_5b/output,pool5/7x7_s1,loss3/classifier} output to be reformatted 0[Half(1000,1,1)] -> loss3/classifier[Half(1000,1,1)]
[06/30/2022-06:21:11] [V] [TRT] Layer(FinishNvmRegion): {conv1/7x7_s2,conv1/relu_7x7,pool1/3x3_s2,pool1/norm1,conv2/3x3_reduce,conv2/relu_3x3_reduce,conv2/3x3,conv2/relu_3x3,conv2/norm2,pool2/3x3_s2,inception_3a/1x1,inception_3a/relu_1x1,inception_3a/3x3_reduce,inception_3a/relu_3x3_reduce,inception_3a/3x3,inception_3a/relu_3x3,inception_3a/5x5_reduce,inception_3a/relu_5x5_reduce,inception_3a/5x5,inception_3a/relu_5x5,inception_3a/pool,inception_3a/pool_proj,inception_3a/relu_pool_proj,inception_3a/output,inception_3b/1x1,inception_3b/relu_1x1,inception_3b/3x3_reduce,inception_3b/relu_3x3_reduce,inception_3b/3x3,inception_3b/relu_3x3,inception_3b/5x5_reduce,inception_3b/relu_5x5_reduce,inception_3b/5x5,inception_3b/relu_5x5,inception_3b/pool,inception_3b/pool_proj,inception_3b/relu_pool_proj,inception_3b/output,pool3/3x3_s2,inception_4a/1x1,inception_4a/relu_1x1,inception_4a/3x3_reduce,inception_4a/relu_3x3_reduce,inception_4a/3x3,inception_4a/relu_3x3,inception_4a/5x5_reduce,inception_4a/relu_5x5_reduce,inception_4a/5x5,inception_4a/relu_5x5,inception_4a/pool,inception_4a/pool_proj,inception_4a/relu_pool_proj,inception_4a/output,inception_4b/1x1,inception_4b/relu_1x1,inception_4b/3x3_reduce,inception_4b/relu_3x3_reduce,inception_4b/3x3,inception_4b/relu_3x3,inception_4b/5x5_reduce,inception_4b/relu_5x5_reduce,inception_4b/5x5,inception_4b/relu_5x5,inception_4b/pool,inception_4b/pool_proj,inception_4b/relu_pool_proj,inception_4b/output,inception_4c/1x1,inception_4c/relu_1x1,inception_4c/3x3_reduce,inception_4c/relu_3x3_reduce,inception_4c/3x3,inception_4c/relu_3x3,inception_4c/5x5_reduce,inception_4c/relu_5x5_reduce,inception_4c/5x5,inception_4c/relu_5x5,inception_4c/pool,inception_4c/pool_proj,inception_4c/relu_pool_proj,inception_4c/output,inception_4d/1x1,inception_4d/relu_1x1,inception_4d/3x3_reduce,inception_4d/relu_3x3_reduce,inception_4d/3x3,inception_4d/relu_3x3,inception_4d/5x5_reduce,inception_4d/relu_5x5_reduce,inception_4d/5x5,inception_4d/relu_5x5,inception_4d/pool,inception_4d/pool_proj,inception_4d/relu_pool_proj,inception_4d/output,inception_4e/1x1,inception_4e/relu_1x1,inception_4e/3x3_reduce,inception_4e/relu_3x3_reduce,inception_4e/3x3,inception_4e/relu_3x3,inception_4e/5x5_reduce,inception_4e/relu_5x5_reduce,inception_4e/5x5,inception_4e/relu_5x5,inception_4e/pool,inception_4e/pool_proj,inception_4e/relu_pool_proj,inception_4e/output,pool4/3x3_s2,inception_5a/1x1,inception_5a/relu_1x1,inception_5a/3x3_reduce,inception_5a/relu_3x3_reduce,inception_5a/3x3,inception_5a/relu_3x3,inception_5a/5x5_reduce,inception_5a/relu_5x5_reduce,inception_5a/5x5,inception_5a/relu_5x5,inception_5a/pool,inception_5a/pool_proj,inception_5a/relu_pool_proj,inception_5a/output,inception_5b/1x1,inception_5b/relu_1x1,inception_5b/3x3_reduce,inception_5b/relu_3x3_reduce,inception_5b/3x3,inception_5b/relu_3x3,inception_5b/5x5_reduce,inception_5b/relu_5x5_reduce,inception_5b/5x5,inception_5b/relu_5x5,inception_5b/pool,inception_5b/pool_proj,inception_5b/relu_pool_proj,inception_5b/output,pool5/7x7_s1,loss3/classifier} output to be reformatted 0 finish, Tactic: 0, {conv1/7x7_s2,conv1/relu_7x7,pool1/3x3_s2,pool1/norm1,conv2/3x3_reduce,conv2/relu_3x3_reduce,conv2/3x3,conv2/relu_3x3,conv2/norm2,pool2/3x3_s2,inception_3a/1x1,inception_3a/relu_1x1,inception_3a/3x3_reduce,inception_3a/relu_3x3_reduce,inception_3a/3x3,inception_3a/relu_3x3,inception_3a/5x5_reduce,inception_3a/relu_5x5_reduce,inception_3a/5x5,inception_3a/relu_5x5,inception_3a/pool,inception_3a/pool_proj,inception_3a/relu_pool_proj,inception_3a/output,inception_3b/1x1,inception_3b/relu_1x1,inception_3b/3x3_reduce,inception_3b/relu_3x3_reduce,inception_3b/3x3,inception_3b/relu_3x3,inception_3b/5x5_reduce,inception_3b/relu_5x5_reduce,inception_3b/5x5,inception_3b/relu_5x5,inception_3b/pool,inception_3b/pool_proj,inception_3b/relu_pool_proj,inception_3b/output,pool3/3x3_s2,inception_4a/1x1,inception_4a/relu_1x1,inception_4a/3x3_reduce,inception_4a/relu_3x3_reduce,inception_4a/3x3,inception_4a/relu_3x3,inception_4a/5x5_reduce,inception_4a/relu_5x5_reduce,inception_4a/5x5,inception_4a/relu_5x5,inception_4a/pool,inception_4a/pool_proj,inception_4a/relu_pool_proj,inception_4a/output,inception_4b/1x1,inception_4b/relu_1x1,inception_4b/3x3_reduce,inception_4b/relu_3x3_reduce,inception_4b/3x3,inception_4b/relu_3x3,inception_4b/5x5_reduce,inception_4b/relu_5x5_reduce,inception_4b/5x5,inception_4b/relu_5x5,inception_4b/pool,inception_4b/pool_proj,inception_4b/relu_pool_proj,inception_4b/output,inception_4c/1x1,inception_4c/relu_1x1,inception_4c/3x3_reduce,inception_4c/relu_3x3_reduce,inception_4c/3x3,inception_4c/relu_3x3,inception_4c/5x5_reduce,inception_4c/relu_5x5_reduce,inception_4c/5x5,inception_4c/relu_5x5,inception_4c/pool,inception_4c/pool_proj,inception_4c/relu_pool_proj,inception_4c/output,inception_4d/1x1,inception_4d/relu_1x1,inception_4d/3x3_reduce,inception_4d/relu_3x3_reduce,inception_4d/3x3,inception_4d/relu_3x3,inception_4d/5x5_reduce,inception_4d/relu_5x5_reduce,inception_4d/5x5,inception_4d/relu_5x5,inception_4d/pool,inception_4d/pool_proj,inception_4d/relu_pool_proj,inception_4d/output,inception_4e/1x1,inception_4e/relu_1x1,inception_4e/3x3_reduce,inception_4e/relu_3x3_reduce,inception_4e/3x3,inception_4e/relu_3x3,inception_4e/5x5_reduce,inception_4e/relu_5x5_reduce,inception_4e/5x5,inception_4e/relu_5x5,inception_4e/pool,inception_4e/pool_proj,inception_4e/relu_pool_proj,inception_4e/output,pool4/3x3_s2,inception_5a/1x1,inception_5a/relu_1x1,inception_5a/3x3_reduce,inception_5a/relu_3x3_reduce,inception_5a/3x3,inception_5a/relu_3x3,inception_5a/5x5_reduce,inception_5a/relu_5x5_reduce,inception_5a/5x5,inception_5a/relu_5x5,inception_5a/pool,inception_5a/pool_proj,inception_5a/relu_pool_proj,inception_5a/output,inception_5b/1x1,inception_5b/relu_1x1,inception_5b/3x3_reduce,inception_5b/relu_3x3_reduce,inception_5b/3x3,inception_5b/relu_3x3,inception_5b/5x5_reduce,inception_5b/relu_5x5_reduce,inception_5b/5x5,inception_5b/relu_5x5,inception_5b/pool,inception_5b/pool_proj,inception_5b/relu_pool_proj,inception_5b/output,pool5/7x7_s1,loss3/classifier} output to be reformatted 0[Half(1000,1,1)] -> 
[06/30/2022-06:21:11] [V] [TRT] Layer(SoftMax): prob, Tactic: 18, loss3/classifier[Half(1000,1,1)] -> prob output to be reformatted 0[Half(1000,1,1)]
[06/30/2022-06:21:11] [V] [TRT] Layer(Reformat): prob output reformatter 0, Tactic: 0, prob output to be reformatted 0[Half(1000,1,1)] -> prob[Float(1000,1,1)]
[06/30/2022-06:21:12] [I] Starting inference threads
[06/30/2022-06:21:15] [I] Warmup completed 7 queries over 200 ms
[06/30/2022-06:21:15] [I] Timing trace has 102 queries over 3.0459 s
[06/30/2022-06:21:15] [I] Trace averages of 10 runs:
[06/30/2022-06:21:15] [I] Average on 10 runs - GPU latency: 29.8465 ms - Host latency: 29.9281 ms (end to end 29.9455 ms, enqueue 1.24336 ms)
[06/30/2022-06:21:15] [I] Average on 10 runs - GPU latency: 29.85 ms - Host latency: 29.9311 ms (end to end 29.9477 ms, enqueue 1.23919 ms)
[06/30/2022-06:21:15] [I] Average on 10 runs - GPU latency: 29.8496 ms - Host latency: 29.9308 ms (end to end 29.9464 ms, enqueue 1.22849 ms)
[06/30/2022-06:21:15] [I] Average on 10 runs - GPU latency: 29.7694 ms - Host latency: 29.8378 ms (end to end 29.8505 ms, enqueue 1.1645 ms)
[06/30/2022-06:21:15] [I] Average on 10 runs - GPU latency: 29.7489 ms - Host latency: 29.8114 ms (end to end 29.8239 ms, enqueue 1.17266 ms)
[06/30/2022-06:21:15] [I] Average on 10 runs - GPU latency: 29.7457 ms - Host latency: 29.8085 ms (end to end 29.8212 ms, enqueue 1.13134 ms)
[06/30/2022-06:21:15] [I] Average on 10 runs - GPU latency: 29.7471 ms - Host latency: 29.8098 ms (end to end 29.8222 ms, enqueue 1.16338 ms)
[06/30/2022-06:21:15] [I] Average on 10 runs - GPU latency: 29.7481 ms - Host latency: 29.8107 ms (end to end 29.8209 ms, enqueue 1.14348 ms)
[06/30/2022-06:21:15] [I] Average on 10 runs - GPU latency: 29.7453 ms - Host latency: 29.808 ms (end to end 29.8216 ms, enqueue 1.16912 ms)
[06/30/2022-06:21:15] [I] Average on 10 runs - GPU latency: 29.7487 ms - Host latency: 29.8114 ms (end to end 29.824 ms, enqueue 1.13921 ms)
[06/30/2022-06:21:15] [I] Host Latency
[06/30/2022-06:21:15] [I] min: 29.7964 ms (end to end 29.8047 ms)
[06/30/2022-06:21:15] [I] max: 29.9426 ms (end to end 29.962 ms)
[06/30/2022-06:21:15] [I] mean: 29.848 ms (end to end 29.8616 ms)
[06/30/2022-06:21:15] [I] median: 29.8135 ms (end to end 29.8257 ms)
[06/30/2022-06:21:15] [I] percentile: 29.9404 ms at 99% (end to end 29.9578 ms at 99%)
[06/30/2022-06:21:15] [I] throughput: 33.4876 qps
[06/30/2022-06:21:15] [I] walltime: 3.0459 s
[06/30/2022-06:21:15] [I] Enqueue Time
[06/30/2022-06:21:15] [I] min: 1.00781 ms
[06/30/2022-06:21:15] [I] max: 1.36731 ms
[06/30/2022-06:21:15] [I] median: 1.17651 ms
[06/30/2022-06:21:15] [I] GPU Compute
[06/30/2022-06:21:15] [I] min: 29.7339 ms
[06/30/2022-06:21:15] [I] max: 29.8619 ms
[06/30/2022-06:21:15] [I] mean: 29.7793 ms
[06/30/2022-06:21:15] [I] median: 29.7512 ms
[06/30/2022-06:21:15] [I] percentile: 29.8588 ms at 99%
[06/30/2022-06:21:15] [I] total compute time: 3.03749 s
&&&& PASSED TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --deploy=/usr/src/tensorrt/data/googlenet/googlenet.prototxt --output=prob --verbose --useDLACore=0 --allowGPUFallback