&&&& RUNNING TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=version-RFB-640.onnx --verbose
[08/12/2021-08:40:28] [I] === Model Options ===
[08/12/2021-08:40:28] [I] Format: ONNX
[08/12/2021-08:40:28] [I] Model: version-RFB-640.onnx
[08/12/2021-08:40:28] [I] Output:
[08/12/2021-08:40:28] [I] === Build Options ===
[08/12/2021-08:40:28] [I] Max batch: 1
[08/12/2021-08:40:28] [I] Workspace: 16 MB
[08/12/2021-08:40:28] [I] minTiming: 1
[08/12/2021-08:40:28] [I] avgTiming: 8
[08/12/2021-08:40:28] [I] Precision: FP32
[08/12/2021-08:40:28] [I] Calibration: 
[08/12/2021-08:40:28] [I] Safe mode: Disabled
[08/12/2021-08:40:28] [I] Save engine: 
[08/12/2021-08:40:28] [I] Load engine: 
[08/12/2021-08:40:28] [I] Builder Cache: Enabled
[08/12/2021-08:40:28] [I] NVTX verbosity: 0
[08/12/2021-08:40:28] [I] Inputs format: fp32:CHW
[08/12/2021-08:40:28] [I] Outputs format: fp32:CHW
[08/12/2021-08:40:28] [I] Input build shapes: model
[08/12/2021-08:40:28] [I] Input calibration shapes: model
[08/12/2021-08:40:28] [I] === System Options ===
[08/12/2021-08:40:28] [I] Device: 0
[08/12/2021-08:40:28] [I] DLACore: 
[08/12/2021-08:40:28] [I] Plugins:
[08/12/2021-08:40:28] [I] === Inference Options ===
[08/12/2021-08:40:28] [I] Batch: 1
[08/12/2021-08:40:28] [I] Input inference shapes: model
[08/12/2021-08:40:28] [I] Iterations: 10
[08/12/2021-08:40:28] [I] Duration: 3s (+ 200ms warm up)
[08/12/2021-08:40:28] [I] Sleep time: 0ms
[08/12/2021-08:40:28] [I] Streams: 1
[08/12/2021-08:40:28] [I] ExposeDMA: Disabled
[08/12/2021-08:40:28] [I] Spin-wait: Disabled
[08/12/2021-08:40:28] [I] Multithreading: Disabled
[08/12/2021-08:40:28] [I] CUDA Graph: Disabled
[08/12/2021-08:40:28] [I] Skip inference: Disabled
[08/12/2021-08:40:28] [I] Inputs:
[08/12/2021-08:40:28] [I] === Reporting Options ===
[08/12/2021-08:40:28] [I] Verbose: Enabled
[08/12/2021-08:40:28] [I] Averages: 10 inferences
[08/12/2021-08:40:28] [I] Percentile: 99
[08/12/2021-08:40:28] [I] Dump output: Disabled
[08/12/2021-08:40:28] [I] Profile: Disabled
[08/12/2021-08:40:28] [I] Export timing to JSON file: 
[08/12/2021-08:40:28] [I] Export output to JSON file: 
[08/12/2021-08:40:28] [I] Export profile to JSON file: 
[08/12/2021-08:40:28] [I] 
[08/12/2021-08:40:28] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1
[08/12/2021-08:40:28] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1
[08/12/2021-08:40:28] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1
[08/12/2021-08:40:28] [V] [TRT] Registered plugin creator - ::Region_TRT version 1
[08/12/2021-08:40:28] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1
[08/12/2021-08:40:28] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1
[08/12/2021-08:40:28] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1
[08/12/2021-08:40:28] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1
[08/12/2021-08:40:28] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1
[08/12/2021-08:40:28] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1
[08/12/2021-08:40:28] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1
[08/12/2021-08:40:28] [V] [TRT] Registered plugin creator - ::CropAndResize version 1
[08/12/2021-08:40:28] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1
[08/12/2021-08:40:28] [V] [TRT] Registered plugin creator - ::Proposal version 1
[08/12/2021-08:40:28] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1
[08/12/2021-08:40:28] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1
[08/12/2021-08:40:28] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1
[08/12/2021-08:40:28] [V] [TRT] Registered plugin creator - ::Split version 1
[08/12/2021-08:40:28] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1
[08/12/2021-08:40:28] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1
----------------------------------------------------------------
Input filename:   version-RFB-640.onnx
ONNX IR version:  0.0.0
Opset version:    0
Producer name:    
Producer version: 
Domain:           
Model version:    0
Doc string:       
----------------------------------------------------------------
[08/12/2021-08:40:30] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1
[08/12/2021-08:40:30] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1
[08/12/2021-08:40:30] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1
[08/12/2021-08:40:30] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1
[08/12/2021-08:40:30] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1
[08/12/2021-08:40:30] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1
[08/12/2021-08:40:30] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1
[08/12/2021-08:40:30] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1
[08/12/2021-08:40:30] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1
[08/12/2021-08:40:30] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1
[08/12/2021-08:40:30] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1
[08/12/2021-08:40:30] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1
[08/12/2021-08:40:30] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1
[08/12/2021-08:40:30] [V] [TRT] Plugin creator already registered - ::Proposal version 1
[08/12/2021-08:40:30] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1
[08/12/2021-08:40:30] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1
[08/12/2021-08:40:30] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1
[08/12/2021-08:40:30] [V] [TRT] Plugin creator already registered - ::Split version 1
[08/12/2021-08:40:30] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1
[08/12/2021-08:40:30] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1
 ----- Parsing of ONNX model version-RFB-640.onnx is Done ---- 
[E] [TRT] Network must have at least one output
[E] [TRT] Network validation failed.
[E] Engine creation failed
[E] Engine set up failed