&&&& RUNNING TensorRT.trtexec # ./trtexec --onnx=models/yolov3-tiny-416-bs8.onnx --explicitBatch --int8 --workspace=2048 --avgRuns=100 --duration=180 --loadEngine=models/yolov3-tiny-416_b8_ws2048_gpu.engine
[07/01/2020-10:50:16] [I] === Model Options ===
[07/01/2020-10:50:16] [I] Format: ONNX
[07/01/2020-10:50:16] [I] Model: models/yolov3-tiny-416-bs8.onnx
[07/01/2020-10:50:16] [I] Output:
[07/01/2020-10:50:16] [I] === Build Options ===
[07/01/2020-10:50:16] [I] Max batch: explicit
[07/01/2020-10:50:16] [I] Workspace: 2048 MB
[07/01/2020-10:50:16] [I] minTiming: 1
[07/01/2020-10:50:16] [I] avgTiming: 8
[07/01/2020-10:50:16] [I] Precision: FP32+INT8
[07/01/2020-10:50:16] [I] Calibration: Dynamic
[07/01/2020-10:50:16] [I] Safe mode: Disabled
[07/01/2020-10:50:16] [I] Save engine: 
[07/01/2020-10:50:16] [I] Load engine: models/yolov3-tiny-416_b8_ws2048_gpu.engine
[07/01/2020-10:50:16] [I] Builder Cache: Enabled
[07/01/2020-10:50:16] [I] NVTX verbosity: 0
[07/01/2020-10:50:16] [I] Inputs format: fp32:CHW
[07/01/2020-10:50:16] [I] Outputs format: fp32:CHW
[07/01/2020-10:50:16] [I] Input build shapes: model
[07/01/2020-10:50:16] [I] Input calibration shapes: model
[07/01/2020-10:50:16] [I] === System Options ===
[07/01/2020-10:50:16] [I] Device: 0
[07/01/2020-10:50:16] [I] DLACore: 
[07/01/2020-10:50:16] [I] Plugins:
[07/01/2020-10:50:16] [I] === Inference Options ===
[07/01/2020-10:50:16] [I] Batch: Explicit
[07/01/2020-10:50:16] [I] Input inference shapes: model
[07/01/2020-10:50:16] [I] Iterations: 10
[07/01/2020-10:50:16] [I] Duration: 180s (+ 200ms warm up)
[07/01/2020-10:50:16] [I] Sleep time: 0ms
[07/01/2020-10:50:16] [I] Streams: 1
[07/01/2020-10:50:16] [I] ExposeDMA: Disabled
[07/01/2020-10:50:16] [I] Spin-wait: Disabled
[07/01/2020-10:50:16] [I] Multithreading: Disabled
[07/01/2020-10:50:16] [I] CUDA Graph: Disabled
[07/01/2020-10:50:16] [I] Skip inference: Disabled
[07/01/2020-10:50:16] [I] Inputs:
[07/01/2020-10:50:16] [I] === Reporting Options ===
[07/01/2020-10:50:16] [I] Verbose: Disabled
[07/01/2020-10:50:16] [I] Averages: 100 inferences
[07/01/2020-10:50:16] [I] Percentile: 99
[07/01/2020-10:50:16] [I] Dump output: Disabled
[07/01/2020-10:50:16] [I] Profile: Disabled
[07/01/2020-10:50:16] [I] Export timing to JSON file: 
[07/01/2020-10:50:16] [I] Export output to JSON file: 
[07/01/2020-10:50:16] [I] Export profile to JSON file: 
[07/01/2020-10:50:16] [I] 
[07/01/2020-10:50:16] [E] Error opening engine file: models/yolov3-tiny-416_b8_ws2048_gpu.engine
[07/01/2020-10:50:16] [E] Engine creation failed
[07/01/2020-10:50:16] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec # ./trtexec --onnx=models/yolov3-tiny-416-bs8.onnx --explicitBatch --int8 --workspace=2048 --avgRuns=100 --duration=180 --loadEngine=models/yolov3-tiny-416_b8_ws2048_gpu.engine