TensorRT cannot parse ONNX model

Description

A clear and concise description of the bug or issue.

Environment

TensorRT Version - 7:
GPU Type -> dGPU aws Tesla T4:
Nvidia Driver Version - 440.82:
CUDA Version - 10.2:
CUDNN Version:
Operating System + Version:
Python Version (if applicable):
TensorFlow Version (if applicable):
PyTorch Version (if applicable) -> 1.4.0 and 1.5.0:
Baremetal or Container (if container which image + tag) -> nvcr.io/nvidia/tensorrt:20.03-py3:

Relevant Files

Please attach or include links to any models, data, files, or scripts necessary to reproduce your issue. (Github repo, Google Drive, Dropbox, etc.)

Steps To Reproduce

Please include:

  • Exact steps/commands to build your repro
  • Exact steps/commands to run your repro
  • Full traceback of errors encountered

I was trying to convert yolov5s onnx model to TensorRT which throwed an error I have no idea about.
Script to generate onnx model is given here. I did a minor change to that, converted ‘cpu’ weights to ‘cuda’ weights and then created yolo5s_cuda.onnx:

root@b572b7f4df0e:/home# trtexec --onnx=yolov5s_cuda.onnx --explicitBatch --saveEngine=yolov5.engine --workspace=4096 --fp16&&&& RUNNING TensorRT.trtexec # trtexec --onnx=yolov5s_cuda.onnx --explicitBatch --saveEngine=yolov5.engine --workspace=4096 --fp16
[06/17/2020-14:45:24] [I] === Model Options ===
[06/17/2020-14:45:24] [I] Format: ONNX
[06/17/2020-14:45:24] [I] Model: yolov5s_cuda.onnx
[06/17/2020-14:45:24] [I] Output:
[06/17/2020-14:45:24] [I] === Build Options ===
[06/17/2020-14:45:24] [I] Max batch: explicit
[06/17/2020-14:45:24] [I] Workspace: 4096 MB
[06/17/2020-14:45:24] [I] minTiming: 1
[06/17/2020-14:45:24] [I] avgTiming: 8
[06/17/2020-14:45:24] [I] Precision: FP16
[06/17/2020-14:45:24] [I] Calibration: 
[06/17/2020-14:45:24] [I] Safe mode: Disabled
[06/17/2020-14:45:24] [I] Save engine: yolov5.engine
[06/17/2020-14:45:24] [I] Load engine: 
[06/17/2020-14:45:24] [I] Inputs format: fp32:CHW
[06/17/2020-14:45:24] [I] Outputs format: fp32:CHW
[06/17/2020-14:45:24] [I] Input build shapes: model
[06/17/2020-14:45:24] [I] === System Options ===
[06/17/2020-14:45:24] [I] Device: 0
[06/17/2020-14:45:24] [I] DLACore: 
[06/17/2020-14:45:24] [I] Plugins:
[06/17/2020-14:45:24] [I] === Inference Options ===
[06/17/2020-14:45:24] [I] Batch: Explicit
[06/17/2020-14:45:24] [I] Iterations: 10
[06/17/2020-14:45:24] [I] Duration: 3s (+ 200ms warm up)
[06/17/2020-14:45:24] [I] Sleep time: 0ms
[06/17/2020-14:45:24] [I] Streams: 1
[06/17/2020-14:45:24] [I] ExposeDMA: Disabled
[06/17/2020-14:45:24] [I] Spin-wait: Disabled
[06/17/2020-14:45:24] [I] Multithreading: Disabled
[06/17/2020-14:45:24] [I] CUDA Graph: Disabled
[06/17/2020-14:45:24] [I] Skip inference: Disabled
[06/17/2020-14:45:24] [I] Inputs:
[06/17/2020-14:45:24] [I] === Reporting Options ===
[06/17/2020-14:45:24] [I] Verbose: Disabled
[06/17/2020-14:45:24] [I] Averages: 10 inferences
[06/17/2020-14:45:24] [I] Percentile: 99
[06/17/2020-14:45:24] [I] Dump output: Disabled
[06/17/2020-14:45:24] [I] Profile: Disabled
[06/17/2020-14:45:24] [I] Export timing to JSON file: 
[06/17/2020-14:45:24] [I] Export output to JSON file: 
[06/17/2020-14:45:24] [I] Export profile to JSON file: 
[06/17/2020-14:45:24] [I] 
----------------------------------------------------------------
Input filename:   yolov5s_cuda.onnx
ONNX IR version:  0.0.4
Opset version:    11
Producer name:    pytorch
Producer version: 1.3
Domain:           
Model version:    0
Doc string:       
----------------------------------------------------------------
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:222: One or more weights outside the range of INT32 was clamped
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:222: One or more weights outside the range of INT32 was clamped
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:222: One or more weights outside the range of INT32 was clamped
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:222: One or more weights outside the range of INT32 was clamped
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:222: One or more weights outside the range of INT32 was clamped
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:222: One or more weights outside the range of INT32 was clamped
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:222: One or more weights outside the range of INT32 was clamped
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:222: One or more weights outside the range of INT32 was clamped
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/17/2020-14:45:25] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
While parsing node number 172 [Resize]:
ERROR: ModelImporter.cpp:124 In function parseGraph:
[5] Assertion failed: ctx->tensors().count(inputName)
[06/17/2020-14:45:25] [E] Failed to parse onnx file
[06/17/2020-14:45:25] [E] Parsing model failed
[06/17/2020-14:45:25] [E] Engine creation failed
[06/17/2020-14:45:25] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec # trtexec --onnx=yolov5s_cuda.onnx --explicitBatch --saveEngine=yolov5.engine --workspace=4096 --fp16

Hello,
Request you to share the onnx model, so that we can assist you quicker.
Also if possible, please share the trtexec output in --verbose mode.
Thanks!

onnx model is uploaded here

@AakankshaS I can only see this much of the output in verbose mode:

[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 203
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Add] inputs: [199 -> (1, 64, 80, 80)], [203 -> (1, 64, 80, 80)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 31) [ElementWise] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 204 for ONNX tensor: 204
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Add] outputs: [204 -> (1, 64, 80, 80)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 204
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.4.m.2.cv1.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.4.m.2.cv1.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [204 -> (1, 64, 80, 80)], [model.4.m.2.cv1.conv.weight -> (64, 64, 1, 1)], [model.4.m.2.cv1.conv.bias -> (64)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 64, 80, 80)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 64
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 64, 80, 80)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 32) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 205 for ONNX tensor: 205
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [205 -> (1, 64, 80, 80)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 205
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [205 -> (1, 64, 80, 80)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 33) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 206 for ONNX tensor: 206
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [206 -> (1, 64, 80, 80)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 206
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.4.m.2.cv2.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.4.m.2.cv2.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [206 -> (1, 64, 80, 80)], [model.4.m.2.cv2.conv.weight -> (64, 64, 3, 3)], [model.4.m.2.cv2.conv.bias -> (64)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 64, 80, 80)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 64
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 64, 80, 80)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 34) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 207 for ONNX tensor: 207
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [207 -> (1, 64, 80, 80)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 207
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [207 -> (1, 64, 80, 80)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 35) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 208 for ONNX tensor: 208
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [208 -> (1, 64, 80, 80)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Add]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 204
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 208
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Add] inputs: [204 -> (1, 64, 80, 80)], [208 -> (1, 64, 80, 80)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 36) [ElementWise] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 209 for ONNX tensor: 209
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Add] outputs: [209 -> (1, 64, 80, 80)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 209
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.4.cv3.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [209 -> (1, 64, 80, 80)], [model.4.cv3.weight -> (64, 64, 1, 1)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 64, 80, 80)
[06/18/2020-04:16:54] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 64
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 64, 80, 80)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 37) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 210 for ONNX tensor: 210
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [210 -> (1, 64, 80, 80)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 192
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.4.cv2.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [192 -> (1, 128, 80, 80)], [model.4.cv2.weight -> (64, 128, 1, 1)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 128, 80, 80)
[06/18/2020-04:16:54] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 64
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 64, 80, 80)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 38) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 211 for ONNX tensor: 211
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [211 -> (1, 64, 80, 80)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Concat]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 210
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 211
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Concat] inputs: [210 -> (1, 64, 80, 80)], [211 -> (1, 64, 80, 80)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 39) [Concatenation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 212 for ONNX tensor: 212
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Concat] outputs: [212 -> (1, 128, 80, 80)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [BatchNormalization]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 212
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.4.bn.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.4.bn.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.4.bn.running_mean
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.4.bn.running_var
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [BatchNormalization] inputs: [212 -> (1, 128, 80, 80)], [model.4.bn.weight -> (128)], [model.4.bn.bias -> (128)], [model.4.bn.running_mean -> (128)], [model.4.bn.running_var -> (128)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 40) [Scale] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 213 for ONNX tensor: 213
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [BatchNormalization] outputs: [213 -> (1, 128, 80, 80)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 213
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [213 -> (1, 128, 80, 80)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 41) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 214 for ONNX tensor: 214
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [214 -> (1, 128, 80, 80)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 214
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.4.cv4.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.4.cv4.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [214 -> (1, 128, 80, 80)], [model.4.cv4.conv.weight -> (128, 128, 1, 1)], [model.4.cv4.conv.bias -> (128)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 128, 80, 80)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 128
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 128, 80, 80)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 42) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 215 for ONNX tensor: 215
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [215 -> (1, 128, 80, 80)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 215
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [215 -> (1, 128, 80, 80)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 43) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 216 for ONNX tensor: 216
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [216 -> (1, 128, 80, 80)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 216
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.5.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.5.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [216 -> (1, 128, 80, 80)], [model.5.conv.weight -> (256, 128, 3, 3)], [model.5.conv.bias -> (256)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 128, 80, 80)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (3, 3), strides: (2, 2), padding: (1, 1), dilations: (1, 1), numOutputs: 256
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 44) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 217 for ONNX tensor: 217
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [217 -> (1, 256, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 217
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [217 -> (1, 256, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 45) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 218 for ONNX tensor: 218
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [218 -> (1, 256, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 218
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.cv1.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.cv1.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [218 -> (1, 256, 40, 40)], [model.6.cv1.conv.weight -> (128, 256, 1, 1)], [model.6.cv1.conv.bias -> (128)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 256, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 128
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 128, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 46) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 219 for ONNX tensor: 219
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [219 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 219
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [219 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 47) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 220 for ONNX tensor: 220
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [220 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 220
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.m.0.cv1.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.m.0.cv1.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [220 -> (1, 128, 40, 40)], [model.6.m.0.cv1.conv.weight -> (128, 128, 1, 1)], [model.6.m.0.cv1.conv.bias -> (128)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 128, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 128
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 128, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 48) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 221 for ONNX tensor: 221
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [221 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 221
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [221 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 49) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 222 for ONNX tensor: 222
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [222 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 222
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.m.0.cv2.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.m.0.cv2.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [222 -> (1, 128, 40, 40)], [model.6.m.0.cv2.conv.weight -> (128, 128, 3, 3)], [model.6.m.0.cv2.conv.bias -> (128)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 128, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 128
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 128, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 50) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 223 for ONNX tensor: 223
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [223 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 223
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [223 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 51) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 224 for ONNX tensor: 224
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [224 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Add]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 220
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 224
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Add] inputs: [220 -> (1, 128, 40, 40)], [224 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 52) [ElementWise] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 225 for ONNX tensor: 225
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Add] outputs: [225 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 225
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.m.1.cv1.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.m.1.cv1.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [225 -> (1, 128, 40, 40)], [model.6.m.1.cv1.conv.weight -> (128, 128, 1, 1)], [model.6.m.1.cv1.conv.bias -> (128)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 128, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 128
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 128, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 53) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 226 for ONNX tensor: 226
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [226 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 226
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [226 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 54) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 227 for ONNX tensor: 227
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [227 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 227
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.m.1.cv2.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.m.1.cv2.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [227 -> (1, 128, 40, 40)], [model.6.m.1.cv2.conv.weight -> (128, 128, 3, 3)], [model.6.m.1.cv2.conv.bias -> (128)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 128, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 128
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 128, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 55) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 228 for ONNX tensor: 228
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [228 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 228
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [228 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 56) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 229 for ONNX tensor: 229
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [229 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Add]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 225
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 229
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Add] inputs: [225 -> (1, 128, 40, 40)], [229 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 57) [ElementWise] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 230 for ONNX tensor: 230
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Add] outputs: [230 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 230
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.m.2.cv1.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.m.2.cv1.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [230 -> (1, 128, 40, 40)], [model.6.m.2.cv1.conv.weight -> (128, 128, 1, 1)], [model.6.m.2.cv1.conv.bias -> (128)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 128, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 128
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 128, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 58) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 231 for ONNX tensor: 231
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [231 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 231
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [231 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 59) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 232 for ONNX tensor: 232
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [232 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 232
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.m.2.cv2.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.m.2.cv2.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [232 -> (1, 128, 40, 40)], [model.6.m.2.cv2.conv.weight -> (128, 128, 3, 3)], [model.6.m.2.cv2.conv.bias -> (128)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 128, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 128
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 128, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 60) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 233 for ONNX tensor: 233
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [233 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 233
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [233 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 61) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 234 for ONNX tensor: 234
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [234 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Add]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 230
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 234
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Add] inputs: [230 -> (1, 128, 40, 40)], [234 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 62) [ElementWise] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 235 for ONNX tensor: 235
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Add] outputs: [235 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 235
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.cv3.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [235 -> (1, 128, 40, 40)], [model.6.cv3.weight -> (128, 128, 1, 1)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 128, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 128
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 128, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 63) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 236 for ONNX tensor: 236
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [236 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 218
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.cv2.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [218 -> (1, 256, 40, 40)], [model.6.cv2.weight -> (128, 256, 1, 1)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 256, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 128
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 128, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 64) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 237 for ONNX tensor: 237
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [237 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Concat]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 236
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 237
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Concat] inputs: [236 -> (1, 128, 40, 40)], [237 -> (1, 128, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 65) [Concatenation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 238 for ONNX tensor: 238
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Concat] outputs: [238 -> (1, 256, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [BatchNormalization]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 238
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.bn.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.bn.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.bn.running_mean
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.bn.running_var
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [BatchNormalization] inputs: [238 -> (1, 256, 40, 40)], [model.6.bn.weight -> (256)], [model.6.bn.bias -> (256)], [model.6.bn.running_mean -> (256)], [model.6.bn.running_var -> (256)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 66) [Scale] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 239 for ONNX tensor: 239
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [BatchNormalization] outputs: [239 -> (1, 256, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 239
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [239 -> (1, 256, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 67) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 240 for ONNX tensor: 240
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [240 -> (1, 256, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 240
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.cv4.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.6.cv4.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [240 -> (1, 256, 40, 40)], [model.6.cv4.conv.weight -> (256, 256, 1, 1)], [model.6.cv4.conv.bias -> (256)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 256, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 256
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 68) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 241 for ONNX tensor: 241
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [241 -> (1, 256, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 241
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [241 -> (1, 256, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 69) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 242 for ONNX tensor: 242
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [242 -> (1, 256, 40, 40)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 242
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.7.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.7.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [242 -> (1, 256, 40, 40)], [model.7.conv.weight -> (512, 256, 3, 3)], [model.7.conv.bias -> (512)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 256, 40, 40)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (3, 3), strides: (2, 2), padding: (1, 1), dilations: (1, 1), numOutputs: 512
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 512, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 70) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 243 for ONNX tensor: 243
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [243 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 243
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [243 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 71) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 244 for ONNX tensor: 244
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [244 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 244
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.8.cv1.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.8.cv1.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [244 -> (1, 512, 20, 20)], [model.8.cv1.conv.weight -> (256, 512, 1, 1)], [model.8.cv1.conv.bias -> (256)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 512, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 256
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 72) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 245 for ONNX tensor: 245
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [245 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 245
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [245 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 73) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 246 for ONNX tensor: 246
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [246 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [MaxPool]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 246
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [MaxPool] inputs: [246 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 74) [Pooling] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 247 for ONNX tensor: 247
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [MaxPool] outputs: [247 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [MaxPool]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 246
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [MaxPool] inputs: [246 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 75) [Pooling] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 248 for ONNX tensor: 248
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [MaxPool] outputs: [248 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [MaxPool]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 246
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [MaxPool] inputs: [246 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 76) [Pooling] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 249 for ONNX tensor: 249
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [MaxPool] outputs: [249 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Concat]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 246
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 247
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 248
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 249
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Concat] inputs: [246 -> (1, 256, 20, 20)], [247 -> (1, 256, 20, 20)], [248 -> (1, 256, 20, 20)], [249 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 77) [Concatenation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 250 for ONNX tensor: 250
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Concat] outputs: [250 -> (1, 1024, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 250
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.8.cv2.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.8.cv2.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [250 -> (1, 1024, 20, 20)], [model.8.cv2.conv.weight -> (512, 1024, 1, 1)], [model.8.cv2.conv.bias -> (512)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 1024, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 512
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 512, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 78) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 251 for ONNX tensor: 251
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [251 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 251
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [251 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 79) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 252 for ONNX tensor: 252
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [252 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 252
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.9.cv1.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.9.cv1.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [252 -> (1, 512, 20, 20)], [model.9.cv1.conv.weight -> (256, 512, 1, 1)], [model.9.cv1.conv.bias -> (256)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 512, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 256
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 80) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 253 for ONNX tensor: 253
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [253 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 253
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [253 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 81) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 254 for ONNX tensor: 254
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [254 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 254
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.9.m.0.cv1.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.9.m.0.cv1.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [254 -> (1, 256, 20, 20)], [model.9.m.0.cv1.conv.weight -> (256, 256, 1, 1)], [model.9.m.0.cv1.conv.bias -> (256)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 256, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 256
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 82) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 255 for ONNX tensor: 255
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [255 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 255
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [255 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 83) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 256 for ONNX tensor: 256
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [256 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 256
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.9.m.0.cv2.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.9.m.0.cv2.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [256 -> (1, 256, 20, 20)], [model.9.m.0.cv2.conv.weight -> (256, 256, 3, 3)], [model.9.m.0.cv2.conv.bias -> (256)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 256, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 256
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 84) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 257 for ONNX tensor: 257
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [257 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 257
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [257 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 85) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 258 for ONNX tensor: 258
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [258 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Add]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 254
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 258
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Add] inputs: [254 -> (1, 256, 20, 20)], [258 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 86) [ElementWise] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 259 for ONNX tensor: 259
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Add] outputs: [259 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 259
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.9.m.1.cv1.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.9.m.1.cv1.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [259 -> (1, 256, 20, 20)], [model.9.m.1.cv1.conv.weight -> (256, 256, 1, 1)], [model.9.m.1.cv1.conv.bias -> (256)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 256, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 256
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 87) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 260 for ONNX tensor: 260
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [260 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 260
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [260 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 88) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 261 for ONNX tensor: 261
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [261 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 261
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.9.m.1.cv2.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.9.m.1.cv2.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [261 -> (1, 256, 20, 20)], [model.9.m.1.cv2.conv.weight -> (256, 256, 3, 3)], [model.9.m.1.cv2.conv.bias -> (256)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 256, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 256
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 89) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 262 for ONNX tensor: 262
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [262 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 262
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [262 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 90) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 263 for ONNX tensor: 263
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [263 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Add]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 259
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 263
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Add] inputs: [259 -> (1, 256, 20, 20)], [263 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 91) [ElementWise] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 264 for ONNX tensor: 264
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Add] outputs: [264 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 264
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.9.cv3.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [264 -> (1, 256, 20, 20)], [model.9.cv3.weight -> (256, 256, 1, 1)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 256, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 256
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 92) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 265 for ONNX tensor: 265
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [265 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 252
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.9.cv2.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [252 -> (1, 512, 20, 20)], [model.9.cv2.weight -> (256, 512, 1, 1)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 512, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 256
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 93) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 266 for ONNX tensor: 266
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [266 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Concat]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 265
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 266
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Concat] inputs: [265 -> (1, 256, 20, 20)], [266 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 94) [Concatenation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 267 for ONNX tensor: 267
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Concat] outputs: [267 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [BatchNormalization]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 267
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.9.bn.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.9.bn.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.9.bn.running_mean
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.9.bn.running_var
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [BatchNormalization] inputs: [267 -> (1, 512, 20, 20)], [model.9.bn.weight -> (512)], [model.9.bn.bias -> (512)], [model.9.bn.running_mean -> (512)], [model.9.bn.running_var -> (512)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 95) [Scale] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 268 for ONNX tensor: 268
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [BatchNormalization] outputs: [268 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 268
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [268 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 96) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 269 for ONNX tensor: 269
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [269 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 269
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.9.cv4.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.9.cv4.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [269 -> (1, 512, 20, 20)], [model.9.cv4.conv.weight -> (512, 512, 1, 1)], [model.9.cv4.conv.bias -> (512)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 512, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 512
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 512, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 97) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 270 for ONNX tensor: 270
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [270 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 270
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [270 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 98) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 271 for ONNX tensor: 271
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [271 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 271
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.10.cv1.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.10.cv1.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [271 -> (1, 512, 20, 20)], [model.10.cv1.conv.weight -> (256, 512, 1, 1)], [model.10.cv1.conv.bias -> (256)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 512, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 256
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 99) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 272 for ONNX tensor: 272
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [272 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 272
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [272 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 100) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 273 for ONNX tensor: 273
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [273 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 273
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.10.m.0.cv1.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.10.m.0.cv1.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [273 -> (1, 256, 20, 20)], [model.10.m.0.cv1.conv.weight -> (256, 256, 1, 1)], [model.10.m.0.cv1.conv.bias -> (256)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 256, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 256
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 101) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 274 for ONNX tensor: 274
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [274 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 274
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [274 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 102) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 275 for ONNX tensor: 275
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [275 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 275
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.10.m.0.cv2.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.10.m.0.cv2.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [275 -> (1, 256, 20, 20)], [model.10.m.0.cv2.conv.weight -> (256, 256, 3, 3)], [model.10.m.0.cv2.conv.bias -> (256)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 256, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 256
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 103) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 276 for ONNX tensor: 276
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [276 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 276
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [276 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 104) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 277 for ONNX tensor: 277
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [277 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 277
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.10.cv3.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [277 -> (1, 256, 20, 20)], [model.10.cv3.weight -> (256, 256, 1, 1)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 256, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 256
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 105) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 278 for ONNX tensor: 278
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [278 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 271
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.10.cv2.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [271 -> (1, 512, 20, 20)], [model.10.cv2.weight -> (256, 512, 1, 1)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 512, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 256
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 106) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 279 for ONNX tensor: 279
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [279 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Concat]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 278
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 279
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Concat] inputs: [278 -> (1, 256, 20, 20)], [279 -> (1, 256, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 107) [Concatenation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 280 for ONNX tensor: 280
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Concat] outputs: [280 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [BatchNormalization]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 280
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.10.bn.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.10.bn.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.10.bn.running_mean
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.10.bn.running_var
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [BatchNormalization] inputs: [280 -> (1, 512, 20, 20)], [model.10.bn.weight -> (512)], [model.10.bn.bias -> (512)], [model.10.bn.running_mean -> (512)], [model.10.bn.running_var -> (512)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 108) [Scale] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 281 for ONNX tensor: 281
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [BatchNormalization] outputs: [281 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 281
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [281 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 109) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 282 for ONNX tensor: 282
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [282 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 282
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.10.cv4.conv.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.10.cv4.conv.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [282 -> (1, 512, 20, 20)], [model.10.cv4.conv.weight -> (512, 512, 1, 1)], [model.10.cv4.conv.bias -> (512)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 512, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 512
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 512, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 110) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 283 for ONNX tensor: 283
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [283 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [LeakyRelu]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 283
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [LeakyRelu] inputs: [283 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 111) [Activation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 284 for ONNX tensor: 284
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [LeakyRelu] outputs: [284 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Conv]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 284
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.11.weight
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: model.11.bias
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Conv] inputs: [284 -> (1, 512, 20, 20)], [model.11.weight -> (255, 512, 1, 1)], [model.11.bias -> (255)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 512, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 255
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 255, 20, 20)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 112) [Convolution] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 285 for ONNX tensor: 285
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Conv] outputs: [285 -> (1, 255, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Shape]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 284
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Shape] inputs: [284 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 113) [Shape] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 286 for ONNX tensor: 286
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Shape] outputs: [286 -> (4)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Constant]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Constant] inputs: 
[06/18/2020-04:16:54] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Constant] outputs: [287 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Gather]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 286
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 287
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Gather] inputs: [286 -> (4)], [287 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:942: Using Gather axis: 0
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 114) [Constant] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 288 for ONNX tensor: 288
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Gather] outputs: [288 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Cast]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 288
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Cast] inputs: [288 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:315: Casting to type: float32
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 116) [Identity] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 289 for ONNX tensor: 289
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Cast] outputs: [289 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Constant]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Constant] inputs: 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Constant] outputs: [290 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Mul]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 289
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 290
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Mul] inputs: [289 -> ()], [290 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 117) [Constant] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 291 for ONNX tensor: 291
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Mul] outputs: [291 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Cast]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 291
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Cast] inputs: [291 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:315: Casting to type: float32
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 119) [Identity] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 292 for ONNX tensor: 292
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Cast] outputs: [292 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Floor]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 292
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Floor] inputs: [292 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] onnx2trt_utils.cpp:1411: Original shape: (), unsqueezing to: (1)
[06/18/2020-04:16:54] [V] [TRT] onnx2trt_utils.cpp:1272: Original shape: (1), squeezing to: ()
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 120) [Shuffle] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 293 for ONNX tensor: 293
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Floor] outputs: [293 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Shape]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 284
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Shape] inputs: [284 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 123) [Shape] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 294 for ONNX tensor: 294
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Shape] outputs: [294 -> (4)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Constant]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Constant] inputs: 
[06/18/2020-04:16:54] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Constant] outputs: [295 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Gather]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 294
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 295
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Gather] inputs: [294 -> (4)], [295 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:942: Using Gather axis: 0
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 124) [Constant] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 296 for ONNX tensor: 296
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Gather] outputs: [296 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Cast]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 296
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Cast] inputs: [296 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:315: Casting to type: float32
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 126) [Identity] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 297 for ONNX tensor: 297
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Cast] outputs: [297 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Constant]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Constant] inputs: 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Constant] outputs: [298 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Mul]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 297
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 298
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Mul] inputs: [297 -> ()], [298 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 127) [Constant] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 299 for ONNX tensor: 299
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Mul] outputs: [299 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Cast]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 299
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Cast] inputs: [299 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:315: Casting to type: float32
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 129) [Identity] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 300 for ONNX tensor: 300
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Cast] outputs: [300 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Floor]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 300
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Floor] inputs: [300 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] onnx2trt_utils.cpp:1411: Original shape: (), unsqueezing to: (1)
[06/18/2020-04:16:54] [V] [TRT] onnx2trt_utils.cpp:1272: Original shape: (1), squeezing to: ()
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 130) [Shuffle] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 301 for ONNX tensor: 301
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Floor] outputs: [301 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Unsqueeze]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 293
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Unsqueeze] inputs: [293 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] onnx2trt_utils.cpp:1411: Original shape: (), unsqueezing to: (1)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 133) [Shuffle] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 302 for ONNX tensor: 302
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Unsqueeze] outputs: [302 -> (1)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Unsqueeze]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 301
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Unsqueeze] inputs: [301 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] onnx2trt_utils.cpp:1411: Original shape: (), unsqueezing to: (1)
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 134) [Shuffle] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 303 for ONNX tensor: 303
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Unsqueeze] outputs: [303 -> (1)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Concat]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 302
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 303
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Concat] inputs: [302 -> (1)], [303 -> (1)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 135) [Concatenation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 304 for ONNX tensor: 304
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Concat] outputs: [304 -> (2)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Constant]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Constant] inputs: 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Constant] outputs: [305 -> ()], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Shape]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 284
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Shape] inputs: [284 -> (1, 512, 20, 20)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 136) [Shape] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 306 for ONNX tensor: 306
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Shape] outputs: [306 -> (4)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Constant]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Constant] inputs: 
[06/18/2020-04:16:54] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Constant] outputs: [307 -> (1)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Constant]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Constant] inputs: 
[06/18/2020-04:16:54] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Constant] outputs: [308 -> (1)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Constant]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Constant] inputs: 
[06/18/2020-04:16:54] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Constant] outputs: [309 -> (1)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Slice]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 306
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 308
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 309
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 307
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Slice] inputs: [306 -> (4)], [308 -> (1)], [309 -> (1)], [307 -> (1)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 137) [Slice] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 310 for ONNX tensor: 310
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Slice] outputs: [310 -> (2)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Cast]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 304
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Cast] inputs: [304 -> (2)], 
[06/18/2020-04:16:54] [V] [TRT] builtin_op_importers.cpp:315: Casting to type: int32
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 138) [Identity] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 311 for ONNX tensor: 311
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Cast] outputs: [311 -> (2)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Concat]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 310
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 311
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:129:  [Concat] inputs: [310 -> (2)], [311 -> (2)], 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:122: Registering layer: (Unnamed Layer* 139) [Concatenation] for ONNX node: 
[06/18/2020-04:16:54] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 312 for ONNX tensor: 312
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:180:  [Concat] outputs: [312 -> (4)], 
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:107: Parsing node:  [Resize]
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 284
[06/18/2020-04:16:54] [V] [TRT] ModelImporter.cpp:123: Searching for input: 305
While parsing node number 172 [Resize -> "313"]:
--- Begin node ---
input: "284"
input: "305"
input: "305"
input: "312"
output: "313"
op_type: "Resize"
attribute {
  name: "coordinate_transformation_mode"
  s: "asymmetric"
  type: STRING
}
attribute {
  name: "cubic_coeff_a"
  f: -0.75
  type: FLOAT
}
attribute {
  name: "mode"
  s: "nearest"
  type: STRING
}
attribute {
  name: "nearest_mode"
  s: "floor"
  type: STRING
}

--- End node ---
ERROR: ModelImporter.cpp:124 In function parseGraph:
[5] Assertion failed: ctx->tensors().count(inputName)
[06/18/2020-04:16:54] [E] Failed to parse onnx file
[06/18/2020-04:16:54] [E] Parsing model failed
[06/18/2020-04:16:54] [E] Engine creation failed
[06/18/2020-04:16:54] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec # trtexec --onnx=yolov5s_cuda.onnx --explicitBatch --saveEngine=yolov5s_fp16.engine --workspace=4096 --verbose --fp16

Hi @y14uc339,
The issue has been fixed in next release.
Please stay tuned for next TRT release.

Thanks

@AakankshaS Thanks, any idea when that is going to come ?

1 Like

Request you to wait for the announcements.
Also while working with next release, you will have to simplify your model by using onnx-simplifier.
Check the link below for reference.


Thanks!