[TensorRT] ERROR: Network must have at least one output [TensorRT] ERROR: Network validation failed

darshancganji12 · October 5, 2020, 7:33pm

Hi,
I am converting my Custom model from ONNX to TRT.

I am using the below code to convert from ONNX to TRT:

`import tensorrt as trt
TRT_LOGGER = trt.Logger(trt.Logger.WARNING)
trt_runtime = trt.Runtime(TRT_LOGGER)
def build_engine(onnx_path, shape = [1,1,224,224]):
with trt.Builder(TRT_LOGGER) as builder, builder.create_network(1) as network, trt.OnnxParser(network, TRT_LOGGER) as parser:
builder.max_workspace_size = (256 << 20)
with open(onnx_path, ‘rb’) as model:
parser.parse(model.read())
network.get_input(0).shape = shape
engine = builder.build_cuda_engine(network)
return engine
def save_engine(engine, file_name):
buf = engine.serialize()def load_engine(trt_runtime, plan_path):
with open(engine_path, ‘rb’) as f:
engine_data = f.read()
def load_engine(trt_runtime, plan_path):
with open(engine_path, ‘rb’) as f:
engine_data = f.read()
engine = trt_runtime.deserialize_cuda_engine(engine_data)
return engine
from onnx import ModelProto

engine_name = “xyz.plan”
onnx_path = “xyz.onnx”

model = ModelProto()
with open(onnx_path, “rb”) as f:
model.ParseFromString(f.read())

batch_size = 1

d0 = model.graph.input[0].type.tensor_type.shape.dim[1].dim_value
d1 = model.graph.input[0].type.tensor_type.shape.dim[2].dim_value
d2 = model.graph.input[0].type.tensor_type.shape.dim[3].dim_value
shape = [batch_size , d0, d1 ,d2]

engine = build_engine(onnx_path)
save_engine(engine, engine_name) `

The error I am facing is:
[TensorRT] ERROR: Network must have at least one output [TensorRT] ERROR: Network validation failed

TensorRT Version : 7.0.0-1.
Cuda Version : 10.2

May I know how to get rid of this Issue? would be a great help!

Thanks

AakankshaS · October 6, 2020, 3:07am

Hi @darshancganji12,
Request you to share your onnx model so that we can help you better.

Thanks!

darshancganji12 · October 6, 2020, 3:33am

Hi @AakankshaS,

Thanks for your Reply.
Here is the ONNX model: Face_Detection(3).onnx - Google Drive

And here is the Log I get while I run ONNX to TRT script:
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] WARNING: onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] ERROR: Network must have at least one output
[TensorRT] ERROR: Network validation failed.

Looking forward to the Reply.

Thanks!

AakankshaS · October 6, 2020, 6:14am

Hi @darshancganji12,
Are you using custom plugins?
This error “ERROR: Network must have at least one output”, usually means that the TensorRT ONNX parser failed to parse your model.

Can you try parsing your model with trtexec --onnx=facedetection.onnx --verbose --explicitBatch --shapes=input.1:1x3x112x112

Thanks!

darshancganji12 · October 6, 2020, 7:05am

Hi @AakankshaS,

I have tried parsing the model the command you specified: trtexec --onnx=facedetection.onnx --verbose --explicitBatch --shapes=input.1:1x3x112x112.

The Log has been attached below:

   &&&& RUNNING TensorRT.trtexec # trtexec --onnx=facedetection.onnx --verbose --explicitBatch --shapes=input.1:1x3x112x112
    [10/06/2020-06:46:29] [I] === Model Options ===
    [10/06/2020-06:46:29] [I] Format: ONNX
    [10/06/2020-06:46:29] [I] Model: facedetection.onnx
    [10/06/2020-06:46:29] [I] Output:
    [10/06/2020-06:46:29] [I] === Build Options ===
    [10/06/2020-06:46:29] [I] Max batch: explicit
    [10/06/2020-06:46:29] [I] Workspace: 16 MB
    [10/06/2020-06:46:29] [I] minTiming: 1
    [10/06/2020-06:46:29] [I] avgTiming: 8
    [10/06/2020-06:46:29] [I] Precision: FP32
    [10/06/2020-06:46:29] [I] Calibration:
    [10/06/2020-06:46:29] [I] Safe mode: Disabled
    [10/06/2020-06:46:29] [I] Save engine:
    [10/06/2020-06:46:29] [I] Load engine:
    [10/06/2020-06:46:29] [I] Inputs format: fp32:CHW
    [10/06/2020-06:46:29] [I] Outputs format: fp32:CHW
    [10/06/2020-06:46:29] [I] Input build shape: input.1=1x3x112x112+1x3x112x112+1x3x112x112
    [10/06/2020-06:46:29] [I] === System Options ===
    [10/06/2020-06:46:29] [I] Device: 0
    [10/06/2020-06:46:29] [I] DLACore:
    [10/06/2020-06:46:29] [I] Plugins:
    [10/06/2020-06:46:29] [I] === Inference Options ===
    [10/06/2020-06:46:29] [I] Batch: Explicit
    [10/06/2020-06:46:29] [I] Iterations: 10
    [10/06/2020-06:46:29] [I] Duration: 3s (+ 200ms warm up)
    [10/06/2020-06:46:29] [I] Sleep time: 0ms
    [10/06/2020-06:46:29] [I] Streams: 1
    [10/06/2020-06:46:29] [I] ExposeDMA: Disabled
    [10/06/2020-06:46:29] [I] Spin-wait: Disabled
    [10/06/2020-06:46:29] [I] Multithreading: Disabled
    [10/06/2020-06:46:29] [I] CUDA Graph: Disabled
    [10/06/2020-06:46:29] [I] Skip inference: Disabled
    [10/06/2020-06:46:29] [I] Inputs:
    [10/06/2020-06:46:29] [I] === Reporting Options ===
    [10/06/2020-06:46:29] [I] Verbose: Enabled
    [10/06/2020-06:46:29] [I] Averages: 10 inferences
    [10/06/2020-06:46:29] [I] Percentile: 99
    [10/06/2020-06:46:29] [I] Dump output: Disabled
    [10/06/2020-06:46:29] [I] Profile: Disabled
    [10/06/2020-06:46:29] [I] Export timing to JSON file:
    [10/06/2020-06:46:29] [I] Export output to JSON file:
    [10/06/2020-06:46:29] [I] Export profile to JSON file:
    [10/06/2020-06:46:29] [V] [TRT] Plugin creator registration succeeded - ::GridAnchor_TRT
    [10/06/2020-06:46:29] [V] [TRT] Plugin creator registration succeeded - ::NMS_TRT
    [10/06/2020-06:46:29] [V] [TRT] Plugin creator registration succeeded - ::Reorg_TRT
    [10/06/2020-06:46:29] [V] [TRT] Plugin creator registration succeeded - ::Region_TRT
    [10/06/2020-06:46:29] [V] [TRT] Plugin creator registration succeeded - ::Clip_TRT
    [10/06/2020-06:46:29] [V] [TRT] Plugin creator registration succeeded - ::LReLU_TRT
    [10/06/2020-06:46:29] [V] [TRT] Plugin creator registration succeeded - ::PriorBox_TRT
    [10/06/2020-06:46:29] [V] [TRT] Plugin creator registration succeeded - ::Normalize_TRT
    [10/06/2020-06:46:29] [V] [TRT] Plugin creator registration succeeded - ::RPROI_TRT
    [10/06/2020-06:46:29] [V] [TRT] Plugin creator registration succeeded - ::BatchedNMS_TRT
    [10/06/2020-06:46:29] [V] [TRT] Plugin creator registration succeeded - ::FlattenConcat_TRT
    [10/06/2020-06:46:29] [V] [TRT] Plugin creator registration succeeded - ::CropAndResize
    [10/06/2020-06:46:29] [V] [TRT] Plugin creator registration succeeded - ::DetectionLayer_TRT
    [10/06/2020-06:46:29] [V] [TRT] Plugin creator registration succeeded - ::Proposal
    [10/06/2020-06:46:29] [V] [TRT] Plugin creator registration succeeded - ::ProposalLayer_TRT
    [10/06/2020-06:46:29] [V] [TRT] Plugin creator registration succeeded - ::PyramidROIAlign_TRT
    [10/06/2020-06:46:29] [V] [TRT] Plugin creator registration succeeded - ::ResizeNearest_TRT
    [10/06/2020-06:46:29] [V] [TRT] Plugin creator registration succeeded - ::Split
    [10/06/2020-06:46:29] [V] [TRT] Plugin creator registration succeeded - ::SpecialSlice_TRT
    [10/06/2020-06:46:29] [V] [TRT] Plugin creator registration succeeded - ::InstanceNormalization_TRT
    Could not open file facedetection.onnx
    Could not open file facedetection.onnx
    Failed to parse ONNX model from filefacedetection.onnx
    [10/06/2020-06:46:29] [E] [TRT] Network must have at least one output
    [10/06/2020-06:46:29] [E] [TRT] Network validation failed.
    [10/06/2020-06:46:29] [E] Engine creation failed
    [10/06/2020-06:46:29] [E] Engine set up failed
    &&&& FAILED TensorRT.trtexec # trtexec --onnx=facedetection.onnx --verbose --explicitBatch --shapes=input.1:1x3x112x112

AakankshaS · October 6, 2020, 7:34am

Hi @darshancganji12,
Kindly use your model name in place of facedetection.onnx, and then share the logs.
Thanks!

darshancganji12 · October 6, 2020, 9:51am

Hi @AakankshaS,

Thanks for your reply.

Here is the Log after running: trtexec --onnx=Face_Detection.onnx --verbose --explicitBatch --shapes=input.1:1x3x112x112

[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 651
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 678
While parsing node number 210 [Resize -> "687"]:
--- Begin node ---
input: "651"
input: "678"
input: "686"
input: "685"
output: "687"
name: "Resize_210"
op_type: "Resize"
attribute {
  name: "coordinate_transformation_mode"
  s: "asymmetric"
  type: STRING
}
attribute {
  name: "cubic_coeff_a"
  f: -0.75
  type: FLOAT
}
attribute {
  name: "mode"
  s: "nearest"
  type: STRING
}
attribute {
  name: "nearest_mode"
  s: "floor"
  type: STRING
}

--- End node ---
ERROR: ModelImporter.cpp:124 In function parseGraph:
[5] Assertion failed: ctx->tensors().count(inputName)
[10/06/2020-09:46:28] [E] Failed to parse onnx file
[10/06/2020-09:46:28] [E] Parsing model failed
[10/06/2020-09:46:28] [E] Engine creation failed
[10/06/2020-09:46:28] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec # trtexec --onnx=Face_Detection.onnx --verbose --explicitBatch --shapes=input.1:1x3x112x112

Thank you

AakankshaS · October 6, 2020, 10:36am

Hi @darshancganji12,
Are you using custom plugin?
Can you please share the entire script.

Thanks!

darshancganji12 · October 6, 2020, 7:35pm

Hi @AakankshaS,

This is the Complete Log I Am getting when I run trtexec command:

[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 7, 7)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_113 for ONNX node: Conv_113
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 590 for ONNX tensor: 590
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_113 [Conv] outputs: [590 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_114 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 590
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.3.bn2.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.3.bn2.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.3.bn2.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.3.bn2.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_114 [BatchNormalization] inputs: [590 -> (1, 256, 7, 7)], [body.layer3.3.bn2.weight -> (256)], [body.layer3.3.bn2.bias -> (256)], [body.layer3.3.bn2.running_mean -> (256)], [body.layer3.3.bn2.running_var -> (256)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_114 for ONNX node: BatchNormalization_114
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 591 for ONNX tensor: 591
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_114 [BatchNormalization] outputs: [591 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_115 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 591
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_115 [Relu] inputs: [591 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_115 for ONNX node: Relu_115
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 592 for ONNX tensor: 592
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_115 [Relu] outputs: [592 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_116 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 592
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.3.conv3.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_116 [Conv] inputs: [592 -> (1, 256, 7, 7)], [body.layer3.3.conv3.weight -> (1024, 256, 1, 1)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 256, 7, 7)
[10/06/2020-09:46:28] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 1024
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 1024, 7, 7)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_116 for ONNX node: Conv_116
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 593 for ONNX tensor: 593
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_116 [Conv] outputs: [593 -> (1, 1024, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_117 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 593
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.3.bn3.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.3.bn3.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.3.bn3.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.3.bn3.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_117 [BatchNormalization] inputs: [593 -> (1, 1024, 7, 7)], [body.layer3.3.bn3.weight -> (1024)], [body.layer3.3.bn3.bias -> (1024)], [body.layer3.3.bn3.running_mean -> (1024)], [body.layer3.3.bn3.running_var -> (1024)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_117 for ONNX node: BatchNormalization_117
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 594 for ONNX tensor: 594
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_117 [BatchNormalization] outputs: [594 -> (1, 1024, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Add_118 [Add]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 594
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 586
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Add_118 [Add] inputs: [594 -> (1, 1024, 7, 7)], [586 -> (1, 1024, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Add_118 for ONNX node: Add_118
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 595 for ONNX tensor: 595
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Add_118 [Add] outputs: [595 -> (1, 1024, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_119 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 595
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_119 [Relu] inputs: [595 -> (1, 1024, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_119 for ONNX node: Relu_119
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 596 for ONNX tensor: 596
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_119 [Relu] outputs: [596 -> (1, 1024, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_120 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 596
10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.4.conv1.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_120 [Conv] inputs: [596 -> (1, 1024, 7, 7)], [body.layer3.4.conv1.weight -> (256, 1024, 1, 1)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 1024, 7, 7)
[10/06/2020-09:46:28] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 256
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 7, 7)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_120 for ONNX node: Conv_120
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 597 for ONNX tensor: 597
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_120 [Conv] outputs: [597 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_121 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 597
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.4.bn1.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.4.bn1.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.4.bn1.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.4.bn1.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_121 [BatchNormalization] inputs: [597 -> (1, 256, 7, 7)], [body.layer3.4.bn1.weight -> (256)], [body.layer3.4.bn1.bias -> (256)], [body.layer3.4.bn1.running_mean -> (256)], [body.layer3.4.bn1.running_var -> (256)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_121 for ONNX node: BatchNormalization_121
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 598 for ONNX tensor: 598
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_121 [BatchNormalization] outputs: [598 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_122 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 598
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_122 [Relu] inputs: [598 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_122 for ONNX node: Relu_122
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 599 for ONNX tensor: 599
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_122 [Relu] outputs: [599 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_123 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 599
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.4.conv2.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_123 [Conv] inputs: [599 -> (1, 256, 7, 7)], [body.layer3.4.conv2.weight -> (256, 256, 3, 3)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 256, 7, 7)
[10/06/2020-09:46:28] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 256
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 7, 7)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_123 for ONNX node: Conv_123
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 600 for ONNX tensor: 600
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_123 [Conv] outputs: [600 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_124 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 600
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.4.bn2.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.4.bn2.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.4.bn2.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.4.bn2.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_124 [BatchNormalization] inputs: [600 -> (1, 256, 7, 7)], [body.layer3.4.bn2.weight -> (256)], [body.layer3.4.bn2.bias -> (256)], [body.layer3.4.bn2.running_mean -> (256)], [body.layer3.4.bn2.running_var -> (256)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_124 for ONNX node: BatchNormalization_124
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 601 for ONNX tensor: 601
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_124 [BatchNormalization] outputs: [601 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_125 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 601
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_125 [Relu] inputs: [601 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_125 for ONNX node: Relu_125
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 602 for ONNX tensor: 602
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_125 [Relu] outputs: [602 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_126 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 602
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.4.conv3.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_126 [Conv] inputs: [602 -> (1, 256, 7, 7)], [body.layer3.4.conv3.weight -> (1024, 256, 1, 1)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 256, 7, 7)
[10/06/2020-09:46:28] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 1024
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 1024, 7, 7)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_126 for ONNX node: Conv_126
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 603 for ONNX tensor: 603
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_126 [Conv] outputs: [603 -> (1, 1024, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_127 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 603
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.4.bn3.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.4.bn3.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.4.bn3.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.4.bn3.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_127 [BatchNormalization] inputs: [603 -> (1, 1024, 7, 7)], [body.layer3.4.bn3.weight -> (1024)], [body.layer3.4.bn3.bias -> (1024)], [body.layer3.4.bn3.running_mean -> (1024)], [body.layer3.4.bn3.running_var -> (1024)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_127 for ONNX node: BatchNormalization_127
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 604 for ONNX tensor: 604
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_127 [BatchNormalization] outputs: [604 -> (1, 1024, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Add_128 [Add]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 604
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 596
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Add_128 [Add] inputs: [604 -> (1, 1024, 7, 7)], [596 -> (1, 1024, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Add_128 for ONNX node: Add_128
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 605 for ONNX tensor: 605
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Add_128 [Add] outputs: [605 -> (1, 1024, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_129 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 605
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_129 [Relu] inputs: [605 -> (1, 1024, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_129 for ONNX node: Relu_129
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 606 for ONNX tensor: 606
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_129 [Relu] outputs: [606 -> (1, 1024, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_130 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 606
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.5.conv1.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_130 [Conv] inputs: [606 -> (1, 1024, 7, 7)], [body.layer3.5.conv1.weight -> (256, 1024, 1, 1)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 1024, 7, 7)
[10/06/2020-09:46:28] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 256
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 7, 7)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_130 for ONNX node: Conv_130
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 607 for ONNX tensor: 607
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_130 [Conv] outputs: [607 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_131 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 607
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.5.bn1.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.5.bn1.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.5.bn1.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.5.bn1.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_131 [BatchNormalization] inputs: [607 -> (1, 256, 7, 7)], [body.layer3.5.bn1.weight -> (256)], [body.layer3.5.bn1.bias -> (256)], [body.layer3.5.bn1.running_mean -> (256)], [body.layer3.5.bn1.running_var -> (256)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_131 for ONNX node: BatchNormalization_131
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 608 for ONNX tensor: 608
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_131 [BatchNormalization] outputs: [608 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_132 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 608
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_132 [Relu] inputs: [608 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_132 for ONNX node: Relu_132
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 609 for ONNX tensor: 609
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_132 [Relu] outputs: [609 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_133 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 609
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.5.conv2.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_133 [Conv] inputs: [609 -> (1, 256, 7, 7)], [body.layer3.5.conv2.weight -> (256, 256, 3, 3)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 256, 7, 7)
[10/06/2020-09:46:28] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 256
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 7, 7)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_133 for ONNX node: Conv_133
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 610 for ONNX tensor: 610
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_133 [Conv] outputs: [610 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_134 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 610
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.5.bn2.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.5.bn2.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.5.bn2.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.5.bn2.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_134 [BatchNormalization] inputs: [610 -> (1, 256, 7, 7)], [body.layer3.5.bn2.weight -> (256)], [body.layer3.5.bn2.bias -> (256)], [body.layer3.5.bn2.running_mean -> (256)], [body.layer3.5.bn2.running_var -> (256)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_134 for ONNX node: BatchNormalization_134
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 611 for ONNX tensor: 611
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_134 [BatchNormalization] outputs: [611 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_135 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 611
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_135 [Relu] inputs: [611 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_135 for ONNX node: Relu_135
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 612 for ONNX tensor: 612
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_135 [Relu] outputs: [612 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_136 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 612
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.5.conv3.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_136 [Conv] inputs: [612 -> (1, 256, 7, 7)], [body.layer3.5.conv3.weight -> (1024, 256, 1, 1)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 256, 7, 7)
[10/06/2020-09:46:28] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 1024
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 1024, 7, 7)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_136 for ONNX node: Conv_136
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 613 for ONNX tensor: 613
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_136 [Conv] outputs: [613 -> (1, 1024, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_137 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 613
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.5.bn3.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.5.bn3.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.5.bn3.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer3.5.bn3.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_137 [BatchNormalization] inputs: [613 -> (1, 1024, 7, 7)], [body.layer3.5.bn3.weight -> (1024)], [body.layer3.5.bn3.bias -> (1024)], [body.layer3.5.bn3.running_mean -> (1024)], [body.layer3.5.bn3.running_var -> (1024)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_137 for ONNX node: BatchNormalization_137
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 614 for ONNX tensor: 614
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_137 [BatchNormalization] outputs: [614 -> (1, 1024, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Add_138 [Add]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 614
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 606
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Add_138 [Add] inputs: [614 -> (1, 1024, 7, 7)], [606 -> (1, 1024, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Add_138 for ONNX node: Add_138
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 615 for ONNX tensor: 615
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Add_138 [Add] outputs: [615 -> (1, 1024, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_139 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 615
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_139 [Relu] inputs: [615 -> (1, 1024, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_139 for ONNX node: Relu_139
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 616 for ONNX tensor: 616
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_139 [Relu] outputs: [616 -> (1, 1024, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_140 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 616
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.0.conv1.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_140 [Conv] inputs: [616 -> (1, 1024, 7, 7)], [body.layer4.0.conv1.weight -> (512, 1024, 1, 1)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 1024, 7, 7)
[10/06/2020-09:46:28] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 512
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 512, 7, 7)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_140 for ONNX node: Conv_140
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 617 for ONNX tensor: 617
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_140 [Conv] outputs: [617 -> (1, 512, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_141 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 617
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.0.bn1.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.0.bn1.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.0.bn1.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.0.bn1.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_141 [BatchNormalization] inputs: [617 -> (1, 512, 7, 7)], [body.layer4.0.bn1.weight -> (512)], [body.layer4.0.bn1.bias -> (512)], [body.layer4.0.bn1.running_mean -> (512)], [body.layer4.0.bn1.running_var -> (512)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_141 for ONNX node: BatchNormalization_141
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 618 for ONNX tensor: 618
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_141 [BatchNormalization] outputs: [618 -> (1, 512, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_142 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 618
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_142 [Relu] inputs: [618 -> (1, 512, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_142 for ONNX node: Relu_142
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 619 for ONNX tensor: 619
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_142 [Relu] outputs: [619 -> (1, 512, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_143 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 619
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.0.conv2.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_143 [Conv] inputs: [619 -> (1, 512, 7, 7)], [body.layer4.0.conv2.weight -> (512, 512, 3, 3)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 512, 7, 7)
[10/06/2020-09:46:28] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (3, 3), strides: (2, 2), padding: (1, 1), dilations: (1, 1), numOutputs: 512
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 512, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_143 for ONNX node: Conv_143
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 620 for ONNX tensor: 620
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_143 [Conv] outputs: [620 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_144 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 620
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.0.bn2.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.0.bn2.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.0.bn2.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.0.bn2.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_144 [BatchNormalization] inputs: [620 -> (1, 512, 4, 4)], [body.layer4.0.bn2.weight -> (512)], [body.layer4.0.bn2.bias -> (512)], [body.layer4.0.bn2.running_mean -> (512)], [body.layer4.0.bn2.running_var -> (512)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_144 for ONNX node: BatchNormalization_144
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 621 for ONNX tensor: 621
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_144 [BatchNormalization] outputs: [621 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_145 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 621
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_145 [Relu] inputs: [621 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_145 for ONNX node: Relu_145
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 622 for ONNX tensor: 622
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_145 [Relu] outputs: [622 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_146 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 622
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.0.conv3.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_146 [Conv] inputs: [622 -> (1, 512, 4, 4)], [body.layer4.0.conv3.weight -> (2048, 512, 1, 1)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 512, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 2048
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 2048, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_146 for ONNX node: Conv_146
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 623 for ONNX tensor: 623
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_146 [Conv] outputs: [623 -> (1, 2048, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_147 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 623
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.0.bn3.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.0.bn3.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.0.bn3.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.0.bn3.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_147 [BatchNormalization] inputs: [623 -> (1, 2048, 4, 4)], [body.layer4.0.bn3.weight -> (2048)], [body.layer4.0.bn3.bias -> (2048)], [body.layer4.0.bn3.running_mean -> (2048)], [body.layer4.0.bn3.running_var -> (2048)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_147 for ONNX node: BatchNormalization_147
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 624 for ONNX tensor: 624
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_147 [BatchNormalization] outputs: [624 -> (1, 2048, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_148 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 616
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.0.downsample.0.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_148 [Conv] inputs: [616 -> (1, 1024, 7, 7)], [body.layer4.0.downsample.0.weight -> (2048, 1024, 1, 1)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 1024, 7, 7)
[10/06/2020-09:46:28] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (2, 2), padding: (0, 0), dilations: (1, 1), numOutputs: 2048
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 2048, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_148 for ONNX node: Conv_148
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 625 for ONNX tensor: 625
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_148 [Conv] outputs: [625 -> (1, 2048, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_149 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 625
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.0.downsample.1.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.0.downsample.1.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.0.downsample.1.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.0.downsample.1.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_149 [BatchNormalization] inputs: [625 -> (1, 2048, 4, 4)], [body.layer4.0.downsample.1.weight -> (2048)], [body.layer4.0.downsample.1.bias -> (2048)], [body.layer4.0.downsample.1.running_mean -> (2048)], [body.layer4.0.downsample.1.running_var -> (2048)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_149 for ONNX node: BatchNormalization_149
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 626 for ONNX tensor: 626
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_149 [BatchNormalization] outputs: [626 -> (1, 2048, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Add_150 [Add]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 624
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 626
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Add_150 [Add] inputs: [624 -> (1, 2048, 4, 4)], [626 -> (1, 2048, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Add_150 for ONNX node: Add_150
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 627 for ONNX tensor: 627
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Add_150 [Add] outputs: [627 -> (1, 2048, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_151 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 627
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_151 [Relu] inputs: [627 -> (1, 2048, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_151 for ONNX node: Relu_151
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 628 for ONNX tensor: 628
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_151 [Relu] outputs: [628 -> (1, 2048, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_152 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 628
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.1.conv1.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_152 [Conv] inputs: [628 -> (1, 2048, 4, 4)], [body.layer4.1.conv1.weight -> (512, 2048, 1, 1)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 2048, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 512
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 512, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_152 for ONNX node: Conv_152
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 629 for ONNX tensor: 629
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_152 [Conv] outputs: [629 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_153 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 629
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.1.bn1.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.1.bn1.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.1.bn1.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.1.bn1.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_153 [BatchNormalization] inputs: [629 -> (1, 512, 4, 4)], [body.layer4.1.bn1.weight -> (512)], [body.layer4.1.bn1.bias -> (512)], [body.layer4.1.bn1.running_mean -> (512)], [body.layer4.1.bn1.running_var -> (512)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_153 for ONNX node: BatchNormalization_153
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 630 for ONNX tensor: 630
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_153 [BatchNormalization] outputs: [630 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_154 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 630
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_154 [Relu] inputs: [630 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_154 for ONNX node: Relu_154
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 631 for ONNX tensor: 631
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_154 [Relu] outputs: [631 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_155 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 631
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.1.conv2.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_155 [Conv] inputs: [631 -> (1, 512, 4, 4)], [body.layer4.1.conv2.weight -> (512, 512, 3, 3)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 512, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 512
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 512, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_155 for ONNX node: Conv_155
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 632 for ONNX tensor: 632
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_155 [Conv] outputs: [632 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_156 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 632
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.1.bn2.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.1.bn2.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.1.bn2.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.1.bn2.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_156 [BatchNormalization] inputs: [632 -> (1, 512, 4, 4)], [body.layer4.1.bn2.weight -> (512)], [body.layer4.1.bn2.bias -> (512)], [body.layer4.1.bn2.running_mean -> (512)], [body.layer4.1.bn2.running_var -> (512)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_156 for ONNX node: BatchNormalization_156
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 633 for ONNX tensor: 633
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_156 [BatchNormalization] outputs: [633 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_157 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 633
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_157 [Relu] inputs: [633 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_157 for ONNX node: Relu_157
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 634 for ONNX tensor: 634
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_157 [Relu] outputs: [634 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_158 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 634
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.1.conv3.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_158 [Conv] inputs: [634 -> (1, 512, 4, 4)], [body.layer4.1.conv3.weight -> (2048, 512, 1, 1)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 512, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 2048
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 2048, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_158 for ONNX node: Conv_158
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 635 for ONNX tensor: 635
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_158 [Conv] outputs: [635 -> (1, 2048, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_159 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 635
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.1.bn3.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.1.bn3.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.1.bn3.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.1.bn3.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_159 [BatchNormalization] inputs: [635 -> (1, 2048, 4, 4)], [body.layer4.1.bn3.weight -> (2048)], [body.layer4.1.bn3.bias -> (2048)], [body.layer4.1.bn3.running_mean -> (2048)], [body.layer4.1.bn3.running_var -> (2048)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_159 for ONNX node: BatchNormalization_159
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 636 for ONNX tensor: 636
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_159 [BatchNormalization] outputs: [636 -> (1, 2048, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Add_160 [Add]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 636
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 628
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Add_160 [Add] inputs: [636 -> (1, 2048, 4, 4)], [628 -> (1, 2048, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Add_160 for ONNX node: Add_160
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 637 for ONNX tensor: 637
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Add_160 [Add] outputs: [637 -> (1, 2048, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_161 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 637
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_161 [Relu] inputs: [637 -> (1, 2048, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_161 for ONNX node: Relu_161
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 638 for ONNX tensor: 638
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_161 [Relu] outputs: [638 -> (1, 2048, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_162 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 638
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.2.conv1.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_162 [Conv] inputs: [638 -> (1, 2048, 4, 4)], [body.layer4.2.conv1.weight -> (512, 2048, 1, 1)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 2048, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 512
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 512, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_162 for ONNX node: Conv_162
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 639 for ONNX tensor: 639
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_162 [Conv] outputs: [639 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_163 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 639
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.2.bn1.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.2.bn1.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.2.bn1.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.2.bn1.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_163 [BatchNormalization] inputs: [639 -> (1, 512, 4, 4)], [body.layer4.2.bn1.weight -> (512)], [body.layer4.2.bn1.bias -> (512)], [body.layer4.2.bn1.running_mean -> (512)], [body.layer4.2.bn1.running_var -> (512)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_163 for ONNX node: BatchNormalization_163
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 640 for ONNX tensor: 640
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_163 [BatchNormalization] outputs: [640 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_164 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 640
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_164 [Relu] inputs: [640 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_164 for ONNX node: Relu_164
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 641 for ONNX tensor: 641
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_164 [Relu] outputs: [641 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_165 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 641
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.2.conv2.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_165 [Conv] inputs: [641 -> (1, 512, 4, 4)], [body.layer4.2.conv2.weight -> (512, 512, 3, 3)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 512, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 512
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 512, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_165 for ONNX node: Conv_165
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 642 for ONNX tensor: 642
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_165 [Conv] outputs: [642 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_166 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 642
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.2.bn2.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.2.bn2.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.2.bn2.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.2.bn2.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_166 [BatchNormalization] inputs: [642 -> (1, 512, 4, 4)], [body.layer4.2.bn2.weight -> (512)], [body.layer4.2.bn2.bias -> (512)], [body.layer4.2.bn2.running_mean -> (512)], [body.layer4.2.bn2.running_var -> (512)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_166 for ONNX node: BatchNormalization_166
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 643 for ONNX tensor: 643
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_166 [BatchNormalization] outputs: [643 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_167 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 643
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_167 [Relu] inputs: [643 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_167 for ONNX node: Relu_167
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 644 for ONNX tensor: 644
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_167 [Relu] outputs: [644 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_168 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 644
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.2.conv3.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_168 [Conv] inputs: [644 -> (1, 512, 4, 4)], [body.layer4.2.conv3.weight -> (2048, 512, 1, 1)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 512, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call.
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 2048
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 2048, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_168 for ONNX node: Conv_168
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 645 for ONNX tensor: 645
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_168 [Conv] outputs: [645 -> (1, 2048, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_169 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 645
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.2.bn3.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.2.bn3.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.2.bn3.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: body.layer4.2.bn3.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_169 [BatchNormalization] inputs: [645 -> (1, 2048, 4, 4)], [body.layer4.2.bn3.weight -> (2048)], [body.layer4.2.bn3.bias -> (2048)], [body.layer4.2.bn3.running_mean -> (2048)], [body.layer4.2.bn3.running_var -> (2048)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_169 for ONNX node: BatchNormalization_169
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 646 for ONNX tensor: 646
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_169 [BatchNormalization] outputs: [646 -> (1, 2048, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Add_170 [Add]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 646
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 638
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Add_170 [Add] inputs: [646 -> (1, 2048, 4, 4)], [638 -> (1, 2048, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Add_170 for ONNX node: Add_170
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 647 for ONNX tensor: 647
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Add_170 [Add] outputs: [647 -> (1, 2048, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_171 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 647
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_171 [Relu] inputs: [647 -> (1, 2048, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_171 for ONNX node: Relu_171
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 648 for ONNX tensor: 648
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_171 [Relu] outputs: [648 -> (1, 2048, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_172 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 648
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.lateral_blocks.2.0.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.lateral_blocks.2.0.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_172 [Conv] inputs: [648 -> (1, 2048, 4, 4)], [fpn.lateral_blocks.2.0.weight -> (256, 2048, 1, 1)], [fpn.lateral_blocks.2.0.bias -> (256)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 2048, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 256
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_172 for ONNX node: Conv_172
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 649 for ONNX tensor: 649
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_172 [Conv] outputs: [649 -> (1, 256, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_173 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 649
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.lateral_blocks.2.1.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.lateral_blocks.2.1.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.lateral_blocks.2.1.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.lateral_blocks.2.1.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_173 [BatchNormalization] inputs: [649 -> (1, 256, 4, 4)], [fpn.lateral_blocks.2.1.weight -> (256)], [fpn.lateral_blocks.2.1.bias -> (256)], [fpn.lateral_blocks.2.1.running_mean -> (256)], [fpn.lateral_blocks.2.1.running_var -> (256)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_173 for ONNX node: BatchNormalization_173
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 650 for ONNX tensor: 650
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_173 [BatchNormalization] outputs: [650 -> (1, 256, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_174 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 650
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_174 [Relu] inputs: [650 -> (1, 256, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_174 for ONNX node: Relu_174
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 651 for ONNX tensor: 651
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_174 [Relu] outputs: [651 -> (1, 256, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_175 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 651
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_conv1.0.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_conv1.0.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_175 [Conv] inputs: [651 -> (1, 256, 4, 4)], [fpn.context_blocks.2.det_conv1.0.weight -> (256, 256, 3, 3)], [fpn.context_blocks.2.det_conv1.0.bias -> (256)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 256, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 256
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_175 for ONNX node: Conv_175
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 652 for ONNX tensor: 652
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_175 [Conv] outputs: [652 -> (1, 256, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_176 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 652
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_conv1.1.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_conv1.1.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_conv1.1.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_conv1.1.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_176 [BatchNormalization] inputs: [652 -> (1, 256, 4, 4)], [fpn.context_blocks.2.det_conv1.1.weight -> (256)], [fpn.context_blocks.2.det_conv1.1.bias -> (256)], [fpn.context_blocks.2.det_conv1.1.running_mean -> (256)], [fpn.context_blocks.2.det_conv1.1.running_var -> (256)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_176 for ONNX node: BatchNormalization_176
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 653 for ONNX tensor: 653
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_176 [BatchNormalization] outputs: [653 -> (1, 256, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_177 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 651
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv1.0.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv1.0.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_177 [Conv] inputs: [651 -> (1, 256, 4, 4)], [fpn.context_blocks.2.det_context_conv1.0.weight -> (128, 256, 3, 3)], [fpn.context_blocks.2.det_context_conv1.0.bias -> (128)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 256, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 128
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 128, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_177 for ONNX node: Conv_177
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 654 for ONNX tensor: 654
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_177 [Conv] outputs: [654 -> (1, 128, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_178 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 654
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv1.1.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv1.1.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv1.1.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv1.1.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_178 [BatchNormalization] inputs: [654 -> (1, 128, 4, 4)], [fpn.context_blocks.2.det_context_conv1.1.weight -> (128)], [fpn.context_blocks.2.det_context_conv1.1.bias -> (128)], [fpn.context_blocks.2.det_context_conv1.1.running_mean -> (128)], [fpn.context_blocks.2.det_context_conv1.1.running_var -> (128)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_178 for ONNX node: BatchNormalization_178
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 655 for ONNX tensor: 655
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_178 [BatchNormalization] outputs: [655 -> (1, 128, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_179 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 655
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_179 [Relu] inputs: [655 -> (1, 128, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_179 for ONNX node: Relu_179
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 656 for ONNX tensor: 656
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_179 [Relu] outputs: [656 -> (1, 128, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_180 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 656
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv2.0.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv2.0.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_180 [Conv] inputs: [656 -> (1, 128, 4, 4)], [fpn.context_blocks.2.det_context_conv2.0.weight -> (128, 128, 3, 3)], [fpn.context_blocks.2.det_context_conv2.0.bias -> (128)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 128, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 128
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 128, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_180 for ONNX node: Conv_180
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 657 for ONNX tensor: 657
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_180 [Conv] outputs: [657 -> (1, 128, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_181 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 657
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv2.1.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv2.1.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv2.1.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv2.1.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_181 [BatchNormalization] inputs: [657 -> (1, 128, 4, 4)], [fpn.context_blocks.2.det_context_conv2.1.weight -> (128)], [fpn.context_blocks.2.det_context_conv2.1.bias -> (128)], [fpn.context_blocks.2.det_context_conv2.1.running_mean -> (128)], [fpn.context_blocks.2.det_context_conv2.1.running_var -> (128)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_181 for ONNX node: BatchNormalization_181
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 658 for ONNX tensor: 658
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_181 [BatchNormalization] outputs: [658 -> (1, 128, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_182 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 656
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv3_1.0.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv3_1.0.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_182 [Conv] inputs: [656 -> (1, 128, 4, 4)], [fpn.context_blocks.2.det_context_conv3_1.0.weight -> (128, 128, 3, 3)], [fpn.context_blocks.2.det_context_conv3_1.0.bias -> (128)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 128, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 128
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 128, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_182 for ONNX node: Conv_182
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 659 for ONNX tensor: 659
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_182 [Conv] outputs: [659 -> (1, 128, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_183 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 659
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv3_1.1.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv3_1.1.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv3_1.1.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv3_1.1.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_183 [BatchNormalization] inputs: [659 -> (1, 128, 4, 4)], [fpn.context_blocks.2.det_context_conv3_1.1.weight -> (128)], [fpn.context_blocks.2.det_context_conv3_1.1.bias ->(128)], [fpn.context_blocks.2.det_context_conv3_1.1.running_mean -> (128)], [fpn.context_blocks.2.det_context_conv3_1.1.running_var -> (128)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_183 for ONNX node: BatchNormalization_183
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 660 for ONNX tensor: 660
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_183 [BatchNormalization] outputs: [660 -> (1, 128, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_184 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 660
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_184 [Relu] inputs: [660 -> (1, 128, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_184 for ONNX node: Relu_184
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 661 for ONNX tensor: 661
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_184 [Relu] outputs: [661 -> (1, 128, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_185 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 661
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv3_2.0.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv3_2.0.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_185 [Conv] inputs: [661 -> (1, 128, 4, 4)], [fpn.context_blocks.2.det_context_conv3_2.0.weight -> (128, 128, 3, 3)], [fpn.context_blocks.2.det_context_conv3_2.0.bias -> (128)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 128, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 128
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 128, 4, 4)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_185 for ONNX node: Conv_185
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 662 for ONNX tensor: 662
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_185 [Conv] outputs: [662 -> (1, 128, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_186 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 662
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv3_2.1.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv3_2.1.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv3_2.1.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.context_blocks.2.det_context_conv3_2.1.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_186 [BatchNormalization] inputs: [662 -> (1, 128, 4, 4)], [fpn.context_blocks.2.det_context_conv3_2.1.weight -> (128)], [fpn.context_blocks.2.det_context_conv3_2.1.bias ->(128)], [fpn.context_blocks.2.det_context_conv3_2.1.running_mean -> (128)], [fpn.context_blocks.2.det_context_conv3_2.1.running_var -> (128)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_186 for ONNX node: BatchNormalization_186
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 663 for ONNX tensor: 663
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_186 [BatchNormalization] outputs: [663 -> (1, 128, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Concat_187 [Concat]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 653
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 658
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 663
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Concat_187 [Concat] inputs: [653 -> (1, 256, 4, 4)], [658 -> (1, 128, 4, 4)], [663 -> (1, 128, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Concat_187 for ONNX node: Concat_187
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 664 for ONNX tensor: 664
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Concat_187 [Concat] outputs: [664 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_188 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 664
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_188 [Relu] inputs: [664 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_188 for ONNX node: Relu_188
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 665 for ONNX tensor: 665
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_188 [Relu] outputs: [665 -> (1, 512, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Conv_189 [Conv]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 616
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.lateral_blocks.1.0.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.lateral_blocks.1.0.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Conv_189 [Conv] inputs: [616 -> (1, 1024, 7, 7)], [fpn.lateral_blocks.1.0.weight -> (256, 1024, 1, 1)], [fpn.lateral_blocks.1.0.bias -> (256)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:442: Convolution input dimensions: (1, 1024, 7, 7)
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:524: Using kernel: (1, 1), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 256
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:525: Convolution output dimensions: (1, 256, 7, 7)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Conv_189 for ONNX node: Conv_189
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 666 for ONNX tensor: 666
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Conv_189 [Conv] outputs: [666 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: BatchNormalization_190 [BatchNormalization]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 666
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.lateral_blocks.1.1.weight
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.lateral_blocks.1.1.bias
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.lateral_blocks.1.1.running_mean
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: fpn.lateral_blocks.1.1.running_var
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: BatchNormalization_190 [BatchNormalization] inputs: [666 -> (1, 256, 7, 7)], [fpn.lateral_blocks.1.1.weight -> (256)], [fpn.lateral_blocks.1.1.bias -> (256)], [fpn.lateral_blocks.1.1.running_mean -> (256)], [fpn.lateral_blocks.1.1.running_var -> (256)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: BatchNormalization_190 for ONNX node: BatchNormalization_190
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 667 for ONNX tensor: 667
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: BatchNormalization_190 [BatchNormalization] outputs: [667 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Relu_191 [Relu]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 667
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Relu_191 [Relu] inputs: [667 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Relu_191 for ONNX node: Relu_191
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 668 for ONNX tensor: 668
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Relu_191 [Relu] outputs: [668 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Shape_192 [Shape]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 668
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Shape_192 [Shape] inputs: [668 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Shape_192 for ONNX node: Shape_192
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 669 for ONNX tensor: 669
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Shape_192 [Shape] outputs: [669 -> (4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Constant_193 [Constant]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Constant_193 [Constant] inputs:
[10/06/2020-09:46:28] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Constant_193 [Constant] outputs: [670 -> ()],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Gather_194 [Gather]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 669
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 670
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Gather_194 [Gather] inputs: [669 -> (4)], [670 -> ()],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:942: Using Gather axis: 0
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Gather_194 for ONNX node: Gather_194
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 671 for ONNX tensor: 671
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Gather_194 [Gather] outputs: [671 -> ()],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Shape_195 [Shape]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 668
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Shape_195 [Shape] inputs: [668 -> (1, 256, 7, 7)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Shape_195 for ONNX node: Shape_195
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 672 for ONNX tensor: 672
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Shape_195 [Shape] outputs: [672 -> (4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Constant_196 [Constant]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Constant_196 [Constant] inputs:
[10/06/2020-09:46:28] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Constant_196 [Constant] outputs: [673 -> ()],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Gather_197 [Gather]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 672
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 673
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Gather_197 [Gather] inputs: [672 -> (4)], [673 -> ()],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:942: Using Gather axis: 0
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Gather_197 for ONNX node: Gather_197
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 674 for ONNX tensor: 674
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Gather_197 [Gather] outputs: [674 -> ()],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Unsqueeze_198 [Unsqueeze]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 671
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Unsqueeze_198 [Unsqueeze] inputs: [671 -> ()],
[10/06/2020-09:46:28] [V] [TRT] onnx2trt_utils.cpp:1411: Original shape: (), unsqueezing to: (1)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Unsqueeze_198 for ONNX node: Unsqueeze_198
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 675 for ONNX tensor: 675
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Unsqueeze_198 [Unsqueeze] outputs: [675 -> (1)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Unsqueeze_199 [Unsqueeze]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 674
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Unsqueeze_199 [Unsqueeze] inputs: [674 -> ()],
[10/06/2020-09:46:28] [V] [TRT] onnx2trt_utils.cpp:1411: Original shape: (), unsqueezing to: (1)
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Unsqueeze_199 for ONNX node: Unsqueeze_199
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 676 for ONNX tensor: 676
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Unsqueeze_199 [Unsqueeze] outputs: [676 -> (1)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Concat_200 [Concat]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 675
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 676
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Concat_200 [Concat] inputs: [675 -> (1)], [676 -> (1)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Concat_200 for ONNX node: Concat_200
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 677 for ONNX tensor: 677
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Concat_200 [Concat] outputs: [677 -> (2)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Constant_201 [Constant]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Constant_201 [Constant] inputs:
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Constant_201 [Constant] outputs: [678 -> ()],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Shape_202 [Shape]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 651
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Shape_202 [Shape] inputs: [651 -> (1, 256, 4, 4)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Shape_202 for ONNX node: Shape_202
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 679 for ONNX tensor: 679
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Shape_202 [Shape] outputs: [679 -> (4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Constant_203 [Constant]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Constant_203 [Constant] inputs:
[10/06/2020-09:46:28] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Constant_203 [Constant] outputs: [680 -> (1)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Constant_204 [Constant]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Constant_204 [Constant] inputs:
[10/06/2020-09:46:28] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Constant_204 [Constant] outputs: [681 -> (1)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Constant_205 [Constant]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Constant_205 [Constant] inputs:
[10/06/2020-09:46:28] [W] [TRT] onnx2trt_utils.cpp:198: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Constant_205 [Constant] outputs: [682 -> (1)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Slice_206 [Slice]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 679
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 681
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 682
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 680
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Slice_206 [Slice] inputs: [679 -> (4)], [681 -> (1)], [682 -> (1)],[680 -> (1)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Slice_206 for ONNX node: Slice_206
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 683 for ONNX tensor: 683
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Slice_206 [Slice] outputs: [683 -> (2)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Cast_207 [Cast]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 677
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Cast_207 [Cast] inputs: [677 -> (2)],
[10/06/2020-09:46:28] [V] [TRT] builtin_op_importers.cpp:315: Casting to type: int32
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Cast_207 for ONNX node: Cast_207
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 684 for ONNX tensor: 684
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Cast_207 [Cast] outputs: [684 -> (2)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Concat_208 [Concat]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 683
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 684
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Concat_208 [Concat] inputs: [683 -> (2)], [684 -> (2)],
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:122: Registering layer: Concat_208 for ONNX node: Concat_208
[10/06/2020-09:46:28] [V] [TRT] ImporterContext.hpp:97: Registering tensor: 685 for ONNX tensor: 685
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Concat_208 [Concat] outputs: [685 -> (4)],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Constant_209 [Constant]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:129: Constant_209 [Constant] inputs:
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:180: Constant_209 [Constant] outputs: [686 -> ()],
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:107: Parsing node: Resize_210 [Resize]
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 651
[10/06/2020-09:46:28] [V] [TRT] ModelImporter.cpp:123: Searching for input: 678
While parsing node number 210 [Resize -> "687"]:
--- Begin node ---
input: "651"
input: "678"
input: "686"
input: "685"
output: "687"
name: "Resize_210"
op_type: "Resize"
attribute {
  name: "coordinate_transformation_mode"
  s: "asymmetric"
  type: STRING
}
attribute {
  name: "cubic_coeff_a"
  f: -0.75
  type: FLOAT
}
attribute {
  name: "mode"
  s: "nearest"
  type: STRING
}
attribute {
  name: "nearest_mode"
  s: "floor"
  type: STRING
}

--- End node ---
ERROR: ModelImporter.cpp:124 In function parseGraph:
[5] Assertion failed: ctx->tensors().count(inputName)
[10/06/2020-09:46:28] [E] Failed to parse onnx file
[10/06/2020-09:46:28] [E] Parsing model failed
[10/06/2020-09:46:28] [E] Engine creation failed
[10/06/2020-09:46:28] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec # trtexec --onnx=Face_Detection.onnx --verbose --explicitBatch --shapes=input.1:1x3x112x112

Thanks

darshancganji12 · October 15, 2020, 7:06am

Looking forward to the reply

AakankshaS · October 16, 2020, 9:08am

Hi @darshancganji12,
The below link may answer your query
https://github.com/onnx/onnx-tensorrt/issues/302#issuecomment-550455726
Also, are you using custom plugin?
Thanks!

Topic		Replies	Views
TensorRT cannot parse ONNX model TensorRT	5	1799	June 18, 2020
Run the Tacotron2 meet the problem TensorRT	7	1832	February 21, 2022
Convert onnx to trt format using trtexec TensorRT tensorrt	5	5355	August 17, 2021
[TensorRT] ERROR: Network must have at least one output TensorRT tensorrt	29	2385	September 30, 2021
BUG: Output TRT engine from trtexec has completely different inference than input model TensorRT tensorrt , debugging-and-troubleshooting	3	2220	January 4, 2022
ONNX and tensorRT: ERROR: Network must have at least one output TensorRT	30	16848	October 6, 2020
Run out of memory when creating TensorRT engine from onnx model Jetson Xavier NX tensorrt	7	2739	October 18, 2021
Error converting gru model to TRT engine TensorRT	3	1006	October 25, 2021
ONNX to TensorRT conversion Jetson Nano tensorrt , pytorch , onnx	4	354	July 3, 2024
Onnx to trt conversion TensorRT tensorrt	8	799	April 21, 2020

[TensorRT] ERROR: Network must have at least one output [TensorRT] ERROR: Network validation failed

Related topics