DeepStream

siddhusiddhartha25 · April 26, 2021, 10:13am

Sir,
I am trying to work on tensorrt model on deepstream with my own dataset. I successfully converted my yolo weights file into onnx file. I am facing the problem in converting that onnx file into tensorrt engine file. It is showing the error. When i run this script, /usr/src/tensorrt/bin/trtexec --onnx=custom-yolov4-tiny_human1-608.onnx --explicitBatch --saveEngine=custom-yolov4-tiny_human1-608.engine --workspace=4096 --fp16
&&&& RUNNING TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=custom-yolov4-tiny_human1-608.onnx --explicitBatch --saveEngine=custom-yolov4-tiny_human1-608.engine --workspace=4096 --fp16
[04/26/2021-16:16:57] [I] === Model Options ===
[04/26/2021-16:16:57] [I] Format: ONNX
[04/26/2021-16:16:57] [I] Model: custom-yolov4-tiny_human1-608.onnx
[04/26/2021-16:16:57] [I] Output:
[04/26/2021-16:16:57] [I] === Build Options ===
[04/26/2021-16:16:57] [I] Max batch: explicit
[04/26/2021-16:16:57] [I] Workspace: 4096 MB
[04/26/2021-16:16:57] [I] minTiming: 1
[04/26/2021-16:16:57] [I] avgTiming: 8
[04/26/2021-16:16:57] [I] Precision: FP32+FP16
[04/26/2021-16:16:57] [I] Calibration:
[04/26/2021-16:16:57] [I] Safe mode: Disabled
[04/26/2021-16:16:57] [I] Save engine: custom-yolov4-tiny_human1-608.engine
[04/26/2021-16:16:57] [I] Load engine:
[04/26/2021-16:16:57] [I] Builder Cache: Enabled
[04/26/2021-16:16:57] [I] NVTX verbosity: 0
[04/26/2021-16:16:57] [I] Inputs format: fp32:CHW
[04/26/2021-16:16:57] [I] Outputs format: fp32:CHW
[04/26/2021-16:16:57] [I] Input build shapes: model
[04/26/2021-16:16:57] [I] Input calibration shapes: model
[04/26/2021-16:16:57] [I] === System Options ===
[04/26/2021-16:16:57] [I] Device: 0
[04/26/2021-16:16:57] [I] DLACore:
[04/26/2021-16:16:57] [I] Plugins:
[04/26/2021-16:16:57] [I] === Inference Options ===
[04/26/2021-16:16:57] [I] Batch: Explicit
[04/26/2021-16:16:57] [I] Input inference shapes: model
[04/26/2021-16:16:57] [I] Iterations: 10
[04/26/2021-16:16:57] [I] Duration: 3s (+ 200ms warm up)
[04/26/2021-16:16:57] [I] Sleep time: 0ms
[04/26/2021-16:16:57] [I] Streams: 1
[04/26/2021-16:16:57] [I] ExposeDMA: Disabled
[04/26/2021-16:16:57] [I] Spin-wait: Disabled
[04/26/2021-16:16:57] [I] Multithreading: Disabled
[04/26/2021-16:16:57] [I] CUDA Graph: Disabled
[04/26/2021-16:16:57] [I] Skip inference: Disabled
[04/26/2021-16:16:57] [I] Inputs:
[04/26/2021-16:16:57] [I] === Reporting Options ===
[04/26/2021-16:16:57] [I] Verbose: Disabled
[04/26/2021-16:16:57] [I] Averages: 10 inferences
[04/26/2021-16:16:57] [I] Percentile: 99
[04/26/2021-16:16:57] [I] Dump output: Disabled
[04/26/2021-16:16:57] [I] Profile: Disabled
[04/26/2021-16:16:57] [I] Export timing to JSON file:
[04/26/2021-16:16:57] [I] Export output to JSON file:
[04/26/2021-16:16:57] [I] Export profile to JSON file:
[04/26/2021-16:16:57] [I]

Input filename: custom-yolov4-tiny_human1-608.onnx
ONNX IR version: 0.0.4
Opset version: 9
Producer name: NVIDIA TensorRT sample
Producer version:
Domain:
Model version: 0
Doc string:

[04/26/2021-16:17:01] [E] [TRT] …/rtSafe/safeRuntime.cpp (25) - Cuda Error in allocate: 2 (out of memory)
[04/26/2021-16:17:01] [E] [TRT] …/rtSafe/safeRuntime.cpp (25) - Cuda Error in allocate: 2 (out of memory)
[04/26/2021-16:17:01] [E] Engine creation failed
[04/26/2021-16:17:01] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=custom-yolov4-tiny_human1-608.onnx --explicitBatch --saveEngine=custom-yolov4-tiny_human1-608.engine --workspace=4096 --fp16

I am enclosing screenshot if the error also. Please help me sort out this issue…
I am following this resource from the internet.

Thanks in advance…

kayccc · April 26, 2021, 10:50pm

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU)
• DeepStream Version
• JetPack Version (valid for Jetson only)
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only)
• Issue Type( questions, new requirements, bugs)
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)

siddhusiddhartha25 · April 27, 2021, 5:28am

NVIDIA Jetson Nano (Developer Kit Version)
L4T 32.4.4 [ JetPack UNKNOWN ]
Ubuntu 18.04.5 LTS
Kernel Version: 4.9.140-tegra
CUDA 10.2.89
CUDA Architecture: 5.3
OpenCV version: 4.1.1
OpenCV Cuda: NO
CUDNN: 8.0.0.180
TensorRT: 7.1.3.0
Vision Works: 1.6.0.501
VPI: 0.4.4

AastaLLL · April 27, 2021, 5:31am

Hi,

It seems that your issue is related to TensorRT only.
The error indicates an out of memory error.

If you are using Nano, the total memory resource is just 4G (or 2G) and it will limit you from a complicated model.
Maybe you can give YOLOv4 Tiny a try.

Thanks.

siddhusiddhartha25 · April 27, 2021, 5:34am

Sir, I am using yolov4 tiny only.still showing the same error

AastaLLL · April 27, 2021, 5:48am

Hi,

Could you run the trtexec with --verbose and share the log with us?

Thanks.

siddhusiddhartha25 · April 27, 2021, 6:05am

&&&& RUNNING TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=custom-yolov4-tiny_human1-608.onnx --explicitBatch --saveEngine=custom-yolov4-tiny_human1-608.engine --workspace=4096 --fp16 --verbose
[04/27/2021-11:25:33] [I] === Model Options ===
[04/27/2021-11:25:33] [I] Format: ONNX
[04/27/2021-11:25:33] [I] Model: custom-yolov4-tiny_human1-608.onnx
[04/27/2021-11:25:33] [I] Output:
[04/27/2021-11:25:33] [I] === Build Options ===
[04/27/2021-11:25:33] [I] Max batch: explicit
[04/27/2021-11:25:33] [I] Workspace: 4096 MB
[04/27/2021-11:25:33] [I] minTiming: 1
[04/27/2021-11:25:33] [I] avgTiming: 8
[04/27/2021-11:25:33] [I] Precision: FP32+FP16
[04/27/2021-11:25:33] [I] Calibration:
[04/27/2021-11:25:33] [I] Safe mode: Disabled
[04/27/2021-11:25:33] [I] Save engine: custom-yolov4-tiny_human1-608.engine
[04/27/2021-11:25:33] [I] Load engine:
[04/27/2021-11:25:33] [I] Builder Cache: Enabled
[04/27/2021-11:25:33] [I] NVTX verbosity: 0
[04/27/2021-11:25:33] [I] Inputs format: fp32:CHW
[04/27/2021-11:25:33] [I] Outputs format: fp32:CHW
[04/27/2021-11:25:33] [I] Input build shapes: model
[04/27/2021-11:25:33] [I] Input calibration shapes: model
[04/27/2021-11:25:33] [I] === System Options ===
[04/27/2021-11:25:33] [I] Device: 0
[04/27/2021-11:25:33] [I] DLACore:
[04/27/2021-11:25:33] [I] Plugins:
[04/27/2021-11:25:33] [I] === Inference Options ===
[04/27/2021-11:25:33] [I] Batch: Explicit
[04/27/2021-11:25:33] [I] Input inference shapes: model
[04/27/2021-11:25:33] [I] Iterations: 10
[04/27/2021-11:25:33] [I] Duration: 3s (+ 200ms warm up)
[04/27/2021-11:25:33] [I] Sleep time: 0ms
[04/27/2021-11:25:33] [I] Streams: 1
[04/27/2021-11:25:33] [I] ExposeDMA: Disabled
[04/27/2021-11:25:33] [I] Spin-wait: Disabled
[04/27/2021-11:25:33] [I] Multithreading: Disabled
[04/27/2021-11:25:33] [I] CUDA Graph: Disabled
[04/27/2021-11:25:33] [I] Skip inference: Disabled
[04/27/2021-11:25:33] [I] Inputs:
[04/27/2021-11:25:33] [I] === Reporting Options ===
[04/27/2021-11:25:33] [I] Verbose: Enabled
[04/27/2021-11:25:33] [I] Averages: 10 inferences
[04/27/2021-11:25:33] [I] Percentile: 99
[04/27/2021-11:25:33] [I] Dump output: Disabled
[04/27/2021-11:25:33] [I] Profile: Disabled
[04/27/2021-11:25:33] [I] Export timing to JSON file:
[04/27/2021-11:25:33] [I] Export output to JSON file:
[04/27/2021-11:25:33] [I] Export profile to JSON file:
[04/27/2021-11:25:33] [I]
[04/27/2021-11:25:33] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1
[04/27/2021-11:25:33] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1
[04/27/2021-11:25:33] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1
[04/27/2021-11:25:33] [V] [TRT] Registered plugin creator - ::Region_TRT version 1
[04/27/2021-11:25:33] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1
[04/27/2021-11:25:33] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1
[04/27/2021-11:25:33] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1
[04/27/2021-11:25:33] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1
[04/27/2021-11:25:33] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1
[04/27/2021-11:25:33] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1
[04/27/2021-11:25:33] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1
[04/27/2021-11:25:33] [V] [TRT] Registered plugin creator - ::CropAndResize version 1
[04/27/2021-11:25:33] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1
[04/27/2021-11:25:33] [V] [TRT] Registered plugin creator - ::Proposal version 1
[04/27/2021-11:25:33] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1
[04/27/2021-11:25:33] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1
[04/27/2021-11:25:33] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1
[04/27/2021-11:25:33] [V] [TRT] Registered plugin creator - ::Split version 1
[04/27/2021-11:25:33] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1
[04/27/2021-11:25:33] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1

Input filename: custom-yolov4-tiny_human1-608.onnx
ONNX IR version: 0.0.4
Opset version: 9
Producer name: NVIDIA TensorRT sample
Producer version:
Domain:
Model version: 0
Doc string:

[04/27/2021-11:25:37] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1
[04/27/2021-11:25:37] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1
[04/27/2021-11:25:37] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1
[04/27/2021-11:25:37] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1
[04/27/2021-11:25:37] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1
[04/27/2021-11:25:37] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1
[04/27/2021-11:25:37] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1
[04/27/2021-11:25:37] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1
[04/27/2021-11:25:37] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1
[04/27/2021-11:25:37] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1
[04/27/2021-11:25:37] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1
[04/27/2021-11:25:37] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1
[04/27/2021-11:25:37] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1
[04/27/2021-11:25:37] [V] [TRT] Plugin creator already registered - ::Proposal version 1
[04/27/2021-11:25:37] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1
[04/27/2021-11:25:37] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1
[04/27/2021-11:25:37] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1
[04/27/2021-11:25:37] [V] [TRT] Plugin creator already registered - ::Split version 1
[04/27/2021-11:25:37] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1
[04/27/2021-11:25:37] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:202: Adding network input: 000_net with dtype: float32, dimensions: (1, 3, 608, 608)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 000_net for ONNX tensor: 000_net
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 001_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 001_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 001_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 001_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 001_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 002_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 002_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 002_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 002_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 002_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 003_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 003_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 003_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 003_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 003_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 005_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 005_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 005_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 005_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 005_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 006_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 006_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 006_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 006_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 006_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 008_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 008_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 008_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 008_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 008_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 011_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 011_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 011_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 011_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 011_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 013_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 013_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 013_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 013_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 013_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 014_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 014_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 014_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 014_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 014_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 016_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 016_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 016_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 016_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 016_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 019_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 019_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 019_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 019_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 019_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 021_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 021_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 021_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 021_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 021_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 022_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 022_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 022_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 022_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 022_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 024_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 024_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 024_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 024_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 024_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 027_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 027_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 027_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 027_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 027_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 028_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 028_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 028_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 028_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 028_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 029_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 029_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 029_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 029_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 029_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 030_convolutional_conv_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 030_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 033_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 033_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 033_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 033_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 033_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 034_upsample_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 036_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 036_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 036_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 036_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 036_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 037_convolutional_conv_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 037_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 001_convolutional [Conv]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 000_net
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 001_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 001_convolutional [Conv] inputs: [000_net → (1, 3, 608, 608)], [001_convolutional_conv_weights → (32, 3, 3, 3)],
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 3, 608, 608)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 001_convolutional for ONNX node: 001_convolutional
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 32, 304, 304)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 001_convolutional for ONNX tensor: 001_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 001_convolutional [Conv] outputs: [001_convolutional → (1, 32, 304, 304)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 001_convolutional_bn [BatchNormalization]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 001_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 001_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 001_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 001_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 001_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 001_convolutional_bn [BatchNormalization] inputs: [001_convolutional → (1, 32, 304, 304)], [001_convolutional_bn_scale → (32)], [001_convolutional_bn_bias → (32)], [001_convolutional_bn_mean → (32)], [001_convolutional_bn_var → (32)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 001_convolutional_bn for ONNX node: 001_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 001_convolutional_bn for ONNX tensor: 001_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 001_convolutional_bn [BatchNormalization] outputs: [001_convolutional_bn → (1, 32, 304, 304)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 001_convolutional_lrelu [LeakyRelu]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 001_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 001_convolutional_lrelu [LeakyRelu] inputs: [001_convolutional_bn → (1, 32, 304, 304)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 001_convolutional_lrelu for ONNX node: 001_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 001_convolutional_lrelu for ONNX tensor: 001_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 001_convolutional_lrelu [LeakyRelu] outputs: [001_convolutional_lrelu → (1, 32, 304, 304)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 002_convolutional [Conv]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 001_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 002_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 002_convolutional [Conv] inputs: [001_convolutional_lrelu → (1, 32, 304, 304)], [002_convolutional_conv_weights → (64, 32, 3, 3)],
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 32, 304, 304)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 002_convolutional for ONNX node: 002_convolutional
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 152, 152)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 002_convolutional for ONNX tensor: 002_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 002_convolutional [Conv] outputs: [002_convolutional → (1, 64, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 002_convolutional_bn [BatchNormalization]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 002_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 002_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 002_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 002_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 002_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 002_convolutional_bn [BatchNormalization] inputs: [002_convolutional → (1, 64, 152, 152)], [002_convolutional_bn_scale → (64)], [002_convolutional_bn_bias → (64)], [002_convolutional_bn_mean → (64)], [002_convolutional_bn_var → (64)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 002_convolutional_bn for ONNX node: 002_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 002_convolutional_bn for ONNX tensor: 002_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 002_convolutional_bn [BatchNormalization] outputs: [002_convolutional_bn → (1, 64, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 002_convolutional_lrelu [LeakyRelu]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 002_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 002_convolutional_lrelu [LeakyRelu] inputs: [002_convolutional_bn → (1, 64, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 002_convolutional_lrelu for ONNX node: 002_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 002_convolutional_lrelu for ONNX tensor: 002_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 002_convolutional_lrelu [LeakyRelu] outputs: [002_convolutional_lrelu → (1, 64, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 003_convolutional [Conv]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 002_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 003_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 003_convolutional [Conv] inputs: [002_convolutional_lrelu → (1, 64, 152, 152)], [003_convolutional_conv_weights → (64, 64, 3, 3)],
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 152, 152)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 003_convolutional for ONNX node: 003_convolutional
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 152, 152)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 003_convolutional for ONNX tensor: 003_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 003_convolutional [Conv] outputs: [003_convolutional → (1, 64, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 003_convolutional_bn [BatchNormalization]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 003_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 003_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 003_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 003_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 003_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 003_convolutional_bn [BatchNormalization] inputs: [003_convolutional → (1, 64, 152, 152)], [003_convolutional_bn_scale → (64)], [003_convolutional_bn_bias → (64)], [003_convolutional_bn_mean → (64)], [003_convolutional_bn_var → (64)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 003_convolutional_bn for ONNX node: 003_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 003_convolutional_bn for ONNX tensor: 003_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 003_convolutional_bn [BatchNormalization] outputs: [003_convolutional_bn → (1, 64, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 003_convolutional_lrelu [LeakyRelu]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 003_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 003_convolutional_lrelu [LeakyRelu] inputs: [003_convolutional_bn → (1, 64, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 003_convolutional_lrelu for ONNX node: 003_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 003_convolutional_lrelu for ONNX tensor: 003_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 003_convolutional_lrelu [LeakyRelu] outputs: [003_convolutional_lrelu → (1, 64, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 004_route [Split]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 003_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 004_route [Split] inputs: [003_convolutional_lrelu → (1, 64, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 004_route for ONNX node: 004_route
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 004_route for ONNX node: 004_route
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 004_route_dummy0 for ONNX tensor: 004_route_dummy0
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 004_route for ONNX tensor: 004_route
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 004_route [Split] outputs: [004_route_dummy0 → (1, 32, 152, 152)], [004_route → (1, 32, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 005_convolutional [Conv]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 004_route
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 005_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 005_convolutional [Conv] inputs: [004_route → (1, 32, 152, 152)], [005_convolutional_conv_weights → (32, 32, 3, 3)],
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 32, 152, 152)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 005_convolutional for ONNX node: 005_convolutional
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 32, 152, 152)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 005_convolutional for ONNX tensor: 005_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 005_convolutional [Conv] outputs: [005_convolutional → (1, 32, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 005_convolutional_bn [BatchNormalization]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 005_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 005_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 005_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 005_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 005_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 005_convolutional_bn [BatchNormalization] inputs: [005_convolutional → (1, 32, 152, 152)], [005_convolutional_bn_scale → (32)], [005_convolutional_bn_bias → (32)], [005_convolutional_bn_mean → (32)], [005_convolutional_bn_var → (32)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 005_convolutional_bn for ONNX node: 005_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 005_convolutional_bn for ONNX tensor: 005_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 005_convolutional_bn [BatchNormalization] outputs: [005_convolutional_bn → (1, 32, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 005_convolutional_lrelu [LeakyRelu]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 005_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 005_convolutional_lrelu [LeakyRelu] inputs: [005_convolutional_bn → (1, 32, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 005_convolutional_lrelu for ONNX node: 005_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 005_convolutional_lrelu for ONNX tensor: 005_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 005_convolutional_lrelu [LeakyRelu] outputs: [005_convolutional_lrelu → (1, 32, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 006_convolutional [Conv]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 005_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 006_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 006_convolutional [Conv] inputs: [005_convolutional_lrelu → (1, 32, 152, 152)], [006_convolutional_conv_weights → (32, 32, 3, 3)],
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 32, 152, 152)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 006_convolutional for ONNX node: 006_convolutional
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 32, 152, 152)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 006_convolutional for ONNX tensor: 006_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 006_convolutional [Conv] outputs: [006_convolutional → (1, 32, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 006_convolutional_bn [BatchNormalization]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 006_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 006_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 006_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 006_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 006_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 006_convolutional_bn [BatchNormalization] inputs: [006_convolutional → (1, 32, 152, 152)], [006_convolutional_bn_scale → (32)], [006_convolutional_bn_bias → (32)], [006_convolutional_bn_mean → (32)], [006_convolutional_bn_var → (32)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 006_convolutional_bn for ONNX node: 006_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 006_convolutional_bn for ONNX tensor: 006_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 006_convolutional_bn [BatchNormalization] outputs: [006_convolutional_bn → (1, 32, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 006_convolutional_lrelu [LeakyRelu]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 006_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 006_convolutional_lrelu [LeakyRelu] inputs: [006_convolutional_bn → (1, 32, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 006_convolutional_lrelu for ONNX node: 006_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 006_convolutional_lrelu for ONNX tensor: 006_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 006_convolutional_lrelu [LeakyRelu] outputs: [006_convolutional_lrelu → (1, 32, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 007_route [Concat]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 006_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 005_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 007_route [Concat] inputs: [006_convolutional_lrelu → (1, 32, 152, 152)], [005_convolutional_lrelu → (1, 32, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 007_route for ONNX node: 007_route
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 007_route for ONNX tensor: 007_route
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 007_route [Concat] outputs: [007_route → (1, 64, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 008_convolutional [Conv]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 007_route
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 008_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 008_convolutional [Conv] inputs: [007_route → (1, 64, 152, 152)], [008_convolutional_conv_weights → (64, 64, 1, 1)],
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 152, 152)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 008_convolutional for ONNX node: 008_convolutional
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 152, 152)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 008_convolutional for ONNX tensor: 008_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 008_convolutional [Conv] outputs: [008_convolutional → (1, 64, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 008_convolutional_bn [BatchNormalization]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 008_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 008_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 008_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 008_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 008_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 008_convolutional_bn [BatchNormalization] inputs: [008_convolutional → (1, 64, 152, 152)], [008_convolutional_bn_scale → (64)], [008_convolutional_bn_bias → (64)], [008_convolutional_bn_mean → (64)], [008_convolutional_bn_var → (64)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 008_convolutional_bn for ONNX node: 008_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 008_convolutional_bn for ONNX tensor: 008_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 008_convolutional_bn [BatchNormalization] outputs: [008_convolutional_bn → (1, 64, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 008_convolutional_lrelu [LeakyRelu]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 008_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 008_convolutional_lrelu [LeakyRelu] inputs: [008_convolutional_bn → (1, 64, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 008_convolutional_lrelu for ONNX node: 008_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 008_convolutional_lrelu for ONNX tensor: 008_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 008_convolutional_lrelu [LeakyRelu] outputs: [008_convolutional_lrelu → (1, 64, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 009_route [Concat]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 003_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 008_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 009_route [Concat] inputs: [003_convolutional_lrelu → (1, 64, 152, 152)], [008_convolutional_lrelu → (1, 64, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 009_route for ONNX node: 009_route
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 009_route for ONNX tensor: 009_route
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 009_route [Concat] outputs: [009_route → (1, 128, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 010_maxpool [MaxPool]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 009_route
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 010_maxpool [MaxPool] inputs: [009_route → (1, 128, 152, 152)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 010_maxpool for ONNX node: 010_maxpool
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 010_maxpool for ONNX tensor: 010_maxpool
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 010_maxpool [MaxPool] outputs: [010_maxpool → (1, 128, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 011_convolutional [Conv]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 010_maxpool
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 011_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 011_convolutional [Conv] inputs: [010_maxpool → (1, 128, 76, 76)], [011_convolutional_conv_weights → (128, 128, 3, 3)],
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 128, 76, 76)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 011_convolutional for ONNX node: 011_convolutional
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 128, 76, 76)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 011_convolutional for ONNX tensor: 011_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 011_convolutional [Conv] outputs: [011_convolutional → (1, 128, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 011_convolutional_bn [BatchNormalization]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 011_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 011_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 011_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 011_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 011_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 011_convolutional_bn [BatchNormalization] inputs: [011_convolutional → (1, 128, 76, 76)], [011_convolutional_bn_scale → (128)], [011_convolutional_bn_bias → (128)], [011_convolutional_bn_mean → (128)], [011_convolutional_bn_var → (128)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 011_convolutional_bn for ONNX node: 011_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 011_convolutional_bn for ONNX tensor: 011_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 011_convolutional_bn [BatchNormalization] outputs: [011_convolutional_bn → (1, 128, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 011_convolutional_lrelu [LeakyRelu]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 011_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 011_convolutional_lrelu [LeakyRelu] inputs: [011_convolutional_bn → (1, 128, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 011_convolutional_lrelu for ONNX node: 011_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 011_convolutional_lrelu for ONNX tensor: 011_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 011_convolutional_lrelu [LeakyRelu] outputs: [011_convolutional_lrelu → (1, 128, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 012_route [Split]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 011_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 012_route [Split] inputs: [011_convolutional_lrelu → (1, 128, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 012_route for ONNX node: 012_route
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 012_route for ONNX node: 012_route
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 012_route_dummy0 for ONNX tensor: 012_route_dummy0
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 012_route for ONNX tensor: 012_route
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 012_route [Split] outputs: [012_route_dummy0 → (1, 64, 76, 76)], [012_route → (1, 64, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 013_convolutional [Conv]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 012_route
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 013_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 013_convolutional [Conv] inputs: [012_route → (1, 64, 76, 76)], [013_convolutional_conv_weights → (64, 64, 3, 3)],
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 76, 76)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 013_convolutional for ONNX node: 013_convolutional
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 76, 76)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 013_convolutional for ONNX tensor: 013_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 013_convolutional [Conv] outputs: [013_convolutional → (1, 64, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 013_convolutional_bn [BatchNormalization]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 013_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 013_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 013_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 013_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 013_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 013_convolutional_bn [BatchNormalization] inputs: [013_convolutional → (1, 64, 76, 76)], [013_convolutional_bn_scale → (64)], [013_convolutional_bn_bias → (64)], [013_convolutional_bn_mean → (64)], [013_convolutional_bn_var → (64)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 013_convolutional_bn for ONNX node: 013_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 013_convolutional_bn for ONNX tensor: 013_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 013_convolutional_bn [BatchNormalization] outputs: [013_convolutional_bn → (1, 64, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 013_convolutional_lrelu [LeakyRelu]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 013_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 013_convolutional_lrelu [LeakyRelu] inputs: [013_convolutional_bn → (1, 64, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 013_convolutional_lrelu for ONNX node: 013_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 013_convolutional_lrelu for ONNX tensor: 013_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 013_convolutional_lrelu [LeakyRelu] outputs: [013_convolutional_lrelu → (1, 64, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 014_convolutional [Conv]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 013_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 014_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 014_convolutional [Conv] inputs: [013_convolutional_lrelu → (1, 64, 76, 76)], [014_convolutional_conv_weights → (64, 64, 3, 3)],
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 76, 76)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 014_convolutional for ONNX node: 014_convolutional
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 76, 76)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 014_convolutional for ONNX tensor: 014_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 014_convolutional [Conv] outputs: [014_convolutional → (1, 64, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 014_convolutional_bn [BatchNormalization]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 014_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 014_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 014_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 014_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 014_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 014_convolutional_bn [BatchNormalization] inputs: [014_convolutional → (1, 64, 76, 76)], [014_convolutional_bn_scale → (64)], [014_convolutional_bn_bias → (64)], [014_convolutional_bn_mean → (64)], [014_convolutional_bn_var → (64)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 014_convolutional_bn for ONNX node: 014_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 014_convolutional_bn for ONNX tensor: 014_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 014_convolutional_bn [BatchNormalization] outputs: [014_convolutional_bn → (1, 64, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 014_convolutional_lrelu [LeakyRelu]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 014_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 014_convolutional_lrelu [LeakyRelu] inputs: [014_convolutional_bn → (1, 64, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 014_convolutional_lrelu for ONNX node: 014_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 014_convolutional_lrelu for ONNX tensor: 014_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 014_convolutional_lrelu [LeakyRelu] outputs: [014_convolutional_lrelu → (1, 64, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 015_route [Concat]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 014_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 013_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 015_route [Concat] inputs: [014_convolutional_lrelu → (1, 64, 76, 76)], [013_convolutional_lrelu → (1, 64, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 015_route for ONNX node: 015_route
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 015_route for ONNX tensor: 015_route
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 015_route [Concat] outputs: [015_route → (1, 128, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 016_convolutional [Conv]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 015_route
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 016_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 016_convolutional [Conv] inputs: [015_route → (1, 128, 76, 76)], [016_convolutional_conv_weights → (128, 128, 1, 1)],
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 128, 76, 76)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 016_convolutional for ONNX node: 016_convolutional
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 128, 76, 76)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 016_convolutional for ONNX tensor: 016_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 016_convolutional [Conv] outputs: [016_convolutional → (1, 128, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 016_convolutional_bn [BatchNormalization]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 016_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 016_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 016_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 016_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 016_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 016_convolutional_bn [BatchNormalization] inputs: [016_convolutional → (1, 128, 76, 76)], [016_convolutional_bn_scale → (128)], [016_convolutional_bn_bias → (128)], [016_convolutional_bn_mean → (128)], [016_convolutional_bn_var → (128)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 016_convolutional_bn for ONNX node: 016_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 016_convolutional_bn for ONNX tensor: 016_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 016_convolutional_bn [BatchNormalization] outputs: [016_convolutional_bn → (1, 128, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 016_convolutional_lrelu [LeakyRelu]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 016_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 016_convolutional_lrelu [LeakyRelu] inputs: [016_convolutional_bn → (1, 128, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 016_convolutional_lrelu for ONNX node: 016_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 016_convolutional_lrelu for ONNX tensor: 016_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 016_convolutional_lrelu [LeakyRelu] outputs: [016_convolutional_lrelu → (1, 128, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 017_route [Concat]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 011_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 016_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 017_route [Concat] inputs: [011_convolutional_lrelu → (1, 128, 76, 76)], [016_convolutional_lrelu → (1, 128, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 017_route for ONNX node: 017_route
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 017_route for ONNX tensor: 017_route
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 017_route [Concat] outputs: [017_route → (1, 256, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 018_maxpool [MaxPool]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 017_route
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 018_maxpool [MaxPool] inputs: [017_route → (1, 256, 76, 76)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 018_maxpool for ONNX node: 018_maxpool
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 018_maxpool for ONNX tensor: 018_maxpool
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 018_maxpool [MaxPool] outputs: [018_maxpool → (1, 256, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 019_convolutional [Conv]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 018_maxpool
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 019_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 019_convolutional [Conv] inputs: [018_maxpool → (1, 256, 38, 38)], [019_convolutional_conv_weights → (256, 256, 3, 3)],
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 38, 38)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 019_convolutional for ONNX node: 019_convolutional
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 38, 38)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 019_convolutional for ONNX tensor: 019_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 019_convolutional [Conv] outputs: [019_convolutional → (1, 256, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 019_convolutional_bn [BatchNormalization]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 019_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 019_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 019_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 019_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 019_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 019_convolutional_bn [BatchNormalization] inputs: [019_convolutional → (1, 256, 38, 38)], [019_convolutional_bn_scale → (256)], [019_convolutional_bn_bias → (256)], [019_convolutional_bn_mean → (256)], [019_convolutional_bn_var → (256)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 019_convolutional_bn for ONNX node: 019_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 019_convolutional_bn for ONNX tensor: 019_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 019_convolutional_bn [BatchNormalization] outputs: [019_convolutional_bn → (1, 256, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 019_convolutional_lrelu [LeakyRelu]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 019_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 019_convolutional_lrelu [LeakyRelu] inputs: [019_convolutional_bn → (1, 256, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 019_convolutional_lrelu for ONNX node: 019_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 019_convolutional_lrelu for ONNX tensor: 019_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 019_convolutional_lrelu [LeakyRelu] outputs: [019_convolutional_lrelu → (1, 256, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 020_route [Split]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 019_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 020_route [Split] inputs: [019_convolutional_lrelu → (1, 256, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 020_route for ONNX node: 020_route
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 020_route for ONNX node: 020_route
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 020_route_dummy0 for ONNX tensor: 020_route_dummy0
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 020_route for ONNX tensor: 020_route
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 020_route [Split] outputs: [020_route_dummy0 → (1, 128, 38, 38)], [020_route → (1, 128, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 021_convolutional [Conv]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 020_route
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 021_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 021_convolutional [Conv] inputs: [020_route → (1, 128, 38, 38)], [021_convolutional_conv_weights → (128, 128, 3, 3)],
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 128, 38, 38)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 021_convolutional for ONNX node: 021_convolutional
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 128, 38, 38)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 021_convolutional for ONNX tensor: 021_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 021_convolutional [Conv] outputs: [021_convolutional → (1, 128, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 021_convolutional_bn [BatchNormalization]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 021_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 021_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 021_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 021_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 021_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 021_convolutional_bn [BatchNormalization] inputs: [021_convolutional → (1, 128, 38, 38)], [021_convolutional_bn_scale → (128)], [021_convolutional_bn_bias → (128)], [021_convolutional_bn_mean → (128)], [021_convolutional_bn_var → (128)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 021_convolutional_bn for ONNX node: 021_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 021_convolutional_bn for ONNX tensor: 021_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 021_convolutional_bn [BatchNormalization] outputs: [021_convolutional_bn → (1, 128, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 021_convolutional_lrelu [LeakyRelu]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 021_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 021_convolutional_lrelu [LeakyRelu] inputs: [021_convolutional_bn → (1, 128, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 021_convolutional_lrelu for ONNX node: 021_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 021_convolutional_lrelu for ONNX tensor: 021_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 021_convolutional_lrelu [LeakyRelu] outputs: [021_convolutional_lrelu → (1, 128, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 022_convolutional [Conv]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 021_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 022_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 022_convolutional [Conv] inputs: [021_convolutional_lrelu → (1, 128, 38, 38)], [022_convolutional_conv_weights → (128, 128, 3, 3)],
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 128, 38, 38)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 022_convolutional for ONNX node: 022_convolutional
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 128, 38, 38)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 022_convolutional for ONNX tensor: 022_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 022_convolutional [Conv] outputs: [022_convolutional → (1, 128, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 022_convolutional_bn [BatchNormalization]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 022_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 022_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 022_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 022_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 022_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 022_convolutional_bn [BatchNormalization] inputs: [022_convolutional → (1, 128, 38, 38)], [022_convolutional_bn_scale → (128)], [022_convolutional_bn_bias → (128)], [022_convolutional_bn_mean → (128)], [022_convolutional_bn_var → (128)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 022_convolutional_bn for ONNX node: 022_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 022_convolutional_bn for ONNX tensor: 022_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 022_convolutional_bn [BatchNormalization] outputs: [022_convolutional_bn → (1, 128, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 022_convolutional_lrelu [LeakyRelu]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 022_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 022_convolutional_lrelu [LeakyRelu] inputs: [022_convolutional_bn → (1, 128, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 022_convolutional_lrelu for ONNX node: 022_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 022_convolutional_lrelu for ONNX tensor: 022_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 022_convolutional_lrelu [LeakyRelu] outputs: [022_convolutional_lrelu → (1, 128, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 023_route [Concat]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 022_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 021_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 023_route [Concat] inputs: [022_convolutional_lrelu → (1, 128, 38, 38)], [021_convolutional_lrelu → (1, 128, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 023_route for ONNX node: 023_route
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 023_route for ONNX tensor: 023_route
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 023_route [Concat] outputs: [023_route → (1, 256, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 024_convolutional [Conv]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 023_route
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 024_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 024_convolutional [Conv] inputs: [023_route → (1, 256, 38, 38)], [024_convolutional_conv_weights → (256, 256, 1, 1)],
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 38, 38)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 024_convolutional for ONNX node: 024_convolutional
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 38, 38)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 024_convolutional for ONNX tensor: 024_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 024_convolutional [Conv] outputs: [024_convolutional → (1, 256, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 024_convolutional_bn [BatchNormalization]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 024_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 024_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 024_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 024_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 024_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 024_convolutional_bn [BatchNormalization] inputs: [024_convolutional → (1, 256, 38, 38)], [024_convolutional_bn_scale → (256)], [024_convolutional_bn_bias → (256)], [024_convolutional_bn_mean → (256)], [024_convolutional_bn_var → (256)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 024_convolutional_bn for ONNX node: 024_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 024_convolutional_bn for ONNX tensor: 024_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 024_convolutional_bn [BatchNormalization] outputs: [024_convolutional_bn → (1, 256, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 024_convolutional_lrelu [LeakyRelu]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 024_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 024_convolutional_lrelu [LeakyRelu] inputs: [024_convolutional_bn → (1, 256, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 024_convolutional_lrelu for ONNX node: 024_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 024_convolutional_lrelu for ONNX tensor: 024_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 024_convolutional_lrelu [LeakyRelu] outputs: [024_convolutional_lrelu → (1, 256, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 025_route [Concat]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 019_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 024_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 025_route [Concat] inputs: [019_convolutional_lrelu → (1, 256, 38, 38)], [024_convolutional_lrelu → (1, 256, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 025_route for ONNX node: 025_route
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 025_route for ONNX tensor: 025_route
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 025_route [Concat] outputs: [025_route → (1, 512, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 026_maxpool [MaxPool]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 025_route
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 026_maxpool [MaxPool] inputs: [025_route → (1, 512, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 026_maxpool for ONNX node: 026_maxpool
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 026_maxpool for ONNX tensor: 026_maxpool
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 026_maxpool [MaxPool] outputs: [026_maxpool → (1, 512, 19, 19)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 027_convolutional [Conv]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 026_maxpool
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 027_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 027_convolutional [Conv] inputs: [026_maxpool → (1, 512, 19, 19)], [027_convolutional_conv_weights → (512, 512, 3, 3)],
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 512, 19, 19)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 027_convolutional for ONNX node: 027_convolutional
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 512, 19, 19)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 027_convolutional for ONNX tensor: 027_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 027_convolutional [Conv] outputs: [027_convolutional → (1, 512, 19, 19)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 027_convolutional_bn [BatchNormalization]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 027_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 027_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 027_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 027_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 027_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 027_convolutional_bn [BatchNormalization] inputs: [027_convolutional → (1, 512, 19, 19)], [027_convolutional_bn_scale → (512)], [027_convolutional_bn_bias → (512)], [027_convolutional_bn_mean → (512)], [027_convolutional_bn_var → (512)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 027_convolutional_bn for ONNX node: 027_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 027_convolutional_bn for ONNX tensor: 027_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 027_convolutional_bn [BatchNormalization] outputs: [027_convolutional_bn → (1, 512, 19, 19)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 027_convolutional_lrelu [LeakyRelu]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 027_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 027_convolutional_lrelu [LeakyRelu] inputs: [027_convolutional_bn → (1, 512, 19, 19)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 027_convolutional_lrelu for ONNX node: 027_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 027_convolutional_lrelu for ONNX tensor: 027_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 027_convolutional_lrelu [LeakyRelu] outputs: [027_convolutional_lrelu → (1, 512, 19, 19)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 028_convolutional [Conv]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 027_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 028_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 028_convolutional [Conv] inputs: [027_convolutional_lrelu → (1, 512, 19, 19)], [028_convolutional_conv_weights → (256, 512, 1, 1)],
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 512, 19, 19)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 028_convolutional for ONNX node: 028_convolutional
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 19, 19)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 028_convolutional for ONNX tensor: 028_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 028_convolutional [Conv] outputs: [028_convolutional → (1, 256, 19, 19)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 028_convolutional_bn [BatchNormalization]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 028_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 028_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 028_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 028_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 028_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 028_convolutional_bn [BatchNormalization] inputs: [028_convolutional → (1, 256, 19, 19)], [028_convolutional_bn_scale → (256)], [028_convolutional_bn_bias → (256)], [028_convolutional_bn_mean → (256)], [028_convolutional_bn_var → (256)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 028_convolutional_bn for ONNX node: 028_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 028_convolutional_bn for ONNX tensor: 028_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 028_convolutional_bn [BatchNormalization] outputs: [028_convolutional_bn → (1, 256, 19, 19)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 028_convolutional_lrelu [LeakyRelu]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 028_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 028_convolutional_lrelu [LeakyRelu] inputs: [028_convolutional_bn → (1, 256, 19, 19)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 028_convolutional_lrelu for ONNX node: 028_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 028_convolutional_lrelu for ONNX tensor: 028_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 028_convolutional_lrelu [LeakyRelu] outputs: [028_convolutional_lrelu → (1, 256, 19, 19)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 029_convolutional [Conv]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 028_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 029_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 029_convolutional [Conv] inputs: [028_convolutional_lrelu → (1, 256, 19, 19)], [029_convolutional_conv_weights → (512, 256, 3, 3)],
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 19, 19)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 029_convolutional for ONNX node: 029_convolutional
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 512, 19, 19)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 029_convolutional for ONNX tensor: 029_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 029_convolutional [Conv] outputs: [029_convolutional → (1, 512, 19, 19)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 029_convolutional_bn [BatchNormalization]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 029_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 029_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 029_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 029_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 029_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 029_convolutional_bn [BatchNormalization] inputs: [029_convolutional → (1, 512, 19, 19)], [029_convolutional_bn_scale → (512)], [029_convolutional_bn_bias → (512)], [029_convolutional_bn_mean → (512)], [029_convolutional_bn_var → (512)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 029_convolutional_bn for ONNX node: 029_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 029_convolutional_bn for ONNX tensor: 029_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 029_convolutional_bn [BatchNormalization] outputs: [029_convolutional_bn → (1, 512, 19, 19)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 029_convolutional_lrelu [LeakyRelu]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 029_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 029_convolutional_lrelu [LeakyRelu] inputs: [029_convolutional_bn → (1, 512, 19, 19)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 029_convolutional_lrelu for ONNX node: 029_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 029_convolutional_lrelu for ONNX tensor: 029_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 029_convolutional_lrelu [LeakyRelu] outputs: [029_convolutional_lrelu → (1, 512, 19, 19)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 030_convolutional [Conv]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 029_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 030_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 030_convolutional_conv_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 030_convolutional [Conv] inputs: [029_convolutional_lrelu → (1, 512, 19, 19)], [030_convolutional_conv_weights → (18, 512, 1, 1)], [030_convolutional_conv_bias → (18)],
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 512, 19, 19)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 030_convolutional for ONNX node: 030_convolutional
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 18
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 18, 19, 19)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 030_convolutional_1 for ONNX tensor: 030_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 030_convolutional [Conv] outputs: [030_convolutional → (1, 18, 19, 19)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 033_convolutional [Conv]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 028_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 033_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 033_convolutional [Conv] inputs: [028_convolutional_lrelu → (1, 256, 19, 19)], [033_convolutional_conv_weights → (128, 256, 1, 1)],
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 19, 19)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 033_convolutional for ONNX node: 033_convolutional
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 128, 19, 19)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 033_convolutional for ONNX tensor: 033_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 033_convolutional [Conv] outputs: [033_convolutional → (1, 128, 19, 19)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 033_convolutional_bn [BatchNormalization]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 033_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 033_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 033_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 033_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 033_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 033_convolutional_bn [BatchNormalization] inputs: [033_convolutional → (1, 128, 19, 19)], [033_convolutional_bn_scale → (128)], [033_convolutional_bn_bias → (128)], [033_convolutional_bn_mean → (128)], [033_convolutional_bn_var → (128)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 033_convolutional_bn for ONNX node: 033_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 033_convolutional_bn for ONNX tensor: 033_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 033_convolutional_bn [BatchNormalization] outputs: [033_convolutional_bn → (1, 128, 19, 19)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 033_convolutional_lrelu [LeakyRelu]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 033_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 033_convolutional_lrelu [LeakyRelu] inputs: [033_convolutional_bn → (1, 128, 19, 19)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 033_convolutional_lrelu for ONNX node: 033_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 033_convolutional_lrelu for ONNX tensor: 033_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 033_convolutional_lrelu [LeakyRelu] outputs: [033_convolutional_lrelu → (1, 128, 19, 19)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 034_upsample [Upsample]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 033_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 034_upsample_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 034_upsample [Upsample] inputs: [033_convolutional_lrelu → (1, 128, 19, 19)], [034_upsample_scale → (4)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 034_upsample for ONNX node: 034_upsample
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 034_upsample for ONNX tensor: 034_upsample
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 034_upsample [Upsample] outputs: [034_upsample → (1, 128, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 035_route [Concat]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 034_upsample
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 024_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 035_route [Concat] inputs: [034_upsample → (1, 128, 38, 38)], [024_convolutional_lrelu → (1, 256, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 035_route for ONNX node: 035_route
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 035_route for ONNX tensor: 035_route
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 035_route [Concat] outputs: [035_route → (1, 384, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 036_convolutional [Conv]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 035_route
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 036_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 036_convolutional [Conv] inputs: [035_route → (1, 384, 38, 38)], [036_convolutional_conv_weights → (256, 384, 3, 3)],
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 384, 38, 38)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 036_convolutional for ONNX node: 036_convolutional
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 38, 38)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 036_convolutional for ONNX tensor: 036_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 036_convolutional [Conv] outputs: [036_convolutional → (1, 256, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 036_convolutional_bn [BatchNormalization]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 036_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 036_convolutional_bn_scale
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 036_convolutional_bn_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 036_convolutional_bn_mean
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 036_convolutional_bn_var
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 036_convolutional_bn [BatchNormalization] inputs: [036_convolutional → (1, 256, 38, 38)], [036_convolutional_bn_scale → (256)], [036_convolutional_bn_bias → (256)], [036_convolutional_bn_mean → (256)], [036_convolutional_bn_var → (256)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 036_convolutional_bn for ONNX node: 036_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 036_convolutional_bn for ONNX tensor: 036_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 036_convolutional_bn [BatchNormalization] outputs: [036_convolutional_bn → (1, 256, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 036_convolutional_lrelu [LeakyRelu]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 036_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 036_convolutional_lrelu [LeakyRelu] inputs: [036_convolutional_bn → (1, 256, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 036_convolutional_lrelu for ONNX node: 036_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 036_convolutional_lrelu for ONNX tensor: 036_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 036_convolutional_lrelu [LeakyRelu] outputs: [036_convolutional_lrelu → (1, 256, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:103: Parsing node: 037_convolutional [Conv]
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 036_convolutional_lrelu
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 037_convolutional_conv_weights
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:119: Searching for input: 037_convolutional_conv_bias
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:125: 037_convolutional [Conv] inputs: [036_convolutional_lrelu → (1, 256, 38, 38)], [037_convolutional_conv_weights → (18, 256, 1, 1)], [037_convolutional_conv_bias → (18)],
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 38, 38)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:141: Registering layer: 037_convolutional for ONNX node: 037_convolutional
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 18
[04/27/2021-11:25:37] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 18, 38, 38)
[04/27/2021-11:25:37] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 037_convolutional_1 for ONNX tensor: 037_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:179: 037_convolutional [Conv] outputs: [037_convolutional → (1, 18, 38, 38)],
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:507: Marking 030_convolutional_1 as output: 030_convolutional
[04/27/2021-11:25:37] [V] [TRT] ModelImporter.cpp:507: Marking 037_convolutional_1 as output: 037_convolutional
----- Parsing of ONNX model custom-yolov4-tiny_human1-608.onnx is Done ----
[04/27/2021-11:25:37] [V] [TRT] Applying generic optimizations to the graph for inference.
[04/27/2021-11:25:37] [V] [TRT] Original: 73 layers
[04/27/2021-11:25:37] [V] [TRT] After dead-layer removal: 73 layers
[04/27/2021-11:25:37] [V] [TRT] After Myelin optimization: 73 layers
[04/27/2021-11:25:37] [V] [TRT] Fusing convolution weights from 001_convolutional with scale 001_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] Fusing convolution weights from 002_convolutional with scale 002_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] Fusing convolution weights from 003_convolutional with scale 003_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] Fusing convolution weights from 005_convolutional with scale 005_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] Fusing convolution weights from 006_convolutional with scale 006_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] Fusing convolution weights from 008_convolutional with scale 008_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] Fusing convolution weights from 011_convolutional with scale 011_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] Fusing convolution weights from 013_convolutional with scale 013_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] Fusing convolution weights from 014_convolutional with scale 014_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] Fusing convolution weights from 016_convolutional with scale 016_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] Fusing convolution weights from 019_convolutional with scale 019_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] Fusing convolution weights from 021_convolutional with scale 021_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] Fusing convolution weights from 022_convolutional with scale 022_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] Fusing convolution weights from 024_convolutional with scale 024_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] Fusing convolution weights from 027_convolutional with scale 027_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] Fusing convolution weights from 028_convolutional with scale 028_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] Fusing convolution weights from 033_convolutional with scale 033_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] Fusing convolution weights from 029_convolutional with scale 029_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] Fusing convolution weights from 036_convolutional with scale 036_convolutional_bn
[04/27/2021-11:25:37] [V] [TRT] After scale fusion: 54 layers
[04/27/2021-11:25:37] [V] [TRT] After vertical fusions: 54 layers
[04/27/2021-11:25:37] [V] [TRT] After final dead-layer removal: 54 layers
[04/27/2021-11:25:37] [V] [TRT] After tensor merging: 54 layers
[04/27/2021-11:25:37] [V] [TRT] Replacing slice 004_route_1 with copy from 003_convolutional_lrelu to 004_route
[04/27/2021-11:25:37] [V] [TRT] Replacing slice 012_route_1 with copy from 011_convolutional_lrelu to 012_route
[04/27/2021-11:25:37] [V] [TRT] Replacing slice 020_route_1 with copy from 019_convolutional_lrelu to 020_route
[04/27/2021-11:25:37] [V] [TRT] Eliminating concatenation 007_route
[04/27/2021-11:25:37] [V] [TRT] Retargeting 006_convolutional_lrelu to 007_route
[04/27/2021-11:25:37] [V] [TRT] Retargeting 005_convolutional_lrelu to 007_route
[04/27/2021-11:25:37] [V] [TRT] Eliminating concatenation 009_route
[04/27/2021-11:25:37] [V] [TRT] Generating copy for 003_convolutional_lrelu to 009_route
[04/27/2021-11:25:37] [V] [TRT] Retargeting 008_convolutional_lrelu to 009_route
[04/27/2021-11:25:37] [V] [TRT] Eliminating concatenation 015_route
[04/27/2021-11:25:37] [V] [TRT] Retargeting 014_convolutional_lrelu to 015_route
[04/27/2021-11:25:37] [V] [TRT] Retargeting 013_convolutional_lrelu to 015_route
[04/27/2021-11:25:37] [V] [TRT] Eliminating concatenation 017_route
[04/27/2021-11:25:37] [V] [TRT] Generating copy for 011_convolutional_lrelu to 017_route
[04/27/2021-11:25:37] [V] [TRT] Retargeting 016_convolutional_lrelu to 017_route
[04/27/2021-11:25:37] [V] [TRT] Eliminating concatenation 023_route
[04/27/2021-11:25:37] [V] [TRT] Retargeting 022_convolutional_lrelu to 023_route
[04/27/2021-11:25:37] [V] [TRT] Retargeting 021_convolutional_lrelu to 023_route
[04/27/2021-11:25:37] [V] [TRT] Eliminating concatenation 025_route
[04/27/2021-11:25:37] [V] [TRT] Generating copy for 019_convolutional_lrelu to 025_route
[04/27/2021-11:25:37] [V] [TRT] Retargeting 024_convolutional_lrelu to 025_route
[04/27/2021-11:25:37] [V] [TRT] Eliminating concatenation 035_route
[04/27/2021-11:25:37] [V] [TRT] Generating copy for 034_upsample to 035_route
[04/27/2021-11:25:37] [V] [TRT] Generating copy for 025_route to 035_route
[04/27/2021-11:25:37] [V] [TRT] After concat removal: 52 layers
[04/27/2021-11:25:37] [V] [TRT] Graph construction and optimization completed in 0.0651334 seconds.
[04/27/2021-11:25:42] [E] [TRT] …/rtSafe/safeRuntime.cpp (25) - Cuda Error in allocate: 2 (out of memory)
[04/27/2021-11:25:42] [E] [TRT] …/rtSafe/safeRuntime.cpp (25) - Cuda Error in allocate: 2 (out of memory)
[04/27/2021-11:25:42] [E] Engine creation failed
[04/27/2021-11:25:42] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=custom-yolov4-tiny_human1-608.onnx --explicitBatch --saveEngine=custom-yolov4-tiny_human1-608.engine --workspace=4096 --fp16 --verbose

siddhusiddhartha25 · April 27, 2021, 7:46am

Thank you Sir, I got this memory error solved.

In this link, after the engine creation, they asked us to run the make file in nvdsinfer_custom_impl_Yolo directory. After running the make command , it is showing the error.
siddhu2041@linux:/opt/nvidia/deepstream/deepstream-5.1/sources/objectDetector_Yolo/nvdsinfer_custom_impl_Yolo$ CUDA_VER=10.0 make
make: *** No rule to make target ‘libnvdsinfer_custom_impl_Yolo.so’, needed by ‘TARGET_LIB’. Stop.

how to solve this error Sir. Please help me to solve this error. Thanks in Advance.

AastaLLL · April 29, 2021, 4:32am

Hi,

Please try below command instead:

CUDA_VER=10.2 make

Thanks.

DeepStream

Input filename: custom-yolov4-tiny_human1-608.onnx ONNX IR version: 0.0.4 Opset version: 9 Producer name: NVIDIA TensorRT sample Producer version: Domain: Model version: 0 Doc string:

Input filename: custom-yolov4-tiny_human1-608.onnx ONNX IR version: 0.0.4 Opset version: 9 Producer name: NVIDIA TensorRT sample Producer version: Domain: Model version: 0 Doc string:

Input filename: custom-yolov4-tiny_human1-608.onnx
ONNX IR version: 0.0.4
Opset version: 9
Producer name: NVIDIA TensorRT sample
Producer version:
Domain:
Model version: 0
Doc string:

Input filename: custom-yolov4-tiny_human1-608.onnx
ONNX IR version: 0.0.4
Opset version: 9
Producer name: NVIDIA TensorRT sample
Producer version:
Domain:
Model version: 0
Doc string: