&&&& RUNNING TensorRT.trtexec [TensorRT v8401] # trtexec --verbose --nvtxMode=verbose --buildOnly --workspace=8192 --onnx=0.pth.onnx --saveEngine=0.pth.onnx.engine --timingCacheFile=./timing.cache --profilingVerbosity=detailed --fp16 --int8 [01/13/2023-08:20:23] [W] --workspace flag has been deprecated by --memPoolSize flag. [01/13/2023-08:20:23] [W] --nvtxMode flag has been deprecated by --profilingVerbosity flag. [01/13/2023-08:20:23] [I] === Model Options === [01/13/2023-08:20:23] [I] Format: ONNX [01/13/2023-08:20:23] [I] Model: 0.pth.onnx [01/13/2023-08:20:23] [I] Output: [01/13/2023-08:20:23] [I] === Build Options === [01/13/2023-08:20:23] [I] Max batch: explicit batch [01/13/2023-08:20:23] [I] Memory Pools: workspace: 8192 MiB, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default [01/13/2023-08:20:23] [I] minTiming: 1 [01/13/2023-08:20:23] [I] avgTiming: 8 [01/13/2023-08:20:23] [I] Precision: FP32+FP16+INT8 [01/13/2023-08:20:23] [I] LayerPrecisions: [01/13/2023-08:20:23] [I] Calibration: Dynamic [01/13/2023-08:20:23] [I] Refit: Disabled [01/13/2023-08:20:23] [I] Sparsity: Disabled [01/13/2023-08:20:23] [I] Safe mode: Disabled [01/13/2023-08:20:23] [I] DirectIO mode: Disabled [01/13/2023-08:20:23] [I] Restricted mode: Disabled [01/13/2023-08:20:23] [I] Build only: Enabled [01/13/2023-08:20:23] [I] Save engine: 0.pth.onnx.engine [01/13/2023-08:20:23] [I] Load engine: [01/13/2023-08:20:23] [I] Profiling verbosity: 2 [01/13/2023-08:20:23] [I] Tactic sources: Using default tactic sources [01/13/2023-08:20:23] [I] timingCacheMode: global [01/13/2023-08:20:23] [I] timingCacheFile: ./timing.cache [01/13/2023-08:20:23] [I] Input(s)s format: fp32:CHW [01/13/2023-08:20:23] [I] Output(s)s format: fp32:CHW [01/13/2023-08:20:23] [I] Input build shapes: model [01/13/2023-08:20:23] [I] Input calibration shapes: model [01/13/2023-08:20:23] [I] === System Options === [01/13/2023-08:20:23] [I] Device: 0 [01/13/2023-08:20:23] [I] DLACore: [01/13/2023-08:20:23] [I] Plugins: [01/13/2023-08:20:23] [I] === Inference Options === [01/13/2023-08:20:23] [I] Batch: Explicit [01/13/2023-08:20:23] [I] Input inference shapes: model [01/13/2023-08:20:23] [I] Iterations: 10 [01/13/2023-08:20:23] [I] Duration: 3s (+ 200ms warm up) [01/13/2023-08:20:23] [I] Sleep time: 0ms [01/13/2023-08:20:23] [I] Idle time: 0ms [01/13/2023-08:20:23] [I] Streams: 1 [01/13/2023-08:20:23] [I] ExposeDMA: Disabled [01/13/2023-08:20:23] [I] Data transfers: Enabled [01/13/2023-08:20:23] [I] Spin-wait: Disabled [01/13/2023-08:20:23] [I] Multithreading: Disabled [01/13/2023-08:20:23] [I] CUDA Graph: Disabled [01/13/2023-08:20:23] [I] Separate profiling: Disabled [01/13/2023-08:20:23] [I] Time Deserialize: Disabled [01/13/2023-08:20:23] [I] Time Refit: Disabled [01/13/2023-08:20:23] [I] Inputs: [01/13/2023-08:20:23] [I] === Reporting Options === [01/13/2023-08:20:23] [I] Verbose: Enabled [01/13/2023-08:20:23] [I] Averages: 10 inferences [01/13/2023-08:20:23] [I] Percentile: 99 [01/13/2023-08:20:23] [I] Dump refittable layers:Disabled [01/13/2023-08:20:23] [I] Dump output: Disabled [01/13/2023-08:20:23] [I] Profile: Disabled [01/13/2023-08:20:23] [I] Export timing to JSON file: [01/13/2023-08:20:23] [I] Export output to JSON file: [01/13/2023-08:20:23] [I] Export profile to JSON file: [01/13/2023-08:20:23] [I] [01/13/2023-08:20:23] [I] === Device Information === [01/13/2023-08:20:23] [I] Selected Device: Orin [01/13/2023-08:20:23] [I] Compute Capability: 8.7 [01/13/2023-08:20:23] [I] SMs: 16 [01/13/2023-08:20:23] [I] Compute Clock Rate: 1.3 GHz [01/13/2023-08:20:23] [I] Device Global Memory: 30535 MiB [01/13/2023-08:20:23] [I] Shared Memory per SM: 164 KiB [01/13/2023-08:20:23] [I] Memory Bus Width: 128 bits (ECC disabled) [01/13/2023-08:20:23] [I] Memory Clock Rate: 1.3 GHz [01/13/2023-08:20:23] [I] [01/13/2023-08:20:23] [I] TensorRT version: 8.4.1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::ScatterND version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::BatchTilePlugin_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::CropAndResizeDynamic version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::EfficientNMS_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::EfficientNMS_Explicit_TF_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::EfficientNMS_Implicit_TF_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::ProposalDynamic version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::Proposal version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::Split version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 2 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::CoordConvAC version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::DecodeBbox3DPlugin version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::GenerateDetection_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::MultilevelCropAndResize_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::MultilevelProposeROI_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::NMSDynamic_TRT version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::PillarScatterPlugin version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::VoxelGeneratorPlugin version 1 [01/13/2023-08:20:23] [V] [TRT] Registered plugin creator - ::MultiscaleDeformableAttnPlugin_TRT version 1 [01/13/2023-08:20:24] [I] [TRT] [MemUsageChange] Init CUDA: CPU +218, GPU +0, now: CPU 242, GPU 8988 (MiB) [01/13/2023-08:20:26] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +351, GPU +329, now: CPU 612, GPU 9332 (MiB) [01/13/2023-08:20:26] [I] Start parsing network model [01/13/2023-08:20:26] [I] [TRT] ---------------------------------------------------------------- [01/13/2023-08:20:26] [I] [TRT] Input filename: 0.pth.onnx [01/13/2023-08:20:26] [I] [TRT] ONNX IR version: 0.0.6 [01/13/2023-08:20:26] [I] [TRT] Opset version: 13 [01/13/2023-08:20:26] [I] [TRT] Producer name: pytorch [01/13/2023-08:20:26] [I] [TRT] Producer version: 1.10 [01/13/2023-08:20:26] [I] [TRT] Domain: [01/13/2023-08:20:26] [I] [TRT] Model version: 0 [01/13/2023-08:20:26] [I] [TRT] Doc string: [01/13/2023-08:20:26] [I] [TRT] ---------------------------------------------------------------- [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::ScatterND version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::BatchTilePlugin_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::CropAndResizeDynamic version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::EfficientNMS_Explicit_TF_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::EfficientNMS_Implicit_TF_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::ProposalDynamic version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::Proposal version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::Split version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 2 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::CoordConvAC version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::DecodeBbox3DPlugin version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::GenerateDetection_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::MultilevelCropAndResize_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::MultilevelProposeROI_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::NMSDynamic_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::PillarScatterPlugin version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::VoxelGeneratorPlugin version 1 [01/13/2023-08:20:26] [V] [TRT] Plugin creator already registered - ::MultiscaleDeformableAttnPlugin_TRT version 1 [01/13/2023-08:20:26] [V] [TRT] Adding network input: inputs.1 with dtype: float32, dimensions: (1, 3, 256, 304) [01/13/2023-08:20:26] [V] [TRT] Registering tensor: inputs.1 for ONNX tensor: inputs.1 [01/13/2023-08:20:26] [V] [TRT] Importing initializer: conv1.weight [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn1.weight [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn1.bias [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn1.running_mean [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn1.running_var [01/13/2023-08:20:26] [V] [TRT] Importing initializer: conv21.weight [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn21.weight [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn21.bias [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn21.running_mean [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn21.running_var [01/13/2023-08:20:26] [V] [TRT] Importing initializer: conv22.weight [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn22.weight [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn22.bias [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn22.running_mean [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn22.running_var [01/13/2023-08:20:26] [V] [TRT] Importing initializer: conv23.weight [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn23.weight [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn23.bias [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn23.running_mean [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn23.running_var [01/13/2023-08:20:26] [V] [TRT] Importing initializer: conv2.weight [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn2.weight [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn2.bias [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn2.running_mean [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn2.running_var [01/13/2023-08:20:26] [V] [TRT] Importing initializer: conv31.weight [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn31.weight [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn31.bias [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn31.running_mean [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn31.running_var [01/13/2023-08:20:26] [V] [TRT] Importing initializer: conv32.weight [01/13/2023-08:20:26] [V] [TRT] Importing initializer: conv311.weight [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn311.weight [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn311.bias [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn311.running_mean [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn311.running_var [01/13/2023-08:20:26] [V] [TRT] Importing initializer: conv321.weight [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn321.weight [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn321.bias [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn321.running_mean [01/13/2023-08:20:26] [V] [TRT] Importing initializer: bn321.running_var [01/13/2023-08:20:26] [V] [TRT] Importing initializer: conv_class.weight [01/13/2023-08:20:26] [V] [TRT] Importing initializer: 225 [01/13/2023-08:20:26] [V] [TRT] Importing initializer: 226 [01/13/2023-08:20:26] [V] [TRT] Importing initializer: 227 [01/13/2023-08:20:26] [V] [TRT] Importing initializer: 228 [01/13/2023-08:20:26] [V] [TRT] Importing initializer: 229 [01/13/2023-08:20:26] [V] [TRT] Importing initializer: 230 [01/13/2023-08:20:26] [V] [TRT] Importing initializer: 231 [01/13/2023-08:20:26] [V] [TRT] Importing initializer: 232 [01/13/2023-08:20:26] [V] [TRT] Importing initializer: 233 [01/13/2023-08:20:26] [V] [TRT] Importing initializer: 234 [01/13/2023-08:20:26] [V] [TRT] Importing initializer: 238 [01/13/2023-08:20:26] [W] [TRT] onnx2trt_utils.cpp:367: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32. [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_0 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_0 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_0 [Constant] outputs: [58 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_1 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_1 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_1 [Constant] outputs: [59 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_2 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: inputs.1 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 58 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 59 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_2 [QuantizeLinear] inputs: [inputs.1 -> (1, 3, 256, 304)[FLOAT]], [58 -> ()[FLOAT]], [59 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 58 for ONNX node: 58 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 59 for ONNX node: 59 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 60 for ONNX tensor: 60 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_2 [QuantizeLinear] outputs: [60 -> (1, 3, 256, 304)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_3 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_3 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_3 [Constant] outputs: [61 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_4 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_4 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_4 [Constant] outputs: [62 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_5 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 60 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 61 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 62 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_5 [DequantizeLinear] inputs: [60 -> (1, 3, 256, 304)[FLOAT]], [61 -> ()[FLOAT]], [62 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 61 for ONNX node: 61 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 62 for ONNX node: 62 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 63 for ONNX tensor: 63 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_5 [DequantizeLinear] outputs: [63 -> (1, 3, 256, 304)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_6 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_6 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_6 [Constant] outputs: [64 -> (16)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_7 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: conv1.weight [01/13/2023-08:20:26] [V] [TRT] Searching for input: 64 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 225 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_7 [QuantizeLinear] inputs: [conv1.weight -> (16, 3, 7, 7)[FLOAT]], [64 -> (16)[FLOAT]], [225 -> (16)[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: conv1.weight for ONNX node: conv1.weight [01/13/2023-08:20:26] [V] [TRT] Registering layer: 64 for ONNX node: 64 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 225 for ONNX node: 225 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 67 for ONNX tensor: 67 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_7 [QuantizeLinear] outputs: [67 -> (16, 3, 7, 7)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_8 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 67 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 64 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 225 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_8 [DequantizeLinear] inputs: [67 -> (16, 3, 7, 7)[FLOAT]], [64 -> (16)[FLOAT]], [225 -> (16)[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 68 for ONNX tensor: 68 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_8 [DequantizeLinear] outputs: [68 -> (16, 3, 7, 7)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Conv_9 [Conv] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 63 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 68 [01/13/2023-08:20:26] [V] [TRT] Conv_9 [Conv] inputs: [63 -> (1, 3, 256, 304)[FLOAT]], [68 -> (16, 3, 7, 7)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Convolution input dimensions: (1, 3, 256, 304) [01/13/2023-08:20:26] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [01/13/2023-08:20:26] [V] [TRT] Registering layer: Conv_9 for ONNX node: Conv_9 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 69 for ONNX tensor: 69 [01/13/2023-08:20:26] [V] [TRT] Conv_9 [Conv] outputs: [69 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: BatchNormalization_10 [BatchNormalization] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 69 [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn1.weight [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn1.bias [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn1.running_mean [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn1.running_var [01/13/2023-08:20:26] [V] [TRT] BatchNormalization_10 [BatchNormalization] inputs: [69 -> (1, 16, 128, 152)[FLOAT]], [bn1.weight -> (16)[FLOAT]], [bn1.bias -> (16)[FLOAT]], [bn1.running_mean -> (16)[FLOAT]], [bn1.running_var -> (16)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: BatchNormalization_10 for ONNX node: BatchNormalization_10 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 70 for ONNX tensor: 70 [01/13/2023-08:20:26] [V] [TRT] BatchNormalization_10 [BatchNormalization] outputs: [70 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Relu_11 [Relu] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 70 [01/13/2023-08:20:26] [V] [TRT] Relu_11 [Relu] inputs: [70 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: Relu_11 for ONNX node: Relu_11 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 71 for ONNX tensor: 71 [01/13/2023-08:20:26] [V] [TRT] Relu_11 [Relu] outputs: [71 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_12 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_12 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_12 [Constant] outputs: [72 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_13 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_13 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_13 [Constant] outputs: [73 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_14 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 71 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 72 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 73 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_14 [QuantizeLinear] inputs: [71 -> (1, 16, 128, 152)[FLOAT]], [72 -> ()[FLOAT]], [73 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 72 for ONNX node: 72 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 73 for ONNX node: 73 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 74 for ONNX tensor: 74 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_14 [QuantizeLinear] outputs: [74 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_15 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_15 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_15 [Constant] outputs: [75 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_16 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_16 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_16 [Constant] outputs: [76 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_17 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 74 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 75 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 76 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_17 [DequantizeLinear] inputs: [74 -> (1, 16, 128, 152)[FLOAT]], [75 -> ()[FLOAT]], [76 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 75 for ONNX node: 75 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 76 for ONNX node: 76 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 77 for ONNX tensor: 77 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_17 [DequantizeLinear] outputs: [77 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_18 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_18 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_18 [Constant] outputs: [78 -> (32)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_19 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: conv21.weight [01/13/2023-08:20:26] [V] [TRT] Searching for input: 78 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 226 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_19 [QuantizeLinear] inputs: [conv21.weight -> (32, 16, 1, 1)[FLOAT]], [78 -> (32)[FLOAT]], [226 -> (32)[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: conv21.weight for ONNX node: conv21.weight [01/13/2023-08:20:26] [V] [TRT] Registering layer: 78 for ONNX node: 78 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 226 for ONNX node: 226 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 81 for ONNX tensor: 81 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_19 [QuantizeLinear] outputs: [81 -> (32, 16, 1, 1)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_20 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 81 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 78 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 226 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_20 [DequantizeLinear] inputs: [81 -> (32, 16, 1, 1)[FLOAT]], [78 -> (32)[FLOAT]], [226 -> (32)[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 82 for ONNX tensor: 82 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_20 [DequantizeLinear] outputs: [82 -> (32, 16, 1, 1)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Conv_21 [Conv] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 77 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 82 [01/13/2023-08:20:26] [V] [TRT] Conv_21 [Conv] inputs: [77 -> (1, 16, 128, 152)[FLOAT]], [82 -> (32, 16, 1, 1)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Convolution input dimensions: (1, 16, 128, 152) [01/13/2023-08:20:26] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [01/13/2023-08:20:26] [V] [TRT] Registering layer: Conv_21 for ONNX node: Conv_21 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 83 for ONNX tensor: 83 [01/13/2023-08:20:26] [V] [TRT] Conv_21 [Conv] outputs: [83 -> (1, 32, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: BatchNormalization_22 [BatchNormalization] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 83 [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn21.weight [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn21.bias [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn21.running_mean [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn21.running_var [01/13/2023-08:20:26] [V] [TRT] BatchNormalization_22 [BatchNormalization] inputs: [83 -> (1, 32, 128, 152)[FLOAT]], [bn21.weight -> (32)[FLOAT]], [bn21.bias -> (32)[FLOAT]], [bn21.running_mean -> (32)[FLOAT]], [bn21.running_var -> (32)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: BatchNormalization_22 for ONNX node: BatchNormalization_22 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 84 for ONNX tensor: 84 [01/13/2023-08:20:26] [V] [TRT] BatchNormalization_22 [BatchNormalization] outputs: [84 -> (1, 32, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Relu_23 [Relu] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 84 [01/13/2023-08:20:26] [V] [TRT] Relu_23 [Relu] inputs: [84 -> (1, 32, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: Relu_23 for ONNX node: Relu_23 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 85 for ONNX tensor: 85 [01/13/2023-08:20:26] [V] [TRT] Relu_23 [Relu] outputs: [85 -> (1, 32, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_24 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_24 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_24 [Constant] outputs: [86 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_25 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_25 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_25 [Constant] outputs: [87 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_26 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 85 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 86 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 87 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_26 [QuantizeLinear] inputs: [85 -> (1, 32, 128, 152)[FLOAT]], [86 -> ()[FLOAT]], [87 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 86 for ONNX node: 86 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 87 for ONNX node: 87 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 88 for ONNX tensor: 88 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_26 [QuantizeLinear] outputs: [88 -> (1, 32, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_27 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_27 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_27 [Constant] outputs: [89 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_28 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_28 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_28 [Constant] outputs: [90 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_29 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 88 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 89 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 90 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_29 [DequantizeLinear] inputs: [88 -> (1, 32, 128, 152)[FLOAT]], [89 -> ()[FLOAT]], [90 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 89 for ONNX node: 89 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 90 for ONNX node: 90 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 91 for ONNX tensor: 91 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_29 [DequantizeLinear] outputs: [91 -> (1, 32, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_30 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_30 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_30 [Constant] outputs: [92 -> (32)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_31 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: conv22.weight [01/13/2023-08:20:26] [V] [TRT] Searching for input: 92 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 227 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_31 [QuantizeLinear] inputs: [conv22.weight -> (32, 32, 3, 3)[FLOAT]], [92 -> (32)[FLOAT]], [227 -> (32)[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: conv22.weight for ONNX node: conv22.weight [01/13/2023-08:20:26] [V] [TRT] Registering layer: 92 for ONNX node: 92 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 227 for ONNX node: 227 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 95 for ONNX tensor: 95 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_31 [QuantizeLinear] outputs: [95 -> (32, 32, 3, 3)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_32 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 95 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 92 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 227 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_32 [DequantizeLinear] inputs: [95 -> (32, 32, 3, 3)[FLOAT]], [92 -> (32)[FLOAT]], [227 -> (32)[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 96 for ONNX tensor: 96 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_32 [DequantizeLinear] outputs: [96 -> (32, 32, 3, 3)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Conv_33 [Conv] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 91 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 96 [01/13/2023-08:20:26] [V] [TRT] Conv_33 [Conv] inputs: [91 -> (1, 32, 128, 152)[FLOAT]], [96 -> (32, 32, 3, 3)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Convolution input dimensions: (1, 32, 128, 152) [01/13/2023-08:20:26] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [01/13/2023-08:20:26] [V] [TRT] Registering layer: Conv_33 for ONNX node: Conv_33 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 97 for ONNX tensor: 97 [01/13/2023-08:20:26] [V] [TRT] Conv_33 [Conv] outputs: [97 -> (1, 32, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: BatchNormalization_34 [BatchNormalization] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 97 [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn22.weight [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn22.bias [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn22.running_mean [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn22.running_var [01/13/2023-08:20:26] [V] [TRT] BatchNormalization_34 [BatchNormalization] inputs: [97 -> (1, 32, 128, 152)[FLOAT]], [bn22.weight -> (32)[FLOAT]], [bn22.bias -> (32)[FLOAT]], [bn22.running_mean -> (32)[FLOAT]], [bn22.running_var -> (32)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: BatchNormalization_34 for ONNX node: BatchNormalization_34 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 98 for ONNX tensor: 98 [01/13/2023-08:20:26] [V] [TRT] BatchNormalization_34 [BatchNormalization] outputs: [98 -> (1, 32, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Relu_35 [Relu] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 98 [01/13/2023-08:20:26] [V] [TRT] Relu_35 [Relu] inputs: [98 -> (1, 32, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: Relu_35 for ONNX node: Relu_35 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 99 for ONNX tensor: 99 [01/13/2023-08:20:26] [V] [TRT] Relu_35 [Relu] outputs: [99 -> (1, 32, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_36 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_36 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_36 [Constant] outputs: [100 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_37 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_37 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_37 [Constant] outputs: [101 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_38 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 99 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 100 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 101 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_38 [QuantizeLinear] inputs: [99 -> (1, 32, 128, 152)[FLOAT]], [100 -> ()[FLOAT]], [101 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 100 for ONNX node: 100 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 101 for ONNX node: 101 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 102 for ONNX tensor: 102 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_38 [QuantizeLinear] outputs: [102 -> (1, 32, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_39 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_39 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_39 [Constant] outputs: [103 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_40 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_40 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_40 [Constant] outputs: [104 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_41 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 102 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 103 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 104 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_41 [DequantizeLinear] inputs: [102 -> (1, 32, 128, 152)[FLOAT]], [103 -> ()[FLOAT]], [104 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 103 for ONNX node: 103 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 104 for ONNX node: 104 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 105 for ONNX tensor: 105 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_41 [DequantizeLinear] outputs: [105 -> (1, 32, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_42 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_42 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_42 [Constant] outputs: [106 -> (16)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_43 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: conv23.weight [01/13/2023-08:20:26] [V] [TRT] Searching for input: 106 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 228 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_43 [QuantizeLinear] inputs: [conv23.weight -> (16, 32, 1, 1)[FLOAT]], [106 -> (16)[FLOAT]], [228 -> (16)[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: conv23.weight for ONNX node: conv23.weight [01/13/2023-08:20:26] [V] [TRT] Registering layer: 106 for ONNX node: 106 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 228 for ONNX node: 228 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 109 for ONNX tensor: 109 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_43 [QuantizeLinear] outputs: [109 -> (16, 32, 1, 1)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_44 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 109 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 106 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 228 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_44 [DequantizeLinear] inputs: [109 -> (16, 32, 1, 1)[FLOAT]], [106 -> (16)[FLOAT]], [228 -> (16)[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 110 for ONNX tensor: 110 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_44 [DequantizeLinear] outputs: [110 -> (16, 32, 1, 1)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Conv_45 [Conv] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 105 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 110 [01/13/2023-08:20:26] [V] [TRT] Conv_45 [Conv] inputs: [105 -> (1, 32, 128, 152)[FLOAT]], [110 -> (16, 32, 1, 1)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Convolution input dimensions: (1, 32, 128, 152) [01/13/2023-08:20:26] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [01/13/2023-08:20:26] [V] [TRT] Registering layer: Conv_45 for ONNX node: Conv_45 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 111 for ONNX tensor: 111 [01/13/2023-08:20:26] [V] [TRT] Conv_45 [Conv] outputs: [111 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: BatchNormalization_46 [BatchNormalization] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 111 [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn23.weight [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn23.bias [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn23.running_mean [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn23.running_var [01/13/2023-08:20:26] [V] [TRT] BatchNormalization_46 [BatchNormalization] inputs: [111 -> (1, 16, 128, 152)[FLOAT]], [bn23.weight -> (16)[FLOAT]], [bn23.bias -> (16)[FLOAT]], [bn23.running_mean -> (16)[FLOAT]], [bn23.running_var -> (16)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: BatchNormalization_46 for ONNX node: BatchNormalization_46 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 112 for ONNX tensor: 112 [01/13/2023-08:20:26] [V] [TRT] BatchNormalization_46 [BatchNormalization] outputs: [112 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Relu_47 [Relu] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 112 [01/13/2023-08:20:26] [V] [TRT] Relu_47 [Relu] inputs: [112 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: Relu_47 for ONNX node: Relu_47 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 113 for ONNX tensor: 113 [01/13/2023-08:20:26] [V] [TRT] Relu_47 [Relu] outputs: [113 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_48 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_48 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_48 [Constant] outputs: [114 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_49 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_49 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_49 [Constant] outputs: [115 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_50 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 71 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 114 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 115 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_50 [QuantizeLinear] inputs: [71 -> (1, 16, 128, 152)[FLOAT]], [114 -> ()[FLOAT]], [115 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 114 for ONNX node: 114 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 115 for ONNX node: 115 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 116 for ONNX tensor: 116 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_50 [QuantizeLinear] outputs: [116 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_51 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_51 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_51 [Constant] outputs: [117 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_52 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_52 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_52 [Constant] outputs: [118 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_53 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 116 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 117 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 118 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_53 [DequantizeLinear] inputs: [116 -> (1, 16, 128, 152)[FLOAT]], [117 -> ()[FLOAT]], [118 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 117 for ONNX node: 117 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 118 for ONNX node: 118 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 119 for ONNX tensor: 119 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_53 [DequantizeLinear] outputs: [119 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_54 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_54 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_54 [Constant] outputs: [120 -> (16)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_55 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: conv2.weight [01/13/2023-08:20:26] [V] [TRT] Searching for input: 120 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 229 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_55 [QuantizeLinear] inputs: [conv2.weight -> (16, 16, 1, 1)[FLOAT]], [120 -> (16)[FLOAT]], [229 -> (16)[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: conv2.weight for ONNX node: conv2.weight [01/13/2023-08:20:26] [V] [TRT] Registering layer: 120 for ONNX node: 120 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 229 for ONNX node: 229 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 123 for ONNX tensor: 123 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_55 [QuantizeLinear] outputs: [123 -> (16, 16, 1, 1)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_56 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 123 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 120 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 229 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_56 [DequantizeLinear] inputs: [123 -> (16, 16, 1, 1)[FLOAT]], [120 -> (16)[FLOAT]], [229 -> (16)[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 124 for ONNX tensor: 124 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_56 [DequantizeLinear] outputs: [124 -> (16, 16, 1, 1)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Conv_57 [Conv] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 119 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 124 [01/13/2023-08:20:26] [V] [TRT] Conv_57 [Conv] inputs: [119 -> (1, 16, 128, 152)[FLOAT]], [124 -> (16, 16, 1, 1)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Convolution input dimensions: (1, 16, 128, 152) [01/13/2023-08:20:26] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [01/13/2023-08:20:26] [V] [TRT] Registering layer: Conv_57 for ONNX node: Conv_57 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 125 for ONNX tensor: 125 [01/13/2023-08:20:26] [V] [TRT] Conv_57 [Conv] outputs: [125 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: BatchNormalization_58 [BatchNormalization] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 125 [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn2.weight [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn2.bias [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn2.running_mean [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn2.running_var [01/13/2023-08:20:26] [V] [TRT] BatchNormalization_58 [BatchNormalization] inputs: [125 -> (1, 16, 128, 152)[FLOAT]], [bn2.weight -> (16)[FLOAT]], [bn2.bias -> (16)[FLOAT]], [bn2.running_mean -> (16)[FLOAT]], [bn2.running_var -> (16)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: BatchNormalization_58 for ONNX node: BatchNormalization_58 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 126 for ONNX tensor: 126 [01/13/2023-08:20:26] [V] [TRT] BatchNormalization_58 [BatchNormalization] outputs: [126 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Relu_59 [Relu] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 126 [01/13/2023-08:20:26] [V] [TRT] Relu_59 [Relu] inputs: [126 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: Relu_59 for ONNX node: Relu_59 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 127 for ONNX tensor: 127 [01/13/2023-08:20:26] [V] [TRT] Relu_59 [Relu] outputs: [127 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_60 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_60 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_60 [Constant] outputs: [128 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_61 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_61 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_61 [Constant] outputs: [129 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_62 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 127 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 128 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 129 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_62 [QuantizeLinear] inputs: [127 -> (1, 16, 128, 152)[FLOAT]], [128 -> ()[FLOAT]], [129 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 128 for ONNX node: 128 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 129 for ONNX node: 129 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 130 for ONNX tensor: 130 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_62 [QuantizeLinear] outputs: [130 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_63 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_63 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_63 [Constant] outputs: [131 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_64 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_64 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_64 [Constant] outputs: [132 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_65 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 130 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 131 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 132 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_65 [DequantizeLinear] inputs: [130 -> (1, 16, 128, 152)[FLOAT]], [131 -> ()[FLOAT]], [132 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 131 for ONNX node: 131 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 132 for ONNX node: 132 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 133 for ONNX tensor: 133 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_65 [DequantizeLinear] outputs: [133 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Add_66 [Add] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 113 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 133 [01/13/2023-08:20:26] [V] [TRT] Add_66 [Add] inputs: [113 -> (1, 16, 128, 152)[FLOAT]], [133 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: Add_66 for ONNX node: Add_66 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 134 for ONNX tensor: 134 [01/13/2023-08:20:26] [V] [TRT] Add_66 [Add] outputs: [134 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Relu_67 [Relu] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 134 [01/13/2023-08:20:26] [V] [TRT] Relu_67 [Relu] inputs: [134 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: Relu_67 for ONNX node: Relu_67 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 135 for ONNX tensor: 135 [01/13/2023-08:20:26] [V] [TRT] Relu_67 [Relu] outputs: [135 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_68 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_68 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_68 [Constant] outputs: [136 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_69 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_69 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_69 [Constant] outputs: [137 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_70 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 135 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 136 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 137 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_70 [QuantizeLinear] inputs: [135 -> (1, 16, 128, 152)[FLOAT]], [136 -> ()[FLOAT]], [137 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 136 for ONNX node: 136 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 137 for ONNX node: 137 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 138 for ONNX tensor: 138 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_70 [QuantizeLinear] outputs: [138 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_71 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_71 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_71 [Constant] outputs: [139 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_72 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_72 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_72 [Constant] outputs: [140 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_73 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 138 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 139 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 140 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_73 [DequantizeLinear] inputs: [138 -> (1, 16, 128, 152)[FLOAT]], [139 -> ()[FLOAT]], [140 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 139 for ONNX node: 139 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 140 for ONNX node: 140 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 141 for ONNX tensor: 141 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_73 [DequantizeLinear] outputs: [141 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_74 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_74 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_74 [Constant] outputs: [142 -> (64)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_75 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: conv31.weight [01/13/2023-08:20:26] [V] [TRT] Searching for input: 142 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 230 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_75 [QuantizeLinear] inputs: [conv31.weight -> (64, 16, 3, 3)[FLOAT]], [142 -> (64)[FLOAT]], [230 -> (64)[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: conv31.weight for ONNX node: conv31.weight [01/13/2023-08:20:26] [V] [TRT] Registering layer: 142 for ONNX node: 142 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 230 for ONNX node: 230 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 145 for ONNX tensor: 145 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_75 [QuantizeLinear] outputs: [145 -> (64, 16, 3, 3)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_76 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 145 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 142 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 230 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_76 [DequantizeLinear] inputs: [145 -> (64, 16, 3, 3)[FLOAT]], [142 -> (64)[FLOAT]], [230 -> (64)[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 146 for ONNX tensor: 146 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_76 [DequantizeLinear] outputs: [146 -> (64, 16, 3, 3)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Conv_77 [Conv] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 141 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 146 [01/13/2023-08:20:26] [V] [TRT] Conv_77 [Conv] inputs: [141 -> (1, 16, 128, 152)[FLOAT]], [146 -> (64, 16, 3, 3)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Convolution input dimensions: (1, 16, 128, 152) [01/13/2023-08:20:26] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [01/13/2023-08:20:26] [V] [TRT] Registering layer: Conv_77 for ONNX node: Conv_77 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 147 for ONNX tensor: 147 [01/13/2023-08:20:26] [V] [TRT] Conv_77 [Conv] outputs: [147 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: BatchNormalization_78 [BatchNormalization] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 147 [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn31.weight [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn31.bias [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn31.running_mean [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn31.running_var [01/13/2023-08:20:26] [V] [TRT] BatchNormalization_78 [BatchNormalization] inputs: [147 -> (1, 64, 63, 75)[FLOAT]], [bn31.weight -> (64)[FLOAT]], [bn31.bias -> (64)[FLOAT]], [bn31.running_mean -> (64)[FLOAT]], [bn31.running_var -> (64)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: BatchNormalization_78 for ONNX node: BatchNormalization_78 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 148 for ONNX tensor: 148 [01/13/2023-08:20:26] [V] [TRT] BatchNormalization_78 [BatchNormalization] outputs: [148 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Relu_79 [Relu] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 148 [01/13/2023-08:20:26] [V] [TRT] Relu_79 [Relu] inputs: [148 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: Relu_79 for ONNX node: Relu_79 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 149 for ONNX tensor: 149 [01/13/2023-08:20:26] [V] [TRT] Relu_79 [Relu] outputs: [149 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_80 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_80 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_80 [Constant] outputs: [150 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_81 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_81 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_81 [Constant] outputs: [151 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_82 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 149 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 150 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 151 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_82 [QuantizeLinear] inputs: [149 -> (1, 64, 63, 75)[FLOAT]], [150 -> ()[FLOAT]], [151 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 150 for ONNX node: 150 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 151 for ONNX node: 151 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 152 for ONNX tensor: 152 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_82 [QuantizeLinear] outputs: [152 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_83 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_83 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_83 [Constant] outputs: [153 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_84 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_84 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_84 [Constant] outputs: [154 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_85 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 152 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 153 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 154 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_85 [DequantizeLinear] inputs: [152 -> (1, 64, 63, 75)[FLOAT]], [153 -> ()[FLOAT]], [154 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 153 for ONNX node: 153 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 154 for ONNX node: 154 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 155 for ONNX tensor: 155 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_85 [DequantizeLinear] outputs: [155 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_86 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_86 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_86 [Constant] outputs: [156 -> (64)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_87 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: conv311.weight [01/13/2023-08:20:26] [V] [TRT] Searching for input: 156 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 231 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_87 [QuantizeLinear] inputs: [conv311.weight -> (64, 64, 1, 1)[FLOAT]], [156 -> (64)[FLOAT]], [231 -> (64)[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: conv311.weight for ONNX node: conv311.weight [01/13/2023-08:20:26] [V] [TRT] Registering layer: 156 for ONNX node: 156 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 231 for ONNX node: 231 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 159 for ONNX tensor: 159 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_87 [QuantizeLinear] outputs: [159 -> (64, 64, 1, 1)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_88 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 159 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 156 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 231 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_88 [DequantizeLinear] inputs: [159 -> (64, 64, 1, 1)[FLOAT]], [156 -> (64)[FLOAT]], [231 -> (64)[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 160 for ONNX tensor: 160 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_88 [DequantizeLinear] outputs: [160 -> (64, 64, 1, 1)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Conv_89 [Conv] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 155 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 160 [01/13/2023-08:20:26] [V] [TRT] Conv_89 [Conv] inputs: [155 -> (1, 64, 63, 75)[FLOAT]], [160 -> (64, 64, 1, 1)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Convolution input dimensions: (1, 64, 63, 75) [01/13/2023-08:20:26] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [01/13/2023-08:20:26] [V] [TRT] Registering layer: Conv_89 for ONNX node: Conv_89 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 161 for ONNX tensor: 161 [01/13/2023-08:20:26] [V] [TRT] Conv_89 [Conv] outputs: [161 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: BatchNormalization_90 [BatchNormalization] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 161 [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn311.weight [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn311.bias [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn311.running_mean [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn311.running_var [01/13/2023-08:20:26] [V] [TRT] BatchNormalization_90 [BatchNormalization] inputs: [161 -> (1, 64, 63, 75)[FLOAT]], [bn311.weight -> (64)[FLOAT]], [bn311.bias -> (64)[FLOAT]], [bn311.running_mean -> (64)[FLOAT]], [bn311.running_var -> (64)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: BatchNormalization_90 for ONNX node: BatchNormalization_90 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 162 for ONNX tensor: 162 [01/13/2023-08:20:26] [V] [TRT] BatchNormalization_90 [BatchNormalization] outputs: [162 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Relu_91 [Relu] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 162 [01/13/2023-08:20:26] [V] [TRT] Relu_91 [Relu] inputs: [162 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: Relu_91 for ONNX node: Relu_91 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 163 for ONNX tensor: 163 [01/13/2023-08:20:26] [V] [TRT] Relu_91 [Relu] outputs: [163 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_92 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_92 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_92 [Constant] outputs: [164 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_93 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_93 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_93 [Constant] outputs: [165 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_94 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 135 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 164 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 165 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_94 [QuantizeLinear] inputs: [135 -> (1, 16, 128, 152)[FLOAT]], [164 -> ()[FLOAT]], [165 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 164 for ONNX node: 164 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 165 for ONNX node: 165 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 166 for ONNX tensor: 166 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_94 [QuantizeLinear] outputs: [166 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_95 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_95 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_95 [Constant] outputs: [167 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_96 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_96 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_96 [Constant] outputs: [168 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_97 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 166 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 167 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 168 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_97 [DequantizeLinear] inputs: [166 -> (1, 16, 128, 152)[FLOAT]], [167 -> ()[FLOAT]], [168 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 167 for ONNX node: 167 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 168 for ONNX node: 168 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 169 for ONNX tensor: 169 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_97 [DequantizeLinear] outputs: [169 -> (1, 16, 128, 152)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_98 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_98 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_98 [Constant] outputs: [170 -> (64)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_99 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: conv32.weight [01/13/2023-08:20:26] [V] [TRT] Searching for input: 170 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 232 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_99 [QuantizeLinear] inputs: [conv32.weight -> (64, 16, 3, 3)[FLOAT]], [170 -> (64)[FLOAT]], [232 -> (64)[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: conv32.weight for ONNX node: conv32.weight [01/13/2023-08:20:26] [V] [TRT] Registering layer: 170 for ONNX node: 170 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 232 for ONNX node: 232 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 173 for ONNX tensor: 173 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_99 [QuantizeLinear] outputs: [173 -> (64, 16, 3, 3)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_100 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 173 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 170 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 232 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_100 [DequantizeLinear] inputs: [173 -> (64, 16, 3, 3)[FLOAT]], [170 -> (64)[FLOAT]], [232 -> (64)[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 174 for ONNX tensor: 174 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_100 [DequantizeLinear] outputs: [174 -> (64, 16, 3, 3)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Conv_101 [Conv] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 169 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 174 [01/13/2023-08:20:26] [V] [TRT] Conv_101 [Conv] inputs: [169 -> (1, 16, 128, 152)[FLOAT]], [174 -> (64, 16, 3, 3)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Convolution input dimensions: (1, 16, 128, 152) [01/13/2023-08:20:26] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [01/13/2023-08:20:26] [V] [TRT] Registering layer: Conv_101 for ONNX node: Conv_101 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 175 for ONNX tensor: 175 [01/13/2023-08:20:26] [V] [TRT] Conv_101 [Conv] outputs: [175 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Relu_102 [Relu] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 175 [01/13/2023-08:20:26] [V] [TRT] Relu_102 [Relu] inputs: [175 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: Relu_102 for ONNX node: Relu_102 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 176 for ONNX tensor: 176 [01/13/2023-08:20:26] [V] [TRT] Relu_102 [Relu] outputs: [176 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_103 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_103 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_103 [Constant] outputs: [177 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_104 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_104 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_104 [Constant] outputs: [178 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_105 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 176 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 177 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 178 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_105 [QuantizeLinear] inputs: [176 -> (1, 64, 63, 75)[FLOAT]], [177 -> ()[FLOAT]], [178 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 177 for ONNX node: 177 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 178 for ONNX node: 178 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 179 for ONNX tensor: 179 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_105 [QuantizeLinear] outputs: [179 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_106 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_106 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_106 [Constant] outputs: [180 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_107 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_107 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_107 [Constant] outputs: [181 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_108 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 179 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 180 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 181 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_108 [DequantizeLinear] inputs: [179 -> (1, 64, 63, 75)[FLOAT]], [180 -> ()[FLOAT]], [181 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 180 for ONNX node: 180 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 181 for ONNX node: 181 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 182 for ONNX tensor: 182 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_108 [DequantizeLinear] outputs: [182 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_109 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_109 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_109 [Constant] outputs: [183 -> (64)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_110 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: conv321.weight [01/13/2023-08:20:26] [V] [TRT] Searching for input: 183 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 233 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_110 [QuantizeLinear] inputs: [conv321.weight -> (64, 64, 1, 1)[FLOAT]], [183 -> (64)[FLOAT]], [233 -> (64)[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: conv321.weight for ONNX node: conv321.weight [01/13/2023-08:20:26] [V] [TRT] Registering layer: 183 for ONNX node: 183 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 233 for ONNX node: 233 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 186 for ONNX tensor: 186 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_110 [QuantizeLinear] outputs: [186 -> (64, 64, 1, 1)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_111 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 186 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 183 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 233 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_111 [DequantizeLinear] inputs: [186 -> (64, 64, 1, 1)[FLOAT]], [183 -> (64)[FLOAT]], [233 -> (64)[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 187 for ONNX tensor: 187 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_111 [DequantizeLinear] outputs: [187 -> (64, 64, 1, 1)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Conv_112 [Conv] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 182 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 187 [01/13/2023-08:20:26] [V] [TRT] Conv_112 [Conv] inputs: [182 -> (1, 64, 63, 75)[FLOAT]], [187 -> (64, 64, 1, 1)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Convolution input dimensions: (1, 64, 63, 75) [01/13/2023-08:20:26] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [01/13/2023-08:20:26] [V] [TRT] Registering layer: Conv_112 for ONNX node: Conv_112 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 188 for ONNX tensor: 188 [01/13/2023-08:20:26] [V] [TRT] Conv_112 [Conv] outputs: [188 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: BatchNormalization_113 [BatchNormalization] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 188 [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn321.weight [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn321.bias [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn321.running_mean [01/13/2023-08:20:26] [V] [TRT] Searching for input: bn321.running_var [01/13/2023-08:20:26] [V] [TRT] BatchNormalization_113 [BatchNormalization] inputs: [188 -> (1, 64, 63, 75)[FLOAT]], [bn321.weight -> (64)[FLOAT]], [bn321.bias -> (64)[FLOAT]], [bn321.running_mean -> (64)[FLOAT]], [bn321.running_var -> (64)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: BatchNormalization_113 for ONNX node: BatchNormalization_113 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 189 for ONNX tensor: 189 [01/13/2023-08:20:26] [V] [TRT] BatchNormalization_113 [BatchNormalization] outputs: [189 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Relu_114 [Relu] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 189 [01/13/2023-08:20:26] [V] [TRT] Relu_114 [Relu] inputs: [189 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: Relu_114 for ONNX node: Relu_114 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 190 for ONNX tensor: 190 [01/13/2023-08:20:26] [V] [TRT] Relu_114 [Relu] outputs: [190 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_115 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_115 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_115 [Constant] outputs: [191 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_116 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_116 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_116 [Constant] outputs: [192 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_117 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 190 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 191 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 192 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_117 [QuantizeLinear] inputs: [190 -> (1, 64, 63, 75)[FLOAT]], [191 -> ()[FLOAT]], [192 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 191 for ONNX node: 191 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 192 for ONNX node: 192 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 193 for ONNX tensor: 193 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_117 [QuantizeLinear] outputs: [193 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_118 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_118 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_118 [Constant] outputs: [194 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_119 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_119 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_119 [Constant] outputs: [195 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_120 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 193 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 194 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 195 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_120 [DequantizeLinear] inputs: [193 -> (1, 64, 63, 75)[FLOAT]], [194 -> ()[FLOAT]], [195 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 194 for ONNX node: 194 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 195 for ONNX node: 195 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 196 for ONNX tensor: 196 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_120 [DequantizeLinear] outputs: [196 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Add_121 [Add] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 163 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 196 [01/13/2023-08:20:26] [V] [TRT] Add_121 [Add] inputs: [163 -> (1, 64, 63, 75)[FLOAT]], [196 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: Add_121 for ONNX node: Add_121 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 197 for ONNX tensor: 197 [01/13/2023-08:20:26] [V] [TRT] Add_121 [Add] outputs: [197 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_122 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_122 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_122 [Constant] outputs: [198 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_123 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_123 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_123 [Constant] outputs: [199 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_124 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 197 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 198 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 199 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_124 [QuantizeLinear] inputs: [197 -> (1, 64, 63, 75)[FLOAT]], [198 -> ()[FLOAT]], [199 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 198 for ONNX node: 198 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 199 for ONNX node: 199 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 200 for ONNX tensor: 200 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_124 [QuantizeLinear] outputs: [200 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_125 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_125 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_125 [Constant] outputs: [201 -> ()[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_126 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_126 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_126 [Constant] outputs: [202 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_127 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 200 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 201 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 202 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_127 [DequantizeLinear] inputs: [200 -> (1, 64, 63, 75)[FLOAT]], [201 -> ()[FLOAT]], [202 -> ()[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 201 for ONNX node: 201 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 202 for ONNX node: 202 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 203 for ONNX tensor: 203 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_127 [DequantizeLinear] outputs: [203 -> (1, 64, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_128 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_128 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_128 [Constant] outputs: [204 -> (2)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: QuantizeLinear_129 [QuantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: conv_class.weight [01/13/2023-08:20:26] [V] [TRT] Searching for input: 204 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 234 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_129 [QuantizeLinear] inputs: [conv_class.weight -> (2, 64, 1, 1)[FLOAT]], [204 -> (2)[FLOAT]], [234 -> (2)[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: conv_class.weight for ONNX node: conv_class.weight [01/13/2023-08:20:26] [V] [TRT] Registering layer: 204 for ONNX node: 204 [01/13/2023-08:20:26] [V] [TRT] Registering layer: 234 for ONNX node: 234 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 207 for ONNX tensor: 207 [01/13/2023-08:20:26] [V] [TRT] QuantizeLinear_129 [QuantizeLinear] outputs: [207 -> (2, 64, 1, 1)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: DequantizeLinear_130 [DequantizeLinear] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 207 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 204 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 234 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_130 [DequantizeLinear] inputs: [207 -> (2, 64, 1, 1)[FLOAT]], [204 -> (2)[FLOAT]], [234 -> (2)[INT8]], [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 208 for ONNX tensor: 208 [01/13/2023-08:20:26] [V] [TRT] DequantizeLinear_130 [DequantizeLinear] outputs: [208 -> (2, 64, 1, 1)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Conv_131 [Conv] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 203 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 208 [01/13/2023-08:20:26] [V] [TRT] Conv_131 [Conv] inputs: [203 -> (1, 64, 63, 75)[FLOAT]], [208 -> (2, 64, 1, 1)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Convolution input dimensions: (1, 64, 63, 75) [01/13/2023-08:20:26] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [01/13/2023-08:20:26] [V] [TRT] Registering layer: Conv_131 for ONNX node: Conv_131 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 209 for ONNX tensor: 209 [01/13/2023-08:20:26] [V] [TRT] Conv_131 [Conv] outputs: [209 -> (1, 2, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Shape_132 [Shape] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 209 [01/13/2023-08:20:26] [V] [TRT] Shape_132 [Shape] inputs: [209 -> (1, 2, 63, 75)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: Shape_132 for ONNX node: Shape_132 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 215 for ONNX tensor: 215 [01/13/2023-08:20:26] [V] [TRT] Shape_132 [Shape] outputs: [215 -> (4)[INT32]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_133 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_133 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_133 [Constant] outputs: [216 -> (1)[INT32]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_134 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_134 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_134 [Constant] outputs: [217 -> (1)[INT32]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Constant_135 [Constant] [01/13/2023-08:20:26] [V] [TRT] Constant_135 [Constant] inputs: [01/13/2023-08:20:26] [V] [TRT] Constant_135 [Constant] outputs: [218 -> (1)[INT32]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Slice_136 [Slice] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 215 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 217 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 218 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 216 [01/13/2023-08:20:26] [V] [TRT] Slice_136 [Slice] inputs: [215 -> (4)[INT32]], [217 -> (1)[INT32]], [218 -> (1)[INT32]], [216 -> (1)[INT32]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: Slice_136 for ONNX node: Slice_136 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 219 for ONNX tensor: 219 [01/13/2023-08:20:26] [V] [TRT] Slice_136 [Slice] outputs: [219 -> (2)[INT32]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Concat_137 [Concat] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 219 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 238 [01/13/2023-08:20:26] [V] [TRT] Concat_137 [Concat] inputs: [219 -> (2)[INT32]], [238 -> (2)[INT32]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: 238 for ONNX node: 238 [01/13/2023-08:20:26] [V] [TRT] Registering layer: Concat_137 for ONNX node: Concat_137 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 221 for ONNX tensor: 221 [01/13/2023-08:20:26] [V] [TRT] Concat_137 [Concat] outputs: [221 -> (4)[INT32]], [01/13/2023-08:20:26] [V] [TRT] Parsing node: Resize_138 [Resize] [01/13/2023-08:20:26] [V] [TRT] Searching for input: 209 [01/13/2023-08:20:26] [V] [TRT] Searching for input: 221 [01/13/2023-08:20:26] [V] [TRT] Resize_138 [Resize] inputs: [209 -> (1, 2, 63, 75)[FLOAT]], [optional input, not set], [optional input, not set], [221 -> (4)[INT32]], [01/13/2023-08:20:26] [V] [TRT] Registering layer: Resize_138 for ONNX node: Resize_138 [01/13/2023-08:20:26] [V] [TRT] Registering tensor: 224_106 for ONNX tensor: 224 [01/13/2023-08:20:26] [V] [TRT] Resize_138 [Resize] outputs: [224 -> (1, 2, 256, 304)[FLOAT]], [01/13/2023-08:20:26] [V] [TRT] Marking 224_106 as output: 224 [01/13/2023-08:20:26] [I] Finish parsing network model [01/13/2023-08:20:26] [V] Trying to set exclusive file lock ./timing.cache.lock [01/13/2023-08:20:26] [V] File locked in 8.512e-06 seconds. [01/13/2023-08:20:26] [W] Could not read timing cache from: ./timing.cache. A new timing cache will be generated and written. [01/13/2023-08:20:26] [V] Trying to remove exclusive file lock ./timing.cache.lock [01/13/2023-08:20:26] [V] File unlocked in 6.112e-06 seconds. [01/13/2023-08:20:26] [W] [TRT] Calibrator won't be used in explicit precision mode. Use quantization aware training to generate network with Quantize/Dequantize nodes. [01/13/2023-08:20:26] [V] [TRT] Applying generic optimizations to the graph for inference. [01/13/2023-08:20:26] [V] [TRT] Original: 153 layers [01/13/2023-08:20:26] [V] [TRT] After dead-layer removal: 153 layers [01/13/2023-08:20:26] [V] [TRT] QDQ graph optimizer - constant folding of Q/DQ initializers [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_2 [01/13/2023-08:20:26] [V] [TRT] Removing 59 [01/13/2023-08:20:26] [V] [TRT] Removing 58 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_19 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_31 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_43 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_55 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_75 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_87 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_99 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_110 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_129 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_5 [01/13/2023-08:20:26] [V] [TRT] Removing 62 [01/13/2023-08:20:26] [V] [TRT] Removing 61 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_20 [01/13/2023-08:20:26] [V] [TRT] Removing 226 [01/13/2023-08:20:26] [V] [TRT] Removing 78 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_44 [01/13/2023-08:20:26] [V] [TRT] Removing 228 [01/13/2023-08:20:26] [V] [TRT] Removing 106 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_76 [01/13/2023-08:20:26] [V] [TRT] Removing 230 [01/13/2023-08:20:26] [V] [TRT] Removing 142 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_100 [01/13/2023-08:20:26] [V] [TRT] Removing 232 [01/13/2023-08:20:26] [V] [TRT] Removing 170 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_130 [01/13/2023-08:20:26] [V] [TRT] Removing 234 [01/13/2023-08:20:26] [V] [TRT] Removing 204 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_14 [01/13/2023-08:20:26] [V] [TRT] Removing 73 [01/13/2023-08:20:26] [V] [TRT] Removing 72 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_17 [01/13/2023-08:20:26] [V] [TRT] Removing 76 [01/13/2023-08:20:26] [V] [TRT] Removing 75 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_26 [01/13/2023-08:20:26] [V] [TRT] Removing 87 [01/13/2023-08:20:26] [V] [TRT] Removing 86 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_29 [01/13/2023-08:20:26] [V] [TRT] Removing 90 [01/13/2023-08:20:26] [V] [TRT] Removing 89 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_38 [01/13/2023-08:20:26] [V] [TRT] Removing 101 [01/13/2023-08:20:26] [V] [TRT] Removing 100 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_70 [01/13/2023-08:20:26] [V] [TRT] Removing 137 [01/13/2023-08:20:26] [V] [TRT] Removing 136 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_73 [01/13/2023-08:20:26] [V] [TRT] Removing 140 [01/13/2023-08:20:26] [V] [TRT] Removing 139 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_105 [01/13/2023-08:20:26] [V] [TRT] Removing 178 [01/13/2023-08:20:26] [V] [TRT] Removing 177 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_108 [01/13/2023-08:20:26] [V] [TRT] Removing 181 [01/13/2023-08:20:26] [V] [TRT] Removing 180 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_117 [01/13/2023-08:20:26] [V] [TRT] Removing 192 [01/13/2023-08:20:26] [V] [TRT] Removing 191 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_124 [01/13/2023-08:20:26] [V] [TRT] Removing 199 [01/13/2023-08:20:26] [V] [TRT] Removing 198 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_7 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_8 [01/13/2023-08:20:26] [V] [TRT] Removing 225 [01/13/2023-08:20:26] [V] [TRT] Removing 64 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_32 [01/13/2023-08:20:26] [V] [TRT] Removing 227 [01/13/2023-08:20:26] [V] [TRT] Removing 92 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_56 [01/13/2023-08:20:26] [V] [TRT] Removing 229 [01/13/2023-08:20:26] [V] [TRT] Removing 120 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_88 [01/13/2023-08:20:26] [V] [TRT] Removing 231 [01/13/2023-08:20:26] [V] [TRT] Removing 156 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_111 [01/13/2023-08:20:26] [V] [TRT] Removing 233 [01/13/2023-08:20:26] [V] [TRT] Removing 183 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_50 [01/13/2023-08:20:26] [V] [TRT] Removing 115 [01/13/2023-08:20:26] [V] [TRT] Removing 114 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_53 [01/13/2023-08:20:26] [V] [TRT] Removing 118 [01/13/2023-08:20:26] [V] [TRT] Removing 117 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_62 [01/13/2023-08:20:26] [V] [TRT] Removing 129 [01/13/2023-08:20:26] [V] [TRT] Removing 128 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_65 [01/13/2023-08:20:26] [V] [TRT] Removing 132 [01/13/2023-08:20:26] [V] [TRT] Removing 131 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_41 [01/13/2023-08:20:26] [V] [TRT] Removing 104 [01/13/2023-08:20:26] [V] [TRT] Removing 103 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_94 [01/13/2023-08:20:26] [V] [TRT] Removing 165 [01/13/2023-08:20:26] [V] [TRT] Removing 164 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_97 [01/13/2023-08:20:26] [V] [TRT] Removing 168 [01/13/2023-08:20:26] [V] [TRT] Removing 167 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on QuantizeLinear_82 [01/13/2023-08:20:26] [V] [TRT] Removing 151 [01/13/2023-08:20:26] [V] [TRT] Removing 150 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_85 [01/13/2023-08:20:26] [V] [TRT] Removing 154 [01/13/2023-08:20:26] [V] [TRT] Removing 153 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_120 [01/13/2023-08:20:26] [V] [TRT] Removing 195 [01/13/2023-08:20:26] [V] [TRT] Removing 194 [01/13/2023-08:20:26] [V] [TRT] Running: ConstQDQInitializersFusion on DequantizeLinear_127 [01/13/2023-08:20:26] [V] [TRT] Removing 202 [01/13/2023-08:20:26] [V] [TRT] Removing 201 [01/13/2023-08:20:26] [V] [TRT] After Myelin optimization: 85 layers [01/13/2023-08:20:26] [V] [TRT] QDQ graph optimizer - constant folding of Q/DQ initializers [01/13/2023-08:20:26] [V] [TRT] QDQ graph optimizer forward pass - DQ motions and fusions [01/13/2023-08:20:26] [V] [TRT] QDQ graph optimizer backward pass [01/13/2023-08:20:26] [V] [TRT] QDQ graph optimizer quantization pass - Generate quantized ops [01/13/2023-08:20:26] [V] [TRT] Running: EltReluFusion on Add_66 [01/13/2023-08:20:26] [V] [TRT] EltReluFusion: Fusing Add_66 with Relu_67 [01/13/2023-08:20:26] [V] [TRT] Running: ScaleActivationFusion on BatchNormalization_10 [01/13/2023-08:20:26] [V] [TRT] ScaleActivationFusion: Fusing BatchNormalization_10 with Relu_11 [01/13/2023-08:20:26] [V] [TRT] Running: ScaleActivationFusion on BatchNormalization_22 [01/13/2023-08:20:26] [V] [TRT] ScaleActivationFusion: Fusing BatchNormalization_22 with Relu_23 [01/13/2023-08:20:26] [V] [TRT] Running: ScaleActivationFusion on BatchNormalization_58 [01/13/2023-08:20:26] [V] [TRT] ScaleActivationFusion: Fusing BatchNormalization_58 with Relu_59 [01/13/2023-08:20:26] [V] [TRT] Running: ScaleActivationFusion on BatchNormalization_34 [01/13/2023-08:20:26] [V] [TRT] ScaleActivationFusion: Fusing BatchNormalization_34 with Relu_35 [01/13/2023-08:20:26] [V] [TRT] Running: ScaleActivationFusion on BatchNormalization_46 [01/13/2023-08:20:26] [V] [TRT] ScaleActivationFusion: Fusing BatchNormalization_46 with Relu_47 [01/13/2023-08:20:26] [V] [TRT] Running: ScaleActivationFusion on BatchNormalization_78 [01/13/2023-08:20:26] [V] [TRT] ScaleActivationFusion: Fusing BatchNormalization_78 with Relu_79 [01/13/2023-08:20:26] [V] [TRT] Running: ScaleActivationFusion on BatchNormalization_113 [01/13/2023-08:20:26] [V] [TRT] ScaleActivationFusion: Fusing BatchNormalization_113 with Relu_114 [01/13/2023-08:20:26] [V] [TRT] Running: ScaleActivationFusion on BatchNormalization_90 [01/13/2023-08:20:26] [V] [TRT] ScaleActivationFusion: Fusing BatchNormalization_90 with Relu_91 [01/13/2023-08:20:26] [V] [TRT] Running: ConstWeightsQuantizeFusion on conv1.weight [01/13/2023-08:20:26] [V] [TRT] ConstWeightsQuantizeFusion: Fusing conv1.weight with QuantizeLinear_7 [01/13/2023-08:20:26] [V] [TRT] Running: ConstWeightsQuantizeFusion on conv21.weight [01/13/2023-08:20:26] [V] [TRT] ConstWeightsQuantizeFusion: Fusing conv21.weight with QuantizeLinear_19 [01/13/2023-08:20:26] [V] [TRT] Running: ConstWeightsQuantizeFusion on conv22.weight [01/13/2023-08:20:26] [V] [TRT] ConstWeightsQuantizeFusion: Fusing conv22.weight with QuantizeLinear_31 [01/13/2023-08:20:26] [V] [TRT] Running: ConstWeightsQuantizeFusion on conv23.weight [01/13/2023-08:20:26] [V] [TRT] ConstWeightsQuantizeFusion: Fusing conv23.weight with QuantizeLinear_43 [01/13/2023-08:20:26] [V] [TRT] Running: ConstWeightsQuantizeFusion on conv2.weight [01/13/2023-08:20:26] [V] [TRT] ConstWeightsQuantizeFusion: Fusing conv2.weight with QuantizeLinear_55 [01/13/2023-08:20:26] [V] [TRT] Running: ConstWeightsQuantizeFusion on conv31.weight [01/13/2023-08:20:26] [V] [TRT] ConstWeightsQuantizeFusion: Fusing conv31.weight with QuantizeLinear_75 [01/13/2023-08:20:26] [V] [TRT] Running: ConstWeightsQuantizeFusion on conv311.weight [01/13/2023-08:20:26] [V] [TRT] ConstWeightsQuantizeFusion: Fusing conv311.weight with QuantizeLinear_87 [01/13/2023-08:20:26] [V] [TRT] Running: ConstWeightsQuantizeFusion on conv32.weight [01/13/2023-08:20:26] [V] [TRT] ConstWeightsQuantizeFusion: Fusing conv32.weight with QuantizeLinear_99 [01/13/2023-08:20:26] [V] [TRT] Running: ConstWeightsQuantizeFusion on conv321.weight [01/13/2023-08:20:26] [V] [TRT] ConstWeightsQuantizeFusion: Fusing conv321.weight with QuantizeLinear_110 [01/13/2023-08:20:26] [V] [TRT] Running: ConstWeightsQuantizeFusion on conv_class.weight [01/13/2023-08:20:26] [V] [TRT] ConstWeightsQuantizeFusion: Fusing conv_class.weight with QuantizeLinear_129 [01/13/2023-08:20:26] [V] [TRT] Running: ConvReluFusion on Conv_101 [01/13/2023-08:20:26] [V] [TRT] ConvReluFusion: Fusing Conv_101 with Relu_102 [01/13/2023-08:20:26] [V] [TRT] Running: HorizontalMergeQNodes on QuantizeLinear_14 [01/13/2023-08:20:26] [V] [TRT] Eliminating QuantizeLinear_50 which duplicates (Q) QuantizeLinear_14 [01/13/2023-08:20:26] [V] [TRT] Removing QuantizeLinear_50 [01/13/2023-08:20:26] [V] [TRT] Running: HorizontalMergeQNodes on QuantizeLinear_70 [01/13/2023-08:20:26] [V] [TRT] Eliminating QuantizeLinear_94 which duplicates (Q) QuantizeLinear_70 [01/13/2023-08:20:26] [V] [TRT] Removing QuantizeLinear_94 [01/13/2023-08:20:26] [V] [TRT] Running: QConvScaleFusion on Conv_9 [01/13/2023-08:20:26] [V] [TRT] Removing BatchNormalization_10 + Relu_11 [01/13/2023-08:20:26] [V] [TRT] Running: QConvScaleFusion on Conv_21 [01/13/2023-08:20:26] [V] [TRT] Removing BatchNormalization_22 + Relu_23 [01/13/2023-08:20:26] [V] [TRT] Running: QConvScaleFusion on Conv_57 [01/13/2023-08:20:26] [V] [TRT] Removing BatchNormalization_58 + Relu_59 [01/13/2023-08:20:26] [V] [TRT] Running: QConvScaleFusion on Conv_33 [01/13/2023-08:20:26] [V] [TRT] Removing BatchNormalization_34 + Relu_35 [01/13/2023-08:20:26] [V] [TRT] Running: QConvScaleFusion on Conv_45 [01/13/2023-08:20:26] [V] [TRT] Removing BatchNormalization_46 + Relu_47 [01/13/2023-08:20:26] [V] [TRT] Running: QConvScaleFusion on Conv_77 [01/13/2023-08:20:26] [V] [TRT] Removing BatchNormalization_78 + Relu_79 [01/13/2023-08:20:26] [V] [TRT] Running: QConvScaleFusion on Conv_112 [01/13/2023-08:20:26] [V] [TRT] Removing BatchNormalization_113 + Relu_114 [01/13/2023-08:20:26] [V] [TRT] Running: QConvScaleFusion on Conv_89 [01/13/2023-08:20:26] [V] [TRT] Removing BatchNormalization_90 + Relu_91 [01/13/2023-08:20:26] [V] [TRT] Running: QuantizeConvWithResidualAdd on Conv_45 [01/13/2023-08:20:26] [V] [TRT] Swapping Add_66 + Relu_67 with QuantizeLinear_70 [01/13/2023-08:20:26] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantizeLinear_70 into Conv_45 [01/13/2023-08:20:26] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantizeLinear_41 and DequantizeLinear_44) into Conv_45 [01/13/2023-08:20:26] [V] [TRT] Removing QuantizeLinear_70 [01/13/2023-08:20:26] [V] [TRT] Removing DequantizeLinear_41 [01/13/2023-08:20:26] [V] [TRT] Removing DequantizeLinear_44 [01/13/2023-08:20:26] [V] [TRT] ConstWeightsFusion: Fusing conv23.weight + QuantizeLinear_43 with Conv_45 [01/13/2023-08:20:26] [E] Error[2]: [graphOptimizer.cpp::fusePattern::1777] Error Code 2: Internal Error (Assertion matchPattern(context, first) && matchBackend(first) failed. ) [01/13/2023-08:20:26] [E] Error[2]: [builder.cpp::buildSerializedNetwork::636] Error Code 2: Internal Error (Assertion engine != nullptr failed. ) [01/13/2023-08:20:26] [E] Engine could not be created from network [01/13/2023-08:20:26] [E] Building engine failed [01/13/2023-08:20:26] [E] Failed to create engine from model or file. [01/13/2023-08:20:26] [E] Engine set up failed &&&& FAILED TensorRT.trtexec [TensorRT v8401] # trtexec --verbose --nvtxMode=verbose --buildOnly --workspace=8192 --onnx=0.pth.onnx --saveEngine=0.pth.onnx.engine --timingCacheFile=./timing.cache --profilingVerbosity=detailed --fp16 --int8