Hi , thanks for your attention,
&&&& RUNNING TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=/home/jarf/Desktop/pypro/4pic/model_4pic.onnx --saveEngine=resnet_engine.trt --explicitBatch --fp16 --verbose
[08/09/2021-06:08:14] [I] === Model Options ===
[08/09/2021-06:08:14] [I] Format: ONNX
[08/09/2021-06:08:14] [I] Model: /home/jarf/Desktop/pypro/4pic/model_4pic.onnx
[08/09/2021-06:08:14] [I] Output:
[08/09/2021-06:08:14] [I] === Build Options ===
[08/09/2021-06:08:14] [I] Max batch: explicit
[08/09/2021-06:08:14] [I] Workspace: 16 MB
[08/09/2021-06:08:14] [I] minTiming: 1
[08/09/2021-06:08:14] [I] avgTiming: 8
[08/09/2021-06:08:14] [I] Precision: FP32+FP16
[08/09/2021-06:08:14] [I] Calibration:
[08/09/2021-06:08:14] [I] Safe mode: Disabled
[08/09/2021-06:08:14] [I] Save engine: resnet_engine.trt
[08/09/2021-06:08:14] [I] Load engine:
[08/09/2021-06:08:14] [I] Builder Cache: Enabled
[08/09/2021-06:08:14] [I] NVTX verbosity: 0
[08/09/2021-06:08:14] [I] Inputs format: fp32:CHW
[08/09/2021-06:08:14] [I] Outputs format: fp32:CHW
[08/09/2021-06:08:14] [I] Input build shapes: model
[08/09/2021-06:08:14] [I] Input calibration shapes: model
[08/09/2021-06:08:14] [I] === System Options ===
[08/09/2021-06:08:14] [I] Device: 0
[08/09/2021-06:08:14] [I] DLACore:
[08/09/2021-06:08:14] [I] Plugins:
[08/09/2021-06:08:14] [I] === Inference Options ===
[08/09/2021-06:08:14] [I] Batch: Explicit
[08/09/2021-06:08:14] [I] Input inference shapes: model
[08/09/2021-06:08:14] [I] Iterations: 10
[08/09/2021-06:08:14] [I] Duration: 3s (+ 200ms warm up)
[08/09/2021-06:08:14] [I] Sleep time: 0ms
[08/09/2021-06:08:14] [I] Streams: 1
[08/09/2021-06:08:14] [I] ExposeDMA: Disabled
[08/09/2021-06:08:14] [I] Spin-wait: Disabled
[08/09/2021-06:08:14] [I] Multithreading: Disabled
[08/09/2021-06:08:14] [I] CUDA Graph: Disabled
[08/09/2021-06:08:14] [I] Skip inference: Disabled
[08/09/2021-06:08:14] [I] Inputs:
[08/09/2021-06:08:14] [I] === Reporting Options ===
[08/09/2021-06:08:14] [I] Verbose: Enabled
[08/09/2021-06:08:14] [I] Averages: 10 inferences
[08/09/2021-06:08:14] [I] Percentile: 99
[08/09/2021-06:08:14] [I] Dump output: Disabled
[08/09/2021-06:08:14] [I] Profile: Disabled
[08/09/2021-06:08:14] [I] Export timing to JSON file:
[08/09/2021-06:08:14] [I] Export output to JSON file:
[08/09/2021-06:08:14] [I] Export profile to JSON file:
[08/09/2021-06:08:14] [I]
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::Region_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::CropAndResize version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::Proposal version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::Split version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1
Input filename: /home/jarf/Desktop/pypro/4pic/model_4pic.onnx
ONNX IR version: 0.0.7
Opset version: 13
Producer name: tf2onnx
Producer version: 1.10.0
Domain:
Model version: 0
Doc string:
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::Proposal version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::Split version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:202: Adding network input: input_2 with dtype: float32, dimensions: (-1, 32, 32, 3)
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: input_2 for ONNX tensor: input_2
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:202: Adding network input: input_3 with dtype: float32, dimensions: (-1, 32, 32, 3)
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: input_3 for ONNX tensor: input_3
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:202: Adding network input: input_4 with dtype: float32, dimensions: (-1, 32, 32, 3)
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: input_4 for ONNX tensor: input_4
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:202: Adding network input: input_5 with dtype: float32, dimensions: (-1, 32, 32, 3)
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: input_5 for ONNX tensor: input_5
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_axes__92
[08/09/2021-06:08:19] [W] [TRT] onnx2trt_utils.cpp:220: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/model/dense/MatMul_1/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/model/dense/BiasAdd_1/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/model/conv2d_2/Conv2D_3/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_2/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/model/conv2d_1/Conv2D_3/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/model/conv2d/Conv2D_1/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/dense_3/MatMul/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/dense_3/BiasAdd/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/dense_2/MatMul/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/dense_2/BiasAdd/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/dense_1/MatMul/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/dense_1/BiasAdd/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd__66 [Transpose]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: input_2
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd__66 [Transpose] inputs: [input_2 → (-1, 32, 32, 3)],
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd__66 for ONNX node: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd__66
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd__66:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd__66:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd__66 [Transpose] outputs: [StatefulPartitionedCall/model_1/model/conv2d/BiasAdd__66:0 → (-1, 3, 32, 32)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3__6 [Transpose]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: input_5
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3__6 [Transpose] inputs: [input_5 → (-1, 32, 32, 3)],
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3__6 for ONNX node: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3__6
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3__6:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3__6:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3__6 [Transpose] outputs: [StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3__6:0 → (-1, 3, 32, 32)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2__26 [Transpose]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: input_4
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2__26 [Transpose] inputs: [input_4 → (-1, 32, 32, 3)],
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2__26 for ONNX node: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2__26
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2__26:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2__26:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2__26 [Transpose] outputs: [StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2__26:0 → (-1, 3, 32, 32)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3 [Conv]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3__6:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d/Conv2D_1/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3 [Conv] inputs: [StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3__6:0 → (-1, 3, 32, 32)], [StatefulPartitionedCall/model_1/model/conv2d/Conv2D_1/ReadVariableOp:0 → (36, 3, 3, 3)], [StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2/ReadVariableOp:0 → (36)],
[08/09/2021-06:08:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 3, 32, 32)
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3 for ONNX node: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3
[08/09/2021-06:08:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 36
[08/09/2021-06:08:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 36, 30, 30)
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3 [Conv] outputs: [StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3:0 → (-1, 36, 30, 30)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/conv2d/Relu_3 [Relu]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/conv2d/Relu_3 [Relu] inputs: [StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3:0 → (-1, 36, 30, 30)],
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/conv2d/Relu_3 for ONNX node: StatefulPartitionedCall/model_1/model/conv2d/Relu_3
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/conv2d/Relu_3:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/conv2d/Relu_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/conv2d/Relu_3 [Relu] outputs: [StatefulPartitionedCall/model_1/model/conv2d/Relu_3:0 → (-1, 36, 30, 30)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/max_pooling2d/MaxPool_3 [MaxPool]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d/Relu_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/max_pooling2d/MaxPool_3 [MaxPool] inputs: [StatefulPartitionedCall/model_1/model/conv2d/Relu_3:0 → (-1, 36, 30, 30)],
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/max_pooling2d/MaxPool_3 for ONNX node: StatefulPartitionedCall/model_1/model/max_pooling2d/MaxPool_3
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/max_pooling2d/MaxPool_3:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/max_pooling2d/MaxPool_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/max_pooling2d/MaxPool_3 [MaxPool] outputs: [StatefulPartitionedCall/model_1/model/max_pooling2d/MaxPool_3:0 → (-1, 36, 15, 15)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3 [Conv]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/max_pooling2d/MaxPool_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d_1/Conv2D_3/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3 [Conv] inputs: [StatefulPartitionedCall/model_1/model/max_pooling2d/MaxPool_3:0 → (-1, 36, 15, 15)], [StatefulPartitionedCall/model_1/model/conv2d_1/Conv2D_3/ReadVariableOp:0 → (48, 36, 3, 3)], [StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3/ReadVariableOp:0 → (48)],
[08/09/2021-06:08:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 36, 15, 15)
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3 for ONNX node: StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3
[08/09/2021-06:08:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 48
[08/09/2021-06:08:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 48, 13, 13)
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3 [Conv] outputs: [StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3:0 → (-1, 48, 13, 13)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/conv2d_1/Relu_3 [Relu]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/conv2d_1/Relu_3 [Relu] inputs: [StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3:0 → (-1, 48, 13, 13)],
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/conv2d_1/Relu_3 for ONNX node: StatefulPartitionedCall/model_1/model/conv2d_1/Relu_3
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/conv2d_1/Relu_3:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/conv2d_1/Relu_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/conv2d_1/Relu_3 [Relu] outputs: [StatefulPartitionedCall/model_1/model/conv2d_1/Relu_3:0 → (-1, 48, 13, 13)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/max_pooling2d_1/MaxPool_3 [MaxPool]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d_1/Relu_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/max_pooling2d_1/MaxPool_3 [MaxPool] inputs: [StatefulPartitionedCall/model_1/model/conv2d_1/Relu_3:0 → (-1, 48, 13, 13)],
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/max_pooling2d_1/MaxPool_3 for ONNX node: StatefulPartitionedCall/model_1/model/max_pooling2d_1/MaxPool_3
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/max_pooling2d_1/MaxPool_3:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/max_pooling2d_1/MaxPool_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/max_pooling2d_1/MaxPool_3 [MaxPool] outputs: [StatefulPartitionedCall/model_1/model/max_pooling2d_1/MaxPool_3:0 → (-1, 48, 6, 6)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_3 [Conv]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/max_pooling2d_1/MaxPool_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d_2/Conv2D_3/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_2/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_3 [Conv] inputs: [StatefulPartitionedCall/model_1/model/max_pooling2d_1/MaxPool_3:0 → (-1, 48, 6, 6)], [StatefulPartitionedCall/model_1/model/conv2d_2/Conv2D_3/ReadVariableOp:0 → (64, 48, 3, 3)], [StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_2/ReadVariableOp:0 → (64)],
[08/09/2021-06:08:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 48, 6, 6)
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_3 for ONNX node: StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_3
[08/09/2021-06:08:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64
[08/09/2021-06:08:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 64, 4, 4)
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_3:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_3 [Conv] outputs: [StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_3:0 → (-1, 64, 4, 4)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/conv2d_2/Relu_3 [Relu]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/conv2d_2/Relu_3 [Relu] inputs: [StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_3:0 → (-1, 64, 4, 4)],
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/conv2d_2/Relu_3 for ONNX node: StatefulPartitionedCall/model_1/model/conv2d_2/Relu_3
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/conv2d_2/Relu_3:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/conv2d_2/Relu_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/conv2d_2/Relu_3 [Relu] outputs: [StatefulPartitionedCall/model_1/model/conv2d_2/Relu_3:0 → (-1, 64, 4, 4)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3 [GlobalAveragePool]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d_2/Relu_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3 [GlobalAveragePool] inputs: [StatefulPartitionedCall/model_1/model/conv2d_2/Relu_3:0 → (-1, 64, 4, 4)],
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3 for ONNX node: StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3 [GlobalAveragePool] outputs: [StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3:0 → (-1, 64, 1, 1)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3_Squeeze__89 [Squeeze]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_axes__92
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3_Squeeze__89 [Squeeze] inputs: [StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3:0 → (-1, 64, 1, 1)], [const_axes__92 → (2)],
terminate called after throwing an instance of ‘std::out_of_range’
what(): Attribute not found: axes
Aborted (core dumped)