Converting onnx model to trt model (multi view CNN)

Hi, I have two models , one of them have single input for each prediction(1pic_model) and the other have 4 input each prediction(4pic_model) , when I use the following command in terminal:
/usr/src/tensorrt/bin/trtexec --onnx=Input_model_dir/model.onnx --saveEngine=resnet_engine.trt --explicitBatch --fp16
for 1pic_model it will do the task but when I want to convert 4pic_model, it wont do the task and gives the following error :

&&&& RUNNING TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=/home/jarf/Desktop/pypro/4pic/model_4pic.onnx --saveEngine=resnet_engine.trt --explicitBatch --fp16
[08/08/2021-07:04:30] [I] === Model Options ===
[08/08/2021-07:04:30] [I] Format: ONNX
[08/08/2021-07:04:30] [I] Model: /home/jarf/Desktop/pypro/4pic/model_4pic.onnx
[08/08/2021-07:04:30] [I] Output:
[08/08/2021-07:04:30] [I] === Build Options ===
[08/08/2021-07:04:30] [I] Max batch: explicit
[08/08/2021-07:04:30] [I] Workspace: 16 MB
[08/08/2021-07:04:30] [I] minTiming: 1
[08/08/2021-07:04:30] [I] avgTiming: 8
[08/08/2021-07:04:30] [I] Precision: FP32+FP16
[08/08/2021-07:04:30] [I] Calibration:
[08/08/2021-07:04:30] [I] Safe mode: Disabled
[08/08/2021-07:04:30] [I] Save engine: resnet_engine.trt
[08/08/2021-07:04:30] [I] Load engine:
[08/08/2021-07:04:30] [I] Builder Cache: Enabled
[08/08/2021-07:04:30] [I] NVTX verbosity: 0
[08/08/2021-07:04:30] [I] Inputs format: fp32:CHW
[08/08/2021-07:04:30] [I] Outputs format: fp32:CHW
[08/08/2021-07:04:30] [I] Input build shapes: model
[08/08/2021-07:04:30] [I] Input calibration shapes: model
[08/08/2021-07:04:30] [I] === System Options ===
[08/08/2021-07:04:30] [I] Device: 0
[08/08/2021-07:04:30] [I] DLACore:
[08/08/2021-07:04:30] [I] Plugins:
[08/08/2021-07:04:30] [I] === Inference Options ===
[08/08/2021-07:04:30] [I] Batch: Explicit
[08/08/2021-07:04:30] [I] Input inference shapes: model
[08/08/2021-07:04:30] [I] Iterations: 10
[08/08/2021-07:04:30] [I] Duration: 3s (+ 200ms warm up)
[08/08/2021-07:04:30] [I] Sleep time: 0ms
[08/08/2021-07:04:30] [I] Streams: 1
[08/08/2021-07:04:30] [I] ExposeDMA: Disabled
[08/08/2021-07:04:30] [I] Spin-wait: Disabled
[08/08/2021-07:04:30] [I] Multithreading: Disabled
[08/08/2021-07:04:30] [I] CUDA Graph: Disabled
[08/08/2021-07:04:30] [I] Skip inference: Disabled
[08/08/2021-07:04:30] [I] Inputs:
[08/08/2021-07:04:30] [I] === Reporting Options ===
[08/08/2021-07:04:30] [I] Verbose: Disabled
[08/08/2021-07:04:30] [I] Averages: 10 inferences
[08/08/2021-07:04:30] [I] Percentile: 99
[08/08/2021-07:04:30] [I] Dump output: Disabled
[08/08/2021-07:04:30] [I] Profile: Disabled
[08/08/2021-07:04:30] [I] Export timing to JSON file:
[08/08/2021-07:04:30] [I] Export output to JSON file:
[08/08/2021-07:04:30] [I] Export profile to JSON file:
[08/08/2021-07:04:30] [I]

Input filename: /home/jarf/Desktop/pypro/4pic/model_4pic.onnx
ONNX IR version: 0.0.7
Opset version: 13
Producer name: tf2onnx
Producer version: 1.10.0
Domain:
Model version: 0
Doc string:

[08/08/2021-07:04:34] [W] [TRT] onnx2trt_utils.cpp:220: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
terminate called after throwing an instance of ‘std::out_of_range’
what(): Attribute not found: axes
Aborted (core dumped)

Hi,

Could you enable the verbose log and share the output with us?

$ /usr/src/tensorrt/bin/trtexec ... --verbose

Thanks.

Hi , thanks for your attention,
&&&& RUNNING TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=/home/jarf/Desktop/pypro/4pic/model_4pic.onnx --saveEngine=resnet_engine.trt --explicitBatch --fp16 --verbose
[08/09/2021-06:08:14] [I] === Model Options ===
[08/09/2021-06:08:14] [I] Format: ONNX
[08/09/2021-06:08:14] [I] Model: /home/jarf/Desktop/pypro/4pic/model_4pic.onnx
[08/09/2021-06:08:14] [I] Output:
[08/09/2021-06:08:14] [I] === Build Options ===
[08/09/2021-06:08:14] [I] Max batch: explicit
[08/09/2021-06:08:14] [I] Workspace: 16 MB
[08/09/2021-06:08:14] [I] minTiming: 1
[08/09/2021-06:08:14] [I] avgTiming: 8
[08/09/2021-06:08:14] [I] Precision: FP32+FP16
[08/09/2021-06:08:14] [I] Calibration:
[08/09/2021-06:08:14] [I] Safe mode: Disabled
[08/09/2021-06:08:14] [I] Save engine: resnet_engine.trt
[08/09/2021-06:08:14] [I] Load engine:
[08/09/2021-06:08:14] [I] Builder Cache: Enabled
[08/09/2021-06:08:14] [I] NVTX verbosity: 0
[08/09/2021-06:08:14] [I] Inputs format: fp32:CHW
[08/09/2021-06:08:14] [I] Outputs format: fp32:CHW
[08/09/2021-06:08:14] [I] Input build shapes: model
[08/09/2021-06:08:14] [I] Input calibration shapes: model
[08/09/2021-06:08:14] [I] === System Options ===
[08/09/2021-06:08:14] [I] Device: 0
[08/09/2021-06:08:14] [I] DLACore:
[08/09/2021-06:08:14] [I] Plugins:
[08/09/2021-06:08:14] [I] === Inference Options ===
[08/09/2021-06:08:14] [I] Batch: Explicit
[08/09/2021-06:08:14] [I] Input inference shapes: model
[08/09/2021-06:08:14] [I] Iterations: 10
[08/09/2021-06:08:14] [I] Duration: 3s (+ 200ms warm up)
[08/09/2021-06:08:14] [I] Sleep time: 0ms
[08/09/2021-06:08:14] [I] Streams: 1
[08/09/2021-06:08:14] [I] ExposeDMA: Disabled
[08/09/2021-06:08:14] [I] Spin-wait: Disabled
[08/09/2021-06:08:14] [I] Multithreading: Disabled
[08/09/2021-06:08:14] [I] CUDA Graph: Disabled
[08/09/2021-06:08:14] [I] Skip inference: Disabled
[08/09/2021-06:08:14] [I] Inputs:
[08/09/2021-06:08:14] [I] === Reporting Options ===
[08/09/2021-06:08:14] [I] Verbose: Enabled
[08/09/2021-06:08:14] [I] Averages: 10 inferences
[08/09/2021-06:08:14] [I] Percentile: 99
[08/09/2021-06:08:14] [I] Dump output: Disabled
[08/09/2021-06:08:14] [I] Profile: Disabled
[08/09/2021-06:08:14] [I] Export timing to JSON file:
[08/09/2021-06:08:14] [I] Export output to JSON file:
[08/09/2021-06:08:14] [I] Export profile to JSON file:
[08/09/2021-06:08:14] [I]
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::Region_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::CropAndResize version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::Proposal version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::Split version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1
[08/09/2021-06:08:14] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1

Input filename: /home/jarf/Desktop/pypro/4pic/model_4pic.onnx
ONNX IR version: 0.0.7
Opset version: 13
Producer name: tf2onnx
Producer version: 1.10.0
Domain:
Model version: 0
Doc string:

[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::Proposal version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::Split version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:202: Adding network input: input_2 with dtype: float32, dimensions: (-1, 32, 32, 3)
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: input_2 for ONNX tensor: input_2
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:202: Adding network input: input_3 with dtype: float32, dimensions: (-1, 32, 32, 3)
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: input_3 for ONNX tensor: input_3
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:202: Adding network input: input_4 with dtype: float32, dimensions: (-1, 32, 32, 3)
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: input_4 for ONNX tensor: input_4
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:202: Adding network input: input_5 with dtype: float32, dimensions: (-1, 32, 32, 3)
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: input_5 for ONNX tensor: input_5
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_axes__92
[08/09/2021-06:08:19] [W] [TRT] onnx2trt_utils.cpp:220: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/model/dense/MatMul_1/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/model/dense/BiasAdd_1/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/model/conv2d_2/Conv2D_3/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_2/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/model/conv2d_1/Conv2D_3/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/model/conv2d/Conv2D_1/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/dense_3/MatMul/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/dense_3/BiasAdd/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/dense_2/MatMul/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/dense_2/BiasAdd/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/dense_1/MatMul/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/model_1/dense_1/BiasAdd/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd__66 [Transpose]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: input_2
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd__66 [Transpose] inputs: [input_2 → (-1, 32, 32, 3)],
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd__66 for ONNX node: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd__66
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd__66:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd__66:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd__66 [Transpose] outputs: [StatefulPartitionedCall/model_1/model/conv2d/BiasAdd__66:0 → (-1, 3, 32, 32)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3__6 [Transpose]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: input_5
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3__6 [Transpose] inputs: [input_5 → (-1, 32, 32, 3)],
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3__6 for ONNX node: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3__6
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3__6:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3__6:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3__6 [Transpose] outputs: [StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3__6:0 → (-1, 3, 32, 32)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2__26 [Transpose]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: input_4
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2__26 [Transpose] inputs: [input_4 → (-1, 32, 32, 3)],
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2__26 for ONNX node: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2__26
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2__26:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2__26:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2__26 [Transpose] outputs: [StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2__26:0 → (-1, 3, 32, 32)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3 [Conv]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3__6:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d/Conv2D_1/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3 [Conv] inputs: [StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3__6:0 → (-1, 3, 32, 32)], [StatefulPartitionedCall/model_1/model/conv2d/Conv2D_1/ReadVariableOp:0 → (36, 3, 3, 3)], [StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_2/ReadVariableOp:0 → (36)],
[08/09/2021-06:08:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 3, 32, 32)
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3 for ONNX node: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3
[08/09/2021-06:08:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 36
[08/09/2021-06:08:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 36, 30, 30)
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3 [Conv] outputs: [StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3:0 → (-1, 36, 30, 30)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/conv2d/Relu_3 [Relu]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/conv2d/Relu_3 [Relu] inputs: [StatefulPartitionedCall/model_1/model/conv2d/BiasAdd_3:0 → (-1, 36, 30, 30)],
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/conv2d/Relu_3 for ONNX node: StatefulPartitionedCall/model_1/model/conv2d/Relu_3
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/conv2d/Relu_3:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/conv2d/Relu_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/conv2d/Relu_3 [Relu] outputs: [StatefulPartitionedCall/model_1/model/conv2d/Relu_3:0 → (-1, 36, 30, 30)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/max_pooling2d/MaxPool_3 [MaxPool]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d/Relu_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/max_pooling2d/MaxPool_3 [MaxPool] inputs: [StatefulPartitionedCall/model_1/model/conv2d/Relu_3:0 → (-1, 36, 30, 30)],
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/max_pooling2d/MaxPool_3 for ONNX node: StatefulPartitionedCall/model_1/model/max_pooling2d/MaxPool_3
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/max_pooling2d/MaxPool_3:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/max_pooling2d/MaxPool_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/max_pooling2d/MaxPool_3 [MaxPool] outputs: [StatefulPartitionedCall/model_1/model/max_pooling2d/MaxPool_3:0 → (-1, 36, 15, 15)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3 [Conv]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/max_pooling2d/MaxPool_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d_1/Conv2D_3/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3 [Conv] inputs: [StatefulPartitionedCall/model_1/model/max_pooling2d/MaxPool_3:0 → (-1, 36, 15, 15)], [StatefulPartitionedCall/model_1/model/conv2d_1/Conv2D_3/ReadVariableOp:0 → (48, 36, 3, 3)], [StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3/ReadVariableOp:0 → (48)],
[08/09/2021-06:08:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 36, 15, 15)
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3 for ONNX node: StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3
[08/09/2021-06:08:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 48
[08/09/2021-06:08:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 48, 13, 13)
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3 [Conv] outputs: [StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3:0 → (-1, 48, 13, 13)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/conv2d_1/Relu_3 [Relu]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/conv2d_1/Relu_3 [Relu] inputs: [StatefulPartitionedCall/model_1/model/conv2d_1/BiasAdd_3:0 → (-1, 48, 13, 13)],
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/conv2d_1/Relu_3 for ONNX node: StatefulPartitionedCall/model_1/model/conv2d_1/Relu_3
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/conv2d_1/Relu_3:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/conv2d_1/Relu_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/conv2d_1/Relu_3 [Relu] outputs: [StatefulPartitionedCall/model_1/model/conv2d_1/Relu_3:0 → (-1, 48, 13, 13)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/max_pooling2d_1/MaxPool_3 [MaxPool]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d_1/Relu_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/max_pooling2d_1/MaxPool_3 [MaxPool] inputs: [StatefulPartitionedCall/model_1/model/conv2d_1/Relu_3:0 → (-1, 48, 13, 13)],
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/max_pooling2d_1/MaxPool_3 for ONNX node: StatefulPartitionedCall/model_1/model/max_pooling2d_1/MaxPool_3
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/max_pooling2d_1/MaxPool_3:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/max_pooling2d_1/MaxPool_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/max_pooling2d_1/MaxPool_3 [MaxPool] outputs: [StatefulPartitionedCall/model_1/model/max_pooling2d_1/MaxPool_3:0 → (-1, 48, 6, 6)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_3 [Conv]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/max_pooling2d_1/MaxPool_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d_2/Conv2D_3/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_2/ReadVariableOp:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_3 [Conv] inputs: [StatefulPartitionedCall/model_1/model/max_pooling2d_1/MaxPool_3:0 → (-1, 48, 6, 6)], [StatefulPartitionedCall/model_1/model/conv2d_2/Conv2D_3/ReadVariableOp:0 → (64, 48, 3, 3)], [StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_2/ReadVariableOp:0 → (64)],
[08/09/2021-06:08:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 48, 6, 6)
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_3 for ONNX node: StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_3
[08/09/2021-06:08:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64
[08/09/2021-06:08:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 64, 4, 4)
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_3:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_3 [Conv] outputs: [StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_3:0 → (-1, 64, 4, 4)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/conv2d_2/Relu_3 [Relu]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/conv2d_2/Relu_3 [Relu] inputs: [StatefulPartitionedCall/model_1/model/conv2d_2/BiasAdd_3:0 → (-1, 64, 4, 4)],
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/conv2d_2/Relu_3 for ONNX node: StatefulPartitionedCall/model_1/model/conv2d_2/Relu_3
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/conv2d_2/Relu_3:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/conv2d_2/Relu_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/conv2d_2/Relu_3 [Relu] outputs: [StatefulPartitionedCall/model_1/model/conv2d_2/Relu_3:0 → (-1, 64, 4, 4)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3 [GlobalAveragePool]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/conv2d_2/Relu_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3 [GlobalAveragePool] inputs: [StatefulPartitionedCall/model_1/model/conv2d_2/Relu_3:0 → (-1, 64, 4, 4)],
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3 for ONNX node: StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3
[08/09/2021-06:08:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3:0 for ONNX tensor: StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3 [GlobalAveragePool] outputs: [StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3:0 → (-1, 64, 1, 1)],
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3_Squeeze__89 [Squeeze]
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3:0
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_axes__92
[08/09/2021-06:08:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3_Squeeze__89 [Squeeze] inputs: [StatefulPartitionedCall/model_1/model/global_average_pooling2d/Mean_3:0 → (-1, 64, 1, 1)], [const_axes__92 → (2)],
terminate called after throwing an instance of ‘std::out_of_range’
what(): Attribute not found: axes
Aborted (core dumped)

Hi,

It seems that you are meeting an error from here.
The axis information for the Squeeze layer changes from opset-13.(attribute->weight)

However, we add that support from onnx2trt v8.0EA.
Could you update the parser accordingly?

You can do this by upgrading the parser from GitHub.
Or reflash your system with JetPack4.6 to get TensorRT v8.0 directly.

Thanks.