&&&& RUNNING TensorRT.trtexec # ./trtexec --onnx=/home/adascoe/Sainath/Model/Mar3_3.onnx --explicitBatch --minShapes=conv2d_input:0:1x145x145x3 --optShapes=conv2d_input:0:16x145x145x3 --maxShapes=conv2d_input:0:256x256x256x3 --shapes=conv2d_input:0:5x145x145x3 --verbose --saveEngine=model13.trt [03/14/2023-12:51:53] [I] === Model Options === [03/14/2023-12:51:53] [I] Format: ONNX [03/14/2023-12:51:53] [I] Model: /home/adascoe/Sainath/Model/Mar3_3.onnx [03/14/2023-12:51:53] [I] Output: [03/14/2023-12:51:53] [I] === Build Options === [03/14/2023-12:51:53] [I] Max batch: explicit [03/14/2023-12:51:53] [I] Workspace: 16 MB [03/14/2023-12:51:53] [I] minTiming: 1 [03/14/2023-12:51:53] [I] avgTiming: 8 [03/14/2023-12:51:53] [I] Precision: FP32 [03/14/2023-12:51:53] [I] Calibration: [03/14/2023-12:51:53] [I] Safe mode: Disabled [03/14/2023-12:51:53] [I] Save engine: model13.trt [03/14/2023-12:51:53] [I] Load engine: [03/14/2023-12:51:53] [I] Inputs format: fp32:CHW [03/14/2023-12:51:53] [I] Outputs format: fp32:CHW [03/14/2023-12:51:53] [I] Input build shape: conv2d_input:0=1x145x145x3+16x145x145x3+256x256x256x3 [03/14/2023-12:51:53] [I] === System Options === [03/14/2023-12:51:53] [I] Device: 0 [03/14/2023-12:51:53] [I] DLACore: [03/14/2023-12:51:53] [I] Plugins: [03/14/2023-12:51:53] [I] === Inference Options === [03/14/2023-12:51:53] [I] Batch: Explicit [03/14/2023-12:51:53] [I] Input inference shape: conv2d_input:0=5x145x145x3 [03/14/2023-12:51:53] [I] Iterations: 10 (200 ms warm up) [03/14/2023-12:51:53] [I] Duration: 3s [03/14/2023-12:51:53] [I] Sleep time: 0ms [03/14/2023-12:51:53] [I] Streams: 1 [03/14/2023-12:51:53] [I] Spin-wait: Disabled [03/14/2023-12:51:53] [I] Multithreading: Enabled [03/14/2023-12:51:53] [I] CUDA Graph: Disabled [03/14/2023-12:51:53] [I] Skip inference: Disabled [03/14/2023-12:51:53] [I] Separate profiling: Disabled [03/14/2023-12:51:53] [I] Consistency: Disabled [03/14/2023-12:51:53] [I] === Reporting Options === [03/14/2023-12:51:53] [I] Verbose: Enabled [03/14/2023-12:51:53] [I] Averages: 10 inferences [03/14/2023-12:51:53] [I] Percentile: 99 [03/14/2023-12:51:53] [I] Dump output: Disabled [03/14/2023-12:51:53] [I] Profile: Disabled [03/14/2023-12:51:53] [I] Export timing to JSON file: [03/14/2023-12:51:53] [I] Export profile to JSON file: [03/14/2023-12:51:53] [I] [03/14/2023-12:51:53] [I] [03/14/2023-12:51:53] [V] [TRT] Plugin Creator registration succeeded - GridAnchor_TRT [03/14/2023-12:51:53] [V] [TRT] Plugin Creator registration succeeded - NMS_TRT [03/14/2023-12:51:53] [V] [TRT] Plugin Creator registration succeeded - Reorg_TRT [03/14/2023-12:51:53] [V] [TRT] Plugin Creator registration succeeded - Region_TRT [03/14/2023-12:51:53] [V] [TRT] Plugin Creator registration succeeded - Clip_TRT [03/14/2023-12:51:53] [V] [TRT] Plugin Creator registration succeeded - LReLU_TRT [03/14/2023-12:51:53] [V] [TRT] Plugin Creator registration succeeded - PriorBox_TRT [03/14/2023-12:51:53] [V] [TRT] Plugin Creator registration succeeded - Normalize_TRT [03/14/2023-12:51:53] [V] [TRT] Plugin Creator registration succeeded - RPROI_TRT [03/14/2023-12:51:53] [V] [TRT] Plugin Creator registration succeeded - BatchedNMS_TRT [03/14/2023-12:51:53] [V] [TRT] Plugin Creator registration succeeded - FlattenConcat_TRT [03/14/2023-12:51:53] [V] [TRT] Plugin Creator registration succeeded - Split [03/14/2023-12:51:53] [V] [TRT] Plugin Creator registration succeeded - InstanceNormalization_TRT ---------------------------------------------------------------- Input filename: /home/adascoe/Sainath/Model/Mar3_3.onnx ONNX IR version: 0.0.7 Opset version: 13 Producer name: tf2onnx Producer version: 1.13.0 2c1db5 Domain: Model version: 0 Doc string: ---------------------------------------------------------------- [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:209: Adding network input: conv2d_input with dtype: float32, dimensions: (-1, 145, 145, 3) [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: conv2d_input for ONNX tensor: conv2d_input [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:91: Importing initializer: sequential/dense_1/MatMul/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:91: Importing initializer: sequential/dense_1/BiasAdd/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:91: Importing initializer: sequential/dense/MatMul/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:91: Importing initializer: sequential/dense/BiasAdd/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:91: Importing initializer: sequential/conv2d_3/Conv2D/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:91: Importing initializer: sequential/conv2d_3/BiasAdd/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:91: Importing initializer: sequential/conv2d_2/Conv2D/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:91: Importing initializer: sequential/conv2d_2/BiasAdd/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:91: Importing initializer: sequential/conv2d_1/Conv2D/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:91: Importing initializer: sequential/conv2d_1/BiasAdd/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:91: Importing initializer: sequential/conv2d/Conv2D/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:91: Importing initializer: sequential/conv2d/BiasAdd/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:91: Importing initializer: const_fold_opt__78 [03/14/2023-12:51:53] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:108: Parsing node: sequential/conv2d/BiasAdd__45 [Transpose] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: conv2d_input [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:130: sequential/conv2d/BiasAdd__45 [Transpose] inputs: [conv2d_input -> (-1, 145, 145, 3)], [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sequential/conv2d/BiasAdd__45 for ONNX node: sequential/conv2d/BiasAdd__45 [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sequential/conv2d/BiasAdd__45:0 for ONNX tensor: sequential/conv2d/BiasAdd__45:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:186: sequential/conv2d/BiasAdd__45 [Transpose] outputs: [sequential/conv2d/BiasAdd__45:0 -> (-1, 3, 145, 145)], [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:108: Parsing node: sequential/conv2d/BiasAdd [Conv] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/conv2d/BiasAdd__45:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/conv2d/Conv2D/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/conv2d/BiasAdd/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:130: sequential/conv2d/BiasAdd [Conv] inputs: [sequential/conv2d/BiasAdd__45:0 -> (-1, 3, 145, 145)], [sequential/conv2d/Conv2D/ReadVariableOp:0 -> (256, 3, 3, 3)], [sequential/conv2d/BiasAdd/ReadVariableOp:0 -> (256)], [03/14/2023-12:51:53] [V] [TRT] builtin_op_importers.cpp:441: Convolution input dimensions: (-1, 3, 145, 145) [03/14/2023-12:51:53] [V] [TRT] builtin_op_importers.cpp:523: Using kernel: (3, 3), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 256 [03/14/2023-12:51:53] [V] [TRT] builtin_op_importers.cpp:524: Convolution output dimensions: (-1, 256, 143, 143) [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sequential/conv2d/BiasAdd for ONNX node: sequential/conv2d/BiasAdd [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sequential/conv2d/BiasAdd:0 for ONNX tensor: sequential/conv2d/BiasAdd:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:186: sequential/conv2d/BiasAdd [Conv] outputs: [sequential/conv2d/BiasAdd:0 -> (-1, 256, 143, 143)], [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:108: Parsing node: sequential/conv2d/Relu [Relu] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/conv2d/BiasAdd:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:130: sequential/conv2d/Relu [Relu] inputs: [sequential/conv2d/BiasAdd:0 -> (-1, 256, 143, 143)], [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sequential/conv2d/Relu for ONNX node: sequential/conv2d/Relu [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sequential/conv2d/Relu:0 for ONNX tensor: sequential/conv2d/Relu:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:186: sequential/conv2d/Relu [Relu] outputs: [sequential/conv2d/Relu:0 -> (-1, 256, 143, 143)], [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:108: Parsing node: sequential/max_pooling2d/MaxPool [MaxPool] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/conv2d/Relu:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:130: sequential/max_pooling2d/MaxPool [MaxPool] inputs: [sequential/conv2d/Relu:0 -> (-1, 256, 143, 143)], [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sequential/max_pooling2d/MaxPool for ONNX node: sequential/max_pooling2d/MaxPool [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sequential/max_pooling2d/MaxPool:0 for ONNX tensor: sequential/max_pooling2d/MaxPool:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:186: sequential/max_pooling2d/MaxPool [MaxPool] outputs: [sequential/max_pooling2d/MaxPool:0 -> (-1, 256, 71, 71)], [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:108: Parsing node: sequential/conv2d_1/BiasAdd [Conv] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/max_pooling2d/MaxPool:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/conv2d_1/Conv2D/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/conv2d_1/BiasAdd/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:130: sequential/conv2d_1/BiasAdd [Conv] inputs: [sequential/max_pooling2d/MaxPool:0 -> (-1, 256, 71, 71)], [sequential/conv2d_1/Conv2D/ReadVariableOp:0 -> (128, 256, 3, 3)], [sequential/conv2d_1/BiasAdd/ReadVariableOp:0 -> (128)], [03/14/2023-12:51:53] [V] [TRT] builtin_op_importers.cpp:441: Convolution input dimensions: (-1, 256, 71, 71) [03/14/2023-12:51:53] [V] [TRT] builtin_op_importers.cpp:523: Using kernel: (3, 3), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 128 [03/14/2023-12:51:53] [V] [TRT] builtin_op_importers.cpp:524: Convolution output dimensions: (-1, 128, 69, 69) [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sequential/conv2d_1/BiasAdd for ONNX node: sequential/conv2d_1/BiasAdd [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sequential/conv2d_1/BiasAdd:0 for ONNX tensor: sequential/conv2d_1/BiasAdd:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:186: sequential/conv2d_1/BiasAdd [Conv] outputs: [sequential/conv2d_1/BiasAdd:0 -> (-1, 128, 69, 69)], [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:108: Parsing node: sequential/conv2d_1/Relu [Relu] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/conv2d_1/BiasAdd:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:130: sequential/conv2d_1/Relu [Relu] inputs: [sequential/conv2d_1/BiasAdd:0 -> (-1, 128, 69, 69)], [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sequential/conv2d_1/Relu for ONNX node: sequential/conv2d_1/Relu [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sequential/conv2d_1/Relu:0 for ONNX tensor: sequential/conv2d_1/Relu:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:186: sequential/conv2d_1/Relu [Relu] outputs: [sequential/conv2d_1/Relu:0 -> (-1, 128, 69, 69)], [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:108: Parsing node: sequential/max_pooling2d_1/MaxPool [MaxPool] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/conv2d_1/Relu:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:130: sequential/max_pooling2d_1/MaxPool [MaxPool] inputs: [sequential/conv2d_1/Relu:0 -> (-1, 128, 69, 69)], [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sequential/max_pooling2d_1/MaxPool for ONNX node: sequential/max_pooling2d_1/MaxPool [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sequential/max_pooling2d_1/MaxPool:0 for ONNX tensor: sequential/max_pooling2d_1/MaxPool:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:186: sequential/max_pooling2d_1/MaxPool [MaxPool] outputs: [sequential/max_pooling2d_1/MaxPool:0 -> (-1, 128, 34, 34)], [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:108: Parsing node: sequential/conv2d_2/BiasAdd [Conv] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/max_pooling2d_1/MaxPool:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/conv2d_2/Conv2D/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/conv2d_2/BiasAdd/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:130: sequential/conv2d_2/BiasAdd [Conv] inputs: [sequential/max_pooling2d_1/MaxPool:0 -> (-1, 128, 34, 34)], [sequential/conv2d_2/Conv2D/ReadVariableOp:0 -> (64, 128, 3, 3)], [sequential/conv2d_2/BiasAdd/ReadVariableOp:0 -> (64)], [03/14/2023-12:51:53] [V] [TRT] builtin_op_importers.cpp:441: Convolution input dimensions: (-1, 128, 34, 34) [03/14/2023-12:51:53] [V] [TRT] builtin_op_importers.cpp:523: Using kernel: (3, 3), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 64 [03/14/2023-12:51:53] [V] [TRT] builtin_op_importers.cpp:524: Convolution output dimensions: (-1, 64, 32, 32) [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sequential/conv2d_2/BiasAdd for ONNX node: sequential/conv2d_2/BiasAdd [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sequential/conv2d_2/BiasAdd:0 for ONNX tensor: sequential/conv2d_2/BiasAdd:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:186: sequential/conv2d_2/BiasAdd [Conv] outputs: [sequential/conv2d_2/BiasAdd:0 -> (-1, 64, 32, 32)], [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:108: Parsing node: sequential/conv2d_2/Relu [Relu] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/conv2d_2/BiasAdd:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:130: sequential/conv2d_2/Relu [Relu] inputs: [sequential/conv2d_2/BiasAdd:0 -> (-1, 64, 32, 32)], [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sequential/conv2d_2/Relu for ONNX node: sequential/conv2d_2/Relu [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sequential/conv2d_2/Relu:0 for ONNX tensor: sequential/conv2d_2/Relu:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:186: sequential/conv2d_2/Relu [Relu] outputs: [sequential/conv2d_2/Relu:0 -> (-1, 64, 32, 32)], [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:108: Parsing node: sequential/max_pooling2d_2/MaxPool [MaxPool] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/conv2d_2/Relu:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:130: sequential/max_pooling2d_2/MaxPool [MaxPool] inputs: [sequential/conv2d_2/Relu:0 -> (-1, 64, 32, 32)], [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sequential/max_pooling2d_2/MaxPool for ONNX node: sequential/max_pooling2d_2/MaxPool [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sequential/max_pooling2d_2/MaxPool:0 for ONNX tensor: sequential/max_pooling2d_2/MaxPool:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:186: sequential/max_pooling2d_2/MaxPool [MaxPool] outputs: [sequential/max_pooling2d_2/MaxPool:0 -> (-1, 64, 16, 16)], [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:108: Parsing node: sequential/conv2d_3/BiasAdd [Conv] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/max_pooling2d_2/MaxPool:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/conv2d_3/Conv2D/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/conv2d_3/BiasAdd/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:130: sequential/conv2d_3/BiasAdd [Conv] inputs: [sequential/max_pooling2d_2/MaxPool:0 -> (-1, 64, 16, 16)], [sequential/conv2d_3/Conv2D/ReadVariableOp:0 -> (32, 64, 3, 3)], [sequential/conv2d_3/BiasAdd/ReadVariableOp:0 -> (32)], [03/14/2023-12:51:53] [V] [TRT] builtin_op_importers.cpp:441: Convolution input dimensions: (-1, 64, 16, 16) [03/14/2023-12:51:53] [V] [TRT] builtin_op_importers.cpp:523: Using kernel: (3, 3), strides: (1, 1), padding: (0, 0), dilations: (1, 1), numOutputs: 32 [03/14/2023-12:51:53] [V] [TRT] builtin_op_importers.cpp:524: Convolution output dimensions: (-1, 32, 14, 14) [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sequential/conv2d_3/BiasAdd for ONNX node: sequential/conv2d_3/BiasAdd [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sequential/conv2d_3/BiasAdd:0 for ONNX tensor: sequential/conv2d_3/BiasAdd:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:186: sequential/conv2d_3/BiasAdd [Conv] outputs: [sequential/conv2d_3/BiasAdd:0 -> (-1, 32, 14, 14)], [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:108: Parsing node: sequential/conv2d_3/Relu [Relu] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/conv2d_3/BiasAdd:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:130: sequential/conv2d_3/Relu [Relu] inputs: [sequential/conv2d_3/BiasAdd:0 -> (-1, 32, 14, 14)], [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sequential/conv2d_3/Relu for ONNX node: sequential/conv2d_3/Relu [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sequential/conv2d_3/Relu:0 for ONNX tensor: sequential/conv2d_3/Relu:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:186: sequential/conv2d_3/Relu [Relu] outputs: [sequential/conv2d_3/Relu:0 -> (-1, 32, 14, 14)], [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:108: Parsing node: sequential/max_pooling2d_3/MaxPool [MaxPool] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/conv2d_3/Relu:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:130: sequential/max_pooling2d_3/MaxPool [MaxPool] inputs: [sequential/conv2d_3/Relu:0 -> (-1, 32, 14, 14)], [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sequential/max_pooling2d_3/MaxPool for ONNX node: sequential/max_pooling2d_3/MaxPool [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sequential/max_pooling2d_3/MaxPool:0 for ONNX tensor: sequential/max_pooling2d_3/MaxPool:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:186: sequential/max_pooling2d_3/MaxPool [MaxPool] outputs: [sequential/max_pooling2d_3/MaxPool:0 -> (-1, 32, 7, 7)], [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:108: Parsing node: sequential/max_pooling2d_3/MaxPool__75 [Transpose] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/max_pooling2d_3/MaxPool:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:130: sequential/max_pooling2d_3/MaxPool__75 [Transpose] inputs: [sequential/max_pooling2d_3/MaxPool:0 -> (-1, 32, 7, 7)], [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sequential/max_pooling2d_3/MaxPool__75 for ONNX node: sequential/max_pooling2d_3/MaxPool__75 [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sequential/max_pooling2d_3/MaxPool__75:0 for ONNX tensor: sequential/max_pooling2d_3/MaxPool__75:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:186: sequential/max_pooling2d_3/MaxPool__75 [Transpose] outputs: [sequential/max_pooling2d_3/MaxPool__75:0 -> (-1, 7, 7, 32)], [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:108: Parsing node: sequential/flatten/Reshape [Reshape] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/max_pooling2d_3/MaxPool__75:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: const_fold_opt__78 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:130: sequential/flatten/Reshape [Reshape] inputs: [sequential/max_pooling2d_3/MaxPool__75:0 -> (-1, 7, 7, 32)], [const_fold_opt__78 -> (2)], [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sequential/flatten/Reshape for ONNX node: sequential/flatten/Reshape [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sequential/flatten/Reshape:0 for ONNX tensor: sequential/flatten/Reshape:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:186: sequential/flatten/Reshape [Reshape] outputs: [sequential/flatten/Reshape:0 -> (-1, 1568)], [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:108: Parsing node: sequential/dense/MatMul [MatMul] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/flatten/Reshape:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/dense/MatMul/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:130: sequential/dense/MatMul [MatMul] inputs: [sequential/flatten/Reshape:0 -> (-1, 1568)], [sequential/dense/MatMul/ReadVariableOp:0 -> (1568, 64)], [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sequential/dense/MatMul for ONNX node: sequential/dense/MatMul [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sequential/dense/MatMul:0 for ONNX tensor: sequential/dense/MatMul:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:186: sequential/dense/MatMul [MatMul] outputs: [sequential/dense/MatMul:0 -> (-1, 64)], [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:108: Parsing node: sequential/dense/BiasAdd [Add] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/dense/MatMul:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/dense/BiasAdd/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:130: sequential/dense/BiasAdd [Add] inputs: [sequential/dense/MatMul:0 -> (-1, 64)], [sequential/dense/BiasAdd/ReadVariableOp:0 -> (64)], [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sequential/dense/BiasAdd for ONNX node: sequential/dense/BiasAdd [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sequential/dense/BiasAdd:0 for ONNX tensor: sequential/dense/BiasAdd:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:186: sequential/dense/BiasAdd [Add] outputs: [sequential/dense/BiasAdd:0 -> (-1, 64)], [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:108: Parsing node: sequential/dense/Relu [Relu] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/dense/BiasAdd:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:130: sequential/dense/Relu [Relu] inputs: [sequential/dense/BiasAdd:0 -> (-1, 64)], [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sequential/dense/Relu for ONNX node: sequential/dense/Relu [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sequential/dense/Relu:0 for ONNX tensor: sequential/dense/Relu:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:186: sequential/dense/Relu [Relu] outputs: [sequential/dense/Relu:0 -> (-1, 64)], [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:108: Parsing node: sequential/dense_1/MatMul [MatMul] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/dense/Relu:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/dense_1/MatMul/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:130: sequential/dense_1/MatMul [MatMul] inputs: [sequential/dense/Relu:0 -> (-1, 64)], [sequential/dense_1/MatMul/ReadVariableOp:0 -> (64, 4)], [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sequential/dense_1/MatMul for ONNX node: sequential/dense_1/MatMul [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sequential/dense_1/MatMul:0 for ONNX tensor: sequential/dense_1/MatMul:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:186: sequential/dense_1/MatMul [MatMul] outputs: [sequential/dense_1/MatMul:0 -> (-1, 4)], [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:108: Parsing node: sequential/dense_1/BiasAdd [Add] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/dense_1/MatMul:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/dense_1/BiasAdd/ReadVariableOp:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:130: sequential/dense_1/BiasAdd [Add] inputs: [sequential/dense_1/MatMul:0 -> (-1, 4)], [sequential/dense_1/BiasAdd/ReadVariableOp:0 -> (4)], [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sequential/dense_1/BiasAdd for ONNX node: sequential/dense_1/BiasAdd [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sequential/dense_1/BiasAdd:0 for ONNX tensor: sequential/dense_1/BiasAdd:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:186: sequential/dense_1/BiasAdd [Add] outputs: [sequential/dense_1/BiasAdd:0 -> (-1, 4)], [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:108: Parsing node: sequential/dense_1/Softmax [Softmax] [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:124: Searching for input: sequential/dense_1/BiasAdd:0 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:130: sequential/dense_1/Softmax [Softmax] inputs: [sequential/dense_1/BiasAdd:0 -> (-1, 4)], [03/14/2023-12:51:53] [03/14/2023-12:51:53] [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sequential/dense_1/Softmax for ONNX node: sequential/dense_1/Softmax [03/14/2023-12:51:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: dense_1_1 for ONNX tensor: dense_1 [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:186: sequential/dense_1/Softmax [Softmax] outputs: [dense_1 -> (-1, -1)], [03/14/2023-12:51:53] [V] [TRT] ModelImporter.cpp:500: Marking dense_1_1 as output: dense_1 ----- Parsing of ONNX model /home/adascoe/Sainath/Model/Mar3_3.onnx is Done ---- [03/14/2023-12:51:53]