&&&& RUNNING TensorRT.trtexec [TensorRT v8001] # trtexec --onnx=/home/kirill/trt-optimizer/model_knn.onnx --verbose --explicitBatch
[08/13/2021-18:28:01] [I] === Model Options ===
[08/13/2021-18:28:01] [I] Format: ONNX
[08/13/2021-18:28:01] [I] Model: /home/kirill/trt-optimizer/model_knn.onnx
[08/13/2021-18:28:01] [I] Output:
[08/13/2021-18:28:01] [I] === Build Options ===
[08/13/2021-18:28:01] [I] Max batch: explicit
[08/13/2021-18:28:01] [I] Workspace: 16 MiB
[08/13/2021-18:28:01] [I] minTiming: 1
[08/13/2021-18:28:01] [I] avgTiming: 8
[08/13/2021-18:28:01] [I] Precision: FP32
[08/13/2021-18:28:01] [I] Calibration: 
[08/13/2021-18:28:01] [I] Refit: Disabled
[08/13/2021-18:28:01] [I] Sparsity: Disabled
[08/13/2021-18:28:01] [I] Safe mode: Disabled
[08/13/2021-18:28:01] [I] Restricted mode: Disabled
[08/13/2021-18:28:01] [I] Save engine: 
[08/13/2021-18:28:01] [I] Load engine: 
[08/13/2021-18:28:01] [I] NVTX verbosity: 0
[08/13/2021-18:28:01] [I] Tactic sources: Using default tactic sources
[08/13/2021-18:28:01] [I] timingCacheMode: local
[08/13/2021-18:28:01] [I] timingCacheFile: 
[08/13/2021-18:28:01] [I] Input(s)s format: fp32:CHW
[08/13/2021-18:28:01] [I] Output(s)s format: fp32:CHW
[08/13/2021-18:28:01] [I] Input build shapes: model
[08/13/2021-18:28:01] [I] Input calibration shapes: model
[08/13/2021-18:28:01] [I] === System Options ===
[08/13/2021-18:28:01] [I] Device: 0
[08/13/2021-18:28:01] [I] DLACore: 
[08/13/2021-18:28:01] [I] Plugins:
[08/13/2021-18:28:01] [I] === Inference Options ===
[08/13/2021-18:28:01] [I] Batch: Explicit
[08/13/2021-18:28:01] [I] Input inference shapes: model
[08/13/2021-18:28:01] [I] Iterations: 10
[08/13/2021-18:28:01] [I] Duration: 3s (+ 200ms warm up)
[08/13/2021-18:28:01] [I] Sleep time: 0ms
[08/13/2021-18:28:01] [I] Streams: 1
[08/13/2021-18:28:01] [I] ExposeDMA: Disabled
[08/13/2021-18:28:01] [I] Data transfers: Enabled
[08/13/2021-18:28:01] [I] Spin-wait: Disabled
[08/13/2021-18:28:01] [I] Multithreading: Disabled
[08/13/2021-18:28:01] [I] CUDA Graph: Disabled
[08/13/2021-18:28:01] [I] Separate profiling: Disabled
[08/13/2021-18:28:01] [I] Time Deserialize: Disabled
[08/13/2021-18:28:01] [I] Time Refit: Disabled
[08/13/2021-18:28:01] [I] Skip inference: Disabled
[08/13/2021-18:28:01] [I] Inputs:
[08/13/2021-18:28:01] [I] === Reporting Options ===
[08/13/2021-18:28:01] [I] Verbose: Enabled
[08/13/2021-18:28:01] [I] Averages: 10 inferences
[08/13/2021-18:28:01] [I] Percentile: 99
[08/13/2021-18:28:01] [I] Dump refittable layers:Disabled
[08/13/2021-18:28:01] [I] Dump output: Disabled
[08/13/2021-18:28:01] [I] Profile: Disabled
[08/13/2021-18:28:01] [I] Export timing to JSON file: 
[08/13/2021-18:28:01] [I] Export output to JSON file: 
[08/13/2021-18:28:01] [I] Export profile to JSON file: 
[08/13/2021-18:28:01] [I] 
[08/13/2021-18:28:01] [I] === Device Information ===
[08/13/2021-18:28:01] [I] Selected Device: GeForce RTX 2080 Ti
[08/13/2021-18:28:01] [I] Compute Capability: 7.5
[08/13/2021-18:28:01] [I] SMs: 68
[08/13/2021-18:28:01] [I] Compute Clock Rate: 1.545 GHz
[08/13/2021-18:28:01] [I] Device Global Memory: 11016 MiB
[08/13/2021-18:28:01] [I] Shared Memory per SM: 64 KiB
[08/13/2021-18:28:01] [I] Memory Bus Width: 352 bits (ECC disabled)
[08/13/2021-18:28:01] [I] Memory Clock Rate: 7 GHz
[08/13/2021-18:28:01] [I] 
[08/13/2021-18:28:01] [I] TensorRT version: 8001
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::Region_TRT version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::ScatterND version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::CropAndResize version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::EfficientNMS_TRT version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::Proposal version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::Split version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1
[08/13/2021-18:28:01] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1
[08/13/2021-18:28:02] [I] [TRT] [MemUsageChange] Init CUDA: CPU +334, GPU +0, now: CPU 340, GPU 658 (MiB)
[08/13/2021-18:28:02] [I] Start parsing network model
[08/13/2021-18:28:02] [I] [TRT] ----------------------------------------------------------------
[08/13/2021-18:28:02] [I] [TRT] Input filename:   /home/kirill/trt-optimizer/model_knn.onnx
[08/13/2021-18:28:02] [I] [TRT] ONNX IR version:  0.0.6
[08/13/2021-18:28:02] [I] [TRT] Opset version:    13
[08/13/2021-18:28:02] [I] [TRT] Producer name:    pytorch
[08/13/2021-18:28:02] [I] [TRT] Producer version: 1.9
[08/13/2021-18:28:02] [I] [TRT] Domain:           
[08/13/2021-18:28:02] [I] [TRT] Model version:    0
[08/13/2021-18:28:02] [I] [TRT] Doc string:       
[08/13/2021-18:28:02] [I] [TRT] ----------------------------------------------------------------
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::ScatterND version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TRT version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::Proposal version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::Split version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1
[08/13/2021-18:28:02] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1
[08/13/2021-18:28:02] [V] [TRT] Adding network input: input with dtype: float32, dimensions: (-1, 39)
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: input for ONNX tensor: input
[08/13/2021-18:28:02] [V] [TRT] Adding network input: xyz.1 with dtype: float32, dimensions: (2380, 3)
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: xyz.1 for ONNX tensor: xyz.1
[08/13/2021-18:28:02] [V] [TRT] Importing initializer: linear3.weight
[08/13/2021-18:28:02] [V] [TRT] Importing initializer: linear3.bias
[08/13/2021-18:28:02] [V] [TRT] Importing initializer: linear1.weight
[08/13/2021-18:28:02] [V] [TRT] Importing initializer: linear1.bias
[08/13/2021-18:28:02] [V] [TRT] Importing initializer: linear2.bias
[08/13/2021-18:28:02] [V] [TRT] Importing initializer: 125
[08/13/2021-18:28:02] [08/13/2021-18:28:02] [V] [TRT] Importing initializer: 126
[08/13/2021-18:28:02] [V] [TRT] Importing initializer: 127
[08/13/2021-18:28:02] [V] [TRT] Importing initializer: 128
[08/13/2021-18:28:02] [V] [TRT] Importing initializer: 129
[08/13/2021-18:28:02] [V] [TRT] Importing initializer: 130
[08/13/2021-18:28:02] [V] [TRT] Importing initializer: 131
[08/13/2021-18:28:02] [V] [TRT] Importing initializer: 132
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_0 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_0 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_0 [Constant] outputs: [8 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Shape_1 [Shape]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: xyz.1
[08/13/2021-18:28:02] [V] [TRT] Shape_1 [Shape] inputs: [xyz.1 -> (2380, 3)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Shape_1 for ONNX node: Shape_1
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 12 for ONNX tensor: 12
[08/13/2021-18:28:02] [V] [TRT] Shape_1 [Shape] outputs: [12 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_2 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_2 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_2 [Constant] outputs: [13 -> ()[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Gather_3 [Gather]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 12
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 13
[08/13/2021-18:28:02] [V] [TRT] Gather_3 [Gather] inputs: [12 -> (2)[INT32]], [13 -> ()[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: 13 for ONNX node: 13
[08/13/2021-18:28:02] [V] [TRT] Using Gather axis: 0
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Gather_3 for ONNX node: Gather_3
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 14 for ONNX tensor: 14
[08/13/2021-18:28:02] [V] [TRT] Gather_3 [Gather] outputs: [14 -> ()[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Transpose_4 [Transpose]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: xyz.1
[08/13/2021-18:28:02] [V] [TRT] Transpose_4 [Transpose] inputs: [xyz.1 -> (2380, 3)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Transpose_4 for ONNX node: Transpose_4
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 15 for ONNX tensor: 15
[08/13/2021-18:28:02] [V] [TRT] Transpose_4 [Transpose] outputs: [15 -> (3, 2380)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: MatMul_5 [MatMul]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: xyz.1
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 15
[08/13/2021-18:28:02] [V] [TRT] MatMul_5 [MatMul] inputs: [xyz.1 -> (2380, 3)[FLOAT]], [15 -> (3, 2380)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: MatMul_5 for ONNX node: MatMul_5
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 16 for ONNX tensor: 16
[08/13/2021-18:28:02] [V] [TRT] MatMul_5 [MatMul] outputs: [16 -> (2380, 2380)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_6 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_6 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_6 [Constant] outputs: [17 -> ()[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Pow_7 [Pow]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: xyz.1
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 17
[08/13/2021-18:28:02] [V] [TRT] Pow_7 [Pow] inputs: [xyz.1 -> (2380, 3)[FLOAT]], [17 -> ()[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: 17 for ONNX node: 17
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Pow_7 for ONNX node: Pow_7
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 18 for ONNX tensor: 18
[08/13/2021-18:28:02] [V] [TRT] Pow_7 [Pow] outputs: [18 -> (2380, 3)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: ReduceSum_8 [ReduceSum]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 18
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 8
[08/13/2021-18:28:02] [V] [TRT] ReduceSum_8 [ReduceSum] inputs: [18 -> (2380, 3)[FLOAT]], [8 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: ReduceSum_8 for ONNX node: ReduceSum_8
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 19 for ONNX tensor: 19
[08/13/2021-18:28:02] [V] [TRT] ReduceSum_8 [ReduceSum] outputs: [19 -> (2380)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_9 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_9 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_9 [Constant] outputs: [20 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Unsqueeze_10 [Unsqueeze]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 14
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 20
[08/13/2021-18:28:02] [V] [TRT] Unsqueeze_10 [Unsqueeze] inputs: [14 -> ()[INT32]], [20 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Unsqueeze_10 for ONNX node: Unsqueeze_10
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 21 for ONNX tensor: 21
[08/13/2021-18:28:02] [V] [TRT] Unsqueeze_10 [Unsqueeze] outputs: [21 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Concat_11 [Concat]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 21
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 125
[08/13/2021-18:28:02] [V] [TRT] Concat_11 [Concat] inputs: [21 -> (1)[INT32]], [125 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: 125 for ONNX node: 125
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Concat_11 for ONNX node: Concat_11
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 24 for ONNX tensor: 24
[08/13/2021-18:28:02] [V] [TRT] Concat_11 [Concat] outputs: [24 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Reshape_12 [Reshape]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 19
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 24
[08/13/2021-18:28:02] [V] [TRT] Reshape_12 [Reshape] inputs: [19 -> (2380)[FLOAT]], [24 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Reshape_12 for ONNX node: Reshape_12
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 25 for ONNX tensor: 25
[08/13/2021-18:28:02] [V] [TRT] Reshape_12 [Reshape] outputs: [25 -> (2380, 1)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_13 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_13 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_13 [Constant] outputs: [26 -> ()[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Mul_14 [Mul]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 16
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 26
[08/13/2021-18:28:02] [V] [TRT] Mul_14 [Mul] inputs: [16 -> (2380, 2380)[FLOAT]], [26 -> ()[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: 26 for ONNX node: 26
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Mul_14 for ONNX node: Mul_14
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 27 for ONNX tensor: 27
[08/13/2021-18:28:02] [V] [TRT] Mul_14 [Mul] outputs: [27 -> (2380, 2380)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_15 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_15 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_15 [Constant] outputs: [30 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Unsqueeze_16 [Unsqueeze]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 14
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 30
[08/13/2021-18:28:02] [V] [TRT] Unsqueeze_16 [Unsqueeze] inputs: [14 -> ()[INT32]], [30 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Unsqueeze_16 for ONNX node: Unsqueeze_16
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 31 for ONNX tensor: 31
[08/13/2021-18:28:02] [V] [TRT] Unsqueeze_16 [Unsqueeze] outputs: [31 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Concat_17 [Concat]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 126
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 31
[08/13/2021-18:28:02] [V] [TRT] Concat_17 [Concat] inputs: [126 -> (1)[INT32]], [31 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: 126 for ONNX node: 126
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Concat_17 for ONNX node: Concat_17
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 32 for ONNX tensor: 32
[08/13/2021-18:28:02] [V] [TRT] Concat_17 [Concat] outputs: [32 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Reshape_18 [Reshape]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 19
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 32
[08/13/2021-18:28:02] [V] [TRT] Reshape_18 [Reshape] inputs: [19 -> (2380)[FLOAT]], [32 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Reshape_18 for ONNX node: Reshape_18
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 33 for ONNX tensor: 33
[08/13/2021-18:28:02] [V] [TRT] Reshape_18 [Reshape] outputs: [33 -> (1, 2380)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Add_19 [Add]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 27
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 25
[08/13/2021-18:28:02] [V] [TRT] Add_19 [Add] inputs: [27 -> (2380, 2380)[FLOAT]], [25 -> (2380, 1)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Add_19 for ONNX node: Add_19
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 34 for ONNX tensor: 34
[08/13/2021-18:28:02] [V] [TRT] Add_19 [Add] outputs: [34 -> (2380, 2380)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Add_20 [Add]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 34
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 33
[08/13/2021-18:28:02] [V] [TRT] Add_20 [Add] inputs: [34 -> (2380, 2380)[FLOAT]], [33 -> (1, 2380)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Add_20 for ONNX node: Add_20
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 35 for ONNX tensor: 35
[08/13/2021-18:28:02] [V] [TRT] Add_20 [Add] outputs: [35 -> (2380, 2380)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: TopK_21 [TopK]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 35
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 127
[08/13/2021-18:28:02] [V] [TRT] TopK_21 [TopK] inputs: [35 -> (2380, 2380)[FLOAT]], [127 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: TopK_21 for ONNX node: TopK_21
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 38 for ONNX tensor: 38
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 39 for ONNX tensor: 39
[08/13/2021-18:28:02] [V] [TRT] TopK_21 [TopK] outputs: [38 -> (2380, 16)[FLOAT]], [39 -> (2380, 16)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Gemm_22 [Gemm]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: xyz.1
[08/13/2021-18:28:02] [V] [TRT] Searching for input: linear3.weight
[08/13/2021-18:28:02] [V] [TRT] Searching for input: linear3.bias
[08/13/2021-18:28:02] [V] [TRT] Gemm_22 [Gemm] inputs: [xyz.1 -> (2380, 3)[FLOAT]], [linear3.weight -> (128, 3)[FLOAT]], [linear3.bias -> (128)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] GEMM: using FC layer instead of MM because all criteria were met.
[08/13/2021-18:28:02] [V] [TRT] Original shape: (2380, 3), unsqueezing to: (2380, 3, 1, 1)
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Gemm_22 for ONNX node: Gemm_22
[08/13/2021-18:28:02] [V] [TRT] Original shape: (2380, 128, 1, 1), squeezing to: (2380, 128)
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 40 for ONNX tensor: 40
[08/13/2021-18:28:02] [V] [TRT] Gemm_22 [Gemm] outputs: [40 -> (2380, 128)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Relu_23 [Relu]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 40
[08/13/2021-18:28:02] [V] [TRT] Relu_23 [Relu] inputs: [40 -> (2380, 128)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Relu_23 for ONNX node: Relu_23
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 41 for ONNX tensor: 41
[08/13/2021-18:28:02] [V] [TRT] Relu_23 [Relu] outputs: [41 -> (2380, 128)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_24 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_24 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_24 [Constant] outputs: [42 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Reshape_25 [Reshape]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 39
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 42
[08/13/2021-18:28:02] [V] [TRT] Reshape_25 [Reshape] inputs: [39 -> (2380, 16)[INT32]], [42 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Reshape_25 for ONNX node: Reshape_25
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 43 for ONNX tensor: 43
[08/13/2021-18:28:02] [V] [TRT] Reshape_25 [Reshape] outputs: [43 -> (38080)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_26 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_26 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_26 [Constant] outputs: [44 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Unsqueeze_27 [Unsqueeze]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 43
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 44
[08/13/2021-18:28:02] [V] [TRT] Unsqueeze_27 [Unsqueeze] inputs: [43 -> (38080)[INT32]], [44 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Original shape: (38080,), unsqueezing to: (38080, 1)
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Unsqueeze_27 for ONNX node: Unsqueeze_27
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 45 for ONNX tensor: 45
[08/13/2021-18:28:02] [V] [TRT] Unsqueeze_27 [Unsqueeze] outputs: [45 -> (38080, 1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Shape_28 [Shape]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 41
[08/13/2021-18:28:02] [V] [TRT] Shape_28 [Shape] inputs: [41 -> (2380, 128)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Shape_28 for ONNX node: Shape_28
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 46 for ONNX tensor: 46
[08/13/2021-18:28:02] [V] [TRT] Shape_28 [Shape] outputs: [46 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_29 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_29 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_29 [Constant] outputs: [47 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_30 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_30 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_30 [Constant] outputs: [48 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_31 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_31 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647
[08/13/2021-18:28:02] [08/13/2021-18:28:02] [V] [TRT] Constant_31 [Constant] outputs: [49 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Slice_32 [Slice]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 46
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 48
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 49
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 47
[08/13/2021-18:28:02] [V] [TRT] Slice_32 [Slice] inputs: [46 -> (2)[INT32]], [48 -> (1)[INT32]], [49 -> (1)[INT32]], [47 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Slice_32 for ONNX node: Slice_32
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 50 for ONNX tensor: 50
[08/13/2021-18:28:02] [V] [TRT] Slice_32 [Slice] outputs: [50 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_33 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_33 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_33 [Constant] outputs: [51 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Squeeze_34 [Squeeze]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 50
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 51
[08/13/2021-18:28:02] [V] [TRT] Squeeze_34 [Squeeze] inputs: [50 -> (1)[INT32]], [51 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Original shape: (1,), squeezing to: ()
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Squeeze_34 for ONNX node: Squeeze_34
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 52 for ONNX tensor: 52
[08/13/2021-18:28:02] [V] [TRT] Squeeze_34 [Squeeze] outputs: [52 -> ()[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_35 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_35 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_35 [Constant] outputs: [55 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Unsqueeze_36 [Unsqueeze]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 52
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 55
[08/13/2021-18:28:02] [V] [TRT] Unsqueeze_36 [Unsqueeze] inputs: [52 -> ()[INT32]], [55 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Unsqueeze_36 for ONNX node: Unsqueeze_36
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 56 for ONNX tensor: 56
[08/13/2021-18:28:02] [V] [TRT] Unsqueeze_36 [Unsqueeze] outputs: [56 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Concat_37 [Concat]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 128
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 56
[08/13/2021-18:28:02] [V] [TRT] Concat_37 [Concat] inputs: [128 -> (1)[INT32]], [56 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: 128 for ONNX node: 128
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Concat_37 for ONNX node: Concat_37
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 57 for ONNX tensor: 57
[08/13/2021-18:28:02] [V] [TRT] Concat_37 [Concat] outputs: [57 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_38 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_38 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_38 [Constant] outputs: [58 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Reshape_39 [Reshape]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 57
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 58
[08/13/2021-18:28:02] [V] [TRT] Reshape_39 [Reshape] inputs: [57 -> (2)[INT32]], [58 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Reshape_39 for ONNX node: Reshape_39
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 59 for ONNX tensor: 59
[08/13/2021-18:28:02] [V] [TRT] Reshape_39 [Reshape] outputs: [59 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Shape_40 [Shape]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 59
[08/13/2021-18:28:02] [V] [TRT] Shape_40 [Shape] inputs: [59 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Shape_40 for ONNX node: Shape_40
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 60 for ONNX tensor: 60
[08/13/2021-18:28:02] [V] [TRT] Shape_40 [Shape] outputs: [60 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: ConstantOfShape_41 [ConstantOfShape]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 60
[08/13/2021-18:28:02] [V] [TRT] ConstantOfShape_41 [ConstantOfShape] inputs: [60 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: ConstantOfShape_41 for ONNX node: ConstantOfShape_41
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 61 for ONNX tensor: 61
[08/13/2021-18:28:02] [V] [TRT] ConstantOfShape_41 [ConstantOfShape] outputs: [61 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_42 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_42 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_42 [Constant] outputs: [62 -> ()[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Mul_43 [Mul]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 61
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 62
[08/13/2021-18:28:02] [V] [TRT] Mul_43 [Mul] inputs: [61 -> (2)[INT32]], [62 -> ()[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: 62 for ONNX node: 62
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Mul_43 for ONNX node: Mul_43
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 63 for ONNX tensor: 63
[08/13/2021-18:28:02] [V] [TRT] Mul_43 [Mul] outputs: [63 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Equal_44 [Equal]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 59
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 63
[08/13/2021-18:28:02] [V] [TRT] Equal_44 [Equal] inputs: [59 -> (2)[INT32]], [63 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Equal_44 for ONNX node: Equal_44
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 64 for ONNX tensor: 64
[08/13/2021-18:28:02] [V] [TRT] Equal_44 [Equal] outputs: [64 -> (2)[BOOL]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Where_45 [Where]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 64
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 61
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 59
[08/13/2021-18:28:02] [V] [TRT] Where_45 [Where] inputs: [64 -> (2)[BOOL]], [61 -> (2)[INT32]], [59 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Where_45 for ONNX node: Where_45
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 65 for ONNX tensor: 65
[08/13/2021-18:28:02] [V] [TRT] Where_45 [Where] outputs: [65 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Expand_46 [Expand]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 45
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 65
[08/13/2021-18:28:02] [V] [TRT] Expand_46 [Expand] inputs: [45 -> (38080, 1)[INT32]], [65 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Expand_46 for ONNX node: Expand_46
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 66 for ONNX tensor: 66
[08/13/2021-18:28:02] [V] [TRT] Expand_46 [Expand] outputs: [66 -> (38080, 128)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: GatherElements_47 [GatherElements]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 41
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 66
[08/13/2021-18:28:02] [V] [TRT] GatherElements_47 [GatherElements] inputs: [41 -> (2380, 128)[FLOAT]], [66 -> (38080, 128)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Using Gather axis: 0
[08/13/2021-18:28:02] [V] [TRT] Registering layer: GatherElements_47 for ONNX node: GatherElements_47
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 67 for ONNX tensor: 67
[08/13/2021-18:28:02] [V] [TRT] GatherElements_47 [GatherElements] outputs: [67 -> (38080, 128)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Shape_48 [Shape]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 41
[08/13/2021-18:28:02] [V] [TRT] Shape_48 [Shape] inputs: [41 -> (2380, 128)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Shape_48 for ONNX node: Shape_48
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 68 for ONNX tensor: 68
[08/13/2021-18:28:02] [V] [TRT] Shape_48 [Shape] outputs: [68 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_49 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_49 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_49 [Constant] outputs: [69 -> ()[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Gather_50 [Gather]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 68
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 69
[08/13/2021-18:28:02] [V] [TRT] Gather_50 [Gather] inputs: [68 -> (2)[INT32]], [69 -> ()[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: 69 for ONNX node: 69
[08/13/2021-18:28:02] [V] [TRT] Using Gather axis: 0
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Gather_50 for ONNX node: Gather_50
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 70 for ONNX tensor: 70
[08/13/2021-18:28:02] [V] [TRT] Gather_50 [Gather] outputs: [70 -> ()[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Shape_51 [Shape]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 41
[08/13/2021-18:28:02] [V] [TRT] Shape_51 [Shape] inputs: [41 -> (2380, 128)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Shape_51 for ONNX node: Shape_51
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 71 for ONNX tensor: 71
[08/13/2021-18:28:02] [V] [TRT] Shape_51 [Shape] outputs: [71 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_52 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_52 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_52 [Constant] outputs: [72 -> ()[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Gather_53 [Gather]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 71
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 72
[08/13/2021-18:28:02] [V] [TRT] Gather_53 [Gather] inputs: [71 -> (2)[INT32]], [72 -> ()[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: 72 for ONNX node: 72
[08/13/2021-18:28:02] [V] [TRT] Using Gather axis: 0
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Gather_53 for ONNX node: Gather_53
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 73 for ONNX tensor: 73
[08/13/2021-18:28:02] [V] [TRT] Gather_53 [Gather] outputs: [73 -> ()[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_54 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_54 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_54 [Constant] outputs: [74 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Unsqueeze_55 [Unsqueeze]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 70
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 74
[08/13/2021-18:28:02] [V] [TRT] Unsqueeze_55 [Unsqueeze] inputs: [70 -> ()[INT32]], [74 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Unsqueeze_55 for ONNX node: Unsqueeze_55
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 75 for ONNX tensor: 75
[08/13/2021-18:28:02] [V] [TRT] Unsqueeze_55 [Unsqueeze] outputs: [75 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_56 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_56 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_56 [Constant] outputs: [78 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Unsqueeze_57 [Unsqueeze]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 73
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 78
[08/13/2021-18:28:02] [V] [TRT] Unsqueeze_57 [Unsqueeze] inputs: [73 -> ()[INT32]], [78 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Unsqueeze_57 for ONNX node: Unsqueeze_57
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 79 for ONNX tensor: 79
[08/13/2021-18:28:02] [V] [TRT] Unsqueeze_57 [Unsqueeze] outputs: [79 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Concat_58 [Concat]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 75
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 129
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 79
[08/13/2021-18:28:02] [V] [TRT] Concat_58 [Concat] inputs: [75 -> (1)[INT32]], [129 -> (1)[INT32]], [79 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: 129 for ONNX node: 129
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Concat_58 for ONNX node: Concat_58
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 80 for ONNX tensor: 80
[08/13/2021-18:28:02] [V] [TRT] Concat_58 [Concat] outputs: [80 -> (3)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Reshape_59 [Reshape]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 67
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 80
[08/13/2021-18:28:02] [V] [TRT] Reshape_59 [Reshape] inputs: [67 -> (38080, 128)[FLOAT]], [80 -> (3)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Reshape_59 for ONNX node: Reshape_59
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 81 for ONNX tensor: 81
[08/13/2021-18:28:02] [V] [TRT] Reshape_59 [Reshape] outputs: [81 -> (2380, 16, 128)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Gemm_60 [Gemm]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: input
[08/13/2021-18:28:02] [V] [TRT] Searching for input: linear1.weight
[08/13/2021-18:28:02] [V] [TRT] Searching for input: linear1.bias
[08/13/2021-18:28:02] [V] [TRT] Gemm_60 [Gemm] inputs: [input -> (-1, 39)[FLOAT]], [linear1.weight -> (128, 39)[FLOAT]], [linear1.bias -> (128)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] GEMM: using FC layer instead of MM because all criteria were met.
[08/13/2021-18:28:02] [V] [TRT] Original shape: (_, 39), unsqueezing to: (_, _, _, _)
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Gemm_60 for ONNX node: Gemm_60
[08/13/2021-18:28:02] [V] [TRT] Original shape: (_, 128, 1, 1), squeezing to: (_, _)
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 82 for ONNX tensor: 82
[08/13/2021-18:28:02] [V] [TRT] Gemm_60 [Gemm] outputs: [82 -> (-1, 128)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Relu_61 [Relu]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 82
[08/13/2021-18:28:02] [V] [TRT] Relu_61 [Relu] inputs: [82 -> (-1, 128)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Relu_61 for ONNX node: Relu_61
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 83 for ONNX tensor: 83
[08/13/2021-18:28:02] [V] [TRT] Relu_61 [Relu] outputs: [83 -> (-1, 128)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Shape_62 [Shape]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 83
[08/13/2021-18:28:02] [V] [TRT] Shape_62 [Shape] inputs: [83 -> (-1, 128)[FLOAT]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Shape_62 for ONNX node: Shape_62
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 84 for ONNX tensor: 84
[08/13/2021-18:28:02] [V] [TRT] Shape_62 [Shape] outputs: [84 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_63 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_63 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_63 [Constant] outputs: [85 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_64 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_64 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_64 [Constant] outputs: [86 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_65 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_65 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647
[08/13/2021-18:28:02] [08/13/2021-18:28:02] [V] [TRT] Constant_65 [Constant] outputs: [87 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Slice_66 [Slice]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 84
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 86
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 87
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 85
[08/13/2021-18:28:02] [V] [TRT] Slice_66 [Slice] inputs: [84 -> (2)[INT32]], [86 -> (1)[INT32]], [87 -> (1)[INT32]], [85 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Slice_66 for ONNX node: Slice_66
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 88 for ONNX tensor: 88
[08/13/2021-18:28:02] [V] [TRT] Slice_66 [Slice] outputs: [88 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_67 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_67 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_67 [Constant] outputs: [89 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Squeeze_68 [Squeeze]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 88
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 89
[08/13/2021-18:28:02] [V] [TRT] Squeeze_68 [Squeeze] inputs: [88 -> (1)[INT32]], [89 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Original shape: (1,), squeezing to: ()
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Squeeze_68 for ONNX node: Squeeze_68
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 90 for ONNX tensor: 90
[08/13/2021-18:28:02] [V] [TRT] Squeeze_68 [Squeeze] outputs: [90 -> ()[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_69 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_69 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_69 [Constant] outputs: [93 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Unsqueeze_70 [Unsqueeze]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 90
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 93
[08/13/2021-18:28:02] [V] [TRT] Unsqueeze_70 [Unsqueeze] inputs: [90 -> ()[INT32]], [93 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Unsqueeze_70 for ONNX node: Unsqueeze_70
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 94 for ONNX tensor: 94
[08/13/2021-18:28:02] [V] [TRT] Unsqueeze_70 [Unsqueeze] outputs: [94 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Concat_71 [Concat]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 130
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 94
[08/13/2021-18:28:02] [V] [TRT] Concat_71 [Concat] inputs: [130 -> (1)[INT32]], [94 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: 130 for ONNX node: 130
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Concat_71 for ONNX node: Concat_71
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 95 for ONNX tensor: 95
[08/13/2021-18:28:02] [V] [TRT] Concat_71 [Concat] outputs: [95 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_72 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_72 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_72 [Constant] outputs: [96 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Reshape_73 [Reshape]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 95
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 96
[08/13/2021-18:28:02] [V] [TRT] Reshape_73 [Reshape] inputs: [95 -> (2)[INT32]], [96 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Reshape_73 for ONNX node: Reshape_73
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 97 for ONNX tensor: 97
[08/13/2021-18:28:02] [V] [TRT] Reshape_73 [Reshape] outputs: [97 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Shape_74 [Shape]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 97
[08/13/2021-18:28:02] [V] [TRT] Shape_74 [Shape] inputs: [97 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Shape_74 for ONNX node: Shape_74
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 98 for ONNX tensor: 98
[08/13/2021-18:28:02] [V] [TRT] Shape_74 [Shape] outputs: [98 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: ConstantOfShape_75 [ConstantOfShape]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 98
[08/13/2021-18:28:02] [V] [TRT] ConstantOfShape_75 [ConstantOfShape] inputs: [98 -> (1)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: ConstantOfShape_75 for ONNX node: ConstantOfShape_75
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 99 for ONNX tensor: 99
[08/13/2021-18:28:02] [V] [TRT] ConstantOfShape_75 [ConstantOfShape] outputs: [99 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Constant_76 [Constant]
[08/13/2021-18:28:02] [V] [TRT] Constant_76 [Constant] inputs: 
[08/13/2021-18:28:02] [V] [TRT] Constant_76 [Constant] outputs: [100 -> ()[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Mul_77 [Mul]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 99
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 100
[08/13/2021-18:28:02] [V] [TRT] Mul_77 [Mul] inputs: [99 -> (2)[INT32]], [100 -> ()[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: 100 for ONNX node: 100
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Mul_77 for ONNX node: Mul_77
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 101 for ONNX tensor: 101
[08/13/2021-18:28:02] [V] [TRT] Mul_77 [Mul] outputs: [101 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Equal_78 [Equal]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 97
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 101
[08/13/2021-18:28:02] [V] [TRT] Equal_78 [Equal] inputs: [97 -> (2)[INT32]], [101 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Equal_78 for ONNX node: Equal_78
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 102 for ONNX tensor: 102
[08/13/2021-18:28:02] [V] [TRT] Equal_78 [Equal] outputs: [102 -> (2)[BOOL]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Where_79 [Where]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 102
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 99
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 97
[08/13/2021-18:28:02] [V] [TRT] Where_79 [Where] inputs: [102 -> (2)[BOOL]], [99 -> (2)[INT32]], [97 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Where_79 for ONNX node: Where_79
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 103 for ONNX tensor: 103
[08/13/2021-18:28:02] [V] [TRT] Where_79 [Where] outputs: [103 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: Expand_80 [Expand]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 45
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 103
[08/13/2021-18:28:02] [V] [TRT] Expand_80 [Expand] inputs: [45 -> (38080, 1)[INT32]], [103 -> (2)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Registering layer: Expand_80 for ONNX node: Expand_80
[08/13/2021-18:28:02] [V] [TRT] Registering tensor: 104 for ONNX tensor: 104
[08/13/2021-18:28:02] [V] [TRT] Expand_80 [Expand] outputs: [104 -> (38080, 128)[INT32]], 
[08/13/2021-18:28:02] [V] [TRT] Parsing node: GatherElements_81 [GatherElements]
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 83
[08/13/2021-18:28:02] [V] [TRT] Searching for input: 104
[08/13/2021-18:28:02] [V] [TRT] GatherElements_81 [GatherElements] inputs: [83 -> (-1, 128)[FLOAT]], [104 -> (38080, 128)[INT32]], 
[08/13/2021-18:28:02] [08/13/2021-18:28:02] [08/13/2021-18:28:02] [08/13/2021-18:28:02] [08/13/2021-18:28:02] [08/13/2021-18:28:02] [08/13/2021-18:28:02] [I] Finish parsing network model
[08/13/2021-18:28:02] [08/13/2021-18:28:02] [08/13/2021-18:28:02] &&&& FAILED TensorRT.trtexec [TensorRT v8001] # trtexec --onnx=/home/kirill/trt-optimizer/model_knn.onnx --verbose --explicitBatch