DlewareAnalyzer report:
===============================================================
onnx version -  1.12.0
onnxsimplifier version -  unknown
onnxruntime version -  1.10.0
Onnx Runtime device -  CPU
onnx model IR version -  7
onnx model producer name -  
onnx model producer version -  
Model inputs:
[name: "keypoints"
type {
  tensor_type {
    elem_type: 1
    shape {
      dim {
        dim_param: "batch"
      }
      dim {
        dim_param: "indexs"
      }
      dim {
        dim_param: "coordinates"
      }
    }
  }
}
, name: "scores.1"
type {
  tensor_type {
    elem_type: 1
    shape {
      dim {
        dim_param: "batch"
      }
      dim {
        dim_param: "indexs"
      }
    }
  }
}
, name: "score_map"
type {
  tensor_type {
    elem_type: 1
    shape {
      dim {
        dim_param: "batch"
      }
      dim {
        dim_param: "x"
      }
      dim {
        dim_param: "y"
      }
      dim {
        dim_param: "z"
      }
    }
  }
}
, name: "dense_feat_map"
type {
  tensor_type {
    elem_type: 1
    shape {
      dim {
        dim_param: "batch"
      }
      dim {
        dim_param: "s"
      }
      dim {
        dim_param: "t"
      }
      dim {
        dim_param: "v"
      }
    }
  }
}
]
CAUTION!!! - Tensor input name -  keypoints , dimension -  batch , set its value to 1 for Onnx simplify operation
CAUTION!!! - Tensor input name -  keypoints , dimension -  indexs , set its value to 1 for Onnx simplify operation
CAUTION!!! - Tensor input name -  keypoints , dimension -  coordinates , set its value to 1 for Onnx simplify operation
CAUTION!!! - Tensor input name -  scores.1 , dimension -  batch , set its value to 1 for Onnx simplify operation
CAUTION!!! - Tensor input name -  scores.1 , dimension -  indexs , set its value to 1 for Onnx simplify operation
CAUTION!!! - Tensor input name -  score_map , dimension -  batch , set its value to 1 for Onnx simplify operation
CAUTION!!! - Tensor input name -  score_map , dimension -  x , set its value to 1 for Onnx simplify operation
CAUTION!!! - Tensor input name -  score_map , dimension -  y , set its value to 1 for Onnx simplify operation
CAUTION!!! - Tensor input name -  score_map , dimension -  z , set its value to 1 for Onnx simplify operation
CAUTION!!! - Tensor input name -  dense_feat_map , dimension -  batch , set its value to 1 for Onnx simplify operation
CAUTION!!! - Tensor input name -  dense_feat_map , dimension -  s , set its value to 1 for Onnx simplify operation
CAUTION!!! - Tensor input name -  dense_feat_map , dimension -  t , set its value to 1 for Onnx simplify operation
CAUTION!!! - Tensor input name -  dense_feat_map , dimension -  v , set its value to 1 for Onnx simplify operation
Model outputs:
[name: "descs"
type {
  tensor_type {
    elem_type: 1
    shape {
      dim {
        dim_param: "Divdescs_dim_0"
      }
      dim {
        dim_param: "Divdescs_dim_1"
      }
      dim {
        dim_param: "Divdescs_dim_2"
      }
    }
  }
}
, name: "kpts"
type {
  tensor_type {
    elem_type: 1
    shape {
      dim {
        dim_param: "Gatherkpts_dim_0"
      }
      dim {
        dim_param: "Gatherkpts_dim_1"
      }
      dim {
        dim_param: "Gatherkpts_dim_2"
      }
    }
  }
}
, name: "scores"
type {
  tensor_type {
    elem_type: 1
    shape {
      dim {
        dim_param: "indexs"
      }
      dim {
        dim_param: "batch"
      }
    }
  }
}
]
===============================================================
Onnx model check report:
Model check completed Successfully
Model onnx checker, check model -  OK
/home/hpc/.local/lib/python3.8/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py:55: UserWarning: Specified provider 'CUDAExecutionProvider' is not in available provider names.Available providers: 'CPUExecutionProvider'
  warnings.warn("Specified provider '{}' is not in available provider names."
Onnx Runtime providers -  ['CPUExecutionProvider']
Onnx analyzer initialization completion!
===============================================================
trt version -  8.4.0.11
pandas version -  0.25.3

INSTALLED VERSIONS
------------------
commit           : None
python           : 3.8.10.final.0
python-bits      : 64
OS               : Linux
OS-release       : 5.10.65-tegra
machine          : aarch64
processor        : aarch64
byteorder        : little
LC_ALL           : None
LANG             : en_IL
LOCALE           : en_IL.UTF-8

pandas           : 0.25.3
numpy            : 1.23.1
pytz             : 2019.3
dateutil         : 2.7.3
pip              : 20.0.2
setuptools       : 45.2.0
Cython           : 0.29.30
pytest           : None
hypothesis       : None
sphinx           : None
blosc            : None
feather          : None
xlsxwriter       : None
lxml.etree       : None
html5lib         : None
pymysql          : None
psycopg2         : None
jinja2           : None
IPython          : None
pandas_datareader: None
bs4              : None
bottleneck       : None
fastparquet      : None
gcsfs            : None
lxml.etree       : None
matplotlib       : 3.1.2
numexpr          : None
odfpy            : None
openpyxl         : None
pandas_gbq       : None
pyarrow          : None
pytables         : None
s3fs             : None
scipy            : 1.3.3
sqlalchemy       : None
tables           : None
xarray           : None
xlrd             : None
xlwt             : None
xlsxwriter       : None
cuda version -  (11, 4, 0)
pycuda curand version -  (10, 20, 5)
pycuda driver version -  11040
Detected 1 CUDA Capable device(s) 

Device 0: Xavier
	 Compute Capability: 7.2
	 Total Memory: 7512 megabytes
TRT - INFO
The logger passed into createInferBuilder differs from one already provided for an existing builder, runtime, or refitter. Uses of the global logger, returned by nvinfer1::getLogger(), will return the existing value.

TRT - INFO
[MemUsageChange] Init CUDA: CPU +0, GPU +0, now: CPU 1085, GPU 4606 (MiB)
TRT - INFO
The logger passed into createInferRuntime differs from one already provided for an existing builder, runtime, or refitter. Uses of the global logger, returned by nvinfer1::getLogger(), will return the existing value.

TRT - INFO
[MemUsageChange] Init CUDA: CPU +0, GPU +0, now: CPU 1085, GPU 4606 (MiB)
TRT - INFO
The logger passed into createInferBuilder differs from one already provided for an existing builder, runtime, or refitter. Uses of the global logger, returned by nvinfer1::getLogger(), will return the existing value.

TRT - INFO
[MemUsageChange] Init CUDA: CPU +0, GPU +0, now: CPU 1085, GPU 4606 (MiB)
TRT - VERBOSE
Registered plugin creator - ::GridAnchor_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::GridAnchorRect_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::NMS_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::Reorg_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::Region_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::Clip_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::LReLU_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::PriorBox_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::Normalize_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::ScatterND version 1
TRT - VERBOSE
Registered plugin creator - ::RPROI_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::BatchedNMS_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::BatchedNMSDynamic_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::BatchTilePlugin_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::FlattenConcat_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::CropAndResize version 1
TRT - VERBOSE
Registered plugin creator - ::CropAndResizeDynamic version 1
TRT - VERBOSE
Registered plugin creator - ::DetectionLayer_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::EfficientNMS_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::EfficientNMS_Explicit_TF_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::EfficientNMS_Implicit_TF_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::ProposalDynamic version 1
TRT - VERBOSE
Registered plugin creator - ::Proposal version 1
TRT - VERBOSE
Registered plugin creator - ::ProposalLayer_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::PyramidROIAlign_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::ResizeNearest_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::Split version 1
TRT - VERBOSE
Registered plugin creator - ::SpecialSlice_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::InstanceNormalization_TRT version 1
TRT - VERBOSE
Registered plugin creator - ::InstanceNormalization_TRT version 2
TRT - VERBOSE
Registered plugin creator - ::NMSDynamic_TRT version 1
TRT - VERBOSE
Adding network input: keypoints with dtype: float32, dimensions: (-1, -1, -1)
TRT - VERBOSE
Registering tensor: keypoints for ONNX tensor: keypoints
TRT - VERBOSE
Adding network input: scores.1 with dtype: float32, dimensions: (-1, -1)
TRT - VERBOSE
Registering tensor: scores.1 for ONNX tensor: scores.1
TRT - VERBOSE
Adding network input: score_map with dtype: float32, dimensions: (-1, -1, -1, -1)
TRT - VERBOSE
Registering tensor: score_map for ONNX tensor: score_map
TRT - VERBOSE
Adding network input: dense_feat_map with dtype: float32, dimensions: (-1, -1, -1, -1)
TRT - VERBOSE
Registering tensor: dense_feat_map for ONNX tensor: dense_feat_map
TRT - VERBOSE
Importing initializer: 5
TRT - VERBOSE
Importing initializer: 7
TRT - VERBOSE
Importing initializer: 9
TRT - VERBOSE
Importing initializer: 11
TRT - VERBOSE
Importing initializer: 13
TRT - VERBOSE
Importing initializer: 19
TRT - VERBOSE
Importing initializer: 22
TRT - VERBOSE
Importing initializer: 26
TRT - VERBOSE
Importing initializer: 29
TRT - VERBOSE
Importing initializer: 32
TRT - VERBOSE
Importing initializer: 35
TRT - VERBOSE
Importing initializer: 45
TRT - WARNING
onnx2trt_utils.cpp:363: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
TRT - VERBOSE
Importing initializer: 47
TRT - VERBOSE
Importing initializer: 285
TRT - VERBOSE
Importing initializer: 286
TRT - VERBOSE
Importing initializer: 55
TRT - VERBOSE
Importing initializer: 57
TRT - VERBOSE
Importing initializer: 60
TRT - VERBOSE
Importing initializer: 64
TRT - VERBOSE
Importing initializer: 74
TRT - VERBOSE
Importing initializer: 63
TRT - VERBOSE
Importing initializer: 67
TRT - VERBOSE
Importing initializer: 81
TRT - VERBOSE
Importing initializer: 84
TRT - VERBOSE
Importing initializer: 87
TRT - VERBOSE
Importing initializer: 89
TRT - VERBOSE
Importing initializer: 91
TRT - VERBOSE
Importing initializer: 93
TRT - VERBOSE
Importing initializer: 287
TRT - VERBOSE
Importing initializer: 104
TRT - VERBOSE
Importing initializer: 107
TRT - VERBOSE
Importing initializer: 109
TRT - VERBOSE
Importing initializer: 112
TRT - VERBOSE
Importing initializer: 114
TRT - VERBOSE
Importing initializer: 118
TRT - VERBOSE
Importing initializer: 121
TRT - VERBOSE
Importing initializer: 123
TRT - VERBOSE
Importing initializer: 129
TRT - VERBOSE
Importing initializer: 288
TRT - VERBOSE
Importing initializer: 137
TRT - VERBOSE
Importing initializer: 289
TRT - VERBOSE
Importing initializer: 145
TRT - VERBOSE
Importing initializer: 290
TRT - VERBOSE
Importing initializer: 153
TRT - VERBOSE
Importing initializer: 291
TRT - VERBOSE
Importing initializer: 163
TRT - VERBOSE
Importing initializer: 165
TRT - VERBOSE
Importing initializer: 168
TRT - VERBOSE
Importing initializer: 171
TRT - VERBOSE
Importing initializer: 175
TRT - VERBOSE
Importing initializer: 177
TRT - VERBOSE
Importing initializer: 179
TRT - VERBOSE
Importing initializer: 181
TRT - VERBOSE
Importing initializer: 183
TRT - VERBOSE
Importing initializer: 185
TRT - VERBOSE
Importing initializer: 187
TRT - VERBOSE
Importing initializer: 189
TRT - VERBOSE
Importing initializer: 192
TRT - VERBOSE
Importing initializer: 194
TRT - VERBOSE
Importing initializer: 196
TRT - VERBOSE
Importing initializer: 204
TRT - VERBOSE
Importing initializer: 212
TRT - VERBOSE
Importing initializer: 214
TRT - VERBOSE
Importing initializer: 216
TRT - VERBOSE
Importing initializer: 224
TRT - VERBOSE
Importing initializer: 233
TRT - VERBOSE
Importing initializer: 235
TRT - VERBOSE
Importing initializer: 237
TRT - VERBOSE
Importing initializer: 245
TRT - VERBOSE
Importing initializer: 254
TRT - VERBOSE
Importing initializer: 256
TRT - VERBOSE
Importing initializer: 258
TRT - VERBOSE
Importing initializer: 266
TRT - VERBOSE
Importing initializer: 292
TRT - VERBOSE
Importing initializer: 283
TRT - VERBOSE
Parsing node: Cast_0 [Cast]
TRT - VERBOSE
Searching for input: keypoints
TRT - VERBOSE
Cast_0 [Cast] inputs: [keypoints -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Casting to type: int32
TRT - VERBOSE
Registering layer: Cast_0 for ONNX node: Cast_0
TRT - VERBOSE
Registering tensor: 4 for ONNX tensor: 4
TRT - VERBOSE
Cast_0 [Cast] outputs: [4 -> (-1, -1, -1)[INT32]], 
TRT - VERBOSE
Parsing node: Conv_2 [Conv]
TRT - VERBOSE
Searching for input: score_map
TRT - VERBOSE
Searching for input: 5
TRT - VERBOSE
Conv_2 [Conv] inputs: [score_map -> (-1, -1, -1, -1)[FLOAT]], [5 -> (1, 1, 3, 3)[FLOAT]], 
TRT - VERBOSE
Convolution input dimensions: (-1, -1, -1, -1)
TRT - VERBOSE
Registering layer: Conv_2 for ONNX node: Conv_2
TRT - VERBOSE
Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1
TRT - VERBOSE
Convolution output dimensions: (-1, 1, -1, -1)
TRT - VERBOSE
Registering tensor: 6 for ONNX tensor: 6
TRT - VERBOSE
Conv_2 [Conv] outputs: [6 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Conv_4 [Conv]
TRT - VERBOSE
Searching for input: score_map
TRT - VERBOSE
Searching for input: 7
TRT - VERBOSE
Conv_4 [Conv] inputs: [score_map -> (-1, -1, -1, -1)[FLOAT]], [7 -> (1, 1, 3, 3)[FLOAT]], 
TRT - VERBOSE
Convolution input dimensions: (-1, -1, -1, -1)
TRT - VERBOSE
Registering layer: Conv_4 for ONNX node: Conv_4
TRT - VERBOSE
Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1
TRT - VERBOSE
Convolution output dimensions: (-1, 1, -1, -1)
TRT - VERBOSE
Registering tensor: 8 for ONNX tensor: 8
TRT - VERBOSE
Conv_4 [Conv] outputs: [8 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Conv_6 [Conv]
TRT - VERBOSE
Searching for input: score_map
TRT - VERBOSE
Searching for input: 9
TRT - VERBOSE
Conv_6 [Conv] inputs: [score_map -> (-1, -1, -1, -1)[FLOAT]], [9 -> (1, 1, 3, 3)[FLOAT]], 
TRT - VERBOSE
Convolution input dimensions: (-1, -1, -1, -1)
TRT - VERBOSE
Registering layer: Conv_6 for ONNX node: Conv_6
TRT - VERBOSE
Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1
TRT - VERBOSE
Convolution output dimensions: (-1, 1, -1, -1)
TRT - VERBOSE
Registering tensor: 10 for ONNX tensor: 10
TRT - VERBOSE
Conv_6 [Conv] outputs: [10 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Conv_8 [Conv]
TRT - VERBOSE
Searching for input: score_map
TRT - VERBOSE
Searching for input: 11
TRT - VERBOSE
Conv_8 [Conv] inputs: [score_map -> (-1, -1, -1, -1)[FLOAT]], [11 -> (1, 1, 3, 3)[FLOAT]], 
TRT - VERBOSE
Convolution input dimensions: (-1, -1, -1, -1)
TRT - VERBOSE
Registering layer: Conv_8 for ONNX node: Conv_8
TRT - VERBOSE
Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1
TRT - VERBOSE
Convolution output dimensions: (-1, 1, -1, -1)
TRT - VERBOSE
Registering tensor: 12 for ONNX tensor: 12
TRT - VERBOSE
Conv_8 [Conv] outputs: [12 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Conv_10 [Conv]
TRT - VERBOSE
Searching for input: score_map
TRT - VERBOSE
Searching for input: 13
TRT - VERBOSE
Conv_10 [Conv] inputs: [score_map -> (-1, -1, -1, -1)[FLOAT]], [13 -> (1, 1, 3, 3)[FLOAT]], 
TRT - VERBOSE
Convolution input dimensions: (-1, -1, -1, -1)
TRT - VERBOSE
Registering layer: Conv_10 for ONNX node: Conv_10
TRT - VERBOSE
Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1
TRT - VERBOSE
Convolution output dimensions: (-1, 1, -1, -1)
TRT - VERBOSE
Registering tensor: 14 for ONNX tensor: 14
TRT - VERBOSE
Conv_10 [Conv] outputs: [14 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_11 [Mul]
TRT - VERBOSE
Searching for input: 6
TRT - VERBOSE
Searching for input: 10
TRT - VERBOSE
Mul_11 [Mul] inputs: [6 -> (-1, 1, -1, -1)[FLOAT]], [10 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_11 for ONNX node: Mul_11
TRT - VERBOSE
Registering tensor: 15 for ONNX tensor: 15
TRT - VERBOSE
Mul_11 [Mul] outputs: [15 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_12 [Mul]
TRT - VERBOSE
Searching for input: 8
TRT - VERBOSE
Searching for input: 8
TRT - VERBOSE
Mul_12 [Mul] inputs: [8 -> (-1, 1, -1, -1)[FLOAT]], [8 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_12 for ONNX node: Mul_12
TRT - VERBOSE
Registering tensor: 16 for ONNX tensor: 16
TRT - VERBOSE
Mul_12 [Mul] outputs: [16 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Sub_13 [Sub]
TRT - VERBOSE
Searching for input: 15
TRT - VERBOSE
Searching for input: 16
TRT - VERBOSE
Sub_13 [Sub] inputs: [15 -> (-1, 1, -1, -1)[FLOAT]], [16 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Sub_13 for ONNX node: Sub_13
TRT - VERBOSE
Registering tensor: 17 for ONNX tensor: 17
TRT - VERBOSE
Sub_13 [Sub] outputs: [17 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Div_14 [Div]
TRT - VERBOSE
Searching for input: 10
TRT - VERBOSE
Searching for input: 17
TRT - VERBOSE
Div_14 [Div] inputs: [10 -> (-1, 1, -1, -1)[FLOAT]], [17 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Div_14 for ONNX node: Div_14
TRT - VERBOSE
Registering tensor: 18 for ONNX tensor: 18
TRT - VERBOSE
Div_14 [Div] outputs: [18 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Equal_16 [Equal]
TRT - VERBOSE
Searching for input: 18
TRT - VERBOSE
Searching for input: 19
TRT - VERBOSE
Equal_16 [Equal] inputs: [18 -> (-1, 1, -1, -1)[FLOAT]], [19 -> ()[FLOAT]], 
TRT - VERBOSE
Registering layer: 19 for ONNX node: 19
TRT - VERBOSE
Registering layer: Equal_16 for ONNX node: Equal_16
TRT - VERBOSE
Registering tensor: 20 for ONNX tensor: 20
TRT - VERBOSE
Equal_16 [Equal] outputs: [20 -> (-1, 1, -1, -1)[BOOL]], 
TRT - VERBOSE
Parsing node: Cast_17 [Cast]
TRT - VERBOSE
Searching for input: 20
TRT - VERBOSE
Cast_17 [Cast] inputs: [20 -> (-1, 1, -1, -1)[BOOL]], 
TRT - VERBOSE
Casting to type: bool
TRT - VERBOSE
Registering layer: Cast_17 for ONNX node: Cast_17
TRT - VERBOSE
Registering tensor: 21 for ONNX tensor: 21
TRT - VERBOSE
Cast_17 [Cast] outputs: [21 -> (-1, 1, -1, -1)[BOOL]], 
TRT - VERBOSE
Parsing node: Where_19 [Where]
TRT - VERBOSE
Searching for input: 21
TRT - VERBOSE
Searching for input: 22
TRT - VERBOSE
Searching for input: 18
TRT - VERBOSE
Where_19 [Where] inputs: [21 -> (-1, 1, -1, -1)[BOOL]], [22 -> ()[FLOAT]], [18 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: 22 for ONNX node: 22
TRT - VERBOSE
Registering layer: Where_19 for ONNX node: Where_19
TRT - VERBOSE
Registering tensor: 23 for ONNX tensor: 23
TRT - VERBOSE
Where_19 [Where] outputs: [23 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Neg_20 [Neg]
TRT - VERBOSE
Searching for input: 8
TRT - VERBOSE
Neg_20 [Neg] inputs: [8 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Neg_20 for ONNX node: Neg_20
TRT - VERBOSE
Registering tensor: 24 for ONNX tensor: 24
TRT - VERBOSE
Neg_20 [Neg] outputs: [24 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Div_21 [Div]
TRT - VERBOSE
Searching for input: 24
TRT - VERBOSE
Searching for input: 17
TRT - VERBOSE
Div_21 [Div] inputs: [24 -> (-1, 1, -1, -1)[FLOAT]], [17 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Div_21 for ONNX node: Div_21
TRT - VERBOSE
Registering tensor: 25 for ONNX tensor: 25
TRT - VERBOSE
Div_21 [Div] outputs: [25 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Equal_23 [Equal]
TRT - VERBOSE
Searching for input: 25
TRT - VERBOSE
Searching for input: 26
TRT - VERBOSE
Equal_23 [Equal] inputs: [25 -> (-1, 1, -1, -1)[FLOAT]], [26 -> ()[FLOAT]], 
TRT - VERBOSE
Registering layer: 26 for ONNX node: 26
TRT - VERBOSE
Registering layer: Equal_23 for ONNX node: Equal_23
TRT - VERBOSE
Registering tensor: 27 for ONNX tensor: 27
TRT - VERBOSE
Equal_23 [Equal] outputs: [27 -> (-1, 1, -1, -1)[BOOL]], 
TRT - VERBOSE
Parsing node: Cast_24 [Cast]
TRT - VERBOSE
Searching for input: 27
TRT - VERBOSE
Cast_24 [Cast] inputs: [27 -> (-1, 1, -1, -1)[BOOL]], 
TRT - VERBOSE
Casting to type: bool
TRT - VERBOSE
Registering layer: Cast_24 for ONNX node: Cast_24
TRT - VERBOSE
Registering tensor: 28 for ONNX tensor: 28
TRT - VERBOSE
Cast_24 [Cast] outputs: [28 -> (-1, 1, -1, -1)[BOOL]], 
TRT - VERBOSE
Parsing node: Where_26 [Where]
TRT - VERBOSE
Searching for input: 28
TRT - VERBOSE
Searching for input: 29
TRT - VERBOSE
Searching for input: 25
TRT - VERBOSE
Where_26 [Where] inputs: [28 -> (-1, 1, -1, -1)[BOOL]], [29 -> ()[FLOAT]], [25 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: 29 for ONNX node: 29
TRT - VERBOSE
Registering layer: Where_26 for ONNX node: Where_26
TRT - VERBOSE
Registering tensor: 30 for ONNX tensor: 30
TRT - VERBOSE
Where_26 [Where] outputs: [30 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Div_27 [Div]
TRT - VERBOSE
Searching for input: 6
TRT - VERBOSE
Searching for input: 17
TRT - VERBOSE
Div_27 [Div] inputs: [6 -> (-1, 1, -1, -1)[FLOAT]], [17 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Div_27 for ONNX node: Div_27
TRT - VERBOSE
Registering tensor: 31 for ONNX tensor: 31
TRT - VERBOSE
Div_27 [Div] outputs: [31 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Equal_29 [Equal]
TRT - VERBOSE
Searching for input: 31
TRT - VERBOSE
Searching for input: 32
TRT - VERBOSE
Equal_29 [Equal] inputs: [31 -> (-1, 1, -1, -1)[FLOAT]], [32 -> ()[FLOAT]], 
TRT - VERBOSE
Registering layer: 32 for ONNX node: 32
TRT - VERBOSE
Registering layer: Equal_29 for ONNX node: Equal_29
TRT - VERBOSE
Registering tensor: 33 for ONNX tensor: 33
TRT - VERBOSE
Equal_29 [Equal] outputs: [33 -> (-1, 1, -1, -1)[BOOL]], 
TRT - VERBOSE
Parsing node: Cast_30 [Cast]
TRT - VERBOSE
Searching for input: 33
TRT - VERBOSE
Cast_30 [Cast] inputs: [33 -> (-1, 1, -1, -1)[BOOL]], 
TRT - VERBOSE
Casting to type: bool
TRT - VERBOSE
Registering layer: Cast_30 for ONNX node: Cast_30
TRT - VERBOSE
Registering tensor: 34 for ONNX tensor: 34
TRT - VERBOSE
Cast_30 [Cast] outputs: [34 -> (-1, 1, -1, -1)[BOOL]], 
TRT - VERBOSE
Parsing node: Where_32 [Where]
TRT - VERBOSE
Searching for input: 34
TRT - VERBOSE
Searching for input: 35
TRT - VERBOSE
Searching for input: 31
TRT - VERBOSE
Where_32 [Where] inputs: [34 -> (-1, 1, -1, -1)[BOOL]], [35 -> ()[FLOAT]], [31 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: 35 for ONNX node: 35
TRT - VERBOSE
Registering layer: Where_32 for ONNX node: Where_32
TRT - VERBOSE
Registering tensor: 36 for ONNX tensor: 36
TRT - VERBOSE
Where_32 [Where] outputs: [36 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_33 [Mul]
TRT - VERBOSE
Searching for input: 23
TRT - VERBOSE
Searching for input: 12
TRT - VERBOSE
Mul_33 [Mul] inputs: [23 -> (-1, 1, -1, -1)[FLOAT]], [12 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_33 for ONNX node: Mul_33
TRT - VERBOSE
Registering tensor: 37 for ONNX tensor: 37
TRT - VERBOSE
Mul_33 [Mul] outputs: [37 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_34 [Mul]
TRT - VERBOSE
Searching for input: 30
TRT - VERBOSE
Searching for input: 14
TRT - VERBOSE
Mul_34 [Mul] inputs: [30 -> (-1, 1, -1, -1)[FLOAT]], [14 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_34 for ONNX node: Mul_34
TRT - VERBOSE
Registering tensor: 38 for ONNX tensor: 38
TRT - VERBOSE
Mul_34 [Mul] outputs: [38 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Add_35 [Add]
TRT - VERBOSE
Searching for input: 37
TRT - VERBOSE
Searching for input: 38
TRT - VERBOSE
Add_35 [Add] inputs: [37 -> (-1, 1, -1, -1)[FLOAT]], [38 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Add_35 for ONNX node: Add_35
TRT - VERBOSE
Registering tensor: 39 for ONNX tensor: 39
TRT - VERBOSE
Add_35 [Add] outputs: [39 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Neg_36 [Neg]
TRT - VERBOSE
Searching for input: 39
TRT - VERBOSE
Neg_36 [Neg] inputs: [39 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Neg_36 for ONNX node: Neg_36
TRT - VERBOSE
Registering tensor: 40 for ONNX tensor: 40
TRT - VERBOSE
Neg_36 [Neg] outputs: [40 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_37 [Mul]
TRT - VERBOSE
Searching for input: 30
TRT - VERBOSE
Searching for input: 12
TRT - VERBOSE
Mul_37 [Mul] inputs: [30 -> (-1, 1, -1, -1)[FLOAT]], [12 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_37 for ONNX node: Mul_37
TRT - VERBOSE
Registering tensor: 41 for ONNX tensor: 41
TRT - VERBOSE
Mul_37 [Mul] outputs: [41 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_38 [Mul]
TRT - VERBOSE
Searching for input: 36
TRT - VERBOSE
Searching for input: 14
TRT - VERBOSE
Mul_38 [Mul] inputs: [36 -> (-1, 1, -1, -1)[FLOAT]], [14 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_38 for ONNX node: Mul_38
TRT - VERBOSE
Registering tensor: 42 for ONNX tensor: 42
TRT - VERBOSE
Mul_38 [Mul] outputs: [42 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Add_39 [Add]
TRT - VERBOSE
Searching for input: 41
TRT - VERBOSE
Searching for input: 42
TRT - VERBOSE
Add_39 [Add] inputs: [41 -> (-1, 1, -1, -1)[FLOAT]], [42 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Add_39 for ONNX node: Add_39
TRT - VERBOSE
Registering tensor: 43 for ONNX tensor: 43
TRT - VERBOSE
Add_39 [Add] outputs: [43 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Neg_40 [Neg]
TRT - VERBOSE
Searching for input: 43
TRT - VERBOSE
Neg_40 [Neg] inputs: [43 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Neg_40 for ONNX node: Neg_40
TRT - VERBOSE
Registering tensor: 44 for ONNX tensor: 44
TRT - VERBOSE
Neg_40 [Neg] outputs: [44 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Unsqueeze_42 [Unsqueeze]
TRT - VERBOSE
Searching for input: 40
TRT - VERBOSE
Searching for input: 45
TRT - VERBOSE
Unsqueeze_42 [Unsqueeze] inputs: [40 -> (-1, 1, -1, -1)[FLOAT]], [45 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (_, 1, _, _), unsqueezing to: (_, _, _, _, _)
TRT - VERBOSE
Registering layer: Unsqueeze_42 for ONNX node: Unsqueeze_42
TRT - VERBOSE
Registering tensor: 46 for ONNX tensor: 46
TRT - VERBOSE
Unsqueeze_42 [Unsqueeze] outputs: [46 -> (-1, 1, -1, -1, 1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Unsqueeze_44 [Unsqueeze]
TRT - VERBOSE
Searching for input: 44
TRT - VERBOSE
Searching for input: 47
TRT - VERBOSE
Unsqueeze_44 [Unsqueeze] inputs: [44 -> (-1, 1, -1, -1)[FLOAT]], [47 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (_, 1, _, _), unsqueezing to: (_, _, _, _, _)
TRT - VERBOSE
Registering layer: Unsqueeze_44 for ONNX node: Unsqueeze_44
TRT - VERBOSE
Registering tensor: 48 for ONNX tensor: 48
TRT - VERBOSE
Unsqueeze_44 [Unsqueeze] outputs: [48 -> (-1, 1, -1, -1, 1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Concat_45 [Concat]
TRT - VERBOSE
Searching for input: 46
TRT - VERBOSE
Searching for input: 48
TRT - VERBOSE
Concat_45 [Concat] inputs: [46 -> (-1, 1, -1, -1, 1)[FLOAT]], [48 -> (-1, 1, -1, -1, 1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Concat_45 for ONNX node: Concat_45
TRT - VERBOSE
Registering tensor: 49 for ONNX tensor: 49
TRT - VERBOSE
Concat_45 [Concat] outputs: [49 -> (-1, 1, -1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Parsing node: Clip_46 [Clip]
TRT - VERBOSE
Searching for input: 49
TRT - VERBOSE
Searching for input: 285
TRT - VERBOSE
Searching for input: 286
TRT - VERBOSE
Clip_46 [Clip] inputs: [49 -> (-1, 1, -1, -1, 2)[FLOAT]], [285 -> ()[FLOAT]], [286 -> ()[FLOAT]], 
TRT - VERBOSE
Registering layer: Clip_46 for ONNX node: Clip_46
TRT - VERBOSE
Registering tensor: 54 for ONNX tensor: 54
TRT - VERBOSE
Clip_46 [Clip] outputs: [54 -> (-1, 1, -1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Parsing node: Gather_48 [Gather]
TRT - VERBOSE
Searching for input: 4
TRT - VERBOSE
Searching for input: 55
TRT - VERBOSE
Gather_48 [Gather] inputs: [4 -> (-1, -1, -1)[INT32]], [55 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 55 for ONNX node: 55
TRT - VERBOSE
Using Gather axis: 2
TRT - VERBOSE
Registering layer: Gather_48 for ONNX node: Gather_48
TRT - VERBOSE
Registering tensor: 56 for ONNX tensor: 56
TRT - VERBOSE
Gather_48 [Gather] outputs: [56 -> (-1, -1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_50 [Gather]
TRT - VERBOSE
Searching for input: 4
TRT - VERBOSE
Searching for input: 57
TRT - VERBOSE
Gather_50 [Gather] inputs: [4 -> (-1, -1, -1)[INT32]], [57 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 57 for ONNX node: 57
TRT - VERBOSE
Using Gather axis: 2
TRT - VERBOSE
Registering layer: Gather_50 for ONNX node: Gather_50
TRT - VERBOSE
Registering tensor: 58 for ONNX tensor: 58
TRT - VERBOSE
Gather_50 [Gather] outputs: [58 -> (-1, -1)[INT32]], 
TRT - VERBOSE
Parsing node: Shape_51 [Shape]
TRT - VERBOSE
Searching for input: 54
TRT - VERBOSE
Shape_51 [Shape] inputs: [54 -> (-1, 1, -1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_51 for ONNX node: Shape_51
TRT - VERBOSE
Registering tensor: 59 for ONNX tensor: 59
TRT - VERBOSE
Shape_51 [Shape] outputs: [59 -> (5)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_53 [Gather]
TRT - VERBOSE
Searching for input: 59
TRT - VERBOSE
Searching for input: 60
TRT - VERBOSE
Gather_53 [Gather] inputs: [59 -> (5)[INT32]], [60 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 60 for ONNX node: 60
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_53 for ONNX node: Gather_53
TRT - VERBOSE
Registering tensor: 61 for ONNX tensor: 61
TRT - VERBOSE
Gather_53 [Gather] outputs: [61 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_57 [Gather]
TRT - VERBOSE
Searching for input: 59
TRT - VERBOSE
Searching for input: 64
TRT - VERBOSE
Gather_57 [Gather] inputs: [59 -> (5)[INT32]], [64 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 64 for ONNX node: 64
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_57 for ONNX node: Gather_57
TRT - VERBOSE
Registering tensor: 65 for ONNX tensor: 65
TRT - VERBOSE
Gather_57 [Gather] outputs: [65 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Transpose_60 [Transpose]
TRT - VERBOSE
Searching for input: 54
TRT - VERBOSE
Transpose_60 [Transpose] inputs: [54 -> (-1, 1, -1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_60 for ONNX node: Transpose_60
TRT - VERBOSE
Registering tensor: 68 for ONNX tensor: 68
TRT - VERBOSE
Transpose_60 [Transpose] outputs: [68 -> (-1, -1, -1, 1, 2)[FLOAT]], 
TRT - VERBOSE
Parsing node: Flatten_61 [Flatten]
TRT - VERBOSE
Searching for input: 68
TRT - VERBOSE
Flatten_61 [Flatten] inputs: [68 -> (-1, -1, -1, 1, 2)[FLOAT]], 
TRT - VERBOSE
Registering layer: Flatten_61 for ONNX node: Flatten_61
TRT - VERBOSE
Registering tensor: 69 for ONNX tensor: 69
TRT - VERBOSE
Flatten_61 [Flatten] outputs: [69 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_62 [Mul]
TRT - VERBOSE
Searching for input: 56
TRT - VERBOSE
Searching for input: 65
TRT - VERBOSE
Mul_62 [Mul] inputs: [56 -> (-1, -1)[INT32]], [65 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Mul_62 for ONNX node: Mul_62
TRT - VERBOSE
Registering tensor: 70 for ONNX tensor: 70
TRT - VERBOSE
Mul_62 [Mul] outputs: [70 -> (-1, -1)[INT32]], 
TRT - VERBOSE
Parsing node: Add_63 [Add]
TRT - VERBOSE
Searching for input: 58
TRT - VERBOSE
Searching for input: 70
TRT - VERBOSE
Add_63 [Add] inputs: [58 -> (-1, -1)[INT32]], [70 -> (-1, -1)[INT32]], 
TRT - VERBOSE
Registering layer: Add_63 for ONNX node: Add_63
TRT - VERBOSE
Registering tensor: 71 for ONNX tensor: 71
TRT - VERBOSE
Add_63 [Add] outputs: [71 -> (-1, -1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_64 [Gather]
TRT - VERBOSE
Searching for input: 69
TRT - VERBOSE
Searching for input: 71
TRT - VERBOSE
Gather_64 [Gather] inputs: [69 -> (-1, -1)[FLOAT]], [71 -> (-1, -1)[INT32]], 
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_64 for ONNX node: Gather_64
TRT - VERBOSE
Registering tensor: 72 for ONNX tensor: 72
TRT - VERBOSE
Gather_64 [Gather] outputs: [72 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_65 [Shape]
TRT - VERBOSE
Searching for input: 71
TRT - VERBOSE
Shape_65 [Shape] inputs: [71 -> (-1, -1)[INT32]], 
TRT - VERBOSE
Registering layer: Shape_65 for ONNX node: Shape_65
TRT - VERBOSE
Registering tensor: 73 for ONNX tensor: 73
TRT - VERBOSE
Shape_65 [Shape] outputs: [73 -> (2)[INT32]], 
TRT - VERBOSE
Parsing node: Concat_67 [Concat]
TRT - VERBOSE
Searching for input: 74
TRT - VERBOSE
Searching for input: 61
TRT - VERBOSE
Searching for input: 63
TRT - VERBOSE
Searching for input: 67
TRT - VERBOSE
Concat_67 [Concat] inputs: [74 -> (1)[INT32]], [61 -> (1)[INT32]], [63 -> (1)[INT32]], [67 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 74 for ONNX node: 74
TRT - VERBOSE
Registering layer: 63 for ONNX node: 63
TRT - VERBOSE
Registering layer: 67 for ONNX node: 67
TRT - VERBOSE
Registering layer: Concat_67 for ONNX node: Concat_67
TRT - VERBOSE
Registering tensor: 75 for ONNX tensor: 75
TRT - VERBOSE
Concat_67 [Concat] outputs: [75 -> (4)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_68 [Reshape]
TRT - VERBOSE
Searching for input: 72
TRT - VERBOSE
Searching for input: 75
TRT - VERBOSE
Reshape_68 [Reshape] inputs: [72 -> (-1, -1, -1)[FLOAT]], [75 -> (4)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_68 for ONNX node: Reshape_68
TRT - VERBOSE
Registering tensor: 76 for ONNX tensor: 76
TRT - VERBOSE
Reshape_68 [Reshape] outputs: [76 -> (-1, -1, 1, 2)[FLOAT]], 
TRT - VERBOSE
Parsing node: Transpose_69 [Transpose]
TRT - VERBOSE
Searching for input: 76
TRT - VERBOSE
Transpose_69 [Transpose] inputs: [76 -> (-1, -1, 1, 2)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_69 for ONNX node: Transpose_69
TRT - VERBOSE
Registering tensor: 77 for ONNX tensor: 77
TRT - VERBOSE
Transpose_69 [Transpose] outputs: [77 -> (-1, 1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Parsing node: Concat_70 [Concat]
TRT - VERBOSE
Searching for input: 61
TRT - VERBOSE
Searching for input: 63
TRT - VERBOSE
Searching for input: 73
TRT - VERBOSE
Searching for input: 67
TRT - VERBOSE
Concat_70 [Concat] inputs: [61 -> (1)[INT32]], [63 -> (1)[INT32]], [73 -> (2)[INT32]], [67 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Concat_70 for ONNX node: Concat_70
TRT - VERBOSE
Registering tensor: 78 for ONNX tensor: 78
TRT - VERBOSE
Concat_70 [Concat] outputs: [78 -> (5)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_71 [Reshape]
TRT - VERBOSE
Searching for input: 77
TRT - VERBOSE
Searching for input: 78
TRT - VERBOSE
Reshape_71 [Reshape] inputs: [77 -> (-1, 1, -1, 2)[FLOAT]], [78 -> (5)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_71 for ONNX node: Reshape_71
TRT - VERBOSE
Registering tensor: 79 for ONNX tensor: 79
TRT - VERBOSE
Reshape_71 [Reshape] outputs: [79 -> (-1, 1, -1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_72 [Shape]
TRT - VERBOSE
Searching for input: 79
TRT - VERBOSE
Shape_72 [Shape] inputs: [79 -> (-1, 1, -1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_72 for ONNX node: Shape_72
TRT - VERBOSE
Registering tensor: 80 for ONNX tensor: 80
TRT - VERBOSE
Shape_72 [Shape] outputs: [80 -> (5)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_74 [Gather]
TRT - VERBOSE
Searching for input: 80
TRT - VERBOSE
Searching for input: 81
TRT - VERBOSE
Gather_74 [Gather] inputs: [80 -> (5)[INT32]], [81 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 81 for ONNX node: 81
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_74 for ONNX node: Gather_74
TRT - VERBOSE
Registering tensor: 82 for ONNX tensor: 82
TRT - VERBOSE
Gather_74 [Gather] outputs: [82 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Shape_75 [Shape]
TRT - VERBOSE
Searching for input: 79
TRT - VERBOSE
Shape_75 [Shape] inputs: [79 -> (-1, 1, -1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_75 for ONNX node: Shape_75
TRT - VERBOSE
Registering tensor: 83 for ONNX tensor: 83
TRT - VERBOSE
Shape_75 [Shape] outputs: [83 -> (5)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_77 [Gather]
TRT - VERBOSE
Searching for input: 83
TRT - VERBOSE
Searching for input: 84
TRT - VERBOSE
Gather_77 [Gather] inputs: [83 -> (5)[INT32]], [84 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 84 for ONNX node: 84
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_77 for ONNX node: Gather_77
TRT - VERBOSE
Registering tensor: 85 for ONNX tensor: 85
TRT - VERBOSE
Gather_77 [Gather] outputs: [85 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Shape_78 [Shape]
TRT - VERBOSE
Searching for input: 79
TRT - VERBOSE
Shape_78 [Shape] inputs: [79 -> (-1, 1, -1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_78 for ONNX node: Shape_78
TRT - VERBOSE
Registering tensor: 86 for ONNX tensor: 86
TRT - VERBOSE
Shape_78 [Shape] outputs: [86 -> (5)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_80 [Gather]
TRT - VERBOSE
Searching for input: 86
TRT - VERBOSE
Searching for input: 87
TRT - VERBOSE
Gather_80 [Gather] inputs: [86 -> (5)[INT32]], [87 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 87 for ONNX node: 87
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_80 for ONNX node: Gather_80
TRT - VERBOSE
Registering tensor: 88 for ONNX tensor: 88
TRT - VERBOSE
Gather_80 [Gather] outputs: [88 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Unsqueeze_82 [Unsqueeze]
TRT - VERBOSE
Searching for input: 82
TRT - VERBOSE
Searching for input: 89
TRT - VERBOSE
Unsqueeze_82 [Unsqueeze] inputs: [82 -> ()[INT32]], [89 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (), unsqueezing to: (1,)
TRT - VERBOSE
Registering layer: Unsqueeze_82 for ONNX node: Unsqueeze_82
TRT - VERBOSE
Registering tensor: 90 for ONNX tensor: 90
TRT - VERBOSE
Unsqueeze_82 [Unsqueeze] outputs: [90 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Unsqueeze_84 [Unsqueeze]
TRT - VERBOSE
Searching for input: 85
TRT - VERBOSE
Searching for input: 91
TRT - VERBOSE
Unsqueeze_84 [Unsqueeze] inputs: [85 -> ()[INT32]], [91 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (), unsqueezing to: (1,)
TRT - VERBOSE
Registering layer: Unsqueeze_84 for ONNX node: Unsqueeze_84
TRT - VERBOSE
Registering tensor: 92 for ONNX tensor: 92
TRT - VERBOSE
Unsqueeze_84 [Unsqueeze] outputs: [92 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Unsqueeze_86 [Unsqueeze]
TRT - VERBOSE
Searching for input: 88
TRT - VERBOSE
Searching for input: 93
TRT - VERBOSE
Unsqueeze_86 [Unsqueeze] inputs: [88 -> ()[INT32]], [93 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (), unsqueezing to: (1,)
TRT - VERBOSE
Registering layer: Unsqueeze_86 for ONNX node: Unsqueeze_86
TRT - VERBOSE
Registering tensor: 94 for ONNX tensor: 94
TRT - VERBOSE
Unsqueeze_86 [Unsqueeze] outputs: [94 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Concat_87 [Concat]
TRT - VERBOSE
Searching for input: 90
TRT - VERBOSE
Searching for input: 92
TRT - VERBOSE
Searching for input: 94
TRT - VERBOSE
Concat_87 [Concat] inputs: [90 -> (1)[INT32]], [92 -> (1)[INT32]], [94 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Concat_87 for ONNX node: Concat_87
TRT - VERBOSE
Registering tensor: 95 for ONNX tensor: 95
TRT - VERBOSE
Concat_87 [Concat] outputs: [95 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_88 [Reshape]
TRT - VERBOSE
Searching for input: 79
TRT - VERBOSE
Searching for input: 95
TRT - VERBOSE
Reshape_88 [Reshape] inputs: [79 -> (-1, 1, -1, -1, 2)[FLOAT]], [95 -> (3)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_88 for ONNX node: Reshape_88
TRT - VERBOSE
Registering tensor: 96 for ONNX tensor: 96
TRT - VERBOSE
Reshape_88 [Reshape] outputs: [96 -> (-1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Parsing node: Cast_89 [Cast]
TRT - VERBOSE
Searching for input: 4
TRT - VERBOSE
Cast_89 [Cast] inputs: [4 -> (-1, -1, -1)[INT32]], 
TRT - VERBOSE
Casting to type: float32
TRT - VERBOSE
Registering layer: Cast_89 for ONNX node: Cast_89
TRT - VERBOSE
Registering tensor: 97 for ONNX tensor: 97
TRT - VERBOSE
Cast_89 [Cast] outputs: [97 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Add_90 [Add]
TRT - VERBOSE
Searching for input: 97
TRT - VERBOSE
Searching for input: 96
TRT - VERBOSE
Add_90 [Add] inputs: [97 -> (-1, -1, -1)[FLOAT]], [96 -> (-1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Registering layer: Add_90 for ONNX node: Add_90
TRT - VERBOSE
Registering tensor: 98 for ONNX tensor: 98
TRT - VERBOSE
Add_90 [Add] outputs: [98 -> (-1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Parsing node: Transpose_91 [Transpose]
TRT - VERBOSE
Searching for input: scores.1
TRT - VERBOSE
Transpose_91 [Transpose] inputs: [scores.1 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_91 for ONNX node: Transpose_91
TRT - VERBOSE
Registering tensor: scores_63 for ONNX tensor: scores
TRT - VERBOSE
Transpose_91 [Transpose] outputs: [scores -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Div_92 [Div]
TRT - VERBOSE
Searching for input: 98
TRT - VERBOSE
Searching for input: 287
TRT - VERBOSE
Div_92 [Div] inputs: [98 -> (-1, -1, 2)[FLOAT]], [287 -> ()[FLOAT]], 
TRT - VERBOSE
Registering layer: 287 for ONNX node: 287
TRT - VERBOSE
Registering layer: Div_92 for ONNX node: Div_92
TRT - VERBOSE
Registering tensor: 102 for ONNX tensor: 102
TRT - VERBOSE
Div_92 [Div] outputs: [102 -> (-1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_93 [Shape]
TRT - VERBOSE
Searching for input: dense_feat_map
TRT - VERBOSE
Shape_93 [Shape] inputs: [dense_feat_map -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_93 for ONNX node: Shape_93
TRT - VERBOSE
Registering tensor: 103 for ONNX tensor: 103
TRT - VERBOSE
Shape_93 [Shape] outputs: [103 -> (4)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_95 [Gather]
TRT - VERBOSE
Searching for input: 103
TRT - VERBOSE
Searching for input: 104
TRT - VERBOSE
Gather_95 [Gather] inputs: [103 -> (4)[INT32]], [104 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 104 for ONNX node: 104
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_95 for ONNX node: Gather_95
TRT - VERBOSE
Registering tensor: 105 for ONNX tensor: 105
TRT - VERBOSE
Gather_95 [Gather] outputs: [105 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Shape_96 [Shape]
TRT - VERBOSE
Searching for input: dense_feat_map
TRT - VERBOSE
Shape_96 [Shape] inputs: [dense_feat_map -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_96 for ONNX node: Shape_96
TRT - VERBOSE
Registering tensor: 106 for ONNX tensor: 106
TRT - VERBOSE
Shape_96 [Shape] outputs: [106 -> (4)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_98 [Gather]
TRT - VERBOSE
Searching for input: 106
TRT - VERBOSE
Searching for input: 107
TRT - VERBOSE
Gather_98 [Gather] inputs: [106 -> (4)[INT32]], [107 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 107 for ONNX node: 107
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_98 for ONNX node: Gather_98
TRT - VERBOSE
Registering tensor: 108 for ONNX tensor: 108
TRT - VERBOSE
Gather_98 [Gather] outputs: [108 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Gather_100 [Gather]
TRT - VERBOSE
Searching for input: 102
TRT - VERBOSE
Searching for input: 109
TRT - VERBOSE
Gather_100 [Gather] inputs: [102 -> (-1, -1, 2)[FLOAT]], [109 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 109 for ONNX node: 109
TRT - VERBOSE
Using Gather axis: 2
TRT - VERBOSE
Registering layer: Gather_100 for ONNX node: Gather_100
TRT - VERBOSE
Registering tensor: 110 for ONNX tensor: 110
TRT - VERBOSE
Gather_100 [Gather] outputs: [110 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_101 [Shape]
TRT - VERBOSE
Searching for input: 102
TRT - VERBOSE
Shape_101 [Shape] inputs: [102 -> (-1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_101 for ONNX node: Shape_101
TRT - VERBOSE
Registering tensor: 111 for ONNX tensor: 111
TRT - VERBOSE
Shape_101 [Shape] outputs: [111 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_103 [Gather]
TRT - VERBOSE
Searching for input: 111
TRT - VERBOSE
Searching for input: 112
TRT - VERBOSE
Gather_103 [Gather] inputs: [111 -> (3)[INT32]], [112 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 112 for ONNX node: 112
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_103 for ONNX node: Gather_103
TRT - VERBOSE
Registering tensor: 113 for ONNX tensor: 113
TRT - VERBOSE
Gather_103 [Gather] outputs: [113 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Unsqueeze_105 [Unsqueeze]
TRT - VERBOSE
Searching for input: 113
TRT - VERBOSE
Searching for input: 114
TRT - VERBOSE
Unsqueeze_105 [Unsqueeze] inputs: [113 -> ()[INT32]], [114 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (), unsqueezing to: (1,)
TRT - VERBOSE
Registering layer: Unsqueeze_105 for ONNX node: Unsqueeze_105
TRT - VERBOSE
Registering tensor: 115 for ONNX tensor: 115
TRT - VERBOSE
Unsqueeze_105 [Unsqueeze] outputs: [115 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Concat_106 [Concat]
TRT - VERBOSE
Searching for input: 115
TRT - VERBOSE
Concat_106 [Concat] inputs: [115 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Concat_106 for ONNX node: Concat_106
TRT - VERBOSE
Registering tensor: 116 for ONNX tensor: 116
TRT - VERBOSE
Concat_106 [Concat] outputs: [116 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_107 [Reshape]
TRT - VERBOSE
Searching for input: 110
TRT - VERBOSE
Searching for input: 116
TRT - VERBOSE
Reshape_107 [Reshape] inputs: [110 -> (-1, -1)[FLOAT]], [116 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_107 for ONNX node: Reshape_107
TRT - VERBOSE
Registering tensor: 117 for ONNX tensor: 117
TRT - VERBOSE
Reshape_107 [Reshape] outputs: [117 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Gather_109 [Gather]
TRT - VERBOSE
Searching for input: 102
TRT - VERBOSE
Searching for input: 118
TRT - VERBOSE
Gather_109 [Gather] inputs: [102 -> (-1, -1, 2)[FLOAT]], [118 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 118 for ONNX node: 118
TRT - VERBOSE
Using Gather axis: 2
TRT - VERBOSE
Registering layer: Gather_109 for ONNX node: Gather_109
TRT - VERBOSE
Registering tensor: 119 for ONNX tensor: 119
TRT - VERBOSE
Gather_109 [Gather] outputs: [119 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_110 [Shape]
TRT - VERBOSE
Searching for input: 102
TRT - VERBOSE
Shape_110 [Shape] inputs: [102 -> (-1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_110 for ONNX node: Shape_110
TRT - VERBOSE
Registering tensor: 120 for ONNX tensor: 120
TRT - VERBOSE
Shape_110 [Shape] outputs: [120 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_112 [Gather]
TRT - VERBOSE
Searching for input: 120
TRT - VERBOSE
Searching for input: 121
TRT - VERBOSE
Gather_112 [Gather] inputs: [120 -> (3)[INT32]], [121 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 121 for ONNX node: 121
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_112 for ONNX node: Gather_112
TRT - VERBOSE
Registering tensor: 122 for ONNX tensor: 122
TRT - VERBOSE
Gather_112 [Gather] outputs: [122 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Unsqueeze_114 [Unsqueeze]
TRT - VERBOSE
Searching for input: 122
TRT - VERBOSE
Searching for input: 123
TRT - VERBOSE
Unsqueeze_114 [Unsqueeze] inputs: [122 -> ()[INT32]], [123 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (), unsqueezing to: (1,)
TRT - VERBOSE
Registering layer: Unsqueeze_114 for ONNX node: Unsqueeze_114
TRT - VERBOSE
Registering tensor: 124 for ONNX tensor: 124
TRT - VERBOSE
Unsqueeze_114 [Unsqueeze] outputs: [124 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Concat_115 [Concat]
TRT - VERBOSE
Searching for input: 124
TRT - VERBOSE
Concat_115 [Concat] inputs: [124 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Concat_115 for ONNX node: Concat_115
TRT - VERBOSE
Registering tensor: 125 for ONNX tensor: 125
TRT - VERBOSE
Concat_115 [Concat] outputs: [125 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_116 [Reshape]
TRT - VERBOSE
Searching for input: 119
TRT - VERBOSE
Searching for input: 125
TRT - VERBOSE
Reshape_116 [Reshape] inputs: [119 -> (-1, -1)[FLOAT]], [125 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_116 for ONNX node: Reshape_116
TRT - VERBOSE
Registering tensor: 126 for ONNX tensor: 126
TRT - VERBOSE
Reshape_116 [Reshape] outputs: [126 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Floor_117 [Floor]
TRT - VERBOSE
Searching for input: 117
TRT - VERBOSE
Floor_117 [Floor] inputs: [117 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Floor_117 for ONNX node: Floor_117
TRT - VERBOSE
Registering tensor: 127 for ONNX tensor: 127
TRT - VERBOSE
Floor_117 [Floor] outputs: [127 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Cast_118 [Cast]
TRT - VERBOSE
Searching for input: 127
TRT - VERBOSE
Cast_118 [Cast] inputs: [127 -> (-1)[FLOAT]], 
TRT - VERBOSE
Casting to type: int32
TRT - VERBOSE
Registering layer: Cast_118 for ONNX node: Cast_118
TRT - VERBOSE
Registering tensor: 128 for ONNX tensor: 128
TRT - VERBOSE
Cast_118 [Cast] outputs: [128 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Sub_120 [Sub]
TRT - VERBOSE
Searching for input: 105
TRT - VERBOSE
Searching for input: 129
TRT - VERBOSE
Sub_120 [Sub] inputs: [105 -> ()[INT32]], [129 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 129 for ONNX node: 129
TRT - VERBOSE
Registering layer: Sub_120 for ONNX node: Sub_120
TRT - VERBOSE
Registering tensor: 130 for ONNX tensor: 130
TRT - VERBOSE
Sub_120 [Sub] outputs: [130 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Cast_121 [Cast]
TRT - VERBOSE
Searching for input: 130
TRT - VERBOSE
Cast_121 [Cast] inputs: [130 -> ()[INT32]], 
TRT - VERBOSE
Casting to type: int32
TRT - VERBOSE
Registering layer: Cast_121 for ONNX node: Cast_121
TRT - VERBOSE
Registering tensor: 133 for ONNX tensor: 133
TRT - VERBOSE
Cast_121 [Cast] outputs: [133 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Clip_122 [Clip]
TRT - VERBOSE
Searching for input: 128
TRT - VERBOSE
Searching for input: 288
TRT - VERBOSE
Searching for input: 133
TRT - VERBOSE
Clip_122 [Clip] inputs: [128 -> (-1)[INT32]], [288 -> ()[INT32]], [133 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 288 for ONNX node: 288
TRT - VERBOSE
Registering tensor: 134 for ONNX tensor: 134
TRT - VERBOSE
Clip_122 [Clip] outputs: [134 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Ceil_123 [Ceil]
TRT - VERBOSE
Searching for input: 117
TRT - VERBOSE
Ceil_123 [Ceil] inputs: [117 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Ceil_123 for ONNX node: Ceil_123
TRT - VERBOSE
Registering tensor: 135 for ONNX tensor: 135
TRT - VERBOSE
Ceil_123 [Ceil] outputs: [135 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Cast_124 [Cast]
TRT - VERBOSE
Searching for input: 135
TRT - VERBOSE
Cast_124 [Cast] inputs: [135 -> (-1)[FLOAT]], 
TRT - VERBOSE
Casting to type: int32
TRT - VERBOSE
Registering layer: Cast_124 for ONNX node: Cast_124
TRT - VERBOSE
Registering tensor: 136 for ONNX tensor: 136
TRT - VERBOSE
Cast_124 [Cast] outputs: [136 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Sub_126 [Sub]
TRT - VERBOSE
Searching for input: 105
TRT - VERBOSE
Searching for input: 137
TRT - VERBOSE
Sub_126 [Sub] inputs: [105 -> ()[INT32]], [137 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 137 for ONNX node: 137
TRT - VERBOSE
Registering layer: Sub_126 for ONNX node: Sub_126
TRT - VERBOSE
Registering tensor: 138 for ONNX tensor: 138
TRT - VERBOSE
Sub_126 [Sub] outputs: [138 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Cast_127 [Cast]
TRT - VERBOSE
Searching for input: 138
TRT - VERBOSE
Cast_127 [Cast] inputs: [138 -> ()[INT32]], 
TRT - VERBOSE
Casting to type: int32
TRT - VERBOSE
Registering layer: Cast_127 for ONNX node: Cast_127
TRT - VERBOSE
Registering tensor: 141 for ONNX tensor: 141
TRT - VERBOSE
Cast_127 [Cast] outputs: [141 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Clip_128 [Clip]
TRT - VERBOSE
Searching for input: 136
TRT - VERBOSE
Searching for input: 289
TRT - VERBOSE
Searching for input: 141
TRT - VERBOSE
Clip_128 [Clip] inputs: [136 -> (-1)[INT32]], [289 -> ()[INT32]], [141 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 289 for ONNX node: 289
TRT - VERBOSE
Registering tensor: 142 for ONNX tensor: 142
TRT - VERBOSE
Clip_128 [Clip] outputs: [142 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Floor_129 [Floor]
TRT - VERBOSE
Searching for input: 126
TRT - VERBOSE
Floor_129 [Floor] inputs: [126 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Floor_129 for ONNX node: Floor_129
TRT - VERBOSE
Registering tensor: 143 for ONNX tensor: 143
TRT - VERBOSE
Floor_129 [Floor] outputs: [143 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Cast_130 [Cast]
TRT - VERBOSE
Searching for input: 143
TRT - VERBOSE
Cast_130 [Cast] inputs: [143 -> (-1)[FLOAT]], 
TRT - VERBOSE
Casting to type: int32
TRT - VERBOSE
Registering layer: Cast_130 for ONNX node: Cast_130
TRT - VERBOSE
Registering tensor: 144 for ONNX tensor: 144
TRT - VERBOSE
Cast_130 [Cast] outputs: [144 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Sub_132 [Sub]
TRT - VERBOSE
Searching for input: 108
TRT - VERBOSE
Searching for input: 145
TRT - VERBOSE
Sub_132 [Sub] inputs: [108 -> ()[INT32]], [145 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 145 for ONNX node: 145
TRT - VERBOSE
Registering layer: Sub_132 for ONNX node: Sub_132
TRT - VERBOSE
Registering tensor: 146 for ONNX tensor: 146
TRT - VERBOSE
Sub_132 [Sub] outputs: [146 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Cast_133 [Cast]
TRT - VERBOSE
Searching for input: 146
TRT - VERBOSE
Cast_133 [Cast] inputs: [146 -> ()[INT32]], 
TRT - VERBOSE
Casting to type: int32
TRT - VERBOSE
Registering layer: Cast_133 for ONNX node: Cast_133
TRT - VERBOSE
Registering tensor: 149 for ONNX tensor: 149
TRT - VERBOSE
Cast_133 [Cast] outputs: [149 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Clip_134 [Clip]
TRT - VERBOSE
Searching for input: 144
TRT - VERBOSE
Searching for input: 290
TRT - VERBOSE
Searching for input: 149
TRT - VERBOSE
Clip_134 [Clip] inputs: [144 -> (-1)[INT32]], [290 -> ()[INT32]], [149 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 290 for ONNX node: 290
TRT - VERBOSE
Registering tensor: 150 for ONNX tensor: 150
TRT - VERBOSE
Clip_134 [Clip] outputs: [150 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Ceil_135 [Ceil]
TRT - VERBOSE
Searching for input: 126
TRT - VERBOSE
Ceil_135 [Ceil] inputs: [126 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Ceil_135 for ONNX node: Ceil_135
TRT - VERBOSE
Registering tensor: 151 for ONNX tensor: 151
TRT - VERBOSE
Ceil_135 [Ceil] outputs: [151 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Cast_136 [Cast]
TRT - VERBOSE
Searching for input: 151
TRT - VERBOSE
Cast_136 [Cast] inputs: [151 -> (-1)[FLOAT]], 
TRT - VERBOSE
Casting to type: int32
TRT - VERBOSE
Registering layer: Cast_136 for ONNX node: Cast_136
TRT - VERBOSE
Registering tensor: 152 for ONNX tensor: 152
TRT - VERBOSE
Cast_136 [Cast] outputs: [152 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Sub_138 [Sub]
TRT - VERBOSE
Searching for input: 108
TRT - VERBOSE
Searching for input: 153
TRT - VERBOSE
Sub_138 [Sub] inputs: [108 -> ()[INT32]], [153 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 153 for ONNX node: 153
TRT - VERBOSE
Registering layer: Sub_138 for ONNX node: Sub_138
TRT - VERBOSE
Registering tensor: 154 for ONNX tensor: 154
TRT - VERBOSE
Sub_138 [Sub] outputs: [154 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Cast_139 [Cast]
TRT - VERBOSE
Searching for input: 154
TRT - VERBOSE
Cast_139 [Cast] inputs: [154 -> ()[INT32]], 
TRT - VERBOSE
Casting to type: int32
TRT - VERBOSE
Registering layer: Cast_139 for ONNX node: Cast_139
TRT - VERBOSE
Registering tensor: 157 for ONNX tensor: 157
TRT - VERBOSE
Cast_139 [Cast] outputs: [157 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Clip_140 [Clip]
TRT - VERBOSE
Searching for input: 152
TRT - VERBOSE
Searching for input: 291
TRT - VERBOSE
Searching for input: 157
TRT - VERBOSE
Clip_140 [Clip] inputs: [152 -> (-1)[INT32]], [291 -> ()[INT32]], [157 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 291 for ONNX node: 291
TRT - VERBOSE
Registering tensor: 158 for ONNX tensor: 158
TRT - VERBOSE
Clip_140 [Clip] outputs: [158 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Cast_141 [Cast]
TRT - VERBOSE
Searching for input: 134
TRT - VERBOSE
Cast_141 [Cast] inputs: [134 -> (-1)[INT32]], 
TRT - VERBOSE
Casting to type: float32
TRT - VERBOSE
Registering layer: Cast_141 for ONNX node: Cast_141
TRT - VERBOSE
Registering tensor: 159 for ONNX tensor: 159
TRT - VERBOSE
Cast_141 [Cast] outputs: [159 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Sub_142 [Sub]
TRT - VERBOSE
Searching for input: 117
TRT - VERBOSE
Searching for input: 159
TRT - VERBOSE
Sub_142 [Sub] inputs: [117 -> (-1)[FLOAT]], [159 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Sub_142 for ONNX node: Sub_142
TRT - VERBOSE
Registering tensor: 160 for ONNX tensor: 160
TRT - VERBOSE
Sub_142 [Sub] outputs: [160 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Cast_143 [Cast]
TRT - VERBOSE
Searching for input: 150
TRT - VERBOSE
Cast_143 [Cast] inputs: [150 -> (-1)[INT32]], 
TRT - VERBOSE
Casting to type: float32
TRT - VERBOSE
Registering layer: Cast_143 for ONNX node: Cast_143
TRT - VERBOSE
Registering tensor: 161 for ONNX tensor: 161
TRT - VERBOSE
Cast_143 [Cast] outputs: [161 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Sub_144 [Sub]
TRT - VERBOSE
Searching for input: 126
TRT - VERBOSE
Searching for input: 161
TRT - VERBOSE
Sub_144 [Sub] inputs: [126 -> (-1)[FLOAT]], [161 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Sub_144 for ONNX node: Sub_144
TRT - VERBOSE
Registering tensor: 162 for ONNX tensor: 162
TRT - VERBOSE
Sub_144 [Sub] outputs: [162 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Sub_146 [Sub]
TRT - VERBOSE
Searching for input: 163
TRT - VERBOSE
Searching for input: 160
TRT - VERBOSE
Sub_146 [Sub] inputs: [163 -> ()[FLOAT]], [160 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: 163 for ONNX node: 163
TRT - VERBOSE
Registering layer: Sub_146 for ONNX node: Sub_146
TRT - VERBOSE
Registering tensor: 164 for ONNX tensor: 164
TRT - VERBOSE
Sub_146 [Sub] outputs: [164 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Sub_148 [Sub]
TRT - VERBOSE
Searching for input: 165
TRT - VERBOSE
Searching for input: 162
TRT - VERBOSE
Sub_148 [Sub] inputs: [165 -> ()[FLOAT]], [162 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: 165 for ONNX node: 165
TRT - VERBOSE
Registering layer: Sub_148 for ONNX node: Sub_148
TRT - VERBOSE
Registering tensor: 166 for ONNX tensor: 166
TRT - VERBOSE
Sub_148 [Sub] outputs: [166 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_149 [Mul]
TRT - VERBOSE
Searching for input: 164
TRT - VERBOSE
Searching for input: 166
TRT - VERBOSE
Mul_149 [Mul] inputs: [164 -> (-1)[FLOAT]], [166 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_149 for ONNX node: Mul_149
TRT - VERBOSE
Registering tensor: 167 for ONNX tensor: 167
TRT - VERBOSE
Mul_149 [Mul] outputs: [167 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Sub_151 [Sub]
TRT - VERBOSE
Searching for input: 168
TRT - VERBOSE
Searching for input: 160
TRT - VERBOSE
Sub_151 [Sub] inputs: [168 -> ()[FLOAT]], [160 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: 168 for ONNX node: 168
TRT - VERBOSE
Registering layer: Sub_151 for ONNX node: Sub_151
TRT - VERBOSE
Registering tensor: 169 for ONNX tensor: 169
TRT - VERBOSE
Sub_151 [Sub] outputs: [169 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_152 [Mul]
TRT - VERBOSE
Searching for input: 169
TRT - VERBOSE
Searching for input: 162
TRT - VERBOSE
Mul_152 [Mul] inputs: [169 -> (-1)[FLOAT]], [162 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_152 for ONNX node: Mul_152
TRT - VERBOSE
Registering tensor: 170 for ONNX tensor: 170
TRT - VERBOSE
Mul_152 [Mul] outputs: [170 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Sub_154 [Sub]
TRT - VERBOSE
Searching for input: 171
TRT - VERBOSE
Searching for input: 162
TRT - VERBOSE
Sub_154 [Sub] inputs: [171 -> ()[FLOAT]], [162 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: 171 for ONNX node: 171
TRT - VERBOSE
Registering layer: Sub_154 for ONNX node: Sub_154
TRT - VERBOSE
Registering tensor: 172 for ONNX tensor: 172
TRT - VERBOSE
Sub_154 [Sub] outputs: [172 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_155 [Mul]
TRT - VERBOSE
Searching for input: 160
TRT - VERBOSE
Searching for input: 172
TRT - VERBOSE
Mul_155 [Mul] inputs: [160 -> (-1)[FLOAT]], [172 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_155 for ONNX node: Mul_155
TRT - VERBOSE
Registering tensor: 173 for ONNX tensor: 173
TRT - VERBOSE
Mul_155 [Mul] outputs: [173 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_156 [Mul]
TRT - VERBOSE
Searching for input: 160
TRT - VERBOSE
Searching for input: 162
TRT - VERBOSE
Mul_156 [Mul] inputs: [160 -> (-1)[FLOAT]], [162 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_156 for ONNX node: Mul_156
TRT - VERBOSE
Registering tensor: 174 for ONNX tensor: 174
TRT - VERBOSE
Mul_156 [Mul] outputs: [174 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Unsqueeze_158 [Unsqueeze]
TRT - VERBOSE
Searching for input: 167
TRT - VERBOSE
Searching for input: 175
TRT - VERBOSE
Unsqueeze_158 [Unsqueeze] inputs: [167 -> (-1)[FLOAT]], [175 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (_,), unsqueezing to: (_, _)
TRT - VERBOSE
Registering layer: Unsqueeze_158 for ONNX node: Unsqueeze_158
TRT - VERBOSE
Registering tensor: 176 for ONNX tensor: 176
TRT - VERBOSE
Unsqueeze_158 [Unsqueeze] outputs: [176 -> (1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Unsqueeze_160 [Unsqueeze]
TRT - VERBOSE
Searching for input: 176
TRT - VERBOSE
Searching for input: 177
TRT - VERBOSE
Unsqueeze_160 [Unsqueeze] inputs: [176 -> (1, -1)[FLOAT]], [177 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (1, _), unsqueezing to: (_, _, _)
TRT - VERBOSE
Registering layer: Unsqueeze_160 for ONNX node: Unsqueeze_160
TRT - VERBOSE
Registering tensor: 178 for ONNX tensor: 178
TRT - VERBOSE
Unsqueeze_160 [Unsqueeze] outputs: [178 -> (1, 1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Unsqueeze_162 [Unsqueeze]
TRT - VERBOSE
Searching for input: 170
TRT - VERBOSE
Searching for input: 179
TRT - VERBOSE
Unsqueeze_162 [Unsqueeze] inputs: [170 -> (-1)[FLOAT]], [179 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (_,), unsqueezing to: (_, _)
TRT - VERBOSE
Registering layer: Unsqueeze_162 for ONNX node: Unsqueeze_162
TRT - VERBOSE
Registering tensor: 180 for ONNX tensor: 180
TRT - VERBOSE
Unsqueeze_162 [Unsqueeze] outputs: [180 -> (1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Unsqueeze_164 [Unsqueeze]
TRT - VERBOSE
Searching for input: 180
TRT - VERBOSE
Searching for input: 181
TRT - VERBOSE
Unsqueeze_164 [Unsqueeze] inputs: [180 -> (1, -1)[FLOAT]], [181 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (1, _), unsqueezing to: (_, _, _)
TRT - VERBOSE
Registering layer: Unsqueeze_164 for ONNX node: Unsqueeze_164
TRT - VERBOSE
Registering tensor: 182 for ONNX tensor: 182
TRT - VERBOSE
Unsqueeze_164 [Unsqueeze] outputs: [182 -> (1, 1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Unsqueeze_166 [Unsqueeze]
TRT - VERBOSE
Searching for input: 173
TRT - VERBOSE
Searching for input: 183
TRT - VERBOSE
Unsqueeze_166 [Unsqueeze] inputs: [173 -> (-1)[FLOAT]], [183 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (_,), unsqueezing to: (_, _)
TRT - VERBOSE
Registering layer: Unsqueeze_166 for ONNX node: Unsqueeze_166
TRT - VERBOSE
Registering tensor: 184 for ONNX tensor: 184
TRT - VERBOSE
Unsqueeze_166 [Unsqueeze] outputs: [184 -> (1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Unsqueeze_168 [Unsqueeze]
TRT - VERBOSE
Searching for input: 184
TRT - VERBOSE
Searching for input: 185
TRT - VERBOSE
Unsqueeze_168 [Unsqueeze] inputs: [184 -> (1, -1)[FLOAT]], [185 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (1, _), unsqueezing to: (_, _, _)
TRT - VERBOSE
Registering layer: Unsqueeze_168 for ONNX node: Unsqueeze_168
TRT - VERBOSE
Registering tensor: 186 for ONNX tensor: 186
TRT - VERBOSE
Unsqueeze_168 [Unsqueeze] outputs: [186 -> (1, 1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Unsqueeze_170 [Unsqueeze]
TRT - VERBOSE
Searching for input: 174
TRT - VERBOSE
Searching for input: 187
TRT - VERBOSE
Unsqueeze_170 [Unsqueeze] inputs: [174 -> (-1)[FLOAT]], [187 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (_,), unsqueezing to: (_, _)
TRT - VERBOSE
Registering layer: Unsqueeze_170 for ONNX node: Unsqueeze_170
TRT - VERBOSE
Registering tensor: 188 for ONNX tensor: 188
TRT - VERBOSE
Unsqueeze_170 [Unsqueeze] outputs: [188 -> (1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Unsqueeze_172 [Unsqueeze]
TRT - VERBOSE
Searching for input: 188
TRT - VERBOSE
Searching for input: 189
TRT - VERBOSE
Unsqueeze_172 [Unsqueeze] inputs: [188 -> (1, -1)[FLOAT]], [189 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (1, _), unsqueezing to: (_, _, _)
TRT - VERBOSE
Registering layer: Unsqueeze_172 for ONNX node: Unsqueeze_172
TRT - VERBOSE
Registering tensor: 190 for ONNX tensor: 190
TRT - VERBOSE
Unsqueeze_172 [Unsqueeze] outputs: [190 -> (1, 1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_173 [Shape]
TRT - VERBOSE
Searching for input: dense_feat_map
TRT - VERBOSE
Shape_173 [Shape] inputs: [dense_feat_map -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_173 for ONNX node: Shape_173
TRT - VERBOSE
Registering tensor: 191 for ONNX tensor: 191
TRT - VERBOSE
Shape_173 [Shape] outputs: [191 -> (4)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_175 [Gather]
TRT - VERBOSE
Searching for input: 191
TRT - VERBOSE
Searching for input: 192
TRT - VERBOSE
Gather_175 [Gather] inputs: [191 -> (4)[INT32]], [192 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 192 for ONNX node: 192
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_175 for ONNX node: Gather_175
TRT - VERBOSE
Registering tensor: 193 for ONNX tensor: 193
TRT - VERBOSE
Gather_175 [Gather] outputs: [193 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_177 [Gather]
TRT - VERBOSE
Searching for input: 191
TRT - VERBOSE
Searching for input: 194
TRT - VERBOSE
Gather_177 [Gather] inputs: [191 -> (4)[INT32]], [194 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 194 for ONNX node: 194
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_177 for ONNX node: Gather_177
TRT - VERBOSE
Registering tensor: 195 for ONNX tensor: 195
TRT - VERBOSE
Gather_177 [Gather] outputs: [195 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_179 [Gather]
TRT - VERBOSE
Searching for input: 191
TRT - VERBOSE
Searching for input: 196
TRT - VERBOSE
Gather_179 [Gather] inputs: [191 -> (4)[INT32]], [196 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 196 for ONNX node: 196
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_179 for ONNX node: Gather_179
TRT - VERBOSE
Registering tensor: 197 for ONNX tensor: 197
TRT - VERBOSE
Gather_179 [Gather] outputs: [197 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Transpose_180 [Transpose]
TRT - VERBOSE
Searching for input: dense_feat_map
TRT - VERBOSE
Transpose_180 [Transpose] inputs: [dense_feat_map -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_180 for ONNX node: Transpose_180
TRT - VERBOSE
Registering tensor: 198 for ONNX tensor: 198
TRT - VERBOSE
Transpose_180 [Transpose] outputs: [198 -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Flatten_181 [Flatten]
TRT - VERBOSE
Searching for input: 198
TRT - VERBOSE
Flatten_181 [Flatten] inputs: [198 -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Flatten_181 for ONNX node: Flatten_181
TRT - VERBOSE
Registering tensor: 199 for ONNX tensor: 199
TRT - VERBOSE
Flatten_181 [Flatten] outputs: [199 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_182 [Mul]
TRT - VERBOSE
Searching for input: 134
TRT - VERBOSE
Searching for input: 197
TRT - VERBOSE
Mul_182 [Mul] inputs: [134 -> (-1)[INT32]], [197 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Mul_182 for ONNX node: Mul_182
TRT - VERBOSE
Registering tensor: 200 for ONNX tensor: 200
TRT - VERBOSE
Mul_182 [Mul] outputs: [200 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Add_183 [Add]
TRT - VERBOSE
Searching for input: 150
TRT - VERBOSE
Searching for input: 200
TRT - VERBOSE
Add_183 [Add] inputs: [150 -> (-1)[INT32]], [200 -> (-1)[INT32]], 
TRT - VERBOSE
Registering layer: Add_183 for ONNX node: Add_183
TRT - VERBOSE
Registering tensor: 201 for ONNX tensor: 201
TRT - VERBOSE
Add_183 [Add] outputs: [201 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_184 [Gather]
TRT - VERBOSE
Searching for input: 199
TRT - VERBOSE
Searching for input: 201
TRT - VERBOSE
Gather_184 [Gather] inputs: [199 -> (-1, -1)[FLOAT]], [201 -> (-1)[INT32]], 
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_184 for ONNX node: Gather_184
TRT - VERBOSE
Registering tensor: 202 for ONNX tensor: 202
TRT - VERBOSE
Gather_184 [Gather] outputs: [202 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_185 [Shape]
TRT - VERBOSE
Searching for input: 201
TRT - VERBOSE
Shape_185 [Shape] inputs: [201 -> (-1)[INT32]], 
TRT - VERBOSE
Registering layer: Shape_185 for ONNX node: Shape_185
TRT - VERBOSE
Registering tensor: 203 for ONNX tensor: 203
TRT - VERBOSE
Shape_185 [Shape] outputs: [203 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Concat_187 [Concat]
TRT - VERBOSE
Searching for input: 204
TRT - VERBOSE
Searching for input: 193
TRT - VERBOSE
Searching for input: 195
TRT - VERBOSE
Concat_187 [Concat] inputs: [204 -> (1)[INT32]], [193 -> (1)[INT32]], [195 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 204 for ONNX node: 204
TRT - VERBOSE
Registering layer: Concat_187 for ONNX node: Concat_187
TRT - VERBOSE
Registering tensor: 205 for ONNX tensor: 205
TRT - VERBOSE
Concat_187 [Concat] outputs: [205 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_188 [Reshape]
TRT - VERBOSE
Searching for input: 202
TRT - VERBOSE
Searching for input: 205
TRT - VERBOSE
Reshape_188 [Reshape] inputs: [202 -> (-1, -1)[FLOAT]], [205 -> (3)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_188 for ONNX node: Reshape_188
TRT - VERBOSE
Registering tensor: 206 for ONNX tensor: 206
TRT - VERBOSE
Reshape_188 [Reshape] outputs: [206 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Transpose_189 [Transpose]
TRT - VERBOSE
Searching for input: 206
TRT - VERBOSE
Transpose_189 [Transpose] inputs: [206 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_189 for ONNX node: Transpose_189
TRT - VERBOSE
Registering tensor: 207 for ONNX tensor: 207
TRT - VERBOSE
Transpose_189 [Transpose] outputs: [207 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Concat_190 [Concat]
TRT - VERBOSE
Searching for input: 193
TRT - VERBOSE
Searching for input: 195
TRT - VERBOSE
Searching for input: 203
TRT - VERBOSE
Concat_190 [Concat] inputs: [193 -> (1)[INT32]], [195 -> (1)[INT32]], [203 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Concat_190 for ONNX node: Concat_190
TRT - VERBOSE
Registering tensor: 208 for ONNX tensor: 208
TRT - VERBOSE
Concat_190 [Concat] outputs: [208 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_191 [Reshape]
TRT - VERBOSE
Searching for input: 207
TRT - VERBOSE
Searching for input: 208
TRT - VERBOSE
Reshape_191 [Reshape] inputs: [207 -> (-1, -1, -1)[FLOAT]], [208 -> (3)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_191 for ONNX node: Reshape_191
TRT - VERBOSE
Registering tensor: 209 for ONNX tensor: 209
TRT - VERBOSE
Reshape_191 [Reshape] outputs: [209 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_192 [Mul]
TRT - VERBOSE
Searching for input: 178
TRT - VERBOSE
Searching for input: 209
TRT - VERBOSE
Mul_192 [Mul] inputs: [178 -> (1, 1, -1)[FLOAT]], [209 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_192 for ONNX node: Mul_192
TRT - VERBOSE
Registering tensor: 210 for ONNX tensor: 210
TRT - VERBOSE
Mul_192 [Mul] outputs: [210 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_193 [Shape]
TRT - VERBOSE
Searching for input: dense_feat_map
TRT - VERBOSE
Shape_193 [Shape] inputs: [dense_feat_map -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_193 for ONNX node: Shape_193
TRT - VERBOSE
Registering tensor: 211 for ONNX tensor: 211
TRT - VERBOSE
Shape_193 [Shape] outputs: [211 -> (4)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_195 [Gather]
TRT - VERBOSE
Searching for input: 211
TRT - VERBOSE
Searching for input: 212
TRT - VERBOSE
Gather_195 [Gather] inputs: [211 -> (4)[INT32]], [212 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 212 for ONNX node: 212
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_195 for ONNX node: Gather_195
TRT - VERBOSE
Registering tensor: 213 for ONNX tensor: 213
TRT - VERBOSE
Gather_195 [Gather] outputs: [213 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_197 [Gather]
TRT - VERBOSE
Searching for input: 211
TRT - VERBOSE
Searching for input: 214
TRT - VERBOSE
Gather_197 [Gather] inputs: [211 -> (4)[INT32]], [214 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 214 for ONNX node: 214
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_197 for ONNX node: Gather_197
TRT - VERBOSE
Registering tensor: 215 for ONNX tensor: 215
TRT - VERBOSE
Gather_197 [Gather] outputs: [215 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_199 [Gather]
TRT - VERBOSE
Searching for input: 211
TRT - VERBOSE
Searching for input: 216
TRT - VERBOSE
Gather_199 [Gather] inputs: [211 -> (4)[INT32]], [216 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 216 for ONNX node: 216
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_199 for ONNX node: Gather_199
TRT - VERBOSE
Registering tensor: 217 for ONNX tensor: 217
TRT - VERBOSE
Gather_199 [Gather] outputs: [217 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Transpose_200 [Transpose]
TRT - VERBOSE
Searching for input: dense_feat_map
TRT - VERBOSE
Transpose_200 [Transpose] inputs: [dense_feat_map -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_200 for ONNX node: Transpose_200
TRT - VERBOSE
Registering tensor: 218 for ONNX tensor: 218
TRT - VERBOSE
Transpose_200 [Transpose] outputs: [218 -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Flatten_201 [Flatten]
TRT - VERBOSE
Searching for input: 218
TRT - VERBOSE
Flatten_201 [Flatten] inputs: [218 -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Flatten_201 for ONNX node: Flatten_201
TRT - VERBOSE
Registering tensor: 219 for ONNX tensor: 219
TRT - VERBOSE
Flatten_201 [Flatten] outputs: [219 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_202 [Mul]
TRT - VERBOSE
Searching for input: 134
TRT - VERBOSE
Searching for input: 217
TRT - VERBOSE
Mul_202 [Mul] inputs: [134 -> (-1)[INT32]], [217 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Mul_202 for ONNX node: Mul_202
TRT - VERBOSE
Registering tensor: 220 for ONNX tensor: 220
TRT - VERBOSE
Mul_202 [Mul] outputs: [220 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Add_203 [Add]
TRT - VERBOSE
Searching for input: 158
TRT - VERBOSE
Searching for input: 220
TRT - VERBOSE
Add_203 [Add] inputs: [158 -> (-1)[INT32]], [220 -> (-1)[INT32]], 
TRT - VERBOSE
Registering layer: Add_203 for ONNX node: Add_203
TRT - VERBOSE
Registering tensor: 221 for ONNX tensor: 221
TRT - VERBOSE
Add_203 [Add] outputs: [221 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_204 [Gather]
TRT - VERBOSE
Searching for input: 219
TRT - VERBOSE
Searching for input: 221
TRT - VERBOSE
Gather_204 [Gather] inputs: [219 -> (-1, -1)[FLOAT]], [221 -> (-1)[INT32]], 
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_204 for ONNX node: Gather_204
TRT - VERBOSE
Registering tensor: 222 for ONNX tensor: 222
TRT - VERBOSE
Gather_204 [Gather] outputs: [222 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_205 [Shape]
TRT - VERBOSE
Searching for input: 221
TRT - VERBOSE
Shape_205 [Shape] inputs: [221 -> (-1)[INT32]], 
TRT - VERBOSE
Registering layer: Shape_205 for ONNX node: Shape_205
TRT - VERBOSE
Registering tensor: 223 for ONNX tensor: 223
TRT - VERBOSE
Shape_205 [Shape] outputs: [223 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Concat_207 [Concat]
TRT - VERBOSE
Searching for input: 224
TRT - VERBOSE
Searching for input: 213
TRT - VERBOSE
Searching for input: 215
TRT - VERBOSE
Concat_207 [Concat] inputs: [224 -> (1)[INT32]], [213 -> (1)[INT32]], [215 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 224 for ONNX node: 224
TRT - VERBOSE
Registering layer: Concat_207 for ONNX node: Concat_207
TRT - VERBOSE
Registering tensor: 225 for ONNX tensor: 225
TRT - VERBOSE
Concat_207 [Concat] outputs: [225 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_208 [Reshape]
TRT - VERBOSE
Searching for input: 222
TRT - VERBOSE
Searching for input: 225
TRT - VERBOSE
Reshape_208 [Reshape] inputs: [222 -> (-1, -1)[FLOAT]], [225 -> (3)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_208 for ONNX node: Reshape_208
TRT - VERBOSE
Registering tensor: 226 for ONNX tensor: 226
TRT - VERBOSE
Reshape_208 [Reshape] outputs: [226 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Transpose_209 [Transpose]
TRT - VERBOSE
Searching for input: 226
TRT - VERBOSE
Transpose_209 [Transpose] inputs: [226 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_209 for ONNX node: Transpose_209
TRT - VERBOSE
Registering tensor: 227 for ONNX tensor: 227
TRT - VERBOSE
Transpose_209 [Transpose] outputs: [227 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Concat_210 [Concat]
TRT - VERBOSE
Searching for input: 213
TRT - VERBOSE
Searching for input: 215
TRT - VERBOSE
Searching for input: 223
TRT - VERBOSE
Concat_210 [Concat] inputs: [213 -> (1)[INT32]], [215 -> (1)[INT32]], [223 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Concat_210 for ONNX node: Concat_210
TRT - VERBOSE
Registering tensor: 228 for ONNX tensor: 228
TRT - VERBOSE
Concat_210 [Concat] outputs: [228 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_211 [Reshape]
TRT - VERBOSE
Searching for input: 227
TRT - VERBOSE
Searching for input: 228
TRT - VERBOSE
Reshape_211 [Reshape] inputs: [227 -> (-1, -1, -1)[FLOAT]], [228 -> (3)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_211 for ONNX node: Reshape_211
TRT - VERBOSE
Registering tensor: 229 for ONNX tensor: 229
TRT - VERBOSE
Reshape_211 [Reshape] outputs: [229 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_212 [Mul]
TRT - VERBOSE
Searching for input: 182
TRT - VERBOSE
Searching for input: 229
TRT - VERBOSE
Mul_212 [Mul] inputs: [182 -> (1, 1, -1)[FLOAT]], [229 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_212 for ONNX node: Mul_212
TRT - VERBOSE
Registering tensor: 230 for ONNX tensor: 230
TRT - VERBOSE
Mul_212 [Mul] outputs: [230 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Add_213 [Add]
TRT - VERBOSE
Searching for input: 210
TRT - VERBOSE
Searching for input: 230
TRT - VERBOSE
Add_213 [Add] inputs: [210 -> (-1, -1, -1)[FLOAT]], [230 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Add_213 for ONNX node: Add_213
TRT - VERBOSE
Registering tensor: 231 for ONNX tensor: 231
TRT - VERBOSE
Add_213 [Add] outputs: [231 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_214 [Shape]
TRT - VERBOSE
Searching for input: dense_feat_map
TRT - VERBOSE
Shape_214 [Shape] inputs: [dense_feat_map -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_214 for ONNX node: Shape_214
TRT - VERBOSE
Registering tensor: 232 for ONNX tensor: 232
TRT - VERBOSE
Shape_214 [Shape] outputs: [232 -> (4)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_216 [Gather]
TRT - VERBOSE
Searching for input: 232
TRT - VERBOSE
Searching for input: 233
TRT - VERBOSE
Gather_216 [Gather] inputs: [232 -> (4)[INT32]], [233 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 233 for ONNX node: 233
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_216 for ONNX node: Gather_216
TRT - VERBOSE
Registering tensor: 234 for ONNX tensor: 234
TRT - VERBOSE
Gather_216 [Gather] outputs: [234 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_218 [Gather]
TRT - VERBOSE
Searching for input: 232
TRT - VERBOSE
Searching for input: 235
TRT - VERBOSE
Gather_218 [Gather] inputs: [232 -> (4)[INT32]], [235 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 235 for ONNX node: 235
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_218 for ONNX node: Gather_218
TRT - VERBOSE
Registering tensor: 236 for ONNX tensor: 236
TRT - VERBOSE
Gather_218 [Gather] outputs: [236 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_220 [Gather]
TRT - VERBOSE
Searching for input: 232
TRT - VERBOSE
Searching for input: 237
TRT - VERBOSE
Gather_220 [Gather] inputs: [232 -> (4)[INT32]], [237 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 237 for ONNX node: 237
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_220 for ONNX node: Gather_220
TRT - VERBOSE
Registering tensor: 238 for ONNX tensor: 238
TRT - VERBOSE
Gather_220 [Gather] outputs: [238 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Transpose_221 [Transpose]
TRT - VERBOSE
Searching for input: dense_feat_map
TRT - VERBOSE
Transpose_221 [Transpose] inputs: [dense_feat_map -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_221 for ONNX node: Transpose_221
TRT - VERBOSE
Registering tensor: 239 for ONNX tensor: 239
TRT - VERBOSE
Transpose_221 [Transpose] outputs: [239 -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Flatten_222 [Flatten]
TRT - VERBOSE
Searching for input: 239
TRT - VERBOSE
Flatten_222 [Flatten] inputs: [239 -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Flatten_222 for ONNX node: Flatten_222
TRT - VERBOSE
Registering tensor: 240 for ONNX tensor: 240
TRT - VERBOSE
Flatten_222 [Flatten] outputs: [240 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_223 [Mul]
TRT - VERBOSE
Searching for input: 142
TRT - VERBOSE
Searching for input: 238
TRT - VERBOSE
Mul_223 [Mul] inputs: [142 -> (-1)[INT32]], [238 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Mul_223 for ONNX node: Mul_223
TRT - VERBOSE
Registering tensor: 241 for ONNX tensor: 241
TRT - VERBOSE
Mul_223 [Mul] outputs: [241 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Add_224 [Add]
TRT - VERBOSE
Searching for input: 150
TRT - VERBOSE
Searching for input: 241
TRT - VERBOSE
Add_224 [Add] inputs: [150 -> (-1)[INT32]], [241 -> (-1)[INT32]], 
TRT - VERBOSE
Registering layer: Add_224 for ONNX node: Add_224
TRT - VERBOSE
Registering tensor: 242 for ONNX tensor: 242
TRT - VERBOSE
Add_224 [Add] outputs: [242 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_225 [Gather]
TRT - VERBOSE
Searching for input: 240
TRT - VERBOSE
Searching for input: 242
TRT - VERBOSE
Gather_225 [Gather] inputs: [240 -> (-1, -1)[FLOAT]], [242 -> (-1)[INT32]], 
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_225 for ONNX node: Gather_225
TRT - VERBOSE
Registering tensor: 243 for ONNX tensor: 243
TRT - VERBOSE
Gather_225 [Gather] outputs: [243 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_226 [Shape]
TRT - VERBOSE
Searching for input: 242
TRT - VERBOSE
Shape_226 [Shape] inputs: [242 -> (-1)[INT32]], 
TRT - VERBOSE
Registering layer: Shape_226 for ONNX node: Shape_226
TRT - VERBOSE
Registering tensor: 244 for ONNX tensor: 244
TRT - VERBOSE
Shape_226 [Shape] outputs: [244 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Concat_228 [Concat]
TRT - VERBOSE
Searching for input: 245
TRT - VERBOSE
Searching for input: 234
TRT - VERBOSE
Searching for input: 236
TRT - VERBOSE
Concat_228 [Concat] inputs: [245 -> (1)[INT32]], [234 -> (1)[INT32]], [236 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 245 for ONNX node: 245
TRT - VERBOSE
Registering layer: Concat_228 for ONNX node: Concat_228
TRT - VERBOSE
Registering tensor: 246 for ONNX tensor: 246
TRT - VERBOSE
Concat_228 [Concat] outputs: [246 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_229 [Reshape]
TRT - VERBOSE
Searching for input: 243
TRT - VERBOSE
Searching for input: 246
TRT - VERBOSE
Reshape_229 [Reshape] inputs: [243 -> (-1, -1)[FLOAT]], [246 -> (3)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_229 for ONNX node: Reshape_229
TRT - VERBOSE
Registering tensor: 247 for ONNX tensor: 247
TRT - VERBOSE
Reshape_229 [Reshape] outputs: [247 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Transpose_230 [Transpose]
TRT - VERBOSE
Searching for input: 247
TRT - VERBOSE
Transpose_230 [Transpose] inputs: [247 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_230 for ONNX node: Transpose_230
TRT - VERBOSE
Registering tensor: 248 for ONNX tensor: 248
TRT - VERBOSE
Transpose_230 [Transpose] outputs: [248 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Concat_231 [Concat]
TRT - VERBOSE
Searching for input: 234
TRT - VERBOSE
Searching for input: 236
TRT - VERBOSE
Searching for input: 244
TRT - VERBOSE
Concat_231 [Concat] inputs: [234 -> (1)[INT32]], [236 -> (1)[INT32]], [244 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Concat_231 for ONNX node: Concat_231
TRT - VERBOSE
Registering tensor: 249 for ONNX tensor: 249
TRT - VERBOSE
Concat_231 [Concat] outputs: [249 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_232 [Reshape]
TRT - VERBOSE
Searching for input: 248
TRT - VERBOSE
Searching for input: 249
TRT - VERBOSE
Reshape_232 [Reshape] inputs: [248 -> (-1, -1, -1)[FLOAT]], [249 -> (3)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_232 for ONNX node: Reshape_232
TRT - VERBOSE
Registering tensor: 250 for ONNX tensor: 250
TRT - VERBOSE
Reshape_232 [Reshape] outputs: [250 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_233 [Mul]
TRT - VERBOSE
Searching for input: 186
TRT - VERBOSE
Searching for input: 250
TRT - VERBOSE
Mul_233 [Mul] inputs: [186 -> (1, 1, -1)[FLOAT]], [250 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_233 for ONNX node: Mul_233
TRT - VERBOSE
Registering tensor: 251 for ONNX tensor: 251
TRT - VERBOSE
Mul_233 [Mul] outputs: [251 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Add_234 [Add]
TRT - VERBOSE
Searching for input: 231
TRT - VERBOSE
Searching for input: 251
TRT - VERBOSE
Add_234 [Add] inputs: [231 -> (-1, -1, -1)[FLOAT]], [251 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Add_234 for ONNX node: Add_234
TRT - VERBOSE
Registering tensor: 252 for ONNX tensor: 252
TRT - VERBOSE
Add_234 [Add] outputs: [252 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_235 [Shape]
TRT - VERBOSE
Searching for input: dense_feat_map
TRT - VERBOSE
Shape_235 [Shape] inputs: [dense_feat_map -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_235 for ONNX node: Shape_235
TRT - VERBOSE
Registering tensor: 253 for ONNX tensor: 253
TRT - VERBOSE
Shape_235 [Shape] outputs: [253 -> (4)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_237 [Gather]
TRT - VERBOSE
Searching for input: 253
TRT - VERBOSE
Searching for input: 254
TRT - VERBOSE
Gather_237 [Gather] inputs: [253 -> (4)[INT32]], [254 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 254 for ONNX node: 254
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_237 for ONNX node: Gather_237
TRT - VERBOSE
Registering tensor: 255 for ONNX tensor: 255
TRT - VERBOSE
Gather_237 [Gather] outputs: [255 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_239 [Gather]
TRT - VERBOSE
Searching for input: 253
TRT - VERBOSE
Searching for input: 256
TRT - VERBOSE
Gather_239 [Gather] inputs: [253 -> (4)[INT32]], [256 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 256 for ONNX node: 256
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_239 for ONNX node: Gather_239
TRT - VERBOSE
Registering tensor: 257 for ONNX tensor: 257
TRT - VERBOSE
Gather_239 [Gather] outputs: [257 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_241 [Gather]
TRT - VERBOSE
Searching for input: 253
TRT - VERBOSE
Searching for input: 258
TRT - VERBOSE
Gather_241 [Gather] inputs: [253 -> (4)[INT32]], [258 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 258 for ONNX node: 258
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_241 for ONNX node: Gather_241
TRT - VERBOSE
Registering tensor: 259 for ONNX tensor: 259
TRT - VERBOSE
Gather_241 [Gather] outputs: [259 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Transpose_242 [Transpose]
TRT - VERBOSE
Searching for input: dense_feat_map
TRT - VERBOSE
Transpose_242 [Transpose] inputs: [dense_feat_map -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_242 for ONNX node: Transpose_242
TRT - VERBOSE
Registering tensor: 260 for ONNX tensor: 260
TRT - VERBOSE
Transpose_242 [Transpose] outputs: [260 -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Flatten_243 [Flatten]
TRT - VERBOSE
Searching for input: 260
TRT - VERBOSE
Flatten_243 [Flatten] inputs: [260 -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Flatten_243 for ONNX node: Flatten_243
TRT - VERBOSE
Registering tensor: 261 for ONNX tensor: 261
TRT - VERBOSE
Flatten_243 [Flatten] outputs: [261 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_244 [Mul]
TRT - VERBOSE
Searching for input: 142
TRT - VERBOSE
Searching for input: 259
TRT - VERBOSE
Mul_244 [Mul] inputs: [142 -> (-1)[INT32]], [259 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Mul_244 for ONNX node: Mul_244
TRT - VERBOSE
Registering tensor: 262 for ONNX tensor: 262
TRT - VERBOSE
Mul_244 [Mul] outputs: [262 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Add_245 [Add]
TRT - VERBOSE
Searching for input: 158
TRT - VERBOSE
Searching for input: 262
TRT - VERBOSE
Add_245 [Add] inputs: [158 -> (-1)[INT32]], [262 -> (-1)[INT32]], 
TRT - VERBOSE
Registering layer: Add_245 for ONNX node: Add_245
TRT - VERBOSE
Registering tensor: 263 for ONNX tensor: 263
TRT - VERBOSE
Add_245 [Add] outputs: [263 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_246 [Gather]
TRT - VERBOSE
Searching for input: 261
TRT - VERBOSE
Searching for input: 263
TRT - VERBOSE
Gather_246 [Gather] inputs: [261 -> (-1, -1)[FLOAT]], [263 -> (-1)[INT32]], 
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_246 for ONNX node: Gather_246
TRT - VERBOSE
Registering tensor: 264 for ONNX tensor: 264
TRT - VERBOSE
Gather_246 [Gather] outputs: [264 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_247 [Shape]
TRT - VERBOSE
Searching for input: 263
TRT - VERBOSE
Shape_247 [Shape] inputs: [263 -> (-1)[INT32]], 
TRT - VERBOSE
Registering layer: Shape_247 for ONNX node: Shape_247
TRT - VERBOSE
Registering tensor: 265 for ONNX tensor: 265
TRT - VERBOSE
Shape_247 [Shape] outputs: [265 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Concat_249 [Concat]
TRT - VERBOSE
Searching for input: 266
TRT - VERBOSE
Searching for input: 255
TRT - VERBOSE
Searching for input: 257
TRT - VERBOSE
Concat_249 [Concat] inputs: [266 -> (1)[INT32]], [255 -> (1)[INT32]], [257 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 266 for ONNX node: 266
TRT - VERBOSE
Registering layer: Concat_249 for ONNX node: Concat_249
TRT - VERBOSE
Registering tensor: 267 for ONNX tensor: 267
TRT - VERBOSE
Concat_249 [Concat] outputs: [267 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_250 [Reshape]
TRT - VERBOSE
Searching for input: 264
TRT - VERBOSE
Searching for input: 267
TRT - VERBOSE
Reshape_250 [Reshape] inputs: [264 -> (-1, -1)[FLOAT]], [267 -> (3)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_250 for ONNX node: Reshape_250
TRT - VERBOSE
Registering tensor: 268 for ONNX tensor: 268
TRT - VERBOSE
Reshape_250 [Reshape] outputs: [268 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Transpose_251 [Transpose]
TRT - VERBOSE
Searching for input: 268
TRT - VERBOSE
Transpose_251 [Transpose] inputs: [268 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_251 for ONNX node: Transpose_251
TRT - VERBOSE
Registering tensor: 269 for ONNX tensor: 269
TRT - VERBOSE
Transpose_251 [Transpose] outputs: [269 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Concat_252 [Concat]
TRT - VERBOSE
Searching for input: 255
TRT - VERBOSE
Searching for input: 257
TRT - VERBOSE
Searching for input: 265
TRT - VERBOSE
Concat_252 [Concat] inputs: [255 -> (1)[INT32]], [257 -> (1)[INT32]], [265 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Concat_252 for ONNX node: Concat_252
TRT - VERBOSE
Registering tensor: 270 for ONNX tensor: 270
TRT - VERBOSE
Concat_252 [Concat] outputs: [270 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_253 [Reshape]
TRT - VERBOSE
Searching for input: 269
TRT - VERBOSE
Searching for input: 270
TRT - VERBOSE
Reshape_253 [Reshape] inputs: [269 -> (-1, -1, -1)[FLOAT]], [270 -> (3)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_253 for ONNX node: Reshape_253
TRT - VERBOSE
Registering tensor: 271 for ONNX tensor: 271
TRT - VERBOSE
Reshape_253 [Reshape] outputs: [271 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_254 [Mul]
TRT - VERBOSE
Searching for input: 190
TRT - VERBOSE
Searching for input: 271
TRT - VERBOSE
Mul_254 [Mul] inputs: [190 -> (1, 1, -1)[FLOAT]], [271 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_254 for ONNX node: Mul_254
TRT - VERBOSE
Registering tensor: 272 for ONNX tensor: 272
TRT - VERBOSE
Mul_254 [Mul] outputs: [272 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Add_255 [Add]
TRT - VERBOSE
Searching for input: 252
TRT - VERBOSE
Searching for input: 272
TRT - VERBOSE
Add_255 [Add] inputs: [252 -> (-1, -1, -1)[FLOAT]], [272 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Add_255 for ONNX node: Add_255
TRT - VERBOSE
Registering tensor: 273 for ONNX tensor: 273
TRT - VERBOSE
Add_255 [Add] outputs: [273 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Transpose_256 [Transpose]
TRT - VERBOSE
Searching for input: 273
TRT - VERBOSE
Transpose_256 [Transpose] inputs: [273 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_256 for ONNX node: Transpose_256
TRT - VERBOSE
Registering tensor: 274 for ONNX tensor: 274
TRT - VERBOSE
Transpose_256 [Transpose] outputs: [274 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: ReduceL2_257 [ReduceL2]
TRT - VERBOSE
Searching for input: 274
TRT - VERBOSE
ReduceL2_257 [ReduceL2] inputs: [274 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: ReduceL2_257 for ONNX node: ReduceL2_257
TRT - VERBOSE
Registering layer: ReduceL2_257_96 for ONNX node: ReduceL2_257
TRT - VERBOSE
Registering tensor: 275 for ONNX tensor: 275
TRT - VERBOSE
ReduceL2_257 [ReduceL2] outputs: [275 -> (-1, -1, 1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Clip_258 [Clip]
TRT - VERBOSE
Searching for input: 275
TRT - VERBOSE
Searching for input: 292
TRT - VERBOSE
Clip_258 [Clip] inputs: [275 -> (-1, -1, 1)[FLOAT]], [292 -> ()[FLOAT]], [optional input, not set], 
TRT - VERBOSE
Registering layer: 292 for ONNX node: 292
TRT - VERBOSE
Registering tensor: 279 for ONNX tensor: 279
TRT - VERBOSE
Clip_258 [Clip] outputs: [279 -> (-1, -1, 1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_259 [Shape]
TRT - VERBOSE
Searching for input: 274
TRT - VERBOSE
Shape_259 [Shape] inputs: [274 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_259 for ONNX node: Shape_259
TRT - VERBOSE
Registering tensor: 280 for ONNX tensor: 280
TRT - VERBOSE
Shape_259 [Shape] outputs: [280 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Expand_260 [Expand]
TRT - VERBOSE
Searching for input: 279
TRT - VERBOSE
Searching for input: 280
TRT - VERBOSE
Expand_260 [Expand] inputs: [279 -> (-1, -1, 1)[FLOAT]], [280 -> (3)[INT32]], 
TRT - VERBOSE
Registering layer: Expand_260 for ONNX node: Expand_260
TRT - VERBOSE
Registering tensor: 281 for ONNX tensor: 281
TRT - VERBOSE
Expand_260 [Expand] outputs: [281 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Div_261 [Div]
TRT - VERBOSE
Searching for input: 274
TRT - VERBOSE
Searching for input: 281
TRT - VERBOSE
Div_261 [Div] inputs: [274 -> (-1, -1, -1)[FLOAT]], [281 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Div_261 for ONNX node: Div_261
TRT - VERBOSE
Registering tensor: descs_100 for ONNX tensor: descs
TRT - VERBOSE
Div_261 [Div] outputs: [descs -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Gather_263 [Gather]
TRT - VERBOSE
Searching for input: 98
TRT - VERBOSE
Searching for input: 283
TRT - VERBOSE
Gather_263 [Gather] inputs: [98 -> (-1, -1, 2)[FLOAT]], [283 -> (2)[INT32]], 
TRT - VERBOSE
Registering layer: 283 for ONNX node: 283
TRT - VERBOSE
Using Gather axis: 2
TRT - VERBOSE
Registering layer: Gather_263 for ONNX node: Gather_263
TRT - VERBOSE
Registering tensor: kpts_101 for ONNX tensor: kpts
TRT - VERBOSE
Gather_263 [Gather] outputs: [kpts -> (-1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Marking descs_100 as output: descs
TRT - VERBOSE
Marking kpts_101 as output: kpts
TRT - VERBOSE
Marking scores_63 as output: scores
===============================================================
TensorRT model supports report:
Model is fully supported by TRT and can be parsed by it!
The model is fully supported by the TRT. Printing the parsed graph:
subGraph index -  0 : Fully supported
__________________________
Model Supported nodes:
     subGraphIndex  NodeIndex   Operator  Support
0                0          0       Cast     True
1                0          1       Conv     True
6                0          6        Mul     True
8                0          8        Sub     True
9                0          9        Div     True
10               0         10      Equal     True
12               0         12      Where     True
13               0         13        Neg     True
24               0         24        Add     True
30               0         30  Unsqueeze     True
32               0         32     Concat     True
33               0         33       Clip     True
34               0         34     Gather     True
36               0         36      Shape     True
39               0         39  Transpose     True
40               0         40    Flatten     True
46               0         46    Reshape     True
81               0         81      Floor     True
86               0         86       Ceil     True
189              0        189   ReduceL2     True
192              0        192     Expand     True
Operator
Gather       31
Mul          19
Shape        18
Cast         15
Unsqueeze    15
Concat       14
Reshape      13
Transpose    12
Add          11
Sub          11
Clip          6
Div           5
Flatten       5
Conv          5
Where         3
Equal         3
Neg           3
Ceil          2
Floor         2
Expand        1
ReduceL2      1
Name: count, dtype: int64
__________________________
Model NotSupported nodes:
Empty DataFrame
Columns: [subGraphIndex, NodeIndex, Operator, Support, count]
Index: []
Operator
Gather       31
Mul          19
Shape        18
Cast         15
Unsqueeze    15
Concat       14
Reshape      13
Transpose    12
Add          11
Sub          11
Clip          6
Div           5
Flatten       5
Conv          5
Where         3
Equal         3
Neg           3
Ceil          2
Floor         2
Expand        1
ReduceL2      1
Name: count, dtype: int64
__________________________
Model topology:
     subGraphIndex  NodeIndex   Operator  Support  count
0                0          0       Cast     True      1
1                0          1       Conv     True      1
2                0          2       Conv     True      1
3                0          3       Conv     True      1
4                0          4       Conv     True      1
5                0          5       Conv     True      1
6                0          6        Mul     True      1
7                0          7        Mul     True      1
8                0          8        Sub     True      1
9                0          9        Div     True      1
10               0         10      Equal     True      1
11               0         11       Cast     True      1
12               0         12      Where     True      1
13               0         13        Neg     True      1
14               0         14        Div     True      1
15               0         15      Equal     True      1
16               0         16       Cast     True      1
17               0         17      Where     True      1
18               0         18        Div     True      1
19               0         19      Equal     True      1
20               0         20       Cast     True      1
21               0         21      Where     True      1
22               0         22        Mul     True      1
23               0         23        Mul     True      1
24               0         24        Add     True      1
25               0         25        Neg     True      1
26               0         26        Mul     True      1
27               0         27        Mul     True      1
28               0         28        Add     True      1
29               0         29        Neg     True      1
30               0         30  Unsqueeze     True      1
31               0         31  Unsqueeze     True      1
32               0         32     Concat     True      1
33               0         33       Clip     True      1
34               0         34     Gather     True      1
35               0         35     Gather     True      1
36               0         36      Shape     True      1
37               0         37     Gather     True      1
38               0         38     Gather     True      1
39               0         39  Transpose     True      1
40               0         40    Flatten     True      1
41               0         41        Mul     True      1
42               0         42        Add     True      1
43               0         43     Gather     True      1
44               0         44      Shape     True      1
45               0         45     Concat     True      1
46               0         46    Reshape     True      1
47               0         47  Transpose     True      1
48               0         48     Concat     True      1
49               0         49    Reshape     True      1
50               0         50      Shape     True      1
51               0         51     Gather     True      1
52               0         52      Shape     True      1
53               0         53     Gather     True      1
54               0         54      Shape     True      1
55               0         55     Gather     True      1
56               0         56  Unsqueeze     True      1
57               0         57  Unsqueeze     True      1
58               0         58  Unsqueeze     True      1
59               0         59     Concat     True      1
60               0         60    Reshape     True      1
61               0         61       Cast     True      1
62               0         62        Add     True      1
63               0         63  Transpose     True      1
64               0         64        Div     True      1
65               0         65      Shape     True      1
66               0         66     Gather     True      1
67               0         67      Shape     True      1
68               0         68     Gather     True      1
69               0         69     Gather     True      1
70               0         70      Shape     True      1
71               0         71     Gather     True      1
72               0         72  Unsqueeze     True      1
73               0         73     Concat     True      1
74               0         74    Reshape     True      1
75               0         75     Gather     True      1
76               0         76      Shape     True      1
77               0         77     Gather     True      1
78               0         78  Unsqueeze     True      1
79               0         79     Concat     True      1
80               0         80    Reshape     True      1
81               0         81      Floor     True      1
82               0         82       Cast     True      1
83               0         83        Sub     True      1
84               0         84       Cast     True      1
85               0         85       Clip     True      1
86               0         86       Ceil     True      1
87               0         87       Cast     True      1
88               0         88        Sub     True      1
89               0         89       Cast     True      1
90               0         90       Clip     True      1
91               0         91      Floor     True      1
92               0         92       Cast     True      1
93               0         93        Sub     True      1
94               0         94       Cast     True      1
95               0         95       Clip     True      1
96               0         96       Ceil     True      1
97               0         97       Cast     True      1
98               0         98        Sub     True      1
99               0         99       Cast     True      1
100              0        100       Clip     True      1
101              0        101       Cast     True      1
102              0        102        Sub     True      1
103              0        103       Cast     True      1
104              0        104        Sub     True      1
105              0        105        Sub     True      1
106              0        106        Sub     True      1
107              0        107        Mul     True      1
108              0        108        Sub     True      1
109              0        109        Mul     True      1
110              0        110        Sub     True      1
111              0        111        Mul     True      1
112              0        112        Mul     True      1
113              0        113  Unsqueeze     True      1
114              0        114  Unsqueeze     True      1
115              0        115  Unsqueeze     True      1
116              0        116  Unsqueeze     True      1
117              0        117  Unsqueeze     True      1
118              0        118  Unsqueeze     True      1
119              0        119  Unsqueeze     True      1
120              0        120  Unsqueeze     True      1
121              0        121      Shape     True      1
122              0        122     Gather     True      1
123              0        123     Gather     True      1
124              0        124     Gather     True      1
125              0        125  Transpose     True      1
126              0        126    Flatten     True      1
127              0        127        Mul     True      1
128              0        128        Add     True      1
129              0        129     Gather     True      1
130              0        130      Shape     True      1
131              0        131     Concat     True      1
132              0        132    Reshape     True      1
133              0        133  Transpose     True      1
134              0        134     Concat     True      1
135              0        135    Reshape     True      1
136              0        136        Mul     True      1
137              0        137      Shape     True      1
138              0        138     Gather     True      1
139              0        139     Gather     True      1
140              0        140     Gather     True      1
141              0        141  Transpose     True      1
142              0        142    Flatten     True      1
143              0        143        Mul     True      1
144              0        144        Add     True      1
145              0        145     Gather     True      1
146              0        146      Shape     True      1
147              0        147     Concat     True      1
148              0        148    Reshape     True      1
149              0        149  Transpose     True      1
150              0        150     Concat     True      1
151              0        151    Reshape     True      1
152              0        152        Mul     True      1
153              0        153        Add     True      1
154              0        154      Shape     True      1
155              0        155     Gather     True      1
156              0        156     Gather     True      1
157              0        157     Gather     True      1
158              0        158  Transpose     True      1
159              0        159    Flatten     True      1
160              0        160        Mul     True      1
161              0        161        Add     True      1
162              0        162     Gather     True      1
163              0        163      Shape     True      1
164              0        164     Concat     True      1
165              0        165    Reshape     True      1
166              0        166  Transpose     True      1
167              0        167     Concat     True      1
168              0        168    Reshape     True      1
169              0        169        Mul     True      1
170              0        170        Add     True      1
171              0        171      Shape     True      1
172              0        172     Gather     True      1
173              0        173     Gather     True      1
174              0        174     Gather     True      1
175              0        175  Transpose     True      1
176              0        176    Flatten     True      1
177              0        177        Mul     True      1
178              0        178        Add     True      1
179              0        179     Gather     True      1
180              0        180      Shape     True      1
181              0        181     Concat     True      1
182              0        182    Reshape     True      1
183              0        183  Transpose     True      1
184              0        184     Concat     True      1
185              0        185    Reshape     True      1
186              0        186        Mul     True      1
187              0        187        Add     True      1
188              0        188  Transpose     True      1
189              0        189   ReduceL2     True      1
190              0        190       Clip     True      1
191              0        191      Shape     True      1
192              0        192     Expand     True      1
193              0        193        Div     True      1
194              0        194     Gather     True      1
===============================================================
Beginning Onnx file parsing
TRT - INFO
----------------------------------------------------------------
TRT - INFO
Input filename:   ../Delivery/model2_folded.onnx
TRT - INFO
ONNX IR version:  0.0.7
TRT - INFO
Opset version:    13
TRT - INFO
Producer name:    
TRT - INFO
Producer version: 
TRT - INFO
Domain:           
TRT - INFO
Model version:    0
TRT - INFO
Doc string:       
TRT - INFO
----------------------------------------------------------------
TRT - VERBOSE
Plugin creator already registered - ::GridAnchor_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::GridAnchorRect_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::NMS_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::Reorg_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::Region_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::Clip_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::LReLU_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::PriorBox_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::Normalize_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::ScatterND version 1
TRT - VERBOSE
Plugin creator already registered - ::RPROI_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::BatchedNMS_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::BatchTilePlugin_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::FlattenConcat_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::CropAndResize version 1
TRT - VERBOSE
Plugin creator already registered - ::CropAndResizeDynamic version 1
TRT - VERBOSE
Plugin creator already registered - ::DetectionLayer_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::EfficientNMS_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::EfficientNMS_Explicit_TF_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::EfficientNMS_Implicit_TF_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::ProposalDynamic version 1
TRT - VERBOSE
Plugin creator already registered - ::Proposal version 1
TRT - VERBOSE
Plugin creator already registered - ::ProposalLayer_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::PyramidROIAlign_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::ResizeNearest_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::Split version 1
TRT - VERBOSE
Plugin creator already registered - ::SpecialSlice_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::InstanceNormalization_TRT version 1
TRT - VERBOSE
Plugin creator already registered - ::InstanceNormalization_TRT version 2
TRT - VERBOSE
Plugin creator already registered - ::NMSDynamic_TRT version 1
TRT - VERBOSE
Adding network input: keypoints with dtype: float32, dimensions: (-1, -1, -1)
TRT - VERBOSE
Registering tensor: keypoints for ONNX tensor: keypoints
TRT - VERBOSE
Adding network input: scores.1 with dtype: float32, dimensions: (-1, -1)
TRT - VERBOSE
Registering tensor: scores.1 for ONNX tensor: scores.1
TRT - VERBOSE
Adding network input: score_map with dtype: float32, dimensions: (-1, -1, -1, -1)
TRT - VERBOSE
Registering tensor: score_map for ONNX tensor: score_map
TRT - VERBOSE
Adding network input: dense_feat_map with dtype: float32, dimensions: (-1, -1, -1, -1)
TRT - VERBOSE
Registering tensor: dense_feat_map for ONNX tensor: dense_feat_map
TRT - VERBOSE
Importing initializer: 5
TRT - VERBOSE
Importing initializer: 7
TRT - VERBOSE
Importing initializer: 9
TRT - VERBOSE
Importing initializer: 11
TRT - VERBOSE
Importing initializer: 13
TRT - VERBOSE
Importing initializer: 19
TRT - VERBOSE
Importing initializer: 22
TRT - VERBOSE
Importing initializer: 26
TRT - VERBOSE
Importing initializer: 29
TRT - VERBOSE
Importing initializer: 32
TRT - VERBOSE
Importing initializer: 35
TRT - VERBOSE
Importing initializer: 45
TRT - VERBOSE
Importing initializer: 47
TRT - VERBOSE
Importing initializer: 285
TRT - VERBOSE
Importing initializer: 286
TRT - VERBOSE
Importing initializer: 55
TRT - VERBOSE
Importing initializer: 57
TRT - VERBOSE
Importing initializer: 60
TRT - VERBOSE
Importing initializer: 64
TRT - VERBOSE
Importing initializer: 74
TRT - VERBOSE
Importing initializer: 63
TRT - VERBOSE
Importing initializer: 67
TRT - VERBOSE
Importing initializer: 81
TRT - VERBOSE
Importing initializer: 84
TRT - VERBOSE
Importing initializer: 87
TRT - VERBOSE
Importing initializer: 89
TRT - VERBOSE
Importing initializer: 91
TRT - VERBOSE
Importing initializer: 93
TRT - VERBOSE
Importing initializer: 287
TRT - VERBOSE
Importing initializer: 104
TRT - VERBOSE
Importing initializer: 107
TRT - VERBOSE
Importing initializer: 109
TRT - VERBOSE
Importing initializer: 112
TRT - VERBOSE
Importing initializer: 114
TRT - VERBOSE
Importing initializer: 118
TRT - VERBOSE
Importing initializer: 121
TRT - VERBOSE
Importing initializer: 123
TRT - VERBOSE
Importing initializer: 129
TRT - VERBOSE
Importing initializer: 288
TRT - VERBOSE
Importing initializer: 137
TRT - VERBOSE
Importing initializer: 289
TRT - VERBOSE
Importing initializer: 145
TRT - VERBOSE
Importing initializer: 290
TRT - VERBOSE
Importing initializer: 153
TRT - VERBOSE
Importing initializer: 291
TRT - VERBOSE
Importing initializer: 163
TRT - VERBOSE
Importing initializer: 165
TRT - VERBOSE
Importing initializer: 168
TRT - VERBOSE
Importing initializer: 171
TRT - VERBOSE
Importing initializer: 175
TRT - VERBOSE
Importing initializer: 177
TRT - VERBOSE
Importing initializer: 179
TRT - VERBOSE
Importing initializer: 181
TRT - VERBOSE
Importing initializer: 183
TRT - VERBOSE
Importing initializer: 185
TRT - VERBOSE
Importing initializer: 187
TRT - VERBOSE
Importing initializer: 189
TRT - VERBOSE
Importing initializer: 192
TRT - VERBOSE
Importing initializer: 194
TRT - VERBOSE
Importing initializer: 196
TRT - VERBOSE
Importing initializer: 204
TRT - VERBOSE
Importing initializer: 212
TRT - VERBOSE
Importing initializer: 214
TRT - VERBOSE
Importing initializer: 216
TRT - VERBOSE
Importing initializer: 224
TRT - VERBOSE
Importing initializer: 233
TRT - VERBOSE
Importing initializer: 235
TRT - VERBOSE
Importing initializer: 237
TRT - VERBOSE
Importing initializer: 245
TRT - VERBOSE
Importing initializer: 254
TRT - VERBOSE
Importing initializer: 256
TRT - VERBOSE
Importing initializer: 258
TRT - VERBOSE
Importing initializer: 266
TRT - VERBOSE
Importing initializer: 292
TRT - VERBOSE
Importing initializer: 283
TRT - VERBOSE
Parsing node: Cast_0 [Cast]
TRT - VERBOSE
Searching for input: keypoints
TRT - VERBOSE
Cast_0 [Cast] inputs: [keypoints -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Casting to type: int32
TRT - VERBOSE
Registering layer: Cast_0 for ONNX node: Cast_0
TRT - VERBOSE
Registering tensor: 4 for ONNX tensor: 4
TRT - VERBOSE
Cast_0 [Cast] outputs: [4 -> (-1, -1, -1)[INT32]], 
TRT - VERBOSE
Parsing node: Conv_2 [Conv]
TRT - VERBOSE
Searching for input: score_map
TRT - VERBOSE
Searching for input: 5
TRT - VERBOSE
Conv_2 [Conv] inputs: [score_map -> (-1, -1, -1, -1)[FLOAT]], [5 -> (1, 1, 3, 3)[FLOAT]], 
TRT - VERBOSE
Convolution input dimensions: (-1, -1, -1, -1)
TRT - VERBOSE
Registering layer: Conv_2 for ONNX node: Conv_2
TRT - VERBOSE
Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1
TRT - VERBOSE
Convolution output dimensions: (-1, 1, -1, -1)
TRT - VERBOSE
Registering tensor: 6 for ONNX tensor: 6
TRT - VERBOSE
Conv_2 [Conv] outputs: [6 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Conv_4 [Conv]
TRT - VERBOSE
Searching for input: score_map
TRT - VERBOSE
Searching for input: 7
TRT - VERBOSE
Conv_4 [Conv] inputs: [score_map -> (-1, -1, -1, -1)[FLOAT]], [7 -> (1, 1, 3, 3)[FLOAT]], 
TRT - VERBOSE
Convolution input dimensions: (-1, -1, -1, -1)
TRT - VERBOSE
Registering layer: Conv_4 for ONNX node: Conv_4
TRT - VERBOSE
Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1
TRT - VERBOSE
Convolution output dimensions: (-1, 1, -1, -1)
TRT - VERBOSE
Registering tensor: 8 for ONNX tensor: 8
TRT - VERBOSE
Conv_4 [Conv] outputs: [8 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Conv_6 [Conv]
TRT - VERBOSE
Searching for input: score_map
TRT - VERBOSE
Searching for input: 9
TRT - VERBOSE
Conv_6 [Conv] inputs: [score_map -> (-1, -1, -1, -1)[FLOAT]], [9 -> (1, 1, 3, 3)[FLOAT]], 
TRT - VERBOSE
Convolution input dimensions: (-1, -1, -1, -1)
TRT - VERBOSE
Registering layer: Conv_6 for ONNX node: Conv_6
TRT - VERBOSE
Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1
TRT - VERBOSE
Convolution output dimensions: (-1, 1, -1, -1)
TRT - VERBOSE
Registering tensor: 10 for ONNX tensor: 10
TRT - VERBOSE
Conv_6 [Conv] outputs: [10 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Conv_8 [Conv]
TRT - VERBOSE
Searching for input: score_map
TRT - VERBOSE
Searching for input: 11
TRT - VERBOSE
Conv_8 [Conv] inputs: [score_map -> (-1, -1, -1, -1)[FLOAT]], [11 -> (1, 1, 3, 3)[FLOAT]], 
TRT - VERBOSE
Convolution input dimensions: (-1, -1, -1, -1)
TRT - VERBOSE
Registering layer: Conv_8 for ONNX node: Conv_8
TRT - VERBOSE
Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1
TRT - VERBOSE
Convolution output dimensions: (-1, 1, -1, -1)
TRT - VERBOSE
Registering tensor: 12 for ONNX tensor: 12
TRT - VERBOSE
Conv_8 [Conv] outputs: [12 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Conv_10 [Conv]
TRT - VERBOSE
Searching for input: score_map
TRT - VERBOSE
Searching for input: 13
TRT - VERBOSE
Conv_10 [Conv] inputs: [score_map -> (-1, -1, -1, -1)[FLOAT]], [13 -> (1, 1, 3, 3)[FLOAT]], 
TRT - VERBOSE
Convolution input dimensions: (-1, -1, -1, -1)
TRT - VERBOSE
Registering layer: Conv_10 for ONNX node: Conv_10
TRT - VERBOSE
Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1
TRT - VERBOSE
Convolution output dimensions: (-1, 1, -1, -1)
TRT - VERBOSE
Registering tensor: 14 for ONNX tensor: 14
TRT - VERBOSE
Conv_10 [Conv] outputs: [14 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_11 [Mul]
TRT - VERBOSE
Searching for input: 6
TRT - VERBOSE
Searching for input: 10
TRT - VERBOSE
Mul_11 [Mul] inputs: [6 -> (-1, 1, -1, -1)[FLOAT]], [10 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_11 for ONNX node: Mul_11
TRT - VERBOSE
Registering tensor: 15 for ONNX tensor: 15
TRT - VERBOSE
Mul_11 [Mul] outputs: [15 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_12 [Mul]
TRT - VERBOSE
Searching for input: 8
TRT - VERBOSE
Searching for input: 8
TRT - VERBOSE
Mul_12 [Mul] inputs: [8 -> (-1, 1, -1, -1)[FLOAT]], [8 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_12 for ONNX node: Mul_12
TRT - VERBOSE
Registering tensor: 16 for ONNX tensor: 16
TRT - VERBOSE
Mul_12 [Mul] outputs: [16 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Sub_13 [Sub]
TRT - VERBOSE
Searching for input: 15
TRT - VERBOSE
Searching for input: 16
TRT - VERBOSE
Sub_13 [Sub] inputs: [15 -> (-1, 1, -1, -1)[FLOAT]], [16 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Sub_13 for ONNX node: Sub_13
TRT - VERBOSE
Registering tensor: 17 for ONNX tensor: 17
TRT - VERBOSE
Sub_13 [Sub] outputs: [17 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Div_14 [Div]
TRT - VERBOSE
Searching for input: 10
TRT - VERBOSE
Searching for input: 17
TRT - VERBOSE
Div_14 [Div] inputs: [10 -> (-1, 1, -1, -1)[FLOAT]], [17 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Div_14 for ONNX node: Div_14
TRT - VERBOSE
Registering tensor: 18 for ONNX tensor: 18
TRT - VERBOSE
Div_14 [Div] outputs: [18 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Equal_16 [Equal]
TRT - VERBOSE
Searching for input: 18
TRT - VERBOSE
Searching for input: 19
TRT - VERBOSE
Equal_16 [Equal] inputs: [18 -> (-1, 1, -1, -1)[FLOAT]], [19 -> ()[FLOAT]], 
TRT - VERBOSE
Registering layer: 19 for ONNX node: 19
TRT - VERBOSE
Registering layer: Equal_16 for ONNX node: Equal_16
TRT - VERBOSE
Registering tensor: 20 for ONNX tensor: 20
TRT - VERBOSE
Equal_16 [Equal] outputs: [20 -> (-1, 1, -1, -1)[BOOL]], 
TRT - VERBOSE
Parsing node: Cast_17 [Cast]
TRT - VERBOSE
Searching for input: 20
TRT - VERBOSE
Cast_17 [Cast] inputs: [20 -> (-1, 1, -1, -1)[BOOL]], 
TRT - VERBOSE
Casting to type: bool
TRT - VERBOSE
Registering layer: Cast_17 for ONNX node: Cast_17
TRT - VERBOSE
Registering tensor: 21 for ONNX tensor: 21
TRT - VERBOSE
Cast_17 [Cast] outputs: [21 -> (-1, 1, -1, -1)[BOOL]], 
TRT - VERBOSE
Parsing node: Where_19 [Where]
TRT - VERBOSE
Searching for input: 21
TRT - VERBOSE
Searching for input: 22
TRT - VERBOSE
Searching for input: 18
TRT - VERBOSE
Where_19 [Where] inputs: [21 -> (-1, 1, -1, -1)[BOOL]], [22 -> ()[FLOAT]], [18 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: 22 for ONNX node: 22
TRT - VERBOSE
Registering layer: Where_19 for ONNX node: Where_19
TRT - VERBOSE
Registering tensor: 23 for ONNX tensor: 23
TRT - VERBOSE
Where_19 [Where] outputs: [23 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Neg_20 [Neg]
TRT - VERBOSE
Searching for input: 8
TRT - VERBOSE
Neg_20 [Neg] inputs: [8 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Neg_20 for ONNX node: Neg_20
TRT - VERBOSE
Registering tensor: 24 for ONNX tensor: 24
TRT - VERBOSE
Neg_20 [Neg] outputs: [24 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Div_21 [Div]
TRT - VERBOSE
Searching for input: 24
TRT - VERBOSE
Searching for input: 17
TRT - VERBOSE
Div_21 [Div] inputs: [24 -> (-1, 1, -1, -1)[FLOAT]], [17 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Div_21 for ONNX node: Div_21
TRT - VERBOSE
Registering tensor: 25 for ONNX tensor: 25
TRT - VERBOSE
Div_21 [Div] outputs: [25 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Equal_23 [Equal]
TRT - VERBOSE
Searching for input: 25
TRT - VERBOSE
Searching for input: 26
TRT - VERBOSE
Equal_23 [Equal] inputs: [25 -> (-1, 1, -1, -1)[FLOAT]], [26 -> ()[FLOAT]], 
TRT - VERBOSE
Registering layer: 26 for ONNX node: 26
TRT - VERBOSE
Registering layer: Equal_23 for ONNX node: Equal_23
TRT - VERBOSE
Registering tensor: 27 for ONNX tensor: 27
TRT - VERBOSE
Equal_23 [Equal] outputs: [27 -> (-1, 1, -1, -1)[BOOL]], 
TRT - VERBOSE
Parsing node: Cast_24 [Cast]
TRT - VERBOSE
Searching for input: 27
TRT - VERBOSE
Cast_24 [Cast] inputs: [27 -> (-1, 1, -1, -1)[BOOL]], 
TRT - VERBOSE
Casting to type: bool
TRT - VERBOSE
Registering layer: Cast_24 for ONNX node: Cast_24
TRT - VERBOSE
Registering tensor: 28 for ONNX tensor: 28
TRT - VERBOSE
Cast_24 [Cast] outputs: [28 -> (-1, 1, -1, -1)[BOOL]], 
TRT - VERBOSE
Parsing node: Where_26 [Where]
TRT - VERBOSE
Searching for input: 28
TRT - VERBOSE
Searching for input: 29
TRT - VERBOSE
Searching for input: 25
TRT - VERBOSE
Where_26 [Where] inputs: [28 -> (-1, 1, -1, -1)[BOOL]], [29 -> ()[FLOAT]], [25 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: 29 for ONNX node: 29
TRT - VERBOSE
Registering layer: Where_26 for ONNX node: Where_26
TRT - VERBOSE
Registering tensor: 30 for ONNX tensor: 30
TRT - VERBOSE
Where_26 [Where] outputs: [30 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Div_27 [Div]
TRT - VERBOSE
Searching for input: 6
TRT - VERBOSE
Searching for input: 17
TRT - VERBOSE
Div_27 [Div] inputs: [6 -> (-1, 1, -1, -1)[FLOAT]], [17 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Div_27 for ONNX node: Div_27
TRT - VERBOSE
Registering tensor: 31 for ONNX tensor: 31
TRT - VERBOSE
Div_27 [Div] outputs: [31 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Equal_29 [Equal]
TRT - VERBOSE
Searching for input: 31
TRT - VERBOSE
Searching for input: 32
TRT - VERBOSE
Equal_29 [Equal] inputs: [31 -> (-1, 1, -1, -1)[FLOAT]], [32 -> ()[FLOAT]], 
TRT - VERBOSE
Registering layer: 32 for ONNX node: 32
TRT - VERBOSE
Registering layer: Equal_29 for ONNX node: Equal_29
TRT - VERBOSE
Registering tensor: 33 for ONNX tensor: 33
TRT - VERBOSE
Equal_29 [Equal] outputs: [33 -> (-1, 1, -1, -1)[BOOL]], 
TRT - VERBOSE
Parsing node: Cast_30 [Cast]
TRT - VERBOSE
Searching for input: 33
TRT - VERBOSE
Cast_30 [Cast] inputs: [33 -> (-1, 1, -1, -1)[BOOL]], 
TRT - VERBOSE
Casting to type: bool
TRT - VERBOSE
Registering layer: Cast_30 for ONNX node: Cast_30
TRT - VERBOSE
Registering tensor: 34 for ONNX tensor: 34
TRT - VERBOSE
Cast_30 [Cast] outputs: [34 -> (-1, 1, -1, -1)[BOOL]], 
TRT - VERBOSE
Parsing node: Where_32 [Where]
TRT - VERBOSE
Searching for input: 34
TRT - VERBOSE
Searching for input: 35
TRT - VERBOSE
Searching for input: 31
TRT - VERBOSE
Where_32 [Where] inputs: [34 -> (-1, 1, -1, -1)[BOOL]], [35 -> ()[FLOAT]], [31 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: 35 for ONNX node: 35
TRT - VERBOSE
Registering layer: Where_32 for ONNX node: Where_32
TRT - VERBOSE
Registering tensor: 36 for ONNX tensor: 36
TRT - VERBOSE
Where_32 [Where] outputs: [36 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_33 [Mul]
TRT - VERBOSE
Searching for input: 23
TRT - VERBOSE
Searching for input: 12
TRT - VERBOSE
Mul_33 [Mul] inputs: [23 -> (-1, 1, -1, -1)[FLOAT]], [12 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_33 for ONNX node: Mul_33
TRT - VERBOSE
Registering tensor: 37 for ONNX tensor: 37
TRT - VERBOSE
Mul_33 [Mul] outputs: [37 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_34 [Mul]
TRT - VERBOSE
Searching for input: 30
TRT - VERBOSE
Searching for input: 14
TRT - VERBOSE
Mul_34 [Mul] inputs: [30 -> (-1, 1, -1, -1)[FLOAT]], [14 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_34 for ONNX node: Mul_34
TRT - VERBOSE
Registering tensor: 38 for ONNX tensor: 38
TRT - VERBOSE
Mul_34 [Mul] outputs: [38 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Add_35 [Add]
TRT - VERBOSE
Searching for input: 37
TRT - VERBOSE
Searching for input: 38
TRT - VERBOSE
Add_35 [Add] inputs: [37 -> (-1, 1, -1, -1)[FLOAT]], [38 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Add_35 for ONNX node: Add_35
TRT - VERBOSE
Registering tensor: 39 for ONNX tensor: 39
TRT - VERBOSE
Add_35 [Add] outputs: [39 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Neg_36 [Neg]
TRT - VERBOSE
Searching for input: 39
TRT - VERBOSE
Neg_36 [Neg] inputs: [39 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Neg_36 for ONNX node: Neg_36
TRT - VERBOSE
Registering tensor: 40 for ONNX tensor: 40
TRT - VERBOSE
Neg_36 [Neg] outputs: [40 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_37 [Mul]
TRT - VERBOSE
Searching for input: 30
TRT - VERBOSE
Searching for input: 12
TRT - VERBOSE
Mul_37 [Mul] inputs: [30 -> (-1, 1, -1, -1)[FLOAT]], [12 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_37 for ONNX node: Mul_37
TRT - VERBOSE
Registering tensor: 41 for ONNX tensor: 41
TRT - VERBOSE
Mul_37 [Mul] outputs: [41 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_38 [Mul]
TRT - VERBOSE
Searching for input: 36
TRT - VERBOSE
Searching for input: 14
TRT - VERBOSE
Mul_38 [Mul] inputs: [36 -> (-1, 1, -1, -1)[FLOAT]], [14 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_38 for ONNX node: Mul_38
TRT - VERBOSE
Registering tensor: 42 for ONNX tensor: 42
TRT - VERBOSE
Mul_38 [Mul] outputs: [42 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Add_39 [Add]
TRT - VERBOSE
Searching for input: 41
TRT - VERBOSE
Searching for input: 42
TRT - VERBOSE
Add_39 [Add] inputs: [41 -> (-1, 1, -1, -1)[FLOAT]], [42 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Add_39 for ONNX node: Add_39
TRT - VERBOSE
Registering tensor: 43 for ONNX tensor: 43
TRT - VERBOSE
Add_39 [Add] outputs: [43 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Neg_40 [Neg]
TRT - VERBOSE
Searching for input: 43
TRT - VERBOSE
Neg_40 [Neg] inputs: [43 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Neg_40 for ONNX node: Neg_40
TRT - VERBOSE
Registering tensor: 44 for ONNX tensor: 44
TRT - VERBOSE
Neg_40 [Neg] outputs: [44 -> (-1, 1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Unsqueeze_42 [Unsqueeze]
TRT - VERBOSE
Searching for input: 40
TRT - VERBOSE
Searching for input: 45
TRT - VERBOSE
Unsqueeze_42 [Unsqueeze] inputs: [40 -> (-1, 1, -1, -1)[FLOAT]], [45 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (_, 1, _, _), unsqueezing to: (_, _, _, _, _)
TRT - VERBOSE
Registering layer: Unsqueeze_42 for ONNX node: Unsqueeze_42
TRT - VERBOSE
Registering tensor: 46 for ONNX tensor: 46
TRT - VERBOSE
Unsqueeze_42 [Unsqueeze] outputs: [46 -> (-1, 1, -1, -1, 1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Unsqueeze_44 [Unsqueeze]
TRT - VERBOSE
Searching for input: 44
TRT - VERBOSE
Searching for input: 47
TRT - VERBOSE
Unsqueeze_44 [Unsqueeze] inputs: [44 -> (-1, 1, -1, -1)[FLOAT]], [47 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (_, 1, _, _), unsqueezing to: (_, _, _, _, _)
TRT - VERBOSE
Registering layer: Unsqueeze_44 for ONNX node: Unsqueeze_44
TRT - VERBOSE
Registering tensor: 48 for ONNX tensor: 48
TRT - VERBOSE
Unsqueeze_44 [Unsqueeze] outputs: [48 -> (-1, 1, -1, -1, 1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Concat_45 [Concat]
TRT - VERBOSE
Searching for input: 46
TRT - VERBOSE
Searching for input: 48
TRT - VERBOSE
Concat_45 [Concat] inputs: [46 -> (-1, 1, -1, -1, 1)[FLOAT]], [48 -> (-1, 1, -1, -1, 1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Concat_45 for ONNX node: Concat_45
TRT - VERBOSE
Registering tensor: 49 for ONNX tensor: 49
TRT - VERBOSE
Concat_45 [Concat] outputs: [49 -> (-1, 1, -1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Parsing node: Clip_46 [Clip]
TRT - VERBOSE
Searching for input: 49
TRT - VERBOSE
Searching for input: 285
TRT - VERBOSE
Searching for input: 286
TRT - VERBOSE
Clip_46 [Clip] inputs: [49 -> (-1, 1, -1, -1, 2)[FLOAT]], [285 -> ()[FLOAT]], [286 -> ()[FLOAT]], 
TRT - VERBOSE
Registering layer: Clip_46 for ONNX node: Clip_46
TRT - VERBOSE
Registering tensor: 54 for ONNX tensor: 54
TRT - VERBOSE
Clip_46 [Clip] outputs: [54 -> (-1, 1, -1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Parsing node: Gather_48 [Gather]
TRT - VERBOSE
Searching for input: 4
TRT - VERBOSE
Searching for input: 55
TRT - VERBOSE
Gather_48 [Gather] inputs: [4 -> (-1, -1, -1)[INT32]], [55 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 55 for ONNX node: 55
TRT - VERBOSE
Using Gather axis: 2
TRT - VERBOSE
Registering layer: Gather_48 for ONNX node: Gather_48
TRT - VERBOSE
Registering tensor: 56 for ONNX tensor: 56
TRT - VERBOSE
Gather_48 [Gather] outputs: [56 -> (-1, -1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_50 [Gather]
TRT - VERBOSE
Searching for input: 4
TRT - VERBOSE
Searching for input: 57
TRT - VERBOSE
Gather_50 [Gather] inputs: [4 -> (-1, -1, -1)[INT32]], [57 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 57 for ONNX node: 57
TRT - VERBOSE
Using Gather axis: 2
TRT - VERBOSE
Registering layer: Gather_50 for ONNX node: Gather_50
TRT - VERBOSE
Registering tensor: 58 for ONNX tensor: 58
TRT - VERBOSE
Gather_50 [Gather] outputs: [58 -> (-1, -1)[INT32]], 
TRT - VERBOSE
Parsing node: Shape_51 [Shape]
TRT - VERBOSE
Searching for input: 54
TRT - VERBOSE
Shape_51 [Shape] inputs: [54 -> (-1, 1, -1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_51 for ONNX node: Shape_51
TRT - VERBOSE
Registering tensor: 59 for ONNX tensor: 59
TRT - VERBOSE
Shape_51 [Shape] outputs: [59 -> (5)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_53 [Gather]
TRT - VERBOSE
Searching for input: 59
TRT - VERBOSE
Searching for input: 60
TRT - VERBOSE
Gather_53 [Gather] inputs: [59 -> (5)[INT32]], [60 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 60 for ONNX node: 60
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_53 for ONNX node: Gather_53
TRT - VERBOSE
Registering tensor: 61 for ONNX tensor: 61
TRT - VERBOSE
Gather_53 [Gather] outputs: [61 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_57 [Gather]
TRT - VERBOSE
Searching for input: 59
TRT - VERBOSE
Searching for input: 64
TRT - VERBOSE
Gather_57 [Gather] inputs: [59 -> (5)[INT32]], [64 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 64 for ONNX node: 64
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_57 for ONNX node: Gather_57
TRT - VERBOSE
Registering tensor: 65 for ONNX tensor: 65
TRT - VERBOSE
Gather_57 [Gather] outputs: [65 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Transpose_60 [Transpose]
TRT - VERBOSE
Searching for input: 54
TRT - VERBOSE
Transpose_60 [Transpose] inputs: [54 -> (-1, 1, -1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_60 for ONNX node: Transpose_60
TRT - VERBOSE
Registering tensor: 68 for ONNX tensor: 68
TRT - VERBOSE
Transpose_60 [Transpose] outputs: [68 -> (-1, -1, -1, 1, 2)[FLOAT]], 
TRT - VERBOSE
Parsing node: Flatten_61 [Flatten]
TRT - VERBOSE
Searching for input: 68
TRT - VERBOSE
Flatten_61 [Flatten] inputs: [68 -> (-1, -1, -1, 1, 2)[FLOAT]], 
TRT - VERBOSE
Registering layer: Flatten_61 for ONNX node: Flatten_61
TRT - VERBOSE
Registering tensor: 69 for ONNX tensor: 69
TRT - VERBOSE
Flatten_61 [Flatten] outputs: [69 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_62 [Mul]
TRT - VERBOSE
Searching for input: 56
TRT - VERBOSE
Searching for input: 65
TRT - VERBOSE
Mul_62 [Mul] inputs: [56 -> (-1, -1)[INT32]], [65 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Mul_62 for ONNX node: Mul_62
TRT - VERBOSE
Registering tensor: 70 for ONNX tensor: 70
TRT - VERBOSE
Mul_62 [Mul] outputs: [70 -> (-1, -1)[INT32]], 
TRT - VERBOSE
Parsing node: Add_63 [Add]
TRT - VERBOSE
Searching for input: 58
TRT - VERBOSE
Searching for input: 70
TRT - VERBOSE
Add_63 [Add] inputs: [58 -> (-1, -1)[INT32]], [70 -> (-1, -1)[INT32]], 
TRT - VERBOSE
Registering layer: Add_63 for ONNX node: Add_63
TRT - VERBOSE
Registering tensor: 71 for ONNX tensor: 71
TRT - VERBOSE
Add_63 [Add] outputs: [71 -> (-1, -1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_64 [Gather]
TRT - VERBOSE
Searching for input: 69
TRT - VERBOSE
Searching for input: 71
TRT - VERBOSE
Gather_64 [Gather] inputs: [69 -> (-1, -1)[FLOAT]], [71 -> (-1, -1)[INT32]], 
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_64 for ONNX node: Gather_64
TRT - VERBOSE
Registering tensor: 72 for ONNX tensor: 72
TRT - VERBOSE
Gather_64 [Gather] outputs: [72 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_65 [Shape]
TRT - VERBOSE
Searching for input: 71
TRT - VERBOSE
Shape_65 [Shape] inputs: [71 -> (-1, -1)[INT32]], 
TRT - VERBOSE
Registering layer: Shape_65 for ONNX node: Shape_65
TRT - VERBOSE
Registering tensor: 73 for ONNX tensor: 73
TRT - VERBOSE
Shape_65 [Shape] outputs: [73 -> (2)[INT32]], 
TRT - VERBOSE
Parsing node: Concat_67 [Concat]
TRT - VERBOSE
Searching for input: 74
TRT - VERBOSE
Searching for input: 61
TRT - VERBOSE
Searching for input: 63
TRT - VERBOSE
Searching for input: 67
TRT - VERBOSE
Concat_67 [Concat] inputs: [74 -> (1)[INT32]], [61 -> (1)[INT32]], [63 -> (1)[INT32]], [67 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 74 for ONNX node: 74
TRT - VERBOSE
Registering layer: 63 for ONNX node: 63
TRT - VERBOSE
Registering layer: 67 for ONNX node: 67
TRT - VERBOSE
Registering layer: Concat_67 for ONNX node: Concat_67
TRT - VERBOSE
Registering tensor: 75 for ONNX tensor: 75
TRT - VERBOSE
Concat_67 [Concat] outputs: [75 -> (4)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_68 [Reshape]
TRT - VERBOSE
Searching for input: 72
TRT - VERBOSE
Searching for input: 75
TRT - VERBOSE
Reshape_68 [Reshape] inputs: [72 -> (-1, -1, -1)[FLOAT]], [75 -> (4)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_68 for ONNX node: Reshape_68
TRT - VERBOSE
Registering tensor: 76 for ONNX tensor: 76
TRT - VERBOSE
Reshape_68 [Reshape] outputs: [76 -> (-1, -1, 1, 2)[FLOAT]], 
TRT - VERBOSE
Parsing node: Transpose_69 [Transpose]
TRT - VERBOSE
Searching for input: 76
TRT - VERBOSE
Transpose_69 [Transpose] inputs: [76 -> (-1, -1, 1, 2)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_69 for ONNX node: Transpose_69
TRT - VERBOSE
Registering tensor: 77 for ONNX tensor: 77
TRT - VERBOSE
Transpose_69 [Transpose] outputs: [77 -> (-1, 1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Parsing node: Concat_70 [Concat]
TRT - VERBOSE
Searching for input: 61
TRT - VERBOSE
Searching for input: 63
TRT - VERBOSE
Searching for input: 73
TRT - VERBOSE
Searching for input: 67
TRT - VERBOSE
Concat_70 [Concat] inputs: [61 -> (1)[INT32]], [63 -> (1)[INT32]], [73 -> (2)[INT32]], [67 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Concat_70 for ONNX node: Concat_70
TRT - VERBOSE
Registering tensor: 78 for ONNX tensor: 78
TRT - VERBOSE
Concat_70 [Concat] outputs: [78 -> (5)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_71 [Reshape]
TRT - VERBOSE
Searching for input: 77
TRT - VERBOSE
Searching for input: 78
TRT - VERBOSE
Reshape_71 [Reshape] inputs: [77 -> (-1, 1, -1, 2)[FLOAT]], [78 -> (5)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_71 for ONNX node: Reshape_71
TRT - VERBOSE
Registering tensor: 79 for ONNX tensor: 79
TRT - VERBOSE
Reshape_71 [Reshape] outputs: [79 -> (-1, 1, -1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_72 [Shape]
TRT - VERBOSE
Searching for input: 79
TRT - VERBOSE
Shape_72 [Shape] inputs: [79 -> (-1, 1, -1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_72 for ONNX node: Shape_72
TRT - VERBOSE
Registering tensor: 80 for ONNX tensor: 80
TRT - VERBOSE
Shape_72 [Shape] outputs: [80 -> (5)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_74 [Gather]
TRT - VERBOSE
Searching for input: 80
TRT - VERBOSE
Searching for input: 81
TRT - VERBOSE
Gather_74 [Gather] inputs: [80 -> (5)[INT32]], [81 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 81 for ONNX node: 81
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_74 for ONNX node: Gather_74
TRT - VERBOSE
Registering tensor: 82 for ONNX tensor: 82
TRT - VERBOSE
Gather_74 [Gather] outputs: [82 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Shape_75 [Shape]
TRT - VERBOSE
Searching for input: 79
TRT - VERBOSE
Shape_75 [Shape] inputs: [79 -> (-1, 1, -1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_75 for ONNX node: Shape_75
TRT - VERBOSE
Registering tensor: 83 for ONNX tensor: 83
TRT - VERBOSE
Shape_75 [Shape] outputs: [83 -> (5)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_77 [Gather]
TRT - VERBOSE
Searching for input: 83
TRT - VERBOSE
Searching for input: 84
TRT - VERBOSE
Gather_77 [Gather] inputs: [83 -> (5)[INT32]], [84 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 84 for ONNX node: 84
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_77 for ONNX node: Gather_77
TRT - VERBOSE
Registering tensor: 85 for ONNX tensor: 85
TRT - VERBOSE
Gather_77 [Gather] outputs: [85 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Shape_78 [Shape]
TRT - VERBOSE
Searching for input: 79
TRT - VERBOSE
Shape_78 [Shape] inputs: [79 -> (-1, 1, -1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_78 for ONNX node: Shape_78
TRT - VERBOSE
Registering tensor: 86 for ONNX tensor: 86
TRT - VERBOSE
Shape_78 [Shape] outputs: [86 -> (5)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_80 [Gather]
TRT - VERBOSE
Searching for input: 86
TRT - VERBOSE
Searching for input: 87
TRT - VERBOSE
Gather_80 [Gather] inputs: [86 -> (5)[INT32]], [87 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 87 for ONNX node: 87
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_80 for ONNX node: Gather_80
TRT - VERBOSE
Registering tensor: 88 for ONNX tensor: 88
TRT - VERBOSE
Gather_80 [Gather] outputs: [88 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Unsqueeze_82 [Unsqueeze]
TRT - VERBOSE
Searching for input: 82
TRT - VERBOSE
Searching for input: 89
TRT - VERBOSE
Unsqueeze_82 [Unsqueeze] inputs: [82 -> ()[INT32]], [89 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (), unsqueezing to: (1,)
TRT - VERBOSE
Registering layer: Unsqueeze_82 for ONNX node: Unsqueeze_82
TRT - VERBOSE
Registering tensor: 90 for ONNX tensor: 90
TRT - VERBOSE
Unsqueeze_82 [Unsqueeze] outputs: [90 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Unsqueeze_84 [Unsqueeze]
TRT - VERBOSE
Searching for input: 85
TRT - VERBOSE
Searching for input: 91
TRT - VERBOSE
Unsqueeze_84 [Unsqueeze] inputs: [85 -> ()[INT32]], [91 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (), unsqueezing to: (1,)
TRT - VERBOSE
Registering layer: Unsqueeze_84 for ONNX node: Unsqueeze_84
TRT - VERBOSE
Registering tensor: 92 for ONNX tensor: 92
TRT - VERBOSE
Unsqueeze_84 [Unsqueeze] outputs: [92 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Unsqueeze_86 [Unsqueeze]
TRT - VERBOSE
Searching for input: 88
TRT - VERBOSE
Searching for input: 93
TRT - VERBOSE
Unsqueeze_86 [Unsqueeze] inputs: [88 -> ()[INT32]], [93 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (), unsqueezing to: (1,)
TRT - VERBOSE
Registering layer: Unsqueeze_86 for ONNX node: Unsqueeze_86
TRT - VERBOSE
Registering tensor: 94 for ONNX tensor: 94
TRT - VERBOSE
Unsqueeze_86 [Unsqueeze] outputs: [94 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Concat_87 [Concat]
TRT - VERBOSE
Searching for input: 90
TRT - VERBOSE
Searching for input: 92
TRT - VERBOSE
Searching for input: 94
TRT - VERBOSE
Concat_87 [Concat] inputs: [90 -> (1)[INT32]], [92 -> (1)[INT32]], [94 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Concat_87 for ONNX node: Concat_87
TRT - VERBOSE
Registering tensor: 95 for ONNX tensor: 95
TRT - VERBOSE
Concat_87 [Concat] outputs: [95 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_88 [Reshape]
TRT - VERBOSE
Searching for input: 79
TRT - VERBOSE
Searching for input: 95
TRT - VERBOSE
Reshape_88 [Reshape] inputs: [79 -> (-1, 1, -1, -1, 2)[FLOAT]], [95 -> (3)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_88 for ONNX node: Reshape_88
TRT - VERBOSE
Registering tensor: 96 for ONNX tensor: 96
TRT - VERBOSE
Reshape_88 [Reshape] outputs: [96 -> (-1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Parsing node: Cast_89 [Cast]
TRT - VERBOSE
Searching for input: 4
TRT - VERBOSE
Cast_89 [Cast] inputs: [4 -> (-1, -1, -1)[INT32]], 
TRT - VERBOSE
Casting to type: float32
TRT - VERBOSE
Registering layer: Cast_89 for ONNX node: Cast_89
TRT - VERBOSE
Registering tensor: 97 for ONNX tensor: 97
TRT - VERBOSE
Cast_89 [Cast] outputs: [97 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Add_90 [Add]
TRT - VERBOSE
Searching for input: 97
TRT - VERBOSE
Searching for input: 96
TRT - VERBOSE
Add_90 [Add] inputs: [97 -> (-1, -1, -1)[FLOAT]], [96 -> (-1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Registering layer: Add_90 for ONNX node: Add_90
TRT - VERBOSE
Registering tensor: 98 for ONNX tensor: 98
TRT - VERBOSE
Add_90 [Add] outputs: [98 -> (-1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Parsing node: Transpose_91 [Transpose]
TRT - VERBOSE
Searching for input: scores.1
TRT - VERBOSE
Transpose_91 [Transpose] inputs: [scores.1 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_91 for ONNX node: Transpose_91
TRT - VERBOSE
Registering tensor: scores_63 for ONNX tensor: scores
TRT - VERBOSE
Transpose_91 [Transpose] outputs: [scores -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Div_92 [Div]
TRT - VERBOSE
Searching for input: 98
TRT - VERBOSE
Searching for input: 287
TRT - VERBOSE
Div_92 [Div] inputs: [98 -> (-1, -1, 2)[FLOAT]], [287 -> ()[FLOAT]], 
TRT - VERBOSE
Registering layer: 287 for ONNX node: 287
TRT - VERBOSE
Registering layer: Div_92 for ONNX node: Div_92
TRT - VERBOSE
Registering tensor: 102 for ONNX tensor: 102
TRT - VERBOSE
Div_92 [Div] outputs: [102 -> (-1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_93 [Shape]
TRT - VERBOSE
Searching for input: dense_feat_map
TRT - VERBOSE
Shape_93 [Shape] inputs: [dense_feat_map -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_93 for ONNX node: Shape_93
TRT - VERBOSE
Registering tensor: 103 for ONNX tensor: 103
TRT - VERBOSE
Shape_93 [Shape] outputs: [103 -> (4)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_95 [Gather]
TRT - VERBOSE
Searching for input: 103
TRT - VERBOSE
Searching for input: 104
TRT - VERBOSE
Gather_95 [Gather] inputs: [103 -> (4)[INT32]], [104 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 104 for ONNX node: 104
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_95 for ONNX node: Gather_95
TRT - VERBOSE
Registering tensor: 105 for ONNX tensor: 105
TRT - VERBOSE
Gather_95 [Gather] outputs: [105 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Shape_96 [Shape]
TRT - VERBOSE
Searching for input: dense_feat_map
TRT - VERBOSE
Shape_96 [Shape] inputs: [dense_feat_map -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_96 for ONNX node: Shape_96
TRT - VERBOSE
Registering tensor: 106 for ONNX tensor: 106
TRT - VERBOSE
Shape_96 [Shape] outputs: [106 -> (4)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_98 [Gather]
TRT - VERBOSE
Searching for input: 106
TRT - VERBOSE
Searching for input: 107
TRT - VERBOSE
Gather_98 [Gather] inputs: [106 -> (4)[INT32]], [107 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 107 for ONNX node: 107
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_98 for ONNX node: Gather_98
TRT - VERBOSE
Registering tensor: 108 for ONNX tensor: 108
TRT - VERBOSE
Gather_98 [Gather] outputs: [108 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Gather_100 [Gather]
TRT - VERBOSE
Searching for input: 102
TRT - VERBOSE
Searching for input: 109
TRT - VERBOSE
Gather_100 [Gather] inputs: [102 -> (-1, -1, 2)[FLOAT]], [109 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 109 for ONNX node: 109
TRT - VERBOSE
Using Gather axis: 2
TRT - VERBOSE
Registering layer: Gather_100 for ONNX node: Gather_100
TRT - VERBOSE
Registering tensor: 110 for ONNX tensor: 110
TRT - VERBOSE
Gather_100 [Gather] outputs: [110 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_101 [Shape]
TRT - VERBOSE
Searching for input: 102
TRT - VERBOSE
Shape_101 [Shape] inputs: [102 -> (-1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_101 for ONNX node: Shape_101
TRT - VERBOSE
Registering tensor: 111 for ONNX tensor: 111
TRT - VERBOSE
Shape_101 [Shape] outputs: [111 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_103 [Gather]
TRT - VERBOSE
Searching for input: 111
TRT - VERBOSE
Searching for input: 112
TRT - VERBOSE
Gather_103 [Gather] inputs: [111 -> (3)[INT32]], [112 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 112 for ONNX node: 112
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_103 for ONNX node: Gather_103
TRT - VERBOSE
Registering tensor: 113 for ONNX tensor: 113
TRT - VERBOSE
Gather_103 [Gather] outputs: [113 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Unsqueeze_105 [Unsqueeze]
TRT - VERBOSE
Searching for input: 113
TRT - VERBOSE
Searching for input: 114
TRT - VERBOSE
Unsqueeze_105 [Unsqueeze] inputs: [113 -> ()[INT32]], [114 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (), unsqueezing to: (1,)
TRT - VERBOSE
Registering layer: Unsqueeze_105 for ONNX node: Unsqueeze_105
TRT - VERBOSE
Registering tensor: 115 for ONNX tensor: 115
TRT - VERBOSE
Unsqueeze_105 [Unsqueeze] outputs: [115 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Concat_106 [Concat]
TRT - VERBOSE
Searching for input: 115
TRT - VERBOSE
Concat_106 [Concat] inputs: [115 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Concat_106 for ONNX node: Concat_106
TRT - VERBOSE
Registering tensor: 116 for ONNX tensor: 116
TRT - VERBOSE
Concat_106 [Concat] outputs: [116 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_107 [Reshape]
TRT - VERBOSE
Searching for input: 110
TRT - VERBOSE
Searching for input: 116
TRT - VERBOSE
Reshape_107 [Reshape] inputs: [110 -> (-1, -1)[FLOAT]], [116 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_107 for ONNX node: Reshape_107
TRT - VERBOSE
Registering tensor: 117 for ONNX tensor: 117
TRT - VERBOSE
Reshape_107 [Reshape] outputs: [117 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Gather_109 [Gather]
TRT - VERBOSE
Searching for input: 102
TRT - VERBOSE
Searching for input: 118
TRT - VERBOSE
Gather_109 [Gather] inputs: [102 -> (-1, -1, 2)[FLOAT]], [118 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 118 for ONNX node: 118
TRT - VERBOSE
Using Gather axis: 2
TRT - VERBOSE
Registering layer: Gather_109 for ONNX node: Gather_109
TRT - VERBOSE
Registering tensor: 119 for ONNX tensor: 119
TRT - VERBOSE
Gather_109 [Gather] outputs: [119 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_110 [Shape]
TRT - VERBOSE
Searching for input: 102
TRT - VERBOSE
Shape_110 [Shape] inputs: [102 -> (-1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_110 for ONNX node: Shape_110
TRT - VERBOSE
Registering tensor: 120 for ONNX tensor: 120
TRT - VERBOSE
Shape_110 [Shape] outputs: [120 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_112 [Gather]
TRT - VERBOSE
Searching for input: 120
TRT - VERBOSE
Searching for input: 121
TRT - VERBOSE
Gather_112 [Gather] inputs: [120 -> (3)[INT32]], [121 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 121 for ONNX node: 121
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_112 for ONNX node: Gather_112
TRT - VERBOSE
Registering tensor: 122 for ONNX tensor: 122
TRT - VERBOSE
Gather_112 [Gather] outputs: [122 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Unsqueeze_114 [Unsqueeze]
TRT - VERBOSE
Searching for input: 122
TRT - VERBOSE
Searching for input: 123
TRT - VERBOSE
Unsqueeze_114 [Unsqueeze] inputs: [122 -> ()[INT32]], [123 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (), unsqueezing to: (1,)
TRT - VERBOSE
Registering layer: Unsqueeze_114 for ONNX node: Unsqueeze_114
TRT - VERBOSE
Registering tensor: 124 for ONNX tensor: 124
TRT - VERBOSE
Unsqueeze_114 [Unsqueeze] outputs: [124 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Concat_115 [Concat]
TRT - VERBOSE
Searching for input: 124
TRT - VERBOSE
Concat_115 [Concat] inputs: [124 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Concat_115 for ONNX node: Concat_115
TRT - VERBOSE
Registering tensor: 125 for ONNX tensor: 125
TRT - VERBOSE
Concat_115 [Concat] outputs: [125 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_116 [Reshape]
TRT - VERBOSE
Searching for input: 119
TRT - VERBOSE
Searching for input: 125
TRT - VERBOSE
Reshape_116 [Reshape] inputs: [119 -> (-1, -1)[FLOAT]], [125 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_116 for ONNX node: Reshape_116
TRT - VERBOSE
Registering tensor: 126 for ONNX tensor: 126
TRT - VERBOSE
Reshape_116 [Reshape] outputs: [126 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Floor_117 [Floor]
TRT - VERBOSE
Searching for input: 117
TRT - VERBOSE
Floor_117 [Floor] inputs: [117 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Floor_117 for ONNX node: Floor_117
TRT - VERBOSE
Registering tensor: 127 for ONNX tensor: 127
TRT - VERBOSE
Floor_117 [Floor] outputs: [127 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Cast_118 [Cast]
TRT - VERBOSE
Searching for input: 127
TRT - VERBOSE
Cast_118 [Cast] inputs: [127 -> (-1)[FLOAT]], 
TRT - VERBOSE
Casting to type: int32
TRT - VERBOSE
Registering layer: Cast_118 for ONNX node: Cast_118
TRT - VERBOSE
Registering tensor: 128 for ONNX tensor: 128
TRT - VERBOSE
Cast_118 [Cast] outputs: [128 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Sub_120 [Sub]
TRT - VERBOSE
Searching for input: 105
TRT - VERBOSE
Searching for input: 129
TRT - VERBOSE
Sub_120 [Sub] inputs: [105 -> ()[INT32]], [129 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 129 for ONNX node: 129
TRT - VERBOSE
Registering layer: Sub_120 for ONNX node: Sub_120
TRT - VERBOSE
Registering tensor: 130 for ONNX tensor: 130
TRT - VERBOSE
Sub_120 [Sub] outputs: [130 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Cast_121 [Cast]
TRT - VERBOSE
Searching for input: 130
TRT - VERBOSE
Cast_121 [Cast] inputs: [130 -> ()[INT32]], 
TRT - VERBOSE
Casting to type: int32
TRT - VERBOSE
Registering layer: Cast_121 for ONNX node: Cast_121
TRT - VERBOSE
Registering tensor: 133 for ONNX tensor: 133
TRT - VERBOSE
Cast_121 [Cast] outputs: [133 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Clip_122 [Clip]
TRT - VERBOSE
Searching for input: 128
TRT - VERBOSE
Searching for input: 288
TRT - VERBOSE
Searching for input: 133
TRT - VERBOSE
Clip_122 [Clip] inputs: [128 -> (-1)[INT32]], [288 -> ()[INT32]], [133 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 288 for ONNX node: 288
TRT - VERBOSE
Registering tensor: 134 for ONNX tensor: 134
TRT - VERBOSE
Clip_122 [Clip] outputs: [134 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Ceil_123 [Ceil]
TRT - VERBOSE
Searching for input: 117
TRT - VERBOSE
Ceil_123 [Ceil] inputs: [117 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Ceil_123 for ONNX node: Ceil_123
TRT - VERBOSE
Registering tensor: 135 for ONNX tensor: 135
TRT - VERBOSE
Ceil_123 [Ceil] outputs: [135 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Cast_124 [Cast]
TRT - VERBOSE
Searching for input: 135
TRT - VERBOSE
Cast_124 [Cast] inputs: [135 -> (-1)[FLOAT]], 
TRT - VERBOSE
Casting to type: int32
TRT - VERBOSE
Registering layer: Cast_124 for ONNX node: Cast_124
TRT - VERBOSE
Registering tensor: 136 for ONNX tensor: 136
TRT - VERBOSE
Cast_124 [Cast] outputs: [136 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Sub_126 [Sub]
TRT - VERBOSE
Searching for input: 105
TRT - VERBOSE
Searching for input: 137
TRT - VERBOSE
Sub_126 [Sub] inputs: [105 -> ()[INT32]], [137 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 137 for ONNX node: 137
TRT - VERBOSE
Registering layer: Sub_126 for ONNX node: Sub_126
TRT - VERBOSE
Registering tensor: 138 for ONNX tensor: 138
TRT - VERBOSE
Sub_126 [Sub] outputs: [138 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Cast_127 [Cast]
TRT - VERBOSE
Searching for input: 138
TRT - VERBOSE
Cast_127 [Cast] inputs: [138 -> ()[INT32]], 
TRT - VERBOSE
Casting to type: int32
TRT - VERBOSE
Registering layer: Cast_127 for ONNX node: Cast_127
TRT - VERBOSE
Registering tensor: 141 for ONNX tensor: 141
TRT - VERBOSE
Cast_127 [Cast] outputs: [141 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Clip_128 [Clip]
TRT - VERBOSE
Searching for input: 136
TRT - VERBOSE
Searching for input: 289
TRT - VERBOSE
Searching for input: 141
TRT - VERBOSE
Clip_128 [Clip] inputs: [136 -> (-1)[INT32]], [289 -> ()[INT32]], [141 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 289 for ONNX node: 289
TRT - VERBOSE
Registering tensor: 142 for ONNX tensor: 142
TRT - VERBOSE
Clip_128 [Clip] outputs: [142 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Floor_129 [Floor]
TRT - VERBOSE
Searching for input: 126
TRT - VERBOSE
Floor_129 [Floor] inputs: [126 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Floor_129 for ONNX node: Floor_129
TRT - VERBOSE
Registering tensor: 143 for ONNX tensor: 143
TRT - VERBOSE
Floor_129 [Floor] outputs: [143 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Cast_130 [Cast]
TRT - VERBOSE
Searching for input: 143
TRT - VERBOSE
Cast_130 [Cast] inputs: [143 -> (-1)[FLOAT]], 
TRT - VERBOSE
Casting to type: int32
TRT - VERBOSE
Registering layer: Cast_130 for ONNX node: Cast_130
TRT - VERBOSE
Registering tensor: 144 for ONNX tensor: 144
TRT - VERBOSE
Cast_130 [Cast] outputs: [144 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Sub_132 [Sub]
TRT - VERBOSE
Searching for input: 108
TRT - VERBOSE
Searching for input: 145
TRT - VERBOSE
Sub_132 [Sub] inputs: [108 -> ()[INT32]], [145 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 145 for ONNX node: 145
TRT - VERBOSE
Registering layer: Sub_132 for ONNX node: Sub_132
TRT - VERBOSE
Registering tensor: 146 for ONNX tensor: 146
TRT - VERBOSE
Sub_132 [Sub] outputs: [146 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Cast_133 [Cast]
TRT - VERBOSE
Searching for input: 146
TRT - VERBOSE
Cast_133 [Cast] inputs: [146 -> ()[INT32]], 
TRT - VERBOSE
Casting to type: int32
TRT - VERBOSE
Registering layer: Cast_133 for ONNX node: Cast_133
TRT - VERBOSE
Registering tensor: 149 for ONNX tensor: 149
TRT - VERBOSE
Cast_133 [Cast] outputs: [149 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Clip_134 [Clip]
TRT - VERBOSE
Searching for input: 144
TRT - VERBOSE
Searching for input: 290
TRT - VERBOSE
Searching for input: 149
TRT - VERBOSE
Clip_134 [Clip] inputs: [144 -> (-1)[INT32]], [290 -> ()[INT32]], [149 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 290 for ONNX node: 290
TRT - VERBOSE
Registering tensor: 150 for ONNX tensor: 150
TRT - VERBOSE
Clip_134 [Clip] outputs: [150 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Ceil_135 [Ceil]
TRT - VERBOSE
Searching for input: 126
TRT - VERBOSE
Ceil_135 [Ceil] inputs: [126 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Ceil_135 for ONNX node: Ceil_135
TRT - VERBOSE
Registering tensor: 151 for ONNX tensor: 151
TRT - VERBOSE
Ceil_135 [Ceil] outputs: [151 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Cast_136 [Cast]
TRT - VERBOSE
Searching for input: 151
TRT - VERBOSE
Cast_136 [Cast] inputs: [151 -> (-1)[FLOAT]], 
TRT - VERBOSE
Casting to type: int32
TRT - VERBOSE
Registering layer: Cast_136 for ONNX node: Cast_136
TRT - VERBOSE
Registering tensor: 152 for ONNX tensor: 152
TRT - VERBOSE
Cast_136 [Cast] outputs: [152 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Sub_138 [Sub]
TRT - VERBOSE
Searching for input: 108
TRT - VERBOSE
Searching for input: 153
TRT - VERBOSE
Sub_138 [Sub] inputs: [108 -> ()[INT32]], [153 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 153 for ONNX node: 153
TRT - VERBOSE
Registering layer: Sub_138 for ONNX node: Sub_138
TRT - VERBOSE
Registering tensor: 154 for ONNX tensor: 154
TRT - VERBOSE
Sub_138 [Sub] outputs: [154 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Cast_139 [Cast]
TRT - VERBOSE
Searching for input: 154
TRT - VERBOSE
Cast_139 [Cast] inputs: [154 -> ()[INT32]], 
TRT - VERBOSE
Casting to type: int32
TRT - VERBOSE
Registering layer: Cast_139 for ONNX node: Cast_139
TRT - VERBOSE
Registering tensor: 157 for ONNX tensor: 157
TRT - VERBOSE
Cast_139 [Cast] outputs: [157 -> ()[INT32]], 
TRT - VERBOSE
Parsing node: Clip_140 [Clip]
TRT - VERBOSE
Searching for input: 152
TRT - VERBOSE
Searching for input: 291
TRT - VERBOSE
Searching for input: 157
TRT - VERBOSE
Clip_140 [Clip] inputs: [152 -> (-1)[INT32]], [291 -> ()[INT32]], [157 -> ()[INT32]], 
TRT - VERBOSE
Registering layer: 291 for ONNX node: 291
TRT - VERBOSE
Registering tensor: 158 for ONNX tensor: 158
TRT - VERBOSE
Clip_140 [Clip] outputs: [158 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Cast_141 [Cast]
TRT - VERBOSE
Searching for input: 134
TRT - VERBOSE
Cast_141 [Cast] inputs: [134 -> (-1)[INT32]], 
TRT - VERBOSE
Casting to type: float32
TRT - VERBOSE
Registering layer: Cast_141 for ONNX node: Cast_141
TRT - VERBOSE
Registering tensor: 159 for ONNX tensor: 159
TRT - VERBOSE
Cast_141 [Cast] outputs: [159 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Sub_142 [Sub]
TRT - VERBOSE
Searching for input: 117
TRT - VERBOSE
Searching for input: 159
TRT - VERBOSE
Sub_142 [Sub] inputs: [117 -> (-1)[FLOAT]], [159 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Sub_142 for ONNX node: Sub_142
TRT - VERBOSE
Registering tensor: 160 for ONNX tensor: 160
TRT - VERBOSE
Sub_142 [Sub] outputs: [160 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Cast_143 [Cast]
TRT - VERBOSE
Searching for input: 150
TRT - VERBOSE
Cast_143 [Cast] inputs: [150 -> (-1)[INT32]], 
TRT - VERBOSE
Casting to type: float32
TRT - VERBOSE
Registering layer: Cast_143 for ONNX node: Cast_143
TRT - VERBOSE
Registering tensor: 161 for ONNX tensor: 161
TRT - VERBOSE
Cast_143 [Cast] outputs: [161 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Sub_144 [Sub]
TRT - VERBOSE
Searching for input: 126
TRT - VERBOSE
Searching for input: 161
TRT - VERBOSE
Sub_144 [Sub] inputs: [126 -> (-1)[FLOAT]], [161 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Sub_144 for ONNX node: Sub_144
TRT - VERBOSE
Registering tensor: 162 for ONNX tensor: 162
TRT - VERBOSE
Sub_144 [Sub] outputs: [162 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Sub_146 [Sub]
TRT - VERBOSE
Searching for input: 163
TRT - VERBOSE
Searching for input: 160
TRT - VERBOSE
Sub_146 [Sub] inputs: [163 -> ()[FLOAT]], [160 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: 163 for ONNX node: 163
TRT - VERBOSE
Registering layer: Sub_146 for ONNX node: Sub_146
TRT - VERBOSE
Registering tensor: 164 for ONNX tensor: 164
TRT - VERBOSE
Sub_146 [Sub] outputs: [164 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Sub_148 [Sub]
TRT - VERBOSE
Searching for input: 165
TRT - VERBOSE
Searching for input: 162
TRT - VERBOSE
Sub_148 [Sub] inputs: [165 -> ()[FLOAT]], [162 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: 165 for ONNX node: 165
TRT - VERBOSE
Registering layer: Sub_148 for ONNX node: Sub_148
TRT - VERBOSE
Registering tensor: 166 for ONNX tensor: 166
TRT - VERBOSE
Sub_148 [Sub] outputs: [166 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_149 [Mul]
TRT - VERBOSE
Searching for input: 164
TRT - VERBOSE
Searching for input: 166
TRT - VERBOSE
Mul_149 [Mul] inputs: [164 -> (-1)[FLOAT]], [166 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_149 for ONNX node: Mul_149
TRT - VERBOSE
Registering tensor: 167 for ONNX tensor: 167
TRT - VERBOSE
Mul_149 [Mul] outputs: [167 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Sub_151 [Sub]
TRT - VERBOSE
Searching for input: 168
TRT - VERBOSE
Searching for input: 160
TRT - VERBOSE
Sub_151 [Sub] inputs: [168 -> ()[FLOAT]], [160 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: 168 for ONNX node: 168
TRT - VERBOSE
Registering layer: Sub_151 for ONNX node: Sub_151
TRT - VERBOSE
Registering tensor: 169 for ONNX tensor: 169
TRT - VERBOSE
Sub_151 [Sub] outputs: [169 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_152 [Mul]
TRT - VERBOSE
Searching for input: 169
TRT - VERBOSE
Searching for input: 162
TRT - VERBOSE
Mul_152 [Mul] inputs: [169 -> (-1)[FLOAT]], [162 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_152 for ONNX node: Mul_152
TRT - VERBOSE
Registering tensor: 170 for ONNX tensor: 170
TRT - VERBOSE
Mul_152 [Mul] outputs: [170 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Sub_154 [Sub]
TRT - VERBOSE
Searching for input: 171
TRT - VERBOSE
Searching for input: 162
TRT - VERBOSE
Sub_154 [Sub] inputs: [171 -> ()[FLOAT]], [162 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: 171 for ONNX node: 171
TRT - VERBOSE
Registering layer: Sub_154 for ONNX node: Sub_154
TRT - VERBOSE
Registering tensor: 172 for ONNX tensor: 172
TRT - VERBOSE
Sub_154 [Sub] outputs: [172 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_155 [Mul]
TRT - VERBOSE
Searching for input: 160
TRT - VERBOSE
Searching for input: 172
TRT - VERBOSE
Mul_155 [Mul] inputs: [160 -> (-1)[FLOAT]], [172 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_155 for ONNX node: Mul_155
TRT - VERBOSE
Registering tensor: 173 for ONNX tensor: 173
TRT - VERBOSE
Mul_155 [Mul] outputs: [173 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_156 [Mul]
TRT - VERBOSE
Searching for input: 160
TRT - VERBOSE
Searching for input: 162
TRT - VERBOSE
Mul_156 [Mul] inputs: [160 -> (-1)[FLOAT]], [162 -> (-1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_156 for ONNX node: Mul_156
TRT - VERBOSE
Registering tensor: 174 for ONNX tensor: 174
TRT - VERBOSE
Mul_156 [Mul] outputs: [174 -> (-1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Unsqueeze_158 [Unsqueeze]
TRT - VERBOSE
Searching for input: 167
TRT - VERBOSE
Searching for input: 175
TRT - VERBOSE
Unsqueeze_158 [Unsqueeze] inputs: [167 -> (-1)[FLOAT]], [175 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (_,), unsqueezing to: (_, _)
TRT - VERBOSE
Registering layer: Unsqueeze_158 for ONNX node: Unsqueeze_158
TRT - VERBOSE
Registering tensor: 176 for ONNX tensor: 176
TRT - VERBOSE
Unsqueeze_158 [Unsqueeze] outputs: [176 -> (1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Unsqueeze_160 [Unsqueeze]
TRT - VERBOSE
Searching for input: 176
TRT - VERBOSE
Searching for input: 177
TRT - VERBOSE
Unsqueeze_160 [Unsqueeze] inputs: [176 -> (1, -1)[FLOAT]], [177 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (1, _), unsqueezing to: (_, _, _)
TRT - VERBOSE
Registering layer: Unsqueeze_160 for ONNX node: Unsqueeze_160
TRT - VERBOSE
Registering tensor: 178 for ONNX tensor: 178
TRT - VERBOSE
Unsqueeze_160 [Unsqueeze] outputs: [178 -> (1, 1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Unsqueeze_162 [Unsqueeze]
TRT - VERBOSE
Searching for input: 170
TRT - VERBOSE
Searching for input: 179
TRT - VERBOSE
Unsqueeze_162 [Unsqueeze] inputs: [170 -> (-1)[FLOAT]], [179 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (_,), unsqueezing to: (_, _)
TRT - VERBOSE
Registering layer: Unsqueeze_162 for ONNX node: Unsqueeze_162
TRT - VERBOSE
Registering tensor: 180 for ONNX tensor: 180
TRT - VERBOSE
Unsqueeze_162 [Unsqueeze] outputs: [180 -> (1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Unsqueeze_164 [Unsqueeze]
TRT - VERBOSE
Searching for input: 180
TRT - VERBOSE
Searching for input: 181
TRT - VERBOSE
Unsqueeze_164 [Unsqueeze] inputs: [180 -> (1, -1)[FLOAT]], [181 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (1, _), unsqueezing to: (_, _, _)
TRT - VERBOSE
Registering layer: Unsqueeze_164 for ONNX node: Unsqueeze_164
TRT - VERBOSE
Registering tensor: 182 for ONNX tensor: 182
TRT - VERBOSE
Unsqueeze_164 [Unsqueeze] outputs: [182 -> (1, 1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Unsqueeze_166 [Unsqueeze]
TRT - VERBOSE
Searching for input: 173
TRT - VERBOSE
Searching for input: 183
TRT - VERBOSE
Unsqueeze_166 [Unsqueeze] inputs: [173 -> (-1)[FLOAT]], [183 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (_,), unsqueezing to: (_, _)
TRT - VERBOSE
Registering layer: Unsqueeze_166 for ONNX node: Unsqueeze_166
TRT - VERBOSE
Registering tensor: 184 for ONNX tensor: 184
TRT - VERBOSE
Unsqueeze_166 [Unsqueeze] outputs: [184 -> (1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Unsqueeze_168 [Unsqueeze]
TRT - VERBOSE
Searching for input: 184
TRT - VERBOSE
Searching for input: 185
TRT - VERBOSE
Unsqueeze_168 [Unsqueeze] inputs: [184 -> (1, -1)[FLOAT]], [185 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (1, _), unsqueezing to: (_, _, _)
TRT - VERBOSE
Registering layer: Unsqueeze_168 for ONNX node: Unsqueeze_168
TRT - VERBOSE
Registering tensor: 186 for ONNX tensor: 186
TRT - VERBOSE
Unsqueeze_168 [Unsqueeze] outputs: [186 -> (1, 1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Unsqueeze_170 [Unsqueeze]
TRT - VERBOSE
Searching for input: 174
TRT - VERBOSE
Searching for input: 187
TRT - VERBOSE
Unsqueeze_170 [Unsqueeze] inputs: [174 -> (-1)[FLOAT]], [187 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (_,), unsqueezing to: (_, _)
TRT - VERBOSE
Registering layer: Unsqueeze_170 for ONNX node: Unsqueeze_170
TRT - VERBOSE
Registering tensor: 188 for ONNX tensor: 188
TRT - VERBOSE
Unsqueeze_170 [Unsqueeze] outputs: [188 -> (1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Unsqueeze_172 [Unsqueeze]
TRT - VERBOSE
Searching for input: 188
TRT - VERBOSE
Searching for input: 189
TRT - VERBOSE
Unsqueeze_172 [Unsqueeze] inputs: [188 -> (1, -1)[FLOAT]], [189 -> (1)[INT32]], 
TRT - VERBOSE
Original shape: (1, _), unsqueezing to: (_, _, _)
TRT - VERBOSE
Registering layer: Unsqueeze_172 for ONNX node: Unsqueeze_172
TRT - VERBOSE
Registering tensor: 190 for ONNX tensor: 190
TRT - VERBOSE
Unsqueeze_172 [Unsqueeze] outputs: [190 -> (1, 1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_173 [Shape]
TRT - VERBOSE
Searching for input: dense_feat_map
TRT - VERBOSE
Shape_173 [Shape] inputs: [dense_feat_map -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_173 for ONNX node: Shape_173
TRT - VERBOSE
Registering tensor: 191 for ONNX tensor: 191
TRT - VERBOSE
Shape_173 [Shape] outputs: [191 -> (4)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_175 [Gather]
TRT - VERBOSE
Searching for input: 191
TRT - VERBOSE
Searching for input: 192
TRT - VERBOSE
Gather_175 [Gather] inputs: [191 -> (4)[INT32]], [192 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 192 for ONNX node: 192
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_175 for ONNX node: Gather_175
TRT - VERBOSE
Registering tensor: 193 for ONNX tensor: 193
TRT - VERBOSE
Gather_175 [Gather] outputs: [193 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_177 [Gather]
TRT - VERBOSE
Searching for input: 191
TRT - VERBOSE
Searching for input: 194
TRT - VERBOSE
Gather_177 [Gather] inputs: [191 -> (4)[INT32]], [194 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 194 for ONNX node: 194
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_177 for ONNX node: Gather_177
TRT - VERBOSE
Registering tensor: 195 for ONNX tensor: 195
TRT - VERBOSE
Gather_177 [Gather] outputs: [195 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_179 [Gather]
TRT - VERBOSE
Searching for input: 191
TRT - VERBOSE
Searching for input: 196
TRT - VERBOSE
Gather_179 [Gather] inputs: [191 -> (4)[INT32]], [196 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 196 for ONNX node: 196
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_179 for ONNX node: Gather_179
TRT - VERBOSE
Registering tensor: 197 for ONNX tensor: 197
TRT - VERBOSE
Gather_179 [Gather] outputs: [197 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Transpose_180 [Transpose]
TRT - VERBOSE
Searching for input: dense_feat_map
TRT - VERBOSE
Transpose_180 [Transpose] inputs: [dense_feat_map -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_180 for ONNX node: Transpose_180
TRT - VERBOSE
Registering tensor: 198 for ONNX tensor: 198
TRT - VERBOSE
Transpose_180 [Transpose] outputs: [198 -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Flatten_181 [Flatten]
TRT - VERBOSE
Searching for input: 198
TRT - VERBOSE
Flatten_181 [Flatten] inputs: [198 -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Flatten_181 for ONNX node: Flatten_181
TRT - VERBOSE
Registering tensor: 199 for ONNX tensor: 199
TRT - VERBOSE
Flatten_181 [Flatten] outputs: [199 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_182 [Mul]
TRT - VERBOSE
Searching for input: 134
TRT - VERBOSE
Searching for input: 197
TRT - VERBOSE
Mul_182 [Mul] inputs: [134 -> (-1)[INT32]], [197 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Mul_182 for ONNX node: Mul_182
TRT - VERBOSE
Registering tensor: 200 for ONNX tensor: 200
TRT - VERBOSE
Mul_182 [Mul] outputs: [200 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Add_183 [Add]
TRT - VERBOSE
Searching for input: 150
TRT - VERBOSE
Searching for input: 200
TRT - VERBOSE
Add_183 [Add] inputs: [150 -> (-1)[INT32]], [200 -> (-1)[INT32]], 
TRT - VERBOSE
Registering layer: Add_183 for ONNX node: Add_183
TRT - VERBOSE
Registering tensor: 201 for ONNX tensor: 201
TRT - VERBOSE
Add_183 [Add] outputs: [201 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_184 [Gather]
TRT - VERBOSE
Searching for input: 199
TRT - VERBOSE
Searching for input: 201
TRT - VERBOSE
Gather_184 [Gather] inputs: [199 -> (-1, -1)[FLOAT]], [201 -> (-1)[INT32]], 
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_184 for ONNX node: Gather_184
TRT - VERBOSE
Registering tensor: 202 for ONNX tensor: 202
TRT - VERBOSE
Gather_184 [Gather] outputs: [202 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_185 [Shape]
TRT - VERBOSE
Searching for input: 201
TRT - VERBOSE
Shape_185 [Shape] inputs: [201 -> (-1)[INT32]], 
TRT - VERBOSE
Registering layer: Shape_185 for ONNX node: Shape_185
TRT - VERBOSE
Registering tensor: 203 for ONNX tensor: 203
TRT - VERBOSE
Shape_185 [Shape] outputs: [203 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Concat_187 [Concat]
TRT - VERBOSE
Searching for input: 204
TRT - VERBOSE
Searching for input: 193
TRT - VERBOSE
Searching for input: 195
TRT - VERBOSE
Concat_187 [Concat] inputs: [204 -> (1)[INT32]], [193 -> (1)[INT32]], [195 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 204 for ONNX node: 204
TRT - VERBOSE
Registering layer: Concat_187 for ONNX node: Concat_187
TRT - VERBOSE
Registering tensor: 205 for ONNX tensor: 205
TRT - VERBOSE
Concat_187 [Concat] outputs: [205 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_188 [Reshape]
TRT - VERBOSE
Searching for input: 202
TRT - VERBOSE
Searching for input: 205
TRT - VERBOSE
Reshape_188 [Reshape] inputs: [202 -> (-1, -1)[FLOAT]], [205 -> (3)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_188 for ONNX node: Reshape_188
TRT - VERBOSE
Registering tensor: 206 for ONNX tensor: 206
TRT - VERBOSE
Reshape_188 [Reshape] outputs: [206 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Transpose_189 [Transpose]
TRT - VERBOSE
Searching for input: 206
TRT - VERBOSE
Transpose_189 [Transpose] inputs: [206 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_189 for ONNX node: Transpose_189
TRT - VERBOSE
Registering tensor: 207 for ONNX tensor: 207
TRT - VERBOSE
Transpose_189 [Transpose] outputs: [207 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Concat_190 [Concat]
TRT - VERBOSE
Searching for input: 193
TRT - VERBOSE
Searching for input: 195
TRT - VERBOSE
Searching for input: 203
TRT - VERBOSE
Concat_190 [Concat] inputs: [193 -> (1)[INT32]], [195 -> (1)[INT32]], [203 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Concat_190 for ONNX node: Concat_190
TRT - VERBOSE
Registering tensor: 208 for ONNX tensor: 208
TRT - VERBOSE
Concat_190 [Concat] outputs: [208 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_191 [Reshape]
TRT - VERBOSE
Searching for input: 207
TRT - VERBOSE
Searching for input: 208
TRT - VERBOSE
Reshape_191 [Reshape] inputs: [207 -> (-1, -1, -1)[FLOAT]], [208 -> (3)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_191 for ONNX node: Reshape_191
TRT - VERBOSE
Registering tensor: 209 for ONNX tensor: 209
TRT - VERBOSE
Reshape_191 [Reshape] outputs: [209 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_192 [Mul]
TRT - VERBOSE
Searching for input: 178
TRT - VERBOSE
Searching for input: 209
TRT - VERBOSE
Mul_192 [Mul] inputs: [178 -> (1, 1, -1)[FLOAT]], [209 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_192 for ONNX node: Mul_192
TRT - VERBOSE
Registering tensor: 210 for ONNX tensor: 210
TRT - VERBOSE
Mul_192 [Mul] outputs: [210 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_193 [Shape]
TRT - VERBOSE
Searching for input: dense_feat_map
TRT - VERBOSE
Shape_193 [Shape] inputs: [dense_feat_map -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_193 for ONNX node: Shape_193
TRT - VERBOSE
Registering tensor: 211 for ONNX tensor: 211
TRT - VERBOSE
Shape_193 [Shape] outputs: [211 -> (4)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_195 [Gather]
TRT - VERBOSE
Searching for input: 211
TRT - VERBOSE
Searching for input: 212
TRT - VERBOSE
Gather_195 [Gather] inputs: [211 -> (4)[INT32]], [212 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 212 for ONNX node: 212
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_195 for ONNX node: Gather_195
TRT - VERBOSE
Registering tensor: 213 for ONNX tensor: 213
TRT - VERBOSE
Gather_195 [Gather] outputs: [213 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_197 [Gather]
TRT - VERBOSE
Searching for input: 211
TRT - VERBOSE
Searching for input: 214
TRT - VERBOSE
Gather_197 [Gather] inputs: [211 -> (4)[INT32]], [214 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 214 for ONNX node: 214
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_197 for ONNX node: Gather_197
TRT - VERBOSE
Registering tensor: 215 for ONNX tensor: 215
TRT - VERBOSE
Gather_197 [Gather] outputs: [215 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_199 [Gather]
TRT - VERBOSE
Searching for input: 211
TRT - VERBOSE
Searching for input: 216
TRT - VERBOSE
Gather_199 [Gather] inputs: [211 -> (4)[INT32]], [216 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 216 for ONNX node: 216
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_199 for ONNX node: Gather_199
TRT - VERBOSE
Registering tensor: 217 for ONNX tensor: 217
TRT - VERBOSE
Gather_199 [Gather] outputs: [217 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Transpose_200 [Transpose]
TRT - VERBOSE
Searching for input: dense_feat_map
TRT - VERBOSE
Transpose_200 [Transpose] inputs: [dense_feat_map -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_200 for ONNX node: Transpose_200
TRT - VERBOSE
Registering tensor: 218 for ONNX tensor: 218
TRT - VERBOSE
Transpose_200 [Transpose] outputs: [218 -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Flatten_201 [Flatten]
TRT - VERBOSE
Searching for input: 218
TRT - VERBOSE
Flatten_201 [Flatten] inputs: [218 -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Flatten_201 for ONNX node: Flatten_201
TRT - VERBOSE
Registering tensor: 219 for ONNX tensor: 219
TRT - VERBOSE
Flatten_201 [Flatten] outputs: [219 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_202 [Mul]
TRT - VERBOSE
Searching for input: 134
TRT - VERBOSE
Searching for input: 217
TRT - VERBOSE
Mul_202 [Mul] inputs: [134 -> (-1)[INT32]], [217 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Mul_202 for ONNX node: Mul_202
TRT - VERBOSE
Registering tensor: 220 for ONNX tensor: 220
TRT - VERBOSE
Mul_202 [Mul] outputs: [220 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Add_203 [Add]
TRT - VERBOSE
Searching for input: 158
TRT - VERBOSE
Searching for input: 220
TRT - VERBOSE
Add_203 [Add] inputs: [158 -> (-1)[INT32]], [220 -> (-1)[INT32]], 
TRT - VERBOSE
Registering layer: Add_203 for ONNX node: Add_203
TRT - VERBOSE
Registering tensor: 221 for ONNX tensor: 221
TRT - VERBOSE
Add_203 [Add] outputs: [221 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_204 [Gather]
TRT - VERBOSE
Searching for input: 219
TRT - VERBOSE
Searching for input: 221
TRT - VERBOSE
Gather_204 [Gather] inputs: [219 -> (-1, -1)[FLOAT]], [221 -> (-1)[INT32]], 
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_204 for ONNX node: Gather_204
TRT - VERBOSE
Registering tensor: 222 for ONNX tensor: 222
TRT - VERBOSE
Gather_204 [Gather] outputs: [222 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_205 [Shape]
TRT - VERBOSE
Searching for input: 221
TRT - VERBOSE
Shape_205 [Shape] inputs: [221 -> (-1)[INT32]], 
TRT - VERBOSE
Registering layer: Shape_205 for ONNX node: Shape_205
TRT - VERBOSE
Registering tensor: 223 for ONNX tensor: 223
TRT - VERBOSE
Shape_205 [Shape] outputs: [223 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Concat_207 [Concat]
TRT - VERBOSE
Searching for input: 224
TRT - VERBOSE
Searching for input: 213
TRT - VERBOSE
Searching for input: 215
TRT - VERBOSE
Concat_207 [Concat] inputs: [224 -> (1)[INT32]], [213 -> (1)[INT32]], [215 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 224 for ONNX node: 224
TRT - VERBOSE
Registering layer: Concat_207 for ONNX node: Concat_207
TRT - VERBOSE
Registering tensor: 225 for ONNX tensor: 225
TRT - VERBOSE
Concat_207 [Concat] outputs: [225 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_208 [Reshape]
TRT - VERBOSE
Searching for input: 222
TRT - VERBOSE
Searching for input: 225
TRT - VERBOSE
Reshape_208 [Reshape] inputs: [222 -> (-1, -1)[FLOAT]], [225 -> (3)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_208 for ONNX node: Reshape_208
TRT - VERBOSE
Registering tensor: 226 for ONNX tensor: 226
TRT - VERBOSE
Reshape_208 [Reshape] outputs: [226 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Transpose_209 [Transpose]
TRT - VERBOSE
Searching for input: 226
TRT - VERBOSE
Transpose_209 [Transpose] inputs: [226 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_209 for ONNX node: Transpose_209
TRT - VERBOSE
Registering tensor: 227 for ONNX tensor: 227
TRT - VERBOSE
Transpose_209 [Transpose] outputs: [227 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Concat_210 [Concat]
TRT - VERBOSE
Searching for input: 213
TRT - VERBOSE
Searching for input: 215
TRT - VERBOSE
Searching for input: 223
TRT - VERBOSE
Concat_210 [Concat] inputs: [213 -> (1)[INT32]], [215 -> (1)[INT32]], [223 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Concat_210 for ONNX node: Concat_210
TRT - VERBOSE
Registering tensor: 228 for ONNX tensor: 228
TRT - VERBOSE
Concat_210 [Concat] outputs: [228 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_211 [Reshape]
TRT - VERBOSE
Searching for input: 227
TRT - VERBOSE
Searching for input: 228
TRT - VERBOSE
Reshape_211 [Reshape] inputs: [227 -> (-1, -1, -1)[FLOAT]], [228 -> (3)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_211 for ONNX node: Reshape_211
TRT - VERBOSE
Registering tensor: 229 for ONNX tensor: 229
TRT - VERBOSE
Reshape_211 [Reshape] outputs: [229 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_212 [Mul]
TRT - VERBOSE
Searching for input: 182
TRT - VERBOSE
Searching for input: 229
TRT - VERBOSE
Mul_212 [Mul] inputs: [182 -> (1, 1, -1)[FLOAT]], [229 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_212 for ONNX node: Mul_212
TRT - VERBOSE
Registering tensor: 230 for ONNX tensor: 230
TRT - VERBOSE
Mul_212 [Mul] outputs: [230 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Add_213 [Add]
TRT - VERBOSE
Searching for input: 210
TRT - VERBOSE
Searching for input: 230
TRT - VERBOSE
Add_213 [Add] inputs: [210 -> (-1, -1, -1)[FLOAT]], [230 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Add_213 for ONNX node: Add_213
TRT - VERBOSE
Registering tensor: 231 for ONNX tensor: 231
TRT - VERBOSE
Add_213 [Add] outputs: [231 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_214 [Shape]
TRT - VERBOSE
Searching for input: dense_feat_map
TRT - VERBOSE
Shape_214 [Shape] inputs: [dense_feat_map -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_214 for ONNX node: Shape_214
TRT - VERBOSE
Registering tensor: 232 for ONNX tensor: 232
TRT - VERBOSE
Shape_214 [Shape] outputs: [232 -> (4)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_216 [Gather]
TRT - VERBOSE
Searching for input: 232
TRT - VERBOSE
Searching for input: 233
TRT - VERBOSE
Gather_216 [Gather] inputs: [232 -> (4)[INT32]], [233 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 233 for ONNX node: 233
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_216 for ONNX node: Gather_216
TRT - VERBOSE
Registering tensor: 234 for ONNX tensor: 234
TRT - VERBOSE
Gather_216 [Gather] outputs: [234 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_218 [Gather]
TRT - VERBOSE
Searching for input: 232
TRT - VERBOSE
Searching for input: 235
TRT - VERBOSE
Gather_218 [Gather] inputs: [232 -> (4)[INT32]], [235 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 235 for ONNX node: 235
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_218 for ONNX node: Gather_218
TRT - VERBOSE
Registering tensor: 236 for ONNX tensor: 236
TRT - VERBOSE
Gather_218 [Gather] outputs: [236 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_220 [Gather]
TRT - VERBOSE
Searching for input: 232
TRT - VERBOSE
Searching for input: 237
TRT - VERBOSE
Gather_220 [Gather] inputs: [232 -> (4)[INT32]], [237 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 237 for ONNX node: 237
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_220 for ONNX node: Gather_220
TRT - VERBOSE
Registering tensor: 238 for ONNX tensor: 238
TRT - VERBOSE
Gather_220 [Gather] outputs: [238 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Transpose_221 [Transpose]
TRT - VERBOSE
Searching for input: dense_feat_map
TRT - VERBOSE
Transpose_221 [Transpose] inputs: [dense_feat_map -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_221 for ONNX node: Transpose_221
TRT - VERBOSE
Registering tensor: 239 for ONNX tensor: 239
TRT - VERBOSE
Transpose_221 [Transpose] outputs: [239 -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Flatten_222 [Flatten]
TRT - VERBOSE
Searching for input: 239
TRT - VERBOSE
Flatten_222 [Flatten] inputs: [239 -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Flatten_222 for ONNX node: Flatten_222
TRT - VERBOSE
Registering tensor: 240 for ONNX tensor: 240
TRT - VERBOSE
Flatten_222 [Flatten] outputs: [240 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_223 [Mul]
TRT - VERBOSE
Searching for input: 142
TRT - VERBOSE
Searching for input: 238
TRT - VERBOSE
Mul_223 [Mul] inputs: [142 -> (-1)[INT32]], [238 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Mul_223 for ONNX node: Mul_223
TRT - VERBOSE
Registering tensor: 241 for ONNX tensor: 241
TRT - VERBOSE
Mul_223 [Mul] outputs: [241 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Add_224 [Add]
TRT - VERBOSE
Searching for input: 150
TRT - VERBOSE
Searching for input: 241
TRT - VERBOSE
Add_224 [Add] inputs: [150 -> (-1)[INT32]], [241 -> (-1)[INT32]], 
TRT - VERBOSE
Registering layer: Add_224 for ONNX node: Add_224
TRT - VERBOSE
Registering tensor: 242 for ONNX tensor: 242
TRT - VERBOSE
Add_224 [Add] outputs: [242 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_225 [Gather]
TRT - VERBOSE
Searching for input: 240
TRT - VERBOSE
Searching for input: 242
TRT - VERBOSE
Gather_225 [Gather] inputs: [240 -> (-1, -1)[FLOAT]], [242 -> (-1)[INT32]], 
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_225 for ONNX node: Gather_225
TRT - VERBOSE
Registering tensor: 243 for ONNX tensor: 243
TRT - VERBOSE
Gather_225 [Gather] outputs: [243 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_226 [Shape]
TRT - VERBOSE
Searching for input: 242
TRT - VERBOSE
Shape_226 [Shape] inputs: [242 -> (-1)[INT32]], 
TRT - VERBOSE
Registering layer: Shape_226 for ONNX node: Shape_226
TRT - VERBOSE
Registering tensor: 244 for ONNX tensor: 244
TRT - VERBOSE
Shape_226 [Shape] outputs: [244 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Concat_228 [Concat]
TRT - VERBOSE
Searching for input: 245
TRT - VERBOSE
Searching for input: 234
TRT - VERBOSE
Searching for input: 236
TRT - VERBOSE
Concat_228 [Concat] inputs: [245 -> (1)[INT32]], [234 -> (1)[INT32]], [236 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 245 for ONNX node: 245
TRT - VERBOSE
Registering layer: Concat_228 for ONNX node: Concat_228
TRT - VERBOSE
Registering tensor: 246 for ONNX tensor: 246
TRT - VERBOSE
Concat_228 [Concat] outputs: [246 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_229 [Reshape]
TRT - VERBOSE
Searching for input: 243
TRT - VERBOSE
Searching for input: 246
TRT - VERBOSE
Reshape_229 [Reshape] inputs: [243 -> (-1, -1)[FLOAT]], [246 -> (3)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_229 for ONNX node: Reshape_229
TRT - VERBOSE
Registering tensor: 247 for ONNX tensor: 247
TRT - VERBOSE
Reshape_229 [Reshape] outputs: [247 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Transpose_230 [Transpose]
TRT - VERBOSE
Searching for input: 247
TRT - VERBOSE
Transpose_230 [Transpose] inputs: [247 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_230 for ONNX node: Transpose_230
TRT - VERBOSE
Registering tensor: 248 for ONNX tensor: 248
TRT - VERBOSE
Transpose_230 [Transpose] outputs: [248 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Concat_231 [Concat]
TRT - VERBOSE
Searching for input: 234
TRT - VERBOSE
Searching for input: 236
TRT - VERBOSE
Searching for input: 244
TRT - VERBOSE
Concat_231 [Concat] inputs: [234 -> (1)[INT32]], [236 -> (1)[INT32]], [244 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Concat_231 for ONNX node: Concat_231
TRT - VERBOSE
Registering tensor: 249 for ONNX tensor: 249
TRT - VERBOSE
Concat_231 [Concat] outputs: [249 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_232 [Reshape]
TRT - VERBOSE
Searching for input: 248
TRT - VERBOSE
Searching for input: 249
TRT - VERBOSE
Reshape_232 [Reshape] inputs: [248 -> (-1, -1, -1)[FLOAT]], [249 -> (3)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_232 for ONNX node: Reshape_232
TRT - VERBOSE
Registering tensor: 250 for ONNX tensor: 250
TRT - VERBOSE
Reshape_232 [Reshape] outputs: [250 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_233 [Mul]
TRT - VERBOSE
Searching for input: 186
TRT - VERBOSE
Searching for input: 250
TRT - VERBOSE
Mul_233 [Mul] inputs: [186 -> (1, 1, -1)[FLOAT]], [250 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_233 for ONNX node: Mul_233
TRT - VERBOSE
Registering tensor: 251 for ONNX tensor: 251
TRT - VERBOSE
Mul_233 [Mul] outputs: [251 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Add_234 [Add]
TRT - VERBOSE
Searching for input: 231
TRT - VERBOSE
Searching for input: 251
TRT - VERBOSE
Add_234 [Add] inputs: [231 -> (-1, -1, -1)[FLOAT]], [251 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Add_234 for ONNX node: Add_234
TRT - VERBOSE
Registering tensor: 252 for ONNX tensor: 252
TRT - VERBOSE
Add_234 [Add] outputs: [252 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_235 [Shape]
TRT - VERBOSE
Searching for input: dense_feat_map
TRT - VERBOSE
Shape_235 [Shape] inputs: [dense_feat_map -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_235 for ONNX node: Shape_235
TRT - VERBOSE
Registering tensor: 253 for ONNX tensor: 253
TRT - VERBOSE
Shape_235 [Shape] outputs: [253 -> (4)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_237 [Gather]
TRT - VERBOSE
Searching for input: 253
TRT - VERBOSE
Searching for input: 254
TRT - VERBOSE
Gather_237 [Gather] inputs: [253 -> (4)[INT32]], [254 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 254 for ONNX node: 254
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_237 for ONNX node: Gather_237
TRT - VERBOSE
Registering tensor: 255 for ONNX tensor: 255
TRT - VERBOSE
Gather_237 [Gather] outputs: [255 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_239 [Gather]
TRT - VERBOSE
Searching for input: 253
TRT - VERBOSE
Searching for input: 256
TRT - VERBOSE
Gather_239 [Gather] inputs: [253 -> (4)[INT32]], [256 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 256 for ONNX node: 256
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_239 for ONNX node: Gather_239
TRT - VERBOSE
Registering tensor: 257 for ONNX tensor: 257
TRT - VERBOSE
Gather_239 [Gather] outputs: [257 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_241 [Gather]
TRT - VERBOSE
Searching for input: 253
TRT - VERBOSE
Searching for input: 258
TRT - VERBOSE
Gather_241 [Gather] inputs: [253 -> (4)[INT32]], [258 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 258 for ONNX node: 258
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_241 for ONNX node: Gather_241
TRT - VERBOSE
Registering tensor: 259 for ONNX tensor: 259
TRT - VERBOSE
Gather_241 [Gather] outputs: [259 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Transpose_242 [Transpose]
TRT - VERBOSE
Searching for input: dense_feat_map
TRT - VERBOSE
Transpose_242 [Transpose] inputs: [dense_feat_map -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_242 for ONNX node: Transpose_242
TRT - VERBOSE
Registering tensor: 260 for ONNX tensor: 260
TRT - VERBOSE
Transpose_242 [Transpose] outputs: [260 -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Flatten_243 [Flatten]
TRT - VERBOSE
Searching for input: 260
TRT - VERBOSE
Flatten_243 [Flatten] inputs: [260 -> (-1, -1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Flatten_243 for ONNX node: Flatten_243
TRT - VERBOSE
Registering tensor: 261 for ONNX tensor: 261
TRT - VERBOSE
Flatten_243 [Flatten] outputs: [261 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_244 [Mul]
TRT - VERBOSE
Searching for input: 142
TRT - VERBOSE
Searching for input: 259
TRT - VERBOSE
Mul_244 [Mul] inputs: [142 -> (-1)[INT32]], [259 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Mul_244 for ONNX node: Mul_244
TRT - VERBOSE
Registering tensor: 262 for ONNX tensor: 262
TRT - VERBOSE
Mul_244 [Mul] outputs: [262 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Add_245 [Add]
TRT - VERBOSE
Searching for input: 158
TRT - VERBOSE
Searching for input: 262
TRT - VERBOSE
Add_245 [Add] inputs: [158 -> (-1)[INT32]], [262 -> (-1)[INT32]], 
TRT - VERBOSE
Registering layer: Add_245 for ONNX node: Add_245
TRT - VERBOSE
Registering tensor: 263 for ONNX tensor: 263
TRT - VERBOSE
Add_245 [Add] outputs: [263 -> (-1)[INT32]], 
TRT - VERBOSE
Parsing node: Gather_246 [Gather]
TRT - VERBOSE
Searching for input: 261
TRT - VERBOSE
Searching for input: 263
TRT - VERBOSE
Gather_246 [Gather] inputs: [261 -> (-1, -1)[FLOAT]], [263 -> (-1)[INT32]], 
TRT - VERBOSE
Using Gather axis: 0
TRT - VERBOSE
Registering layer: Gather_246 for ONNX node: Gather_246
TRT - VERBOSE
Registering tensor: 264 for ONNX tensor: 264
TRT - VERBOSE
Gather_246 [Gather] outputs: [264 -> (-1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_247 [Shape]
TRT - VERBOSE
Searching for input: 263
TRT - VERBOSE
Shape_247 [Shape] inputs: [263 -> (-1)[INT32]], 
TRT - VERBOSE
Registering layer: Shape_247 for ONNX node: Shape_247
TRT - VERBOSE
Registering tensor: 265 for ONNX tensor: 265
TRT - VERBOSE
Shape_247 [Shape] outputs: [265 -> (1)[INT32]], 
TRT - VERBOSE
Parsing node: Concat_249 [Concat]
TRT - VERBOSE
Searching for input: 266
TRT - VERBOSE
Searching for input: 255
TRT - VERBOSE
Searching for input: 257
TRT - VERBOSE
Concat_249 [Concat] inputs: [266 -> (1)[INT32]], [255 -> (1)[INT32]], [257 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: 266 for ONNX node: 266
TRT - VERBOSE
Registering layer: Concat_249 for ONNX node: Concat_249
TRT - VERBOSE
Registering tensor: 267 for ONNX tensor: 267
TRT - VERBOSE
Concat_249 [Concat] outputs: [267 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_250 [Reshape]
TRT - VERBOSE
Searching for input: 264
TRT - VERBOSE
Searching for input: 267
TRT - VERBOSE
Reshape_250 [Reshape] inputs: [264 -> (-1, -1)[FLOAT]], [267 -> (3)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_250 for ONNX node: Reshape_250
TRT - VERBOSE
Registering tensor: 268 for ONNX tensor: 268
TRT - VERBOSE
Reshape_250 [Reshape] outputs: [268 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Transpose_251 [Transpose]
TRT - VERBOSE
Searching for input: 268
TRT - VERBOSE
Transpose_251 [Transpose] inputs: [268 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_251 for ONNX node: Transpose_251
TRT - VERBOSE
Registering tensor: 269 for ONNX tensor: 269
TRT - VERBOSE
Transpose_251 [Transpose] outputs: [269 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Concat_252 [Concat]
TRT - VERBOSE
Searching for input: 255
TRT - VERBOSE
Searching for input: 257
TRT - VERBOSE
Searching for input: 265
TRT - VERBOSE
Concat_252 [Concat] inputs: [255 -> (1)[INT32]], [257 -> (1)[INT32]], [265 -> (1)[INT32]], 
TRT - VERBOSE
Registering layer: Concat_252 for ONNX node: Concat_252
TRT - VERBOSE
Registering tensor: 270 for ONNX tensor: 270
TRT - VERBOSE
Concat_252 [Concat] outputs: [270 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Reshape_253 [Reshape]
TRT - VERBOSE
Searching for input: 269
TRT - VERBOSE
Searching for input: 270
TRT - VERBOSE
Reshape_253 [Reshape] inputs: [269 -> (-1, -1, -1)[FLOAT]], [270 -> (3)[INT32]], 
TRT - VERBOSE
Registering layer: Reshape_253 for ONNX node: Reshape_253
TRT - VERBOSE
Registering tensor: 271 for ONNX tensor: 271
TRT - VERBOSE
Reshape_253 [Reshape] outputs: [271 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Mul_254 [Mul]
TRT - VERBOSE
Searching for input: 190
TRT - VERBOSE
Searching for input: 271
TRT - VERBOSE
Mul_254 [Mul] inputs: [190 -> (1, 1, -1)[FLOAT]], [271 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Mul_254 for ONNX node: Mul_254
TRT - VERBOSE
Registering tensor: 272 for ONNX tensor: 272
TRT - VERBOSE
Mul_254 [Mul] outputs: [272 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Add_255 [Add]
TRT - VERBOSE
Searching for input: 252
TRT - VERBOSE
Searching for input: 272
TRT - VERBOSE
Add_255 [Add] inputs: [252 -> (-1, -1, -1)[FLOAT]], [272 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Add_255 for ONNX node: Add_255
TRT - VERBOSE
Registering tensor: 273 for ONNX tensor: 273
TRT - VERBOSE
Add_255 [Add] outputs: [273 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Transpose_256 [Transpose]
TRT - VERBOSE
Searching for input: 273
TRT - VERBOSE
Transpose_256 [Transpose] inputs: [273 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Transpose_256 for ONNX node: Transpose_256
TRT - VERBOSE
Registering tensor: 274 for ONNX tensor: 274
TRT - VERBOSE
Transpose_256 [Transpose] outputs: [274 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: ReduceL2_257 [ReduceL2]
TRT - VERBOSE
Searching for input: 274
TRT - VERBOSE
ReduceL2_257 [ReduceL2] inputs: [274 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: ReduceL2_257 for ONNX node: ReduceL2_257
TRT - VERBOSE
Registering layer: ReduceL2_257_96 for ONNX node: ReduceL2_257
TRT - VERBOSE
Registering tensor: 275 for ONNX tensor: 275
TRT - VERBOSE
ReduceL2_257 [ReduceL2] outputs: [275 -> (-1, -1, 1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Clip_258 [Clip]
TRT - VERBOSE
Searching for input: 275
TRT - VERBOSE
Searching for input: 292
TRT - VERBOSE
Clip_258 [Clip] inputs: [275 -> (-1, -1, 1)[FLOAT]], [292 -> ()[FLOAT]], [optional input, not set], 
TRT - VERBOSE
Registering layer: 292 for ONNX node: 292
TRT - VERBOSE
Registering tensor: 279 for ONNX tensor: 279
TRT - VERBOSE
Clip_258 [Clip] outputs: [279 -> (-1, -1, 1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Shape_259 [Shape]
TRT - VERBOSE
Searching for input: 274
TRT - VERBOSE
Shape_259 [Shape] inputs: [274 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Shape_259 for ONNX node: Shape_259
TRT - VERBOSE
Registering tensor: 280 for ONNX tensor: 280
TRT - VERBOSE
Shape_259 [Shape] outputs: [280 -> (3)[INT32]], 
TRT - VERBOSE
Parsing node: Expand_260 [Expand]
TRT - VERBOSE
Searching for input: 279
TRT - VERBOSE
Searching for input: 280
TRT - VERBOSE
Expand_260 [Expand] inputs: [279 -> (-1, -1, 1)[FLOAT]], [280 -> (3)[INT32]], 
TRT - VERBOSE
Registering layer: Expand_260 for ONNX node: Expand_260
TRT - VERBOSE
Registering tensor: 281 for ONNX tensor: 281
TRT - VERBOSE
Expand_260 [Expand] outputs: [281 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Div_261 [Div]
TRT - VERBOSE
Searching for input: 274
TRT - VERBOSE
Searching for input: 281
TRT - VERBOSE
Div_261 [Div] inputs: [274 -> (-1, -1, -1)[FLOAT]], [281 -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Registering layer: Div_261 for ONNX node: Div_261
TRT - VERBOSE
Registering tensor: descs_100 for ONNX tensor: descs
TRT - VERBOSE
Div_261 [Div] outputs: [descs -> (-1, -1, -1)[FLOAT]], 
TRT - VERBOSE
Parsing node: Gather_263 [Gather]
TRT - VERBOSE
Searching for input: 98
TRT - VERBOSE
Searching for input: 283
TRT - VERBOSE
Gather_263 [Gather] inputs: [98 -> (-1, -1, 2)[FLOAT]], [283 -> (2)[INT32]], 
TRT - VERBOSE
Registering layer: 283 for ONNX node: 283
TRT - VERBOSE
Using Gather axis: 2
TRT - VERBOSE
Registering layer: Gather_263 for ONNX node: Gather_263
TRT - VERBOSE
Registering tensor: kpts_101 for ONNX tensor: kpts
TRT - VERBOSE
Gather_263 [Gather] outputs: [kpts -> (-1, -1, 2)[FLOAT]], 
TRT - VERBOSE
Marking descs_100 as output: descs
TRT - VERBOSE
Marking kpts_101 as output: kpts
TRT - VERBOSE
Marking scores_63 as output: scores
Completed Onnx file parsing
TensorRT model parse report:
Model parsing OK!
Network Description
Input 'keypoints' with shape (-1, -1, -1) and dtype DataType.FLOAT
Input 'scores.1' with shape (-1, -1) and dtype DataType.FLOAT
Input 'score_map' with shape (-1, -1, -1, -1) and dtype DataType.FLOAT
Input 'dense_feat_map' with shape (-1, -1, -1, -1) and dtype DataType.FLOAT
Output 'descs' with shape (-1, -1, -1) and dtype DataType.FLOAT
Output 'kpts' with shape (-1, -1, 2) and dtype DataType.FLOAT
Output 'scores' with shape (-1, -1) and dtype DataType.FLOAT
===============================================================
Beginning Trt engine building
Start model optimization...
TRT - WARNING
DLA requests all profiles have same min, max, and opt value. All dla layers are falling back to GPU
TRT - VERBOSE
Applying generic optimizations to the graph for inference.
TRT - VERBOSE
Original: 171 layers
TRT - VERBOSE
After dead-layer removal: 171 layers
TRT - VERBOSE
Running: ConstShuffleFusion
TRT - VERBOSE
ConstShuffleFusion: Fusing 19 with (Unnamed Layer* 29) [Shuffle]
TRT - VERBOSE
Running: ConstShuffleFusion
TRT - VERBOSE
ConstShuffleFusion: Fusing 22 with (Unnamed Layer* 33) [Shuffle]
TRT - VERBOSE
Running: ConstShuffleFusion
TRT - VERBOSE
ConstShuffleFusion: Fusing 26 with (Unnamed Layer* 38) [Shuffle]
TRT - VERBOSE
Running: ConstShuffleFusion
TRT - VERBOSE
ConstShuffleFusion: Fusing 29 with (Unnamed Layer* 42) [Shuffle]
TRT - VERBOSE
Running: ConstShuffleFusion
TRT - VERBOSE
ConstShuffleFusion: Fusing 32 with (Unnamed Layer* 46) [Shuffle]
TRT - VERBOSE
Running: ConstShuffleFusion
TRT - VERBOSE
ConstShuffleFusion: Fusing 35 with (Unnamed Layer* 50) [Shuffle]
TRT - VERBOSE
Running: ConstShuffleFusion
TRT - VERBOSE
ConstShuffleFusion: Fusing 287 with (Unnamed Layer* 127) [Shuffle]
TRT - VERBOSE
Running: ConstShuffleFusion
TRT - VERBOSE
ConstShuffleFusion: Fusing 163 with (Unnamed Layer* 196) [Shuffle]
TRT - VERBOSE
Running: ConstShuffleFusion
TRT - VERBOSE
ConstShuffleFusion: Fusing 165 with (Unnamed Layer* 199) [Shuffle]
TRT - VERBOSE
Running: ConstShuffleFusion
TRT - VERBOSE
ConstShuffleFusion: Fusing 168 with (Unnamed Layer* 203) [Shuffle]
TRT - VERBOSE
Running: ConstShuffleFusion
TRT - VERBOSE
ConstShuffleFusion: Fusing 171 with (Unnamed Layer* 207) [Shuffle]
TRT - VERBOSE
Running: ConstShuffleFusion
TRT - VERBOSE
ConstShuffleFusion: Fusing 292 with (Unnamed Layer* 396) [Shuffle]
TRT - VERBOSE
Running: ConstShuffleFusion
TRT - VERBOSE
ConstShuffleFusion: Fusing (Unnamed Layer* 395) [Constant] with (Unnamed Layer* 397) [Shuffle]
TRT - VERBOSE
Running: ShuffleShuffleFusion
TRT - VERBOSE
ShuffleShuffleFusion: Fusing Transpose_180 with Flatten_181
TRT - VERBOSE
Running: ShuffleShuffleFusion
TRT - VERBOSE
ShuffleShuffleFusion: Fusing Transpose_200 with Flatten_201
TRT - VERBOSE
Running: ShuffleShuffleFusion
TRT - VERBOSE
ShuffleShuffleFusion: Fusing Transpose_221 with Flatten_222
TRT - VERBOSE
Running: ShuffleShuffleFusion
TRT - VERBOSE
ShuffleShuffleFusion: Fusing Transpose_242 with Flatten_243
TRT - VERBOSE
Running: ShuffleShuffleFusion
TRT - VERBOSE
ShuffleShuffleFusion: Fusing Transpose_60 with Flatten_61
TRT - VERBOSE
Running: ShuffleShuffleFusion
TRT - VERBOSE
ShuffleShuffleFusion: Fusing Reshape_68 with Transpose_69
TRT - VERBOSE
Running: ShuffleShuffleFusion
TRT - VERBOSE
ShuffleShuffleFusion: Fusing Reshape_71 with Reshape_88
TRT - VERBOSE
Running: ShuffleShuffleFusion
TRT - VERBOSE
ShuffleShuffleFusion: Fusing Reshape_188 with Transpose_189
TRT - VERBOSE
Running: ShuffleShuffleFusion
TRT - VERBOSE
ShuffleShuffleFusion: Fusing Reshape_188 + Transpose_189 with Reshape_191
TRT - VERBOSE
Running: ShuffleShuffleFusion
TRT - VERBOSE
ShuffleShuffleFusion: Fusing Reshape_208 with Transpose_209
TRT - VERBOSE
Running: ShuffleShuffleFusion
TRT - VERBOSE
ShuffleShuffleFusion: Fusing Reshape_208 + Transpose_209 with Reshape_211
TRT - VERBOSE
Running: ShuffleShuffleFusion
TRT - VERBOSE
ShuffleShuffleFusion: Fusing Reshape_229 with Transpose_230
TRT - VERBOSE
Running: ShuffleShuffleFusion
TRT - VERBOSE
ShuffleShuffleFusion: Fusing Reshape_229 + Transpose_230 with Reshape_232
TRT - VERBOSE
Running: ShuffleShuffleFusion
TRT - VERBOSE
ShuffleShuffleFusion: Fusing Reshape_250 with Transpose_251
TRT - VERBOSE
Running: ShuffleShuffleFusion
TRT - VERBOSE
ShuffleShuffleFusion: Fusing Reshape_250 + Transpose_251 with Reshape_253
TRT - VERBOSE
Running: ShuffleShuffleFusion
TRT - VERBOSE
ShuffleShuffleFusion: Fusing Unsqueeze_170 with Unsqueeze_172
TRT - VERBOSE
Running: ShuffleShuffleFusion
TRT - VERBOSE
ShuffleShuffleFusion: Fusing Unsqueeze_162 with Unsqueeze_164
TRT - VERBOSE
Running: ShuffleShuffleFusion
TRT - VERBOSE
ShuffleShuffleFusion: Fusing Unsqueeze_158 with Unsqueeze_160
TRT - VERBOSE
Running: ShuffleShuffleFusion
TRT - VERBOSE
ShuffleShuffleFusion: Fusing Unsqueeze_166 with Unsqueeze_168
TRT - VERBOSE
DLA Memory Consumption Summary:
TRT - VERBOSE
	Number of DLA node candidates offloaded : 0 out of 2
TRT - VERBOSE
	Total memory required by accepted candidates : Managed SRAM = 0 MiB,	Local DRAM = 0 MiB,	Global DRAM = 0 MiB
TRT - VERBOSE
After Myelin optimization: 15 layers
TRT - VERBOSE
Applying ScaleNodes fusions.
TRT - VERBOSE
After scale fusion: 15 layers
TRT - VERBOSE
Running: ActivationToPointwiseConversion
TRT - VERBOSE
Swap the layer type of Clip_46 from ACTIVATION to POINTWISE
TRT - VERBOSE
After vertical fusions: 15 layers
TRT - VERBOSE
Replacing input 6 of {ForeignNode[55...Div_261]} with 261 (output of Transpose_242 + Flatten_243)
TRT - VERBOSE
Replacing input 9 of {ForeignNode[55...Div_261]} with 261 (output of Transpose_242 + Flatten_243)
TRT - VERBOSE
Replacing input 7 of {ForeignNode[55...Div_261]} with 261 (output of Transpose_242 + Flatten_243)
TRT - VERBOSE
After dupe layer removal: 15 layers
TRT - VERBOSE
After final dead-layer removal: 12 layers
TRT - VERBOSE
After tensor merging: 12 layers
TRT - VERBOSE
After slice removal: 12 layers
TRT - VERBOSE
After concat removal: 12 layers
TRT - VERBOSE
Graph construction and optimization completed in 0.07234 seconds.
TRT - INFO
---------- Layers Running on DLA ----------
TRT - INFO
---------- Layers Running on GPU ----------
TRT - INFO
[GpuLayer] COPY: Reformatting CopyNode for Network Input score_map
TRT - INFO
[GpuLayer] CONVOLUTION: Conv_10
TRT - INFO
[GpuLayer] CONVOLUTION: Conv_8
TRT - INFO
[GpuLayer] CONVOLUTION: Conv_6
TRT - INFO
[GpuLayer] CONVOLUTION: Conv_4
TRT - INFO
[GpuLayer] CONVOLUTION: Conv_2
TRT - INFO
[GpuLayer] MYELIN: {ForeignNode[19 + (Unnamed Layer* 29) [Shuffle]...Concat_45]}
TRT - INFO
[GpuLayer] SHUFFLE: Transpose_242 + Flatten_243
TRT - INFO
[GpuLayer] SHUFFLE: Transpose_91
TRT - INFO
[GpuLayer] SHAPE_HOST_TO_DEVICE: [HostToDeviceCopy]
TRT - INFO
[GpuLayer] POINTWISE: PWN(Clip_46)
TRT - INFO
[GpuLayer] SHUFFLE: Transpose_60 + Flatten_61
TRT - INFO
[GpuLayer] MYELIN: {ForeignNode[55...Div_261]}
TRT - VERBOSE
Using cublasLt as a tactic source
TRT - INFO
[MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +8, now: CPU 1087, GPU 4607 (MiB)
TRT - VERBOSE
Using cuDNN as a tactic source
TRT - INFO
[MemUsageChange] Init cuDNN: CPU +0, GPU +9, now: CPU 1087, GPU 4616 (MiB)
TRT - INFO
Local timing cache in use. Profiling results in this builder pass will not be stored.
TRT - VERBOSE
Constructing optimization profile number 0 [1/1].
TRT - VERBOSE
Reserving memory for activation tensors. Host: 0 bytes Device: 21086080 bytes
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
*************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) -> Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
--------------- Timing Runner: Reformatting CopyNode for Network Input score_map (Reformat)
TRT - VERBOSE
Tactic: 1000 Time: 0.138848
TRT - VERBOSE
Tactic: 1002 Time: 0.0582187
TRT - VERBOSE
Tactic: 0 Time: 0.120956
TRT - VERBOSE
Fastest Tactic: 1002 Time: 0.0582187
TRT - VERBOSE
>>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002
TRT - VERBOSE
*************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) -> Float((* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))),1,(# 3 (SHAPE score_map)),1) ***************
TRT - VERBOSE
--------------- Timing Runner: Reformatting CopyNode for Network Input score_map (Reformat)
TRT - VERBOSE
Tactic: 1000 Time: 0.0589333
TRT - VERBOSE
Tactic: 1002 Time: 0.08472
TRT - VERBOSE
Tactic: 0 Time: 0.0581564
TRT - VERBOSE
Fastest Tactic: 0 Time: 0.0581564
TRT - VERBOSE
>>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
*************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) -> Float((* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))),1,(# 3 (SHAPE score_map)),1) ***************
TRT - VERBOSE
--------------- Timing Runner: Optimizer Reformat(Reformatted score_map -> <out>) (Reformat)
TRT - VERBOSE
Tactic: 1000 Time: 0.057952
TRT - VERBOSE
Tactic: 1002 Time: 0.0712619
TRT - VERBOSE
Tactic: 0 Time: 0.0579751
TRT - VERBOSE
Fastest Tactic: 1000 Time: 0.057952
TRT - VERBOSE
*************** Autotuning Reformat: Float((* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))),1,(# 3 (SHAPE score_map)),1) -> Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
--------------- Timing Runner: Optimizer Reformat(Reformatted score_map -> <out>) (Reformat)
TRT - VERBOSE
Tactic: 1000 Time: 0.0470613
TRT - VERBOSE
Tactic: 1002 Time: 0.0698219
TRT - VERBOSE
Tactic: 0 Time: 0.0467
TRT - VERBOSE
Fastest Tactic: 0 Time: 0.0467
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
*************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) -> Float((* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))),1,(# 3 (SHAPE score_map)),1) ***************
TRT - VERBOSE
*************** Autotuning Reformat: Float((* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))),1,(# 3 (SHAPE score_map)),1) -> Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
*************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) -> Float((* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))),1,(# 3 (SHAPE score_map)),1) ***************
TRT - VERBOSE
*************** Autotuning Reformat: Float((* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))),1,(# 3 (SHAPE score_map)),1) -> Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
*************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) -> Float((* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))),1,(# 3 (SHAPE score_map)),1) ***************
TRT - VERBOSE
*************** Autotuning Reformat: Float((* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))),1,(# 3 (SHAPE score_map)),1) -> Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
*************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) -> Float((* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))),1,(# 3 (SHAPE score_map)),1) ***************
TRT - VERBOSE
*************** Autotuning Reformat: Float((* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))),1,(# 3 (SHAPE score_map)),1) -> Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
*************** Autotuning Reformat: Float((* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))),1,(# 3 (SHAPE score_map)),1) -> Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
*************** Autotuning Reformat: Float((* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))),1,(# 3 (SHAPE score_map)),1) -> Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
*************** Autotuning Reformat: Float((* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))),1,(# 3 (SHAPE score_map)),1) -> Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
*************** Autotuning Reformat: Float((* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))),1,(# 3 (SHAPE score_map)),1) -> Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
*************** Autotuning Reformat: Float((* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))),1,(# 3 (SHAPE score_map)),1) -> Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
*************** Autotuning Reformat: Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* (# 2 (SHAPE score_map)) E0) -> Float(E1,E1,1,E0,(# 2 (SHAPE score_map))) where E0=(* 2 (# 2 (SHAPE score_map))) E1=(* (# 3 (SHAPE score_map)) E0) ***************
TRT - VERBOSE
--------------- Timing Runner: Optimizer Reformat(<in> -> 49) (Reformat)
TRT - VERBOSE
Tactic: 1000 Time: 0.139794
TRT - VERBOSE
Tactic: 1002 Time: 0.0910453
TRT - VERBOSE
Tactic: 0 Time: 0.13856
TRT - VERBOSE
Fastest Tactic: 1002 Time: 0.0910453
TRT - VERBOSE
*************** Autotuning Reformat: Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* (# 2 (SHAPE score_map)) E0) -> Float(E1,E1,E0:32,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* E0 (CEIL_DIV (# 2 (SHAPE score_map)) 32)) ***************
TRT - VERBOSE
--------------- Timing Runner: Optimizer Reformat(<in> -> 49) (Reformat)
TRT - VERBOSE
Tactic: 1000 Time: 0.388853
TRT - VERBOSE
Tactic: 1002 Time: 0.0953307
TRT - VERBOSE
Tactic: 0 Time: 0.388928
TRT - VERBOSE
Fastest Tactic: 1002 Time: 0.0953307
TRT - VERBOSE
*************** Autotuning Reformat: Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* (# 2 (SHAPE score_map)) E0) -> Float((* (# 2 (SHAPE score_map)) E0),1:4,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
--------------- Timing Runner: Optimizer Reformat(<in> -> 49) (Reformat)
TRT - VERBOSE
Tactic: 1000 Time: 0.843787
TRT - VERBOSE
Tactic: 1002 Time: 31.0487
TRT - VERBOSE
Tactic: 0 Time: 0.468651
TRT - VERBOSE
Fastest Tactic: 0 Time: 0.468651
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
*************** Autotuning Reformat: Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* (# 2 (SHAPE score_map)) E0) -> Float(E1,E1,1,E0,(# 2 (SHAPE score_map))) where E0=(* 2 (# 2 (SHAPE score_map))) E1=(* (# 3 (SHAPE score_map)) E0) ***************
TRT - VERBOSE
--------------- Timing Runner: Optimizer Reformat(49 -> <out>) (Reformat)
TRT - VERBOSE
Tactic: 1000 Time: 0.0647893
TRT - VERBOSE
Tactic: 1002 Time: 0.0584071
TRT - VERBOSE
Tactic: 0 Time: 0.0645671
TRT - VERBOSE
Fastest Tactic: 1002 Time: 0.0584071
TRT - VERBOSE
*************** Autotuning Reformat: Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* (# 2 (SHAPE score_map)) E0) -> Float(E1,E1,E0:32,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* E0 (CEIL_DIV (# 2 (SHAPE score_map)) 32)) ***************
TRT - VERBOSE
--------------- Timing Runner: Optimizer Reformat(49 -> <out>) (Reformat)
TRT - VERBOSE
Tactic: 1000 Time: 0.172363
TRT - VERBOSE
Tactic: 1002 Time: 0.0569084
TRT - VERBOSE
Tactic: 0 Time: 0.171909
TRT - VERBOSE
Fastest Tactic: 1002 Time: 0.0569084
TRT - VERBOSE
*************** Autotuning Reformat: Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* (# 2 (SHAPE score_map)) E0) -> Float((* (# 2 (SHAPE score_map)) E0),1:4,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
--------------- Timing Runner: Optimizer Reformat(49 -> <out>) (Reformat)
TRT - VERBOSE
Tactic: 1000 Time: 0.234672
TRT - VERBOSE
Tactic: 1002 Time: 11.6012
TRT - VERBOSE
Tactic: 0 Time: 0.168832
TRT - VERBOSE
Fastest Tactic: 0 Time: 0.168832
TRT - VERBOSE
*************** Autotuning Reformat: Float(E1,E1,1,E0,(# 2 (SHAPE score_map))) where E0=(* 2 (# 2 (SHAPE score_map))) E1=(* (# 3 (SHAPE score_map)) E0) -> Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* (# 2 (SHAPE score_map)) E0) ***************
TRT - VERBOSE
--------------- Timing Runner: Optimizer Reformat(49 -> <out>) (Reformat)
TRT - VERBOSE
Tactic: 1000 Time: 0.0505966
TRT - VERBOSE
Tactic: 1002 Time: 0.053181
TRT - VERBOSE
Tactic: 0 Time: 0.050333
TRT - VERBOSE
Fastest Tactic: 0 Time: 0.050333
TRT - VERBOSE
*************** Autotuning Reformat: Float(E1,E1,1,E0,(# 2 (SHAPE score_map))) where E0=(* 2 (# 2 (SHAPE score_map))) E1=(* (# 3 (SHAPE score_map)) E0) -> Float(E1,E1,E0:32,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* E0 (CEIL_DIV (# 2 (SHAPE score_map)) 32)) ***************
TRT - VERBOSE
--------------- Timing Runner: Optimizer Reformat(49 -> <out>) (Reformat)
TRT - VERBOSE
Tactic: 1000 Time: 0.134596
TRT - VERBOSE
Tactic: 1002 Time: 0.0528274
TRT - VERBOSE
Tactic: 0 Time: 0.136331
TRT - VERBOSE
Fastest Tactic: 1002 Time: 0.0528274
TRT - VERBOSE
*************** Autotuning Reformat: Float(E1,E1,1,E0,(# 2 (SHAPE score_map))) where E0=(* 2 (# 2 (SHAPE score_map))) E1=(* (# 3 (SHAPE score_map)) E0) -> Float((* (# 2 (SHAPE score_map)) E0),1:4,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
--------------- Timing Runner: Optimizer Reformat(49 -> <out>) (Reformat)
TRT - VERBOSE
Tactic: 1000 Time: 0.512363
TRT - VERBOSE
Tactic: 1002 Time: 0.144622
TRT - VERBOSE
Tactic: 0 Time: 0.195088
TRT - VERBOSE
Fastest Tactic: 1002 Time: 0.144622
TRT - VERBOSE
*************** Autotuning Reformat: Float(E1,E1,E0:32,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* E0 (CEIL_DIV (# 2 (SHAPE score_map)) 32)) -> Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* (# 2 (SHAPE score_map)) E0) ***************
TRT - VERBOSE
--------------- Timing Runner: Optimizer Reformat(49 -> <out>) (Reformat)
TRT - VERBOSE
Tactic: 1000 Time: 0.0478095
TRT - VERBOSE
Tactic: 1002 Time: 0.0561493
TRT - VERBOSE
Tactic: 0 Time: 0.0516069
TRT - VERBOSE
Fastest Tactic: 1000 Time: 0.0478095
TRT - VERBOSE
*************** Autotuning Reformat: Float(E1,E1,E0:32,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* E0 (CEIL_DIV (# 2 (SHAPE score_map)) 32)) -> Float(E1,E1,1,E0,(# 2 (SHAPE score_map))) where E0=(* 2 (# 2 (SHAPE score_map))) E1=(* (# 3 (SHAPE score_map)) E0) ***************
TRT - VERBOSE
--------------- Timing Runner: Optimizer Reformat(49 -> <out>) (Reformat)
TRT - VERBOSE
Tactic: 1000 Time: 0.0391076
TRT - VERBOSE
Tactic: 1002 Time: 0.0759445
TRT - VERBOSE
Tactic: 0 Time: 0.0392332
TRT - VERBOSE
Fastest Tactic: 1000 Time: 0.0391076
TRT - VERBOSE
*************** Autotuning Reformat: Float(E1,E1,E0:32,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* E0 (CEIL_DIV (# 2 (SHAPE score_map)) 32)) -> Float((* (# 2 (SHAPE score_map)) E0),1:4,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
--------------- Timing Runner: Optimizer Reformat(49 -> <out>) (Reformat)
TRT - VERBOSE
Tactic: 1000 Time: 0.194613
TRT - VERBOSE
Tactic: 1002 Time: 0.166768
TRT - VERBOSE
Tactic: 0 Time: 0.196347
TRT - VERBOSE
Fastest Tactic: 1002 Time: 0.166768
TRT - VERBOSE
*************** Autotuning Reformat: Float((* (# 2 (SHAPE score_map)) E0),1:4,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) -> Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* (# 2 (SHAPE score_map)) E0) ***************
TRT - VERBOSE
--------------- Timing Runner: Optimizer Reformat(49 -> <out>) (Reformat)
TRT - VERBOSE
Tactic: 1000 Time: 0.070336
TRT - VERBOSE
Tactic: 1002 Time: 10.4925
TRT - VERBOSE
Tactic: 0 Time: 0.0688192
TRT - VERBOSE
Fastest Tactic: 0 Time: 0.0688192
TRT - VERBOSE
*************** Autotuning Reformat: Float((* (# 2 (SHAPE score_map)) E0),1:4,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) -> Float(E1,E1,1,E0,(# 2 (SHAPE score_map))) where E0=(* 2 (# 2 (SHAPE score_map))) E1=(* (# 3 (SHAPE score_map)) E0) ***************
TRT - VERBOSE
--------------- Timing Runner: Optimizer Reformat(49 -> <out>) (Reformat)
TRT - VERBOSE
Tactic: 1000 Time: 0.14443
TRT - VERBOSE
Tactic: 1002 Time: 2.15411
TRT - VERBOSE
Tactic: 0 Time: 0.158201
TRT - VERBOSE
Fastest Tactic: 1000 Time: 0.14443
TRT - VERBOSE
*************** Autotuning Reformat: Float((* (# 2 (SHAPE score_map)) E0),1:4,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) -> Float(E1,E1,E0:32,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* E0 (CEIL_DIV (# 2 (SHAPE score_map)) 32)) ***************
TRT - VERBOSE
--------------- Timing Runner: Optimizer Reformat(49 -> <out>) (Reformat)
TRT - VERBOSE
Tactic: 1000 Time: 0.142592
TRT - VERBOSE
Tactic: 1002 Time: 1.89853
TRT - VERBOSE
Tactic: 0 Time: 0.132996
TRT - VERBOSE
Fastest Tactic: 0 Time: 0.132996
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
*************** Autotuning Reformat: Float(E1,E1,1,E0,(# 2 (SHAPE score_map))) where E0=(* 2 (# 2 (SHAPE score_map))) E1=(* (# 3 (SHAPE score_map)) E0) -> Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* (# 2 (SHAPE score_map)) E0) ***************
TRT - VERBOSE
*************** Autotuning Reformat: Float(E1,E1,E0:32,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* E0 (CEIL_DIV (# 2 (SHAPE score_map)) 32)) -> Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* (# 2 (SHAPE score_map)) E0) ***************
TRT - VERBOSE
*************** Autotuning Reformat: Float((* (# 2 (SHAPE score_map)) E0),1:4,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) -> Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* (# 2 (SHAPE score_map)) E0) ***************
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing reformatting costs
TRT - VERBOSE
=============== Computing costs for 
TRT - VERBOSE
*************** Autotuning format combination:  -> Int32(1), Int32(1), Int32(1), Int32(1), Int32(), Int32(), Int32(1), Int32(), Int32(), Int32(), Int32(), Int32() ***************
TRT - VERBOSE
--------------- Timing Runner: [HostToDeviceCopy] (ShapeHostToDevice)
TRT - VERBOSE
Tactic: 0 Time: 0.222748
TRT - VERBOSE
Fastest Tactic: 0 Time: 0.222748
TRT - VERBOSE
>>>>>>>>>>>>>>> Chose Runner Type: ShapeHostToDevice Tactic: 0
TRT - VERBOSE
=============== Computing costs for 
TRT - VERBOSE
*************** Autotuning format combination: Float(E0,E0,(# 3 (SHAPE score_map)),1) -> Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
--------------- Timing Runner: Conv_10 (CudaDepthwiseConvolution)
TRT - VERBOSE
Tactic: -1 Time: 0.295259
TRT - VERBOSE
Fastest Tactic: -1 Time: 0.295259
TRT - VERBOSE
--------------- Timing Runner: Conv_10 (FusedConvActConvolution)
TRT - VERBOSE
FusedConvActConvolution has no valid tactics for this config, skipping
TRT - VERBOSE
--------------- Timing Runner: Conv_10 (CudnnConvolution)
TRT - VERBOSE
Tactic: 0 Time: 0.0730795
TRT - VERBOSE
Tactic: 1 Time: 0.0855387
TRT - VERBOSE
Tactic: 2 Time: 0.0686528
TRT - VERBOSE
Tactic: 5 Time: 7.97111
TRT - VERBOSE
Tactic: 6 Time: 0.576832
TRT - VERBOSE
Tactic: 56 Time: 0.0819435
TRT - VERBOSE
Tactic: 57 Time: 0.103051
TRT - VERBOSE
Tactic: 58 Time: 0.076672
TRT - VERBOSE
Tactic: 61 Time: 6.19137
TRT - VERBOSE
Tactic: 62 Time: 0.54832
TRT - VERBOSE
Fastest Tactic: 2 Time: 0.0686528
TRT - VERBOSE
--------------- Timing Runner: Conv_10 (CaskConvolution)
TRT - VERBOSE
Conv_10 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 1825138533642645384
TRT - VERBOSE
Tactic: 1825138533642645384 Time: 1.10336
TRT - VERBOSE
Conv_10 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 2775507031594384867
TRT - VERBOSE
Tactic: 2775507031594384867 Time: 0.540715
TRT - VERBOSE
Conv_10 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 2842488832350522458
TRT - VERBOSE
Tactic: 2842488832350522458 Time: 0.699851
TRT - VERBOSE
Conv_10 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 3915320020053085238
TRT - VERBOSE
Tactic: 3915320020053085238 Time: 0.946069
TRT - VERBOSE
Conv_10 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6448355332020552203
TRT - VERBOSE
Tactic: 6448355332020552203 Time: 2.30041
TRT - VERBOSE
Conv_10 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 6808617066150061604
TRT - VERBOSE
Tactic: 6808617066150061604 Time: 0.439851
TRT - VERBOSE
Conv_10 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 7112028071825297333
TRT - VERBOSE
Tactic: 7112028071825297333 Time: 0.791563
TRT - VERBOSE
Conv_10 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -8260616955872214327
TRT - VERBOSE
Tactic: -8260616955872214327 Time: 0.909824
TRT - VERBOSE
Conv_10 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: -8060443123034038864
TRT - VERBOSE
Tactic: -8060443123034038864 Time: 0.949472
TRT - VERBOSE
Conv_10 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -7808934563993503242
TRT - VERBOSE
Tactic: -7808934563993503242 Time: 1.01161
TRT - VERBOSE
Conv_10 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: -7399595116518866726
TRT - VERBOSE
Tactic: -7399595116518866726 Time: 1.05359
TRT - VERBOSE
Conv_10 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: -6032156791870386903
TRT - VERBOSE
Tactic: -6032156791870386903 Time: 1.97958
TRT - VERBOSE
Conv_10 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -5300316330015236453
TRT - VERBOSE
Tactic: -5300316330015236453 Time: 1.88756
TRT - VERBOSE
Conv_10 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: -4420849921117327522
TRT - VERBOSE
Tactic: -4420849921117327522 Time: 0.268379
TRT - VERBOSE
Conv_10 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: -3946921629105938337
TRT - VERBOSE
Tactic: -3946921629105938337 Time: 0.219712
TRT - VERBOSE
Conv_10 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -3372194142731681310
TRT - VERBOSE
Tactic: -3372194142731681310 Time: 2.91796
TRT - VERBOSE
Conv_10 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: -3266761471688279028
TRT - VERBOSE
Tactic: -3266761471688279028 Time: 3.95314
TRT - VERBOSE
Conv_10 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -2014454614304588418
TRT - VERBOSE
Tactic: -2014454614304588418 Time: 1.56301
TRT - VERBOSE
Fastest Tactic: -3946921629105938337 Time: 0.219712
TRT - VERBOSE
>>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 2
TRT - VERBOSE
*************** Autotuning format combination: Float(E0,1,(# 3 (SHAPE score_map)),1) -> Float(E0,1,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
--------------- Timing Runner: Conv_10 (CaskConvolution)
TRT - VERBOSE
Conv_10 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 308376988672755034
TRT - VERBOSE
Tactic: 308376988672755034 Time: 3.79968
TRT - VERBOSE
Conv_10 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 2708141271742803548
TRT - VERBOSE
Tactic: 2708141271742803548 Time: 1.48135
TRT - VERBOSE
Conv_10 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 4520000145959178064
TRT - VERBOSE
Tactic: 4520000145959178064 Time: 1.61986
TRT - VERBOSE
Conv_10 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 4842296060514715507
TRT - VERBOSE
Tactic: 4842296060514715507 Time: 2.32868
TRT - VERBOSE
Conv_10 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 7413808577096720414
TRT - VERBOSE
Tactic: 7413808577096720414 Time: 2.78583
TRT - VERBOSE
Conv_10 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: -7620740186990306432
TRT - VERBOSE
Tactic: -7620740186990306432 Time: 1.46014
TRT - VERBOSE
Conv_10 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -5678362885511651227
TRT - VERBOSE
Tactic: -5678362885511651227 Time: 1.73523
TRT - VERBOSE
Conv_10 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -2431551186657551688
TRT - VERBOSE
Tactic: -2431551186657551688 Time: 2.93042
TRT - VERBOSE
Fastest Tactic: -7620740186990306432 Time: 1.46014
TRT - VERBOSE
>>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7620740186990306432
TRT - VERBOSE
=============== Computing costs for 
TRT - VERBOSE
*************** Autotuning format combination: Float(E0,E0,(# 3 (SHAPE score_map)),1) -> Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
*************** Autotuning format combination: Float(E0,1,(# 3 (SHAPE score_map)),1) -> Float(E0,1,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
=============== Computing costs for 
TRT - VERBOSE
*************** Autotuning format combination: Float(E0,E0,(# 3 (SHAPE score_map)),1) -> Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
*************** Autotuning format combination: Float(E0,1,(# 3 (SHAPE score_map)),1) -> Float(E0,1,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
=============== Computing costs for 
TRT - VERBOSE
*************** Autotuning format combination: Float(E0,E0,(# 3 (SHAPE score_map)),1) -> Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
*************** Autotuning format combination: Float(E0,1,(# 3 (SHAPE score_map)),1) -> Float(E0,1,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
=============== Computing costs for 
TRT - VERBOSE
*************** Autotuning format combination: Float(E0,E0,(# 3 (SHAPE score_map)),1) -> Float(E0,E0,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
*************** Autotuning format combination: Float(E0,1,(# 3 (SHAPE score_map)),1) -> Float(E0,1,(# 3 (SHAPE score_map)),1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) ***************
TRT - VERBOSE
=============== Computing costs for 
TRT - VERBOSE
*************** Autotuning format combination: Float(E0,E0,(# 3 (SHAPE score_map)),1), Float(E0,E0,(# 3 (SHAPE score_map)),1), Float(E0,E0,(# 3 (SHAPE score_map)),1), Float(E0,E0,(# 3 (SHAPE score_map)),1), Float(E0,E0,(# 3 (SHAPE score_map)),1), Int32(), Int32() -> Float(E2,E2,E1,2,1) where E0=(* (# 2 (SHAPE score_map)) (# 3 (SHAPE score_map))) E1=(* 2 (# 3 (SHAPE score_map))) E2=(* (# 2 (SHAPE score_map)) E1) ***************
TRT - VERBOSE
--------------- Timing Runner: {ForeignNode[19 + (Unnamed Layer* 29) [Shuffle]...Concat_45]} (Myelin)
TRT - WARNING
Myelin graph with multiple dynamic values may have poor performance if they differ. Dynamic values are: 
TRT - WARNING
 (# 3 (SHAPE score_map))
TRT - WARNING
 (# 2 (SHAPE score_map))
TRT - VERBOSE
Tactic: 0 Time: 0.643371
TRT - VERBOSE
Fastest Tactic: 0 Time: 0.643371
TRT - VERBOSE
>>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0
TRT - VERBOSE
=============== Computing costs for 
TRT - VERBOSE
*************** Autotuning format combination: Float((* 128 E0),E0,(# 3 (SHAPE dense_feat_map)),1) -> Float(128,1) where E0=(* (# 2 (SHAPE dense_feat_map)) (# 3 (SHAPE dense_feat_map))) ***************
TRT - VERBOSE
--------------- Timing Runner: Transpose_242 + Flatten_243 (Shuffle)
TRT - VERBOSE
Tactic: 0 Time: 0.198629
TRT - VERBOSE
Tactic: 1 Time: 0.208704
TRT - VERBOSE
Fastest Tactic: 0 Time: 0.198629
TRT - VERBOSE
>>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
TRT - VERBOSE
=============== Computing costs for 
TRT - VERBOSE
*************** Autotuning format combination: Float((# 1 (SHAPE keypoints)),1) -> Float(1,1) ***************
TRT - VERBOSE
--------------- Timing Runner: Transpose_91 (Shuffle)
TRT - VERBOSE
Tactic: 0 Time: 0.018989
TRT - VERBOSE
Tactic: 1 Time: 0.0357259
TRT - VERBOSE
Fastest Tactic: 0 Time: 0.018989
TRT - VERBOSE
>>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
TRT - VERBOSE
=============== Computing costs for 
TRT - VERBOSE
*************** Autotuning format combination: Float(E1,E1,E0,2,1) -> Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* (# 2 (SHAPE score_map)) E0) ***************
TRT - VERBOSE
--------------- Timing Runner: PWN(Clip_46) (PointWiseV2)
TRT - VERBOSE
Tactic: 0 Time: 0.0311447
TRT - VERBOSE
Tactic: 1 Time: 0.0324354
TRT - VERBOSE
Tactic: 2 Time: 0.0301289
TRT - VERBOSE
Tactic: 3 Time: 0.031167
TRT - VERBOSE
Tactic: 4 Time: 0.046804
TRT - VERBOSE
Tactic: 5 Time: 0.0487314
TRT - VERBOSE
Tactic: 6 Time: 0.092408
TRT - VERBOSE
Tactic: 7 Time: 0.0914053
TRT - VERBOSE
Tactic: 8 Time: 0.08924
TRT - VERBOSE
Tactic: 9 Time: 0.0935253
TRT - VERBOSE
Tactic: 28 Time: 0.102013
TRT - VERBOSE
Fastest Tactic: 2 Time: 0.0301289
TRT - VERBOSE
--------------- Timing Runner: PWN(Clip_46) (PointWise)
TRT - VERBOSE
PointWise has no valid tactics for this config, skipping
TRT - VERBOSE
>>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2
TRT - VERBOSE
*************** Autotuning format combination: Float(E1,E1,1,E0,(# 2 (SHAPE score_map))) -> Float(E1,E1,1,E0,(# 2 (SHAPE score_map))) where E0=(* 2 (# 2 (SHAPE score_map))) E1=(* (# 3 (SHAPE score_map)) E0) ***************
TRT - VERBOSE
--------------- Timing Runner: PWN(Clip_46) (PointWiseV2)
TRT - VERBOSE
Tactic: 0 Time: 0.104384
TRT - VERBOSE
Tactic: 1 Time: 0.0918293
TRT - VERBOSE
Tactic: 2 Time: 0.0904107
TRT - VERBOSE
Tactic: 3 Time: 0.0921867
TRT - VERBOSE
Tactic: 4 Time: 0.0900613
TRT - VERBOSE
Tactic: 5 Time: 0.0942533
TRT - VERBOSE
Tactic: 6 Time: 0.0921493
TRT - VERBOSE
Tactic: 7 Time: 0.091704
TRT - VERBOSE
Tactic: 8 Time: 0.0899893
TRT - VERBOSE
Tactic: 9 Time: 0.0938907
TRT - VERBOSE
Tactic: 28 Time: 0.101867
TRT - VERBOSE
Fastest Tactic: 8 Time: 0.0899893
TRT - VERBOSE
--------------- Timing Runner: PWN(Clip_46) (PointWise)
TRT - VERBOSE
PointWise has no valid tactics for this config, skipping
TRT - VERBOSE
>>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8
TRT - VERBOSE
*************** Autotuning format combination: Float(E1,E1,E0:32,2,1) -> Float(E1,E1,E0:32,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* E0 (CEIL_DIV (# 2 (SHAPE score_map)) 32)) ***************
TRT - VERBOSE
--------------- Timing Runner: PWN(Clip_46) (PointWiseV2)
TRT - VERBOSE
Tactic: 24 Time: 0.0620747
TRT - VERBOSE
Tactic: 25 Time: 0.0622702
TRT - VERBOSE
Tactic: 26 Time: 0.0615058
TRT - VERBOSE
Tactic: 27 Time: 0.0626524
TRT - VERBOSE
Tactic: 31 Time: 0.0611876
TRT - VERBOSE
Fastest Tactic: 31 Time: 0.0611876
TRT - VERBOSE
--------------- Timing Runner: PWN(Clip_46) (PointWise)
TRT - VERBOSE
PointWise has no valid tactics for this config, skipping
TRT - VERBOSE
>>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31
TRT - VERBOSE
*************** Autotuning format combination: Float(E1,1:4,E0,2,1) -> Float(E1,1:4,E0,2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* (# 2 (SHAPE score_map)) E0) ***************
TRT - VERBOSE
--------------- Timing Runner: PWN(Clip_46) (PointWiseV2)
TRT - VERBOSE
Tactic: 0 Time: 3.14382
TRT - VERBOSE
Tactic: 1 Time: 4.50063
TRT - VERBOSE
Tactic: 2 Time: 6.53014
TRT - VERBOSE
Tactic: 3 Time: 4.88023
TRT - VERBOSE
Tactic: 4 Time: 4.14537
TRT - VERBOSE
Tactic: 5 Time: 4.08699
TRT - VERBOSE
Tactic: 6 Time: 11.004
TRT - VERBOSE
Tactic: 7 Time: 3.91247
TRT - VERBOSE
Tactic: 8 Time: 3.00592
TRT - VERBOSE
Tactic: 9 Time: 3.19711
TRT - VERBOSE
Tactic: 10 Time: 1.64896
TRT - VERBOSE
Tactic: 11 Time: 2.0549
TRT - VERBOSE
Tactic: 12 Time: 2.64913
TRT - VERBOSE
Tactic: 13 Time: 4.36375
TRT - VERBOSE
Tactic: 14 Time: 4.6258
TRT - VERBOSE
Tactic: 15 Time: 5.33683
TRT - VERBOSE
Tactic: 16 Time: 6.16471
TRT - VERBOSE
Tactic: 17 Time: 5.9871
TRT - VERBOSE
Tactic: 18 Time: 4.89937
TRT - VERBOSE
Tactic: 19 Time: 3.21713
TRT - VERBOSE
Tactic: 20 Time: 2.1019
TRT - VERBOSE
Tactic: 21 Time: 2.83508
TRT - VERBOSE
Tactic: 22 Time: 5.3218
TRT - VERBOSE
Tactic: 23 Time: 5.99543
TRT - VERBOSE
Tactic: 28 Time: 0.156935
TRT - VERBOSE
Tactic: 29 Time: 0.160228
TRT - VERBOSE
Tactic: 30 Time: 0.572107
TRT - VERBOSE
Fastest Tactic: 28 Time: 0.156935
TRT - VERBOSE
>>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28
TRT - VERBOSE
=============== Computing costs for 
TRT - VERBOSE
*************** Autotuning format combination: Float(E1,E1,E0,2,1) -> Float(2,1) where E0=(* 2 (# 3 (SHAPE score_map))) E1=(* (# 2 (SHAPE score_map)) E0) ***************
TRT - VERBOSE
--------------- Timing Runner: Transpose_60 + Flatten_61 (Shuffle)
TRT - VERBOSE
Tactic: 0 Time: 0.0858667
TRT - VERBOSE
Tactic: 1 Time: 0.367403
TRT - VERBOSE
Fastest Tactic: 0 Time: 0.0858667
TRT - VERBOSE
>>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
TRT - VERBOSE
=============== Computing costs for 
TRT - VERBOSE
*************** Autotuning format combination: Float(E0,2,1), Int32(1), Float(2,1), Int32(1), Int32(1), Int32(1), Float(128,1), Float(128,1), Float(128,1), Float(128,1), Int32(), Int32(), Int32() -> Float(E0,2,1), Float((* 128 (# 1 (SHAPE keypoints))),128,1) where E0=(* 2 (# 1 (SHAPE keypoints))) ***************
TRT - VERBOSE
--------------- Timing Runner: {ForeignNode[55...Div_261]} (Myelin)
TRT - WARNING
Myelin graph with multiple dynamic values may have poor performance if they differ. Dynamic values are: 
TRT - WARNING
 (# 2 (SHAPE dense_feat_map))
TRT - WARNING
 (# 3 (SHAPE score_map))
TRT - WARNING
 (# 3 (SHAPE dense_feat_map))
TRT - WARNING
 (# 2 (SHAPE score_map))
TRT - WARNING
 (# 1 (SHAPE keypoints))
TRT - WARNING
Skipping tactic 0 due to Myelin error: autotuning: CUDA error 2 allocating 0-byte buffer: out of memory
TRT - VERBOSE
Fastest Tactic: -3360065831133338131 Time: inf
TRT - VERBOSE
Deleting timing cache: 28 entries, served 24 hits since creation.
TRT - ERROR
10: [optimizer.cpp::computeCosts::3826] Error Code 10: Internal Error (Could not find any implementation for node {ForeignNode[55...Div_261]}.)
Completion model optimization
TRT model optimization ERROR