&&&& RUNNING TensorRT.trtexec [TensorRT v8410] # trtexec --onnx=./test_sim_modify.onnx --dumpProfile --profilingVerbosity=detailed --verbose
[07/07/2022-05:04:20] [I] === Model Options ===
[07/07/2022-05:04:20] [I] Format: ONNX
[07/07/2022-05:04:20] [I] Model: ./test_sim_modify.onnx
[07/07/2022-05:04:20] [I] Output:
[07/07/2022-05:04:20] [I] === Build Options ===
[07/07/2022-05:04:20] [I] Max batch: explicit batch
[07/07/2022-05:04:20] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
[07/07/2022-05:04:20] [I] minTiming: 1
[07/07/2022-05:04:20] [I] avgTiming: 8
[07/07/2022-05:04:20] [I] Precision: FP32
[07/07/2022-05:04:20] [I] LayerPrecisions: 
[07/07/2022-05:04:20] [I] Calibration: 
[07/07/2022-05:04:20] [I] Refit: Disabled
[07/07/2022-05:04:20] [I] Sparsity: Disabled
[07/07/2022-05:04:20] [I] Safe mode: Disabled
[07/07/2022-05:04:20] [I] DirectIO mode: Disabled
[07/07/2022-05:04:20] [I] Restricted mode: Disabled
[07/07/2022-05:04:20] [I] Build only: Disabled
[07/07/2022-05:04:20] [I] Save engine: 
[07/07/2022-05:04:20] [I] Load engine: 
[07/07/2022-05:04:20] [I] Profiling verbosity: 2
[07/07/2022-05:04:20] [I] Tactic sources: Using default tactic sources
[07/07/2022-05:04:20] [I] timingCacheMode: local
[07/07/2022-05:04:20] [I] timingCacheFile: 
[07/07/2022-05:04:20] [I] Input(s)s format: fp32:CHW
[07/07/2022-05:04:20] [I] Output(s)s format: fp32:CHW
[07/07/2022-05:04:20] [I] Input build shapes: model
[07/07/2022-05:04:20] [I] Input calibration shapes: model
[07/07/2022-05:04:20] [I] === System Options ===
[07/07/2022-05:04:20] [I] Device: 0
[07/07/2022-05:04:20] [I] DLACore: 
[07/07/2022-05:04:20] [I] Plugins:
[07/07/2022-05:04:20] [I] === Inference Options ===
[07/07/2022-05:04:20] [I] Batch: Explicit
[07/07/2022-05:04:20] [I] Input inference shapes: model
[07/07/2022-05:04:20] [I] Iterations: 10
[07/07/2022-05:04:20] [I] Duration: 3s (+ 200ms warm up)
[07/07/2022-05:04:20] [I] Sleep time: 0ms
[07/07/2022-05:04:20] [I] Idle time: 0ms
[07/07/2022-05:04:20] [I] Streams: 1
[07/07/2022-05:04:20] [I] ExposeDMA: Disabled
[07/07/2022-05:04:20] [I] Data transfers: Enabled
[07/07/2022-05:04:20] [I] Spin-wait: Disabled
[07/07/2022-05:04:20] [I] Multithreading: Disabled
[07/07/2022-05:04:20] [I] CUDA Graph: Disabled
[07/07/2022-05:04:20] [I] Separate profiling: Disabled
[07/07/2022-05:04:20] [I] Time Deserialize: Disabled
[07/07/2022-05:04:20] [I] Time Refit: Disabled
[07/07/2022-05:04:20] [I] Inputs:
[07/07/2022-05:04:20] [I] === Reporting Options ===
[07/07/2022-05:04:20] [I] Verbose: Enabled
[07/07/2022-05:04:20] [I] Averages: 10 inferences
[07/07/2022-05:04:20] [I] Percentile: 99
[07/07/2022-05:04:20] [I] Dump refittable layers:Disabled
[07/07/2022-05:04:20] [I] Dump output: Disabled
[07/07/2022-05:04:20] [I] Profile: Enabled
[07/07/2022-05:04:20] [I] Export timing to JSON file: 
[07/07/2022-05:04:20] [I] Export output to JSON file: 
[07/07/2022-05:04:20] [I] Export profile to JSON file: 
[07/07/2022-05:04:20] [I] 
[07/07/2022-05:04:20] [I] === Device Information ===
[07/07/2022-05:04:20] [I] Selected Device: Orin
[07/07/2022-05:04:20] [I] Compute Capability: 8.7
[07/07/2022-05:04:20] [I] SMs: 16
[07/07/2022-05:04:20] [I] Compute Clock Rate: 1.275 GHz
[07/07/2022-05:04:20] [I] Device Global Memory: 28904 MiB
[07/07/2022-05:04:20] [I] Shared Memory per SM: 164 KiB
[07/07/2022-05:04:20] [I] Memory Bus Width: 128 bits (ECC disabled)
[07/07/2022-05:04:20] [I] Memory Clock Rate: 1.275 GHz
[07/07/2022-05:04:20] [I] 
[07/07/2022-05:04:20] [I] TensorRT version: 8.4.10
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::Region_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::ScatterND version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::CropAndResize version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::EfficientNMS_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::EfficientNMS_Explicit_TF_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::EfficientNMS_Implicit_TF_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::Proposal version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::Split version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1
[07/07/2022-05:04:20] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 2
[07/07/2022-05:04:20] [I] [TRT] [MemUsageChange] Init CUDA: CPU +294, GPU +0, now: CPU 319, GPU 4543 (MiB)
[07/07/2022-05:04:21] [I] [TRT] [MemUsageSnapshot] Begin constructing builder kernel library: CPU 336 MiB, GPU 4561 MiB
[07/07/2022-05:04:22] [I] [TRT] [MemUsageSnapshot] End constructing builder kernel library: CPU 647 MiB, GPU 4855 MiB
[07/07/2022-05:04:22] [I] Start parsing network model
[07/07/2022-05:04:22] [I] [TRT] ----------------------------------------------------------------
[07/07/2022-05:04:22] [I] [TRT] Input filename:   ./test_sim_modify.onnx
[07/07/2022-05:04:22] [I] [TRT] ONNX IR version:  0.0.8
[07/07/2022-05:04:22] [I] [TRT] Opset version:    12
[07/07/2022-05:04:22] [I] [TRT] Producer name:    pytorch
[07/07/2022-05:04:22] [I] [TRT] Producer version: 1.10
[07/07/2022-05:04:22] [I] [TRT] Domain:           
[07/07/2022-05:04:22] [I] [TRT] Model version:    0
[07/07/2022-05:04:22] [I] [TRT] Doc string:       
[07/07/2022-05:04:22] [I] [TRT] ----------------------------------------------------------------
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::ScatterND version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::EfficientNMS_Explicit_TF_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::EfficientNMS_Implicit_TF_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::Proposal version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::Split version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1
[07/07/2022-05:04:22] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 2
[07/07/2022-05:04:22] [V] [TRT] Adding network input: x_lane with dtype: float32, dimensions: (32, 512, 20, 7)
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: x_lane for ONNX tensor: x_lane
[07/07/2022-05:04:22] [V] [TRT] Adding network input: mask_lane with dtype: float32, dimensions: (32, 512)
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: mask_lane for ONNX tensor: mask_lane
[07/07/2022-05:04:22] [V] [TRT] Adding network input: x_agent with dtype: float32, dimensions: (32, 128, 10, 14)
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: x_agent for ONNX tensor: x_agent
[07/07/2022-05:04:22] [V] [TRT] Adding network input: mask_agent with dtype: float32, dimensions: (32, 128)
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: mask_agent for ONNX tensor: mask_agent
[07/07/2022-05:04:22] [V] [TRT] Adding network input: target with dtype: float32, dimensions: (32, 4000, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: target for ONNX tensor: target
[07/07/2022-05:04:22] [V] [TRT] Adding network input: mask_target with dtype: float32, dimensions: (32, 4000)
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: mask_target for ONNX tensor: mask_target
[07/07/2022-05:04:22] [V] [TRT] Adding network input: hist_traj with dtype: float32, dimensions: (32, 11, 5)
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: hist_traj for ONNX tensor: hist_traj
[07/07/2022-05:04:22] [V] [TRT] Adding network input: hist_traj_gt with dtype: float32, dimensions: (32, 30, 5)
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: hist_traj_gt for ONNX tensor: hist_traj_gt
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2421
[07/07/2022-05:04:22] [W] [TRT] onnx2trt_utils.cpp:363: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2473
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2586
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 526
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2562
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 1040
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2622
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2443
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 476
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 521
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: fc0_target.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2550
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2439
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2440
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2441
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 206
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2491
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2492
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2493
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 373
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 480
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2589
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cg0.fc1.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2461
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2462
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2463
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2513
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2514
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2515
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 1175
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 1858
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 1177
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2469
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 551
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2521
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2523
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2522
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: fc0_lane.0.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2541
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 1613
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: fc0_agent.0.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cg0.fc1.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cg0.fc1.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2525
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2526
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2527
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: interaction.attn_layers.0.q_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: interaction.attn_layers.0.k_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: interaction.attn_layers.0.v_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2590
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2531
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cg0.fc1.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2545
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2546
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: interaction.attn_layers.0.out_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: interaction.attn_layers.0.layer_norm.weight
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: interaction.attn_layers.0.layer_norm.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2547
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2548
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2549
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: interaction.attn_layers.1.q_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: interaction.attn_layers.1.k_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: interaction.attn_layers.1.v_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2556
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: interaction.attn_layers.1.out_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: interaction.attn_layers.1.layer_norm.weight
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: interaction.attn_layers.1.layer_norm.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2558
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2559
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2566
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2567
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2568
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cross_attention.attn_layers.0.q_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cross_attention.attn_layers.0.k_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cross_attention.attn_layers.0.v_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2578
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2577
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cross_attention.attn_layers.1.v_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cross_attention.attn_layers.1.k_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 757
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2575
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cross_attention.attn_layers.0.out_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cross_attention.attn_layers.0.layer_norm.weight
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cross_attention.attn_layers.0.layer_norm.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2576
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cross_attention.attn_layers.1.q_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2585
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cross_attention.attn_layers.1.out_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cross_attention.attn_layers.1.layer_norm.weight
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cross_attention.attn_layers.1.layer_norm.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: norm0_cross.weight
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: norm0_cross.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2587
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 1745
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cg0.fc0.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2394
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2601
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2392
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: fuse_path.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2397
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cg0.fc0.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cg0.fc0.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: fuse_path.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2588
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: fuse_path.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cg0.fc0.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 925
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2592
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2602
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cg1.fc0.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: fuse_path.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: pathNet.decoder.fc1.weight
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: pathNet.decoder.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cg1.fc0.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cg0.norm.weight
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cg1.fc0.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cg0.norm.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2593
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2594
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: pathNet.decoder.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cg1.fc0.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cg1.fc1.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: pathNet.decoder.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: pathNet.decoder.fc2.weight
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: pathNet.decoder.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: pathNet.out.weight
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: pathNet.out.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 1599
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 1606
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cg1.fc1.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cg1.fc1.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 1621
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2595
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 1680
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cg1.fc1.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 1701
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cg1.norm.weight
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: cg1.norm.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2597
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: targetNet.mlp.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: targetNet.mlp.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: targetNet.mlp.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2598
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: targetNet.mlp.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 1016
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 1021
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 1022
[07/07/2022-05:04:22] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647
[07/07/2022-05:04:22] [W] [TRT] onnx2trt_utils.cpp:391: One or more weights outside the range of INT32 was clamped
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 1030
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2607
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2304
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2363
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2384
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2524
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2399
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: scoreNet.mlp.fc1.weight
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: scoreNet.mlp.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: scoreNet.mlp.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: scoreNet.mlp.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: scoreNet.mlp.fc2.weight
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: scoreNet.mlp.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Importing initializer: 2416
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_0 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: x_lane
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2421
[07/07/2022-05:04:22] [V] [TRT] Reshape_0 [Reshape] inputs: [x_lane -> (32, 512, 20, 7)[FLOAT]], [2421 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_0 for ONNX node: Reshape_0
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 134 for ONNX tensor: 134
[07/07/2022-05:04:22] [V] [TRT] Reshape_0 [Reshape] outputs: [134 -> (16384, 20, 7)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_26 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: x_agent
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2473
[07/07/2022-05:04:22] [V] [TRT] Reshape_26 [Reshape] inputs: [x_agent -> (32, 128, 10, 14)[FLOAT]], [2473 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_26 for ONNX node: Reshape_26
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 301 for ONNX tensor: 301
[07/07/2022-05:04:22] [V] [TRT] Reshape_26 [Reshape] outputs: [301 -> (4096, 10, 14)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Concat_59 [Concat]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: mask_agent
[07/07/2022-05:04:22] [V] [TRT] Searching for input: mask_lane
[07/07/2022-05:04:22] [V] [TRT] Concat_59 [Concat] inputs: [mask_agent -> (32, 128)[FLOAT]], [mask_lane -> (32, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Concat_59 for ONNX node: Concat_59
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 470 for ONNX tensor: 470
[07/07/2022-05:04:22] [V] [TRT] Concat_59 [Concat] outputs: [470 -> (32, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_195 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: mask_lane
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_195 [Unsqueeze] inputs: [mask_lane -> (32, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (32, 512), unsqueezing to: (32, 1, 512)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_195 for ONNX node: Unsqueeze_195
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 673 for ONNX tensor: 673
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_195 [Unsqueeze] outputs: [673 -> (32, 1, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_367 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: target
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2586
[07/07/2022-05:04:22] [V] [TRT] MatMul_367 [MatMul] inputs: [target -> (32, 4000, 4)[FLOAT]], [2586 -> (4, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2586 for ONNX node: 2586
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_367 for ONNX node: MatMul_367
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 879 for ONNX tensor: 879
[07/07/2022-05:04:22] [V] [TRT] MatMul_367 [MatMul] outputs: [879 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Equal_503 [Equal]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: mask_target
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 526
[07/07/2022-05:04:22] [V] [TRT] Equal_503 [Equal] inputs: [mask_target -> (32, 4000)[FLOAT]], [526 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 526 for ONNX node: 526
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Equal_503 for ONNX node: Equal_503
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1028 for ONNX tensor: 1028
[07/07/2022-05:04:22] [V] [TRT] Equal_503 [Equal] outputs: [1028 -> (32, 4000)[BOOL]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Slice_517 [Slice]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: hist_traj_gt
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2562
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1040
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2622
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2443
[07/07/2022-05:04:22] [V] [TRT] Slice_517 [Slice] inputs: [hist_traj_gt -> (32, 30, 5)[FLOAT]], [2562 -> (1)[INT32]], [1040 -> (1)[INT32]], [2622 -> (1)[INT32]], [2443 -> (1)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Slice_517 for ONNX node: Slice_517
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1042 for ONNX tensor: 1042
[07/07/2022-05:04:22] [V] [TRT] Slice_517 [Slice] outputs: [1042 -> (32, 30, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Gather_523 [Gather]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: hist_traj
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 476
[07/07/2022-05:04:22] [V] [TRT] Gather_523 [Gather] inputs: [hist_traj -> (32, 11, 5)[FLOAT]], [476 -> ()[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 476 for ONNX node: 476
[07/07/2022-05:04:22] [V] [TRT] Using Gather axis: 1
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Gather_523 for ONNX node: Gather_523
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1049 for ONNX tensor: 1049
[07/07/2022-05:04:22] [V] [TRT] Gather_523 [Gather] outputs: [1049 -> (32, 5)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Gather_1119 [Gather]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: hist_traj
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 476
[07/07/2022-05:04:22] [V] [TRT] Gather_1119 [Gather] inputs: [hist_traj -> (32, 11, 5)[FLOAT]], [476 -> ()[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Using Gather axis: 1
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Gather_1119 for ONNX node: Gather_1119
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1732 for ONNX tensor: 1732
[07/07/2022-05:04:22] [V] [TRT] Gather_1119 [Gather] outputs: [1732 -> (32, 5)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_1 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 134
[07/07/2022-05:04:22] [V] [TRT] Transpose_1 [Transpose] inputs: [134 -> (16384, 20, 7)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_1 for ONNX node: Transpose_1
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 135 for ONNX tensor: 135
[07/07/2022-05:04:22] [V] [TRT] Transpose_1 [Transpose] outputs: [135 -> (20, 16384, 7)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_27 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 301
[07/07/2022-05:04:22] [V] [TRT] Transpose_27 [Transpose] inputs: [301 -> (4096, 10, 14)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_27 for ONNX node: Transpose_27
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 302 for ONNX tensor: 302
[07/07/2022-05:04:22] [V] [TRT] Transpose_27 [Transpose] outputs: [302 -> (10, 4096, 14)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_61 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 470
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_61 [Unsqueeze] inputs: [470 -> (32, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (32, 640), unsqueezing to: (32, 1, 640)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_61 for ONNX node: Unsqueeze_61
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 472 for ONNX tensor: 472
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_61 [Unsqueeze] outputs: [472 -> (32, 1, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_203 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 673
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 521
[07/07/2022-05:04:22] [V] [TRT] Expand_203 [Expand] inputs: [673 -> (32, 1, 512)[FLOAT]], [521 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_203 for ONNX node: Expand_203
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 682 for ONNX tensor: 682
[07/07/2022-05:04:22] [V] [TRT] Expand_203 [Expand] outputs: [682 -> (32, 1, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_368 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: fc0_target.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 879
[07/07/2022-05:04:22] [V] [TRT] Add_368 [Add] inputs: [fc0_target.bias -> (64)[FLOAT]], [879 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: fc0_target.bias for ONNX node: fc0_target.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_368 for ONNX node: Add_368
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 880 for ONNX tensor: 880
[07/07/2022-05:04:22] [V] [TRT] Add_368 [Add] outputs: [880 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Gather_519 [Gather]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1042
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2550
[07/07/2022-05:04:22] [V] [TRT] Gather_519 [Gather] inputs: [1042 -> (32, 30, 4)[FLOAT]], [2550 -> (1)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2550 for ONNX node: 2550
[07/07/2022-05:04:22] [V] [TRT] Using Gather axis: 1
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Gather_519 for ONNX node: Gather_519
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1044 for ONNX tensor: 1044
[07/07/2022-05:04:22] [V] [TRT] Gather_519 [Gather] outputs: [1044 -> (32, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Slice_528 [Slice]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1049
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2562
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1040
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2443
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2443
[07/07/2022-05:04:22] [V] [TRT] Slice_528 [Slice] inputs: [1049 -> (32, 5)[FLOAT]], [2562 -> (1)[INT32]], [1040 -> (1)[INT32]], [2443 -> (1)[INT32]], [2443 -> (1)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Slice_528 for ONNX node: Slice_528
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1054 for ONNX tensor: 1054
[07/07/2022-05:04:22] [V] [TRT] Slice_528 [Slice] outputs: [1054 -> (32, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Slice_1124 [Slice]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1732
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2562
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1040
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2443
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2443
[07/07/2022-05:04:22] [V] [TRT] Slice_1124 [Slice] inputs: [1732 -> (32, 5)[FLOAT]], [2562 -> (1)[INT32]], [1040 -> (1)[INT32]], [2443 -> (1)[INT32]], [2443 -> (1)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Slice_1124 for ONNX node: Slice_1124
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1737 for ONNX tensor: 1737
[07/07/2022-05:04:22] [V] [TRT] Slice_1124 [Slice] outputs: [1737 -> (32, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: GRU_9 [GRU]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 135
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2439
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2440
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2441
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 206
[07/07/2022-05:04:22] [V] [TRT] GRU_9 [GRU] inputs: [135 -> (20, 16384, 7)[FLOAT]], [2439 -> (1, 192, 7)[FLOAT]], [2440 -> (1, 192, 64)[FLOAT]], [2441 -> (1, 384)[FLOAT]], [optional input, not set], [206 -> (1, 16384, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2439 for ONNX node: 2439
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2440 for ONNX node: 2440
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Weights for ZR gates shape is: (1, 128, 7)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Weights for H gate shape is: (1, 64, 7)
[07/07/2022-05:04:22] [V] [TRT] Recurrence weights for ZR gates shape is: (1, 128, 64)
[07/07/2022-05:04:22] [V] [TRT] Recurrence weights for H gate shape is: (1, 64, 64)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2441 for ONNX node: 2441
[07/07/2022-05:04:22] [V] [TRT] Bias for ZR gates shape is: (1, 1, 128)
[07/07/2022-05:04:22] [V] [TRT] Bias for H gate shape is: (1, 1, 64)
[07/07/2022-05:04:22] [V] [TRT] Recurrence bias for ZR gates shape is: (1, 1, 128)
[07/07/2022-05:04:22] [V] [TRT] Recurrence bias for H gate shape is: (1, 1, 64)
[07/07/2022-05:04:22] [V] [TRT] numDirections is: 1, numDirections Tensor shape: (1)
[07/07/2022-05:04:22] [V] [TRT] hiddenSize is: 64, hiddenSizeTensor shape: (1)
[07/07/2022-05:04:22] [V] [TRT] batchSizeTensor shape: (1)
[07/07/2022-05:04:22] [V] [TRT] Gate output rank (equal to initial hidden/cell state rank): (3)
[07/07/2022-05:04:22] [V] [TRT] Entering Loop
[07/07/2022-05:04:22] [V] [TRT] Original shape: (16384, 7), unsqueezing to: (1, 16384, 7)
[07/07/2022-05:04:22] [V] [TRT] Input shape: (1, 16384, 7)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 206 for ONNX node: 206
[07/07/2022-05:04:22] [V] [TRT] Initial hidden state shape: (1, 16384, 64)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: GRU_9 for ONNX node: GRU_9
[07/07/2022-05:04:22] [V] [TRT] Hidden state shape: (1, 16384, 64)
[07/07/2022-05:04:22] [V] [TRT] X(t) * W[zr]^T -> (1, 16384, 128)
[07/07/2022-05:04:22] [V] [TRT] H(t-1) * R[zr]^T -> (1, 16384, 128)
[07/07/2022-05:04:22] [V] [TRT] stackedZR(t) -> (1, 16384, 128)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] z(t) -> (1, 16384, 64)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] r(t) -> (1, 16384, 64)
[07/07/2022-05:04:22] [V] [TRT] h(t) -> (1, 16384, 64)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] H(t) -> (1, 16384, 64)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 207 for ONNX tensor: 207
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 208 for ONNX tensor: 208
[07/07/2022-05:04:22] [V] [TRT] GRU_9 [GRU] outputs: [207 -> (20, 1, 16384, 64)[FLOAT]], [208 -> (1, 16384, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: GRU_35 [GRU]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 302
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2491
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2492
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2493
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 373
[07/07/2022-05:04:22] [V] [TRT] GRU_35 [GRU] inputs: [302 -> (10, 4096, 14)[FLOAT]], [2491 -> (1, 192, 14)[FLOAT]], [2492 -> (1, 192, 64)[FLOAT]], [2493 -> (1, 384)[FLOAT]], [optional input, not set], [373 -> (1, 4096, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2491 for ONNX node: 2491
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2492 for ONNX node: 2492
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Weights for ZR gates shape is: (1, 128, 14)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Weights for H gate shape is: (1, 64, 14)
[07/07/2022-05:04:22] [V] [TRT] Recurrence weights for ZR gates shape is: (1, 128, 64)
[07/07/2022-05:04:22] [V] [TRT] Recurrence weights for H gate shape is: (1, 64, 64)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2493 for ONNX node: 2493
[07/07/2022-05:04:22] [V] [TRT] Bias for ZR gates shape is: (1, 1, 128)
[07/07/2022-05:04:22] [V] [TRT] Bias for H gate shape is: (1, 1, 64)
[07/07/2022-05:04:22] [V] [TRT] Recurrence bias for ZR gates shape is: (1, 1, 128)
[07/07/2022-05:04:22] [V] [TRT] Recurrence bias for H gate shape is: (1, 1, 64)
[07/07/2022-05:04:22] [V] [TRT] numDirections is: 1, numDirections Tensor shape: (1)
[07/07/2022-05:04:22] [V] [TRT] hiddenSize is: 64, hiddenSizeTensor shape: (1)
[07/07/2022-05:04:22] [V] [TRT] batchSizeTensor shape: (1)
[07/07/2022-05:04:22] [V] [TRT] Gate output rank (equal to initial hidden/cell state rank): (3)
[07/07/2022-05:04:22] [V] [TRT] Entering Loop
[07/07/2022-05:04:22] [V] [TRT] Original shape: (4096, 14), unsqueezing to: (1, 4096, 14)
[07/07/2022-05:04:22] [V] [TRT] Input shape: (1, 4096, 14)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 373 for ONNX node: 373
[07/07/2022-05:04:22] [V] [TRT] Initial hidden state shape: (1, 4096, 64)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: GRU_35 for ONNX node: GRU_35
[07/07/2022-05:04:22] [V] [TRT] Hidden state shape: (1, 4096, 64)
[07/07/2022-05:04:22] [V] [TRT] X(t) * W[zr]^T -> (1, 4096, 128)
[07/07/2022-05:04:22] [V] [TRT] H(t-1) * R[zr]^T -> (1, 4096, 128)
[07/07/2022-05:04:22] [V] [TRT] stackedZR(t) -> (1, 4096, 128)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] z(t) -> (1, 4096, 64)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] r(t) -> (1, 4096, 64)
[07/07/2022-05:04:22] [V] [TRT] h(t) -> (1, 4096, 64)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] H(t) -> (1, 4096, 64)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 374 for ONNX tensor: 374
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 375 for ONNX tensor: 375
[07/07/2022-05:04:22] [V] [TRT] GRU_35 [GRU] outputs: [374 -> (10, 1, 4096, 64)[FLOAT]], [375 -> (1, 4096, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_69 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 472
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 480
[07/07/2022-05:04:22] [V] [TRT] Expand_69 [Expand] inputs: [472 -> (32, 1, 640)[FLOAT]], [480 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_69 for ONNX node: Expand_69
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 481 for ONNX tensor: 481
[07/07/2022-05:04:22] [V] [TRT] Expand_69 [Expand] outputs: [481 -> (32, 640, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_249 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 682
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 521
[07/07/2022-05:04:22] [V] [TRT] Expand_249 [Expand] inputs: [682 -> (32, 1, 512)[FLOAT]], [521 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_249 for ONNX node: Expand_249
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 738 for ONNX tensor: 738
[07/07/2022-05:04:22] [V] [TRT] Expand_249 [Expand] outputs: [738 -> (32, 1, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_324 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 682
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 521
[07/07/2022-05:04:22] [V] [TRT] Expand_324 [Expand] inputs: [682 -> (32, 1, 512)[FLOAT]], [521 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_324 for ONNX node: Expand_324
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 829 for ONNX tensor: 829
[07/07/2022-05:04:22] [V] [TRT] Expand_324 [Expand] outputs: [829 -> (32, 1, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_385 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 880
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2589
[07/07/2022-05:04:22] [V] [TRT] MatMul_385 [MatMul] inputs: [880 -> (32, 4000, 64)[FLOAT]], [2589 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2589 for ONNX node: 2589
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_385 for ONNX node: MatMul_385
[07/07/2022-05:04:22] [I] [TRT] MatMul_385: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 900 for ONNX tensor: 900
[07/07/2022-05:04:22] [V] [TRT] MatMul_385 [MatMul] outputs: [900 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_520 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1044
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2586
[07/07/2022-05:04:22] [V] [TRT] MatMul_520 [MatMul] inputs: [1044 -> (32, 1, 4)[FLOAT]], [2586 -> (4, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_520 for ONNX node: MatMul_520
[07/07/2022-05:04:22] [I] [TRT] MatMul_520: broadcasting input1 to make tensors conform, dims(input0)=[32,1,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1046 for ONNX tensor: 1046
[07/07/2022-05:04:22] [V] [TRT] MatMul_520 [MatMul] outputs: [1046 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Split_571 [Split]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1054
[07/07/2022-05:04:22] [V] [TRT] Split_571 [Split] inputs: [1054 -> (32, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_69 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_70 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_71 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_72 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_73 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_74 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_75 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_76 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_77 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_78 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_79 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_80 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_81 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_82 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_83 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_84 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_85 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_86 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_87 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_88 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_89 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_90 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_91 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_92 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_93 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_94 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_95 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_96 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_97 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_98 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_571_99 for ONNX node: Split_571
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1134 for ONNX tensor: 1134
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1135 for ONNX tensor: 1135
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1136 for ONNX tensor: 1136
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1137 for ONNX tensor: 1137
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1138 for ONNX tensor: 1138
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1139 for ONNX tensor: 1139
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1140 for ONNX tensor: 1140
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1141 for ONNX tensor: 1141
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1142 for ONNX tensor: 1142
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1143 for ONNX tensor: 1143
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1144 for ONNX tensor: 1144
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1145 for ONNX tensor: 1145
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1146 for ONNX tensor: 1146
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1147 for ONNX tensor: 1147
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1148 for ONNX tensor: 1148
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1149 for ONNX tensor: 1149
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1150 for ONNX tensor: 1150
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1151 for ONNX tensor: 1151
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1152 for ONNX tensor: 1152
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1153 for ONNX tensor: 1153
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1154 for ONNX tensor: 1154
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1155 for ONNX tensor: 1155
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1156 for ONNX tensor: 1156
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1157 for ONNX tensor: 1157
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1158 for ONNX tensor: 1158
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1159 for ONNX tensor: 1159
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1160 for ONNX tensor: 1160
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1161 for ONNX tensor: 1161
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1162 for ONNX tensor: 1162
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1163 for ONNX tensor: 1163
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1164 for ONNX tensor: 1164
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1165 for ONNX tensor: 1165
[07/07/2022-05:04:22] [V] [TRT] Split_571 [Split] outputs: [1134 -> (1, 4)[FLOAT]], [1135 -> (1, 4)[FLOAT]], [1136 -> (1, 4)[FLOAT]], [1137 -> (1, 4)[FLOAT]], [1138 -> (1, 4)[FLOAT]], [1139 -> (1, 4)[FLOAT]], [1140 -> (1, 4)[FLOAT]], [1141 -> (1, 4)[FLOAT]], [1142 -> (1, 4)[FLOAT]], [1143 -> (1, 4)[FLOAT]], [1144 -> (1, 4)[FLOAT]], [1145 -> (1, 4)[FLOAT]], [1146 -> (1, 4)[FLOAT]], [1147 -> (1, 4)[FLOAT]], [1148 -> (1, 4)[FLOAT]], [1149 -> (1, 4)[FLOAT]], [1150 -> (1, 4)[FLOAT]], [1151 -> (1, 4)[FLOAT]], [1152 -> (1, 4)[FLOAT]], [1153 -> (1, 4)[FLOAT]], [1154 -> (1, 4)[FLOAT]], [1155 -> (1, 4)[FLOAT]], [1156 -> (1, 4)[FLOAT]], [1157 -> (1, 4)[FLOAT]], [1158 -> (1, 4)[FLOAT]], [1159 -> (1, 4)[FLOAT]], [1160 -> (1, 4)[FLOAT]], [1161 -> (1, 4)[FLOAT]], [1162 -> (1, 4)[FLOAT]], [1163 -> (1, 4)[FLOAT]], [1164 -> (1, 4)[FLOAT]], [1165 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Split_1167 [Split]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1737
[07/07/2022-05:04:22] [V] [TRT] Split_1167 [Split] inputs: [1737 -> (32, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_100 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_101 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_102 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_103 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_104 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_105 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_106 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_107 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_108 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_109 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_110 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_111 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_112 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_113 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_114 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_115 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_116 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_117 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_118 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_119 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_120 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_121 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_122 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_123 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_124 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_125 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_126 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_127 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_128 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_129 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_1167_130 for ONNX node: Split_1167
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1817 for ONNX tensor: 1817
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1818 for ONNX tensor: 1818
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1819 for ONNX tensor: 1819
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1820 for ONNX tensor: 1820
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1821 for ONNX tensor: 1821
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1822 for ONNX tensor: 1822
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1823 for ONNX tensor: 1823
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1824 for ONNX tensor: 1824
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1825 for ONNX tensor: 1825
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1826 for ONNX tensor: 1826
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1827 for ONNX tensor: 1827
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1828 for ONNX tensor: 1828
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1829 for ONNX tensor: 1829
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1830 for ONNX tensor: 1830
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1831 for ONNX tensor: 1831
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1832 for ONNX tensor: 1832
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1833 for ONNX tensor: 1833
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1834 for ONNX tensor: 1834
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1835 for ONNX tensor: 1835
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1836 for ONNX tensor: 1836
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1837 for ONNX tensor: 1837
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1838 for ONNX tensor: 1838
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1839 for ONNX tensor: 1839
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1840 for ONNX tensor: 1840
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1841 for ONNX tensor: 1841
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1842 for ONNX tensor: 1842
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1843 for ONNX tensor: 1843
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1844 for ONNX tensor: 1844
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1845 for ONNX tensor: 1845
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1846 for ONNX tensor: 1846
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1847 for ONNX tensor: 1847
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1848 for ONNX tensor: 1848
[07/07/2022-05:04:22] [V] [TRT] Split_1167 [Split] outputs: [1817 -> (1, 4)[FLOAT]], [1818 -> (1, 4)[FLOAT]], [1819 -> (1, 4)[FLOAT]], [1820 -> (1, 4)[FLOAT]], [1821 -> (1, 4)[FLOAT]], [1822 -> (1, 4)[FLOAT]], [1823 -> (1, 4)[FLOAT]], [1824 -> (1, 4)[FLOAT]], [1825 -> (1, 4)[FLOAT]], [1826 -> (1, 4)[FLOAT]], [1827 -> (1, 4)[FLOAT]], [1828 -> (1, 4)[FLOAT]], [1829 -> (1, 4)[FLOAT]], [1830 -> (1, 4)[FLOAT]], [1831 -> (1, 4)[FLOAT]], [1832 -> (1, 4)[FLOAT]], [1833 -> (1, 4)[FLOAT]], [1834 -> (1, 4)[FLOAT]], [1835 -> (1, 4)[FLOAT]], [1836 -> (1, 4)[FLOAT]], [1837 -> (1, 4)[FLOAT]], [1838 -> (1, 4)[FLOAT]], [1839 -> (1, 4)[FLOAT]], [1840 -> (1, 4)[FLOAT]], [1841 -> (1, 4)[FLOAT]], [1842 -> (1, 4)[FLOAT]], [1843 -> (1, 4)[FLOAT]], [1844 -> (1, 4)[FLOAT]], [1845 -> (1, 4)[FLOAT]], [1846 -> (1, 4)[FLOAT]], [1847 -> (1, 4)[FLOAT]], [1848 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Squeeze_10 [Squeeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 207
[07/07/2022-05:04:22] [V] [TRT] Squeeze_10 [Squeeze] inputs: [207 -> (20, 1, 16384, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (20, 1, 16384, 64), squeezing to: (20, 16384, 64)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Squeeze_10 for ONNX node: Squeeze_10
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 209 for ONNX tensor: 209
[07/07/2022-05:04:22] [V] [TRT] Squeeze_10 [Squeeze] outputs: [209 -> (20, 16384, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Squeeze_36 [Squeeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 374
[07/07/2022-05:04:22] [V] [TRT] Squeeze_36 [Squeeze] inputs: [374 -> (10, 1, 4096, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (10, 1, 4096, 64), squeezing to: (10, 4096, 64)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Squeeze_36 for ONNX node: Squeeze_36
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 376 for ONNX tensor: 376
[07/07/2022-05:04:22] [V] [TRT] Squeeze_36 [Squeeze] outputs: [376 -> (10, 4096, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_87 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 481
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 521
[07/07/2022-05:04:22] [V] [TRT] Expand_87 [Expand] inputs: [481 -> (32, 640, 640)[FLOAT]], [521 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_87 for ONNX node: Expand_87
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 524 for ONNX tensor: 524
[07/07/2022-05:04:22] [V] [TRT] Expand_87 [Expand] outputs: [524 -> (32, 640, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_159 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 481
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 521
[07/07/2022-05:04:22] [V] [TRT] Expand_159 [Expand] inputs: [481 -> (32, 640, 640)[FLOAT]], [521 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_159 for ONNX node: Expand_159
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 615 for ONNX tensor: 615
[07/07/2022-05:04:22] [V] [TRT] Expand_159 [Expand] outputs: [615 -> (32, 640, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Tile_250 [Tile]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 738
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 521
[07/07/2022-05:04:22] [V] [TRT] Tile_250 [Tile] inputs: [738 -> (32, 1, 512)[FLOAT]], [521 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Tile_250 for ONNX node: Tile_250
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 739 for ONNX tensor: 739
[07/07/2022-05:04:22] [V] [TRT] Tile_250 [Tile] outputs: [739 -> (32, 1, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Tile_325 [Tile]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 829
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 521
[07/07/2022-05:04:22] [V] [TRT] Tile_325 [Tile] inputs: [829 -> (32, 1, 512)[FLOAT]], [521 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Tile_325 for ONNX node: Tile_325
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 830 for ONNX tensor: 830
[07/07/2022-05:04:22] [V] [TRT] Tile_325 [Tile] outputs: [830 -> (32, 1, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_386 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cg0.fc1.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 900
[07/07/2022-05:04:22] [V] [TRT] Add_386 [Add] inputs: [cg0.fc1.fc1.bias -> (64)[FLOAT]], [900 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cg0.fc1.fc1.bias for ONNX node: cg0.fc1.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_386 for ONNX node: Add_386
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 901 for ONNX tensor: 901
[07/07/2022-05:04:22] [V] [TRT] Add_386 [Add] outputs: [901 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_521 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: fc0_target.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1046
[07/07/2022-05:04:22] [V] [TRT] Add_521 [Add] inputs: [fc0_target.bias -> (64)[FLOAT]], [1046 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_521 for ONNX node: Add_521
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1047 for ONNX tensor: 1047
[07/07/2022-05:04:22] [V] [TRT] Add_521 [Add] outputs: [1047 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_572 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1134
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_572 [Unsqueeze] inputs: [1134 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_572 for ONNX node: Unsqueeze_572
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1166 for ONNX tensor: 1166
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_572 [Unsqueeze] outputs: [1166 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_585 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1135
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_585 [Unsqueeze] inputs: [1135 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_585 for ONNX node: Unsqueeze_585
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1179 for ONNX tensor: 1179
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_585 [Unsqueeze] outputs: [1179 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_598 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1136
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_598 [Unsqueeze] inputs: [1136 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_598 for ONNX node: Unsqueeze_598
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1192 for ONNX tensor: 1192
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_598 [Unsqueeze] outputs: [1192 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_611 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1137
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_611 [Unsqueeze] inputs: [1137 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_611 for ONNX node: Unsqueeze_611
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1205 for ONNX tensor: 1205
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_611 [Unsqueeze] outputs: [1205 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_624 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1138
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_624 [Unsqueeze] inputs: [1138 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_624 for ONNX node: Unsqueeze_624
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1218 for ONNX tensor: 1218
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_624 [Unsqueeze] outputs: [1218 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_637 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1139
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_637 [Unsqueeze] inputs: [1139 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_637 for ONNX node: Unsqueeze_637
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1231 for ONNX tensor: 1231
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_637 [Unsqueeze] outputs: [1231 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_650 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1140
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_650 [Unsqueeze] inputs: [1140 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_650 for ONNX node: Unsqueeze_650
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1244 for ONNX tensor: 1244
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_650 [Unsqueeze] outputs: [1244 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_663 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1141
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_663 [Unsqueeze] inputs: [1141 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_663 for ONNX node: Unsqueeze_663
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1257 for ONNX tensor: 1257
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_663 [Unsqueeze] outputs: [1257 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_676 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1142
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_676 [Unsqueeze] inputs: [1142 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_676 for ONNX node: Unsqueeze_676
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1270 for ONNX tensor: 1270
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_676 [Unsqueeze] outputs: [1270 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_689 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1143
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_689 [Unsqueeze] inputs: [1143 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_689 for ONNX node: Unsqueeze_689
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1283 for ONNX tensor: 1283
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_689 [Unsqueeze] outputs: [1283 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_702 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1144
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_702 [Unsqueeze] inputs: [1144 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_702 for ONNX node: Unsqueeze_702
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1296 for ONNX tensor: 1296
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_702 [Unsqueeze] outputs: [1296 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_715 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1145
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_715 [Unsqueeze] inputs: [1145 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_715 for ONNX node: Unsqueeze_715
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1309 for ONNX tensor: 1309
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_715 [Unsqueeze] outputs: [1309 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_728 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1146
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_728 [Unsqueeze] inputs: [1146 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_728 for ONNX node: Unsqueeze_728
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1322 for ONNX tensor: 1322
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_728 [Unsqueeze] outputs: [1322 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_741 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1147
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_741 [Unsqueeze] inputs: [1147 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_741 for ONNX node: Unsqueeze_741
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1335 for ONNX tensor: 1335
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_741 [Unsqueeze] outputs: [1335 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_754 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1148
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_754 [Unsqueeze] inputs: [1148 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_754 for ONNX node: Unsqueeze_754
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1348 for ONNX tensor: 1348
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_754 [Unsqueeze] outputs: [1348 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_767 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1149
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_767 [Unsqueeze] inputs: [1149 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_767 for ONNX node: Unsqueeze_767
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1361 for ONNX tensor: 1361
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_767 [Unsqueeze] outputs: [1361 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_780 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1150
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_780 [Unsqueeze] inputs: [1150 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_780 for ONNX node: Unsqueeze_780
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1374 for ONNX tensor: 1374
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_780 [Unsqueeze] outputs: [1374 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_793 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1151
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_793 [Unsqueeze] inputs: [1151 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_793 for ONNX node: Unsqueeze_793
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1387 for ONNX tensor: 1387
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_793 [Unsqueeze] outputs: [1387 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_806 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1152
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_806 [Unsqueeze] inputs: [1152 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_806 for ONNX node: Unsqueeze_806
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1400 for ONNX tensor: 1400
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_806 [Unsqueeze] outputs: [1400 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_819 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1153
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_819 [Unsqueeze] inputs: [1153 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_819 for ONNX node: Unsqueeze_819
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1413 for ONNX tensor: 1413
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_819 [Unsqueeze] outputs: [1413 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_832 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1154
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_832 [Unsqueeze] inputs: [1154 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_832 for ONNX node: Unsqueeze_832
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1426 for ONNX tensor: 1426
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_832 [Unsqueeze] outputs: [1426 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_845 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1155
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_845 [Unsqueeze] inputs: [1155 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_845 for ONNX node: Unsqueeze_845
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1439 for ONNX tensor: 1439
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_845 [Unsqueeze] outputs: [1439 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_858 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1156
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_858 [Unsqueeze] inputs: [1156 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_858 for ONNX node: Unsqueeze_858
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1452 for ONNX tensor: 1452
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_858 [Unsqueeze] outputs: [1452 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_871 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1157
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_871 [Unsqueeze] inputs: [1157 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_871 for ONNX node: Unsqueeze_871
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1465 for ONNX tensor: 1465
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_871 [Unsqueeze] outputs: [1465 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_884 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1158
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_884 [Unsqueeze] inputs: [1158 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_884 for ONNX node: Unsqueeze_884
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1478 for ONNX tensor: 1478
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_884 [Unsqueeze] outputs: [1478 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_897 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1159
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_897 [Unsqueeze] inputs: [1159 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_897 for ONNX node: Unsqueeze_897
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1491 for ONNX tensor: 1491
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_897 [Unsqueeze] outputs: [1491 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_910 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1160
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_910 [Unsqueeze] inputs: [1160 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_910 for ONNX node: Unsqueeze_910
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1504 for ONNX tensor: 1504
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_910 [Unsqueeze] outputs: [1504 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_923 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1161
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_923 [Unsqueeze] inputs: [1161 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_923 for ONNX node: Unsqueeze_923
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1517 for ONNX tensor: 1517
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_923 [Unsqueeze] outputs: [1517 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_936 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1162
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_936 [Unsqueeze] inputs: [1162 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_936 for ONNX node: Unsqueeze_936
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1530 for ONNX tensor: 1530
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_936 [Unsqueeze] outputs: [1530 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_949 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1163
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_949 [Unsqueeze] inputs: [1163 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_949 for ONNX node: Unsqueeze_949
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1543 for ONNX tensor: 1543
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_949 [Unsqueeze] outputs: [1543 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_962 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1164
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_962 [Unsqueeze] inputs: [1164 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_962 for ONNX node: Unsqueeze_962
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1556 for ONNX tensor: 1556
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_962 [Unsqueeze] outputs: [1556 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_975 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1165
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_975 [Unsqueeze] inputs: [1165 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_975 for ONNX node: Unsqueeze_975
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1569 for ONNX tensor: 1569
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_975 [Unsqueeze] outputs: [1569 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1168 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1817
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1168 [Unsqueeze] inputs: [1817 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1168 for ONNX node: Unsqueeze_1168
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1849 for ONNX tensor: 1849
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1168 [Unsqueeze] outputs: [1849 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1181 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1818
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1181 [Unsqueeze] inputs: [1818 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1181 for ONNX node: Unsqueeze_1181
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1862 for ONNX tensor: 1862
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1181 [Unsqueeze] outputs: [1862 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1194 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1819
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1194 [Unsqueeze] inputs: [1819 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1194 for ONNX node: Unsqueeze_1194
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1875 for ONNX tensor: 1875
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1194 [Unsqueeze] outputs: [1875 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1207 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1820
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1207 [Unsqueeze] inputs: [1820 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1207 for ONNX node: Unsqueeze_1207
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1888 for ONNX tensor: 1888
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1207 [Unsqueeze] outputs: [1888 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1220 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1821
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1220 [Unsqueeze] inputs: [1821 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1220 for ONNX node: Unsqueeze_1220
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1901 for ONNX tensor: 1901
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1220 [Unsqueeze] outputs: [1901 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1233 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1822
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1233 [Unsqueeze] inputs: [1822 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1233 for ONNX node: Unsqueeze_1233
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1914 for ONNX tensor: 1914
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1233 [Unsqueeze] outputs: [1914 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1246 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1823
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1246 [Unsqueeze] inputs: [1823 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1246 for ONNX node: Unsqueeze_1246
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1927 for ONNX tensor: 1927
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1246 [Unsqueeze] outputs: [1927 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1259 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1824
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1259 [Unsqueeze] inputs: [1824 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1259 for ONNX node: Unsqueeze_1259
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1940 for ONNX tensor: 1940
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1259 [Unsqueeze] outputs: [1940 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1272 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1825
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1272 [Unsqueeze] inputs: [1825 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1272 for ONNX node: Unsqueeze_1272
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1953 for ONNX tensor: 1953
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1272 [Unsqueeze] outputs: [1953 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1285 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1826
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1285 [Unsqueeze] inputs: [1826 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1285 for ONNX node: Unsqueeze_1285
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1966 for ONNX tensor: 1966
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1285 [Unsqueeze] outputs: [1966 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1298 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1827
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1298 [Unsqueeze] inputs: [1827 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1298 for ONNX node: Unsqueeze_1298
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1979 for ONNX tensor: 1979
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1298 [Unsqueeze] outputs: [1979 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1311 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1828
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1311 [Unsqueeze] inputs: [1828 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1311 for ONNX node: Unsqueeze_1311
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1992 for ONNX tensor: 1992
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1311 [Unsqueeze] outputs: [1992 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1324 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1829
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1324 [Unsqueeze] inputs: [1829 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1324 for ONNX node: Unsqueeze_1324
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2005 for ONNX tensor: 2005
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1324 [Unsqueeze] outputs: [2005 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1337 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1830
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1337 [Unsqueeze] inputs: [1830 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1337 for ONNX node: Unsqueeze_1337
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2018 for ONNX tensor: 2018
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1337 [Unsqueeze] outputs: [2018 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1350 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1831
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1350 [Unsqueeze] inputs: [1831 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1350 for ONNX node: Unsqueeze_1350
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2031 for ONNX tensor: 2031
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1350 [Unsqueeze] outputs: [2031 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1363 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1832
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1363 [Unsqueeze] inputs: [1832 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1363 for ONNX node: Unsqueeze_1363
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2044 for ONNX tensor: 2044
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1363 [Unsqueeze] outputs: [2044 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1376 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1833
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1376 [Unsqueeze] inputs: [1833 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1376 for ONNX node: Unsqueeze_1376
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2057 for ONNX tensor: 2057
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1376 [Unsqueeze] outputs: [2057 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1389 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1834
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1389 [Unsqueeze] inputs: [1834 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1389 for ONNX node: Unsqueeze_1389
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2070 for ONNX tensor: 2070
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1389 [Unsqueeze] outputs: [2070 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1402 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1835
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1402 [Unsqueeze] inputs: [1835 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1402 for ONNX node: Unsqueeze_1402
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2083 for ONNX tensor: 2083
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1402 [Unsqueeze] outputs: [2083 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1415 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1836
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1415 [Unsqueeze] inputs: [1836 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1415 for ONNX node: Unsqueeze_1415
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2096 for ONNX tensor: 2096
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1415 [Unsqueeze] outputs: [2096 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1428 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1837
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1428 [Unsqueeze] inputs: [1837 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1428 for ONNX node: Unsqueeze_1428
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2109 for ONNX tensor: 2109
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1428 [Unsqueeze] outputs: [2109 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1441 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1838
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1441 [Unsqueeze] inputs: [1838 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1441 for ONNX node: Unsqueeze_1441
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2122 for ONNX tensor: 2122
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1441 [Unsqueeze] outputs: [2122 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1454 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1839
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1454 [Unsqueeze] inputs: [1839 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1454 for ONNX node: Unsqueeze_1454
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2135 for ONNX tensor: 2135
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1454 [Unsqueeze] outputs: [2135 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1467 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1840
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1467 [Unsqueeze] inputs: [1840 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1467 for ONNX node: Unsqueeze_1467
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2148 for ONNX tensor: 2148
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1467 [Unsqueeze] outputs: [2148 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1480 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1841
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1480 [Unsqueeze] inputs: [1841 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1480 for ONNX node: Unsqueeze_1480
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2161 for ONNX tensor: 2161
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1480 [Unsqueeze] outputs: [2161 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1493 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1842
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1493 [Unsqueeze] inputs: [1842 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1493 for ONNX node: Unsqueeze_1493
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2174 for ONNX tensor: 2174
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1493 [Unsqueeze] outputs: [2174 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1506 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1843
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1506 [Unsqueeze] inputs: [1843 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1506 for ONNX node: Unsqueeze_1506
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2187 for ONNX tensor: 2187
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1506 [Unsqueeze] outputs: [2187 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1519 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1844
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1519 [Unsqueeze] inputs: [1844 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1519 for ONNX node: Unsqueeze_1519
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2200 for ONNX tensor: 2200
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1519 [Unsqueeze] outputs: [2200 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1532 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1845
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1532 [Unsqueeze] inputs: [1845 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1532 for ONNX node: Unsqueeze_1532
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2213 for ONNX tensor: 2213
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1532 [Unsqueeze] outputs: [2213 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1545 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1846
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1545 [Unsqueeze] inputs: [1846 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1545 for ONNX node: Unsqueeze_1545
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2226 for ONNX tensor: 2226
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1545 [Unsqueeze] outputs: [2226 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1558 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1847
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1558 [Unsqueeze] inputs: [1847 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1558 for ONNX node: Unsqueeze_1558
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2239 for ONNX tensor: 2239
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1558 [Unsqueeze] outputs: [2239 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1571 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1848
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1571 [Unsqueeze] inputs: [1848 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1, 4), unsqueezing to: (1, 1, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1571 for ONNX node: Unsqueeze_1571
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2252 for ONNX tensor: 2252
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1571 [Unsqueeze] outputs: [2252 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: GRU_18 [GRU]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 209
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2461
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2462
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2463
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 206
[07/07/2022-05:04:22] [V] [TRT] GRU_18 [GRU] inputs: [209 -> (20, 16384, 64)[FLOAT]], [2461 -> (1, 192, 64)[FLOAT]], [2462 -> (1, 192, 64)[FLOAT]], [2463 -> (1, 384)[FLOAT]], [optional input, not set], [206 -> (1, 16384, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2461 for ONNX node: 2461
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2462 for ONNX node: 2462
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Weights for ZR gates shape is: (1, 128, 64)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Weights for H gate shape is: (1, 64, 64)
[07/07/2022-05:04:22] [I] [TRT] MatMul_520: broadcasting input1 to make tensors conform, dims(input0)=[32,1,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_385: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Recurrence weights for ZR gates shape is: (1, 128, 64)
[07/07/2022-05:04:22] [V] [TRT] Recurrence weights for H gate shape is: (1, 64, 64)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2463 for ONNX node: 2463
[07/07/2022-05:04:22] [V] [TRT] Bias for ZR gates shape is: (1, 1, 128)
[07/07/2022-05:04:22] [V] [TRT] Bias for H gate shape is: (1, 1, 64)
[07/07/2022-05:04:22] [V] [TRT] Recurrence bias for ZR gates shape is: (1, 1, 128)
[07/07/2022-05:04:22] [V] [TRT] Recurrence bias for H gate shape is: (1, 1, 64)
[07/07/2022-05:04:22] [V] [TRT] numDirections is: 1, numDirections Tensor shape: (1)
[07/07/2022-05:04:22] [V] [TRT] hiddenSize is: 64, hiddenSizeTensor shape: (1)
[07/07/2022-05:04:22] [V] [TRT] batchSizeTensor shape: (1)
[07/07/2022-05:04:22] [V] [TRT] Gate output rank (equal to initial hidden/cell state rank): (3)
[07/07/2022-05:04:22] [V] [TRT] Entering Loop
[07/07/2022-05:04:22] [V] [TRT] Original shape: (16384, 64), unsqueezing to: (1, 16384, 64)
[07/07/2022-05:04:22] [V] [TRT] Input shape: (1, 16384, 64)
[07/07/2022-05:04:22] [V] [TRT] Initial hidden state shape: (1, 16384, 64)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: GRU_18 for ONNX node: GRU_18
[07/07/2022-05:04:22] [V] [TRT] Hidden state shape: (1, 16384, 64)
[07/07/2022-05:04:22] [V] [TRT] X(t) * W[zr]^T -> (1, 16384, 128)
[07/07/2022-05:04:22] [V] [TRT] H(t-1) * R[zr]^T -> (1, 16384, 128)
[07/07/2022-05:04:22] [V] [TRT] stackedZR(t) -> (1, 16384, 128)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_520: broadcasting input1 to make tensors conform, dims(input0)=[32,1,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_385: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] z(t) -> (1, 16384, 64)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_520: broadcasting input1 to make tensors conform, dims(input0)=[32,1,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_385: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] r(t) -> (1, 16384, 64)
[07/07/2022-05:04:22] [V] [TRT] h(t) -> (1, 16384, 64)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_520: broadcasting input1 to make tensors conform, dims(input0)=[32,1,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_385: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] H(t) -> (1, 16384, 64)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_520: broadcasting input1 to make tensors conform, dims(input0)=[32,1,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_385: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 279 for ONNX tensor: 279
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 280 for ONNX tensor: 280
[07/07/2022-05:04:22] [V] [TRT] GRU_18 [GRU] outputs: [279 -> (20, 1, 16384, 64)[FLOAT]], [280 -> (1, 16384, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: GRU_44 [GRU]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 376
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2513
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2514
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2515
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 373
[07/07/2022-05:04:22] [V] [TRT] GRU_44 [GRU] inputs: [376 -> (10, 4096, 64)[FLOAT]], [2513 -> (1, 192, 64)[FLOAT]], [2514 -> (1, 192, 64)[FLOAT]], [2515 -> (1, 384)[FLOAT]], [optional input, not set], [373 -> (1, 4096, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2513 for ONNX node: 2513
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2514 for ONNX node: 2514
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Weights for ZR gates shape is: (1, 128, 64)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Weights for H gate shape is: (1, 64, 64)
[07/07/2022-05:04:22] [I] [TRT] MatMul_520: broadcasting input1 to make tensors conform, dims(input0)=[32,1,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_385: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Recurrence weights for ZR gates shape is: (1, 128, 64)
[07/07/2022-05:04:22] [V] [TRT] Recurrence weights for H gate shape is: (1, 64, 64)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2515 for ONNX node: 2515
[07/07/2022-05:04:22] [V] [TRT] Bias for ZR gates shape is: (1, 1, 128)
[07/07/2022-05:04:22] [V] [TRT] Bias for H gate shape is: (1, 1, 64)
[07/07/2022-05:04:22] [V] [TRT] Recurrence bias for ZR gates shape is: (1, 1, 128)
[07/07/2022-05:04:22] [V] [TRT] Recurrence bias for H gate shape is: (1, 1, 64)
[07/07/2022-05:04:22] [V] [TRT] numDirections is: 1, numDirections Tensor shape: (1)
[07/07/2022-05:04:22] [V] [TRT] hiddenSize is: 64, hiddenSizeTensor shape: (1)
[07/07/2022-05:04:22] [V] [TRT] batchSizeTensor shape: (1)
[07/07/2022-05:04:22] [V] [TRT] Gate output rank (equal to initial hidden/cell state rank): (3)
[07/07/2022-05:04:22] [V] [TRT] Entering Loop
[07/07/2022-05:04:22] [V] [TRT] Original shape: (4096, 64), unsqueezing to: (1, 4096, 64)
[07/07/2022-05:04:22] [V] [TRT] Input shape: (1, 4096, 64)
[07/07/2022-05:04:22] [V] [TRT] Initial hidden state shape: (1, 4096, 64)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: GRU_44 for ONNX node: GRU_44
[07/07/2022-05:04:22] [V] [TRT] Hidden state shape: (1, 4096, 64)
[07/07/2022-05:04:22] [V] [TRT] X(t) * W[zr]^T -> (1, 4096, 128)
[07/07/2022-05:04:22] [V] [TRT] H(t-1) * R[zr]^T -> (1, 4096, 128)
[07/07/2022-05:04:22] [V] [TRT] stackedZR(t) -> (1, 4096, 128)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_520: broadcasting input1 to make tensors conform, dims(input0)=[32,1,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_385: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] z(t) -> (1, 4096, 64)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_520: broadcasting input1 to make tensors conform, dims(input0)=[32,1,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_385: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] r(t) -> (1, 4096, 64)
[07/07/2022-05:04:22] [V] [TRT] h(t) -> (1, 4096, 64)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_520: broadcasting input1 to make tensors conform, dims(input0)=[32,1,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_385: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] H(t) -> (1, 4096, 64)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_520: broadcasting input1 to make tensors conform, dims(input0)=[32,1,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_385: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 446 for ONNX tensor: 446
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 447 for ONNX tensor: 447
[07/07/2022-05:04:22] [V] [TRT] GRU_44 [GRU] outputs: [446 -> (10, 1, 4096, 64)[FLOAT]], [447 -> (1, 4096, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Tile_88 [Tile]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 524
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 521
[07/07/2022-05:04:22] [V] [TRT] Tile_88 [Tile] inputs: [524 -> (32, 640, 640)[FLOAT]], [521 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Tile_88 for ONNX node: Tile_88
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 525 for ONNX tensor: 525
[07/07/2022-05:04:22] [V] [TRT] Tile_88 [Tile] outputs: [525 -> (32, 640, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Tile_160 [Tile]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 615
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 521
[07/07/2022-05:04:22] [V] [TRT] Tile_160 [Tile] inputs: [615 -> (32, 640, 640)[FLOAT]], [521 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Tile_160 for ONNX node: Tile_160
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 616 for ONNX tensor: 616
[07/07/2022-05:04:22] [V] [TRT] Tile_160 [Tile] outputs: [616 -> (32, 640, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Equal_252 [Equal]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 739
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 526
[07/07/2022-05:04:22] [V] [TRT] Equal_252 [Equal] inputs: [739 -> (32, 1, 512)[FLOAT]], [526 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Equal_252 for ONNX node: Equal_252
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 741 for ONNX tensor: 741
[07/07/2022-05:04:22] [V] [TRT] Equal_252 [Equal] outputs: [741 -> (32, 1, 512)[BOOL]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Equal_327 [Equal]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 830
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 526
[07/07/2022-05:04:22] [V] [TRT] Equal_327 [Equal] inputs: [830 -> (32, 1, 512)[FLOAT]], [526 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Equal_327 for ONNX node: Equal_327
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 832 for ONNX tensor: 832
[07/07/2022-05:04:22] [V] [TRT] Equal_327 [Equal] outputs: [832 -> (32, 1, 512)[BOOL]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_387 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 901
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_387 [ReduceMean] inputs: [901 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_387 for ONNX node: ReduceMean_387
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 902 for ONNX tensor: 902
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_387 [ReduceMean] outputs: [902 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_582 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1166
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_582 [Expand] inputs: [1166 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_582 for ONNX node: Expand_582
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1176 for ONNX tensor: 1176
[07/07/2022-05:04:22] [V] [TRT] Expand_582 [Expand] outputs: [1176 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_595 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1179
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_595 [Expand] inputs: [1179 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_595 for ONNX node: Expand_595
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1189 for ONNX tensor: 1189
[07/07/2022-05:04:22] [V] [TRT] Expand_595 [Expand] outputs: [1189 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_608 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1192
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_608 [Expand] inputs: [1192 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_608 for ONNX node: Expand_608
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1202 for ONNX tensor: 1202
[07/07/2022-05:04:22] [V] [TRT] Expand_608 [Expand] outputs: [1202 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_621 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1205
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_621 [Expand] inputs: [1205 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_621 for ONNX node: Expand_621
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1215 for ONNX tensor: 1215
[07/07/2022-05:04:22] [V] [TRT] Expand_621 [Expand] outputs: [1215 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_634 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1218
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_634 [Expand] inputs: [1218 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_634 for ONNX node: Expand_634
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1228 for ONNX tensor: 1228
[07/07/2022-05:04:22] [V] [TRT] Expand_634 [Expand] outputs: [1228 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_647 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1231
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_647 [Expand] inputs: [1231 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_647 for ONNX node: Expand_647
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1241 for ONNX tensor: 1241
[07/07/2022-05:04:22] [V] [TRT] Expand_647 [Expand] outputs: [1241 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_660 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1244
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_660 [Expand] inputs: [1244 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_660 for ONNX node: Expand_660
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1254 for ONNX tensor: 1254
[07/07/2022-05:04:22] [V] [TRT] Expand_660 [Expand] outputs: [1254 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_673 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1257
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_673 [Expand] inputs: [1257 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_673 for ONNX node: Expand_673
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1267 for ONNX tensor: 1267
[07/07/2022-05:04:22] [V] [TRT] Expand_673 [Expand] outputs: [1267 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_686 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1270
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_686 [Expand] inputs: [1270 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_686 for ONNX node: Expand_686
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1280 for ONNX tensor: 1280
[07/07/2022-05:04:22] [V] [TRT] Expand_686 [Expand] outputs: [1280 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_699 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1283
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_699 [Expand] inputs: [1283 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_699 for ONNX node: Expand_699
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1293 for ONNX tensor: 1293
[07/07/2022-05:04:22] [V] [TRT] Expand_699 [Expand] outputs: [1293 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_712 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1296
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_712 [Expand] inputs: [1296 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_712 for ONNX node: Expand_712
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1306 for ONNX tensor: 1306
[07/07/2022-05:04:22] [V] [TRT] Expand_712 [Expand] outputs: [1306 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_725 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1309
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_725 [Expand] inputs: [1309 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_725 for ONNX node: Expand_725
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1319 for ONNX tensor: 1319
[07/07/2022-05:04:22] [V] [TRT] Expand_725 [Expand] outputs: [1319 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_738 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1322
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_738 [Expand] inputs: [1322 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_738 for ONNX node: Expand_738
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1332 for ONNX tensor: 1332
[07/07/2022-05:04:22] [V] [TRT] Expand_738 [Expand] outputs: [1332 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_751 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1335
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_751 [Expand] inputs: [1335 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_751 for ONNX node: Expand_751
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1345 for ONNX tensor: 1345
[07/07/2022-05:04:22] [V] [TRT] Expand_751 [Expand] outputs: [1345 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_764 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1348
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_764 [Expand] inputs: [1348 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_764 for ONNX node: Expand_764
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1358 for ONNX tensor: 1358
[07/07/2022-05:04:22] [V] [TRT] Expand_764 [Expand] outputs: [1358 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_777 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1361
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_777 [Expand] inputs: [1361 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_777 for ONNX node: Expand_777
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1371 for ONNX tensor: 1371
[07/07/2022-05:04:22] [V] [TRT] Expand_777 [Expand] outputs: [1371 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_790 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1374
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_790 [Expand] inputs: [1374 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_790 for ONNX node: Expand_790
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1384 for ONNX tensor: 1384
[07/07/2022-05:04:22] [V] [TRT] Expand_790 [Expand] outputs: [1384 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_803 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1387
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_803 [Expand] inputs: [1387 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_803 for ONNX node: Expand_803
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1397 for ONNX tensor: 1397
[07/07/2022-05:04:22] [V] [TRT] Expand_803 [Expand] outputs: [1397 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_816 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1400
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_816 [Expand] inputs: [1400 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_816 for ONNX node: Expand_816
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1410 for ONNX tensor: 1410
[07/07/2022-05:04:22] [V] [TRT] Expand_816 [Expand] outputs: [1410 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_829 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1413
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_829 [Expand] inputs: [1413 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_829 for ONNX node: Expand_829
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1423 for ONNX tensor: 1423
[07/07/2022-05:04:22] [V] [TRT] Expand_829 [Expand] outputs: [1423 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_842 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1426
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_842 [Expand] inputs: [1426 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_842 for ONNX node: Expand_842
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1436 for ONNX tensor: 1436
[07/07/2022-05:04:22] [V] [TRT] Expand_842 [Expand] outputs: [1436 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_855 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1439
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_855 [Expand] inputs: [1439 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_855 for ONNX node: Expand_855
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1449 for ONNX tensor: 1449
[07/07/2022-05:04:22] [V] [TRT] Expand_855 [Expand] outputs: [1449 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_868 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1452
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_868 [Expand] inputs: [1452 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_868 for ONNX node: Expand_868
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1462 for ONNX tensor: 1462
[07/07/2022-05:04:22] [V] [TRT] Expand_868 [Expand] outputs: [1462 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_881 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1465
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_881 [Expand] inputs: [1465 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_881 for ONNX node: Expand_881
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1475 for ONNX tensor: 1475
[07/07/2022-05:04:22] [V] [TRT] Expand_881 [Expand] outputs: [1475 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_894 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1478
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_894 [Expand] inputs: [1478 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_894 for ONNX node: Expand_894
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1488 for ONNX tensor: 1488
[07/07/2022-05:04:22] [V] [TRT] Expand_894 [Expand] outputs: [1488 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_907 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1491
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_907 [Expand] inputs: [1491 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_907 for ONNX node: Expand_907
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1501 for ONNX tensor: 1501
[07/07/2022-05:04:22] [V] [TRT] Expand_907 [Expand] outputs: [1501 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_920 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1504
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_920 [Expand] inputs: [1504 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_920 for ONNX node: Expand_920
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1514 for ONNX tensor: 1514
[07/07/2022-05:04:22] [V] [TRT] Expand_920 [Expand] outputs: [1514 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_933 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1517
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_933 [Expand] inputs: [1517 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_933 for ONNX node: Expand_933
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1527 for ONNX tensor: 1527
[07/07/2022-05:04:22] [V] [TRT] Expand_933 [Expand] outputs: [1527 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_946 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1530
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_946 [Expand] inputs: [1530 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_946 for ONNX node: Expand_946
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1540 for ONNX tensor: 1540
[07/07/2022-05:04:22] [V] [TRT] Expand_946 [Expand] outputs: [1540 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_959 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1543
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_959 [Expand] inputs: [1543 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_959 for ONNX node: Expand_959
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1553 for ONNX tensor: 1553
[07/07/2022-05:04:22] [V] [TRT] Expand_959 [Expand] outputs: [1553 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_972 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1556
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_972 [Expand] inputs: [1556 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_972 for ONNX node: Expand_972
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1566 for ONNX tensor: 1566
[07/07/2022-05:04:22] [V] [TRT] Expand_972 [Expand] outputs: [1566 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_985 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1569
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_985 [Expand] inputs: [1569 -> (1, 1, 4)[FLOAT]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_985 for ONNX node: Expand_985
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1579 for ONNX tensor: 1579
[07/07/2022-05:04:22] [V] [TRT] Expand_985 [Expand] outputs: [1579 -> (1, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1178 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1849
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1178 [Expand] inputs: [1849 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1178 for ONNX node: Expand_1178
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1859 for ONNX tensor: 1859
[07/07/2022-05:04:22] [V] [TRT] Expand_1178 [Expand] outputs: [1859 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1191 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1862
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1191 [Expand] inputs: [1862 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1191 for ONNX node: Expand_1191
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1872 for ONNX tensor: 1872
[07/07/2022-05:04:22] [V] [TRT] Expand_1191 [Expand] outputs: [1872 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1204 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1875
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1204 [Expand] inputs: [1875 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1204 for ONNX node: Expand_1204
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1885 for ONNX tensor: 1885
[07/07/2022-05:04:22] [V] [TRT] Expand_1204 [Expand] outputs: [1885 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1217 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1888
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1217 [Expand] inputs: [1888 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1217 for ONNX node: Expand_1217
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1898 for ONNX tensor: 1898
[07/07/2022-05:04:22] [V] [TRT] Expand_1217 [Expand] outputs: [1898 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1230 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1901
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1230 [Expand] inputs: [1901 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1230 for ONNX node: Expand_1230
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1911 for ONNX tensor: 1911
[07/07/2022-05:04:22] [V] [TRT] Expand_1230 [Expand] outputs: [1911 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1243 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1914
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1243 [Expand] inputs: [1914 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1243 for ONNX node: Expand_1243
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1924 for ONNX tensor: 1924
[07/07/2022-05:04:22] [V] [TRT] Expand_1243 [Expand] outputs: [1924 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1256 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1927
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1256 [Expand] inputs: [1927 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1256 for ONNX node: Expand_1256
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1937 for ONNX tensor: 1937
[07/07/2022-05:04:22] [V] [TRT] Expand_1256 [Expand] outputs: [1937 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1269 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1940
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1269 [Expand] inputs: [1940 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1269 for ONNX node: Expand_1269
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1950 for ONNX tensor: 1950
[07/07/2022-05:04:22] [V] [TRT] Expand_1269 [Expand] outputs: [1950 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1282 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1953
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1282 [Expand] inputs: [1953 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1282 for ONNX node: Expand_1282
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1963 for ONNX tensor: 1963
[07/07/2022-05:04:22] [V] [TRT] Expand_1282 [Expand] outputs: [1963 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1295 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1966
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1295 [Expand] inputs: [1966 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1295 for ONNX node: Expand_1295
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1976 for ONNX tensor: 1976
[07/07/2022-05:04:22] [V] [TRT] Expand_1295 [Expand] outputs: [1976 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1308 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1979
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1308 [Expand] inputs: [1979 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1308 for ONNX node: Expand_1308
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1989 for ONNX tensor: 1989
[07/07/2022-05:04:22] [V] [TRT] Expand_1308 [Expand] outputs: [1989 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1321 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1992
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1321 [Expand] inputs: [1992 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1321 for ONNX node: Expand_1321
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2002 for ONNX tensor: 2002
[07/07/2022-05:04:22] [V] [TRT] Expand_1321 [Expand] outputs: [2002 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1334 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2005
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1334 [Expand] inputs: [2005 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1334 for ONNX node: Expand_1334
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2015 for ONNX tensor: 2015
[07/07/2022-05:04:22] [V] [TRT] Expand_1334 [Expand] outputs: [2015 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1347 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2018
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1347 [Expand] inputs: [2018 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1347 for ONNX node: Expand_1347
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2028 for ONNX tensor: 2028
[07/07/2022-05:04:22] [V] [TRT] Expand_1347 [Expand] outputs: [2028 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1360 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2031
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1360 [Expand] inputs: [2031 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1360 for ONNX node: Expand_1360
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2041 for ONNX tensor: 2041
[07/07/2022-05:04:22] [V] [TRT] Expand_1360 [Expand] outputs: [2041 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1373 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2044
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1373 [Expand] inputs: [2044 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1373 for ONNX node: Expand_1373
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2054 for ONNX tensor: 2054
[07/07/2022-05:04:22] [V] [TRT] Expand_1373 [Expand] outputs: [2054 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1386 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2057
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1386 [Expand] inputs: [2057 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1386 for ONNX node: Expand_1386
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2067 for ONNX tensor: 2067
[07/07/2022-05:04:22] [V] [TRT] Expand_1386 [Expand] outputs: [2067 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1399 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2070
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1399 [Expand] inputs: [2070 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1399 for ONNX node: Expand_1399
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2080 for ONNX tensor: 2080
[07/07/2022-05:04:22] [V] [TRT] Expand_1399 [Expand] outputs: [2080 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1412 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2083
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1412 [Expand] inputs: [2083 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1412 for ONNX node: Expand_1412
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2093 for ONNX tensor: 2093
[07/07/2022-05:04:22] [V] [TRT] Expand_1412 [Expand] outputs: [2093 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1425 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2096
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1425 [Expand] inputs: [2096 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1425 for ONNX node: Expand_1425
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2106 for ONNX tensor: 2106
[07/07/2022-05:04:22] [V] [TRT] Expand_1425 [Expand] outputs: [2106 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1438 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2109
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1438 [Expand] inputs: [2109 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1438 for ONNX node: Expand_1438
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2119 for ONNX tensor: 2119
[07/07/2022-05:04:22] [V] [TRT] Expand_1438 [Expand] outputs: [2119 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1451 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2122
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1451 [Expand] inputs: [2122 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1451 for ONNX node: Expand_1451
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2132 for ONNX tensor: 2132
[07/07/2022-05:04:22] [V] [TRT] Expand_1451 [Expand] outputs: [2132 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1464 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2135
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1464 [Expand] inputs: [2135 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1464 for ONNX node: Expand_1464
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2145 for ONNX tensor: 2145
[07/07/2022-05:04:22] [V] [TRT] Expand_1464 [Expand] outputs: [2145 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1477 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2148
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1477 [Expand] inputs: [2148 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1477 for ONNX node: Expand_1477
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2158 for ONNX tensor: 2158
[07/07/2022-05:04:22] [V] [TRT] Expand_1477 [Expand] outputs: [2158 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1490 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2161
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1490 [Expand] inputs: [2161 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1490 for ONNX node: Expand_1490
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2171 for ONNX tensor: 2171
[07/07/2022-05:04:22] [V] [TRT] Expand_1490 [Expand] outputs: [2171 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1503 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2174
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1503 [Expand] inputs: [2174 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1503 for ONNX node: Expand_1503
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2184 for ONNX tensor: 2184
[07/07/2022-05:04:22] [V] [TRT] Expand_1503 [Expand] outputs: [2184 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1516 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2187
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1516 [Expand] inputs: [2187 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1516 for ONNX node: Expand_1516
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2197 for ONNX tensor: 2197
[07/07/2022-05:04:22] [V] [TRT] Expand_1516 [Expand] outputs: [2197 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1529 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2200
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1529 [Expand] inputs: [2200 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1529 for ONNX node: Expand_1529
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2210 for ONNX tensor: 2210
[07/07/2022-05:04:22] [V] [TRT] Expand_1529 [Expand] outputs: [2210 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1542 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2213
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1542 [Expand] inputs: [2213 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1542 for ONNX node: Expand_1542
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2223 for ONNX tensor: 2223
[07/07/2022-05:04:22] [V] [TRT] Expand_1542 [Expand] outputs: [2223 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1555 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2226
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1555 [Expand] inputs: [2226 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1555 for ONNX node: Expand_1555
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2236 for ONNX tensor: 2236
[07/07/2022-05:04:22] [V] [TRT] Expand_1555 [Expand] outputs: [2236 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1568 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2239
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1568 [Expand] inputs: [2239 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1568 for ONNX node: Expand_1568
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2249 for ONNX tensor: 2249
[07/07/2022-05:04:22] [V] [TRT] Expand_1568 [Expand] outputs: [2249 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1581 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2252
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1858
[07/07/2022-05:04:22] [V] [TRT] Expand_1581 [Expand] inputs: [2252 -> (1, 1, 4)[FLOAT]], [1858 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1581 for ONNX node: Expand_1581
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2262 for ONNX tensor: 2262
[07/07/2022-05:04:22] [V] [TRT] Expand_1581 [Expand] outputs: [2262 -> (1, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Equal_90 [Equal]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 525
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 526
[07/07/2022-05:04:22] [V] [TRT] Equal_90 [Equal] inputs: [525 -> (32, 640, 640)[FLOAT]], [526 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Equal_90 for ONNX node: Equal_90
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 527 for ONNX tensor: 527
[07/07/2022-05:04:22] [V] [TRT] Equal_90 [Equal] outputs: [527 -> (32, 640, 640)[BOOL]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Equal_162 [Equal]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 616
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 526
[07/07/2022-05:04:22] [V] [TRT] Equal_162 [Equal] inputs: [616 -> (32, 640, 640)[FLOAT]], [526 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Equal_162 for ONNX node: Equal_162
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 618 for ONNX tensor: 618
[07/07/2022-05:04:22] [V] [TRT] Equal_162 [Equal] outputs: [618 -> (32, 640, 640)[BOOL]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sub_388 [Sub]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 901
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 902
[07/07/2022-05:04:22] [V] [TRT] Sub_388 [Sub] inputs: [901 -> (32, 4000, 64)[FLOAT]], [902 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sub_388 for ONNX node: Sub_388
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 903 for ONNX tensor: 903
[07/07/2022-05:04:22] [V] [TRT] Sub_388 [Sub] outputs: [903 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_584 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1176
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_584 [Reshape] inputs: [1176 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_584 for ONNX node: Reshape_584
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1178 for ONNX tensor: 1178
[07/07/2022-05:04:22] [V] [TRT] Reshape_584 [Reshape] outputs: [1178 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_597 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1189
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_597 [Reshape] inputs: [1189 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_597 for ONNX node: Reshape_597
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1191 for ONNX tensor: 1191
[07/07/2022-05:04:22] [V] [TRT] Reshape_597 [Reshape] outputs: [1191 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_610 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1202
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_610 [Reshape] inputs: [1202 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_610 for ONNX node: Reshape_610
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1204 for ONNX tensor: 1204
[07/07/2022-05:04:22] [V] [TRT] Reshape_610 [Reshape] outputs: [1204 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_623 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1215
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_623 [Reshape] inputs: [1215 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_623 for ONNX node: Reshape_623
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1217 for ONNX tensor: 1217
[07/07/2022-05:04:22] [V] [TRT] Reshape_623 [Reshape] outputs: [1217 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_636 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1228
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_636 [Reshape] inputs: [1228 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_636 for ONNX node: Reshape_636
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1230 for ONNX tensor: 1230
[07/07/2022-05:04:22] [V] [TRT] Reshape_636 [Reshape] outputs: [1230 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_649 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1241
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_649 [Reshape] inputs: [1241 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_649 for ONNX node: Reshape_649
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1243 for ONNX tensor: 1243
[07/07/2022-05:04:22] [V] [TRT] Reshape_649 [Reshape] outputs: [1243 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_662 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1254
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_662 [Reshape] inputs: [1254 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_662 for ONNX node: Reshape_662
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1256 for ONNX tensor: 1256
[07/07/2022-05:04:22] [V] [TRT] Reshape_662 [Reshape] outputs: [1256 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_675 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1267
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_675 [Reshape] inputs: [1267 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_675 for ONNX node: Reshape_675
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1269 for ONNX tensor: 1269
[07/07/2022-05:04:22] [V] [TRT] Reshape_675 [Reshape] outputs: [1269 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_688 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1280
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_688 [Reshape] inputs: [1280 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_688 for ONNX node: Reshape_688
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1282 for ONNX tensor: 1282
[07/07/2022-05:04:22] [V] [TRT] Reshape_688 [Reshape] outputs: [1282 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_701 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1293
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_701 [Reshape] inputs: [1293 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_701 for ONNX node: Reshape_701
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1295 for ONNX tensor: 1295
[07/07/2022-05:04:22] [V] [TRT] Reshape_701 [Reshape] outputs: [1295 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_714 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1306
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_714 [Reshape] inputs: [1306 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_714 for ONNX node: Reshape_714
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1308 for ONNX tensor: 1308
[07/07/2022-05:04:22] [V] [TRT] Reshape_714 [Reshape] outputs: [1308 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_727 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1319
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_727 [Reshape] inputs: [1319 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_727 for ONNX node: Reshape_727
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1321 for ONNX tensor: 1321
[07/07/2022-05:04:22] [V] [TRT] Reshape_727 [Reshape] outputs: [1321 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_740 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1332
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_740 [Reshape] inputs: [1332 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_740 for ONNX node: Reshape_740
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1334 for ONNX tensor: 1334
[07/07/2022-05:04:22] [V] [TRT] Reshape_740 [Reshape] outputs: [1334 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_753 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1345
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_753 [Reshape] inputs: [1345 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_753 for ONNX node: Reshape_753
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1347 for ONNX tensor: 1347
[07/07/2022-05:04:22] [V] [TRT] Reshape_753 [Reshape] outputs: [1347 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_766 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1358
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_766 [Reshape] inputs: [1358 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_766 for ONNX node: Reshape_766
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1360 for ONNX tensor: 1360
[07/07/2022-05:04:22] [V] [TRT] Reshape_766 [Reshape] outputs: [1360 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_779 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1371
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_779 [Reshape] inputs: [1371 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_779 for ONNX node: Reshape_779
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1373 for ONNX tensor: 1373
[07/07/2022-05:04:22] [V] [TRT] Reshape_779 [Reshape] outputs: [1373 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_792 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1384
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_792 [Reshape] inputs: [1384 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_792 for ONNX node: Reshape_792
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1386 for ONNX tensor: 1386
[07/07/2022-05:04:22] [V] [TRT] Reshape_792 [Reshape] outputs: [1386 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_805 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1397
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_805 [Reshape] inputs: [1397 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_805 for ONNX node: Reshape_805
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1399 for ONNX tensor: 1399
[07/07/2022-05:04:22] [V] [TRT] Reshape_805 [Reshape] outputs: [1399 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_818 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1410
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_818 [Reshape] inputs: [1410 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_818 for ONNX node: Reshape_818
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1412 for ONNX tensor: 1412
[07/07/2022-05:04:22] [V] [TRT] Reshape_818 [Reshape] outputs: [1412 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_831 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1423
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_831 [Reshape] inputs: [1423 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_831 for ONNX node: Reshape_831
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1425 for ONNX tensor: 1425
[07/07/2022-05:04:22] [V] [TRT] Reshape_831 [Reshape] outputs: [1425 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_844 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1436
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_844 [Reshape] inputs: [1436 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_844 for ONNX node: Reshape_844
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1438 for ONNX tensor: 1438
[07/07/2022-05:04:22] [V] [TRT] Reshape_844 [Reshape] outputs: [1438 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_857 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1449
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_857 [Reshape] inputs: [1449 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_857 for ONNX node: Reshape_857
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1451 for ONNX tensor: 1451
[07/07/2022-05:04:22] [V] [TRT] Reshape_857 [Reshape] outputs: [1451 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_870 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1462
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_870 [Reshape] inputs: [1462 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_870 for ONNX node: Reshape_870
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1464 for ONNX tensor: 1464
[07/07/2022-05:04:22] [V] [TRT] Reshape_870 [Reshape] outputs: [1464 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_883 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1475
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_883 [Reshape] inputs: [1475 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_883 for ONNX node: Reshape_883
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1477 for ONNX tensor: 1477
[07/07/2022-05:04:22] [V] [TRT] Reshape_883 [Reshape] outputs: [1477 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_896 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1488
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_896 [Reshape] inputs: [1488 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_896 for ONNX node: Reshape_896
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1490 for ONNX tensor: 1490
[07/07/2022-05:04:22] [V] [TRT] Reshape_896 [Reshape] outputs: [1490 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_909 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1501
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_909 [Reshape] inputs: [1501 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_909 for ONNX node: Reshape_909
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1503 for ONNX tensor: 1503
[07/07/2022-05:04:22] [V] [TRT] Reshape_909 [Reshape] outputs: [1503 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_922 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1514
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_922 [Reshape] inputs: [1514 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_922 for ONNX node: Reshape_922
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1516 for ONNX tensor: 1516
[07/07/2022-05:04:22] [V] [TRT] Reshape_922 [Reshape] outputs: [1516 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_935 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1527
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_935 [Reshape] inputs: [1527 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_935 for ONNX node: Reshape_935
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1529 for ONNX tensor: 1529
[07/07/2022-05:04:22] [V] [TRT] Reshape_935 [Reshape] outputs: [1529 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_948 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1540
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_948 [Reshape] inputs: [1540 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_948 for ONNX node: Reshape_948
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1542 for ONNX tensor: 1542
[07/07/2022-05:04:22] [V] [TRT] Reshape_948 [Reshape] outputs: [1542 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_961 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1553
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_961 [Reshape] inputs: [1553 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_961 for ONNX node: Reshape_961
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1555 for ONNX tensor: 1555
[07/07/2022-05:04:22] [V] [TRT] Reshape_961 [Reshape] outputs: [1555 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_974 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1566
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_974 [Reshape] inputs: [1566 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_974 for ONNX node: Reshape_974
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1568 for ONNX tensor: 1568
[07/07/2022-05:04:22] [V] [TRT] Reshape_974 [Reshape] outputs: [1568 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_987 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1579
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_987 [Reshape] inputs: [1579 -> (1, 1, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_987 for ONNX node: Reshape_987
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1581 for ONNX tensor: 1581
[07/07/2022-05:04:22] [V] [TRT] Reshape_987 [Reshape] outputs: [1581 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1180 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1859
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1180 [Reshape] inputs: [1859 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1180 for ONNX node: Reshape_1180
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1861 for ONNX tensor: 1861
[07/07/2022-05:04:22] [V] [TRT] Reshape_1180 [Reshape] outputs: [1861 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1193 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1872
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1193 [Reshape] inputs: [1872 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1193 for ONNX node: Reshape_1193
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1874 for ONNX tensor: 1874
[07/07/2022-05:04:22] [V] [TRT] Reshape_1193 [Reshape] outputs: [1874 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1206 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1885
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1206 [Reshape] inputs: [1885 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1206 for ONNX node: Reshape_1206
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1887 for ONNX tensor: 1887
[07/07/2022-05:04:22] [V] [TRT] Reshape_1206 [Reshape] outputs: [1887 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1219 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1898
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1219 [Reshape] inputs: [1898 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1219 for ONNX node: Reshape_1219
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1900 for ONNX tensor: 1900
[07/07/2022-05:04:22] [V] [TRT] Reshape_1219 [Reshape] outputs: [1900 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1232 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1911
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1232 [Reshape] inputs: [1911 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1232 for ONNX node: Reshape_1232
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1913 for ONNX tensor: 1913
[07/07/2022-05:04:22] [V] [TRT] Reshape_1232 [Reshape] outputs: [1913 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1245 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1924
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1245 [Reshape] inputs: [1924 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1245 for ONNX node: Reshape_1245
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1926 for ONNX tensor: 1926
[07/07/2022-05:04:22] [V] [TRT] Reshape_1245 [Reshape] outputs: [1926 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1258 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1937
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1258 [Reshape] inputs: [1937 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1258 for ONNX node: Reshape_1258
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1939 for ONNX tensor: 1939
[07/07/2022-05:04:22] [V] [TRT] Reshape_1258 [Reshape] outputs: [1939 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1271 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1950
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1271 [Reshape] inputs: [1950 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1271 for ONNX node: Reshape_1271
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1952 for ONNX tensor: 1952
[07/07/2022-05:04:22] [V] [TRT] Reshape_1271 [Reshape] outputs: [1952 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1284 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1963
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1284 [Reshape] inputs: [1963 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1284 for ONNX node: Reshape_1284
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1965 for ONNX tensor: 1965
[07/07/2022-05:04:22] [V] [TRT] Reshape_1284 [Reshape] outputs: [1965 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1297 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1976
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1297 [Reshape] inputs: [1976 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1297 for ONNX node: Reshape_1297
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1978 for ONNX tensor: 1978
[07/07/2022-05:04:22] [V] [TRT] Reshape_1297 [Reshape] outputs: [1978 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1310 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1989
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1310 [Reshape] inputs: [1989 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1310 for ONNX node: Reshape_1310
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1991 for ONNX tensor: 1991
[07/07/2022-05:04:22] [V] [TRT] Reshape_1310 [Reshape] outputs: [1991 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1323 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2002
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1323 [Reshape] inputs: [2002 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1323 for ONNX node: Reshape_1323
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2004 for ONNX tensor: 2004
[07/07/2022-05:04:22] [V] [TRT] Reshape_1323 [Reshape] outputs: [2004 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1336 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2015
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1336 [Reshape] inputs: [2015 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1336 for ONNX node: Reshape_1336
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2017 for ONNX tensor: 2017
[07/07/2022-05:04:22] [V] [TRT] Reshape_1336 [Reshape] outputs: [2017 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1349 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2028
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1349 [Reshape] inputs: [2028 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1349 for ONNX node: Reshape_1349
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2030 for ONNX tensor: 2030
[07/07/2022-05:04:22] [V] [TRT] Reshape_1349 [Reshape] outputs: [2030 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1362 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2041
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1362 [Reshape] inputs: [2041 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1362 for ONNX node: Reshape_1362
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2043 for ONNX tensor: 2043
[07/07/2022-05:04:22] [V] [TRT] Reshape_1362 [Reshape] outputs: [2043 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1375 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2054
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1375 [Reshape] inputs: [2054 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1375 for ONNX node: Reshape_1375
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2056 for ONNX tensor: 2056
[07/07/2022-05:04:22] [V] [TRT] Reshape_1375 [Reshape] outputs: [2056 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1388 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2067
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1388 [Reshape] inputs: [2067 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1388 for ONNX node: Reshape_1388
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2069 for ONNX tensor: 2069
[07/07/2022-05:04:22] [V] [TRT] Reshape_1388 [Reshape] outputs: [2069 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1401 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2080
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1401 [Reshape] inputs: [2080 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1401 for ONNX node: Reshape_1401
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2082 for ONNX tensor: 2082
[07/07/2022-05:04:22] [V] [TRT] Reshape_1401 [Reshape] outputs: [2082 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1414 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2093
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1414 [Reshape] inputs: [2093 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1414 for ONNX node: Reshape_1414
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2095 for ONNX tensor: 2095
[07/07/2022-05:04:22] [V] [TRT] Reshape_1414 [Reshape] outputs: [2095 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1427 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2106
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1427 [Reshape] inputs: [2106 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1427 for ONNX node: Reshape_1427
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2108 for ONNX tensor: 2108
[07/07/2022-05:04:22] [V] [TRT] Reshape_1427 [Reshape] outputs: [2108 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1440 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2119
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1440 [Reshape] inputs: [2119 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1440 for ONNX node: Reshape_1440
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2121 for ONNX tensor: 2121
[07/07/2022-05:04:22] [V] [TRT] Reshape_1440 [Reshape] outputs: [2121 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1453 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2132
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1453 [Reshape] inputs: [2132 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1453 for ONNX node: Reshape_1453
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2134 for ONNX tensor: 2134
[07/07/2022-05:04:22] [V] [TRT] Reshape_1453 [Reshape] outputs: [2134 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1466 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2145
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1466 [Reshape] inputs: [2145 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1466 for ONNX node: Reshape_1466
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2147 for ONNX tensor: 2147
[07/07/2022-05:04:22] [V] [TRT] Reshape_1466 [Reshape] outputs: [2147 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1479 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2158
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1479 [Reshape] inputs: [2158 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1479 for ONNX node: Reshape_1479
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2160 for ONNX tensor: 2160
[07/07/2022-05:04:22] [V] [TRT] Reshape_1479 [Reshape] outputs: [2160 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1492 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2171
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1492 [Reshape] inputs: [2171 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1492 for ONNX node: Reshape_1492
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2173 for ONNX tensor: 2173
[07/07/2022-05:04:22] [V] [TRT] Reshape_1492 [Reshape] outputs: [2173 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1505 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2184
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1505 [Reshape] inputs: [2184 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1505 for ONNX node: Reshape_1505
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2186 for ONNX tensor: 2186
[07/07/2022-05:04:22] [V] [TRT] Reshape_1505 [Reshape] outputs: [2186 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1518 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2197
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1518 [Reshape] inputs: [2197 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1518 for ONNX node: Reshape_1518
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2199 for ONNX tensor: 2199
[07/07/2022-05:04:22] [V] [TRT] Reshape_1518 [Reshape] outputs: [2199 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1531 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2210
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1531 [Reshape] inputs: [2210 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1531 for ONNX node: Reshape_1531
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2212 for ONNX tensor: 2212
[07/07/2022-05:04:22] [V] [TRT] Reshape_1531 [Reshape] outputs: [2212 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1544 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2223
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1544 [Reshape] inputs: [2223 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1544 for ONNX node: Reshape_1544
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2225 for ONNX tensor: 2225
[07/07/2022-05:04:22] [V] [TRT] Reshape_1544 [Reshape] outputs: [2225 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1557 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2236
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1557 [Reshape] inputs: [2236 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1557 for ONNX node: Reshape_1557
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2238 for ONNX tensor: 2238
[07/07/2022-05:04:22] [V] [TRT] Reshape_1557 [Reshape] outputs: [2238 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1570 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2249
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1570 [Reshape] inputs: [2249 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1570 for ONNX node: Reshape_1570
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2251 for ONNX tensor: 2251
[07/07/2022-05:04:22] [V] [TRT] Reshape_1570 [Reshape] outputs: [2251 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1583 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2262
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1177
[07/07/2022-05:04:22] [V] [TRT] Reshape_1583 [Reshape] inputs: [2262 -> (1, 50, 4)[FLOAT]], [1177 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1583 for ONNX node: Reshape_1583
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2264 for ONNX tensor: 2264
[07/07/2022-05:04:22] [V] [TRT] Reshape_1583 [Reshape] outputs: [2264 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Concat_1 [Concat]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 208
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 280
[07/07/2022-05:04:22] [V] [TRT] Concat_1 [Concat] inputs: [208 -> (1, 16384, 64)[FLOAT]], [280 -> (1, 16384, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Concat_1 for ONNX node: Concat_1
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 286 for ONNX tensor: 286
[07/07/2022-05:04:22] [V] [TRT] Concat_1 [Concat] outputs: [286 -> (1, 16384, 128)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Concat2 [Concat]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 375
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 447
[07/07/2022-05:04:22] [V] [TRT] Concat2 [Concat] inputs: [375 -> (1, 4096, 64)[FLOAT]], [447 -> (1, 4096, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Concat2 for ONNX node: Concat2
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 453 for ONNX tensor: 453
[07/07/2022-05:04:22] [V] [TRT] Concat2 [Concat] outputs: [453 -> (1, 4096, 128)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_25 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 286
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2469
[07/07/2022-05:04:22] [V] [TRT] Reshape_25 [Reshape] inputs: [286 -> (1, 16384, 128)[FLOAT]], [2469 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_25 for ONNX node: Reshape_25
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 293 for ONNX tensor: 293
[07/07/2022-05:04:22] [V] [TRT] Reshape_25 [Reshape] outputs: [293 -> (32, 512, 128)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Pow_391 [Pow]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 903
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 551
[07/07/2022-05:04:22] [V] [TRT] Pow_391 [Pow] inputs: [903 -> (32, 4000, 64)[FLOAT]], [551 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 551 for ONNX node: 551
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Pow_391 for ONNX node: Pow_391
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 906 for ONNX tensor: 906
[07/07/2022-05:04:22] [V] [TRT] Pow_391 [Pow] outputs: [906 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Concat_988 [Concat]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1178
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1191
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1204
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1217
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1230
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1243
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1256
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1269
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1282
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1295
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1308
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1321
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1334
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1347
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1360
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1373
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1386
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1399
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1412
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1425
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1438
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1451
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1464
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1477
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1490
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1503
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1516
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1529
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1542
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1555
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1568
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1581
[07/07/2022-05:04:22] [V] [TRT] Concat_988 [Concat] inputs: [1178 -> (1, 4)[FLOAT]], [1191 -> (1, 4)[FLOAT]], [1204 -> (1, 4)[FLOAT]], [1217 -> (1, 4)[FLOAT]], [1230 -> (1, 4)[FLOAT]], [1243 -> (1, 4)[FLOAT]], [1256 -> (1, 4)[FLOAT]], [1269 -> (1, 4)[FLOAT]], [1282 -> (1, 4)[FLOAT]], [1295 -> (1, 4)[FLOAT]], [1308 -> (1, 4)[FLOAT]], [1321 -> (1, 4)[FLOAT]], [1334 -> (1, 4)[FLOAT]], [1347 -> (1, 4)[FLOAT]], [1360 -> (1, 4)[FLOAT]], [1373 -> (1, 4)[FLOAT]], [1386 -> (1, 4)[FLOAT]], [1399 -> (1, 4)[FLOAT]], [1412 -> (1, 4)[FLOAT]], [1425 -> (1, 4)[FLOAT]], [1438 -> (1, 4)[FLOAT]], [1451 -> (1, 4)[FLOAT]], [1464 -> (1, 4)[FLOAT]], [1477 -> (1, 4)[FLOAT]], [1490 -> (1, 4)[FLOAT]], [1503 -> (1, 4)[FLOAT]], [1516 -> (1, 4)[FLOAT]], [1529 -> (1, 4)[FLOAT]], [1542 -> (1, 4)[FLOAT]], [1555 -> (1, 4)[FLOAT]], [1568 -> (1, 4)[FLOAT]], [1581 -> (1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Concat_988 for ONNX node: Concat_988
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1582 for ONNX tensor: 1582
[07/07/2022-05:04:22] [V] [TRT] Concat_988 [Concat] outputs: [1582 -> (32, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Concat_1584 [Concat]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1861
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1874
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1887
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1900
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1913
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1926
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1939
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1952
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1965
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1978
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1991
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2004
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2017
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2030
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2043
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2056
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2069
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2082
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2095
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2108
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2121
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2134
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2147
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2160
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2173
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2186
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2199
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2212
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2225
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2238
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2251
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2264
[07/07/2022-05:04:22] [V] [TRT] Concat_1584 [Concat] inputs: [1861 -> (50, 4)[FLOAT]], [1874 -> (50, 4)[FLOAT]], [1887 -> (50, 4)[FLOAT]], [1900 -> (50, 4)[FLOAT]], [1913 -> (50, 4)[FLOAT]], [1926 -> (50, 4)[FLOAT]], [1939 -> (50, 4)[FLOAT]], [1952 -> (50, 4)[FLOAT]], [1965 -> (50, 4)[FLOAT]], [1978 -> (50, 4)[FLOAT]], [1991 -> (50, 4)[FLOAT]], [2004 -> (50, 4)[FLOAT]], [2017 -> (50, 4)[FLOAT]], [2030 -> (50, 4)[FLOAT]], [2043 -> (50, 4)[FLOAT]], [2056 -> (50, 4)[FLOAT]], [2069 -> (50, 4)[FLOAT]], [2082 -> (50, 4)[FLOAT]], [2095 -> (50, 4)[FLOAT]], [2108 -> (50, 4)[FLOAT]], [2121 -> (50, 4)[FLOAT]], [2134 -> (50, 4)[FLOAT]], [2147 -> (50, 4)[FLOAT]], [2160 -> (50, 4)[FLOAT]], [2173 -> (50, 4)[FLOAT]], [2186 -> (50, 4)[FLOAT]], [2199 -> (50, 4)[FLOAT]], [2212 -> (50, 4)[FLOAT]], [2225 -> (50, 4)[FLOAT]], [2238 -> (50, 4)[FLOAT]], [2251 -> (50, 4)[FLOAT]], [2264 -> (50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Concat_1584 for ONNX node: Concat_1584
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2265 for ONNX tensor: 2265
[07/07/2022-05:04:22] [V] [TRT] Concat_1584 [Concat] outputs: [2265 -> (1600, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_51 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 453
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2521
[07/07/2022-05:04:22] [V] [TRT] Reshape_51 [Reshape] inputs: [453 -> (1, 4096, 128)[FLOAT]], [2521 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_51 for ONNX node: Reshape_51
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 460 for ONNX tensor: 460
[07/07/2022-05:04:22] [V] [TRT] Reshape_51 [Reshape] outputs: [460 -> (32, 128, 128)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_55 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 293
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2523
[07/07/2022-05:04:22] [V] [TRT] MatMul_55 [MatMul] inputs: [293 -> (32, 512, 128)[FLOAT]], [2523 -> (128, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2523 for ONNX node: 2523
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_55 for ONNX node: MatMul_55
[07/07/2022-05:04:22] [I] [TRT] MatMul_55: broadcasting input1 to make tensors conform, dims(input0)=[32,512,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 466 for ONNX tensor: 466
[07/07/2022-05:04:22] [V] [TRT] MatMul_55 [MatMul] outputs: [466 -> (32, 512, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_392 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 906
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_392 [ReduceMean] inputs: [906 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_392 for ONNX node: ReduceMean_392
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 907 for ONNX tensor: 907
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_392 [ReduceMean] outputs: [907 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Slice_1018 [Slice]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1582
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2562
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1040
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2443
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2443
[07/07/2022-05:04:22] [V] [TRT] Slice_1018 [Slice] inputs: [1582 -> (32, 4)[FLOAT]], [2562 -> (1)[INT32]], [1040 -> (1)[INT32]], [2443 -> (1)[INT32]], [2443 -> (1)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Slice_1018 for ONNX node: Slice_1018
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1612 for ONNX tensor: 1612
[07/07/2022-05:04:22] [V] [TRT] Slice_1018 [Slice] outputs: [1612 -> (32, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Slice_1614 [Slice]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2265
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2562
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1040
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2443
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2443
[07/07/2022-05:04:22] [V] [TRT] Slice_1614 [Slice] inputs: [2265 -> (1600, 4)[FLOAT]], [2562 -> (1)[INT32]], [1040 -> (1)[INT32]], [2443 -> (1)[INT32]], [2443 -> (1)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Slice_1614 for ONNX node: Slice_1614
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2295 for ONNX tensor: 2295
[07/07/2022-05:04:22] [V] [TRT] Slice_1614 [Slice] outputs: [2295 -> (1600, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_52 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 460
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2522
[07/07/2022-05:04:22] [V] [TRT] MatMul_52 [MatMul] inputs: [460 -> (32, 128, 128)[FLOAT]], [2522 -> (128, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2522 for ONNX node: 2522
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_52 for ONNX node: MatMul_52
[07/07/2022-05:04:22] [I] [TRT] MatMul_52: broadcasting input1 to make tensors conform, dims(input0)=[32,128,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 462 for ONNX tensor: 462
[07/07/2022-05:04:22] [V] [TRT] MatMul_52 [MatMul] outputs: [462 -> (32, 128, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_56 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: fc0_lane.0.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 466
[07/07/2022-05:04:22] [V] [TRT] Add_56 [Add] inputs: [fc0_lane.0.bias -> (64)[FLOAT]], [466 -> (32, 512, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: fc0_lane.0.bias for ONNX node: fc0_lane.0.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_56 for ONNX node: Add_56
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 467 for ONNX tensor: 467
[07/07/2022-05:04:22] [V] [TRT] Add_56 [Add] outputs: [467 -> (32, 512, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_394 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 907
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2541
[07/07/2022-05:04:22] [V] [TRT] Add_394 [Add] inputs: [907 -> (32, 4000, 1)[FLOAT]], [2541 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2541 for ONNX node: 2541
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_394 for ONNX node: Add_394
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 909 for ONNX tensor: 909
[07/07/2022-05:04:22] [V] [TRT] Add_394 [Add] outputs: [909 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1020 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1612
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1613
[07/07/2022-05:04:22] [V] [TRT] Reshape_1020 [Reshape] inputs: [1612 -> (32, 4)[FLOAT]], [1613 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1020 for ONNX node: Reshape_1020
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1614 for ONNX tensor: 1614
[07/07/2022-05:04:22] [V] [TRT] Reshape_1020 [Reshape] outputs: [1614 -> (32, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1616 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2295
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1613
[07/07/2022-05:04:22] [V] [TRT] Reshape_1616 [Reshape] inputs: [2295 -> (1600, 4)[FLOAT]], [1613 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1616 for ONNX node: Reshape_1616
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2297 for ONNX tensor: 2297
[07/07/2022-05:04:22] [V] [TRT] Reshape_1616 [Reshape] outputs: [2297 -> (1600, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_53 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: fc0_agent.0.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 462
[07/07/2022-05:04:22] [V] [TRT] Add_53 [Add] inputs: [fc0_agent.0.bias -> (64)[FLOAT]], [462 -> (32, 128, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: fc0_agent.0.bias for ONNX node: fc0_agent.0.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_53 for ONNX node: Add_53
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 463 for ONNX tensor: 463
[07/07/2022-05:04:22] [V] [TRT] Add_53 [Add] outputs: [463 -> (32, 128, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_57 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 467
[07/07/2022-05:04:22] [V] [TRT] Relu_57 [Relu] inputs: [467 -> (32, 512, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_57 for ONNX node: Relu_57
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 468 for ONNX tensor: 468
[07/07/2022-05:04:22] [V] [TRT] Relu_57 [Relu] outputs: [468 -> (32, 512, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sqrt_395 [Sqrt]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 909
[07/07/2022-05:04:22] [V] [TRT] Sqrt_395 [Sqrt] inputs: [909 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sqrt_395 for ONNX node: Sqrt_395
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 910 for ONNX tensor: 910
[07/07/2022-05:04:22] [V] [TRT] Sqrt_395 [Sqrt] outputs: [910 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_54 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 463
[07/07/2022-05:04:22] [V] [TRT] Relu_54 [Relu] inputs: [463 -> (32, 128, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_54 for ONNX node: Relu_54
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 464 for ONNX tensor: 464
[07/07/2022-05:04:22] [V] [TRT] Relu_54 [Relu] outputs: [464 -> (32, 128, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Div_396 [Div]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 903
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 910
[07/07/2022-05:04:22] [V] [TRT] Div_396 [Div] inputs: [903 -> (32, 4000, 64)[FLOAT]], [910 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Div_396 for ONNX node: Div_396
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 911 for ONNX tensor: 911
[07/07/2022-05:04:22] [V] [TRT] Div_396 [Div] outputs: [911 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Concat_58 [Concat]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 464
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 468
[07/07/2022-05:04:22] [V] [TRT] Concat_58 [Concat] inputs: [464 -> (32, 128, 64)[FLOAT]], [468 -> (32, 512, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Concat_58 for ONNX node: Concat_58
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 469 for ONNX tensor: 469
[07/07/2022-05:04:22] [V] [TRT] Concat_58 [Concat] outputs: [469 -> (32, 640, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Mul_397 [Mul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 911
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cg0.fc1.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Mul_397 [Mul] inputs: [911 -> (32, 4000, 64)[FLOAT]], [cg0.fc1.act.0.weight -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cg0.fc1.act.0.weight for ONNX node: cg0.fc1.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Mul_397 for ONNX node: Mul_397
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 912 for ONNX tensor: 912
[07/07/2022-05:04:22] [V] [TRT] Mul_397 [Mul] outputs: [912 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_60 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 469
[07/07/2022-05:04:22] [V] [TRT] Transpose_60 [Transpose] inputs: [469 -> (32, 640, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_60 for ONNX node: Transpose_60
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 471 for ONNX tensor: 471
[07/07/2022-05:04:22] [V] [TRT] Transpose_60 [Transpose] outputs: [471 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_398 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 912
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cg0.fc1.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Add_398 [Add] inputs: [912 -> (32, 4000, 64)[FLOAT]], [cg0.fc1.act.0.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cg0.fc1.act.0.bias for ONNX node: cg0.fc1.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_398 for ONNX node: Add_398
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 913 for ONNX tensor: 913
[07/07/2022-05:04:22] [V] [TRT] Add_398 [Add] outputs: [913 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_70 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 471
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2525
[07/07/2022-05:04:22] [V] [TRT] MatMul_70 [MatMul] inputs: [471 -> (640, 32, 64)[FLOAT]], [2525 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2525 for ONNX node: 2525
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_70 for ONNX node: MatMul_70
[07/07/2022-05:04:22] [I] [TRT] MatMul_70: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 486 for ONNX tensor: 486
[07/07/2022-05:04:22] [V] [TRT] MatMul_70 [MatMul] outputs: [486 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_72 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 471
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2526
[07/07/2022-05:04:22] [V] [TRT] MatMul_72 [MatMul] inputs: [471 -> (640, 32, 64)[FLOAT]], [2526 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2526 for ONNX node: 2526
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_72 for ONNX node: MatMul_72
[07/07/2022-05:04:22] [I] [TRT] MatMul_72: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 489 for ONNX tensor: 489
[07/07/2022-05:04:22] [V] [TRT] MatMul_72 [MatMul] outputs: [489 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_74 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 471
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2527
[07/07/2022-05:04:22] [V] [TRT] MatMul_74 [MatMul] inputs: [471 -> (640, 32, 64)[FLOAT]], [2527 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2527 for ONNX node: 2527
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_74 for ONNX node: MatMul_74
[07/07/2022-05:04:22] [I] [TRT] MatMul_74: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 492 for ONNX tensor: 492
[07/07/2022-05:04:22] [V] [TRT] MatMul_74 [MatMul] outputs: [492 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_399 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 913
[07/07/2022-05:04:22] [V] [TRT] Relu_399 [Relu] inputs: [913 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_399 for ONNX node: Relu_399
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 914 for ONNX tensor: 914
[07/07/2022-05:04:22] [V] [TRT] Relu_399 [Relu] outputs: [914 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_71 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: interaction.attn_layers.0.q_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 486
[07/07/2022-05:04:22] [V] [TRT] Add_71 [Add] inputs: [interaction.attn_layers.0.q_proj.bias -> (64)[FLOAT]], [486 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: interaction.attn_layers.0.q_proj.bias for ONNX node: interaction.attn_layers.0.q_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_71 for ONNX node: Add_71
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 487 for ONNX tensor: 487
[07/07/2022-05:04:22] [V] [TRT] Add_71 [Add] outputs: [487 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_73 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: interaction.attn_layers.0.k_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 489
[07/07/2022-05:04:22] [V] [TRT] Add_73 [Add] inputs: [interaction.attn_layers.0.k_proj.bias -> (64)[FLOAT]], [489 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: interaction.attn_layers.0.k_proj.bias for ONNX node: interaction.attn_layers.0.k_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_73 for ONNX node: Add_73
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 490 for ONNX tensor: 490
[07/07/2022-05:04:22] [V] [TRT] Add_73 [Add] outputs: [490 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_75 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: interaction.attn_layers.0.v_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 492
[07/07/2022-05:04:22] [V] [TRT] Add_75 [Add] inputs: [interaction.attn_layers.0.v_proj.bias -> (64)[FLOAT]], [492 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: interaction.attn_layers.0.v_proj.bias for ONNX node: interaction.attn_layers.0.v_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_75 for ONNX node: Add_75
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 493 for ONNX tensor: 493
[07/07/2022-05:04:22] [V] [TRT] Add_75 [Add] outputs: [493 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_400 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 914
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2590
[07/07/2022-05:04:22] [V] [TRT] MatMul_400 [MatMul] inputs: [914 -> (32, 4000, 64)[FLOAT]], [2590 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2590 for ONNX node: 2590
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_400 for ONNX node: MatMul_400
[07/07/2022-05:04:22] [I] [TRT] MatMul_400: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 916 for ONNX tensor: 916
[07/07/2022-05:04:22] [V] [TRT] MatMul_400 [MatMul] outputs: [916 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_76 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 487
[07/07/2022-05:04:22] [V] [TRT] Relu_76 [Relu] inputs: [487 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_76 for ONNX node: Relu_76
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 494 for ONNX tensor: 494
[07/07/2022-05:04:22] [V] [TRT] Relu_76 [Relu] outputs: [494 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_77 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 490
[07/07/2022-05:04:22] [V] [TRT] Relu_77 [Relu] inputs: [490 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_77 for ONNX node: Relu_77
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 495 for ONNX tensor: 495
[07/07/2022-05:04:22] [V] [TRT] Relu_77 [Relu] outputs: [495 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_81 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 493
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2531
[07/07/2022-05:04:22] [V] [TRT] Reshape_81 [Reshape] inputs: [493 -> (640, 32, 64)[FLOAT]], [2531 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_81 for ONNX node: Reshape_81
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 517 for ONNX tensor: 517
[07/07/2022-05:04:22] [V] [TRT] Reshape_81 [Reshape] outputs: [517 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_401 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cg0.fc1.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 916
[07/07/2022-05:04:22] [V] [TRT] Add_401 [Add] inputs: [cg0.fc1.fc2.bias -> (64)[FLOAT]], [916 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cg0.fc1.fc2.bias for ONNX node: cg0.fc1.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_401 for ONNX node: Add_401
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 917 for ONNX tensor: 917
[07/07/2022-05:04:22] [V] [TRT] Add_401 [Add] outputs: [917 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_78 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 494
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2531
[07/07/2022-05:04:22] [V] [TRT] Reshape_78 [Reshape] inputs: [494 -> (640, 32, 64)[FLOAT]], [2531 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_78 for ONNX node: Reshape_78
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 502 for ONNX tensor: 502
[07/07/2022-05:04:22] [V] [TRT] Reshape_78 [Reshape] outputs: [502 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_80 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 495
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2531
[07/07/2022-05:04:22] [V] [TRT] Reshape_80 [Reshape] inputs: [495 -> (640, 32, 64)[FLOAT]], [2531 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_80 for ONNX node: Reshape_80
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 510 for ONNX tensor: 510
[07/07/2022-05:04:22] [V] [TRT] Reshape_80 [Reshape] outputs: [510 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_82 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 517
[07/07/2022-05:04:22] [V] [TRT] Transpose_82 [Transpose] inputs: [517 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_82 for ONNX node: Transpose_82
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 518 for ONNX tensor: 518
[07/07/2022-05:04:22] [V] [TRT] Transpose_82 [Transpose] outputs: [518 -> (32, 640, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_79 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 502
[07/07/2022-05:04:22] [V] [TRT] Transpose_79 [Transpose] inputs: [502 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_79 for ONNX node: Transpose_79
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 503 for ONNX tensor: 503
[07/07/2022-05:04:22] [V] [TRT] Transpose_79 [Transpose] outputs: [503 -> (32, 640, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_83 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 510
[07/07/2022-05:04:22] [V] [TRT] Transpose_83 [Transpose] inputs: [510 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_83 for ONNX node: Transpose_83
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 519 for ONNX tensor: 519
[07/07/2022-05:04:22] [V] [TRT] Transpose_83 [Transpose] outputs: [519 -> (32, 64, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_84 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 503
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 519
[07/07/2022-05:04:22] [V] [TRT] MatMul_84 [MatMul] inputs: [503 -> (32, 640, 64)[FLOAT]], [519 -> (32, 64, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_84 for ONNX node: MatMul_84
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 520 for ONNX tensor: 520
[07/07/2022-05:04:22] [V] [TRT] MatMul_84 [MatMul] outputs: [520 -> (32, 640, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Where_93 [Where]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 527
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 526
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 520
[07/07/2022-05:04:22] [V] [TRT] Where_93 [Where] inputs: [527 -> (32, 640, 640)[BOOL]], [526 -> ()[FLOAT]], [520 -> (32, 640, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Where_93 for ONNX node: Where_93
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 530 for ONNX tensor: 530
[07/07/2022-05:04:22] [V] [TRT] Where_93 [Where] outputs: [530 -> (32, 640, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceSum_94 [ReduceSum]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 530
[07/07/2022-05:04:22] [V] [TRT] ReduceSum_94 [ReduceSum] inputs: [530 -> (32, 640, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceSum_94 for ONNX node: ReduceSum_94
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 531 for ONNX tensor: 531
[07/07/2022-05:04:22] [V] [TRT] ReduceSum_94 [ReduceSum] outputs: [531 -> (32, 640, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Clip_95 [Clip]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 531
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2541
[07/07/2022-05:04:22] [V] [TRT] Clip_95 [Clip] inputs: [531 -> (32, 640, 1)[FLOAT]], [2541 -> ()[FLOAT]], [optional input, not set], 
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 535 for ONNX tensor: 535
[07/07/2022-05:04:22] [V] [TRT] Clip_95 [Clip] outputs: [535 -> (32, 640, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Div_96 [Div]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 530
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 535
[07/07/2022-05:04:22] [V] [TRT] Div_96 [Div] inputs: [530 -> (32, 640, 640)[FLOAT]], [535 -> (32, 640, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Div_96 for ONNX node: Div_96
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 536 for ONNX tensor: 536
[07/07/2022-05:04:22] [V] [TRT] Div_96 [Div] outputs: [536 -> (32, 640, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_97 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 536
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 518
[07/07/2022-05:04:22] [V] [TRT] MatMul_97 [MatMul] inputs: [536 -> (32, 640, 640)[FLOAT]], [518 -> (32, 640, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_97 for ONNX node: MatMul_97
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 537 for ONNX tensor: 537
[07/07/2022-05:04:22] [V] [TRT] MatMul_97 [MatMul] outputs: [537 -> (32, 640, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_98 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 537
[07/07/2022-05:04:22] [V] [TRT] Transpose_98 [Transpose] inputs: [537 -> (32, 640, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_98 for ONNX node: Transpose_98
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 538 for ONNX tensor: 538
[07/07/2022-05:04:22] [V] [TRT] Transpose_98 [Transpose] outputs: [538 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_99 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 538
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2545
[07/07/2022-05:04:22] [V] [TRT] Reshape_99 [Reshape] inputs: [538 -> (640, 32, 64)[FLOAT]], [2545 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_99 for ONNX node: Reshape_99
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 544 for ONNX tensor: 544
[07/07/2022-05:04:22] [V] [TRT] Reshape_99 [Reshape] outputs: [544 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_100 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 544
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2546
[07/07/2022-05:04:22] [V] [TRT] MatMul_100 [MatMul] inputs: [544 -> (640, 32, 64)[FLOAT]], [2546 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2546 for ONNX node: 2546
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_100 for ONNX node: MatMul_100
[07/07/2022-05:04:22] [I] [TRT] MatMul_100: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 546 for ONNX tensor: 546
[07/07/2022-05:04:22] [V] [TRT] MatMul_100 [MatMul] outputs: [546 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_101 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: interaction.attn_layers.0.out_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 546
[07/07/2022-05:04:22] [V] [TRT] Add_101 [Add] inputs: [interaction.attn_layers.0.out_proj.bias -> (64)[FLOAT]], [546 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: interaction.attn_layers.0.out_proj.bias for ONNX node: interaction.attn_layers.0.out_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_101 for ONNX node: Add_101
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 547 for ONNX tensor: 547
[07/07/2022-05:04:22] [V] [TRT] Add_101 [Add] outputs: [547 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_102 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 547
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 471
[07/07/2022-05:04:22] [V] [TRT] Add_102 [Add] inputs: [547 -> (640, 32, 64)[FLOAT]], [471 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_102 for ONNX node: Add_102
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 548 for ONNX tensor: 548
[07/07/2022-05:04:22] [V] [TRT] Add_102 [Add] outputs: [548 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_103 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 548
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_103 [ReduceMean] inputs: [548 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_103 for ONNX node: ReduceMean_103
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 549 for ONNX tensor: 549
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_103 [ReduceMean] outputs: [549 -> (640, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sub_104 [Sub]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 548
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 549
[07/07/2022-05:04:22] [V] [TRT] Sub_104 [Sub] inputs: [548 -> (640, 32, 64)[FLOAT]], [549 -> (640, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sub_104 for ONNX node: Sub_104
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 550 for ONNX tensor: 550
[07/07/2022-05:04:22] [V] [TRT] Sub_104 [Sub] outputs: [550 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Pow_106 [Pow]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 550
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 551
[07/07/2022-05:04:22] [V] [TRT] Pow_106 [Pow] inputs: [550 -> (640, 32, 64)[FLOAT]], [551 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Pow_106 for ONNX node: Pow_106
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 552 for ONNX tensor: 552
[07/07/2022-05:04:22] [V] [TRT] Pow_106 [Pow] outputs: [552 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_107 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 552
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_107 [ReduceMean] inputs: [552 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_107 for ONNX node: ReduceMean_107
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 553 for ONNX tensor: 553
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_107 [ReduceMean] outputs: [553 -> (640, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_109 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 553
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2541
[07/07/2022-05:04:22] [V] [TRT] Add_109 [Add] inputs: [553 -> (640, 32, 1)[FLOAT]], [2541 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_109 for ONNX node: Add_109
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 555 for ONNX tensor: 555
[07/07/2022-05:04:22] [V] [TRT] Add_109 [Add] outputs: [555 -> (640, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sqrt_110 [Sqrt]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 555
[07/07/2022-05:04:22] [V] [TRT] Sqrt_110 [Sqrt] inputs: [555 -> (640, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sqrt_110 for ONNX node: Sqrt_110
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 556 for ONNX tensor: 556
[07/07/2022-05:04:22] [V] [TRT] Sqrt_110 [Sqrt] outputs: [556 -> (640, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Div_111 [Div]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 550
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 556
[07/07/2022-05:04:22] [V] [TRT] Div_111 [Div] inputs: [550 -> (640, 32, 64)[FLOAT]], [556 -> (640, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Div_111 for ONNX node: Div_111
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 557 for ONNX tensor: 557
[07/07/2022-05:04:22] [V] [TRT] Div_111 [Div] outputs: [557 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Mul_112 [Mul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 557
[07/07/2022-05:04:22] [V] [TRT] Searching for input: interaction.attn_layers.0.layer_norm.weight
[07/07/2022-05:04:22] [V] [TRT] Mul_112 [Mul] inputs: [557 -> (640, 32, 64)[FLOAT]], [interaction.attn_layers.0.layer_norm.weight -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: interaction.attn_layers.0.layer_norm.weight for ONNX node: interaction.attn_layers.0.layer_norm.weight
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Mul_112 for ONNX node: Mul_112
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 558 for ONNX tensor: 558
[07/07/2022-05:04:22] [V] [TRT] Mul_112 [Mul] outputs: [558 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_113 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 558
[07/07/2022-05:04:22] [V] [TRT] Searching for input: interaction.attn_layers.0.layer_norm.bias
[07/07/2022-05:04:22] [V] [TRT] Add_113 [Add] inputs: [558 -> (640, 32, 64)[FLOAT]], [interaction.attn_layers.0.layer_norm.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: interaction.attn_layers.0.layer_norm.bias for ONNX node: interaction.attn_layers.0.layer_norm.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_113 for ONNX node: Add_113
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 559 for ONNX tensor: 559
[07/07/2022-05:04:22] [V] [TRT] Add_113 [Add] outputs: [559 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_127 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 559
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2547
[07/07/2022-05:04:22] [V] [TRT] MatMul_127 [MatMul] inputs: [559 -> (640, 32, 64)[FLOAT]], [2547 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2547 for ONNX node: 2547
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_127 for ONNX node: MatMul_127
[07/07/2022-05:04:22] [I] [TRT] MatMul_127: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 574 for ONNX tensor: 574
[07/07/2022-05:04:22] [V] [TRT] MatMul_127 [MatMul] outputs: [574 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_129 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 559
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2548
[07/07/2022-05:04:22] [V] [TRT] MatMul_129 [MatMul] inputs: [559 -> (640, 32, 64)[FLOAT]], [2548 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2548 for ONNX node: 2548
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_129 for ONNX node: MatMul_129
[07/07/2022-05:04:22] [I] [TRT] MatMul_129: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 577 for ONNX tensor: 577
[07/07/2022-05:04:22] [V] [TRT] MatMul_129 [MatMul] outputs: [577 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_131 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 559
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2549
[07/07/2022-05:04:22] [V] [TRT] MatMul_131 [MatMul] inputs: [559 -> (640, 32, 64)[FLOAT]], [2549 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2549 for ONNX node: 2549
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_131 for ONNX node: MatMul_131
[07/07/2022-05:04:22] [I] [TRT] MatMul_131: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 580 for ONNX tensor: 580
[07/07/2022-05:04:22] [V] [TRT] MatMul_131 [MatMul] outputs: [580 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_128 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: interaction.attn_layers.1.q_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 574
[07/07/2022-05:04:22] [V] [TRT] Add_128 [Add] inputs: [interaction.attn_layers.1.q_proj.bias -> (64)[FLOAT]], [574 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: interaction.attn_layers.1.q_proj.bias for ONNX node: interaction.attn_layers.1.q_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_128 for ONNX node: Add_128
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 575 for ONNX tensor: 575
[07/07/2022-05:04:22] [V] [TRT] Add_128 [Add] outputs: [575 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_130 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: interaction.attn_layers.1.k_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 577
[07/07/2022-05:04:22] [V] [TRT] Add_130 [Add] inputs: [interaction.attn_layers.1.k_proj.bias -> (64)[FLOAT]], [577 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: interaction.attn_layers.1.k_proj.bias for ONNX node: interaction.attn_layers.1.k_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_130 for ONNX node: Add_130
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 578 for ONNX tensor: 578
[07/07/2022-05:04:22] [V] [TRT] Add_130 [Add] outputs: [578 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_132 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: interaction.attn_layers.1.v_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 580
[07/07/2022-05:04:22] [V] [TRT] Add_132 [Add] inputs: [interaction.attn_layers.1.v_proj.bias -> (64)[FLOAT]], [580 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: interaction.attn_layers.1.v_proj.bias for ONNX node: interaction.attn_layers.1.v_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_132 for ONNX node: Add_132
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 581 for ONNX tensor: 581
[07/07/2022-05:04:22] [V] [TRT] Add_132 [Add] outputs: [581 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_133 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 575
[07/07/2022-05:04:22] [V] [TRT] Relu_133 [Relu] inputs: [575 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_133 for ONNX node: Relu_133
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 582 for ONNX tensor: 582
[07/07/2022-05:04:22] [V] [TRT] Relu_133 [Relu] outputs: [582 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_134 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 578
[07/07/2022-05:04:22] [V] [TRT] Relu_134 [Relu] inputs: [578 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_134 for ONNX node: Relu_134
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 583 for ONNX tensor: 583
[07/07/2022-05:04:22] [V] [TRT] Relu_134 [Relu] outputs: [583 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_153 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 581
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2531
[07/07/2022-05:04:22] [V] [TRT] Reshape_153 [Reshape] inputs: [581 -> (640, 32, 64)[FLOAT]], [2531 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_153 for ONNX node: Reshape_153
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 608 for ONNX tensor: 608
[07/07/2022-05:04:22] [V] [TRT] Reshape_153 [Reshape] outputs: [608 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_140 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 582
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2531
[07/07/2022-05:04:22] [V] [TRT] Reshape_140 [Reshape] inputs: [582 -> (640, 32, 64)[FLOAT]], [2531 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_140 for ONNX node: Reshape_140
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 591 for ONNX tensor: 591
[07/07/2022-05:04:22] [V] [TRT] Reshape_140 [Reshape] outputs: [591 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_147 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 583
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2531
[07/07/2022-05:04:22] [V] [TRT] Reshape_147 [Reshape] inputs: [583 -> (640, 32, 64)[FLOAT]], [2531 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_147 for ONNX node: Reshape_147
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 600 for ONNX tensor: 600
[07/07/2022-05:04:22] [V] [TRT] Reshape_147 [Reshape] outputs: [600 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_154 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 608
[07/07/2022-05:04:22] [V] [TRT] Transpose_154 [Transpose] inputs: [608 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_154 for ONNX node: Transpose_154
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 609 for ONNX tensor: 609
[07/07/2022-05:04:22] [V] [TRT] Transpose_154 [Transpose] outputs: [609 -> (32, 640, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_141 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 591
[07/07/2022-05:04:22] [V] [TRT] Transpose_141 [Transpose] inputs: [591 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_141 for ONNX node: Transpose_141
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 592 for ONNX tensor: 592
[07/07/2022-05:04:22] [V] [TRT] Transpose_141 [Transpose] outputs: [592 -> (32, 640, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_155 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 600
[07/07/2022-05:04:22] [V] [TRT] Transpose_155 [Transpose] inputs: [600 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_155 for ONNX node: Transpose_155
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 610 for ONNX tensor: 610
[07/07/2022-05:04:22] [V] [TRT] Transpose_155 [Transpose] outputs: [610 -> (32, 64, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_156 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 592
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 610
[07/07/2022-05:04:22] [V] [TRT] MatMul_156 [MatMul] inputs: [592 -> (32, 640, 64)[FLOAT]], [610 -> (32, 64, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_156 for ONNX node: MatMul_156
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 611 for ONNX tensor: 611
[07/07/2022-05:04:22] [V] [TRT] MatMul_156 [MatMul] outputs: [611 -> (32, 640, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Where_165 [Where]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 618
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 526
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 611
[07/07/2022-05:04:22] [V] [TRT] Where_165 [Where] inputs: [618 -> (32, 640, 640)[BOOL]], [526 -> ()[FLOAT]], [611 -> (32, 640, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Where_165 for ONNX node: Where_165
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 621 for ONNX tensor: 621
[07/07/2022-05:04:22] [V] [TRT] Where_165 [Where] outputs: [621 -> (32, 640, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceSum_166 [ReduceSum]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 621
[07/07/2022-05:04:22] [V] [TRT] ReduceSum_166 [ReduceSum] inputs: [621 -> (32, 640, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceSum_166 for ONNX node: ReduceSum_166
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 622 for ONNX tensor: 622
[07/07/2022-05:04:22] [V] [TRT] ReduceSum_166 [ReduceSum] outputs: [622 -> (32, 640, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Clip_167 [Clip]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 622
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2541
[07/07/2022-05:04:22] [V] [TRT] Clip_167 [Clip] inputs: [622 -> (32, 640, 1)[FLOAT]], [2541 -> ()[FLOAT]], [optional input, not set], 
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 626 for ONNX tensor: 626
[07/07/2022-05:04:22] [V] [TRT] Clip_167 [Clip] outputs: [626 -> (32, 640, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Div_168 [Div]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 621
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 626
[07/07/2022-05:04:22] [V] [TRT] Div_168 [Div] inputs: [621 -> (32, 640, 640)[FLOAT]], [626 -> (32, 640, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Div_168 for ONNX node: Div_168
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 627 for ONNX tensor: 627
[07/07/2022-05:04:22] [V] [TRT] Div_168 [Div] outputs: [627 -> (32, 640, 640)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_169 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 627
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 609
[07/07/2022-05:04:22] [V] [TRT] MatMul_169 [MatMul] inputs: [627 -> (32, 640, 640)[FLOAT]], [609 -> (32, 640, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_169 for ONNX node: MatMul_169
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 628 for ONNX tensor: 628
[07/07/2022-05:04:22] [V] [TRT] MatMul_169 [MatMul] outputs: [628 -> (32, 640, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_170 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 628
[07/07/2022-05:04:22] [V] [TRT] Transpose_170 [Transpose] inputs: [628 -> (32, 640, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_170 for ONNX node: Transpose_170
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 629 for ONNX tensor: 629
[07/07/2022-05:04:22] [V] [TRT] Transpose_170 [Transpose] outputs: [629 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_174 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 629
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2545
[07/07/2022-05:04:22] [V] [TRT] Reshape_174 [Reshape] inputs: [629 -> (640, 32, 64)[FLOAT]], [2545 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_174 for ONNX node: Reshape_174
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 635 for ONNX tensor: 635
[07/07/2022-05:04:22] [V] [TRT] Reshape_174 [Reshape] outputs: [635 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_175 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 635
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2556
[07/07/2022-05:04:22] [V] [TRT] MatMul_175 [MatMul] inputs: [635 -> (640, 32, 64)[FLOAT]], [2556 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2556 for ONNX node: 2556
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_175 for ONNX node: MatMul_175
[07/07/2022-05:04:22] [I] [TRT] MatMul_175: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 637 for ONNX tensor: 637
[07/07/2022-05:04:22] [V] [TRT] MatMul_175 [MatMul] outputs: [637 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_176 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: interaction.attn_layers.1.out_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 637
[07/07/2022-05:04:22] [V] [TRT] Add_176 [Add] inputs: [interaction.attn_layers.1.out_proj.bias -> (64)[FLOAT]], [637 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: interaction.attn_layers.1.out_proj.bias for ONNX node: interaction.attn_layers.1.out_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_176 for ONNX node: Add_176
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 638 for ONNX tensor: 638
[07/07/2022-05:04:22] [V] [TRT] Add_176 [Add] outputs: [638 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_177 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 638
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 559
[07/07/2022-05:04:22] [V] [TRT] Add_177 [Add] inputs: [638 -> (640, 32, 64)[FLOAT]], [559 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_177 for ONNX node: Add_177
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 639 for ONNX tensor: 639
[07/07/2022-05:04:22] [V] [TRT] Add_177 [Add] outputs: [639 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_178 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 639
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_178 [ReduceMean] inputs: [639 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_178 for ONNX node: ReduceMean_178
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 640 for ONNX tensor: 640
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_178 [ReduceMean] outputs: [640 -> (640, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sub_179 [Sub]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 639
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 640
[07/07/2022-05:04:22] [V] [TRT] Sub_179 [Sub] inputs: [639 -> (640, 32, 64)[FLOAT]], [640 -> (640, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sub_179 for ONNX node: Sub_179
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 641 for ONNX tensor: 641
[07/07/2022-05:04:22] [V] [TRT] Sub_179 [Sub] outputs: [641 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Pow_181 [Pow]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 641
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 551
[07/07/2022-05:04:22] [V] [TRT] Pow_181 [Pow] inputs: [641 -> (640, 32, 64)[FLOAT]], [551 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Pow_181 for ONNX node: Pow_181
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 643 for ONNX tensor: 643
[07/07/2022-05:04:22] [V] [TRT] Pow_181 [Pow] outputs: [643 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_182 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 643
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_182 [ReduceMean] inputs: [643 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_182 for ONNX node: ReduceMean_182
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 644 for ONNX tensor: 644
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_182 [ReduceMean] outputs: [644 -> (640, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_184 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 644
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2541
[07/07/2022-05:04:22] [V] [TRT] Add_184 [Add] inputs: [644 -> (640, 32, 1)[FLOAT]], [2541 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_184 for ONNX node: Add_184
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 646 for ONNX tensor: 646
[07/07/2022-05:04:22] [V] [TRT] Add_184 [Add] outputs: [646 -> (640, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sqrt_185 [Sqrt]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 646
[07/07/2022-05:04:22] [V] [TRT] Sqrt_185 [Sqrt] inputs: [646 -> (640, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sqrt_185 for ONNX node: Sqrt_185
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 647 for ONNX tensor: 647
[07/07/2022-05:04:22] [V] [TRT] Sqrt_185 [Sqrt] outputs: [647 -> (640, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Div_186 [Div]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 641
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 647
[07/07/2022-05:04:22] [V] [TRT] Div_186 [Div] inputs: [641 -> (640, 32, 64)[FLOAT]], [647 -> (640, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Div_186 for ONNX node: Div_186
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 648 for ONNX tensor: 648
[07/07/2022-05:04:22] [V] [TRT] Div_186 [Div] outputs: [648 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Mul_187 [Mul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 648
[07/07/2022-05:04:22] [V] [TRT] Searching for input: interaction.attn_layers.1.layer_norm.weight
[07/07/2022-05:04:22] [V] [TRT] Mul_187 [Mul] inputs: [648 -> (640, 32, 64)[FLOAT]], [interaction.attn_layers.1.layer_norm.weight -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: interaction.attn_layers.1.layer_norm.weight for ONNX node: interaction.attn_layers.1.layer_norm.weight
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Mul_187 for ONNX node: Mul_187
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 649 for ONNX tensor: 649
[07/07/2022-05:04:22] [V] [TRT] Mul_187 [Mul] outputs: [649 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_188 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 649
[07/07/2022-05:04:22] [V] [TRT] Searching for input: interaction.attn_layers.1.layer_norm.bias
[07/07/2022-05:04:22] [V] [TRT] Add_188 [Add] inputs: [649 -> (640, 32, 64)[FLOAT]], [interaction.attn_layers.1.layer_norm.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: interaction.attn_layers.1.layer_norm.bias for ONNX node: interaction.attn_layers.1.layer_norm.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_188 for ONNX node: Add_188
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 650 for ONNX tensor: 650
[07/07/2022-05:04:22] [V] [TRT] Add_188 [Add] outputs: [650 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_189 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 650
[07/07/2022-05:04:22] [V] [TRT] Transpose_189 [Transpose] inputs: [650 -> (640, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_189 for ONNX node: Transpose_189
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 651 for ONNX tensor: 651
[07/07/2022-05:04:22] [V] [TRT] Transpose_189 [Transpose] outputs: [651 -> (32, 640, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Slice_190 [Slice]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 651
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2558
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2559
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2443
[07/07/2022-05:04:22] [V] [TRT] Slice_190 [Slice] inputs: [651 -> (32, 640, 64)[FLOAT]], [2558 -> (1)[INT32]], [2559 -> (1)[INT32]], [2443 -> (1)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Slice_190 for ONNX node: Slice_190
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 660 for ONNX tensor: 660
[07/07/2022-05:04:22] [V] [TRT] Slice_190 [Slice] outputs: [660 -> (32, 512, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Slice_191 [Slice]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 651
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2562
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2443
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2443
[07/07/2022-05:04:22] [V] [TRT] Slice_191 [Slice] inputs: [651 -> (32, 640, 64)[FLOAT]], [2562 -> (1)[INT32]], [2443 -> (1)[INT32]], [2443 -> (1)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Slice_191 for ONNX node: Slice_191
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 669 for ONNX tensor: 669
[07/07/2022-05:04:22] [V] [TRT] Slice_191 [Slice] outputs: [669 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_192 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 669
[07/07/2022-05:04:22] [V] [TRT] Transpose_192 [Transpose] inputs: [669 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_192 for ONNX node: Transpose_192
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 670 for ONNX tensor: 670
[07/07/2022-05:04:22] [V] [TRT] Transpose_192 [Transpose] outputs: [670 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_193 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 660
[07/07/2022-05:04:22] [V] [TRT] Transpose_193 [Transpose] inputs: [660 -> (32, 512, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_193 for ONNX node: Transpose_193
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 671 for ONNX tensor: 671
[07/07/2022-05:04:22] [V] [TRT] Transpose_193 [Transpose] outputs: [671 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_194 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 660
[07/07/2022-05:04:22] [V] [TRT] Transpose_194 [Transpose] inputs: [660 -> (32, 512, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_194 for ONNX node: Transpose_194
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 672 for ONNX tensor: 672
[07/07/2022-05:04:22] [V] [TRT] Transpose_194 [Transpose] outputs: [672 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_217 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 670
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2566
[07/07/2022-05:04:22] [V] [TRT] MatMul_217 [MatMul] inputs: [670 -> (1, 32, 64)[FLOAT]], [2566 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2566 for ONNX node: 2566
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_217 for ONNX node: MatMul_217
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 697 for ONNX tensor: 697
[07/07/2022-05:04:22] [V] [TRT] MatMul_217 [MatMul] outputs: [697 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_219 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 671
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2567
[07/07/2022-05:04:22] [V] [TRT] MatMul_219 [MatMul] inputs: [671 -> (512, 32, 64)[FLOAT]], [2567 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2567 for ONNX node: 2567
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_219 for ONNX node: MatMul_219
[07/07/2022-05:04:22] [I] [TRT] MatMul_219: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 700 for ONNX tensor: 700
[07/07/2022-05:04:22] [V] [TRT] MatMul_219 [MatMul] outputs: [700 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_221 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 672
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2568
[07/07/2022-05:04:22] [V] [TRT] MatMul_221 [MatMul] inputs: [672 -> (512, 32, 64)[FLOAT]], [2568 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2568 for ONNX node: 2568
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_221 for ONNX node: MatMul_221
[07/07/2022-05:04:22] [I] [TRT] MatMul_221: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 703 for ONNX tensor: 703
[07/07/2022-05:04:22] [V] [TRT] MatMul_221 [MatMul] outputs: [703 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_218 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cross_attention.attn_layers.0.q_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 697
[07/07/2022-05:04:22] [V] [TRT] Add_218 [Add] inputs: [cross_attention.attn_layers.0.q_proj.bias -> (64)[FLOAT]], [697 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cross_attention.attn_layers.0.q_proj.bias for ONNX node: cross_attention.attn_layers.0.q_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_218 for ONNX node: Add_218
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 698 for ONNX tensor: 698
[07/07/2022-05:04:22] [V] [TRT] Add_218 [Add] outputs: [698 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_220 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cross_attention.attn_layers.0.k_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 700
[07/07/2022-05:04:22] [V] [TRT] Add_220 [Add] inputs: [cross_attention.attn_layers.0.k_proj.bias -> (64)[FLOAT]], [700 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cross_attention.attn_layers.0.k_proj.bias for ONNX node: cross_attention.attn_layers.0.k_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_220 for ONNX node: Add_220
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 701 for ONNX tensor: 701
[07/07/2022-05:04:22] [V] [TRT] Add_220 [Add] outputs: [701 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_222 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cross_attention.attn_layers.0.v_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 703
[07/07/2022-05:04:22] [V] [TRT] Add_222 [Add] inputs: [cross_attention.attn_layers.0.v_proj.bias -> (64)[FLOAT]], [703 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cross_attention.attn_layers.0.v_proj.bias for ONNX node: cross_attention.attn_layers.0.v_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_222 for ONNX node: Add_222
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 704 for ONNX tensor: 704
[07/07/2022-05:04:22] [V] [TRT] Add_222 [Add] outputs: [704 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_223 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 698
[07/07/2022-05:04:22] [V] [TRT] Relu_223 [Relu] inputs: [698 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_223 for ONNX node: Relu_223
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 705 for ONNX tensor: 705
[07/07/2022-05:04:22] [V] [TRT] Relu_223 [Relu] outputs: [705 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_224 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 701
[07/07/2022-05:04:22] [V] [TRT] Relu_224 [Relu] inputs: [701 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_224 for ONNX node: Relu_224
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 706 for ONNX tensor: 706
[07/07/2022-05:04:22] [V] [TRT] Relu_224 [Relu] outputs: [706 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_243 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 704
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2531
[07/07/2022-05:04:22] [V] [TRT] Reshape_243 [Reshape] inputs: [704 -> (512, 32, 64)[FLOAT]], [2531 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_243 for ONNX node: Reshape_243
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 731 for ONNX tensor: 731
[07/07/2022-05:04:22] [V] [TRT] Reshape_243 [Reshape] outputs: [731 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_296 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 704
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2578
[07/07/2022-05:04:22] [V] [TRT] MatMul_296 [MatMul] inputs: [704 -> (512, 32, 64)[FLOAT]], [2578 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2578 for ONNX node: 2578
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_296 for ONNX node: MatMul_296
[07/07/2022-05:04:22] [I] [TRT] MatMul_296: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 794 for ONNX tensor: 794
[07/07/2022-05:04:22] [V] [TRT] MatMul_296 [MatMul] outputs: [794 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_230 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 705
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2531
[07/07/2022-05:04:22] [V] [TRT] Reshape_230 [Reshape] inputs: [705 -> (1, 32, 64)[FLOAT]], [2531 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_230 for ONNX node: Reshape_230
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 714 for ONNX tensor: 714
[07/07/2022-05:04:22] [V] [TRT] Reshape_230 [Reshape] outputs: [714 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_237 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 706
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2531
[07/07/2022-05:04:22] [V] [TRT] Reshape_237 [Reshape] inputs: [706 -> (512, 32, 64)[FLOAT]], [2531 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_237 for ONNX node: Reshape_237
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 723 for ONNX tensor: 723
[07/07/2022-05:04:22] [V] [TRT] Reshape_237 [Reshape] outputs: [723 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_244 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 731
[07/07/2022-05:04:22] [V] [TRT] Transpose_244 [Transpose] inputs: [731 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_244 for ONNX node: Transpose_244
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 732 for ONNX tensor: 732
[07/07/2022-05:04:22] [V] [TRT] Transpose_244 [Transpose] outputs: [732 -> (32, 512, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_294 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 706
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2577
[07/07/2022-05:04:22] [V] [TRT] MatMul_294 [MatMul] inputs: [706 -> (512, 32, 64)[FLOAT]], [2577 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2577 for ONNX node: 2577
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_294 for ONNX node: MatMul_294
[07/07/2022-05:04:22] [I] [TRT] MatMul_294: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 791 for ONNX tensor: 791
[07/07/2022-05:04:22] [V] [TRT] MatMul_294 [MatMul] outputs: [791 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_297 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cross_attention.attn_layers.1.v_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 794
[07/07/2022-05:04:22] [V] [TRT] Add_297 [Add] inputs: [cross_attention.attn_layers.1.v_proj.bias -> (64)[FLOAT]], [794 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cross_attention.attn_layers.1.v_proj.bias for ONNX node: cross_attention.attn_layers.1.v_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_297 for ONNX node: Add_297
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 795 for ONNX tensor: 795
[07/07/2022-05:04:22] [V] [TRT] Add_297 [Add] outputs: [795 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_231 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 714
[07/07/2022-05:04:22] [V] [TRT] Transpose_231 [Transpose] inputs: [714 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_231 for ONNX node: Transpose_231
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 715 for ONNX tensor: 715
[07/07/2022-05:04:22] [V] [TRT] Transpose_231 [Transpose] outputs: [715 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_245 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 723
[07/07/2022-05:04:22] [V] [TRT] Transpose_245 [Transpose] inputs: [723 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_245 for ONNX node: Transpose_245
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 733 for ONNX tensor: 733
[07/07/2022-05:04:22] [V] [TRT] Transpose_245 [Transpose] outputs: [733 -> (32, 64, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_295 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cross_attention.attn_layers.1.k_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 791
[07/07/2022-05:04:22] [V] [TRT] Add_295 [Add] inputs: [cross_attention.attn_layers.1.k_proj.bias -> (64)[FLOAT]], [791 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cross_attention.attn_layers.1.k_proj.bias for ONNX node: cross_attention.attn_layers.1.k_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_295 for ONNX node: Add_295
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 792 for ONNX tensor: 792
[07/07/2022-05:04:22] [V] [TRT] Add_295 [Add] outputs: [792 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_318 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 795
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2531
[07/07/2022-05:04:22] [V] [TRT] Reshape_318 [Reshape] inputs: [795 -> (512, 32, 64)[FLOAT]], [2531 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_318 for ONNX node: Reshape_318
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 822 for ONNX tensor: 822
[07/07/2022-05:04:22] [V] [TRT] Reshape_318 [Reshape] outputs: [822 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_246 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 715
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 733
[07/07/2022-05:04:22] [V] [TRT] MatMul_246 [MatMul] inputs: [715 -> (32, 1, 64)[FLOAT]], [733 -> (32, 64, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_246 for ONNX node: MatMul_246
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 734 for ONNX tensor: 734
[07/07/2022-05:04:22] [V] [TRT] MatMul_246 [MatMul] outputs: [734 -> (32, 1, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_299 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 792
[07/07/2022-05:04:22] [V] [TRT] Relu_299 [Relu] inputs: [792 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_299 for ONNX node: Relu_299
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 797 for ONNX tensor: 797
[07/07/2022-05:04:22] [V] [TRT] Relu_299 [Relu] outputs: [797 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_319 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 822
[07/07/2022-05:04:22] [V] [TRT] Transpose_319 [Transpose] inputs: [822 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_319 for ONNX node: Transpose_319
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 823 for ONNX tensor: 823
[07/07/2022-05:04:22] [V] [TRT] Transpose_319 [Transpose] outputs: [823 -> (32, 512, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Where_255 [Where]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 741
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 526
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 734
[07/07/2022-05:04:22] [V] [TRT] Where_255 [Where] inputs: [741 -> (32, 1, 512)[BOOL]], [526 -> ()[FLOAT]], [734 -> (32, 1, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Where_255 for ONNX node: Where_255
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 744 for ONNX tensor: 744
[07/07/2022-05:04:22] [V] [TRT] Where_255 [Where] outputs: [744 -> (32, 1, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_312 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 797
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2531
[07/07/2022-05:04:22] [V] [TRT] Reshape_312 [Reshape] inputs: [797 -> (512, 32, 64)[FLOAT]], [2531 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_312 for ONNX node: Reshape_312
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 814 for ONNX tensor: 814
[07/07/2022-05:04:22] [V] [TRT] Reshape_312 [Reshape] outputs: [814 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceSum_256 [ReduceSum]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 744
[07/07/2022-05:04:22] [V] [TRT] ReduceSum_256 [ReduceSum] inputs: [744 -> (32, 1, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceSum_256 for ONNX node: ReduceSum_256
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 745 for ONNX tensor: 745
[07/07/2022-05:04:22] [V] [TRT] ReduceSum_256 [ReduceSum] outputs: [745 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_320 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 814
[07/07/2022-05:04:22] [V] [TRT] Transpose_320 [Transpose] inputs: [814 -> (512, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_320 for ONNX node: Transpose_320
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 824 for ONNX tensor: 824
[07/07/2022-05:04:22] [V] [TRT] Transpose_320 [Transpose] outputs: [824 -> (32, 64, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Clip_257 [Clip]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 745
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2541
[07/07/2022-05:04:22] [V] [TRT] Clip_257 [Clip] inputs: [745 -> (32, 1, 1)[FLOAT]], [2541 -> ()[FLOAT]], [optional input, not set], 
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 749 for ONNX tensor: 749
[07/07/2022-05:04:22] [V] [TRT] Clip_257 [Clip] outputs: [749 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Div_258 [Div]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 744
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 749
[07/07/2022-05:04:22] [V] [TRT] Div_258 [Div] inputs: [744 -> (32, 1, 512)[FLOAT]], [749 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Div_258 for ONNX node: Div_258
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 750 for ONNX tensor: 750
[07/07/2022-05:04:22] [V] [TRT] Div_258 [Div] outputs: [750 -> (32, 1, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_259 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 750
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 732
[07/07/2022-05:04:22] [V] [TRT] MatMul_259 [MatMul] inputs: [750 -> (32, 1, 512)[FLOAT]], [732 -> (32, 512, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_259 for ONNX node: MatMul_259
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 751 for ONNX tensor: 751
[07/07/2022-05:04:22] [V] [TRT] MatMul_259 [MatMul] outputs: [751 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_260 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 751
[07/07/2022-05:04:22] [V] [TRT] Transpose_260 [Transpose] inputs: [751 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_260 for ONNX node: Transpose_260
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 752 for ONNX tensor: 752
[07/07/2022-05:04:22] [V] [TRT] Transpose_260 [Transpose] outputs: [752 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_264 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 752
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 757
[07/07/2022-05:04:22] [V] [TRT] Reshape_264 [Reshape] inputs: [752 -> (1, 32, 64)[FLOAT]], [757 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_264 for ONNX node: Reshape_264
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 758 for ONNX tensor: 758
[07/07/2022-05:04:22] [V] [TRT] Reshape_264 [Reshape] outputs: [758 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_265 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 758
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2575
[07/07/2022-05:04:22] [V] [TRT] MatMul_265 [MatMul] inputs: [758 -> (1, 32, 64)[FLOAT]], [2575 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2575 for ONNX node: 2575
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_265 for ONNX node: MatMul_265
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 760 for ONNX tensor: 760
[07/07/2022-05:04:22] [V] [TRT] MatMul_265 [MatMul] outputs: [760 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_266 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cross_attention.attn_layers.0.out_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 760
[07/07/2022-05:04:22] [V] [TRT] Add_266 [Add] inputs: [cross_attention.attn_layers.0.out_proj.bias -> (64)[FLOAT]], [760 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cross_attention.attn_layers.0.out_proj.bias for ONNX node: cross_attention.attn_layers.0.out_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_266 for ONNX node: Add_266
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 761 for ONNX tensor: 761
[07/07/2022-05:04:22] [V] [TRT] Add_266 [Add] outputs: [761 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_267 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 761
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 670
[07/07/2022-05:04:22] [V] [TRT] Add_267 [Add] inputs: [761 -> (1, 32, 64)[FLOAT]], [670 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_267 for ONNX node: Add_267
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 762 for ONNX tensor: 762
[07/07/2022-05:04:22] [V] [TRT] Add_267 [Add] outputs: [762 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_268 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 762
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_268 [ReduceMean] inputs: [762 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_268 for ONNX node: ReduceMean_268
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 763 for ONNX tensor: 763
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_268 [ReduceMean] outputs: [763 -> (1, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sub_269 [Sub]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 762
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 763
[07/07/2022-05:04:22] [V] [TRT] Sub_269 [Sub] inputs: [762 -> (1, 32, 64)[FLOAT]], [763 -> (1, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sub_269 for ONNX node: Sub_269
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 764 for ONNX tensor: 764
[07/07/2022-05:04:22] [V] [TRT] Sub_269 [Sub] outputs: [764 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Pow_271 [Pow]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 764
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 551
[07/07/2022-05:04:22] [V] [TRT] Pow_271 [Pow] inputs: [764 -> (1, 32, 64)[FLOAT]], [551 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Pow_271 for ONNX node: Pow_271
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 766 for ONNX tensor: 766
[07/07/2022-05:04:22] [V] [TRT] Pow_271 [Pow] outputs: [766 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_272 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 766
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_272 [ReduceMean] inputs: [766 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_272 for ONNX node: ReduceMean_272
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 767 for ONNX tensor: 767
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_272 [ReduceMean] outputs: [767 -> (1, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_274 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 767
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2541
[07/07/2022-05:04:22] [V] [TRT] Add_274 [Add] inputs: [767 -> (1, 32, 1)[FLOAT]], [2541 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_274 for ONNX node: Add_274
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 769 for ONNX tensor: 769
[07/07/2022-05:04:22] [V] [TRT] Add_274 [Add] outputs: [769 -> (1, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sqrt_275 [Sqrt]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 769
[07/07/2022-05:04:22] [V] [TRT] Sqrt_275 [Sqrt] inputs: [769 -> (1, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sqrt_275 for ONNX node: Sqrt_275
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 770 for ONNX tensor: 770
[07/07/2022-05:04:22] [V] [TRT] Sqrt_275 [Sqrt] outputs: [770 -> (1, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Div_276 [Div]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 764
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 770
[07/07/2022-05:04:22] [V] [TRT] Div_276 [Div] inputs: [764 -> (1, 32, 64)[FLOAT]], [770 -> (1, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Div_276 for ONNX node: Div_276
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 771 for ONNX tensor: 771
[07/07/2022-05:04:22] [V] [TRT] Div_276 [Div] outputs: [771 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Mul_277 [Mul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 771
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cross_attention.attn_layers.0.layer_norm.weight
[07/07/2022-05:04:22] [V] [TRT] Mul_277 [Mul] inputs: [771 -> (1, 32, 64)[FLOAT]], [cross_attention.attn_layers.0.layer_norm.weight -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cross_attention.attn_layers.0.layer_norm.weight for ONNX node: cross_attention.attn_layers.0.layer_norm.weight
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Mul_277 for ONNX node: Mul_277
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 772 for ONNX tensor: 772
[07/07/2022-05:04:22] [V] [TRT] Mul_277 [Mul] outputs: [772 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_278 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 772
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cross_attention.attn_layers.0.layer_norm.bias
[07/07/2022-05:04:22] [V] [TRT] Add_278 [Add] inputs: [772 -> (1, 32, 64)[FLOAT]], [cross_attention.attn_layers.0.layer_norm.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cross_attention.attn_layers.0.layer_norm.bias for ONNX node: cross_attention.attn_layers.0.layer_norm.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_278 for ONNX node: Add_278
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 773 for ONNX tensor: 773
[07/07/2022-05:04:22] [V] [TRT] Add_278 [Add] outputs: [773 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_292 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 773
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2576
[07/07/2022-05:04:22] [V] [TRT] MatMul_292 [MatMul] inputs: [773 -> (1, 32, 64)[FLOAT]], [2576 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2576 for ONNX node: 2576
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_292 for ONNX node: MatMul_292
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 788 for ONNX tensor: 788
[07/07/2022-05:04:22] [V] [TRT] MatMul_292 [MatMul] outputs: [788 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_293 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cross_attention.attn_layers.1.q_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 788
[07/07/2022-05:04:22] [V] [TRT] Add_293 [Add] inputs: [cross_attention.attn_layers.1.q_proj.bias -> (64)[FLOAT]], [788 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cross_attention.attn_layers.1.q_proj.bias for ONNX node: cross_attention.attn_layers.1.q_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_293 for ONNX node: Add_293
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 789 for ONNX tensor: 789
[07/07/2022-05:04:22] [V] [TRT] Add_293 [Add] outputs: [789 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_298 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 789
[07/07/2022-05:04:22] [V] [TRT] Relu_298 [Relu] inputs: [789 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_298 for ONNX node: Relu_298
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 796 for ONNX tensor: 796
[07/07/2022-05:04:22] [V] [TRT] Relu_298 [Relu] outputs: [796 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_305 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 796
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2531
[07/07/2022-05:04:22] [V] [TRT] Reshape_305 [Reshape] inputs: [796 -> (1, 32, 64)[FLOAT]], [2531 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_305 for ONNX node: Reshape_305
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 805 for ONNX tensor: 805
[07/07/2022-05:04:22] [V] [TRT] Reshape_305 [Reshape] outputs: [805 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_306 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 805
[07/07/2022-05:04:22] [V] [TRT] Transpose_306 [Transpose] inputs: [805 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_306 for ONNX node: Transpose_306
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 806 for ONNX tensor: 806
[07/07/2022-05:04:22] [V] [TRT] Transpose_306 [Transpose] outputs: [806 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_321 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 806
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 824
[07/07/2022-05:04:22] [V] [TRT] MatMul_321 [MatMul] inputs: [806 -> (32, 1, 64)[FLOAT]], [824 -> (32, 64, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_321 for ONNX node: MatMul_321
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 825 for ONNX tensor: 825
[07/07/2022-05:04:22] [V] [TRT] MatMul_321 [MatMul] outputs: [825 -> (32, 1, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Where_330 [Where]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 832
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 526
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 825
[07/07/2022-05:04:22] [V] [TRT] Where_330 [Where] inputs: [832 -> (32, 1, 512)[BOOL]], [526 -> ()[FLOAT]], [825 -> (32, 1, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Where_330 for ONNX node: Where_330
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 835 for ONNX tensor: 835
[07/07/2022-05:04:22] [V] [TRT] Where_330 [Where] outputs: [835 -> (32, 1, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceSum_331 [ReduceSum]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 835
[07/07/2022-05:04:22] [V] [TRT] ReduceSum_331 [ReduceSum] inputs: [835 -> (32, 1, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceSum_331 for ONNX node: ReduceSum_331
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 836 for ONNX tensor: 836
[07/07/2022-05:04:22] [V] [TRT] ReduceSum_331 [ReduceSum] outputs: [836 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Clip_332 [Clip]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 836
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2541
[07/07/2022-05:04:22] [V] [TRT] Clip_332 [Clip] inputs: [836 -> (32, 1, 1)[FLOAT]], [2541 -> ()[FLOAT]], [optional input, not set], 
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 840 for ONNX tensor: 840
[07/07/2022-05:04:22] [V] [TRT] Clip_332 [Clip] outputs: [840 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Div_333 [Div]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 835
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 840
[07/07/2022-05:04:22] [V] [TRT] Div_333 [Div] inputs: [835 -> (32, 1, 512)[FLOAT]], [840 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Div_333 for ONNX node: Div_333
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 841 for ONNX tensor: 841
[07/07/2022-05:04:22] [V] [TRT] Div_333 [Div] outputs: [841 -> (32, 1, 512)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_334 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 841
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 823
[07/07/2022-05:04:22] [V] [TRT] MatMul_334 [MatMul] inputs: [841 -> (32, 1, 512)[FLOAT]], [823 -> (32, 512, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_334 for ONNX node: MatMul_334
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 842 for ONNX tensor: 842
[07/07/2022-05:04:22] [V] [TRT] MatMul_334 [MatMul] outputs: [842 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_335 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 842
[07/07/2022-05:04:22] [V] [TRT] Transpose_335 [Transpose] inputs: [842 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_335 for ONNX node: Transpose_335
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 843 for ONNX tensor: 843
[07/07/2022-05:04:22] [V] [TRT] Transpose_335 [Transpose] outputs: [843 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_339 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 843
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 757
[07/07/2022-05:04:22] [V] [TRT] Reshape_339 [Reshape] inputs: [843 -> (1, 32, 64)[FLOAT]], [757 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_339 for ONNX node: Reshape_339
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 849 for ONNX tensor: 849
[07/07/2022-05:04:22] [V] [TRT] Reshape_339 [Reshape] outputs: [849 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_340 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 849
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2585
[07/07/2022-05:04:22] [V] [TRT] MatMul_340 [MatMul] inputs: [849 -> (1, 32, 64)[FLOAT]], [2585 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2585 for ONNX node: 2585
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_340 for ONNX node: MatMul_340
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 851 for ONNX tensor: 851
[07/07/2022-05:04:22] [V] [TRT] MatMul_340 [MatMul] outputs: [851 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_341 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cross_attention.attn_layers.1.out_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 851
[07/07/2022-05:04:22] [V] [TRT] Add_341 [Add] inputs: [cross_attention.attn_layers.1.out_proj.bias -> (64)[FLOAT]], [851 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cross_attention.attn_layers.1.out_proj.bias for ONNX node: cross_attention.attn_layers.1.out_proj.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_341 for ONNX node: Add_341
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 852 for ONNX tensor: 852
[07/07/2022-05:04:22] [V] [TRT] Add_341 [Add] outputs: [852 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_342 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 852
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 773
[07/07/2022-05:04:22] [V] [TRT] Add_342 [Add] inputs: [852 -> (1, 32, 64)[FLOAT]], [773 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_342 for ONNX node: Add_342
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 853 for ONNX tensor: 853
[07/07/2022-05:04:22] [V] [TRT] Add_342 [Add] outputs: [853 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_343 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 853
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_343 [ReduceMean] inputs: [853 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_343 for ONNX node: ReduceMean_343
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 854 for ONNX tensor: 854
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_343 [ReduceMean] outputs: [854 -> (1, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sub_344 [Sub]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 853
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 854
[07/07/2022-05:04:22] [V] [TRT] Sub_344 [Sub] inputs: [853 -> (1, 32, 64)[FLOAT]], [854 -> (1, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sub_344 for ONNX node: Sub_344
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 855 for ONNX tensor: 855
[07/07/2022-05:04:22] [V] [TRT] Sub_344 [Sub] outputs: [855 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Pow_346 [Pow]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 855
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 551
[07/07/2022-05:04:22] [V] [TRT] Pow_346 [Pow] inputs: [855 -> (1, 32, 64)[FLOAT]], [551 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Pow_346 for ONNX node: Pow_346
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 857 for ONNX tensor: 857
[07/07/2022-05:04:22] [V] [TRT] Pow_346 [Pow] outputs: [857 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_347 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 857
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_347 [ReduceMean] inputs: [857 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_347 for ONNX node: ReduceMean_347
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 858 for ONNX tensor: 858
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_347 [ReduceMean] outputs: [858 -> (1, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_349 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 858
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2541
[07/07/2022-05:04:22] [V] [TRT] Add_349 [Add] inputs: [858 -> (1, 32, 1)[FLOAT]], [2541 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_349 for ONNX node: Add_349
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 860 for ONNX tensor: 860
[07/07/2022-05:04:22] [V] [TRT] Add_349 [Add] outputs: [860 -> (1, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sqrt_350 [Sqrt]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 860
[07/07/2022-05:04:22] [V] [TRT] Sqrt_350 [Sqrt] inputs: [860 -> (1, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sqrt_350 for ONNX node: Sqrt_350
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 861 for ONNX tensor: 861
[07/07/2022-05:04:22] [V] [TRT] Sqrt_350 [Sqrt] outputs: [861 -> (1, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Div_351 [Div]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 855
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 861
[07/07/2022-05:04:22] [V] [TRT] Div_351 [Div] inputs: [855 -> (1, 32, 64)[FLOAT]], [861 -> (1, 32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Div_351 for ONNX node: Div_351
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 862 for ONNX tensor: 862
[07/07/2022-05:04:22] [V] [TRT] Div_351 [Div] outputs: [862 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Mul_352 [Mul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 862
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cross_attention.attn_layers.1.layer_norm.weight
[07/07/2022-05:04:22] [V] [TRT] Mul_352 [Mul] inputs: [862 -> (1, 32, 64)[FLOAT]], [cross_attention.attn_layers.1.layer_norm.weight -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cross_attention.attn_layers.1.layer_norm.weight for ONNX node: cross_attention.attn_layers.1.layer_norm.weight
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Mul_352 for ONNX node: Mul_352
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 863 for ONNX tensor: 863
[07/07/2022-05:04:22] [V] [TRT] Mul_352 [Mul] outputs: [863 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_353 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 863
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cross_attention.attn_layers.1.layer_norm.bias
[07/07/2022-05:04:22] [V] [TRT] Add_353 [Add] inputs: [863 -> (1, 32, 64)[FLOAT]], [cross_attention.attn_layers.1.layer_norm.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cross_attention.attn_layers.1.layer_norm.bias for ONNX node: cross_attention.attn_layers.1.layer_norm.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_353 for ONNX node: Add_353
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 864 for ONNX tensor: 864
[07/07/2022-05:04:22] [V] [TRT] Add_353 [Add] outputs: [864 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Transpose_354 [Transpose]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 864
[07/07/2022-05:04:22] [V] [TRT] Transpose_354 [Transpose] inputs: [864 -> (1, 32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Transpose_354 for ONNX node: Transpose_354
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 865 for ONNX tensor: 865
[07/07/2022-05:04:22] [V] [TRT] Transpose_354 [Transpose] outputs: [865 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_355 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 669
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 865
[07/07/2022-05:04:22] [V] [TRT] Add_355 [Add] inputs: [669 -> (32, 1, 64)[FLOAT]], [865 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_355 for ONNX node: Add_355
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 866 for ONNX tensor: 866
[07/07/2022-05:04:22] [V] [TRT] Add_355 [Add] outputs: [866 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_356 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 866
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_356 [ReduceMean] inputs: [866 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_356 for ONNX node: ReduceMean_356
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 867 for ONNX tensor: 867
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_356 [ReduceMean] outputs: [867 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sub_357 [Sub]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 866
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 867
[07/07/2022-05:04:22] [V] [TRT] Sub_357 [Sub] inputs: [866 -> (32, 1, 64)[FLOAT]], [867 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sub_357 for ONNX node: Sub_357
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 868 for ONNX tensor: 868
[07/07/2022-05:04:22] [V] [TRT] Sub_357 [Sub] outputs: [868 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Pow_359 [Pow]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 868
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 551
[07/07/2022-05:04:22] [V] [TRT] Pow_359 [Pow] inputs: [868 -> (32, 1, 64)[FLOAT]], [551 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Pow_359 for ONNX node: Pow_359
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 870 for ONNX tensor: 870
[07/07/2022-05:04:22] [V] [TRT] Pow_359 [Pow] outputs: [870 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_360 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 870
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_360 [ReduceMean] inputs: [870 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_360 for ONNX node: ReduceMean_360
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 871 for ONNX tensor: 871
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_360 [ReduceMean] outputs: [871 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_362 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 871
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2541
[07/07/2022-05:04:22] [V] [TRT] Add_362 [Add] inputs: [871 -> (32, 1, 1)[FLOAT]], [2541 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_362 for ONNX node: Add_362
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 873 for ONNX tensor: 873
[07/07/2022-05:04:22] [V] [TRT] Add_362 [Add] outputs: [873 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sqrt_363 [Sqrt]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 873
[07/07/2022-05:04:22] [V] [TRT] Sqrt_363 [Sqrt] inputs: [873 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sqrt_363 for ONNX node: Sqrt_363
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 874 for ONNX tensor: 874
[07/07/2022-05:04:22] [V] [TRT] Sqrt_363 [Sqrt] outputs: [874 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Div_364 [Div]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 868
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 874
[07/07/2022-05:04:22] [V] [TRT] Div_364 [Div] inputs: [868 -> (32, 1, 64)[FLOAT]], [874 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Div_364 for ONNX node: Div_364
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 875 for ONNX tensor: 875
[07/07/2022-05:04:22] [V] [TRT] Div_364 [Div] outputs: [875 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Mul_365 [Mul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 875
[07/07/2022-05:04:22] [V] [TRT] Searching for input: norm0_cross.weight
[07/07/2022-05:04:22] [V] [TRT] Mul_365 [Mul] inputs: [875 -> (32, 1, 64)[FLOAT]], [norm0_cross.weight -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: norm0_cross.weight for ONNX node: norm0_cross.weight
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Mul_365 for ONNX node: Mul_365
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 876 for ONNX tensor: 876
[07/07/2022-05:04:22] [V] [TRT] Mul_365 [Mul] outputs: [876 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_366 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 876
[07/07/2022-05:04:22] [V] [TRT] Searching for input: norm0_cross.bias
[07/07/2022-05:04:22] [V] [TRT] Add_366 [Add] inputs: [876 -> (32, 1, 64)[FLOAT]], [norm0_cross.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: norm0_cross.bias for ONNX node: norm0_cross.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_366 for ONNX node: Add_366
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 877 for ONNX tensor: 877
[07/07/2022-05:04:22] [V] [TRT] Add_366 [Add] outputs: [877 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_369 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 877
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2587
[07/07/2022-05:04:22] [V] [TRT] MatMul_369 [MatMul] inputs: [877 -> (32, 1, 64)[FLOAT]], [2587 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2587 for ONNX node: 2587
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_369 for ONNX node: MatMul_369
[07/07/2022-05:04:22] [I] [TRT] MatMul_369: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 882 for ONNX tensor: 882
[07/07/2022-05:04:22] [V] [TRT] MatMul_369 [MatMul] outputs: [882 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_536 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 877
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 521
[07/07/2022-05:04:22] [V] [TRT] Expand_536 [Expand] inputs: [877 -> (32, 1, 64)[FLOAT]], [521 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_536 for ONNX node: Expand_536
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1063 for ONNX tensor: 1063
[07/07/2022-05:04:22] [V] [TRT] Expand_536 [Expand] outputs: [1063 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1132 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 877
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1745
[07/07/2022-05:04:22] [V] [TRT] Expand_1132 [Expand] inputs: [877 -> (32, 1, 64)[FLOAT]], [1745 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1132 for ONNX node: Expand_1132
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1746 for ONNX tensor: 1746
[07/07/2022-05:04:22] [V] [TRT] Expand_1132 [Expand] outputs: [1746 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Squeeze_1701 [Squeeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 877
[07/07/2022-05:04:22] [V] [TRT] Squeeze_1701 [Squeeze] inputs: [877 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (32, 1, 64), squeezing to: (32, 64)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Squeeze_1701 for ONNX node: Squeeze_1701
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2386 for ONNX tensor: 2386
[07/07/2022-05:04:22] [V] [TRT] Squeeze_1701 [Squeeze] outputs: [2386 -> (32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_370 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cg0.fc0.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 882
[07/07/2022-05:04:22] [V] [TRT] Add_370 [Add] inputs: [cg0.fc0.fc1.bias -> (64)[FLOAT]], [882 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cg0.fc0.fc1.bias for ONNX node: cg0.fc0.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_370 for ONNX node: Add_370
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 883 for ONNX tensor: 883
[07/07/2022-05:04:22] [V] [TRT] Add_370 [Add] outputs: [883 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Concat_537 [Concat]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1063
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1047
[07/07/2022-05:04:22] [V] [TRT] Concat_537 [Concat] inputs: [1063 -> (32, 1, 64)[FLOAT]], [1047 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Concat_537 for ONNX node: Concat_537
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1064 for ONNX tensor: 1064
[07/07/2022-05:04:22] [V] [TRT] Concat_537 [Concat] outputs: [1064 -> (32, 1, 128)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1709 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2386
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2394
[07/07/2022-05:04:22] [V] [TRT] Expand_1709 [Expand] inputs: [2386 -> (32, 64)[FLOAT]], [2394 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1709 for ONNX node: Expand_1709
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2395 for ONNX tensor: 2395
[07/07/2022-05:04:22] [V] [TRT] Expand_1709 [Expand] outputs: [2395 -> (32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_371 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 883
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_371 [ReduceMean] inputs: [883 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_371 for ONNX node: ReduceMean_371
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 884 for ONNX tensor: 884
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_371 [ReduceMean] outputs: [884 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_538 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1064
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2601
[07/07/2022-05:04:22] [V] [TRT] MatMul_538 [MatMul] inputs: [1064 -> (32, 1, 128)[FLOAT]], [2601 -> (128, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2601 for ONNX node: 2601
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_538 for ONNX node: MatMul_538
[07/07/2022-05:04:22] [I] [TRT] MatMul_538: broadcasting input1 to make tensors conform, dims(input0)=[32,1,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1066 for ONNX tensor: 1066
[07/07/2022-05:04:22] [V] [TRT] MatMul_538 [MatMul] outputs: [1066 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Tile_1710 [Tile]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2395
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2392
[07/07/2022-05:04:22] [V] [TRT] Tile_1710 [Tile] inputs: [2395 -> (32, 64)[FLOAT]], [2392 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Tile_1710 for ONNX node: Tile_1710
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2396 for ONNX tensor: 2396
[07/07/2022-05:04:22] [V] [TRT] Tile_1710 [Tile] outputs: [2396 -> (32, 3200)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sub_372 [Sub]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 883
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 884
[07/07/2022-05:04:22] [V] [TRT] Sub_372 [Sub] inputs: [883 -> (32, 1, 64)[FLOAT]], [884 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sub_372 for ONNX node: Sub_372
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 885 for ONNX tensor: 885
[07/07/2022-05:04:22] [V] [TRT] Sub_372 [Sub] outputs: [885 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_539 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: fuse_path.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1066
[07/07/2022-05:04:22] [V] [TRT] Add_539 [Add] inputs: [fuse_path.fc1.bias -> (64)[FLOAT]], [1066 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: fuse_path.fc1.bias for ONNX node: fuse_path.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_539 for ONNX node: Add_539
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1067 for ONNX tensor: 1067
[07/07/2022-05:04:22] [V] [TRT] Add_539 [Add] outputs: [1067 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1712 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2396
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2397
[07/07/2022-05:04:22] [V] [TRT] Reshape_1712 [Reshape] inputs: [2396 -> (32, 3200)[FLOAT]], [2397 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1712 for ONNX node: Reshape_1712
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2398 for ONNX tensor: 2398
[07/07/2022-05:04:22] [V] [TRT] Reshape_1712 [Reshape] outputs: [2398 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Pow_374 [Pow]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 885
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 551
[07/07/2022-05:04:22] [V] [TRT] Pow_374 [Pow] inputs: [885 -> (32, 1, 64)[FLOAT]], [551 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Pow_374 for ONNX node: Pow_374
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 887 for ONNX tensor: 887
[07/07/2022-05:04:22] [V] [TRT] Pow_374 [Pow] outputs: [887 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_540 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1067
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_540 [ReduceMean] inputs: [1067 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_540 for ONNX node: ReduceMean_540
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1068 for ONNX tensor: 1068
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_540 [ReduceMean] outputs: [1068 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_375 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 887
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_375 [ReduceMean] inputs: [887 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_375 for ONNX node: ReduceMean_375
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 888 for ONNX tensor: 888
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_375 [ReduceMean] outputs: [888 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sub_541 [Sub]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1067
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1068
[07/07/2022-05:04:22] [V] [TRT] Sub_541 [Sub] inputs: [1067 -> (32, 1, 64)[FLOAT]], [1068 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sub_541 for ONNX node: Sub_541
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1069 for ONNX tensor: 1069
[07/07/2022-05:04:22] [V] [TRT] Sub_541 [Sub] outputs: [1069 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_377 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 888
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2541
[07/07/2022-05:04:22] [V] [TRT] Add_377 [Add] inputs: [888 -> (32, 1, 1)[FLOAT]], [2541 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_377 for ONNX node: Add_377
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 890 for ONNX tensor: 890
[07/07/2022-05:04:22] [V] [TRT] Add_377 [Add] outputs: [890 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Pow_543 [Pow]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1069
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 551
[07/07/2022-05:04:22] [V] [TRT] Pow_543 [Pow] inputs: [1069 -> (32, 1, 64)[FLOAT]], [551 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Pow_543 for ONNX node: Pow_543
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1071 for ONNX tensor: 1071
[07/07/2022-05:04:22] [V] [TRT] Pow_543 [Pow] outputs: [1071 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sqrt_378 [Sqrt]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 890
[07/07/2022-05:04:22] [V] [TRT] Sqrt_378 [Sqrt] inputs: [890 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sqrt_378 for ONNX node: Sqrt_378
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 891 for ONNX tensor: 891
[07/07/2022-05:04:22] [V] [TRT] Sqrt_378 [Sqrt] outputs: [891 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_544 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1071
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_544 [ReduceMean] inputs: [1071 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_544 for ONNX node: ReduceMean_544
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1072 for ONNX tensor: 1072
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_544 [ReduceMean] outputs: [1072 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Div_379 [Div]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 885
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 891
[07/07/2022-05:04:22] [V] [TRT] Div_379 [Div] inputs: [885 -> (32, 1, 64)[FLOAT]], [891 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Div_379 for ONNX node: Div_379
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 892 for ONNX tensor: 892
[07/07/2022-05:04:22] [V] [TRT] Div_379 [Div] outputs: [892 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_546 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1072
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2541
[07/07/2022-05:04:22] [V] [TRT] Add_546 [Add] inputs: [1072 -> (32, 1, 1)[FLOAT]], [2541 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_546 for ONNX node: Add_546
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1074 for ONNX tensor: 1074
[07/07/2022-05:04:22] [V] [TRT] Add_546 [Add] outputs: [1074 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Mul_380 [Mul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 892
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cg0.fc0.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Mul_380 [Mul] inputs: [892 -> (32, 1, 64)[FLOAT]], [cg0.fc0.act.0.weight -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cg0.fc0.act.0.weight for ONNX node: cg0.fc0.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Mul_380 for ONNX node: Mul_380
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 893 for ONNX tensor: 893
[07/07/2022-05:04:22] [V] [TRT] Mul_380 [Mul] outputs: [893 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sqrt_547 [Sqrt]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1074
[07/07/2022-05:04:22] [V] [TRT] Sqrt_547 [Sqrt] inputs: [1074 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sqrt_547 for ONNX node: Sqrt_547
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1075 for ONNX tensor: 1075
[07/07/2022-05:04:22] [V] [TRT] Sqrt_547 [Sqrt] outputs: [1075 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_381 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 893
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cg0.fc0.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Add_381 [Add] inputs: [893 -> (32, 1, 64)[FLOAT]], [cg0.fc0.act.0.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cg0.fc0.act.0.bias for ONNX node: cg0.fc0.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_381 for ONNX node: Add_381
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 894 for ONNX tensor: 894
[07/07/2022-05:04:22] [V] [TRT] Add_381 [Add] outputs: [894 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Div_548 [Div]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1069
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1075
[07/07/2022-05:04:22] [V] [TRT] Div_548 [Div] inputs: [1069 -> (32, 1, 64)[FLOAT]], [1075 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Div_548 for ONNX node: Div_548
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1076 for ONNX tensor: 1076
[07/07/2022-05:04:22] [V] [TRT] Div_548 [Div] outputs: [1076 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_382 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 894
[07/07/2022-05:04:22] [V] [TRT] Relu_382 [Relu] inputs: [894 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_382 for ONNX node: Relu_382
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 895 for ONNX tensor: 895
[07/07/2022-05:04:22] [V] [TRT] Relu_382 [Relu] outputs: [895 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Mul_549 [Mul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1076
[07/07/2022-05:04:22] [V] [TRT] Searching for input: fuse_path.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Mul_549 [Mul] inputs: [1076 -> (32, 1, 64)[FLOAT]], [fuse_path.act.0.weight -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: fuse_path.act.0.weight for ONNX node: fuse_path.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Mul_549 for ONNX node: Mul_549
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1077 for ONNX tensor: 1077
[07/07/2022-05:04:22] [V] [TRT] Mul_549 [Mul] outputs: [1077 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_383 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 895
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2588
[07/07/2022-05:04:22] [V] [TRT] MatMul_383 [MatMul] inputs: [895 -> (32, 1, 64)[FLOAT]], [2588 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2588 for ONNX node: 2588
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_383 for ONNX node: MatMul_383
[07/07/2022-05:04:22] [I] [TRT] MatMul_383: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 897 for ONNX tensor: 897
[07/07/2022-05:04:22] [V] [TRT] MatMul_383 [MatMul] outputs: [897 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_550 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1077
[07/07/2022-05:04:22] [V] [TRT] Searching for input: fuse_path.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Add_550 [Add] inputs: [1077 -> (32, 1, 64)[FLOAT]], [fuse_path.act.0.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: fuse_path.act.0.bias for ONNX node: fuse_path.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_550 for ONNX node: Add_550
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1078 for ONNX tensor: 1078
[07/07/2022-05:04:22] [V] [TRT] Add_550 [Add] outputs: [1078 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_384 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cg0.fc0.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 897
[07/07/2022-05:04:22] [V] [TRT] Add_384 [Add] inputs: [cg0.fc0.fc2.bias -> (64)[FLOAT]], [897 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cg0.fc0.fc2.bias for ONNX node: cg0.fc0.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_384 for ONNX node: Add_384
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 898 for ONNX tensor: 898
[07/07/2022-05:04:22] [V] [TRT] Add_384 [Add] outputs: [898 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_551 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1078
[07/07/2022-05:04:22] [V] [TRT] Relu_551 [Relu] inputs: [1078 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_551 for ONNX node: Relu_551
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1079 for ONNX tensor: 1079
[07/07/2022-05:04:22] [V] [TRT] Relu_551 [Relu] outputs: [1079 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_409 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 898
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 925
[07/07/2022-05:04:22] [V] [TRT] Expand_409 [Expand] inputs: [898 -> (32, 1, 64)[FLOAT]], [925 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_409 for ONNX node: Expand_409
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 926 for ONNX tensor: 926
[07/07/2022-05:04:22] [V] [TRT] Expand_409 [Expand] outputs: [926 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_423 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 898
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2592
[07/07/2022-05:04:22] [V] [TRT] MatMul_423 [MatMul] inputs: [898 -> (32, 1, 64)[FLOAT]], [2592 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2592 for ONNX node: 2592
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_423 for ONNX node: MatMul_423
[07/07/2022-05:04:22] [I] [TRT] MatMul_423: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 941 for ONNX tensor: 941
[07/07/2022-05:04:22] [V] [TRT] MatMul_423 [MatMul] outputs: [941 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_552 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1079
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2602
[07/07/2022-05:04:22] [V] [TRT] MatMul_552 [MatMul] inputs: [1079 -> (32, 1, 64)[FLOAT]], [2602 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2602 for ONNX node: 2602
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_552 for ONNX node: MatMul_552
[07/07/2022-05:04:22] [I] [TRT] MatMul_552: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1081 for ONNX tensor: 1081
[07/07/2022-05:04:22] [V] [TRT] MatMul_552 [MatMul] outputs: [1081 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Mul_410 [Mul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 917
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 926
[07/07/2022-05:04:22] [V] [TRT] Mul_410 [Mul] inputs: [917 -> (32, 4000, 64)[FLOAT]], [926 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Mul_410 for ONNX node: Mul_410
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 927 for ONNX tensor: 927
[07/07/2022-05:04:22] [V] [TRT] Mul_410 [Mul] outputs: [927 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_424 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cg1.fc0.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 941
[07/07/2022-05:04:22] [V] [TRT] Add_424 [Add] inputs: [cg1.fc0.fc1.bias -> (64)[FLOAT]], [941 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cg1.fc0.fc1.bias for ONNX node: cg1.fc0.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_424 for ONNX node: Add_424
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 942 for ONNX tensor: 942
[07/07/2022-05:04:22] [V] [TRT] Add_424 [Add] outputs: [942 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_553 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: fuse_path.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1081
[07/07/2022-05:04:22] [V] [TRT] Add_553 [Add] inputs: [fuse_path.fc2.bias -> (64)[FLOAT]], [1081 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: fuse_path.fc2.bias for ONNX node: fuse_path.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_553 for ONNX node: Add_553
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1082 for ONNX tensor: 1082
[07/07/2022-05:04:22] [V] [TRT] Add_553 [Add] outputs: [1082 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_411 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 917
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 927
[07/07/2022-05:04:22] [V] [TRT] Add_411 [Add] inputs: [917 -> (32, 4000, 64)[FLOAT]], [927 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_411 for ONNX node: Add_411
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 928 for ONNX tensor: 928
[07/07/2022-05:04:22] [V] [TRT] Add_411 [Add] outputs: [928 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_425 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 942
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_425 [ReduceMean] inputs: [942 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_425 for ONNX node: ReduceMean_425
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 943 for ONNX tensor: 943
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_425 [ReduceMean] outputs: [943 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_554 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1082
[07/07/2022-05:04:22] [V] [TRT] Relu_554 [Relu] inputs: [1082 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_554 for ONNX node: Relu_554
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1083 for ONNX tensor: 1083
[07/07/2022-05:04:22] [V] [TRT] Relu_554 [Relu] outputs: [1083 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_412 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 928
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_412 [ReduceMean] inputs: [928 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_412 for ONNX node: ReduceMean_412
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 929 for ONNX tensor: 929
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_412 [ReduceMean] outputs: [929 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sub_426 [Sub]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 942
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 943
[07/07/2022-05:04:22] [V] [TRT] Sub_426 [Sub] inputs: [942 -> (32, 1, 64)[FLOAT]], [943 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sub_426 for ONNX node: Sub_426
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 944 for ONNX tensor: 944
[07/07/2022-05:04:22] [V] [TRT] Sub_426 [Sub] outputs: [944 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_560 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1083
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2397
[07/07/2022-05:04:22] [V] [TRT] Reshape_560 [Reshape] inputs: [1083 -> (32, 1, 64)[FLOAT]], [2397 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_560 for ONNX node: Reshape_560
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1091 for ONNX tensor: 1091
[07/07/2022-05:04:22] [V] [TRT] Reshape_560 [Reshape] outputs: [1091 -> (32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sub_413 [Sub]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 928
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 929
[07/07/2022-05:04:22] [V] [TRT] Sub_413 [Sub] inputs: [928 -> (32, 4000, 64)[FLOAT]], [929 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sub_413 for ONNX node: Sub_413
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 930 for ONNX tensor: 930
[07/07/2022-05:04:22] [V] [TRT] Sub_413 [Sub] outputs: [930 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Pow_428 [Pow]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 944
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 551
[07/07/2022-05:04:22] [V] [TRT] Pow_428 [Pow] inputs: [944 -> (32, 1, 64)[FLOAT]], [551 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Pow_428 for ONNX node: Pow_428
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 946 for ONNX tensor: 946
[07/07/2022-05:04:22] [V] [TRT] Pow_428 [Pow] outputs: [946 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Gemm_989 [Gemm]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1091
[07/07/2022-05:04:22] [V] [TRT] Searching for input: pathNet.decoder.fc1.weight
[07/07/2022-05:04:22] [V] [TRT] Searching for input: pathNet.decoder.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Gemm_989 [Gemm] inputs: [1091 -> (32, 64)[FLOAT]], [pathNet.decoder.fc1.weight -> (64, 64)[FLOAT]], [pathNet.decoder.fc1.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: pathNet.decoder.fc1.weight for ONNX node: pathNet.decoder.fc1.weight
[07/07/2022-05:04:22] [V] [TRT] Using opA: 0 opB: 1
[07/07/2022-05:04:22] [V] [TRT] GEMM: A, after squeezing: (32, 64)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Gemm_989 for ONNX node: Gemm_989
[07/07/2022-05:04:22] [V] [TRT] Registering layer: pathNet.decoder.fc1.bias for ONNX node: pathNet.decoder.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1583 for ONNX tensor: 1583
[07/07/2022-05:04:22] [V] [TRT] Gemm_989 [Gemm] outputs: [1583 -> (32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Pow_415 [Pow]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 930
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 551
[07/07/2022-05:04:22] [V] [TRT] Pow_415 [Pow] inputs: [930 -> (32, 4000, 64)[FLOAT]], [551 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Pow_415 for ONNX node: Pow_415
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 932 for ONNX tensor: 932
[07/07/2022-05:04:22] [V] [TRT] Pow_415 [Pow] outputs: [932 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_429 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 946
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_429 [ReduceMean] inputs: [946 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_429 for ONNX node: ReduceMean_429
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 947 for ONNX tensor: 947
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_429 [ReduceMean] outputs: [947 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_990 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1583
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_990 [ReduceMean] inputs: [1583 -> (32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_990 for ONNX node: ReduceMean_990
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1584 for ONNX tensor: 1584
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_990 [ReduceMean] outputs: [1584 -> (32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_416 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 932
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_416 [ReduceMean] inputs: [932 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_416 for ONNX node: ReduceMean_416
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 933 for ONNX tensor: 933
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_416 [ReduceMean] outputs: [933 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_431 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 947
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2541
[07/07/2022-05:04:22] [V] [TRT] Add_431 [Add] inputs: [947 -> (32, 1, 1)[FLOAT]], [2541 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_431 for ONNX node: Add_431
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 949 for ONNX tensor: 949
[07/07/2022-05:04:22] [V] [TRT] Add_431 [Add] outputs: [949 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sub_991 [Sub]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1583
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1584
[07/07/2022-05:04:22] [V] [TRT] Sub_991 [Sub] inputs: [1583 -> (32, 64)[FLOAT]], [1584 -> (32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sub_991 for ONNX node: Sub_991
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1585 for ONNX tensor: 1585
[07/07/2022-05:04:22] [V] [TRT] Sub_991 [Sub] outputs: [1585 -> (32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_418 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 933
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2541
[07/07/2022-05:04:22] [V] [TRT] Add_418 [Add] inputs: [933 -> (32, 4000, 1)[FLOAT]], [2541 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_418 for ONNX node: Add_418
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 935 for ONNX tensor: 935
[07/07/2022-05:04:22] [V] [TRT] Add_418 [Add] outputs: [935 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sqrt_432 [Sqrt]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 949
[07/07/2022-05:04:22] [V] [TRT] Sqrt_432 [Sqrt] inputs: [949 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sqrt_432 for ONNX node: Sqrt_432
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 950 for ONNX tensor: 950
[07/07/2022-05:04:22] [V] [TRT] Sqrt_432 [Sqrt] outputs: [950 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Pow_993 [Pow]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1585
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 551
[07/07/2022-05:04:22] [V] [TRT] Pow_993 [Pow] inputs: [1585 -> (32, 64)[FLOAT]], [551 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Pow_993 for ONNX node: Pow_993
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1587 for ONNX tensor: 1587
[07/07/2022-05:04:22] [V] [TRT] Pow_993 [Pow] outputs: [1587 -> (32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sqrt_419 [Sqrt]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 935
[07/07/2022-05:04:22] [V] [TRT] Sqrt_419 [Sqrt] inputs: [935 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sqrt_419 for ONNX node: Sqrt_419
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 936 for ONNX tensor: 936
[07/07/2022-05:04:22] [V] [TRT] Sqrt_419 [Sqrt] outputs: [936 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Div_433 [Div]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 944
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 950
[07/07/2022-05:04:22] [V] [TRT] Div_433 [Div] inputs: [944 -> (32, 1, 64)[FLOAT]], [950 -> (32, 1, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Div_433 for ONNX node: Div_433
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 951 for ONNX tensor: 951
[07/07/2022-05:04:22] [V] [TRT] Div_433 [Div] outputs: [951 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_994 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1587
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_994 [ReduceMean] inputs: [1587 -> (32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_994 for ONNX node: ReduceMean_994
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1588 for ONNX tensor: 1588
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_994 [ReduceMean] outputs: [1588 -> (32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Div_420 [Div]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 930
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 936
[07/07/2022-05:04:22] [V] [TRT] Div_420 [Div] inputs: [930 -> (32, 4000, 64)[FLOAT]], [936 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Div_420 for ONNX node: Div_420
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 937 for ONNX tensor: 937
[07/07/2022-05:04:22] [V] [TRT] Div_420 [Div] outputs: [937 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Mul_434 [Mul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 951
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cg1.fc0.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Mul_434 [Mul] inputs: [951 -> (32, 1, 64)[FLOAT]], [cg1.fc0.act.0.weight -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cg1.fc0.act.0.weight for ONNX node: cg1.fc0.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Mul_434 for ONNX node: Mul_434
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 952 for ONNX tensor: 952
[07/07/2022-05:04:22] [V] [TRT] Mul_434 [Mul] outputs: [952 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_996 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1588
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2541
[07/07/2022-05:04:22] [V] [TRT] Add_996 [Add] inputs: [1588 -> (32, 1)[FLOAT]], [2541 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_996 for ONNX node: Add_996
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1590 for ONNX tensor: 1590
[07/07/2022-05:04:22] [V] [TRT] Add_996 [Add] outputs: [1590 -> (32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Mul_421 [Mul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 937
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cg0.norm.weight
[07/07/2022-05:04:22] [V] [TRT] Mul_421 [Mul] inputs: [937 -> (32, 4000, 64)[FLOAT]], [cg0.norm.weight -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cg0.norm.weight for ONNX node: cg0.norm.weight
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Mul_421 for ONNX node: Mul_421
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 938 for ONNX tensor: 938
[07/07/2022-05:04:22] [V] [TRT] Mul_421 [Mul] outputs: [938 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_435 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 952
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cg1.fc0.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Add_435 [Add] inputs: [952 -> (32, 1, 64)[FLOAT]], [cg1.fc0.act.0.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cg1.fc0.act.0.bias for ONNX node: cg1.fc0.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_435 for ONNX node: Add_435
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 953 for ONNX tensor: 953
[07/07/2022-05:04:22] [V] [TRT] Add_435 [Add] outputs: [953 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sqrt_997 [Sqrt]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1590
[07/07/2022-05:04:22] [V] [TRT] Sqrt_997 [Sqrt] inputs: [1590 -> (32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sqrt_997 for ONNX node: Sqrt_997
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1591 for ONNX tensor: 1591
[07/07/2022-05:04:22] [V] [TRT] Sqrt_997 [Sqrt] outputs: [1591 -> (32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_422 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 938
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cg0.norm.bias
[07/07/2022-05:04:22] [V] [TRT] Add_422 [Add] inputs: [938 -> (32, 4000, 64)[FLOAT]], [cg0.norm.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cg0.norm.bias for ONNX node: cg0.norm.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_422 for ONNX node: Add_422
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 939 for ONNX tensor: 939
[07/07/2022-05:04:22] [V] [TRT] Add_422 [Add] outputs: [939 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_436 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 953
[07/07/2022-05:04:22] [V] [TRT] Relu_436 [Relu] inputs: [953 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_436 for ONNX node: Relu_436
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 954 for ONNX tensor: 954
[07/07/2022-05:04:22] [V] [TRT] Relu_436 [Relu] outputs: [954 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Div_998 [Div]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1585
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1591
[07/07/2022-05:04:22] [V] [TRT] Div_998 [Div] inputs: [1585 -> (32, 64)[FLOAT]], [1591 -> (32, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Div_998 for ONNX node: Div_998
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1592 for ONNX tensor: 1592
[07/07/2022-05:04:22] [V] [TRT] Div_998 [Div] outputs: [1592 -> (32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_437 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 954
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2593
[07/07/2022-05:04:22] [V] [TRT] MatMul_437 [MatMul] inputs: [954 -> (32, 1, 64)[FLOAT]], [2593 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2593 for ONNX node: 2593
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_437 for ONNX node: MatMul_437
[07/07/2022-05:04:22] [I] [TRT] MatMul_437: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 956 for ONNX tensor: 956
[07/07/2022-05:04:22] [V] [TRT] MatMul_437 [MatMul] outputs: [956 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_439 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 939
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2594
[07/07/2022-05:04:22] [V] [TRT] MatMul_439 [MatMul] inputs: [939 -> (32, 4000, 64)[FLOAT]], [2594 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2594 for ONNX node: 2594
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_439 for ONNX node: MatMul_439
[07/07/2022-05:04:22] [I] [TRT] MatMul_439: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 959 for ONNX tensor: 959
[07/07/2022-05:04:22] [V] [TRT] MatMul_439 [MatMul] outputs: [959 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Mul_999 [Mul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1592
[07/07/2022-05:04:22] [V] [TRT] Searching for input: pathNet.decoder.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Mul_999 [Mul] inputs: [1592 -> (32, 64)[FLOAT]], [pathNet.decoder.act.0.weight -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: pathNet.decoder.act.0.weight for ONNX node: pathNet.decoder.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Mul_999 for ONNX node: Mul_999
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1593 for ONNX tensor: 1593
[07/07/2022-05:04:22] [V] [TRT] Mul_999 [Mul] outputs: [1593 -> (32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_438 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cg1.fc0.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 956
[07/07/2022-05:04:22] [V] [TRT] Add_438 [Add] inputs: [cg1.fc0.fc2.bias -> (64)[FLOAT]], [956 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cg1.fc0.fc2.bias for ONNX node: cg1.fc0.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_438 for ONNX node: Add_438
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 957 for ONNX tensor: 957
[07/07/2022-05:04:22] [V] [TRT] Add_438 [Add] outputs: [957 -> (32, 1, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_440 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cg1.fc1.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 959
[07/07/2022-05:04:22] [V] [TRT] Add_440 [Add] inputs: [cg1.fc1.fc1.bias -> (64)[FLOAT]], [959 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cg1.fc1.fc1.bias for ONNX node: cg1.fc1.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_440 for ONNX node: Add_440
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 960 for ONNX tensor: 960
[07/07/2022-05:04:22] [V] [TRT] Add_440 [Add] outputs: [960 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_1000 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1593
[07/07/2022-05:04:22] [V] [TRT] Searching for input: pathNet.decoder.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Add_1000 [Add] inputs: [1593 -> (32, 64)[FLOAT]], [pathNet.decoder.act.0.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: pathNet.decoder.act.0.bias for ONNX node: pathNet.decoder.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_1000 for ONNX node: Add_1000
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1594 for ONNX tensor: 1594
[07/07/2022-05:04:22] [V] [TRT] Add_1000 [Add] outputs: [1594 -> (32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_441 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 960
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_441 [ReduceMean] inputs: [960 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_441 for ONNX node: ReduceMean_441
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 961 for ONNX tensor: 961
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_441 [ReduceMean] outputs: [961 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_462 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 957
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 925
[07/07/2022-05:04:22] [V] [TRT] Expand_462 [Expand] inputs: [957 -> (32, 1, 64)[FLOAT]], [925 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_462 for ONNX node: Expand_462
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 984 for ONNX tensor: 984
[07/07/2022-05:04:22] [V] [TRT] Expand_462 [Expand] outputs: [984 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_1001 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1594
[07/07/2022-05:04:22] [V] [TRT] Relu_1001 [Relu] inputs: [1594 -> (32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_1001 for ONNX node: Relu_1001
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1595 for ONNX tensor: 1595
[07/07/2022-05:04:22] [V] [TRT] Relu_1001 [Relu] outputs: [1595 -> (32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sub_442 [Sub]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 960
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 961
[07/07/2022-05:04:22] [V] [TRT] Sub_442 [Sub] inputs: [960 -> (32, 4000, 64)[FLOAT]], [961 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sub_442 for ONNX node: Sub_442
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 962 for ONNX tensor: 962
[07/07/2022-05:04:22] [V] [TRT] Sub_442 [Sub] outputs: [962 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Gemm_1002 [Gemm]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1595
[07/07/2022-05:04:22] [V] [TRT] Searching for input: pathNet.decoder.fc2.weight
[07/07/2022-05:04:22] [V] [TRT] Searching for input: pathNet.decoder.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Gemm_1002 [Gemm] inputs: [1595 -> (32, 64)[FLOAT]], [pathNet.decoder.fc2.weight -> (64, 64)[FLOAT]], [pathNet.decoder.fc2.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: pathNet.decoder.fc2.weight for ONNX node: pathNet.decoder.fc2.weight
[07/07/2022-05:04:22] [V] [TRT] Using opA: 0 opB: 1
[07/07/2022-05:04:22] [V] [TRT] GEMM: A, after squeezing: (32, 64)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Gemm_1002 for ONNX node: Gemm_1002
[07/07/2022-05:04:22] [V] [TRT] Registering layer: pathNet.decoder.fc2.bias for ONNX node: pathNet.decoder.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1596 for ONNX tensor: 1596
[07/07/2022-05:04:22] [V] [TRT] Gemm_1002 [Gemm] outputs: [1596 -> (32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Pow_444 [Pow]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 962
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 551
[07/07/2022-05:04:22] [V] [TRT] Pow_444 [Pow] inputs: [962 -> (32, 4000, 64)[FLOAT]], [551 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Pow_444 for ONNX node: Pow_444
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 964 for ONNX tensor: 964
[07/07/2022-05:04:22] [V] [TRT] Pow_444 [Pow] outputs: [964 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_1003 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1596
[07/07/2022-05:04:22] [V] [TRT] Relu_1003 [Relu] inputs: [1596 -> (32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_1003 for ONNX node: Relu_1003
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1597 for ONNX tensor: 1597
[07/07/2022-05:04:22] [V] [TRT] Relu_1003 [Relu] outputs: [1597 -> (32, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_445 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 964
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_445 [ReduceMean] inputs: [964 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_445 for ONNX node: ReduceMean_445
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 965 for ONNX tensor: 965
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_445 [ReduceMean] outputs: [965 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Gemm_1004 [Gemm]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1597
[07/07/2022-05:04:22] [V] [TRT] Searching for input: pathNet.out.weight
[07/07/2022-05:04:22] [V] [TRT] Searching for input: pathNet.out.bias
[07/07/2022-05:04:22] [V] [TRT] Gemm_1004 [Gemm] inputs: [1597 -> (32, 64)[FLOAT]], [pathNet.out.weight -> (120, 64)[FLOAT]], [pathNet.out.bias -> (120)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: pathNet.out.weight for ONNX node: pathNet.out.weight
[07/07/2022-05:04:22] [V] [TRT] Using opA: 0 opB: 1
[07/07/2022-05:04:22] [V] [TRT] GEMM: A, after squeezing: (32, 64)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Gemm_1004 for ONNX node: Gemm_1004
[07/07/2022-05:04:22] [V] [TRT] Registering layer: pathNet.out.bias for ONNX node: pathNet.out.bias
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1598 for ONNX tensor: 1598
[07/07/2022-05:04:22] [V] [TRT] Gemm_1004 [Gemm] outputs: [1598 -> (32, 120)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_447 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 965
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2541
[07/07/2022-05:04:22] [V] [TRT] Add_447 [Add] inputs: [965 -> (32, 4000, 1)[FLOAT]], [2541 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_447 for ONNX node: Add_447
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 967 for ONNX tensor: 967
[07/07/2022-05:04:22] [V] [TRT] Add_447 [Add] outputs: [967 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1006 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1598
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1599
[07/07/2022-05:04:22] [V] [TRT] Reshape_1006 [Reshape] inputs: [1598 -> (32, 120)[FLOAT]], [1599 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1006 for ONNX node: Reshape_1006
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1600 for ONNX tensor: 1600
[07/07/2022-05:04:22] [V] [TRT] Reshape_1006 [Reshape] outputs: [1600 -> (32, 30, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sqrt_448 [Sqrt]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 967
[07/07/2022-05:04:22] [V] [TRT] Sqrt_448 [Sqrt] inputs: [967 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sqrt_448 for ONNX node: Sqrt_448
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 968 for ONNX tensor: 968
[07/07/2022-05:04:22] [V] [TRT] Sqrt_448 [Sqrt] outputs: [968 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Slice_1011 [Slice]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1600
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2562
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1040
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2622
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2443
[07/07/2022-05:04:22] [V] [TRT] Slice_1011 [Slice] inputs: [1600 -> (32, 30, 4)[FLOAT]], [2562 -> (1)[INT32]], [1040 -> (1)[INT32]], [2622 -> (1)[INT32]], [2443 -> (1)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Slice_1011 for ONNX node: Slice_1011
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1605 for ONNX tensor: 1605
[07/07/2022-05:04:22] [V] [TRT] Slice_1011 [Slice] outputs: [1605 -> (32, 30, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Div_449 [Div]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 962
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 968
[07/07/2022-05:04:22] [V] [TRT] Div_449 [Div] inputs: [962 -> (32, 4000, 64)[FLOAT]], [968 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Div_449 for ONNX node: Div_449
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 969 for ONNX tensor: 969
[07/07/2022-05:04:22] [V] [TRT] Div_449 [Div] outputs: [969 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: CumSum_1013 [CumSum]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1605
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1606
[07/07/2022-05:04:22] [V] [TRT] CumSum_1013 [CumSum] inputs: [1605 -> (32, 30, 4)[FLOAT]], [1606 -> ()[INT32]], 
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_520: broadcasting input1 to make tensors conform, dims(input0)=[32,1,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_385: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_55: broadcasting input1 to make tensors conform, dims(input0)=[32,512,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_52: broadcasting input1 to make tensors conform, dims(input0)=[32,128,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_70: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_72: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_74: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_400: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_100: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_127: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_129: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_131: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_175: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_219: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_221: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_296: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_294: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_369: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_538: broadcasting input1 to make tensors conform, dims(input0)=[32,1,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_383: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_423: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_552: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_439: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_437: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Original shape: (32, 1, 4), squeezing to: (32, 4)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_520: broadcasting input1 to make tensors conform, dims(input0)=[32,1,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_385: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_55: broadcasting input1 to make tensors conform, dims(input0)=[32,512,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_52: broadcasting input1 to make tensors conform, dims(input0)=[32,128,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_70: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_72: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_74: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_400: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_100: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_127: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_129: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_131: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_175: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_219: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_221: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_296: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_294: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_369: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_538: broadcasting input1 to make tensors conform, dims(input0)=[32,1,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_383: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_423: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_552: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_439: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_437: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1607 for ONNX tensor: 1607
[07/07/2022-05:04:22] [V] [TRT] CumSum_1013 [CumSum] outputs: [1607 -> (32, 30, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Mul_450 [Mul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 969
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cg1.fc1.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Mul_450 [Mul] inputs: [969 -> (32, 4000, 64)[FLOAT]], [cg1.fc1.act.0.weight -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cg1.fc1.act.0.weight for ONNX node: cg1.fc1.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Mul_450 for ONNX node: Mul_450
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 970 for ONNX tensor: 970
[07/07/2022-05:04:22] [V] [TRT] Mul_450 [Mul] outputs: [970 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_1021 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1607
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1614
[07/07/2022-05:04:22] [V] [TRT] Add_1021 [Add] inputs: [1607 -> (32, 30, 4)[FLOAT]], [1614 -> (32, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_1021 for ONNX node: Add_1021
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1615 for ONNX tensor: 1615
[07/07/2022-05:04:22] [V] [TRT] Add_1021 [Add] outputs: [1615 -> (32, 30, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_451 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 970
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cg1.fc1.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Add_451 [Add] inputs: [970 -> (32, 4000, 64)[FLOAT]], [cg1.fc1.act.0.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cg1.fc1.act.0.bias for ONNX node: cg1.fc1.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_451 for ONNX node: Add_451
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 971 for ONNX tensor: 971
[07/07/2022-05:04:22] [V] [TRT] Add_451 [Add] outputs: [971 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1028 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1615
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1621
[07/07/2022-05:04:22] [V] [TRT] Expand_1028 [Expand] inputs: [1615 -> (32, 30, 4)[FLOAT]], [1621 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1028 for ONNX node: Expand_1028
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1622 for ONNX tensor: 1622
[07/07/2022-05:04:22] [V] [TRT] Expand_1028 [Expand] outputs: [1622 -> (32, 30, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_452 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 971
[07/07/2022-05:04:22] [V] [TRT] Relu_452 [Relu] inputs: [971 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_452 for ONNX node: Relu_452
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 972 for ONNX tensor: 972
[07/07/2022-05:04:22] [V] [TRT] Relu_452 [Relu] outputs: [972 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1093 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1622
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1621
[07/07/2022-05:04:22] [V] [TRT] Reshape_1093 [Reshape] inputs: [1622 -> (32, 30, 4)[FLOAT]], [1621 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1093 for ONNX node: Reshape_1093
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1687 for ONNX tensor: 1687
[07/07/2022-05:04:22] [V] [TRT] Reshape_1093 [Reshape] outputs: [1687 -> (32, 30, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_453 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 972
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2595
[07/07/2022-05:04:22] [V] [TRT] MatMul_453 [MatMul] inputs: [972 -> (32, 4000, 64)[FLOAT]], [2595 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2595 for ONNX node: 2595
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_453 for ONNX node: MatMul_453
[07/07/2022-05:04:22] [I] [TRT] MatMul_453: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 974 for ONNX tensor: 974
[07/07/2022-05:04:22] [V] [TRT] MatMul_453 [MatMul] outputs: [974 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ScatterND_1094 [ScatterND]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1600
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1680
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1687
[07/07/2022-05:04:22] [V] [TRT] ScatterND_1094 [ScatterND] inputs: [1600 -> (32, 30, 4)[FLOAT]], [1680 -> (32, 30, 4, 3)[INT32]], [1687 -> (32, 30, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 1680 for ONNX node: 1680
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ScatterND_1094 for ONNX node: ScatterND_1094
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1688 for ONNX tensor: 1688
[07/07/2022-05:04:22] [V] [TRT] ScatterND_1094 [ScatterND] outputs: [1688 -> (32, 30, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_454 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cg1.fc1.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 974
[07/07/2022-05:04:22] [V] [TRT] Add_454 [Add] inputs: [cg1.fc1.fc2.bias -> (64)[FLOAT]], [974 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cg1.fc1.fc2.bias for ONNX node: cg1.fc1.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_454 for ONNX node: Add_454
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 975 for ONNX tensor: 975
[07/07/2022-05:04:22] [V] [TRT] Add_454 [Add] outputs: [975 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1104 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1688
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1701
[07/07/2022-05:04:22] [V] [TRT] Reshape_1104 [Reshape] inputs: [1688 -> (32, 30, 4)[FLOAT]], [1701 -> (4)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1104 for ONNX node: Reshape_1104
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1702 for ONNX tensor: 1702
[07/07/2022-05:04:22] [V] [TRT] Reshape_1104 [Reshape] outputs: [1702 -> (32, 1, 30, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Mul_463 [Mul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 975
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 984
[07/07/2022-05:04:22] [V] [TRT] Mul_463 [Mul] inputs: [975 -> (32, 4000, 64)[FLOAT]], [984 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Mul_463 for ONNX node: Mul_463
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 985 for ONNX tensor: 985
[07/07/2022-05:04:22] [V] [TRT] Mul_463 [Mul] outputs: [985 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Squeeze_1105 [Squeeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1702
[07/07/2022-05:04:22] [V] [TRT] Squeeze_1105 [Squeeze] inputs: [1702 -> (32, 1, 30, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (32, 1, 30, 4), squeezing to: (32, 30, 4)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Squeeze_1105 for ONNX node: Squeeze_1105
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: pred_traj_tf_173 for ONNX tensor: pred_traj_tf
[07/07/2022-05:04:22] [V] [TRT] Squeeze_1105 [Squeeze] outputs: [pred_traj_tf -> (32, 30, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_464 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 975
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 985
[07/07/2022-05:04:22] [V] [TRT] Add_464 [Add] inputs: [975 -> (32, 4000, 64)[FLOAT]], [985 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_464 for ONNX node: Add_464
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 986 for ONNX tensor: 986
[07/07/2022-05:04:22] [V] [TRT] Add_464 [Add] outputs: [986 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_465 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 986
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_465 [ReduceMean] inputs: [986 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_465 for ONNX node: ReduceMean_465
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 987 for ONNX tensor: 987
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_465 [ReduceMean] outputs: [987 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sub_466 [Sub]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 986
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 987
[07/07/2022-05:04:22] [V] [TRT] Sub_466 [Sub] inputs: [986 -> (32, 4000, 64)[FLOAT]], [987 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sub_466 for ONNX node: Sub_466
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 988 for ONNX tensor: 988
[07/07/2022-05:04:22] [V] [TRT] Sub_466 [Sub] outputs: [988 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Pow_468 [Pow]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 988
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 551
[07/07/2022-05:04:22] [V] [TRT] Pow_468 [Pow] inputs: [988 -> (32, 4000, 64)[FLOAT]], [551 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Pow_468 for ONNX node: Pow_468
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 990 for ONNX tensor: 990
[07/07/2022-05:04:22] [V] [TRT] Pow_468 [Pow] outputs: [990 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_469 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 990
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_469 [ReduceMean] inputs: [990 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_469 for ONNX node: ReduceMean_469
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 991 for ONNX tensor: 991
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_469 [ReduceMean] outputs: [991 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_471 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 991
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2541
[07/07/2022-05:04:22] [V] [TRT] Add_471 [Add] inputs: [991 -> (32, 4000, 1)[FLOAT]], [2541 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_471 for ONNX node: Add_471
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 993 for ONNX tensor: 993
[07/07/2022-05:04:22] [V] [TRT] Add_471 [Add] outputs: [993 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sqrt_472 [Sqrt]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 993
[07/07/2022-05:04:22] [V] [TRT] Sqrt_472 [Sqrt] inputs: [993 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sqrt_472 for ONNX node: Sqrt_472
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 994 for ONNX tensor: 994
[07/07/2022-05:04:22] [V] [TRT] Sqrt_472 [Sqrt] outputs: [994 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Div_473 [Div]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 988
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 994
[07/07/2022-05:04:22] [V] [TRT] Div_473 [Div] inputs: [988 -> (32, 4000, 64)[FLOAT]], [994 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Div_473 for ONNX node: Div_473
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 995 for ONNX tensor: 995
[07/07/2022-05:04:22] [V] [TRT] Div_473 [Div] outputs: [995 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Mul_474 [Mul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 995
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cg1.norm.weight
[07/07/2022-05:04:22] [V] [TRT] Mul_474 [Mul] inputs: [995 -> (32, 4000, 64)[FLOAT]], [cg1.norm.weight -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cg1.norm.weight for ONNX node: cg1.norm.weight
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Mul_474 for ONNX node: Mul_474
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 996 for ONNX tensor: 996
[07/07/2022-05:04:22] [V] [TRT] Mul_474 [Mul] outputs: [996 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_475 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 996
[07/07/2022-05:04:22] [V] [TRT] Searching for input: cg1.norm.bias
[07/07/2022-05:04:22] [V] [TRT] Add_475 [Add] inputs: [996 -> (32, 4000, 64)[FLOAT]], [cg1.norm.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: cg1.norm.bias for ONNX node: cg1.norm.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_475 for ONNX node: Add_475
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 997 for ONNX tensor: 997
[07/07/2022-05:04:22] [V] [TRT] Add_475 [Add] outputs: [997 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_476 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 997
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2597
[07/07/2022-05:04:22] [V] [TRT] MatMul_476 [MatMul] inputs: [997 -> (32, 4000, 64)[FLOAT]], [2597 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2597 for ONNX node: 2597
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_476 for ONNX node: MatMul_476
[07/07/2022-05:04:22] [I] [TRT] MatMul_476: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 999 for ONNX tensor: 999
[07/07/2022-05:04:22] [V] [TRT] MatMul_476 [MatMul] outputs: [999 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_477 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: targetNet.mlp.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 999
[07/07/2022-05:04:22] [V] [TRT] Add_477 [Add] inputs: [targetNet.mlp.fc1.bias -> (64)[FLOAT]], [999 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: targetNet.mlp.fc1.bias for ONNX node: targetNet.mlp.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_477 for ONNX node: Add_477
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1000 for ONNX tensor: 1000
[07/07/2022-05:04:22] [V] [TRT] Add_477 [Add] outputs: [1000 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_478 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1000
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_478 [ReduceMean] inputs: [1000 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_478 for ONNX node: ReduceMean_478
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1001 for ONNX tensor: 1001
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_478 [ReduceMean] outputs: [1001 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sub_479 [Sub]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1000
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1001
[07/07/2022-05:04:22] [V] [TRT] Sub_479 [Sub] inputs: [1000 -> (32, 4000, 64)[FLOAT]], [1001 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sub_479 for ONNX node: Sub_479
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1002 for ONNX tensor: 1002
[07/07/2022-05:04:22] [V] [TRT] Sub_479 [Sub] outputs: [1002 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Pow_481 [Pow]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1002
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 551
[07/07/2022-05:04:22] [V] [TRT] Pow_481 [Pow] inputs: [1002 -> (32, 4000, 64)[FLOAT]], [551 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Pow_481 for ONNX node: Pow_481
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1004 for ONNX tensor: 1004
[07/07/2022-05:04:22] [V] [TRT] Pow_481 [Pow] outputs: [1004 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_482 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1004
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_482 [ReduceMean] inputs: [1004 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_482 for ONNX node: ReduceMean_482
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1005 for ONNX tensor: 1005
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_482 [ReduceMean] outputs: [1005 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_484 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1005
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2541
[07/07/2022-05:04:22] [V] [TRT] Add_484 [Add] inputs: [1005 -> (32, 4000, 1)[FLOAT]], [2541 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_484 for ONNX node: Add_484
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1007 for ONNX tensor: 1007
[07/07/2022-05:04:22] [V] [TRT] Add_484 [Add] outputs: [1007 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sqrt_485 [Sqrt]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1007
[07/07/2022-05:04:22] [V] [TRT] Sqrt_485 [Sqrt] inputs: [1007 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sqrt_485 for ONNX node: Sqrt_485
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1008 for ONNX tensor: 1008
[07/07/2022-05:04:22] [V] [TRT] Sqrt_485 [Sqrt] outputs: [1008 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Div_486 [Div]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1002
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1008
[07/07/2022-05:04:22] [V] [TRT] Div_486 [Div] inputs: [1002 -> (32, 4000, 64)[FLOAT]], [1008 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Div_486 for ONNX node: Div_486
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1009 for ONNX tensor: 1009
[07/07/2022-05:04:22] [V] [TRT] Div_486 [Div] outputs: [1009 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Mul_487 [Mul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1009
[07/07/2022-05:04:22] [V] [TRT] Searching for input: targetNet.mlp.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Mul_487 [Mul] inputs: [1009 -> (32, 4000, 64)[FLOAT]], [targetNet.mlp.act.0.weight -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: targetNet.mlp.act.0.weight for ONNX node: targetNet.mlp.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Mul_487 for ONNX node: Mul_487
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1010 for ONNX tensor: 1010
[07/07/2022-05:04:22] [V] [TRT] Mul_487 [Mul] outputs: [1010 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_488 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1010
[07/07/2022-05:04:22] [V] [TRT] Searching for input: targetNet.mlp.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Add_488 [Add] inputs: [1010 -> (32, 4000, 64)[FLOAT]], [targetNet.mlp.act.0.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: targetNet.mlp.act.0.bias for ONNX node: targetNet.mlp.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_488 for ONNX node: Add_488
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1011 for ONNX tensor: 1011
[07/07/2022-05:04:22] [V] [TRT] Add_488 [Add] outputs: [1011 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_489 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1011
[07/07/2022-05:04:22] [V] [TRT] Relu_489 [Relu] inputs: [1011 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_489 for ONNX node: Relu_489
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1012 for ONNX tensor: 1012
[07/07/2022-05:04:22] [V] [TRT] Relu_489 [Relu] outputs: [1012 -> (32, 4000, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_490 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1012
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2598
[07/07/2022-05:04:22] [V] [TRT] MatMul_490 [MatMul] inputs: [1012 -> (32, 4000, 64)[FLOAT]], [2598 -> (64, 5)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2598 for ONNX node: 2598
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_490 for ONNX node: MatMul_490
[07/07/2022-05:04:22] [I] [TRT] MatMul_490: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,5][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1014 for ONNX tensor: 1014
[07/07/2022-05:04:22] [V] [TRT] MatMul_490 [MatMul] outputs: [1014 -> (32, 4000, 5)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_491 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: targetNet.mlp.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1014
[07/07/2022-05:04:22] [V] [TRT] Add_491 [Add] inputs: [targetNet.mlp.fc2.bias -> (5)[FLOAT]], [1014 -> (32, 4000, 5)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: targetNet.mlp.fc2.bias for ONNX node: targetNet.mlp.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_491 for ONNX node: Add_491
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1015 for ONNX tensor: 1015
[07/07/2022-05:04:22] [V] [TRT] Add_491 [Add] outputs: [1015 -> (32, 4000, 5)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_493 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1015
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1016
[07/07/2022-05:04:22] [V] [TRT] Reshape_493 [Reshape] inputs: [1015 -> (32, 4000, 5)[FLOAT]], [1016 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_493 for ONNX node: Reshape_493
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1017 for ONNX tensor: 1017
[07/07/2022-05:04:22] [V] [TRT] Reshape_493 [Reshape] outputs: [1017 -> (32, 4000, 5)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Split_494 [Split]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1017
[07/07/2022-05:04:22] [V] [TRT] Split_494 [Split] inputs: [1017 -> (32, 4000, 5)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_494 for ONNX node: Split_494
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Split_494_174 for ONNX node: Split_494
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1018 for ONNX tensor: 1018
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1019 for ONNX tensor: 1019
[07/07/2022-05:04:22] [V] [TRT] Split_494 [Split] outputs: [1018 -> (32, 4000, 1)[FLOAT]], [1019 -> (32, 4000, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Slice_499 [Slice]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1019
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1021
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1022
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2622
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2443
[07/07/2022-05:04:22] [V] [TRT] Slice_499 [Slice] inputs: [1019 -> (32, 4000, 4)[FLOAT]], [1021 -> (1)[INT32]], [1022 -> (1)[INT32]], [2622 -> (1)[INT32]], [2443 -> (1)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Slice_499 for ONNX node: Slice_499
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1024 for ONNX tensor: 1024
[07/07/2022-05:04:22] [V] [TRT] Slice_499 [Slice] outputs: [1024 -> (32, 4000, 2)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Squeeze_501 [Squeeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1018
[07/07/2022-05:04:22] [V] [TRT] Squeeze_501 [Squeeze] inputs: [1018 -> (32, 4000, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (32, 4000, 1), squeezing to: (32, 4000)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Squeeze_501 for ONNX node: Squeeze_501
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1026 for ONNX tensor: 1026
[07/07/2022-05:04:22] [V] [TRT] Squeeze_501 [Squeeze] outputs: [1026 -> (32, 4000)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Slice_511 [Slice]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1019
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2562
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2622
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2622
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2443
[07/07/2022-05:04:22] [V] [TRT] Slice_511 [Slice] inputs: [1019 -> (32, 4000, 4)[FLOAT]], [2562 -> (1)[INT32]], [2622 -> (1)[INT32]], [2622 -> (1)[INT32]], [2443 -> (1)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Slice_511 for ONNX node: Slice_511
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1036 for ONNX tensor: 1036
[07/07/2022-05:04:22] [V] [TRT] Slice_511 [Slice] outputs: [1036 -> (32, 4000, 2)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Tanh_500 [Tanh]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1024
[07/07/2022-05:04:22] [V] [TRT] Tanh_500 [Tanh] inputs: [1024 -> (32, 4000, 2)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Tanh_500 for ONNX node: Tanh_500
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1025 for ONNX tensor: 1025
[07/07/2022-05:04:22] [V] [TRT] Tanh_500 [Tanh] outputs: [1025 -> (32, 4000, 2)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Where_506 [Where]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1028
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1030
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1026
[07/07/2022-05:04:22] [V] [TRT] Where_506 [Where] inputs: [1028 -> (32, 4000)[BOOL]], [1030 -> ()[FLOAT]], [1026 -> (32, 4000)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 1030 for ONNX node: 1030
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Where_506 for ONNX node: Where_506
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: mode_prob_175 for ONNX tensor: mode_prob
[07/07/2022-05:04:22] [V] [TRT] Where_506 [Where] outputs: [mode_prob -> (32, 4000)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Concat_512 [Concat]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1036
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1025
[07/07/2022-05:04:22] [V] [TRT] Concat_512 [Concat] inputs: [1036 -> (32, 4000, 2)[FLOAT]], [1025 -> (32, 4000, 2)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Concat_512 for ONNX node: Concat_512
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: pred_disp_176 for ONNX tensor: pred_disp
[07/07/2022-05:04:22] [V] [TRT] Concat_512 [Concat] outputs: [pred_disp -> (32, 4000, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: TopK_1106 [TopK]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: mode_prob
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2607
[07/07/2022-05:04:22] [V] [TRT] TopK_1106 [TopK] inputs: [mode_prob -> (32, 4000)[FLOAT]], [2607 -> (1)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: TopK_1106 for ONNX node: TopK_1106
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1707 for ONNX tensor: 1707
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1708 for ONNX tensor: 1708
[07/07/2022-05:04:22] [V] [TRT] TopK_1106 [TopK] outputs: [1707 -> (32, 50)[FLOAT]], [1708 -> (32, 50)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_1107 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: target
[07/07/2022-05:04:22] [V] [TRT] Searching for input: pred_disp
[07/07/2022-05:04:22] [V] [TRT] Add_1107 [Add] inputs: [target -> (32, 4000, 4)[FLOAT]], [pred_disp -> (32, 4000, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_1107 for ONNX node: Add_1107
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1709 for ONNX tensor: 1709
[07/07/2022-05:04:22] [V] [TRT] Add_1107 [Add] outputs: [1709 -> (32, 4000, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Unsqueeze_1108 [Unsqueeze]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1708
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1108 [Unsqueeze] inputs: [1708 -> (32, 50)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Original shape: (32, 50), unsqueezing to: (32, 50, 1)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Unsqueeze_1108 for ONNX node: Unsqueeze_1108
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1710 for ONNX tensor: 1710
[07/07/2022-05:04:22] [V] [TRT] Unsqueeze_1108 [Unsqueeze] outputs: [1710 -> (32, 50, 1)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1114 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1710
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1175
[07/07/2022-05:04:22] [V] [TRT] Expand_1114 [Expand] inputs: [1710 -> (32, 50, 1)[INT32]], [1175 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1114 for ONNX node: Expand_1114
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1726 for ONNX tensor: 1726
[07/07/2022-05:04:22] [V] [TRT] Expand_1114 [Expand] outputs: [1726 -> (32, 50, 4)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: GatherElements_1115 [GatherElements]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1709
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1726
[07/07/2022-05:04:22] [V] [TRT] GatherElements_1115 [GatherElements] inputs: [1709 -> (32, 4000, 4)[FLOAT]], [1726 -> (32, 50, 4)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Using Gather axis: 1
[07/07/2022-05:04:22] [V] [TRT] Registering layer: GatherElements_1115 for ONNX node: GatherElements_1115
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1727 for ONNX tensor: 1727
[07/07/2022-05:04:22] [V] [TRT] GatherElements_1115 [GatherElements] outputs: [1727 -> (32, 50, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_1116 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1727
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2586
[07/07/2022-05:04:22] [V] [TRT] MatMul_1116 [MatMul] inputs: [1727 -> (32, 50, 4)[FLOAT]], [2586 -> (4, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_1116 for ONNX node: MatMul_1116
[07/07/2022-05:04:22] [I] [TRT] MatMul_1116: broadcasting input1 to make tensors conform, dims(input0)=[32,50,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1729 for ONNX tensor: 1729
[07/07/2022-05:04:22] [V] [TRT] MatMul_1116 [MatMul] outputs: [1729 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_1117 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: fc0_target.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1729
[07/07/2022-05:04:22] [V] [TRT] Add_1117 [Add] inputs: [fc0_target.bias -> (64)[FLOAT]], [1729 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_1117 for ONNX node: Add_1117
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1730 for ONNX tensor: 1730
[07/07/2022-05:04:22] [V] [TRT] Add_1117 [Add] outputs: [1730 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Concat_1133 [Concat]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1746
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1730
[07/07/2022-05:04:22] [V] [TRT] Concat_1133 [Concat] inputs: [1746 -> (32, 50, 64)[FLOAT]], [1730 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Concat_1133 for ONNX node: Concat_1133
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1747 for ONNX tensor: 1747
[07/07/2022-05:04:22] [V] [TRT] Concat_1133 [Concat] outputs: [1747 -> (32, 50, 128)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_1134 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1747
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2601
[07/07/2022-05:04:22] [V] [TRT] MatMul_1134 [MatMul] inputs: [1747 -> (32, 50, 128)[FLOAT]], [2601 -> (128, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_1134 for ONNX node: MatMul_1134
[07/07/2022-05:04:22] [I] [TRT] MatMul_1134: broadcasting input1 to make tensors conform, dims(input0)=[32,50,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1749 for ONNX tensor: 1749
[07/07/2022-05:04:22] [V] [TRT] MatMul_1134 [MatMul] outputs: [1749 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_1135 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: fuse_path.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1749
[07/07/2022-05:04:22] [V] [TRT] Add_1135 [Add] inputs: [fuse_path.fc1.bias -> (64)[FLOAT]], [1749 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_1135 for ONNX node: Add_1135
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1750 for ONNX tensor: 1750
[07/07/2022-05:04:22] [V] [TRT] Add_1135 [Add] outputs: [1750 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_1136 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1750
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_1136 [ReduceMean] inputs: [1750 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_1136 for ONNX node: ReduceMean_1136
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1751 for ONNX tensor: 1751
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_1136 [ReduceMean] outputs: [1751 -> (32, 50, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sub_1137 [Sub]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1750
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1751
[07/07/2022-05:04:22] [V] [TRT] Sub_1137 [Sub] inputs: [1750 -> (32, 50, 64)[FLOAT]], [1751 -> (32, 50, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sub_1137 for ONNX node: Sub_1137
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1752 for ONNX tensor: 1752
[07/07/2022-05:04:22] [V] [TRT] Sub_1137 [Sub] outputs: [1752 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Pow_1139 [Pow]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1752
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 551
[07/07/2022-05:04:22] [V] [TRT] Pow_1139 [Pow] inputs: [1752 -> (32, 50, 64)[FLOAT]], [551 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Pow_1139 for ONNX node: Pow_1139
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1754 for ONNX tensor: 1754
[07/07/2022-05:04:22] [V] [TRT] Pow_1139 [Pow] outputs: [1754 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_1140 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1754
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_1140 [ReduceMean] inputs: [1754 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_1140 for ONNX node: ReduceMean_1140
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1755 for ONNX tensor: 1755
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_1140 [ReduceMean] outputs: [1755 -> (32, 50, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_1142 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1755
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2541
[07/07/2022-05:04:22] [V] [TRT] Add_1142 [Add] inputs: [1755 -> (32, 50, 1)[FLOAT]], [2541 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_1142 for ONNX node: Add_1142
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1757 for ONNX tensor: 1757
[07/07/2022-05:04:22] [V] [TRT] Add_1142 [Add] outputs: [1757 -> (32, 50, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sqrt_1143 [Sqrt]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1757
[07/07/2022-05:04:22] [V] [TRT] Sqrt_1143 [Sqrt] inputs: [1757 -> (32, 50, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sqrt_1143 for ONNX node: Sqrt_1143
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1758 for ONNX tensor: 1758
[07/07/2022-05:04:22] [V] [TRT] Sqrt_1143 [Sqrt] outputs: [1758 -> (32, 50, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Div_1144 [Div]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1752
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1758
[07/07/2022-05:04:22] [V] [TRT] Div_1144 [Div] inputs: [1752 -> (32, 50, 64)[FLOAT]], [1758 -> (32, 50, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Div_1144 for ONNX node: Div_1144
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1759 for ONNX tensor: 1759
[07/07/2022-05:04:22] [V] [TRT] Div_1144 [Div] outputs: [1759 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Mul_1145 [Mul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1759
[07/07/2022-05:04:22] [V] [TRT] Searching for input: fuse_path.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Mul_1145 [Mul] inputs: [1759 -> (32, 50, 64)[FLOAT]], [fuse_path.act.0.weight -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Mul_1145 for ONNX node: Mul_1145
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1760 for ONNX tensor: 1760
[07/07/2022-05:04:22] [V] [TRT] Mul_1145 [Mul] outputs: [1760 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_1146 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1760
[07/07/2022-05:04:22] [V] [TRT] Searching for input: fuse_path.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Add_1146 [Add] inputs: [1760 -> (32, 50, 64)[FLOAT]], [fuse_path.act.0.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_1146 for ONNX node: Add_1146
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1761 for ONNX tensor: 1761
[07/07/2022-05:04:22] [V] [TRT] Add_1146 [Add] outputs: [1761 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_1147 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1761
[07/07/2022-05:04:22] [V] [TRT] Relu_1147 [Relu] inputs: [1761 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_1147 for ONNX node: Relu_1147
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1762 for ONNX tensor: 1762
[07/07/2022-05:04:22] [V] [TRT] Relu_1147 [Relu] outputs: [1762 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: MatMul_1148 [MatMul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1762
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2602
[07/07/2022-05:04:22] [V] [TRT] MatMul_1148 [MatMul] inputs: [1762 -> (32, 50, 64)[FLOAT]], [2602 -> (64, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: MatMul_1148 for ONNX node: MatMul_1148
[07/07/2022-05:04:22] [I] [TRT] MatMul_1148: broadcasting input1 to make tensors conform, dims(input0)=[32,50,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1764 for ONNX tensor: 1764
[07/07/2022-05:04:22] [V] [TRT] MatMul_1148 [MatMul] outputs: [1764 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_1149 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: fuse_path.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1764
[07/07/2022-05:04:22] [V] [TRT] Add_1149 [Add] inputs: [fuse_path.fc2.bias -> (64)[FLOAT]], [1764 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_1149 for ONNX node: Add_1149
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1765 for ONNX tensor: 1765
[07/07/2022-05:04:22] [V] [TRT] Add_1149 [Add] outputs: [1765 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_1150 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1765
[07/07/2022-05:04:22] [V] [TRT] Relu_1150 [Relu] inputs: [1765 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_1150 for ONNX node: Relu_1150
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1766 for ONNX tensor: 1766
[07/07/2022-05:04:22] [V] [TRT] Relu_1150 [Relu] outputs: [1766 -> (32, 50, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1156 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1766
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2397
[07/07/2022-05:04:22] [V] [TRT] Reshape_1156 [Reshape] inputs: [1766 -> (32, 50, 64)[FLOAT]], [2397 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1156 for ONNX node: Reshape_1156
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 1774 for ONNX tensor: 1774
[07/07/2022-05:04:22] [V] [TRT] Reshape_1156 [Reshape] outputs: [1774 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Gemm_1585 [Gemm]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1774
[07/07/2022-05:04:22] [V] [TRT] Searching for input: pathNet.decoder.fc1.weight
[07/07/2022-05:04:22] [V] [TRT] Searching for input: pathNet.decoder.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Gemm_1585 [Gemm] inputs: [1774 -> (1600, 64)[FLOAT]], [pathNet.decoder.fc1.weight -> (64, 64)[FLOAT]], [pathNet.decoder.fc1.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: pathNet.decoder.fc1.weight_177 for ONNX node: pathNet.decoder.fc1.weight
[07/07/2022-05:04:22] [E] [TRT] ImporterContext.hpp:187: Constant layer: pathNet.decoder.fc1.weight_177 can be a duplicate of: pathNet.decoder.fc1.weight
[07/07/2022-05:04:22] [V] [TRT] Using opA: 0 opB: 1
[07/07/2022-05:04:22] [V] [TRT] GEMM: A, after squeezing: (1600, 64)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Gemm_1585 for ONNX node: Gemm_1585
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2266 for ONNX tensor: 2266
[07/07/2022-05:04:22] [V] [TRT] Gemm_1585 [Gemm] outputs: [2266 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_1586 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2266
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_1586 [ReduceMean] inputs: [2266 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_1586 for ONNX node: ReduceMean_1586
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2267 for ONNX tensor: 2267
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_1586 [ReduceMean] outputs: [2267 -> (1600, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sub_1587 [Sub]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2266
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2267
[07/07/2022-05:04:22] [V] [TRT] Sub_1587 [Sub] inputs: [2266 -> (1600, 64)[FLOAT]], [2267 -> (1600, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sub_1587 for ONNX node: Sub_1587
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2268 for ONNX tensor: 2268
[07/07/2022-05:04:22] [V] [TRT] Sub_1587 [Sub] outputs: [2268 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Pow_1589 [Pow]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2268
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 551
[07/07/2022-05:04:22] [V] [TRT] Pow_1589 [Pow] inputs: [2268 -> (1600, 64)[FLOAT]], [551 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Pow_1589 for ONNX node: Pow_1589
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2270 for ONNX tensor: 2270
[07/07/2022-05:04:22] [V] [TRT] Pow_1589 [Pow] outputs: [2270 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_1590 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2270
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_1590 [ReduceMean] inputs: [2270 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_1590 for ONNX node: ReduceMean_1590
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2271 for ONNX tensor: 2271
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_1590 [ReduceMean] outputs: [2271 -> (1600, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_1592 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2271
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2541
[07/07/2022-05:04:22] [V] [TRT] Add_1592 [Add] inputs: [2271 -> (1600, 1)[FLOAT]], [2541 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_1592 for ONNX node: Add_1592
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2273 for ONNX tensor: 2273
[07/07/2022-05:04:22] [V] [TRT] Add_1592 [Add] outputs: [2273 -> (1600, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sqrt_1593 [Sqrt]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2273
[07/07/2022-05:04:22] [V] [TRT] Sqrt_1593 [Sqrt] inputs: [2273 -> (1600, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sqrt_1593 for ONNX node: Sqrt_1593
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2274 for ONNX tensor: 2274
[07/07/2022-05:04:22] [V] [TRT] Sqrt_1593 [Sqrt] outputs: [2274 -> (1600, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Div_1594 [Div]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2268
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2274
[07/07/2022-05:04:22] [V] [TRT] Div_1594 [Div] inputs: [2268 -> (1600, 64)[FLOAT]], [2274 -> (1600, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Div_1594 for ONNX node: Div_1594
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2275 for ONNX tensor: 2275
[07/07/2022-05:04:22] [V] [TRT] Div_1594 [Div] outputs: [2275 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Mul_1595 [Mul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2275
[07/07/2022-05:04:22] [V] [TRT] Searching for input: pathNet.decoder.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Mul_1595 [Mul] inputs: [2275 -> (1600, 64)[FLOAT]], [pathNet.decoder.act.0.weight -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Mul_1595 for ONNX node: Mul_1595
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2276 for ONNX tensor: 2276
[07/07/2022-05:04:22] [V] [TRT] Mul_1595 [Mul] outputs: [2276 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_1596 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2276
[07/07/2022-05:04:22] [V] [TRT] Searching for input: pathNet.decoder.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Add_1596 [Add] inputs: [2276 -> (1600, 64)[FLOAT]], [pathNet.decoder.act.0.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_1596 for ONNX node: Add_1596
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2277 for ONNX tensor: 2277
[07/07/2022-05:04:22] [V] [TRT] Add_1596 [Add] outputs: [2277 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_1597 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2277
[07/07/2022-05:04:22] [V] [TRT] Relu_1597 [Relu] inputs: [2277 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_1597 for ONNX node: Relu_1597
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2278 for ONNX tensor: 2278
[07/07/2022-05:04:22] [V] [TRT] Relu_1597 [Relu] outputs: [2278 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Gemm_1598 [Gemm]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2278
[07/07/2022-05:04:22] [V] [TRT] Searching for input: pathNet.decoder.fc2.weight
[07/07/2022-05:04:22] [V] [TRT] Searching for input: pathNet.decoder.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Gemm_1598 [Gemm] inputs: [2278 -> (1600, 64)[FLOAT]], [pathNet.decoder.fc2.weight -> (64, 64)[FLOAT]], [pathNet.decoder.fc2.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: pathNet.decoder.fc2.weight_178 for ONNX node: pathNet.decoder.fc2.weight
[07/07/2022-05:04:22] [E] [TRT] ImporterContext.hpp:187: Constant layer: pathNet.decoder.fc2.weight_178 can be a duplicate of: pathNet.decoder.fc2.weight
[07/07/2022-05:04:22] [V] [TRT] Using opA: 0 opB: 1
[07/07/2022-05:04:22] [V] [TRT] GEMM: A, after squeezing: (1600, 64)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Gemm_1598 for ONNX node: Gemm_1598
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2279 for ONNX tensor: 2279
[07/07/2022-05:04:22] [V] [TRT] Gemm_1598 [Gemm] outputs: [2279 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_1599 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2279
[07/07/2022-05:04:22] [V] [TRT] Relu_1599 [Relu] inputs: [2279 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_1599 for ONNX node: Relu_1599
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2280 for ONNX tensor: 2280
[07/07/2022-05:04:22] [V] [TRT] Relu_1599 [Relu] outputs: [2280 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Gemm_1600 [Gemm]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2280
[07/07/2022-05:04:22] [V] [TRT] Searching for input: pathNet.out.weight
[07/07/2022-05:04:22] [V] [TRT] Searching for input: pathNet.out.bias
[07/07/2022-05:04:22] [V] [TRT] Gemm_1600 [Gemm] inputs: [2280 -> (1600, 64)[FLOAT]], [pathNet.out.weight -> (120, 64)[FLOAT]], [pathNet.out.bias -> (120)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: pathNet.out.weight_179 for ONNX node: pathNet.out.weight
[07/07/2022-05:04:22] [E] [TRT] ImporterContext.hpp:187: Constant layer: pathNet.out.weight_179 can be a duplicate of: pathNet.out.weight
[07/07/2022-05:04:22] [V] [TRT] Using opA: 0 opB: 1
[07/07/2022-05:04:22] [V] [TRT] GEMM: A, after squeezing: (1600, 64)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Gemm_1600 for ONNX node: Gemm_1600
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2281 for ONNX tensor: 2281
[07/07/2022-05:04:22] [V] [TRT] Gemm_1600 [Gemm] outputs: [2281 -> (1600, 120)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1602 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2281
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1599
[07/07/2022-05:04:22] [V] [TRT] Reshape_1602 [Reshape] inputs: [2281 -> (1600, 120)[FLOAT]], [1599 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1602 for ONNX node: Reshape_1602
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2283 for ONNX tensor: 2283
[07/07/2022-05:04:22] [V] [TRT] Reshape_1602 [Reshape] outputs: [2283 -> (1600, 30, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Slice_1607 [Slice]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2283
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2562
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1040
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2622
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2443
[07/07/2022-05:04:22] [V] [TRT] Slice_1607 [Slice] inputs: [2283 -> (1600, 30, 4)[FLOAT]], [2562 -> (1)[INT32]], [1040 -> (1)[INT32]], [2622 -> (1)[INT32]], [2443 -> (1)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Slice_1607 for ONNX node: Slice_1607
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2288 for ONNX tensor: 2288
[07/07/2022-05:04:22] [V] [TRT] Slice_1607 [Slice] outputs: [2288 -> (1600, 30, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: CumSum_1609 [CumSum]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2288
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 1606
[07/07/2022-05:04:22] [V] [TRT] CumSum_1609 [CumSum] inputs: [2288 -> (1600, 30, 4)[FLOAT]], [1606 -> ()[INT32]], 
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_520: broadcasting input1 to make tensors conform, dims(input0)=[32,1,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_385: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_55: broadcasting input1 to make tensors conform, dims(input0)=[32,512,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_52: broadcasting input1 to make tensors conform, dims(input0)=[32,128,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_70: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_72: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_74: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_400: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_100: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_127: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_129: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_131: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_175: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_219: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_221: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_296: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_294: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_369: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_538: broadcasting input1 to make tensors conform, dims(input0)=[32,1,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_383: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_423: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_552: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_439: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_437: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_453: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_476: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_490: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,5][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_1116: broadcasting input1 to make tensors conform, dims(input0)=[32,50,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_1134: broadcasting input1 to make tensors conform, dims(input0)=[32,50,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_1148: broadcasting input1 to make tensors conform, dims(input0)=[32,50,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Original shape: (1600, 1, 4), squeezing to: (1600, 4)
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_520: broadcasting input1 to make tensors conform, dims(input0)=[32,1,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_385: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_55: broadcasting input1 to make tensors conform, dims(input0)=[32,512,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_52: broadcasting input1 to make tensors conform, dims(input0)=[32,128,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_70: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_72: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_74: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_400: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_100: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_127: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_129: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_131: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_175: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_219: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_221: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_296: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_294: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_369: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_538: broadcasting input1 to make tensors conform, dims(input0)=[32,1,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_383: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_423: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_552: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_439: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_437: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_453: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_476: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_490: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,5][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_1116: broadcasting input1 to make tensors conform, dims(input0)=[32,50,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_1134: broadcasting input1 to make tensors conform, dims(input0)=[32,50,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_1148: broadcasting input1 to make tensors conform, dims(input0)=[32,50,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2290 for ONNX tensor: 2290
[07/07/2022-05:04:22] [V] [TRT] CumSum_1609 [CumSum] outputs: [2290 -> (1600, 30, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_1617 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2290
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2297
[07/07/2022-05:04:22] [V] [TRT] Add_1617 [Add] inputs: [2290 -> (1600, 30, 4)[FLOAT]], [2297 -> (1600, 1, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_1617 for ONNX node: Add_1617
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2298 for ONNX tensor: 2298
[07/07/2022-05:04:22] [V] [TRT] Add_1617 [Add] outputs: [2298 -> (1600, 30, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Expand_1624 [Expand]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2298
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2304
[07/07/2022-05:04:22] [V] [TRT] Expand_1624 [Expand] inputs: [2298 -> (1600, 30, 4)[FLOAT]], [2304 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Expand_1624 for ONNX node: Expand_1624
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2305 for ONNX tensor: 2305
[07/07/2022-05:04:22] [V] [TRT] Expand_1624 [Expand] outputs: [2305 -> (1600, 30, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1689 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2305
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2304
[07/07/2022-05:04:22] [V] [TRT] Reshape_1689 [Reshape] inputs: [2305 -> (1600, 30, 4)[FLOAT]], [2304 -> (3)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1689 for ONNX node: Reshape_1689
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2370 for ONNX tensor: 2370
[07/07/2022-05:04:22] [V] [TRT] Reshape_1689 [Reshape] outputs: [2370 -> (1600, 30, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ScatterND_1690 [ScatterND]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2283
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2363
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2370
[07/07/2022-05:04:22] [V] [TRT] ScatterND_1690 [ScatterND] inputs: [2283 -> (1600, 30, 4)[FLOAT]], [2363 -> (1600, 30, 4, 3)[INT32]], [2370 -> (1600, 30, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: 2363 for ONNX node: 2363
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ScatterND_1690 for ONNX node: ScatterND_1690
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2371 for ONNX tensor: 2371
[07/07/2022-05:04:22] [V] [TRT] ScatterND_1690 [ScatterND] outputs: [2371 -> (1600, 30, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1700 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2371
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2384
[07/07/2022-05:04:22] [V] [TRT] Reshape_1700 [Reshape] inputs: [2371 -> (1600, 30, 4)[FLOAT]], [2384 -> (4)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1700 for ONNX node: Reshape_1700
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: pred_traj_candidates_188 for ONNX tensor: pred_traj_candidates
[07/07/2022-05:04:22] [V] [TRT] Reshape_1700 [Reshape] outputs: [pred_traj_candidates -> (32, 50, 30, 4)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Slice_1706 [Slice]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: pred_traj_candidates
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2562
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2622
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2524
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2443
[07/07/2022-05:04:22] [V] [TRT] Slice_1706 [Slice] inputs: [pred_traj_candidates -> (32, 50, 30, 4)[FLOAT]], [2562 -> (1)[INT32]], [2622 -> (1)[INT32]], [2524 -> (1)[INT32]], [2443 -> (1)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Slice_1706 for ONNX node: Slice_1706
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2391 for ONNX tensor: 2391
[07/07/2022-05:04:22] [V] [TRT] Slice_1706 [Slice] outputs: [2391 -> (32, 50, 30, 2)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1714 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2391
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2399
[07/07/2022-05:04:22] [V] [TRT] Reshape_1714 [Reshape] inputs: [2391 -> (32, 50, 30, 2)[FLOAT]], [2399 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1714 for ONNX node: Reshape_1714
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2400 for ONNX tensor: 2400
[07/07/2022-05:04:22] [V] [TRT] Reshape_1714 [Reshape] outputs: [2400 -> (1600, 60)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Concat_1715 [Concat]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2398
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2400
[07/07/2022-05:04:22] [V] [TRT] Concat_1715 [Concat] inputs: [2398 -> (1600, 64)[FLOAT]], [2400 -> (1600, 60)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Concat_1715 for ONNX node: Concat_1715
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2401 for ONNX tensor: 2401
[07/07/2022-05:04:22] [V] [TRT] Concat_1715 [Concat] outputs: [2401 -> (1600, 124)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Gemm_1716 [Gemm]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2401
[07/07/2022-05:04:22] [V] [TRT] Searching for input: scoreNet.mlp.fc1.weight
[07/07/2022-05:04:22] [V] [TRT] Searching for input: scoreNet.mlp.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Gemm_1716 [Gemm] inputs: [2401 -> (1600, 124)[FLOAT]], [scoreNet.mlp.fc1.weight -> (64, 124)[FLOAT]], [scoreNet.mlp.fc1.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: scoreNet.mlp.fc1.weight for ONNX node: scoreNet.mlp.fc1.weight
[07/07/2022-05:04:22] [V] [TRT] Using opA: 0 opB: 1
[07/07/2022-05:04:22] [V] [TRT] GEMM: A, after squeezing: (1600, 124)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Gemm_1716 for ONNX node: Gemm_1716
[07/07/2022-05:04:22] [V] [TRT] Registering layer: scoreNet.mlp.fc1.bias for ONNX node: scoreNet.mlp.fc1.bias
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2402 for ONNX tensor: 2402
[07/07/2022-05:04:22] [V] [TRT] Gemm_1716 [Gemm] outputs: [2402 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_1717 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2402
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_1717 [ReduceMean] inputs: [2402 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_1717 for ONNX node: ReduceMean_1717
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2403 for ONNX tensor: 2403
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_1717 [ReduceMean] outputs: [2403 -> (1600, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sub_1718 [Sub]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2402
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2403
[07/07/2022-05:04:22] [V] [TRT] Sub_1718 [Sub] inputs: [2402 -> (1600, 64)[FLOAT]], [2403 -> (1600, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sub_1718 for ONNX node: Sub_1718
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2404 for ONNX tensor: 2404
[07/07/2022-05:04:22] [V] [TRT] Sub_1718 [Sub] outputs: [2404 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Pow_1720 [Pow]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2404
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 551
[07/07/2022-05:04:22] [V] [TRT] Pow_1720 [Pow] inputs: [2404 -> (1600, 64)[FLOAT]], [551 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Pow_1720 for ONNX node: Pow_1720
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2406 for ONNX tensor: 2406
[07/07/2022-05:04:22] [V] [TRT] Pow_1720 [Pow] outputs: [2406 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: ReduceMean_1721 [ReduceMean]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2406
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_1721 [ReduceMean] inputs: [2406 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: ReduceMean_1721 for ONNX node: ReduceMean_1721
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2407 for ONNX tensor: 2407
[07/07/2022-05:04:22] [V] [TRT] ReduceMean_1721 [ReduceMean] outputs: [2407 -> (1600, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_1723 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2407
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2541
[07/07/2022-05:04:22] [V] [TRT] Add_1723 [Add] inputs: [2407 -> (1600, 1)[FLOAT]], [2541 -> ()[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_1723 for ONNX node: Add_1723
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2409 for ONNX tensor: 2409
[07/07/2022-05:04:22] [V] [TRT] Add_1723 [Add] outputs: [2409 -> (1600, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Sqrt_1724 [Sqrt]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2409
[07/07/2022-05:04:22] [V] [TRT] Sqrt_1724 [Sqrt] inputs: [2409 -> (1600, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Sqrt_1724 for ONNX node: Sqrt_1724
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2410 for ONNX tensor: 2410
[07/07/2022-05:04:22] [V] [TRT] Sqrt_1724 [Sqrt] outputs: [2410 -> (1600, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Div_1725 [Div]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2404
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2410
[07/07/2022-05:04:22] [V] [TRT] Div_1725 [Div] inputs: [2404 -> (1600, 64)[FLOAT]], [2410 -> (1600, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Div_1725 for ONNX node: Div_1725
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2411 for ONNX tensor: 2411
[07/07/2022-05:04:22] [V] [TRT] Div_1725 [Div] outputs: [2411 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Mul_1726 [Mul]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2411
[07/07/2022-05:04:22] [V] [TRT] Searching for input: scoreNet.mlp.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Mul_1726 [Mul] inputs: [2411 -> (1600, 64)[FLOAT]], [scoreNet.mlp.act.0.weight -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: scoreNet.mlp.act.0.weight for ONNX node: scoreNet.mlp.act.0.weight
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Mul_1726 for ONNX node: Mul_1726
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2412 for ONNX tensor: 2412
[07/07/2022-05:04:22] [V] [TRT] Mul_1726 [Mul] outputs: [2412 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Add_1727 [Add]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2412
[07/07/2022-05:04:22] [V] [TRT] Searching for input: scoreNet.mlp.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Add_1727 [Add] inputs: [2412 -> (1600, 64)[FLOAT]], [scoreNet.mlp.act.0.bias -> (64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: scoreNet.mlp.act.0.bias for ONNX node: scoreNet.mlp.act.0.bias
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Add_1727 for ONNX node: Add_1727
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2413 for ONNX tensor: 2413
[07/07/2022-05:04:22] [V] [TRT] Add_1727 [Add] outputs: [2413 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Relu_1728 [Relu]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2413
[07/07/2022-05:04:22] [V] [TRT] Relu_1728 [Relu] inputs: [2413 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Relu_1728 for ONNX node: Relu_1728
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2414 for ONNX tensor: 2414
[07/07/2022-05:04:22] [V] [TRT] Relu_1728 [Relu] outputs: [2414 -> (1600, 64)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Gemm_1729 [Gemm]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2414
[07/07/2022-05:04:22] [V] [TRT] Searching for input: scoreNet.mlp.fc2.weight
[07/07/2022-05:04:22] [V] [TRT] Searching for input: scoreNet.mlp.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Gemm_1729 [Gemm] inputs: [2414 -> (1600, 64)[FLOAT]], [scoreNet.mlp.fc2.weight -> (1, 64)[FLOAT]], [scoreNet.mlp.fc2.bias -> (1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: scoreNet.mlp.fc2.weight for ONNX node: scoreNet.mlp.fc2.weight
[07/07/2022-05:04:22] [V] [TRT] Using opA: 0 opB: 1
[07/07/2022-05:04:22] [V] [TRT] GEMM: A, after squeezing: (1600, 64)
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Gemm_1729 for ONNX node: Gemm_1729
[07/07/2022-05:04:22] [V] [TRT] Registering layer: scoreNet.mlp.fc2.bias for ONNX node: scoreNet.mlp.fc2.bias
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: 2415 for ONNX tensor: 2415
[07/07/2022-05:04:22] [V] [TRT] Gemm_1729 [Gemm] outputs: [2415 -> (1600, 1)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Parsing node: Reshape_1731 [Reshape]
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2415
[07/07/2022-05:04:22] [V] [TRT] Searching for input: 2416
[07/07/2022-05:04:22] [V] [TRT] Reshape_1731 [Reshape] inputs: [2415 -> (1600, 1)[FLOAT]], [2416 -> (2)[INT32]], 
[07/07/2022-05:04:22] [V] [TRT] Registering layer: Reshape_1731 for ONNX node: Reshape_1731
[07/07/2022-05:04:22] [V] [TRT] Registering tensor: score_candidates_189 for ONNX tensor: score_candidates
[07/07/2022-05:04:22] [V] [TRT] Reshape_1731 [Reshape] outputs: [score_candidates -> (32, 50)[FLOAT]], 
[07/07/2022-05:04:22] [V] [TRT] Marking pred_traj_tf_173 as output: pred_traj_tf
[07/07/2022-05:04:22] [V] [TRT] Marking mode_prob_175 as output: mode_prob
[07/07/2022-05:04:22] [V] [TRT] Marking pred_disp_176 as output: pred_disp
[07/07/2022-05:04:22] [V] [TRT] Marking pred_traj_candidates_188 as output: pred_traj_candidates
[07/07/2022-05:04:22] [V] [TRT] Marking score_candidates_189 as output: score_candidates
[07/07/2022-05:04:22] [I] Finish parsing network model
[07/07/2022-05:04:22] [I] [TRT] MatMul_367: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_520: broadcasting input1 to make tensors conform, dims(input0)=[32,1,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_385: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_55: broadcasting input1 to make tensors conform, dims(input0)=[32,512,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_52: broadcasting input1 to make tensors conform, dims(input0)=[32,128,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_70: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_72: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_74: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_400: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_100: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_127: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_129: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_131: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_175: broadcasting input1 to make tensors conform, dims(input0)=[640,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_219: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_221: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_296: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_294: broadcasting input1 to make tensors conform, dims(input0)=[512,32,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_369: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_538: broadcasting input1 to make tensors conform, dims(input0)=[32,1,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_383: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_423: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_552: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_439: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_437: broadcasting input1 to make tensors conform, dims(input0)=[32,1,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_453: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_476: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_490: broadcasting input1 to make tensors conform, dims(input0)=[32,4000,64][NONE] dims(input1)=[1,64,5][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_1116: broadcasting input1 to make tensors conform, dims(input0)=[32,50,4][NONE] dims(input1)=[1,4,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_1134: broadcasting input1 to make tensors conform, dims(input0)=[32,50,128][NONE] dims(input1)=[1,128,64][NONE].
[07/07/2022-05:04:22] [I] [TRT] MatMul_1148: broadcasting input1 to make tensors conform, dims(input0)=[32,50,64][NONE] dims(input1)=[1,64,64][NONE].
[07/07/2022-05:04:22] [V] [TRT] Applying generic optimizations to the graph for inference.
[07/07/2022-05:04:22] [V] [TRT] Original: 1143 layers
[07/07/2022-05:04:22] [V] [TRT] After dead-layer removal: 1143 layers
[07/07/2022-05:04:22] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:22] [V] [TRT] ConstShuffleFusion: Fusing 2441 with (Unnamed Layer* 40) [Shuffle]
[07/07/2022-05:04:22] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:22] [V] [TRT] ConstShuffleFusion: Fusing 2493 with (Unnamed Layer* 97) [Shuffle]
[07/07/2022-05:04:22] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:22] [V] [TRT] ConstShuffleFusion: Fusing 2589 with (Unnamed Layer* 143) [Shuffle]
[07/07/2022-05:04:22] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:22] [V] [TRT] ConstShuffleFusion: Fusing cg0.fc1.fc1.bias with (Unnamed Layer* 218) [Shuffle]
[07/07/2022-05:04:22] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:22] [V] [TRT] ConstShuffleFusion: Fusing 2463 with (Unnamed Layer* 301) [Shuffle]
[07/07/2022-05:04:22] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:22] [V] [TRT] ConstShuffleFusion: Fusing 2515 with (Unnamed Layer* 357) [Shuffle]
[07/07/2022-05:04:22] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:22] [V] [TRT] ConstShuffleFusion: Fusing 2523 with (Unnamed Layer* 548) [Shuffle]
[07/07/2022-05:04:22] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:22] [V] [TRT] ConstShuffleFusion: Fusing 2522 with (Unnamed Layer* 554) [Shuffle]
[07/07/2022-05:04:22] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:22] [V] [TRT] ConstShuffleFusion: Fusing fc0_lane.0.bias with (Unnamed Layer* 557) [Shuffle]
[07/07/2022-05:04:22] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:22] [V] [TRT] ConstShuffleFusion: Fusing fc0_agent.0.bias with (Unnamed Layer* 565) [Shuffle]
[07/07/2022-05:04:22] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:22] [V] [TRT] ConstShuffleFusion: Fusing cg0.fc1.act.0.weight with (Unnamed Layer* 573) [Shuffle]
[07/07/2022-05:04:22] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:22] [V] [TRT] ConstShuffleFusion: Fusing cg0.fc1.act.0.bias with (Unnamed Layer* 577) [Shuffle]
[07/07/2022-05:04:22] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:22] [V] [TRT] ConstShuffleFusion: Fusing 2525 with (Unnamed Layer* 580) [Shuffle]
[07/07/2022-05:04:22] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:22] [V] [TRT] ConstShuffleFusion: Fusing 2526 with (Unnamed Layer* 583) [Shuffle]
[07/07/2022-05:04:22] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:22] [V] [TRT] ConstShuffleFusion: Fusing 2527 with (Unnamed Layer* 586) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing interaction.attn_layers.0.q_proj.bias with (Unnamed Layer* 590) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing interaction.attn_layers.0.k_proj.bias with (Unnamed Layer* 593) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing interaction.attn_layers.0.v_proj.bias with (Unnamed Layer* 596) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2590 with (Unnamed Layer* 599) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cg0.fc1.fc2.bias with (Unnamed Layer* 605) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing (Unnamed Layer* 616) [Constant] with (Unnamed Layer* 618) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2546 with (Unnamed Layer* 626) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing interaction.attn_layers.0.out_proj.bias with (Unnamed Layer* 629) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing interaction.attn_layers.0.layer_norm.weight with (Unnamed Layer* 642) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing interaction.attn_layers.0.layer_norm.bias with (Unnamed Layer* 645) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2547 with (Unnamed Layer* 648) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2548 with (Unnamed Layer* 651) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2549 with (Unnamed Layer* 654) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing interaction.attn_layers.1.q_proj.bias with (Unnamed Layer* 657) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing interaction.attn_layers.1.k_proj.bias with (Unnamed Layer* 660) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing interaction.attn_layers.1.v_proj.bias with (Unnamed Layer* 663) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing (Unnamed Layer* 677) [Constant] with (Unnamed Layer* 679) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2556 with (Unnamed Layer* 687) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing interaction.attn_layers.1.out_proj.bias with (Unnamed Layer* 690) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing interaction.attn_layers.1.layer_norm.weight with (Unnamed Layer* 703) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing interaction.attn_layers.1.layer_norm.bias with (Unnamed Layer* 706) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2566 with (Unnamed Layer* 715) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2567 with (Unnamed Layer* 718) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2568 with (Unnamed Layer* 721) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cross_attention.attn_layers.0.q_proj.bias with (Unnamed Layer* 724) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cross_attention.attn_layers.0.k_proj.bias with (Unnamed Layer* 727) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cross_attention.attn_layers.0.v_proj.bias with (Unnamed Layer* 730) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2578 with (Unnamed Layer* 736) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2577 with (Unnamed Layer* 742) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cross_attention.attn_layers.1.v_proj.bias with (Unnamed Layer* 745) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cross_attention.attn_layers.1.k_proj.bias with (Unnamed Layer* 750) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing (Unnamed Layer* 761) [Constant] with (Unnamed Layer* 763) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2575 with (Unnamed Layer* 771) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cross_attention.attn_layers.0.out_proj.bias with (Unnamed Layer* 774) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cross_attention.attn_layers.0.layer_norm.weight with (Unnamed Layer* 787) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cross_attention.attn_layers.0.layer_norm.bias with (Unnamed Layer* 790) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2576 with (Unnamed Layer* 793) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cross_attention.attn_layers.1.q_proj.bias with (Unnamed Layer* 796) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing (Unnamed Layer* 805) [Constant] with (Unnamed Layer* 807) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2585 with (Unnamed Layer* 815) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cross_attention.attn_layers.1.out_proj.bias with (Unnamed Layer* 818) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cross_attention.attn_layers.1.layer_norm.weight with (Unnamed Layer* 831) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cross_attention.attn_layers.1.layer_norm.bias with (Unnamed Layer* 834) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing norm0_cross.weight with (Unnamed Layer* 848) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing norm0_cross.bias with (Unnamed Layer* 851) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2587 with (Unnamed Layer* 854) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cg0.fc0.fc1.bias with (Unnamed Layer* 860) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cg0.fc0.act.0.weight with (Unnamed Layer* 889) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cg0.fc0.act.0.bias with (Unnamed Layer* 893) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2588 with (Unnamed Layer* 901) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cg0.fc0.fc2.bias with (Unnamed Layer* 907) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2592 with (Unnamed Layer* 912) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cg1.fc0.fc1.bias with (Unnamed Layer* 919) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cg1.fc0.act.0.weight with (Unnamed Layer* 956) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cg0.norm.weight with (Unnamed Layer* 961) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cg1.fc0.act.0.bias with (Unnamed Layer* 964) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cg0.norm.bias with (Unnamed Layer* 968) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2593 with (Unnamed Layer* 973) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2594 with (Unnamed Layer* 976) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cg1.fc0.fc2.bias with (Unnamed Layer* 982) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cg1.fc1.fc1.bias with (Unnamed Layer* 985) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cg1.fc1.act.0.weight with (Unnamed Layer* 1037) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cg1.fc1.act.0.bias with (Unnamed Layer* 1041) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2595 with (Unnamed Layer* 1047) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cg1.fc1.fc2.bias with (Unnamed Layer* 1052) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cg1.norm.weight with (Unnamed Layer* 1068) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing cg1.norm.bias with (Unnamed Layer* 1071) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2597 with (Unnamed Layer* 1074) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing targetNet.mlp.fc1.bias with (Unnamed Layer* 1077) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing targetNet.mlp.act.0.weight with (Unnamed Layer* 1089) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing targetNet.mlp.act.0.bias with (Unnamed Layer* 1092) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 2598 with (Unnamed Layer* 1096) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing targetNet.mlp.fc2.bias with (Unnamed Layer* 1099) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing 1030 with (Unnamed Layer* 1109) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_0 with Transpose_1
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_26 with Transpose_27
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_81 with Transpose_82
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_78 with Transpose_79
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_80 with Transpose_83
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_98 with Reshape_99
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_153 with Transpose_154
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_140 with Transpose_141
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_147 with Transpose_155
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_170 with Reshape_174
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_243 with Transpose_244
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_237 with Transpose_245
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_230 with Transpose_231
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_318 with Transpose_319
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_312 with Transpose_320
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_260 with Reshape_264
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_305 with Transpose_306
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_335 with Reshape_339
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleErasure
[07/07/2022-05:04:23] [V] [TRT] Removing Reshape_1093
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1104 with Squeeze_1105
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleErasure
[07/07/2022-05:04:23] [V] [TRT] Removing Reshape_1104 + Squeeze_1105
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleErasure
[07/07/2022-05:04:23] [V] [TRT] Removing Reshape_493
[07/07/2022-05:04:23] [V] [TRT] Running: ShuffleErasure
[07/07/2022-05:04:23] [V] [TRT] Removing Reshape_1689
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing scoreNet.mlp.fc1.bias with (Unnamed Layer* 1209) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing scoreNet.mlp.act.0.weight with (Unnamed Layer* 1221) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing scoreNet.mlp.act.0.bias with (Unnamed Layer* 1224) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] Running: ConstShuffleFusion
[07/07/2022-05:04:23] [V] [TRT] ConstShuffleFusion: Fusing scoreNet.mlp.fc2.bias with (Unnamed Layer* 1230) [Shuffle]
[07/07/2022-05:04:23] [V] [TRT] DLA Memory Consumption Summary:
[07/07/2022-05:04:23] [V] [TRT] 	Number of DLA node candidates offloaded : 0 out of 1
[07/07/2022-05:04:23] [V] [TRT] 	Total memory required by accepted candidates : Managed SRAM = 0 MiB,	Local DRAM = 0 MiB,	Global DRAM = 0 MiB
[07/07/2022-05:04:23] [V] [TRT] After Myelin optimization: 1 layers
[07/07/2022-05:04:23] [V] [TRT] Applying ScaleNodes fusions.
[07/07/2022-05:04:23] [V] [TRT] After scale fusion: 1 layers
[07/07/2022-05:04:23] [V] [TRT] After vertical fusions: 1 layers
[07/07/2022-05:04:23] [V] [TRT] After dupe layer removal: 1 layers
[07/07/2022-05:04:23] [V] [TRT] After final dead-layer removal: 1 layers
[07/07/2022-05:04:23] [V] [TRT] After tensor merging: 1 layers
[07/07/2022-05:04:23] [V] [TRT] After slice removal: 1 layers
[07/07/2022-05:04:23] [V] [TRT] After concat removal: 1 layers
[07/07/2022-05:04:23] [V] [TRT] Graph construction and optimization completed in 0.356477 seconds.
[07/07/2022-05:04:23] [I] [TRT] ---------- Layers Running on DLA ----------
[07/07/2022-05:04:23] [I] [TRT] ---------- Layers Running on GPU ----------
[07/07/2022-05:04:23] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[526...Reshape_1731]}
[07/07/2022-05:04:24] [V] [TRT] Using cublasLt as a tactic source
[07/07/2022-05:04:24] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +534, GPU +494, now: CPU 1199, GPU 5376 (MiB)
[07/07/2022-05:04:24] [V] [TRT] Using cuDNN as a tactic source
[07/07/2022-05:04:24] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +85, GPU +88, now: CPU 1284, GPU 5464 (MiB)
[07/07/2022-05:04:24] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored.
[07/07/2022-05:04:24] [V] [TRT] Constructing optimization profile number 0 [1/1].
[07/07/2022-05:04:24] [V] [TRT] Reserving memory for activation tensors. Host: 0 bytes Device: 17486720 bytes
[07/07/2022-05:04:24] [V] [TRT] =============== Computing reformatting costs
[07/07/2022-05:04:24] [V] [TRT] =============== Computing reformatting costs
[07/07/2022-05:04:24] [V] [TRT] =============== Computing reformatting costs
[07/07/2022-05:04:24] [V] [TRT] =============== Computing reformatting costs
[07/07/2022-05:04:24] [V] [TRT] =============== Computing reformatting costs
[07/07/2022-05:04:24] [V] [TRT] =============== Computing reformatting costs
[07/07/2022-05:04:24] [V] [TRT] =============== Computing reformatting costs
[07/07/2022-05:04:24] [V] [TRT] =============== Computing reformatting costs
[07/07/2022-05:04:24] [V] [TRT] =============== Computing reformatting costs
[07/07/2022-05:04:24] [V] [TRT] =============== Computing reformatting costs
[07/07/2022-05:04:24] [V] [TRT] =============== Computing reformatting costs
[07/07/2022-05:04:24] [V] [TRT] =============== Computing reformatting costs
[07/07/2022-05:04:24] [V] [TRT] =============== Computing reformatting costs
[07/07/2022-05:04:24] [V] [TRT] =============== Computing costs for 
[07/07/2022-05:04:24] [V] [TRT] *************** Autotuning format combination: Float(512,1), Float(128,1), Float(150,5,1), Float(71680,140,7,1), Float(17920,140,14,1), Float(55,5,1), Float(4000,1), Float(16000,4,1) -> Float(120,4,1), Float(16000,4,1), Float(4000,1), Float(6000,120,4,1), Float(50,1) ***************
[07/07/2022-05:04:24] [V] [TRT] --------------- Timing Runner: {ForeignNode[526...Reshape_1731]} (Myelin)
[07/07/2022-05:04:44] [V] [TRT] Tactic: 0 Time: 38.4946
[07/07/2022-05:04:45] [V] [TRT] Fastest Tactic: 0 Time: 38.4946
[07/07/2022-05:04:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0
[07/07/2022-05:04:45] [V] [TRT] Formats and tactics selection completed in 20.7672 seconds.
[07/07/2022-05:04:45] [V] [TRT] After reformat layers: 1 layers
[07/07/2022-05:04:45] [V] [TRT] Pre-optimized block assignment.
[07/07/2022-05:04:45] [V] [TRT] Block size 30308749312
[07/07/2022-05:04:45] [V] [TRT] Total Activation Memory: 30308749312
[07/07/2022-05:04:45] [I] [TRT] Detected 8 inputs and 5 output network tensors.
[07/07/2022-05:04:46] [V] [TRT] Layer: {ForeignNode[526...Reshape_1731]} Host Persistent: 24 Device Persistent: 0 Scratch Memory: 815314432
[07/07/2022-05:04:46] [I] [TRT] Total Host Persistent Memory: 32
[07/07/2022-05:04:46] [I] [TRT] Total Device Persistent Memory: 0
[07/07/2022-05:04:46] [I] [TRT] Total Scratch Memory: 815314432
[07/07/2022-05:04:46] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 5 MiB, GPU 826 MiB
[07/07/2022-05:04:46] [I] [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 0.004256ms to assign 1 blocks to 1 nodes requiring 815314432 bytes.
[07/07/2022-05:04:46] [V] [TRT] Optimized block assignment.
[07/07/2022-05:04:46] [V] [TRT] Block size 815314432
[07/07/2022-05:04:46] [I] [TRT] Total Activation Memory: 815314432
[07/07/2022-05:04:46] [V] [TRT] Disabling unused tactic source: CUDNN
[07/07/2022-05:04:46] [V] [TRT] Disabling unused tactic source: CUBLAS, CUBLASLT
[07/07/2022-05:04:46] [V] [TRT] Engine generation completed in 22.762 seconds.
[07/07/2022-05:04:46] [V] [TRT] Engine Layer Information:
Layer(Myelin): {ForeignNode[526...Reshape_1731]}, Tactic: 0, mask_lane[Float(32,512)], mask_agent[Float(32,128)], hist_traj_gt[Float(32,30,5)], x_lane[Float(32,512,20,7)], x_agent[Float(32,128,10,14)], hist_traj[Float(32,11,5)], mask_target[Float(32,4000)], target[Float(32,4000,4)] -> pred_traj_tf[Float(32,30,4)], pred_disp[Float(32,4000,4)], mode_prob[Float(32,4000)], pred_traj_candidates[Float(32,50,30,4)], score_candidates[Float(32,50)]
[07/07/2022-05:04:46] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +0, GPU +16, now: CPU 0, GPU 16 (MiB)
[07/07/2022-05:04:46] [I] Engine built in 25.7359 sec.
[07/07/2022-05:04:46] [I] [TRT] [MemUsageChange] Init CUDA: CPU +0, GPU +0, now: CPU 968, GPU 5561 (MiB)
[07/07/2022-05:04:46] [I] [TRT] Loaded engine size: 11 MiB
[07/07/2022-05:04:46] [V] [TRT] Deserialization required 2342 microseconds.
[07/07/2022-05:04:46] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +8, now: CPU 0, GPU 8 (MiB)
[07/07/2022-05:04:46] [I] Engine deserialized in 0.00616042 sec.
[07/07/2022-05:04:46] [V] [TRT] Total per-runner device persistent memory is 0
[07/07/2022-05:04:46] [V] [TRT] Total per-runner host persistent memory is 32
[07/07/2022-05:04:46] [V] [TRT] Allocated activation device memory of size 815314432
[07/07/2022-05:04:46] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +777, now: CPU 0, GPU 785 (MiB)
[07/07/2022-05:04:46] [I] Using random values for input x_lane
[07/07/2022-05:04:46] [I] Created input binding for x_lane with dimensions 32x512x20x7
[07/07/2022-05:04:46] [I] Using random values for input mask_lane
[07/07/2022-05:04:46] [I] Created input binding for mask_lane with dimensions 32x512
[07/07/2022-05:04:46] [I] Using random values for input x_agent
[07/07/2022-05:04:46] [I] Created input binding for x_agent with dimensions 32x128x10x14
[07/07/2022-05:04:46] [I] Using random values for input mask_agent
[07/07/2022-05:04:46] [I] Created input binding for mask_agent with dimensions 32x128
[07/07/2022-05:04:46] [I] Using random values for input target
[07/07/2022-05:04:46] [I] Created input binding for target with dimensions 32x4000x4
[07/07/2022-05:04:46] [I] Using random values for input mask_target
[07/07/2022-05:04:46] [I] Created input binding for mask_target with dimensions 32x4000
[07/07/2022-05:04:46] [I] Using random values for input hist_traj
[07/07/2022-05:04:46] [I] Created input binding for hist_traj with dimensions 32x11x5
[07/07/2022-05:04:46] [I] Using random values for input hist_traj_gt
[07/07/2022-05:04:46] [I] Created input binding for hist_traj_gt with dimensions 32x30x5
[07/07/2022-05:04:46] [I] Using random values for output pred_traj_tf
[07/07/2022-05:04:46] [I] Created output binding for pred_traj_tf with dimensions 32x30x4
[07/07/2022-05:04:46] [I] Using random values for output mode_prob
[07/07/2022-05:04:46] [I] Created output binding for mode_prob with dimensions 32x4000
[07/07/2022-05:04:46] [I] Using random values for output pred_disp
[07/07/2022-05:04:46] [I] Created output binding for pred_disp with dimensions 32x4000x4
[07/07/2022-05:04:46] [I] Using random values for output pred_traj_candidates
[07/07/2022-05:04:46] [I] Created output binding for pred_traj_candidates with dimensions 32x50x30x4
[07/07/2022-05:04:46] [I] Using random values for output score_candidates
[07/07/2022-05:04:46] [I] Created output binding for score_candidates with dimensions 32x50
[07/07/2022-05:04:46] [I] Starting inference
[07/07/2022-05:04:50] [W] The network timing report will not be accurate due to extra synchronizations when profiler is enabled.
[07/07/2022-05:04:50] [W] Add --separateProfileRun to profile layer timing in a separate run.
[07/07/2022-05:04:50] [I] Warmup completed 6 queries over 200 ms
[07/07/2022-05:04:50] [I] Timing trace has 78 queries over 3.07473 s
[07/07/2022-05:04:50] [I] 
[07/07/2022-05:04:50] [I] === Trace details ===
[07/07/2022-05:04:50] [I] Trace averages of 10 runs:
[07/07/2022-05:04:50] [I] Average on 10 runs - GPU latency: 38.7346 ms - Host latency: 39.4992 ms (enqueue 39.3388 ms)
[07/07/2022-05:04:50] [I] Average on 10 runs - GPU latency: 38.7443 ms - Host latency: 39.5052 ms (enqueue 39.349 ms)
[07/07/2022-05:04:50] [I] Average on 10 runs - GPU latency: 38.7239 ms - Host latency: 39.4936 ms (enqueue 39.3363 ms)
[07/07/2022-05:04:50] [I] Average on 10 runs - GPU latency: 38.7594 ms - Host latency: 39.5374 ms (enqueue 39.3772 ms)
[07/07/2022-05:04:50] [I] Average on 10 runs - GPU latency: 38.7024 ms - Host latency: 39.4782 ms (enqueue 39.3186 ms)
[07/07/2022-05:04:50] [I] Average on 10 runs - GPU latency: 38.735 ms - Host latency: 39.51 ms (enqueue 39.3508 ms)
[07/07/2022-05:04:50] [I] Average on 10 runs - GPU latency: 38.7734 ms - Host latency: 39.5506 ms (enqueue 39.3904 ms)
[07/07/2022-05:04:50] [I] 
[07/07/2022-05:04:50] [I] === Performance summary ===
[07/07/2022-05:04:50] [I] Throughput: 25.3681 qps
[07/07/2022-05:04:50] [I] Latency: min = 39.4109 ms, max = 39.6045 ms, mean = 39.5123 ms, median = 39.5186 ms, percentile(99%) = 39.6045 ms
[07/07/2022-05:04:50] [I] Enqueue Time: min = 39.2493 ms, max = 39.4441 ms, mean = 39.3535 ms, median = 39.3601 ms, percentile(99%) = 39.4441 ms
[07/07/2022-05:04:50] [I] H2D Latency: min = 0.624786 ms, max = 0.647949 ms, mean = 0.640198 ms, median = 0.641907 ms, percentile(99%) = 0.647949 ms
[07/07/2022-05:04:50] [I] GPU Compute Time: min = 38.632 ms, max = 38.8267 ms, mean = 38.7403 ms, median = 38.7426 ms, percentile(99%) = 38.8267 ms
[07/07/2022-05:04:50] [I] D2H Latency: min = 0.112305 ms, max = 0.142822 ms, mean = 0.13173 ms, median = 0.132263 ms, percentile(99%) = 0.142822 ms
[07/07/2022-05:04:50] [I] Total Host Walltime: 3.07473 s
[07/07/2022-05:04:50] [I] Total GPU Compute Time: 3.02175 s
[07/07/2022-05:04:50] [W] * Throughput may be bound by Enqueue Time rather than GPU Compute and the GPU may be under-utilized.
[07/07/2022-05:04:50] [W]   If not already in use, --useCudaGraph (utilize CUDA graphs where possible) may increase the throughput.
[07/07/2022-05:04:50] [I] Explanations of the performance metrics are printed in the verbose logs.
[07/07/2022-05:04:50] [V] 
[07/07/2022-05:04:50] [V] === Explanations of the performance metrics ===
[07/07/2022-05:04:50] [V] Total Host Walltime: the host walltime from when the first query (after warmups) is enqueued to when the last query is completed.
[07/07/2022-05:04:50] [V] GPU Compute Time: the GPU latency to execute the kernels for a query.
[07/07/2022-05:04:50] [V] Total GPU Compute Time: the summation of the GPU Compute Time of all the queries. If this is significantly shorter than Total Host Walltime, the GPU may be under-utilized because of host-side overheads or data transfers.
[07/07/2022-05:04:50] [V] Throughput: the observed throughput computed by dividing the number of queries by the Total Host Walltime. If this is significantly lower than the reciprocal of GPU Compute Time, the GPU may be under-utilized because of host-side overheads or data transfers.
[07/07/2022-05:04:50] [V] Enqueue Time: the host latency to enqueue a query. If this is longer than GPU Compute Time, the GPU may be under-utilized.
[07/07/2022-05:04:50] [V] H2D Latency: the latency for host-to-device data transfers for input tensors of a single query.
[07/07/2022-05:04:50] [V] D2H Latency: the latency for device-to-host data transfers for output tensors of a single query.
[07/07/2022-05:04:50] [V] Latency: the summation of H2D Latency, GPU Compute Time, and D2H Latency. This is the latency to infer a single query.
[07/07/2022-05:04:50] [I] 
[07/07/2022-05:04:50] [I] 
[07/07/2022-05:04:50] [I] === Profile (84 iterations ) ===
[07/07/2022-05:04:50] [I]                              Layer   Time (ms)   Avg. Time (ms)   Time %
[07/07/2022-05:04:50] [I]  {ForeignNode[526...Reshape_1731]}     3253.18          38.7284    100.0
[07/07/2022-05:04:50] [I]                              Total     3253.18          38.7284    100.0
[07/07/2022-05:04:50] [I] 
&&&& PASSED TensorRT.trtexec [TensorRT v8410] # trtexec --onnx=./test_sim_modify.onnx --dumpProfile --profilingVerbosity=detailed --verbose