&&&& RUNNING TensorRT.trtexec [TensorRT v8000] # trtexec --onnx=/home/htut/Desktop/AltoAI/detection/darknet/yolov4_2_3_416_416_static.onnx --maxBatch=2 --fp16 --saveEngine=yolov4tinychula2-416.trt --verbose [07/07/2021-20:00:59] [I] === Model Options === [07/07/2021-20:00:59] [I] Format: ONNX [07/07/2021-20:00:59] [I] Model: /home/htut/Desktop/AltoAI/detection/darknet/yolov4_2_3_416_416_static.onnx [07/07/2021-20:00:59] [I] Output: [07/07/2021-20:00:59] [I] === Build Options === [07/07/2021-20:00:59] [I] Max batch: explicit [07/07/2021-20:00:59] [I] Workspace: 16 MiB [07/07/2021-20:00:59] [I] minTiming: 1 [07/07/2021-20:00:59] [I] avgTiming: 8 [07/07/2021-20:00:59] [I] Precision: FP32+FP16 [07/07/2021-20:00:59] [I] Calibration: [07/07/2021-20:00:59] [I] Refit: Disabled [07/07/2021-20:00:59] [I] Sparsity: Disabled [07/07/2021-20:00:59] [I] Safe mode: Disabled [07/07/2021-20:00:59] [I] Enable serialization: Disabled [07/07/2021-20:00:59] [I] Save engine: yolov4tinychula2-416.trt [07/07/2021-20:00:59] [I] Load engine: [07/07/2021-20:00:59] [I] NVTX verbosity: 0 [07/07/2021-20:00:59] [I] Tactic sources: Using default tactic sources [07/07/2021-20:00:59] [I] timingCacheMode: local [07/07/2021-20:00:59] [I] timingCacheFile: [07/07/2021-20:00:59] [I] Input(s)s format: fp32:CHW [07/07/2021-20:00:59] [I] Output(s)s format: fp32:CHW [07/07/2021-20:00:59] [I] Input build shapes: model [07/07/2021-20:00:59] [I] Input calibration shapes: model [07/07/2021-20:00:59] [I] === System Options === [07/07/2021-20:00:59] [I] Device: 0 [07/07/2021-20:00:59] [I] DLACore: [07/07/2021-20:00:59] [I] Plugins: [07/07/2021-20:00:59] [I] === Inference Options === [07/07/2021-20:00:59] [I] Batch: Explicit [07/07/2021-20:00:59] [I] Input inference shapes: model [07/07/2021-20:00:59] [I] Iterations: 10 [07/07/2021-20:00:59] [I] Duration: 3s (+ 200ms warm up) [07/07/2021-20:00:59] [I] Sleep time: 0ms [07/07/2021-20:00:59] [I] Streams: 1 [07/07/2021-20:00:59] [I] ExposeDMA: Disabled [07/07/2021-20:00:59] [I] Data transfers: Enabled [07/07/2021-20:00:59] [I] Spin-wait: Disabled [07/07/2021-20:00:59] [I] Multithreading: Disabled [07/07/2021-20:00:59] [I] CUDA Graph: Disabled [07/07/2021-20:00:59] [I] Separate profiling: Disabled [07/07/2021-20:00:59] [I] Time Deserialize: Disabled [07/07/2021-20:00:59] [I] Time Refit: Disabled [07/07/2021-20:00:59] [I] Skip inference: Disabled [07/07/2021-20:00:59] [I] Inputs: [07/07/2021-20:00:59] [I] === Reporting Options === [07/07/2021-20:00:59] [I] Verbose: Enabled [07/07/2021-20:00:59] [I] Averages: 10 inferences [07/07/2021-20:00:59] [I] Percentile: 99 [07/07/2021-20:00:59] [I] Dump refittable layers:Disabled [07/07/2021-20:00:59] [I] Dump output: Disabled [07/07/2021-20:00:59] [I] Profile: Disabled [07/07/2021-20:00:59] [I] Export timing to JSON file: [07/07/2021-20:00:59] [I] Export output to JSON file: [07/07/2021-20:00:59] [I] Export profile to JSON file: [07/07/2021-20:00:59] [I] [07/07/2021-20:00:59] [I] === Device Information === [07/07/2021-20:00:59] [I] Selected Device: NVIDIA GeForce GTX 1070 [07/07/2021-20:00:59] [I] Compute Capability: 6.1 [07/07/2021-20:00:59] [I] SMs: 15 [07/07/2021-20:00:59] [I] Compute Clock Rate: 1.7845 GHz [07/07/2021-20:00:59] [I] Device Global Memory: 8116 MiB [07/07/2021-20:00:59] [I] Shared Memory per SM: 96 KiB [07/07/2021-20:00:59] [I] Memory Bus Width: 256 bits (ECC disabled) [07/07/2021-20:00:59] [I] Memory Clock Rate: 4.004 GHz [07/07/2021-20:00:59] [I] [07/07/2021-20:00:59] [I] TensorRT version: 8000 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::ScatterND version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::Proposal version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::Split version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 [07/07/2021-20:00:59] [I] [TRT] [MemUsageChange] Init CUDA: CPU +147, GPU +0, now: CPU 154, GPU 877 (MiB) [07/07/2021-20:00:59] [I] [TRT] ---------------------------------------------------------------- [07/07/2021-20:00:59] [I] [TRT] Input filename: /home/htut/Desktop/AltoAI/detection/darknet/yolov4_2_3_416_416_static.onnx [07/07/2021-20:00:59] [I] [TRT] ONNX IR version: 0.0.4 [07/07/2021-20:00:59] [I] [TRT] Opset version: 11 [07/07/2021-20:00:59] [I] [TRT] Producer name: pytorch [07/07/2021-20:00:59] [I] [TRT] Producer version: 1.3 [07/07/2021-20:00:59] [I] [TRT] Domain: [07/07/2021-20:00:59] [I] [TRT] Model version: 0 [07/07/2021-20:00:59] [I] [TRT] Doc string: [07/07/2021-20:00:59] [I] [TRT] ---------------------------------------------------------------- [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::ScatterND version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::Proposal version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::Split version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1 [07/07/2021-20:00:59] [V] [TRT] Adding network input: input with dtype: float32, dimensions: (2, 3, 416, 416) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: input for ONNX tensor: input [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1031 [07/07/2021-20:00:59] [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1032 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1033 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1034 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1035 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1036 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1037 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1038 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1039 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1040 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1041 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1042 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1043 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1044 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1045 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1046 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1047 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1048 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1049 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1050 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1051 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1052 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1053 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1054 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1055 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1056 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: 1057 [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.0.bn1.bias [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.0.bn1.running_mean [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.0.bn1.running_var [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.0.bn1.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.0.conv1.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.1.bn2.bias [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.1.bn2.running_mean [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.1.bn2.running_var [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.1.bn2.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.1.conv2.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.10.bn7.bias [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.10.bn7.running_mean [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.10.bn7.running_var [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.10.bn7.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.10.conv7.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.12.bn8.bias [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.12.bn8.running_mean [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.12.bn8.running_var [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.12.bn8.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.12.conv8.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.13.bn9.bias [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.13.bn9.running_mean [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.13.bn9.running_var [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.13.bn9.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.13.conv9.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.15.bn10.bias [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.15.bn10.running_mean [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.15.bn10.running_var [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.15.bn10.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.15.conv10.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.18.bn11.bias [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.18.bn11.running_mean [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.18.bn11.running_var [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.18.bn11.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.18.conv11.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.2.bn3.bias [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.2.bn3.running_mean [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.2.bn3.running_var [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.2.bn3.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.2.conv3.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.20.bn12.bias [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.20.bn12.running_mean [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.20.bn12.running_var [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.20.bn12.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.20.conv12.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.21.bn13.bias [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.21.bn13.running_mean [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.21.bn13.running_var [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.21.bn13.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.21.conv13.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.23.bn14.bias [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.23.bn14.running_mean [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.23.bn14.running_var [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.23.bn14.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.23.conv14.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.26.bn15.bias [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.26.bn15.running_mean [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.26.bn15.running_var [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.26.bn15.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.26.conv15.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.27.bn16.bias [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.27.bn16.running_mean [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.27.bn16.running_var [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.27.bn16.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.27.conv16.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.28.bn17.bias [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.28.bn17.running_mean [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.28.bn17.running_var [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.28.bn17.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.28.conv17.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.29.conv18.bias [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.29.conv18.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.32.bn19.bias [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.32.bn19.running_mean [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.32.bn19.running_var [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.32.bn19.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.32.conv19.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.35.bn20.bias [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.35.bn20.running_mean [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.35.bn20.running_var [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.35.bn20.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.35.conv20.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.36.conv21.bias [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.36.conv21.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.4.bn4.bias [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.4.bn4.running_mean [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.4.bn4.running_var [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.4.bn4.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.4.conv4.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.5.bn5.bias [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.5.bn5.running_mean [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.5.bn5.running_var [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.5.bn5.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.5.conv5.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.7.bn6.bias [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.7.bn6.running_mean [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.7.bn6.running_var [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.7.bn6.weight [07/07/2021-20:00:59] [V] [TRT] Importing initializer: models.7.conv6.weight [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_119 [Conv] [07/07/2021-20:00:59] [V] [TRT] Searching for input: input [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.0.conv1.weight [07/07/2021-20:00:59] [V] [TRT] node_of_119 [Conv] inputs: [input -> (2, 3, 416, 416)], [models.0.conv1.weight -> (32, 3, 3, 3)], [07/07/2021-20:00:59] [V] [TRT] Convolution input dimensions: (2, 3, 416, 416) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_119 for ONNX node: node_of_119 [07/07/2021-20:00:59] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32 [07/07/2021-20:00:59] [V] [TRT] Convolution output dimensions: (2, 32, 208, 208) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 119 for ONNX tensor: 119 [07/07/2021-20:00:59] [V] [TRT] node_of_119 [Conv] outputs: [119 -> (2, 32, 208, 208)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_120 [BatchNormalization] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 119 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.0.bn1.weight [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.0.bn1.bias [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.0.bn1.running_mean [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.0.bn1.running_var [07/07/2021-20:00:59] [V] [TRT] node_of_120 [BatchNormalization] inputs: [119 -> (2, 32, 208, 208)], [models.0.bn1.weight -> (32)], [models.0.bn1.bias -> (32)], [models.0.bn1.running_mean -> (32)], [models.0.bn1.running_var -> (32)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_120 for ONNX node: node_of_120 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 120 for ONNX tensor: 120 [07/07/2021-20:00:59] [V] [TRT] node_of_120 [BatchNormalization] outputs: [120 -> (2, 32, 208, 208)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_121 [LeakyRelu] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 120 [07/07/2021-20:00:59] [V] [TRT] node_of_121 [LeakyRelu] inputs: [120 -> (2, 32, 208, 208)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_121 for ONNX node: node_of_121 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 121 for ONNX tensor: 121 [07/07/2021-20:00:59] [V] [TRT] node_of_121 [LeakyRelu] outputs: [121 -> (2, 32, 208, 208)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_122 [Conv] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 121 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.1.conv2.weight [07/07/2021-20:00:59] [V] [TRT] node_of_122 [Conv] inputs: [121 -> (2, 32, 208, 208)], [models.1.conv2.weight -> (64, 32, 3, 3)], [07/07/2021-20:00:59] [V] [TRT] Convolution input dimensions: (2, 32, 208, 208) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_122 for ONNX node: node_of_122 [07/07/2021-20:00:59] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2021-20:00:59] [V] [TRT] Convolution output dimensions: (2, 64, 104, 104) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 122 for ONNX tensor: 122 [07/07/2021-20:00:59] [V] [TRT] node_of_122 [Conv] outputs: [122 -> (2, 64, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_123 [BatchNormalization] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 122 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.1.bn2.weight [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.1.bn2.bias [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.1.bn2.running_mean [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.1.bn2.running_var [07/07/2021-20:00:59] [V] [TRT] node_of_123 [BatchNormalization] inputs: [122 -> (2, 64, 104, 104)], [models.1.bn2.weight -> (64)], [models.1.bn2.bias -> (64)], [models.1.bn2.running_mean -> (64)], [models.1.bn2.running_var -> (64)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_123 for ONNX node: node_of_123 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 123 for ONNX tensor: 123 [07/07/2021-20:00:59] [V] [TRT] node_of_123 [BatchNormalization] outputs: [123 -> (2, 64, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_124 [LeakyRelu] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 123 [07/07/2021-20:00:59] [V] [TRT] node_of_124 [LeakyRelu] inputs: [123 -> (2, 64, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_124 for ONNX node: node_of_124 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 124 for ONNX tensor: 124 [07/07/2021-20:00:59] [V] [TRT] node_of_124 [LeakyRelu] outputs: [124 -> (2, 64, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_125 [Conv] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 124 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.2.conv3.weight [07/07/2021-20:00:59] [V] [TRT] node_of_125 [Conv] inputs: [124 -> (2, 64, 104, 104)], [models.2.conv3.weight -> (64, 64, 3, 3)], [07/07/2021-20:00:59] [V] [TRT] Convolution input dimensions: (2, 64, 104, 104) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_125 for ONNX node: node_of_125 [07/07/2021-20:00:59] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2021-20:00:59] [V] [TRT] Convolution output dimensions: (2, 64, 104, 104) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 125 for ONNX tensor: 125 [07/07/2021-20:00:59] [V] [TRT] node_of_125 [Conv] outputs: [125 -> (2, 64, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_126 [BatchNormalization] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 125 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.2.bn3.weight [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.2.bn3.bias [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.2.bn3.running_mean [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.2.bn3.running_var [07/07/2021-20:00:59] [V] [TRT] node_of_126 [BatchNormalization] inputs: [125 -> (2, 64, 104, 104)], [models.2.bn3.weight -> (64)], [models.2.bn3.bias -> (64)], [models.2.bn3.running_mean -> (64)], [models.2.bn3.running_var -> (64)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_126 for ONNX node: node_of_126 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 126 for ONNX tensor: 126 [07/07/2021-20:00:59] [V] [TRT] node_of_126 [BatchNormalization] outputs: [126 -> (2, 64, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_127 [LeakyRelu] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 126 [07/07/2021-20:00:59] [V] [TRT] node_of_127 [LeakyRelu] inputs: [126 -> (2, 64, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_127 for ONNX node: node_of_127 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 127 for ONNX tensor: 127 [07/07/2021-20:00:59] [V] [TRT] node_of_127 [LeakyRelu] outputs: [127 -> (2, 64, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_128 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 127 [07/07/2021-20:00:59] [V] [TRT] node_of_128 [Shape] inputs: [127 -> (2, 64, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_128 for ONNX node: node_of_128 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 128 for ONNX tensor: 128 [07/07/2021-20:00:59] [V] [TRT] node_of_128 [Shape] outputs: [128 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_129 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_129 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_129 [Constant] outputs: [129 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_130 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 128 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 129 [07/07/2021-20:00:59] [V] [TRT] node_of_130 [Gather] inputs: [128 -> (4)], [129 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 129 for ONNX node: 129 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_130 for ONNX node: node_of_130 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 130 for ONNX tensor: 130 [07/07/2021-20:00:59] [V] [TRT] node_of_130 [Gather] outputs: [130 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_131 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_131 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_131 [Constant] outputs: [131 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_132 [Div] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 130 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 131 [07/07/2021-20:00:59] [V] [TRT] node_of_132 [Div] inputs: [130 -> ()], [131 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 131 for ONNX node: 131 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_132 for ONNX node: node_of_132 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 132 for ONNX tensor: 132 [07/07/2021-20:00:59] [V] [TRT] node_of_132 [Div] outputs: [132 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_133 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_133 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_133 [Constant] outputs: [133 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_134 [Div] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 130 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 133 [07/07/2021-20:00:59] [V] [TRT] node_of_134 [Div] inputs: [130 -> ()], [133 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 133 for ONNX node: 133 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_134 for ONNX node: node_of_134 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 134 for ONNX tensor: 134 [07/07/2021-20:00:59] [V] [TRT] node_of_134 [Div] outputs: [134 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_135 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_135 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_135 [Constant] outputs: [135 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_136 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 134 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 135 [07/07/2021-20:00:59] [V] [TRT] node_of_136 [Mul] inputs: [134 -> ()], [135 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 135 for ONNX node: 135 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_136 for ONNX node: node_of_136 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 136 for ONNX tensor: 136 [07/07/2021-20:00:59] [V] [TRT] node_of_136 [Mul] outputs: [136 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_138 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 132 [07/07/2021-20:00:59] [V] [TRT] node_of_138 [Unsqueeze] inputs: [132 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_138 for ONNX node: node_of_138 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 138 for ONNX tensor: 138 [07/07/2021-20:00:59] [V] [TRT] node_of_138 [Unsqueeze] outputs: [138 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_139 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 136 [07/07/2021-20:00:59] [V] [TRT] node_of_139 [Unsqueeze] inputs: [136 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_139 for ONNX node: node_of_139 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 139 for ONNX tensor: 139 [07/07/2021-20:00:59] [V] [TRT] node_of_139 [Unsqueeze] outputs: [139 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_141 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_141 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_141 [Constant] outputs: [141 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_142 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 127 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 138 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 139 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 1031 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 141 [07/07/2021-20:00:59] [V] [TRT] node_of_142 [Slice] inputs: [127 -> (2, 64, 104, 104)], [138 -> (1)], [139 -> (1)], [1031 -> (1)], [141 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_142 for ONNX node: node_of_142 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 142 for ONNX tensor: 142 [07/07/2021-20:00:59] [V] [TRT] node_of_142 [Slice] outputs: [142 -> (2, 32, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_143 [Conv] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 142 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.4.conv4.weight [07/07/2021-20:00:59] [V] [TRT] node_of_143 [Conv] inputs: [142 -> (2, 32, 104, 104)], [models.4.conv4.weight -> (32, 32, 3, 3)], [07/07/2021-20:00:59] [V] [TRT] Convolution input dimensions: (2, 32, 104, 104) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_143 for ONNX node: node_of_143 [07/07/2021-20:00:59] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32 [07/07/2021-20:00:59] [V] [TRT] Convolution output dimensions: (2, 32, 104, 104) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 143 for ONNX tensor: 143 [07/07/2021-20:00:59] [V] [TRT] node_of_143 [Conv] outputs: [143 -> (2, 32, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_144 [BatchNormalization] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 143 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.4.bn4.weight [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.4.bn4.bias [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.4.bn4.running_mean [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.4.bn4.running_var [07/07/2021-20:00:59] [V] [TRT] node_of_144 [BatchNormalization] inputs: [143 -> (2, 32, 104, 104)], [models.4.bn4.weight -> (32)], [models.4.bn4.bias -> (32)], [models.4.bn4.running_mean -> (32)], [models.4.bn4.running_var -> (32)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_144 for ONNX node: node_of_144 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 144 for ONNX tensor: 144 [07/07/2021-20:00:59] [V] [TRT] node_of_144 [BatchNormalization] outputs: [144 -> (2, 32, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_145 [LeakyRelu] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 144 [07/07/2021-20:00:59] [V] [TRT] node_of_145 [LeakyRelu] inputs: [144 -> (2, 32, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_145 for ONNX node: node_of_145 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 145 for ONNX tensor: 145 [07/07/2021-20:00:59] [V] [TRT] node_of_145 [LeakyRelu] outputs: [145 -> (2, 32, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_146 [Conv] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 145 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.5.conv5.weight [07/07/2021-20:00:59] [V] [TRT] node_of_146 [Conv] inputs: [145 -> (2, 32, 104, 104)], [models.5.conv5.weight -> (32, 32, 3, 3)], [07/07/2021-20:00:59] [V] [TRT] Convolution input dimensions: (2, 32, 104, 104) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_146 for ONNX node: node_of_146 [07/07/2021-20:00:59] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32 [07/07/2021-20:00:59] [V] [TRT] Convolution output dimensions: (2, 32, 104, 104) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 146 for ONNX tensor: 146 [07/07/2021-20:00:59] [V] [TRT] node_of_146 [Conv] outputs: [146 -> (2, 32, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_147 [BatchNormalization] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 146 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.5.bn5.weight [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.5.bn5.bias [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.5.bn5.running_mean [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.5.bn5.running_var [07/07/2021-20:00:59] [V] [TRT] node_of_147 [BatchNormalization] inputs: [146 -> (2, 32, 104, 104)], [models.5.bn5.weight -> (32)], [models.5.bn5.bias -> (32)], [models.5.bn5.running_mean -> (32)], [models.5.bn5.running_var -> (32)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_147 for ONNX node: node_of_147 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 147 for ONNX tensor: 147 [07/07/2021-20:00:59] [V] [TRT] node_of_147 [BatchNormalization] outputs: [147 -> (2, 32, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_148 [LeakyRelu] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 147 [07/07/2021-20:00:59] [V] [TRT] node_of_148 [LeakyRelu] inputs: [147 -> (2, 32, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_148 for ONNX node: node_of_148 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 148 for ONNX tensor: 148 [07/07/2021-20:00:59] [V] [TRT] node_of_148 [LeakyRelu] outputs: [148 -> (2, 32, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_149 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 148 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 145 [07/07/2021-20:00:59] [V] [TRT] node_of_149 [Concat] inputs: [148 -> (2, 32, 104, 104)], [145 -> (2, 32, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_149 for ONNX node: node_of_149 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 149 for ONNX tensor: 149 [07/07/2021-20:00:59] [V] [TRT] node_of_149 [Concat] outputs: [149 -> (2, 64, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_150 [Conv] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 149 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.7.conv6.weight [07/07/2021-20:00:59] [V] [TRT] node_of_150 [Conv] inputs: [149 -> (2, 64, 104, 104)], [models.7.conv6.weight -> (64, 64, 1, 1)], [07/07/2021-20:00:59] [V] [TRT] Convolution input dimensions: (2, 64, 104, 104) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_150 for ONNX node: node_of_150 [07/07/2021-20:00:59] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [07/07/2021-20:00:59] [V] [TRT] Convolution output dimensions: (2, 64, 104, 104) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 150 for ONNX tensor: 150 [07/07/2021-20:00:59] [V] [TRT] node_of_150 [Conv] outputs: [150 -> (2, 64, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_151 [BatchNormalization] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 150 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.7.bn6.weight [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.7.bn6.bias [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.7.bn6.running_mean [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.7.bn6.running_var [07/07/2021-20:00:59] [V] [TRT] node_of_151 [BatchNormalization] inputs: [150 -> (2, 64, 104, 104)], [models.7.bn6.weight -> (64)], [models.7.bn6.bias -> (64)], [models.7.bn6.running_mean -> (64)], [models.7.bn6.running_var -> (64)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_151 for ONNX node: node_of_151 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 151 for ONNX tensor: 151 [07/07/2021-20:00:59] [V] [TRT] node_of_151 [BatchNormalization] outputs: [151 -> (2, 64, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_152 [LeakyRelu] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 151 [07/07/2021-20:00:59] [V] [TRT] node_of_152 [LeakyRelu] inputs: [151 -> (2, 64, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_152 for ONNX node: node_of_152 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 152 for ONNX tensor: 152 [07/07/2021-20:00:59] [V] [TRT] node_of_152 [LeakyRelu] outputs: [152 -> (2, 64, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_153 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 127 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 152 [07/07/2021-20:00:59] [V] [TRT] node_of_153 [Concat] inputs: [127 -> (2, 64, 104, 104)], [152 -> (2, 64, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_153 for ONNX node: node_of_153 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 153 for ONNX tensor: 153 [07/07/2021-20:00:59] [V] [TRT] node_of_153 [Concat] outputs: [153 -> (2, 128, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_154 [MaxPool] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 153 [07/07/2021-20:00:59] [V] [TRT] node_of_154 [MaxPool] inputs: [153 -> (2, 128, 104, 104)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_154 for ONNX node: node_of_154 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 154 for ONNX tensor: 154 [07/07/2021-20:00:59] [V] [TRT] node_of_154 [MaxPool] outputs: [154 -> (2, 128, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_155 [Conv] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 154 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.10.conv7.weight [07/07/2021-20:00:59] [V] [TRT] node_of_155 [Conv] inputs: [154 -> (2, 128, 52, 52)], [models.10.conv7.weight -> (128, 128, 3, 3)], [07/07/2021-20:00:59] [V] [TRT] Convolution input dimensions: (2, 128, 52, 52) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_155 for ONNX node: node_of_155 [07/07/2021-20:00:59] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [07/07/2021-20:00:59] [V] [TRT] Convolution output dimensions: (2, 128, 52, 52) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 155 for ONNX tensor: 155 [07/07/2021-20:00:59] [V] [TRT] node_of_155 [Conv] outputs: [155 -> (2, 128, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_156 [BatchNormalization] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 155 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.10.bn7.weight [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.10.bn7.bias [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.10.bn7.running_mean [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.10.bn7.running_var [07/07/2021-20:00:59] [V] [TRT] node_of_156 [BatchNormalization] inputs: [155 -> (2, 128, 52, 52)], [models.10.bn7.weight -> (128)], [models.10.bn7.bias -> (128)], [models.10.bn7.running_mean -> (128)], [models.10.bn7.running_var -> (128)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_156 for ONNX node: node_of_156 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 156 for ONNX tensor: 156 [07/07/2021-20:00:59] [V] [TRT] node_of_156 [BatchNormalization] outputs: [156 -> (2, 128, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_157 [LeakyRelu] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 156 [07/07/2021-20:00:59] [V] [TRT] node_of_157 [LeakyRelu] inputs: [156 -> (2, 128, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_157 for ONNX node: node_of_157 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 157 for ONNX tensor: 157 [07/07/2021-20:00:59] [V] [TRT] node_of_157 [LeakyRelu] outputs: [157 -> (2, 128, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_158 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 157 [07/07/2021-20:00:59] [V] [TRT] node_of_158 [Shape] inputs: [157 -> (2, 128, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_158 for ONNX node: node_of_158 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 158 for ONNX tensor: 158 [07/07/2021-20:00:59] [V] [TRT] node_of_158 [Shape] outputs: [158 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_159 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_159 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_159 [Constant] outputs: [159 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_160 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 158 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 159 [07/07/2021-20:00:59] [V] [TRT] node_of_160 [Gather] inputs: [158 -> (4)], [159 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 159 for ONNX node: 159 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_160 for ONNX node: node_of_160 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 160 for ONNX tensor: 160 [07/07/2021-20:00:59] [V] [TRT] node_of_160 [Gather] outputs: [160 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_161 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_161 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_161 [Constant] outputs: [161 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_162 [Div] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 160 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 161 [07/07/2021-20:00:59] [V] [TRT] node_of_162 [Div] inputs: [160 -> ()], [161 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 161 for ONNX node: 161 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_162 for ONNX node: node_of_162 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 162 for ONNX tensor: 162 [07/07/2021-20:00:59] [V] [TRT] node_of_162 [Div] outputs: [162 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_163 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_163 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_163 [Constant] outputs: [163 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_164 [Div] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 160 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 163 [07/07/2021-20:00:59] [V] [TRT] node_of_164 [Div] inputs: [160 -> ()], [163 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 163 for ONNX node: 163 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_164 for ONNX node: node_of_164 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 164 for ONNX tensor: 164 [07/07/2021-20:00:59] [V] [TRT] node_of_164 [Div] outputs: [164 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_165 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_165 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_165 [Constant] outputs: [165 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_166 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 164 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 165 [07/07/2021-20:00:59] [V] [TRT] node_of_166 [Mul] inputs: [164 -> ()], [165 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 165 for ONNX node: 165 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_166 for ONNX node: node_of_166 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 166 for ONNX tensor: 166 [07/07/2021-20:00:59] [V] [TRT] node_of_166 [Mul] outputs: [166 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_168 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 162 [07/07/2021-20:00:59] [V] [TRT] node_of_168 [Unsqueeze] inputs: [162 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_168 for ONNX node: node_of_168 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 168 for ONNX tensor: 168 [07/07/2021-20:00:59] [V] [TRT] node_of_168 [Unsqueeze] outputs: [168 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_169 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 166 [07/07/2021-20:00:59] [V] [TRT] node_of_169 [Unsqueeze] inputs: [166 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_169 for ONNX node: node_of_169 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 169 for ONNX tensor: 169 [07/07/2021-20:00:59] [V] [TRT] node_of_169 [Unsqueeze] outputs: [169 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_171 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_171 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_171 [Constant] outputs: [171 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_172 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 157 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 168 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 169 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 1032 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 171 [07/07/2021-20:00:59] [V] [TRT] node_of_172 [Slice] inputs: [157 -> (2, 128, 52, 52)], [168 -> (1)], [169 -> (1)], [1032 -> (1)], [171 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_172 for ONNX node: node_of_172 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 172 for ONNX tensor: 172 [07/07/2021-20:00:59] [V] [TRT] node_of_172 [Slice] outputs: [172 -> (2, 64, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_173 [Conv] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 172 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.12.conv8.weight [07/07/2021-20:00:59] [V] [TRT] node_of_173 [Conv] inputs: [172 -> (2, 64, 52, 52)], [models.12.conv8.weight -> (64, 64, 3, 3)], [07/07/2021-20:00:59] [V] [TRT] Convolution input dimensions: (2, 64, 52, 52) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_173 for ONNX node: node_of_173 [07/07/2021-20:00:59] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2021-20:00:59] [V] [TRT] Convolution output dimensions: (2, 64, 52, 52) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 173 for ONNX tensor: 173 [07/07/2021-20:00:59] [V] [TRT] node_of_173 [Conv] outputs: [173 -> (2, 64, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_174 [BatchNormalization] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 173 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.12.bn8.weight [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.12.bn8.bias [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.12.bn8.running_mean [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.12.bn8.running_var [07/07/2021-20:00:59] [V] [TRT] node_of_174 [BatchNormalization] inputs: [173 -> (2, 64, 52, 52)], [models.12.bn8.weight -> (64)], [models.12.bn8.bias -> (64)], [models.12.bn8.running_mean -> (64)], [models.12.bn8.running_var -> (64)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_174 for ONNX node: node_of_174 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 174 for ONNX tensor: 174 [07/07/2021-20:00:59] [V] [TRT] node_of_174 [BatchNormalization] outputs: [174 -> (2, 64, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_175 [LeakyRelu] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 174 [07/07/2021-20:00:59] [V] [TRT] node_of_175 [LeakyRelu] inputs: [174 -> (2, 64, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_175 for ONNX node: node_of_175 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 175 for ONNX tensor: 175 [07/07/2021-20:00:59] [V] [TRT] node_of_175 [LeakyRelu] outputs: [175 -> (2, 64, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_176 [Conv] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 175 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.13.conv9.weight [07/07/2021-20:00:59] [V] [TRT] node_of_176 [Conv] inputs: [175 -> (2, 64, 52, 52)], [models.13.conv9.weight -> (64, 64, 3, 3)], [07/07/2021-20:00:59] [V] [TRT] Convolution input dimensions: (2, 64, 52, 52) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_176 for ONNX node: node_of_176 [07/07/2021-20:00:59] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2021-20:00:59] [V] [TRT] Convolution output dimensions: (2, 64, 52, 52) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 176 for ONNX tensor: 176 [07/07/2021-20:00:59] [V] [TRT] node_of_176 [Conv] outputs: [176 -> (2, 64, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_177 [BatchNormalization] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 176 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.13.bn9.weight [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.13.bn9.bias [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.13.bn9.running_mean [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.13.bn9.running_var [07/07/2021-20:00:59] [V] [TRT] node_of_177 [BatchNormalization] inputs: [176 -> (2, 64, 52, 52)], [models.13.bn9.weight -> (64)], [models.13.bn9.bias -> (64)], [models.13.bn9.running_mean -> (64)], [models.13.bn9.running_var -> (64)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_177 for ONNX node: node_of_177 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 177 for ONNX tensor: 177 [07/07/2021-20:00:59] [V] [TRT] node_of_177 [BatchNormalization] outputs: [177 -> (2, 64, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_178 [LeakyRelu] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 177 [07/07/2021-20:00:59] [V] [TRT] node_of_178 [LeakyRelu] inputs: [177 -> (2, 64, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_178 for ONNX node: node_of_178 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 178 for ONNX tensor: 178 [07/07/2021-20:00:59] [V] [TRT] node_of_178 [LeakyRelu] outputs: [178 -> (2, 64, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_179 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 178 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 175 [07/07/2021-20:00:59] [V] [TRT] node_of_179 [Concat] inputs: [178 -> (2, 64, 52, 52)], [175 -> (2, 64, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_179 for ONNX node: node_of_179 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 179 for ONNX tensor: 179 [07/07/2021-20:00:59] [V] [TRT] node_of_179 [Concat] outputs: [179 -> (2, 128, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_180 [Conv] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 179 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.15.conv10.weight [07/07/2021-20:00:59] [V] [TRT] node_of_180 [Conv] inputs: [179 -> (2, 128, 52, 52)], [models.15.conv10.weight -> (128, 128, 1, 1)], [07/07/2021-20:00:59] [V] [TRT] Convolution input dimensions: (2, 128, 52, 52) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_180 for ONNX node: node_of_180 [07/07/2021-20:00:59] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [07/07/2021-20:00:59] [V] [TRT] Convolution output dimensions: (2, 128, 52, 52) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 180 for ONNX tensor: 180 [07/07/2021-20:00:59] [V] [TRT] node_of_180 [Conv] outputs: [180 -> (2, 128, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_181 [BatchNormalization] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 180 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.15.bn10.weight [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.15.bn10.bias [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.15.bn10.running_mean [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.15.bn10.running_var [07/07/2021-20:00:59] [V] [TRT] node_of_181 [BatchNormalization] inputs: [180 -> (2, 128, 52, 52)], [models.15.bn10.weight -> (128)], [models.15.bn10.bias -> (128)], [models.15.bn10.running_mean -> (128)], [models.15.bn10.running_var -> (128)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_181 for ONNX node: node_of_181 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 181 for ONNX tensor: 181 [07/07/2021-20:00:59] [V] [TRT] node_of_181 [BatchNormalization] outputs: [181 -> (2, 128, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_182 [LeakyRelu] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 181 [07/07/2021-20:00:59] [V] [TRT] node_of_182 [LeakyRelu] inputs: [181 -> (2, 128, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_182 for ONNX node: node_of_182 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 182 for ONNX tensor: 182 [07/07/2021-20:00:59] [V] [TRT] node_of_182 [LeakyRelu] outputs: [182 -> (2, 128, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_183 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 157 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 182 [07/07/2021-20:00:59] [V] [TRT] node_of_183 [Concat] inputs: [157 -> (2, 128, 52, 52)], [182 -> (2, 128, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_183 for ONNX node: node_of_183 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 183 for ONNX tensor: 183 [07/07/2021-20:00:59] [V] [TRT] node_of_183 [Concat] outputs: [183 -> (2, 256, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_184 [MaxPool] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 183 [07/07/2021-20:00:59] [V] [TRT] node_of_184 [MaxPool] inputs: [183 -> (2, 256, 52, 52)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_184 for ONNX node: node_of_184 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 184 for ONNX tensor: 184 [07/07/2021-20:00:59] [V] [TRT] node_of_184 [MaxPool] outputs: [184 -> (2, 256, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_185 [Conv] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 184 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.18.conv11.weight [07/07/2021-20:00:59] [V] [TRT] node_of_185 [Conv] inputs: [184 -> (2, 256, 26, 26)], [models.18.conv11.weight -> (256, 256, 3, 3)], [07/07/2021-20:00:59] [V] [TRT] Convolution input dimensions: (2, 256, 26, 26) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_185 for ONNX node: node_of_185 [07/07/2021-20:00:59] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [07/07/2021-20:00:59] [V] [TRT] Convolution output dimensions: (2, 256, 26, 26) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 185 for ONNX tensor: 185 [07/07/2021-20:00:59] [V] [TRT] node_of_185 [Conv] outputs: [185 -> (2, 256, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_186 [BatchNormalization] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 185 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.18.bn11.weight [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.18.bn11.bias [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.18.bn11.running_mean [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.18.bn11.running_var [07/07/2021-20:00:59] [V] [TRT] node_of_186 [BatchNormalization] inputs: [185 -> (2, 256, 26, 26)], [models.18.bn11.weight -> (256)], [models.18.bn11.bias -> (256)], [models.18.bn11.running_mean -> (256)], [models.18.bn11.running_var -> (256)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_186 for ONNX node: node_of_186 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 186 for ONNX tensor: 186 [07/07/2021-20:00:59] [V] [TRT] node_of_186 [BatchNormalization] outputs: [186 -> (2, 256, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_187 [LeakyRelu] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 186 [07/07/2021-20:00:59] [V] [TRT] node_of_187 [LeakyRelu] inputs: [186 -> (2, 256, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_187 for ONNX node: node_of_187 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 187 for ONNX tensor: 187 [07/07/2021-20:00:59] [V] [TRT] node_of_187 [LeakyRelu] outputs: [187 -> (2, 256, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_188 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 187 [07/07/2021-20:00:59] [V] [TRT] node_of_188 [Shape] inputs: [187 -> (2, 256, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_188 for ONNX node: node_of_188 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 188 for ONNX tensor: 188 [07/07/2021-20:00:59] [V] [TRT] node_of_188 [Shape] outputs: [188 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_189 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_189 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_189 [Constant] outputs: [189 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_190 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 188 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 189 [07/07/2021-20:00:59] [V] [TRT] node_of_190 [Gather] inputs: [188 -> (4)], [189 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 189 for ONNX node: 189 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_190 for ONNX node: node_of_190 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 190 for ONNX tensor: 190 [07/07/2021-20:00:59] [V] [TRT] node_of_190 [Gather] outputs: [190 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_191 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_191 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_191 [Constant] outputs: [191 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_192 [Div] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 190 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 191 [07/07/2021-20:00:59] [V] [TRT] node_of_192 [Div] inputs: [190 -> ()], [191 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 191 for ONNX node: 191 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_192 for ONNX node: node_of_192 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 192 for ONNX tensor: 192 [07/07/2021-20:00:59] [V] [TRT] node_of_192 [Div] outputs: [192 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_193 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_193 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_193 [Constant] outputs: [193 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_194 [Div] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 190 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 193 [07/07/2021-20:00:59] [V] [TRT] node_of_194 [Div] inputs: [190 -> ()], [193 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 193 for ONNX node: 193 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_194 for ONNX node: node_of_194 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 194 for ONNX tensor: 194 [07/07/2021-20:00:59] [V] [TRT] node_of_194 [Div] outputs: [194 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_195 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_195 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_195 [Constant] outputs: [195 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_196 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 194 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 195 [07/07/2021-20:00:59] [V] [TRT] node_of_196 [Mul] inputs: [194 -> ()], [195 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 195 for ONNX node: 195 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_196 for ONNX node: node_of_196 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 196 for ONNX tensor: 196 [07/07/2021-20:00:59] [V] [TRT] node_of_196 [Mul] outputs: [196 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_198 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 192 [07/07/2021-20:00:59] [V] [TRT] node_of_198 [Unsqueeze] inputs: [192 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_198 for ONNX node: node_of_198 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 198 for ONNX tensor: 198 [07/07/2021-20:00:59] [V] [TRT] node_of_198 [Unsqueeze] outputs: [198 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_199 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 196 [07/07/2021-20:00:59] [V] [TRT] node_of_199 [Unsqueeze] inputs: [196 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_199 for ONNX node: node_of_199 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 199 for ONNX tensor: 199 [07/07/2021-20:00:59] [V] [TRT] node_of_199 [Unsqueeze] outputs: [199 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_201 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_201 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_201 [Constant] outputs: [201 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_202 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 187 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 198 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 199 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 1033 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 201 [07/07/2021-20:00:59] [V] [TRT] node_of_202 [Slice] inputs: [187 -> (2, 256, 26, 26)], [198 -> (1)], [199 -> (1)], [1033 -> (1)], [201 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_202 for ONNX node: node_of_202 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 202 for ONNX tensor: 202 [07/07/2021-20:00:59] [V] [TRT] node_of_202 [Slice] outputs: [202 -> (2, 128, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_203 [Conv] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 202 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.20.conv12.weight [07/07/2021-20:00:59] [V] [TRT] node_of_203 [Conv] inputs: [202 -> (2, 128, 26, 26)], [models.20.conv12.weight -> (128, 128, 3, 3)], [07/07/2021-20:00:59] [V] [TRT] Convolution input dimensions: (2, 128, 26, 26) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_203 for ONNX node: node_of_203 [07/07/2021-20:00:59] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [07/07/2021-20:00:59] [V] [TRT] Convolution output dimensions: (2, 128, 26, 26) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 203 for ONNX tensor: 203 [07/07/2021-20:00:59] [V] [TRT] node_of_203 [Conv] outputs: [203 -> (2, 128, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_204 [BatchNormalization] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 203 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.20.bn12.weight [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.20.bn12.bias [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.20.bn12.running_mean [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.20.bn12.running_var [07/07/2021-20:00:59] [V] [TRT] node_of_204 [BatchNormalization] inputs: [203 -> (2, 128, 26, 26)], [models.20.bn12.weight -> (128)], [models.20.bn12.bias -> (128)], [models.20.bn12.running_mean -> (128)], [models.20.bn12.running_var -> (128)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_204 for ONNX node: node_of_204 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 204 for ONNX tensor: 204 [07/07/2021-20:00:59] [V] [TRT] node_of_204 [BatchNormalization] outputs: [204 -> (2, 128, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_205 [LeakyRelu] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 204 [07/07/2021-20:00:59] [V] [TRT] node_of_205 [LeakyRelu] inputs: [204 -> (2, 128, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_205 for ONNX node: node_of_205 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 205 for ONNX tensor: 205 [07/07/2021-20:00:59] [V] [TRT] node_of_205 [LeakyRelu] outputs: [205 -> (2, 128, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_206 [Conv] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 205 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.21.conv13.weight [07/07/2021-20:00:59] [V] [TRT] node_of_206 [Conv] inputs: [205 -> (2, 128, 26, 26)], [models.21.conv13.weight -> (128, 128, 3, 3)], [07/07/2021-20:00:59] [V] [TRT] Convolution input dimensions: (2, 128, 26, 26) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_206 for ONNX node: node_of_206 [07/07/2021-20:00:59] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [07/07/2021-20:00:59] [V] [TRT] Convolution output dimensions: (2, 128, 26, 26) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 206 for ONNX tensor: 206 [07/07/2021-20:00:59] [V] [TRT] node_of_206 [Conv] outputs: [206 -> (2, 128, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_207 [BatchNormalization] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 206 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.21.bn13.weight [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.21.bn13.bias [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.21.bn13.running_mean [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.21.bn13.running_var [07/07/2021-20:00:59] [V] [TRT] node_of_207 [BatchNormalization] inputs: [206 -> (2, 128, 26, 26)], [models.21.bn13.weight -> (128)], [models.21.bn13.bias -> (128)], [models.21.bn13.running_mean -> (128)], [models.21.bn13.running_var -> (128)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_207 for ONNX node: node_of_207 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 207 for ONNX tensor: 207 [07/07/2021-20:00:59] [V] [TRT] node_of_207 [BatchNormalization] outputs: [207 -> (2, 128, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_208 [LeakyRelu] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 207 [07/07/2021-20:00:59] [V] [TRT] node_of_208 [LeakyRelu] inputs: [207 -> (2, 128, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_208 for ONNX node: node_of_208 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 208 for ONNX tensor: 208 [07/07/2021-20:00:59] [V] [TRT] node_of_208 [LeakyRelu] outputs: [208 -> (2, 128, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_209 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 208 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 205 [07/07/2021-20:00:59] [V] [TRT] node_of_209 [Concat] inputs: [208 -> (2, 128, 26, 26)], [205 -> (2, 128, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_209 for ONNX node: node_of_209 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 209 for ONNX tensor: 209 [07/07/2021-20:00:59] [V] [TRT] node_of_209 [Concat] outputs: [209 -> (2, 256, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_210 [Conv] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 209 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.23.conv14.weight [07/07/2021-20:00:59] [V] [TRT] node_of_210 [Conv] inputs: [209 -> (2, 256, 26, 26)], [models.23.conv14.weight -> (256, 256, 1, 1)], [07/07/2021-20:00:59] [V] [TRT] Convolution input dimensions: (2, 256, 26, 26) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_210 for ONNX node: node_of_210 [07/07/2021-20:00:59] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [07/07/2021-20:00:59] [V] [TRT] Convolution output dimensions: (2, 256, 26, 26) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 210 for ONNX tensor: 210 [07/07/2021-20:00:59] [V] [TRT] node_of_210 [Conv] outputs: [210 -> (2, 256, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_211 [BatchNormalization] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 210 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.23.bn14.weight [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.23.bn14.bias [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.23.bn14.running_mean [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.23.bn14.running_var [07/07/2021-20:00:59] [V] [TRT] node_of_211 [BatchNormalization] inputs: [210 -> (2, 256, 26, 26)], [models.23.bn14.weight -> (256)], [models.23.bn14.bias -> (256)], [models.23.bn14.running_mean -> (256)], [models.23.bn14.running_var -> (256)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_211 for ONNX node: node_of_211 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 211 for ONNX tensor: 211 [07/07/2021-20:00:59] [V] [TRT] node_of_211 [BatchNormalization] outputs: [211 -> (2, 256, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_212 [LeakyRelu] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 211 [07/07/2021-20:00:59] [V] [TRT] node_of_212 [LeakyRelu] inputs: [211 -> (2, 256, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_212 for ONNX node: node_of_212 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 212 for ONNX tensor: 212 [07/07/2021-20:00:59] [V] [TRT] node_of_212 [LeakyRelu] outputs: [212 -> (2, 256, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_213 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 187 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 212 [07/07/2021-20:00:59] [V] [TRT] node_of_213 [Concat] inputs: [187 -> (2, 256, 26, 26)], [212 -> (2, 256, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_213 for ONNX node: node_of_213 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 213 for ONNX tensor: 213 [07/07/2021-20:00:59] [V] [TRT] node_of_213 [Concat] outputs: [213 -> (2, 512, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_214 [MaxPool] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 213 [07/07/2021-20:00:59] [V] [TRT] node_of_214 [MaxPool] inputs: [213 -> (2, 512, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_214 for ONNX node: node_of_214 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 214 for ONNX tensor: 214 [07/07/2021-20:00:59] [V] [TRT] node_of_214 [MaxPool] outputs: [214 -> (2, 512, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_215 [Conv] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 214 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.26.conv15.weight [07/07/2021-20:00:59] [V] [TRT] node_of_215 [Conv] inputs: [214 -> (2, 512, 13, 13)], [models.26.conv15.weight -> (512, 512, 3, 3)], [07/07/2021-20:00:59] [V] [TRT] Convolution input dimensions: (2, 512, 13, 13) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_215 for ONNX node: node_of_215 [07/07/2021-20:00:59] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [07/07/2021-20:00:59] [V] [TRT] Convolution output dimensions: (2, 512, 13, 13) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 215 for ONNX tensor: 215 [07/07/2021-20:00:59] [V] [TRT] node_of_215 [Conv] outputs: [215 -> (2, 512, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_216 [BatchNormalization] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 215 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.26.bn15.weight [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.26.bn15.bias [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.26.bn15.running_mean [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.26.bn15.running_var [07/07/2021-20:00:59] [V] [TRT] node_of_216 [BatchNormalization] inputs: [215 -> (2, 512, 13, 13)], [models.26.bn15.weight -> (512)], [models.26.bn15.bias -> (512)], [models.26.bn15.running_mean -> (512)], [models.26.bn15.running_var -> (512)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_216 for ONNX node: node_of_216 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 216 for ONNX tensor: 216 [07/07/2021-20:00:59] [V] [TRT] node_of_216 [BatchNormalization] outputs: [216 -> (2, 512, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_217 [LeakyRelu] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 216 [07/07/2021-20:00:59] [V] [TRT] node_of_217 [LeakyRelu] inputs: [216 -> (2, 512, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_217 for ONNX node: node_of_217 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 217 for ONNX tensor: 217 [07/07/2021-20:00:59] [V] [TRT] node_of_217 [LeakyRelu] outputs: [217 -> (2, 512, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_218 [Conv] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 217 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.27.conv16.weight [07/07/2021-20:00:59] [V] [TRT] node_of_218 [Conv] inputs: [217 -> (2, 512, 13, 13)], [models.27.conv16.weight -> (256, 512, 1, 1)], [07/07/2021-20:00:59] [V] [TRT] Convolution input dimensions: (2, 512, 13, 13) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_218 for ONNX node: node_of_218 [07/07/2021-20:00:59] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [07/07/2021-20:00:59] [V] [TRT] Convolution output dimensions: (2, 256, 13, 13) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 218 for ONNX tensor: 218 [07/07/2021-20:00:59] [V] [TRT] node_of_218 [Conv] outputs: [218 -> (2, 256, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_219 [BatchNormalization] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 218 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.27.bn16.weight [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.27.bn16.bias [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.27.bn16.running_mean [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.27.bn16.running_var [07/07/2021-20:00:59] [V] [TRT] node_of_219 [BatchNormalization] inputs: [218 -> (2, 256, 13, 13)], [models.27.bn16.weight -> (256)], [models.27.bn16.bias -> (256)], [models.27.bn16.running_mean -> (256)], [models.27.bn16.running_var -> (256)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_219 for ONNX node: node_of_219 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 219 for ONNX tensor: 219 [07/07/2021-20:00:59] [V] [TRT] node_of_219 [BatchNormalization] outputs: [219 -> (2, 256, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_220 [LeakyRelu] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 219 [07/07/2021-20:00:59] [V] [TRT] node_of_220 [LeakyRelu] inputs: [219 -> (2, 256, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_220 for ONNX node: node_of_220 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 220 for ONNX tensor: 220 [07/07/2021-20:00:59] [V] [TRT] node_of_220 [LeakyRelu] outputs: [220 -> (2, 256, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_221 [Conv] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 220 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.28.conv17.weight [07/07/2021-20:00:59] [V] [TRT] node_of_221 [Conv] inputs: [220 -> (2, 256, 13, 13)], [models.28.conv17.weight -> (512, 256, 3, 3)], [07/07/2021-20:00:59] [V] [TRT] Convolution input dimensions: (2, 256, 13, 13) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_221 for ONNX node: node_of_221 [07/07/2021-20:00:59] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [07/07/2021-20:00:59] [V] [TRT] Convolution output dimensions: (2, 512, 13, 13) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 221 for ONNX tensor: 221 [07/07/2021-20:00:59] [V] [TRT] node_of_221 [Conv] outputs: [221 -> (2, 512, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_222 [BatchNormalization] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 221 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.28.bn17.weight [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.28.bn17.bias [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.28.bn17.running_mean [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.28.bn17.running_var [07/07/2021-20:00:59] [V] [TRT] node_of_222 [BatchNormalization] inputs: [221 -> (2, 512, 13, 13)], [models.28.bn17.weight -> (512)], [models.28.bn17.bias -> (512)], [models.28.bn17.running_mean -> (512)], [models.28.bn17.running_var -> (512)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_222 for ONNX node: node_of_222 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 222 for ONNX tensor: 222 [07/07/2021-20:00:59] [V] [TRT] node_of_222 [BatchNormalization] outputs: [222 -> (2, 512, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_223 [LeakyRelu] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 222 [07/07/2021-20:00:59] [V] [TRT] node_of_223 [LeakyRelu] inputs: [222 -> (2, 512, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_223 for ONNX node: node_of_223 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 223 for ONNX tensor: 223 [07/07/2021-20:00:59] [V] [TRT] node_of_223 [LeakyRelu] outputs: [223 -> (2, 512, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_224 [Conv] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 223 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.29.conv18.weight [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.29.conv18.bias [07/07/2021-20:00:59] [V] [TRT] node_of_224 [Conv] inputs: [223 -> (2, 512, 13, 13)], [models.29.conv18.weight -> (18, 512, 1, 1)], [models.29.conv18.bias -> (18)], [07/07/2021-20:00:59] [V] [TRT] Convolution input dimensions: (2, 512, 13, 13) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_224 for ONNX node: node_of_224 [07/07/2021-20:00:59] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 18 [07/07/2021-20:00:59] [V] [TRT] Convolution output dimensions: (2, 18, 13, 13) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 224 for ONNX tensor: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_224 [Conv] outputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_225 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_225 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_225 [Constant] outputs: [225 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_226 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_226 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_226 [Constant] outputs: [226 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_227 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_227 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_227 [Constant] outputs: [227 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_228 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_228 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_228 [Constant] outputs: [228 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_229 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 226 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 227 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 225 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 228 [07/07/2021-20:00:59] [V] [TRT] node_of_229 [Slice] inputs: [224 -> (2, 18, 13, 13)], [226 -> (1)], [227 -> (1)], [225 -> (1)], [228 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_229 for ONNX node: node_of_229 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 229 for ONNX tensor: 229 [07/07/2021-20:00:59] [V] [TRT] node_of_229 [Slice] outputs: [229 -> (2, 2, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_230 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_230 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_230 [Constant] outputs: [230 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_231 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_231 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_231 [Constant] outputs: [231 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_232 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_232 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_232 [Constant] outputs: [232 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_233 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_233 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_233 [Constant] outputs: [233 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_234 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 231 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 232 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 230 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 233 [07/07/2021-20:00:59] [V] [TRT] node_of_234 [Slice] inputs: [224 -> (2, 18, 13, 13)], [231 -> (1)], [232 -> (1)], [230 -> (1)], [233 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_234 for ONNX node: node_of_234 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 234 for ONNX tensor: 234 [07/07/2021-20:00:59] [V] [TRT] node_of_234 [Slice] outputs: [234 -> (2, 2, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_235 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_235 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_235 [Constant] outputs: [235 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_236 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_236 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_236 [Constant] outputs: [236 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_237 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_237 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_237 [Constant] outputs: [237 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_238 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_238 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_238 [Constant] outputs: [238 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_239 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 236 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 237 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 235 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 238 [07/07/2021-20:00:59] [V] [TRT] node_of_239 [Slice] inputs: [224 -> (2, 18, 13, 13)], [236 -> (1)], [237 -> (1)], [235 -> (1)], [238 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_239 for ONNX node: node_of_239 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 239 for ONNX tensor: 239 [07/07/2021-20:00:59] [V] [TRT] node_of_239 [Slice] outputs: [239 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_240 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_240 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_240 [Constant] outputs: [240 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_241 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_241 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_241 [Constant] outputs: [241 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_242 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_242 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_242 [Constant] outputs: [242 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_243 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_243 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_243 [Constant] outputs: [243 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_244 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 241 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 242 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 240 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 243 [07/07/2021-20:00:59] [V] [TRT] node_of_244 [Slice] inputs: [224 -> (2, 18, 13, 13)], [241 -> (1)], [242 -> (1)], [240 -> (1)], [243 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_244 for ONNX node: node_of_244 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 244 for ONNX tensor: 244 [07/07/2021-20:00:59] [V] [TRT] node_of_244 [Slice] outputs: [244 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_245 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_245 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_245 [Constant] outputs: [245 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_246 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_246 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_246 [Constant] outputs: [246 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_247 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_247 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_247 [Constant] outputs: [247 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_248 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_248 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_248 [Constant] outputs: [248 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_249 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 246 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 247 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 245 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 248 [07/07/2021-20:00:59] [V] [TRT] node_of_249 [Slice] inputs: [224 -> (2, 18, 13, 13)], [246 -> (1)], [247 -> (1)], [245 -> (1)], [248 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_249 for ONNX node: node_of_249 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 249 for ONNX tensor: 249 [07/07/2021-20:00:59] [V] [TRT] node_of_249 [Slice] outputs: [249 -> (2, 2, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_250 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_250 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_250 [Constant] outputs: [250 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_251 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_251 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_251 [Constant] outputs: [251 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_252 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_252 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_252 [Constant] outputs: [252 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_253 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_253 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_253 [Constant] outputs: [253 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_254 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 251 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 252 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 250 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 253 [07/07/2021-20:00:59] [V] [TRT] node_of_254 [Slice] inputs: [224 -> (2, 18, 13, 13)], [251 -> (1)], [252 -> (1)], [250 -> (1)], [253 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_254 for ONNX node: node_of_254 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 254 for ONNX tensor: 254 [07/07/2021-20:00:59] [V] [TRT] node_of_254 [Slice] outputs: [254 -> (2, 2, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_255 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_255 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_255 [Constant] outputs: [255 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_256 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_256 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_256 [Constant] outputs: [256 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_257 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_257 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_257 [Constant] outputs: [257 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_258 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_258 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_258 [Constant] outputs: [258 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_259 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 256 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 257 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 255 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 258 [07/07/2021-20:00:59] [V] [TRT] node_of_259 [Slice] inputs: [224 -> (2, 18, 13, 13)], [256 -> (1)], [257 -> (1)], [255 -> (1)], [258 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_259 for ONNX node: node_of_259 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 259 for ONNX tensor: 259 [07/07/2021-20:00:59] [V] [TRT] node_of_259 [Slice] outputs: [259 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_260 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_260 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_260 [Constant] outputs: [260 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_261 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_261 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_261 [Constant] outputs: [261 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_262 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_262 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_262 [Constant] outputs: [262 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_263 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_263 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_263 [Constant] outputs: [263 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_264 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 261 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 262 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 260 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 263 [07/07/2021-20:00:59] [V] [TRT] node_of_264 [Slice] inputs: [224 -> (2, 18, 13, 13)], [261 -> (1)], [262 -> (1)], [260 -> (1)], [263 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_264 for ONNX node: node_of_264 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 264 for ONNX tensor: 264 [07/07/2021-20:00:59] [V] [TRT] node_of_264 [Slice] outputs: [264 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_265 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_265 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_265 [Constant] outputs: [265 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_266 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_266 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_266 [Constant] outputs: [266 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_267 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_267 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_267 [Constant] outputs: [267 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_268 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_268 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_268 [Constant] outputs: [268 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_269 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 266 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 267 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 265 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 268 [07/07/2021-20:00:59] [V] [TRT] node_of_269 [Slice] inputs: [224 -> (2, 18, 13, 13)], [266 -> (1)], [267 -> (1)], [265 -> (1)], [268 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_269 for ONNX node: node_of_269 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 269 for ONNX tensor: 269 [07/07/2021-20:00:59] [V] [TRT] node_of_269 [Slice] outputs: [269 -> (2, 2, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_270 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_270 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_270 [Constant] outputs: [270 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_271 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_271 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_271 [Constant] outputs: [271 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_272 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_272 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_272 [Constant] outputs: [272 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_273 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_273 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_273 [Constant] outputs: [273 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_274 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 271 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 272 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 270 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 273 [07/07/2021-20:00:59] [V] [TRT] node_of_274 [Slice] inputs: [224 -> (2, 18, 13, 13)], [271 -> (1)], [272 -> (1)], [270 -> (1)], [273 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_274 for ONNX node: node_of_274 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 274 for ONNX tensor: 274 [07/07/2021-20:00:59] [V] [TRT] node_of_274 [Slice] outputs: [274 -> (2, 2, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_275 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_275 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_275 [Constant] outputs: [275 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_276 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_276 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_276 [Constant] outputs: [276 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_277 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_277 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_277 [Constant] outputs: [277 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_278 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_278 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_278 [Constant] outputs: [278 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_279 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 276 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 277 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 275 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 278 [07/07/2021-20:00:59] [V] [TRT] node_of_279 [Slice] inputs: [224 -> (2, 18, 13, 13)], [276 -> (1)], [277 -> (1)], [275 -> (1)], [278 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_279 for ONNX node: node_of_279 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 279 for ONNX tensor: 279 [07/07/2021-20:00:59] [V] [TRT] node_of_279 [Slice] outputs: [279 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_280 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_280 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_280 [Constant] outputs: [280 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_281 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_281 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_281 [Constant] outputs: [281 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_282 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_282 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_282 [Constant] outputs: [282 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_283 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_283 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_283 [Constant] outputs: [283 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_284 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 281 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 282 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 280 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 283 [07/07/2021-20:00:59] [V] [TRT] node_of_284 [Slice] inputs: [224 -> (2, 18, 13, 13)], [281 -> (1)], [282 -> (1)], [280 -> (1)], [283 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_284 for ONNX node: node_of_284 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 284 for ONNX tensor: 284 [07/07/2021-20:00:59] [V] [TRT] node_of_284 [Slice] outputs: [284 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_285 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 229 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 249 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 269 [07/07/2021-20:00:59] [V] [TRT] node_of_285 [Concat] inputs: [229 -> (2, 2, 13, 13)], [249 -> (2, 2, 13, 13)], [269 -> (2, 2, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_285 for ONNX node: node_of_285 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 285 for ONNX tensor: 285 [07/07/2021-20:00:59] [V] [TRT] node_of_285 [Concat] outputs: [285 -> (2, 6, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_286 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 234 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 254 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 274 [07/07/2021-20:00:59] [V] [TRT] node_of_286 [Concat] inputs: [234 -> (2, 2, 13, 13)], [254 -> (2, 2, 13, 13)], [274 -> (2, 2, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_286 for ONNX node: node_of_286 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 286 for ONNX tensor: 286 [07/07/2021-20:00:59] [V] [TRT] node_of_286 [Concat] outputs: [286 -> (2, 6, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_287 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 239 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 259 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 279 [07/07/2021-20:00:59] [V] [TRT] node_of_287 [Concat] inputs: [239 -> (2, 1, 13, 13)], [259 -> (2, 1, 13, 13)], [279 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_287 for ONNX node: node_of_287 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 287 for ONNX tensor: 287 [07/07/2021-20:00:59] [V] [TRT] node_of_287 [Concat] outputs: [287 -> (2, 3, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_288 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_288 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_288 for ONNX node: node_of_288 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 288 for ONNX tensor: 288 [07/07/2021-20:00:59] [V] [TRT] node_of_288 [Shape] outputs: [288 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_289 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_289 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_289 [Constant] outputs: [289 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_290 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 288 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 289 [07/07/2021-20:00:59] [V] [TRT] node_of_290 [Gather] inputs: [288 -> (4)], [289 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 289 for ONNX node: 289 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_290 for ONNX node: node_of_290 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 290 for ONNX tensor: 290 [07/07/2021-20:00:59] [V] [TRT] node_of_290 [Gather] outputs: [290 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_291 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_291 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_291 for ONNX node: node_of_291 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 291 for ONNX tensor: 291 [07/07/2021-20:00:59] [V] [TRT] node_of_291 [Shape] outputs: [291 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_292 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_292 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_292 [Constant] outputs: [292 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_293 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 291 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 292 [07/07/2021-20:00:59] [V] [TRT] node_of_293 [Gather] inputs: [291 -> (4)], [292 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 292 for ONNX node: 292 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_293 for ONNX node: node_of_293 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 293 for ONNX tensor: 293 [07/07/2021-20:00:59] [V] [TRT] node_of_293 [Gather] outputs: [293 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_294 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_294 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_294 [Constant] outputs: [294 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_295 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 293 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 294 [07/07/2021-20:00:59] [V] [TRT] node_of_295 [Mul] inputs: [293 -> ()], [294 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 294 for ONNX node: 294 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_295 for ONNX node: node_of_295 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 295 for ONNX tensor: 295 [07/07/2021-20:00:59] [V] [TRT] node_of_295 [Mul] outputs: [295 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_296 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_296 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_296 for ONNX node: node_of_296 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 296 for ONNX tensor: 296 [07/07/2021-20:00:59] [V] [TRT] node_of_296 [Shape] outputs: [296 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_297 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_297 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_297 [Constant] outputs: [297 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_298 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 296 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 297 [07/07/2021-20:00:59] [V] [TRT] node_of_298 [Gather] inputs: [296 -> (4)], [297 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 297 for ONNX node: 297 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_298 for ONNX node: node_of_298 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 298 for ONNX tensor: 298 [07/07/2021-20:00:59] [V] [TRT] node_of_298 [Gather] outputs: [298 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_299 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 295 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 298 [07/07/2021-20:00:59] [V] [TRT] node_of_299 [Mul] inputs: [295 -> ()], [298 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_299 for ONNX node: node_of_299 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 299 for ONNX tensor: 299 [07/07/2021-20:00:59] [V] [TRT] node_of_299 [Mul] outputs: [299 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_300 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 290 [07/07/2021-20:00:59] [V] [TRT] node_of_300 [Unsqueeze] inputs: [290 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_300 for ONNX node: node_of_300 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 300 for ONNX tensor: 300 [07/07/2021-20:00:59] [V] [TRT] node_of_300 [Unsqueeze] outputs: [300 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_301 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 299 [07/07/2021-20:00:59] [V] [TRT] node_of_301 [Unsqueeze] inputs: [299 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_301 for ONNX node: node_of_301 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 301 for ONNX tensor: 301 [07/07/2021-20:00:59] [V] [TRT] node_of_301 [Unsqueeze] outputs: [301 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_302 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 300 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 301 [07/07/2021-20:00:59] [V] [TRT] node_of_302 [Concat] inputs: [300 -> (1)], [301 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_302 for ONNX node: node_of_302 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 302 for ONNX tensor: 302 [07/07/2021-20:00:59] [V] [TRT] node_of_302 [Concat] outputs: [302 -> (2)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_303 [Reshape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 287 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 302 [07/07/2021-20:00:59] [V] [TRT] node_of_303 [Reshape] inputs: [287 -> (2, 3, 13, 13)], [302 -> (2)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_303 for ONNX node: node_of_303 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 303 for ONNX tensor: 303 [07/07/2021-20:00:59] [V] [TRT] node_of_303 [Reshape] outputs: [303 -> (2, 507)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_304 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 244 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 264 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 284 [07/07/2021-20:00:59] [V] [TRT] node_of_304 [Concat] inputs: [244 -> (2, 1, 13, 13)], [264 -> (2, 1, 13, 13)], [284 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_304 for ONNX node: node_of_304 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 304 for ONNX tensor: 304 [07/07/2021-20:00:59] [V] [TRT] node_of_304 [Concat] outputs: [304 -> (2, 3, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_305 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_305 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_305 for ONNX node: node_of_305 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 305 for ONNX tensor: 305 [07/07/2021-20:00:59] [V] [TRT] node_of_305 [Shape] outputs: [305 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_306 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_306 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_306 [Constant] outputs: [306 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_307 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 305 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 306 [07/07/2021-20:00:59] [V] [TRT] node_of_307 [Gather] inputs: [305 -> (4)], [306 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 306 for ONNX node: 306 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_307 for ONNX node: node_of_307 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 307 for ONNX tensor: 307 [07/07/2021-20:00:59] [V] [TRT] node_of_307 [Gather] outputs: [307 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_308 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_308 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_308 for ONNX node: node_of_308 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 308 for ONNX tensor: 308 [07/07/2021-20:00:59] [V] [TRT] node_of_308 [Shape] outputs: [308 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_309 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_309 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_309 [Constant] outputs: [309 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_310 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 308 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 309 [07/07/2021-20:00:59] [V] [TRT] node_of_310 [Gather] inputs: [308 -> (4)], [309 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 309 for ONNX node: 309 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_310 for ONNX node: node_of_310 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 310 for ONNX tensor: 310 [07/07/2021-20:00:59] [V] [TRT] node_of_310 [Gather] outputs: [310 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_311 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_311 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_311 for ONNX node: node_of_311 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 311 for ONNX tensor: 311 [07/07/2021-20:00:59] [V] [TRT] node_of_311 [Shape] outputs: [311 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_312 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_312 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_312 [Constant] outputs: [312 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_313 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 311 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 312 [07/07/2021-20:00:59] [V] [TRT] node_of_313 [Gather] inputs: [311 -> (4)], [312 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 312 for ONNX node: 312 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_313 for ONNX node: node_of_313 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 313 for ONNX tensor: 313 [07/07/2021-20:00:59] [V] [TRT] node_of_313 [Gather] outputs: [313 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_314 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 310 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 313 [07/07/2021-20:00:59] [V] [TRT] node_of_314 [Mul] inputs: [310 -> ()], [313 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_314 for ONNX node: node_of_314 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 314 for ONNX tensor: 314 [07/07/2021-20:00:59] [V] [TRT] node_of_314 [Mul] outputs: [314 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_317 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 307 [07/07/2021-20:00:59] [V] [TRT] node_of_317 [Unsqueeze] inputs: [307 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_317 for ONNX node: node_of_317 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 317 for ONNX tensor: 317 [07/07/2021-20:00:59] [V] [TRT] node_of_317 [Unsqueeze] outputs: [317 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_320 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 314 [07/07/2021-20:00:59] [V] [TRT] node_of_320 [Unsqueeze] inputs: [314 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_320 for ONNX node: node_of_320 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 320 for ONNX tensor: 320 [07/07/2021-20:00:59] [V] [TRT] node_of_320 [Unsqueeze] outputs: [320 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_321 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 317 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 1034 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 1035 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 320 [07/07/2021-20:00:59] [V] [TRT] node_of_321 [Concat] inputs: [317 -> (1)], [1034 -> (1)], [1035 -> (1)], [320 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 1034 for ONNX node: 1034 [07/07/2021-20:00:59] [V] [TRT] Registering layer: 1035 for ONNX node: 1035 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_321 for ONNX node: node_of_321 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 321 for ONNX tensor: 321 [07/07/2021-20:00:59] [V] [TRT] node_of_321 [Concat] outputs: [321 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_322 [Reshape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 304 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 321 [07/07/2021-20:00:59] [V] [TRT] node_of_322 [Reshape] inputs: [304 -> (2, 3, 13, 13)], [321 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_322 for ONNX node: node_of_322 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 322 for ONNX tensor: 322 [07/07/2021-20:00:59] [V] [TRT] node_of_322 [Reshape] outputs: [322 -> (2, 3, 1, 169)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_323 [Transpose] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 322 [07/07/2021-20:00:59] [V] [TRT] node_of_323 [Transpose] inputs: [322 -> (2, 3, 1, 169)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_323 for ONNX node: node_of_323 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 323 for ONNX tensor: 323 [07/07/2021-20:00:59] [V] [TRT] node_of_323 [Transpose] outputs: [323 -> (2, 3, 169, 1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_324 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_324 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_324 for ONNX node: node_of_324 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 324 for ONNX tensor: 324 [07/07/2021-20:00:59] [V] [TRT] node_of_324 [Shape] outputs: [324 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_325 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_325 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_325 [Constant] outputs: [325 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_326 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 324 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 325 [07/07/2021-20:00:59] [V] [TRT] node_of_326 [Gather] inputs: [324 -> (4)], [325 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 325 for ONNX node: 325 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_326 for ONNX node: node_of_326 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 326 for ONNX tensor: 326 [07/07/2021-20:00:59] [V] [TRT] node_of_326 [Gather] outputs: [326 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_327 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_327 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_327 for ONNX node: node_of_327 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 327 for ONNX tensor: 327 [07/07/2021-20:00:59] [V] [TRT] node_of_327 [Shape] outputs: [327 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_328 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_328 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_328 [Constant] outputs: [328 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_329 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 327 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 328 [07/07/2021-20:00:59] [V] [TRT] node_of_329 [Gather] inputs: [327 -> (4)], [328 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 328 for ONNX node: 328 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_329 for ONNX node: node_of_329 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 329 for ONNX tensor: 329 [07/07/2021-20:00:59] [V] [TRT] node_of_329 [Gather] outputs: [329 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_330 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_330 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_330 [Constant] outputs: [330 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_331 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 329 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 330 [07/07/2021-20:00:59] [V] [TRT] node_of_331 [Mul] inputs: [329 -> ()], [330 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 330 for ONNX node: 330 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_331 for ONNX node: node_of_331 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 331 for ONNX tensor: 331 [07/07/2021-20:00:59] [V] [TRT] node_of_331 [Mul] outputs: [331 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_332 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_332 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_332 for ONNX node: node_of_332 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 332 for ONNX tensor: 332 [07/07/2021-20:00:59] [V] [TRT] node_of_332 [Shape] outputs: [332 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_333 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_333 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_333 [Constant] outputs: [333 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_334 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 332 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 333 [07/07/2021-20:00:59] [V] [TRT] node_of_334 [Gather] inputs: [332 -> (4)], [333 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 333 for ONNX node: 333 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_334 for ONNX node: node_of_334 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 334 for ONNX tensor: 334 [07/07/2021-20:00:59] [V] [TRT] node_of_334 [Gather] outputs: [334 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_335 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 331 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 334 [07/07/2021-20:00:59] [V] [TRT] node_of_335 [Mul] inputs: [331 -> ()], [334 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_335 for ONNX node: node_of_335 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 335 for ONNX tensor: 335 [07/07/2021-20:00:59] [V] [TRT] node_of_335 [Mul] outputs: [335 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_337 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 326 [07/07/2021-20:00:59] [V] [TRT] node_of_337 [Unsqueeze] inputs: [326 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_337 for ONNX node: node_of_337 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 337 for ONNX tensor: 337 [07/07/2021-20:00:59] [V] [TRT] node_of_337 [Unsqueeze] outputs: [337 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_338 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 335 [07/07/2021-20:00:59] [V] [TRT] node_of_338 [Unsqueeze] inputs: [335 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_338 for ONNX node: node_of_338 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 338 for ONNX tensor: 338 [07/07/2021-20:00:59] [V] [TRT] node_of_338 [Unsqueeze] outputs: [338 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_340 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 337 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 338 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 1036 [07/07/2021-20:00:59] [V] [TRT] node_of_340 [Concat] inputs: [337 -> (1)], [338 -> (1)], [1036 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 1036 for ONNX node: 1036 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_340 for ONNX node: node_of_340 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 340 for ONNX tensor: 340 [07/07/2021-20:00:59] [V] [TRT] node_of_340 [Concat] outputs: [340 -> (3)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_341 [Reshape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 323 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 340 [07/07/2021-20:00:59] [V] [TRT] node_of_341 [Reshape] inputs: [323 -> (2, 3, 169, 1)], [340 -> (3)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_341 for ONNX node: node_of_341 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 341 for ONNX tensor: 341 [07/07/2021-20:00:59] [V] [TRT] node_of_341 [Reshape] outputs: [341 -> (2, 507, 1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_342 [Sigmoid] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 285 [07/07/2021-20:00:59] [V] [TRT] node_of_342 [Sigmoid] inputs: [285 -> (2, 6, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_342 for ONNX node: node_of_342 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 342 for ONNX tensor: 342 [07/07/2021-20:00:59] [V] [TRT] node_of_342 [Sigmoid] outputs: [342 -> (2, 6, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_343 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_343 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_343 [Constant] outputs: [343 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_344 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 342 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 343 [07/07/2021-20:00:59] [V] [TRT] node_of_344 [Mul] inputs: [342 -> (2, 6, 13, 13)], [343 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 343 for ONNX node: 343 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_344 for ONNX node: node_of_344 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 344 for ONNX tensor: 344 [07/07/2021-20:00:59] [V] [TRT] node_of_344 [Mul] outputs: [344 -> (2, 6, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_345 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_345 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_345 [Constant] outputs: [345 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_346 [Sub] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 344 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 345 [07/07/2021-20:00:59] [V] [TRT] node_of_346 [Sub] inputs: [344 -> (2, 6, 13, 13)], [345 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 345 for ONNX node: 345 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_346 for ONNX node: node_of_346 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 346 for ONNX tensor: 346 [07/07/2021-20:00:59] [V] [TRT] node_of_346 [Sub] outputs: [346 -> (2, 6, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_347 [Exp] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 286 [07/07/2021-20:00:59] [V] [TRT] node_of_347 [Exp] inputs: [286 -> (2, 6, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_347 for ONNX node: node_of_347 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 347 for ONNX tensor: 347 [07/07/2021-20:00:59] [V] [TRT] node_of_347 [Exp] outputs: [347 -> (2, 6, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_348 [Sigmoid] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 303 [07/07/2021-20:00:59] [V] [TRT] node_of_348 [Sigmoid] inputs: [303 -> (2, 507)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_348 for ONNX node: node_of_348 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 348 for ONNX tensor: 348 [07/07/2021-20:00:59] [V] [TRT] node_of_348 [Sigmoid] outputs: [348 -> (2, 507)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_349 [Sigmoid] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 341 [07/07/2021-20:00:59] [V] [TRT] node_of_349 [Sigmoid] inputs: [341 -> (2, 507, 1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_349 for ONNX node: node_of_349 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 349 for ONNX tensor: 349 [07/07/2021-20:00:59] [V] [TRT] node_of_349 [Sigmoid] outputs: [349 -> (2, 507, 1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_350 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_350 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_350 [Constant] outputs: [350 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_351 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_351 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_351 [Constant] outputs: [351 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_352 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_352 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_352 [Constant] outputs: [352 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_353 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_353 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_353 [Constant] outputs: [353 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_354 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 346 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 351 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 352 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 350 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 353 [07/07/2021-20:00:59] [V] [TRT] node_of_354 [Slice] inputs: [346 -> (2, 6, 13, 13)], [351 -> (1)], [352 -> (1)], [350 -> (1)], [353 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_354 for ONNX node: node_of_354 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 354 for ONNX tensor: 354 [07/07/2021-20:00:59] [V] [TRT] node_of_354 [Slice] outputs: [354 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_355 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_355 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_355 [Constant] outputs: [355 -> (1, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_356 [Add] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 354 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 355 [07/07/2021-20:00:59] [V] [TRT] node_of_356 [Add] inputs: [354 -> (2, 1, 13, 13)], [355 -> (1, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 355 for ONNX node: 355 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_356 for ONNX node: node_of_356 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 356 for ONNX tensor: 356 [07/07/2021-20:00:59] [V] [TRT] node_of_356 [Add] outputs: [356 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_357 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_357 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_357 [Constant] outputs: [357 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_358 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_358 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_358 [Constant] outputs: [358 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_359 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_359 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_359 [Constant] outputs: [359 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_360 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_360 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_360 [Constant] outputs: [360 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_361 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 346 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 358 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 359 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 357 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 360 [07/07/2021-20:00:59] [V] [TRT] node_of_361 [Slice] inputs: [346 -> (2, 6, 13, 13)], [358 -> (1)], [359 -> (1)], [357 -> (1)], [360 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_361 for ONNX node: node_of_361 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 361 for ONNX tensor: 361 [07/07/2021-20:00:59] [V] [TRT] node_of_361 [Slice] outputs: [361 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_362 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_362 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_362 [Constant] outputs: [362 -> (1, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_363 [Add] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 361 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 362 [07/07/2021-20:00:59] [V] [TRT] node_of_363 [Add] inputs: [361 -> (2, 1, 13, 13)], [362 -> (1, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 362 for ONNX node: 362 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_363 for ONNX node: node_of_363 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 363 for ONNX tensor: 363 [07/07/2021-20:00:59] [V] [TRT] node_of_363 [Add] outputs: [363 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_364 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_364 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_364 [Constant] outputs: [364 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_365 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_365 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_365 [Constant] outputs: [365 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_366 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_366 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_366 [Constant] outputs: [366 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_367 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_367 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_367 [Constant] outputs: [367 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_368 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 347 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 365 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 366 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 364 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 367 [07/07/2021-20:00:59] [V] [TRT] node_of_368 [Slice] inputs: [347 -> (2, 6, 13, 13)], [365 -> (1)], [366 -> (1)], [364 -> (1)], [367 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_368 for ONNX node: node_of_368 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 368 for ONNX tensor: 368 [07/07/2021-20:00:59] [V] [TRT] node_of_368 [Slice] outputs: [368 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_369 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_369 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_369 [Constant] outputs: [369 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_370 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 368 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 369 [07/07/2021-20:00:59] [V] [TRT] node_of_370 [Mul] inputs: [368 -> (2, 1, 13, 13)], [369 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 369 for ONNX node: 369 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_370 for ONNX node: node_of_370 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 370 for ONNX tensor: 370 [07/07/2021-20:00:59] [V] [TRT] node_of_370 [Mul] outputs: [370 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_371 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_371 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_371 [Constant] outputs: [371 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_372 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_372 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_372 [Constant] outputs: [372 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_373 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_373 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_373 [Constant] outputs: [373 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_374 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_374 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_374 [Constant] outputs: [374 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_375 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 347 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 372 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 373 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 371 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 374 [07/07/2021-20:00:59] [V] [TRT] node_of_375 [Slice] inputs: [347 -> (2, 6, 13, 13)], [372 -> (1)], [373 -> (1)], [371 -> (1)], [374 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_375 for ONNX node: node_of_375 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 375 for ONNX tensor: 375 [07/07/2021-20:00:59] [V] [TRT] node_of_375 [Slice] outputs: [375 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_376 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_376 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_376 [Constant] outputs: [376 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_377 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 375 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 376 [07/07/2021-20:00:59] [V] [TRT] node_of_377 [Mul] inputs: [375 -> (2, 1, 13, 13)], [376 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 376 for ONNX node: 376 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_377 for ONNX node: node_of_377 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 377 for ONNX tensor: 377 [07/07/2021-20:00:59] [V] [TRT] node_of_377 [Mul] outputs: [377 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_378 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_378 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_378 [Constant] outputs: [378 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_379 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_379 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_379 [Constant] outputs: [379 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_380 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_380 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_380 [Constant] outputs: [380 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_381 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_381 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_381 [Constant] outputs: [381 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_382 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 346 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 379 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 380 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 378 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 381 [07/07/2021-20:00:59] [V] [TRT] node_of_382 [Slice] inputs: [346 -> (2, 6, 13, 13)], [379 -> (1)], [380 -> (1)], [378 -> (1)], [381 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_382 for ONNX node: node_of_382 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 382 for ONNX tensor: 382 [07/07/2021-20:00:59] [V] [TRT] node_of_382 [Slice] outputs: [382 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_383 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_383 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_383 [Constant] outputs: [383 -> (1, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_384 [Add] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 382 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 383 [07/07/2021-20:00:59] [V] [TRT] node_of_384 [Add] inputs: [382 -> (2, 1, 13, 13)], [383 -> (1, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 383 for ONNX node: 383 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_384 for ONNX node: node_of_384 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 384 for ONNX tensor: 384 [07/07/2021-20:00:59] [V] [TRT] node_of_384 [Add] outputs: [384 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_385 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_385 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_385 [Constant] outputs: [385 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_386 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_386 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_386 [Constant] outputs: [386 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_387 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_387 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_387 [Constant] outputs: [387 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_388 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_388 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_388 [Constant] outputs: [388 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_389 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 346 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 386 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 387 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 385 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 388 [07/07/2021-20:00:59] [V] [TRT] node_of_389 [Slice] inputs: [346 -> (2, 6, 13, 13)], [386 -> (1)], [387 -> (1)], [385 -> (1)], [388 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_389 for ONNX node: node_of_389 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 389 for ONNX tensor: 389 [07/07/2021-20:00:59] [V] [TRT] node_of_389 [Slice] outputs: [389 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_390 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_390 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_390 [Constant] outputs: [390 -> (1, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_391 [Add] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 389 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 390 [07/07/2021-20:00:59] [V] [TRT] node_of_391 [Add] inputs: [389 -> (2, 1, 13, 13)], [390 -> (1, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 390 for ONNX node: 390 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_391 for ONNX node: node_of_391 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 391 for ONNX tensor: 391 [07/07/2021-20:00:59] [V] [TRT] node_of_391 [Add] outputs: [391 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_392 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_392 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_392 [Constant] outputs: [392 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_393 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_393 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_393 [Constant] outputs: [393 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_394 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_394 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_394 [Constant] outputs: [394 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_395 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_395 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_395 [Constant] outputs: [395 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_396 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 347 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 393 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 394 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 392 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 395 [07/07/2021-20:00:59] [V] [TRT] node_of_396 [Slice] inputs: [347 -> (2, 6, 13, 13)], [393 -> (1)], [394 -> (1)], [392 -> (1)], [395 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_396 for ONNX node: node_of_396 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 396 for ONNX tensor: 396 [07/07/2021-20:00:59] [V] [TRT] node_of_396 [Slice] outputs: [396 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_397 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_397 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_397 [Constant] outputs: [397 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_398 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 396 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 397 [07/07/2021-20:00:59] [V] [TRT] node_of_398 [Mul] inputs: [396 -> (2, 1, 13, 13)], [397 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 397 for ONNX node: 397 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_398 for ONNX node: node_of_398 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 398 for ONNX tensor: 398 [07/07/2021-20:00:59] [V] [TRT] node_of_398 [Mul] outputs: [398 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_399 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_399 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_399 [Constant] outputs: [399 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_400 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_400 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_400 [Constant] outputs: [400 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_401 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_401 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_401 [Constant] outputs: [401 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_402 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_402 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_402 [Constant] outputs: [402 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_403 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 347 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 400 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 401 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 399 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 402 [07/07/2021-20:00:59] [V] [TRT] node_of_403 [Slice] inputs: [347 -> (2, 6, 13, 13)], [400 -> (1)], [401 -> (1)], [399 -> (1)], [402 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_403 for ONNX node: node_of_403 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 403 for ONNX tensor: 403 [07/07/2021-20:00:59] [V] [TRT] node_of_403 [Slice] outputs: [403 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_404 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_404 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_404 [Constant] outputs: [404 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_405 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 403 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 404 [07/07/2021-20:00:59] [V] [TRT] node_of_405 [Mul] inputs: [403 -> (2, 1, 13, 13)], [404 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 404 for ONNX node: 404 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_405 for ONNX node: node_of_405 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 405 for ONNX tensor: 405 [07/07/2021-20:00:59] [V] [TRT] node_of_405 [Mul] outputs: [405 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_406 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_406 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_406 [Constant] outputs: [406 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_407 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_407 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_407 [Constant] outputs: [407 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_408 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_408 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_408 [Constant] outputs: [408 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_409 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_409 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_409 [Constant] outputs: [409 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_410 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 346 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 407 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 408 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 406 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 409 [07/07/2021-20:00:59] [V] [TRT] node_of_410 [Slice] inputs: [346 -> (2, 6, 13, 13)], [407 -> (1)], [408 -> (1)], [406 -> (1)], [409 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_410 for ONNX node: node_of_410 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 410 for ONNX tensor: 410 [07/07/2021-20:00:59] [V] [TRT] node_of_410 [Slice] outputs: [410 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_411 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_411 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_411 [Constant] outputs: [411 -> (1, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_412 [Add] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 410 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 411 [07/07/2021-20:00:59] [V] [TRT] node_of_412 [Add] inputs: [410 -> (2, 1, 13, 13)], [411 -> (1, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 411 for ONNX node: 411 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_412 for ONNX node: node_of_412 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 412 for ONNX tensor: 412 [07/07/2021-20:00:59] [V] [TRT] node_of_412 [Add] outputs: [412 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_413 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_413 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_413 [Constant] outputs: [413 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_414 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_414 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_414 [Constant] outputs: [414 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_415 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_415 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_415 [Constant] outputs: [415 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_416 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_416 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_416 [Constant] outputs: [416 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_417 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 346 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 414 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 415 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 413 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 416 [07/07/2021-20:00:59] [V] [TRT] node_of_417 [Slice] inputs: [346 -> (2, 6, 13, 13)], [414 -> (1)], [415 -> (1)], [413 -> (1)], [416 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_417 for ONNX node: node_of_417 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 417 for ONNX tensor: 417 [07/07/2021-20:00:59] [V] [TRT] node_of_417 [Slice] outputs: [417 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_418 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_418 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_418 [Constant] outputs: [418 -> (1, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_419 [Add] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 417 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 418 [07/07/2021-20:00:59] [V] [TRT] node_of_419 [Add] inputs: [417 -> (2, 1, 13, 13)], [418 -> (1, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 418 for ONNX node: 418 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_419 for ONNX node: node_of_419 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 419 for ONNX tensor: 419 [07/07/2021-20:00:59] [V] [TRT] node_of_419 [Add] outputs: [419 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_420 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_420 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_420 [Constant] outputs: [420 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_421 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_421 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_421 [Constant] outputs: [421 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_422 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_422 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_422 [Constant] outputs: [422 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_423 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_423 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_423 [Constant] outputs: [423 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_424 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 347 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 421 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 422 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 420 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 423 [07/07/2021-20:00:59] [V] [TRT] node_of_424 [Slice] inputs: [347 -> (2, 6, 13, 13)], [421 -> (1)], [422 -> (1)], [420 -> (1)], [423 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_424 for ONNX node: node_of_424 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 424 for ONNX tensor: 424 [07/07/2021-20:00:59] [V] [TRT] node_of_424 [Slice] outputs: [424 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_425 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_425 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_425 [Constant] outputs: [425 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_426 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 424 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 425 [07/07/2021-20:00:59] [V] [TRT] node_of_426 [Mul] inputs: [424 -> (2, 1, 13, 13)], [425 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 425 for ONNX node: 425 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_426 for ONNX node: node_of_426 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 426 for ONNX tensor: 426 [07/07/2021-20:00:59] [V] [TRT] node_of_426 [Mul] outputs: [426 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_427 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_427 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_427 [Constant] outputs: [427 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_428 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_428 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_428 [Constant] outputs: [428 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_429 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_429 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_429 [Constant] outputs: [429 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_430 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_430 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_430 [Constant] outputs: [430 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_431 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 347 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 428 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 429 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 427 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 430 [07/07/2021-20:00:59] [V] [TRT] node_of_431 [Slice] inputs: [347 -> (2, 6, 13, 13)], [428 -> (1)], [429 -> (1)], [427 -> (1)], [430 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_431 for ONNX node: node_of_431 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 431 for ONNX tensor: 431 [07/07/2021-20:00:59] [V] [TRT] node_of_431 [Slice] outputs: [431 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_432 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_432 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_432 [Constant] outputs: [432 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_433 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 431 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 432 [07/07/2021-20:00:59] [V] [TRT] node_of_433 [Mul] inputs: [431 -> (2, 1, 13, 13)], [432 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 432 for ONNX node: 432 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_433 for ONNX node: node_of_433 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 433 for ONNX tensor: 433 [07/07/2021-20:00:59] [V] [TRT] node_of_433 [Mul] outputs: [433 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_434 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 356 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 384 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 412 [07/07/2021-20:00:59] [V] [TRT] node_of_434 [Concat] inputs: [356 -> (2, 1, 13, 13)], [384 -> (2, 1, 13, 13)], [412 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_434 for ONNX node: node_of_434 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 434 for ONNX tensor: 434 [07/07/2021-20:00:59] [V] [TRT] node_of_434 [Concat] outputs: [434 -> (2, 3, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_435 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 363 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 391 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 419 [07/07/2021-20:00:59] [V] [TRT] node_of_435 [Concat] inputs: [363 -> (2, 1, 13, 13)], [391 -> (2, 1, 13, 13)], [419 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_435 for ONNX node: node_of_435 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 435 for ONNX tensor: 435 [07/07/2021-20:00:59] [V] [TRT] node_of_435 [Concat] outputs: [435 -> (2, 3, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_436 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 370 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 398 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 426 [07/07/2021-20:00:59] [V] [TRT] node_of_436 [Concat] inputs: [370 -> (2, 1, 13, 13)], [398 -> (2, 1, 13, 13)], [426 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_436 for ONNX node: node_of_436 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 436 for ONNX tensor: 436 [07/07/2021-20:00:59] [V] [TRT] node_of_436 [Concat] outputs: [436 -> (2, 3, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_437 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 377 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 405 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 433 [07/07/2021-20:00:59] [V] [TRT] node_of_437 [Concat] inputs: [377 -> (2, 1, 13, 13)], [405 -> (2, 1, 13, 13)], [433 -> (2, 1, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_437 for ONNX node: node_of_437 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 437 for ONNX tensor: 437 [07/07/2021-20:00:59] [V] [TRT] node_of_437 [Concat] outputs: [437 -> (2, 3, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_438 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 434 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 436 [07/07/2021-20:00:59] [V] [TRT] node_of_438 [Concat] inputs: [434 -> (2, 3, 13, 13)], [436 -> (2, 3, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_438 for ONNX node: node_of_438 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 438 for ONNX tensor: 438 [07/07/2021-20:00:59] [V] [TRT] node_of_438 [Concat] outputs: [438 -> (2, 6, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_439 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 435 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 437 [07/07/2021-20:00:59] [V] [TRT] node_of_439 [Concat] inputs: [435 -> (2, 3, 13, 13)], [437 -> (2, 3, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_439 for ONNX node: node_of_439 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 439 for ONNX tensor: 439 [07/07/2021-20:00:59] [V] [TRT] node_of_439 [Concat] outputs: [439 -> (2, 6, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_440 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_440 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_440 for ONNX node: node_of_440 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 440 for ONNX tensor: 440 [07/07/2021-20:00:59] [V] [TRT] node_of_440 [Shape] outputs: [440 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_441 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_441 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_441 [Constant] outputs: [441 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_442 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 440 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 441 [07/07/2021-20:00:59] [V] [TRT] node_of_442 [Gather] inputs: [440 -> (4)], [441 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 441 for ONNX node: 441 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_442 for ONNX node: node_of_442 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 442 for ONNX tensor: 442 [07/07/2021-20:00:59] [V] [TRT] node_of_442 [Gather] outputs: [442 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_443 [Cast] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 442 [07/07/2021-20:00:59] [V] [TRT] node_of_443 [Cast] inputs: [442 -> ()], [07/07/2021-20:00:59] [V] [TRT] Casting to type: float32 [07/07/2021-20:00:59] [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_443 for ONNX node: node_of_443 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 443 for ONNX tensor: 443 [07/07/2021-20:00:59] [V] [TRT] node_of_443 [Cast] outputs: [443 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_444 [Div] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 438 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 443 [07/07/2021-20:00:59] [V] [TRT] node_of_444 [Div] inputs: [438 -> (2, 6, 13, 13)], [443 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_444 for ONNX node: node_of_444 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 444 for ONNX tensor: 444 [07/07/2021-20:00:59] [V] [TRT] node_of_444 [Div] outputs: [444 -> (2, 6, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_445 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_445 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_445 for ONNX node: node_of_445 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 445 for ONNX tensor: 445 [07/07/2021-20:00:59] [V] [TRT] node_of_445 [Shape] outputs: [445 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_446 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_446 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_446 [Constant] outputs: [446 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_447 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 445 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 446 [07/07/2021-20:00:59] [V] [TRT] node_of_447 [Gather] inputs: [445 -> (4)], [446 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 446 for ONNX node: 446 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_447 for ONNX node: node_of_447 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 447 for ONNX tensor: 447 [07/07/2021-20:00:59] [V] [TRT] node_of_447 [Gather] outputs: [447 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_448 [Cast] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 447 [07/07/2021-20:00:59] [V] [TRT] node_of_448 [Cast] inputs: [447 -> ()], [07/07/2021-20:00:59] [V] [TRT] Casting to type: float32 [07/07/2021-20:00:59] [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_448 for ONNX node: node_of_448 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 448 for ONNX tensor: 448 [07/07/2021-20:00:59] [V] [TRT] node_of_448 [Cast] outputs: [448 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_449 [Div] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 439 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 448 [07/07/2021-20:00:59] [V] [TRT] node_of_449 [Div] inputs: [439 -> (2, 6, 13, 13)], [448 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_449 for ONNX node: node_of_449 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 449 for ONNX tensor: 449 [07/07/2021-20:00:59] [V] [TRT] node_of_449 [Div] outputs: [449 -> (2, 6, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_450 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_450 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_450 [Constant] outputs: [450 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_451 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_451 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_451 [Constant] outputs: [451 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_452 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_452 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_452 [Constant] outputs: [452 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_453 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_453 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_453 [Constant] outputs: [453 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_454 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 444 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 451 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 452 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 450 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 453 [07/07/2021-20:00:59] [V] [TRT] node_of_454 [Slice] inputs: [444 -> (2, 6, 13, 13)], [451 -> (1)], [452 -> (1)], [450 -> (1)], [453 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_454 for ONNX node: node_of_454 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 454 for ONNX tensor: 454 [07/07/2021-20:00:59] [V] [TRT] node_of_454 [Slice] outputs: [454 -> (2, 3, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_455 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_455 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_455 for ONNX node: node_of_455 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 455 for ONNX tensor: 455 [07/07/2021-20:00:59] [V] [TRT] node_of_455 [Shape] outputs: [455 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_456 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_456 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_456 [Constant] outputs: [456 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_457 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 455 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 456 [07/07/2021-20:00:59] [V] [TRT] node_of_457 [Gather] inputs: [455 -> (4)], [456 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 456 for ONNX node: 456 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_457 for ONNX node: node_of_457 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 457 for ONNX tensor: 457 [07/07/2021-20:00:59] [V] [TRT] node_of_457 [Gather] outputs: [457 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_458 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_458 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_458 for ONNX node: node_of_458 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 458 for ONNX tensor: 458 [07/07/2021-20:00:59] [V] [TRT] node_of_458 [Shape] outputs: [458 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_459 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_459 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_459 [Constant] outputs: [459 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_460 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 458 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 459 [07/07/2021-20:00:59] [V] [TRT] node_of_460 [Gather] inputs: [458 -> (4)], [459 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 459 for ONNX node: 459 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_460 for ONNX node: node_of_460 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 460 for ONNX tensor: 460 [07/07/2021-20:00:59] [V] [TRT] node_of_460 [Gather] outputs: [460 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_461 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_461 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_461 [Constant] outputs: [461 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_462 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 460 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 461 [07/07/2021-20:00:59] [V] [TRT] node_of_462 [Mul] inputs: [460 -> ()], [461 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 461 for ONNX node: 461 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_462 for ONNX node: node_of_462 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 462 for ONNX tensor: 462 [07/07/2021-20:00:59] [V] [TRT] node_of_462 [Mul] outputs: [462 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_463 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_463 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_463 for ONNX node: node_of_463 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 463 for ONNX tensor: 463 [07/07/2021-20:00:59] [V] [TRT] node_of_463 [Shape] outputs: [463 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_464 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_464 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_464 [Constant] outputs: [464 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_465 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 463 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 464 [07/07/2021-20:00:59] [V] [TRT] node_of_465 [Gather] inputs: [463 -> (4)], [464 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 464 for ONNX node: 464 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_465 for ONNX node: node_of_465 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 465 for ONNX tensor: 465 [07/07/2021-20:00:59] [V] [TRT] node_of_465 [Gather] outputs: [465 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_466 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 462 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 465 [07/07/2021-20:00:59] [V] [TRT] node_of_466 [Mul] inputs: [462 -> ()], [465 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_466 for ONNX node: node_of_466 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 466 for ONNX tensor: 466 [07/07/2021-20:00:59] [V] [TRT] node_of_466 [Mul] outputs: [466 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_468 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 457 [07/07/2021-20:00:59] [V] [TRT] node_of_468 [Unsqueeze] inputs: [457 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_468 for ONNX node: node_of_468 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 468 for ONNX tensor: 468 [07/07/2021-20:00:59] [V] [TRT] node_of_468 [Unsqueeze] outputs: [468 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_469 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 466 [07/07/2021-20:00:59] [V] [TRT] node_of_469 [Unsqueeze] inputs: [466 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_469 for ONNX node: node_of_469 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 469 for ONNX tensor: 469 [07/07/2021-20:00:59] [V] [TRT] node_of_469 [Unsqueeze] outputs: [469 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_471 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 468 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 469 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 1037 [07/07/2021-20:00:59] [V] [TRT] node_of_471 [Concat] inputs: [468 -> (1)], [469 -> (1)], [1037 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 1037 for ONNX node: 1037 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_471 for ONNX node: node_of_471 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 471 for ONNX tensor: 471 [07/07/2021-20:00:59] [V] [TRT] node_of_471 [Concat] outputs: [471 -> (3)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_472 [Reshape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 454 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 471 [07/07/2021-20:00:59] [V] [TRT] node_of_472 [Reshape] inputs: [454 -> (2, 3, 13, 13)], [471 -> (3)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_472 for ONNX node: node_of_472 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 472 for ONNX tensor: 472 [07/07/2021-20:00:59] [V] [TRT] node_of_472 [Reshape] outputs: [472 -> (2, 507, 1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_473 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_473 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_473 [Constant] outputs: [473 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_474 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_474 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_474 [Constant] outputs: [474 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_475 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_475 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_475 [Constant] outputs: [475 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_476 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_476 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_476 [Constant] outputs: [476 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_477 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 449 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 474 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 475 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 473 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 476 [07/07/2021-20:00:59] [V] [TRT] node_of_477 [Slice] inputs: [449 -> (2, 6, 13, 13)], [474 -> (1)], [475 -> (1)], [473 -> (1)], [476 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_477 for ONNX node: node_of_477 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 477 for ONNX tensor: 477 [07/07/2021-20:00:59] [V] [TRT] node_of_477 [Slice] outputs: [477 -> (2, 3, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_478 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_478 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_478 for ONNX node: node_of_478 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 478 for ONNX tensor: 478 [07/07/2021-20:00:59] [V] [TRT] node_of_478 [Shape] outputs: [478 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_479 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_479 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_479 [Constant] outputs: [479 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_480 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 478 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 479 [07/07/2021-20:00:59] [V] [TRT] node_of_480 [Gather] inputs: [478 -> (4)], [479 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 479 for ONNX node: 479 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_480 for ONNX node: node_of_480 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 480 for ONNX tensor: 480 [07/07/2021-20:00:59] [V] [TRT] node_of_480 [Gather] outputs: [480 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_481 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_481 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_481 for ONNX node: node_of_481 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 481 for ONNX tensor: 481 [07/07/2021-20:00:59] [V] [TRT] node_of_481 [Shape] outputs: [481 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_482 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_482 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_482 [Constant] outputs: [482 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_483 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 481 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 482 [07/07/2021-20:00:59] [V] [TRT] node_of_483 [Gather] inputs: [481 -> (4)], [482 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 482 for ONNX node: 482 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_483 for ONNX node: node_of_483 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 483 for ONNX tensor: 483 [07/07/2021-20:00:59] [V] [TRT] node_of_483 [Gather] outputs: [483 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_484 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_484 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_484 [Constant] outputs: [484 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_485 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 483 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 484 [07/07/2021-20:00:59] [V] [TRT] node_of_485 [Mul] inputs: [483 -> ()], [484 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 484 for ONNX node: 484 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_485 for ONNX node: node_of_485 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 485 for ONNX tensor: 485 [07/07/2021-20:00:59] [V] [TRT] node_of_485 [Mul] outputs: [485 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_486 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_486 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_486 for ONNX node: node_of_486 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 486 for ONNX tensor: 486 [07/07/2021-20:00:59] [V] [TRT] node_of_486 [Shape] outputs: [486 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_487 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_487 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_487 [Constant] outputs: [487 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_488 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 486 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 487 [07/07/2021-20:00:59] [V] [TRT] node_of_488 [Gather] inputs: [486 -> (4)], [487 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 487 for ONNX node: 487 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_488 for ONNX node: node_of_488 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 488 for ONNX tensor: 488 [07/07/2021-20:00:59] [V] [TRT] node_of_488 [Gather] outputs: [488 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_489 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 485 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 488 [07/07/2021-20:00:59] [V] [TRT] node_of_489 [Mul] inputs: [485 -> ()], [488 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_489 for ONNX node: node_of_489 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 489 for ONNX tensor: 489 [07/07/2021-20:00:59] [V] [TRT] node_of_489 [Mul] outputs: [489 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_491 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 480 [07/07/2021-20:00:59] [V] [TRT] node_of_491 [Unsqueeze] inputs: [480 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_491 for ONNX node: node_of_491 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 491 for ONNX tensor: 491 [07/07/2021-20:00:59] [V] [TRT] node_of_491 [Unsqueeze] outputs: [491 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_492 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 489 [07/07/2021-20:00:59] [V] [TRT] node_of_492 [Unsqueeze] inputs: [489 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_492 for ONNX node: node_of_492 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 492 for ONNX tensor: 492 [07/07/2021-20:00:59] [V] [TRT] node_of_492 [Unsqueeze] outputs: [492 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_494 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 491 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 492 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 1038 [07/07/2021-20:00:59] [V] [TRT] node_of_494 [Concat] inputs: [491 -> (1)], [492 -> (1)], [1038 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 1038 for ONNX node: 1038 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_494 for ONNX node: node_of_494 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 494 for ONNX tensor: 494 [07/07/2021-20:00:59] [V] [TRT] node_of_494 [Concat] outputs: [494 -> (3)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_495 [Reshape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 477 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 494 [07/07/2021-20:00:59] [V] [TRT] node_of_495 [Reshape] inputs: [477 -> (2, 3, 13, 13)], [494 -> (3)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_495 for ONNX node: node_of_495 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 495 for ONNX tensor: 495 [07/07/2021-20:00:59] [V] [TRT] node_of_495 [Reshape] outputs: [495 -> (2, 507, 1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_496 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_496 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_496 [Constant] outputs: [496 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_497 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_497 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_497 [Constant] outputs: [497 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_498 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_498 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/07/2021-20:00:59] [07/07/2021-20:00:59] [V] [TRT] node_of_498 [Constant] outputs: [498 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_499 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_499 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_499 [Constant] outputs: [499 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_500 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 444 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 497 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 498 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 496 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 499 [07/07/2021-20:00:59] [V] [TRT] node_of_500 [Slice] inputs: [444 -> (2, 6, 13, 13)], [497 -> (1)], [498 -> (1)], [496 -> (1)], [499 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_500 for ONNX node: node_of_500 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 500 for ONNX tensor: 500 [07/07/2021-20:00:59] [V] [TRT] node_of_500 [Slice] outputs: [500 -> (2, 3, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_501 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_501 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_501 for ONNX node: node_of_501 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 501 for ONNX tensor: 501 [07/07/2021-20:00:59] [V] [TRT] node_of_501 [Shape] outputs: [501 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_502 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_502 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_502 [Constant] outputs: [502 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_503 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 501 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 502 [07/07/2021-20:00:59] [V] [TRT] node_of_503 [Gather] inputs: [501 -> (4)], [502 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 502 for ONNX node: 502 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_503 for ONNX node: node_of_503 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 503 for ONNX tensor: 503 [07/07/2021-20:00:59] [V] [TRT] node_of_503 [Gather] outputs: [503 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_504 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_504 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_504 for ONNX node: node_of_504 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 504 for ONNX tensor: 504 [07/07/2021-20:00:59] [V] [TRT] node_of_504 [Shape] outputs: [504 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_505 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_505 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_505 [Constant] outputs: [505 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_506 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 504 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 505 [07/07/2021-20:00:59] [V] [TRT] node_of_506 [Gather] inputs: [504 -> (4)], [505 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 505 for ONNX node: 505 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_506 for ONNX node: node_of_506 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 506 for ONNX tensor: 506 [07/07/2021-20:00:59] [V] [TRT] node_of_506 [Gather] outputs: [506 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_507 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_507 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_507 [Constant] outputs: [507 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_508 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 506 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 507 [07/07/2021-20:00:59] [V] [TRT] node_of_508 [Mul] inputs: [506 -> ()], [507 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 507 for ONNX node: 507 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_508 for ONNX node: node_of_508 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 508 for ONNX tensor: 508 [07/07/2021-20:00:59] [V] [TRT] node_of_508 [Mul] outputs: [508 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_509 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_509 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_509 for ONNX node: node_of_509 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 509 for ONNX tensor: 509 [07/07/2021-20:00:59] [V] [TRT] node_of_509 [Shape] outputs: [509 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_510 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_510 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_510 [Constant] outputs: [510 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_511 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 509 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 510 [07/07/2021-20:00:59] [V] [TRT] node_of_511 [Gather] inputs: [509 -> (4)], [510 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 510 for ONNX node: 510 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_511 for ONNX node: node_of_511 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 511 for ONNX tensor: 511 [07/07/2021-20:00:59] [V] [TRT] node_of_511 [Gather] outputs: [511 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_512 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 508 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 511 [07/07/2021-20:00:59] [V] [TRT] node_of_512 [Mul] inputs: [508 -> ()], [511 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_512 for ONNX node: node_of_512 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 512 for ONNX tensor: 512 [07/07/2021-20:00:59] [V] [TRT] node_of_512 [Mul] outputs: [512 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_514 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 503 [07/07/2021-20:00:59] [V] [TRT] node_of_514 [Unsqueeze] inputs: [503 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_514 for ONNX node: node_of_514 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 514 for ONNX tensor: 514 [07/07/2021-20:00:59] [V] [TRT] node_of_514 [Unsqueeze] outputs: [514 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_515 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 512 [07/07/2021-20:00:59] [V] [TRT] node_of_515 [Unsqueeze] inputs: [512 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_515 for ONNX node: node_of_515 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 515 for ONNX tensor: 515 [07/07/2021-20:00:59] [V] [TRT] node_of_515 [Unsqueeze] outputs: [515 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_517 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 514 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 515 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 1039 [07/07/2021-20:00:59] [V] [TRT] node_of_517 [Concat] inputs: [514 -> (1)], [515 -> (1)], [1039 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 1039 for ONNX node: 1039 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_517 for ONNX node: node_of_517 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 517 for ONNX tensor: 517 [07/07/2021-20:00:59] [V] [TRT] node_of_517 [Concat] outputs: [517 -> (3)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_518 [Reshape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 500 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 517 [07/07/2021-20:00:59] [V] [TRT] node_of_518 [Reshape] inputs: [500 -> (2, 3, 13, 13)], [517 -> (3)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_518 for ONNX node: node_of_518 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 518 for ONNX tensor: 518 [07/07/2021-20:00:59] [V] [TRT] node_of_518 [Reshape] outputs: [518 -> (2, 507, 1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_519 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_519 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_519 [Constant] outputs: [519 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_520 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_520 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_520 [Constant] outputs: [520 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_521 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_521 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/07/2021-20:00:59] [07/07/2021-20:00:59] [V] [TRT] node_of_521 [Constant] outputs: [521 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_522 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_522 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_522 [Constant] outputs: [522 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_523 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 449 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 520 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 521 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 519 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 522 [07/07/2021-20:00:59] [V] [TRT] node_of_523 [Slice] inputs: [449 -> (2, 6, 13, 13)], [520 -> (1)], [521 -> (1)], [519 -> (1)], [522 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_523 for ONNX node: node_of_523 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 523 for ONNX tensor: 523 [07/07/2021-20:00:59] [V] [TRT] node_of_523 [Slice] outputs: [523 -> (2, 3, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_524 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_524 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_524 for ONNX node: node_of_524 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 524 for ONNX tensor: 524 [07/07/2021-20:00:59] [V] [TRT] node_of_524 [Shape] outputs: [524 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_525 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_525 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_525 [Constant] outputs: [525 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_526 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 524 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 525 [07/07/2021-20:00:59] [V] [TRT] node_of_526 [Gather] inputs: [524 -> (4)], [525 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 525 for ONNX node: 525 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_526 for ONNX node: node_of_526 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 526 for ONNX tensor: 526 [07/07/2021-20:00:59] [V] [TRT] node_of_526 [Gather] outputs: [526 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_527 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_527 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_527 for ONNX node: node_of_527 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 527 for ONNX tensor: 527 [07/07/2021-20:00:59] [V] [TRT] node_of_527 [Shape] outputs: [527 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_528 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_528 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_528 [Constant] outputs: [528 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_529 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 527 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 528 [07/07/2021-20:00:59] [V] [TRT] node_of_529 [Gather] inputs: [527 -> (4)], [528 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 528 for ONNX node: 528 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_529 for ONNX node: node_of_529 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 529 for ONNX tensor: 529 [07/07/2021-20:00:59] [V] [TRT] node_of_529 [Gather] outputs: [529 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_530 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_530 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_530 [Constant] outputs: [530 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_531 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 529 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 530 [07/07/2021-20:00:59] [V] [TRT] node_of_531 [Mul] inputs: [529 -> ()], [530 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 530 for ONNX node: 530 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_531 for ONNX node: node_of_531 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 531 for ONNX tensor: 531 [07/07/2021-20:00:59] [V] [TRT] node_of_531 [Mul] outputs: [531 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_532 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_532 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_532 for ONNX node: node_of_532 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 532 for ONNX tensor: 532 [07/07/2021-20:00:59] [V] [TRT] node_of_532 [Shape] outputs: [532 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_533 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_533 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_533 [Constant] outputs: [533 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_534 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 532 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 533 [07/07/2021-20:00:59] [V] [TRT] node_of_534 [Gather] inputs: [532 -> (4)], [533 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 533 for ONNX node: 533 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_534 for ONNX node: node_of_534 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 534 for ONNX tensor: 534 [07/07/2021-20:00:59] [V] [TRT] node_of_534 [Gather] outputs: [534 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_535 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 531 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 534 [07/07/2021-20:00:59] [V] [TRT] node_of_535 [Mul] inputs: [531 -> ()], [534 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_535 for ONNX node: node_of_535 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 535 for ONNX tensor: 535 [07/07/2021-20:00:59] [V] [TRT] node_of_535 [Mul] outputs: [535 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_537 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 526 [07/07/2021-20:00:59] [V] [TRT] node_of_537 [Unsqueeze] inputs: [526 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_537 for ONNX node: node_of_537 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 537 for ONNX tensor: 537 [07/07/2021-20:00:59] [V] [TRT] node_of_537 [Unsqueeze] outputs: [537 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_538 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 535 [07/07/2021-20:00:59] [V] [TRT] node_of_538 [Unsqueeze] inputs: [535 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_538 for ONNX node: node_of_538 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 538 for ONNX tensor: 538 [07/07/2021-20:00:59] [V] [TRT] node_of_538 [Unsqueeze] outputs: [538 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_540 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 537 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 538 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 1040 [07/07/2021-20:00:59] [V] [TRT] node_of_540 [Concat] inputs: [537 -> (1)], [538 -> (1)], [1040 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 1040 for ONNX node: 1040 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_540 for ONNX node: node_of_540 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 540 for ONNX tensor: 540 [07/07/2021-20:00:59] [V] [TRT] node_of_540 [Concat] outputs: [540 -> (3)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_541 [Reshape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 523 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 540 [07/07/2021-20:00:59] [V] [TRT] node_of_541 [Reshape] inputs: [523 -> (2, 3, 13, 13)], [540 -> (3)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_541 for ONNX node: node_of_541 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 541 for ONNX tensor: 541 [07/07/2021-20:00:59] [V] [TRT] node_of_541 [Reshape] outputs: [541 -> (2, 507, 1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_542 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_542 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_542 [Constant] outputs: [542 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_543 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 518 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 542 [07/07/2021-20:00:59] [V] [TRT] node_of_543 [Mul] inputs: [518 -> (2, 507, 1)], [542 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 542 for ONNX node: 542 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_543 for ONNX node: node_of_543 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 543 for ONNX tensor: 543 [07/07/2021-20:00:59] [V] [TRT] node_of_543 [Mul] outputs: [543 -> (2, 507, 1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_544 [Sub] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 472 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 543 [07/07/2021-20:00:59] [V] [TRT] node_of_544 [Sub] inputs: [472 -> (2, 507, 1)], [543 -> (2, 507, 1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_544 for ONNX node: node_of_544 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 544 for ONNX tensor: 544 [07/07/2021-20:00:59] [V] [TRT] node_of_544 [Sub] outputs: [544 -> (2, 507, 1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_545 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_545 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_545 [Constant] outputs: [545 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_546 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 541 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 545 [07/07/2021-20:00:59] [V] [TRT] node_of_546 [Mul] inputs: [541 -> (2, 507, 1)], [545 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 545 for ONNX node: 545 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_546 for ONNX node: node_of_546 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 546 for ONNX tensor: 546 [07/07/2021-20:00:59] [V] [TRT] node_of_546 [Mul] outputs: [546 -> (2, 507, 1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_547 [Sub] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 495 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 546 [07/07/2021-20:00:59] [V] [TRT] node_of_547 [Sub] inputs: [495 -> (2, 507, 1)], [546 -> (2, 507, 1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_547 for ONNX node: node_of_547 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 547 for ONNX tensor: 547 [07/07/2021-20:00:59] [V] [TRT] node_of_547 [Sub] outputs: [547 -> (2, 507, 1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_548 [Add] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 544 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 518 [07/07/2021-20:00:59] [V] [TRT] node_of_548 [Add] inputs: [544 -> (2, 507, 1)], [518 -> (2, 507, 1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_548 for ONNX node: node_of_548 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 548 for ONNX tensor: 548 [07/07/2021-20:00:59] [V] [TRT] node_of_548 [Add] outputs: [548 -> (2, 507, 1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_549 [Add] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 547 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 541 [07/07/2021-20:00:59] [V] [TRT] node_of_549 [Add] inputs: [547 -> (2, 507, 1)], [541 -> (2, 507, 1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_549 for ONNX node: node_of_549 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 549 for ONNX tensor: 549 [07/07/2021-20:00:59] [V] [TRT] node_of_549 [Add] outputs: [549 -> (2, 507, 1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_550 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 544 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 547 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 548 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 549 [07/07/2021-20:00:59] [V] [TRT] node_of_550 [Concat] inputs: [544 -> (2, 507, 1)], [547 -> (2, 507, 1)], [548 -> (2, 507, 1)], [549 -> (2, 507, 1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_550 for ONNX node: node_of_550 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 550 for ONNX tensor: 550 [07/07/2021-20:00:59] [V] [TRT] node_of_550 [Concat] outputs: [550 -> (2, 507, 4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_551 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_551 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_551 for ONNX node: node_of_551 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 551 for ONNX tensor: 551 [07/07/2021-20:00:59] [V] [TRT] node_of_551 [Shape] outputs: [551 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_552 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_552 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_552 [Constant] outputs: [552 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_553 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 551 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 552 [07/07/2021-20:00:59] [V] [TRT] node_of_553 [Gather] inputs: [551 -> (4)], [552 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 552 for ONNX node: 552 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_553 for ONNX node: node_of_553 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 553 for ONNX tensor: 553 [07/07/2021-20:00:59] [V] [TRT] node_of_553 [Gather] outputs: [553 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_554 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_554 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_554 for ONNX node: node_of_554 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 554 for ONNX tensor: 554 [07/07/2021-20:00:59] [V] [TRT] node_of_554 [Shape] outputs: [554 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_555 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_555 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_555 [Constant] outputs: [555 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_556 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 554 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 555 [07/07/2021-20:00:59] [V] [TRT] node_of_556 [Gather] inputs: [554 -> (4)], [555 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 555 for ONNX node: 555 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_556 for ONNX node: node_of_556 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 556 for ONNX tensor: 556 [07/07/2021-20:00:59] [V] [TRT] node_of_556 [Gather] outputs: [556 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_557 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_557 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_557 [Constant] outputs: [557 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_558 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 556 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 557 [07/07/2021-20:00:59] [V] [TRT] node_of_558 [Mul] inputs: [556 -> ()], [557 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 557 for ONNX node: 557 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_558 for ONNX node: node_of_558 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 558 for ONNX tensor: 558 [07/07/2021-20:00:59] [V] [TRT] node_of_558 [Mul] outputs: [558 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_559 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_559 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_559 for ONNX node: node_of_559 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 559 for ONNX tensor: 559 [07/07/2021-20:00:59] [V] [TRT] node_of_559 [Shape] outputs: [559 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_560 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_560 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_560 [Constant] outputs: [560 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_561 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 559 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 560 [07/07/2021-20:00:59] [V] [TRT] node_of_561 [Gather] inputs: [559 -> (4)], [560 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 560 for ONNX node: 560 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_561 for ONNX node: node_of_561 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 561 for ONNX tensor: 561 [07/07/2021-20:00:59] [V] [TRT] node_of_561 [Gather] outputs: [561 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_562 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 558 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 561 [07/07/2021-20:00:59] [V] [TRT] node_of_562 [Mul] inputs: [558 -> ()], [561 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_562 for ONNX node: node_of_562 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 562 for ONNX tensor: 562 [07/07/2021-20:00:59] [V] [TRT] node_of_562 [Mul] outputs: [562 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_565 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 553 [07/07/2021-20:00:59] [V] [TRT] node_of_565 [Unsqueeze] inputs: [553 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_565 for ONNX node: node_of_565 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 565 for ONNX tensor: 565 [07/07/2021-20:00:59] [V] [TRT] node_of_565 [Unsqueeze] outputs: [565 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_566 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 562 [07/07/2021-20:00:59] [V] [TRT] node_of_566 [Unsqueeze] inputs: [562 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_566 for ONNX node: node_of_566 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 566 for ONNX tensor: 566 [07/07/2021-20:00:59] [V] [TRT] node_of_566 [Unsqueeze] outputs: [566 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_569 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 565 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 566 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 1041 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 1042 [07/07/2021-20:00:59] [V] [TRT] node_of_569 [Concat] inputs: [565 -> (1)], [566 -> (1)], [1041 -> (1)], [1042 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 1041 for ONNX node: 1041 [07/07/2021-20:00:59] [V] [TRT] Registering layer: 1042 for ONNX node: 1042 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_569 for ONNX node: node_of_569 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 569 for ONNX tensor: 569 [07/07/2021-20:00:59] [V] [TRT] node_of_569 [Concat] outputs: [569 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_570 [Reshape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 550 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 569 [07/07/2021-20:00:59] [V] [TRT] node_of_570 [Reshape] inputs: [550 -> (2, 507, 4)], [569 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_570 for ONNX node: node_of_570 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 570 for ONNX tensor: 570 [07/07/2021-20:00:59] [V] [TRT] node_of_570 [Reshape] outputs: [570 -> (2, 507, 1, 4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_571 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_571 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_571 for ONNX node: node_of_571 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 571 for ONNX tensor: 571 [07/07/2021-20:00:59] [V] [TRT] node_of_571 [Shape] outputs: [571 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_572 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_572 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_572 [Constant] outputs: [572 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_573 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 571 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 572 [07/07/2021-20:00:59] [V] [TRT] node_of_573 [Gather] inputs: [571 -> (4)], [572 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 572 for ONNX node: 572 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_573 for ONNX node: node_of_573 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 573 for ONNX tensor: 573 [07/07/2021-20:00:59] [V] [TRT] node_of_573 [Gather] outputs: [573 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_574 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_574 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_574 for ONNX node: node_of_574 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 574 for ONNX tensor: 574 [07/07/2021-20:00:59] [V] [TRT] node_of_574 [Shape] outputs: [574 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_575 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_575 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_575 [Constant] outputs: [575 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_576 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 574 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 575 [07/07/2021-20:00:59] [V] [TRT] node_of_576 [Gather] inputs: [574 -> (4)], [575 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 575 for ONNX node: 575 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_576 for ONNX node: node_of_576 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 576 for ONNX tensor: 576 [07/07/2021-20:00:59] [V] [TRT] node_of_576 [Gather] outputs: [576 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_577 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_577 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_577 [Constant] outputs: [577 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_578 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 576 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 577 [07/07/2021-20:00:59] [V] [TRT] node_of_578 [Mul] inputs: [576 -> ()], [577 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 577 for ONNX node: 577 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_578 for ONNX node: node_of_578 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 578 for ONNX tensor: 578 [07/07/2021-20:00:59] [V] [TRT] node_of_578 [Mul] outputs: [578 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_579 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 224 [07/07/2021-20:00:59] [V] [TRT] node_of_579 [Shape] inputs: [224 -> (2, 18, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_579 for ONNX node: node_of_579 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 579 for ONNX tensor: 579 [07/07/2021-20:00:59] [V] [TRT] node_of_579 [Shape] outputs: [579 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_580 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_580 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_580 [Constant] outputs: [580 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_581 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 579 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 580 [07/07/2021-20:00:59] [V] [TRT] node_of_581 [Gather] inputs: [579 -> (4)], [580 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 580 for ONNX node: 580 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_581 for ONNX node: node_of_581 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 581 for ONNX tensor: 581 [07/07/2021-20:00:59] [V] [TRT] node_of_581 [Gather] outputs: [581 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_582 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 578 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 581 [07/07/2021-20:00:59] [V] [TRT] node_of_582 [Mul] inputs: [578 -> ()], [581 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_582 for ONNX node: node_of_582 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 582 for ONNX tensor: 582 [07/07/2021-20:00:59] [V] [TRT] node_of_582 [Mul] outputs: [582 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_584 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 573 [07/07/2021-20:00:59] [V] [TRT] node_of_584 [Unsqueeze] inputs: [573 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_584 for ONNX node: node_of_584 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 584 for ONNX tensor: 584 [07/07/2021-20:00:59] [V] [TRT] node_of_584 [Unsqueeze] outputs: [584 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_585 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 582 [07/07/2021-20:00:59] [V] [TRT] node_of_585 [Unsqueeze] inputs: [582 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_585 for ONNX node: node_of_585 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 585 for ONNX tensor: 585 [07/07/2021-20:00:59] [V] [TRT] node_of_585 [Unsqueeze] outputs: [585 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_587 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 584 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 585 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 1043 [07/07/2021-20:00:59] [V] [TRT] node_of_587 [Concat] inputs: [584 -> (1)], [585 -> (1)], [1043 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 1043 for ONNX node: 1043 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_587 for ONNX node: node_of_587 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 587 for ONNX tensor: 587 [07/07/2021-20:00:59] [V] [TRT] node_of_587 [Concat] outputs: [587 -> (3)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_588 [Reshape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 348 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 587 [07/07/2021-20:00:59] [V] [TRT] node_of_588 [Reshape] inputs: [348 -> (2, 507)], [587 -> (3)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_588 for ONNX node: node_of_588 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 588 for ONNX tensor: 588 [07/07/2021-20:00:59] [V] [TRT] node_of_588 [Reshape] outputs: [588 -> (2, 507, 1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_589 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 349 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 588 [07/07/2021-20:00:59] [V] [TRT] node_of_589 [Mul] inputs: [349 -> (2, 507, 1)], [588 -> (2, 507, 1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_589 for ONNX node: node_of_589 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 589 for ONNX tensor: 589 [07/07/2021-20:00:59] [V] [TRT] node_of_589 [Mul] outputs: [589 -> (2, 507, 1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_590 [Conv] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 220 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.32.conv19.weight [07/07/2021-20:00:59] [V] [TRT] node_of_590 [Conv] inputs: [220 -> (2, 256, 13, 13)], [models.32.conv19.weight -> (128, 256, 1, 1)], [07/07/2021-20:00:59] [V] [TRT] Convolution input dimensions: (2, 256, 13, 13) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_590 for ONNX node: node_of_590 [07/07/2021-20:00:59] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [07/07/2021-20:00:59] [V] [TRT] Convolution output dimensions: (2, 128, 13, 13) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 590 for ONNX tensor: 590 [07/07/2021-20:00:59] [V] [TRT] node_of_590 [Conv] outputs: [590 -> (2, 128, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_591 [BatchNormalization] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 590 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.32.bn19.weight [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.32.bn19.bias [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.32.bn19.running_mean [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.32.bn19.running_var [07/07/2021-20:00:59] [V] [TRT] node_of_591 [BatchNormalization] inputs: [590 -> (2, 128, 13, 13)], [models.32.bn19.weight -> (128)], [models.32.bn19.bias -> (128)], [models.32.bn19.running_mean -> (128)], [models.32.bn19.running_var -> (128)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_591 for ONNX node: node_of_591 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 591 for ONNX tensor: 591 [07/07/2021-20:00:59] [V] [TRT] node_of_591 [BatchNormalization] outputs: [591 -> (2, 128, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_592 [LeakyRelu] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 591 [07/07/2021-20:00:59] [V] [TRT] node_of_592 [LeakyRelu] inputs: [591 -> (2, 128, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_592 for ONNX node: node_of_592 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 592 for ONNX tensor: 592 [07/07/2021-20:00:59] [V] [TRT] node_of_592 [LeakyRelu] outputs: [592 -> (2, 128, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_593 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 592 [07/07/2021-20:00:59] [V] [TRT] node_of_593 [Shape] inputs: [592 -> (2, 128, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_593 for ONNX node: node_of_593 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 593 for ONNX tensor: 593 [07/07/2021-20:00:59] [V] [TRT] node_of_593 [Shape] outputs: [593 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_594 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_594 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_594 [Constant] outputs: [594 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_595 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 593 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 594 [07/07/2021-20:00:59] [V] [TRT] node_of_595 [Gather] inputs: [593 -> (4)], [594 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 594 for ONNX node: 594 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_595 for ONNX node: node_of_595 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 595 for ONNX tensor: 595 [07/07/2021-20:00:59] [V] [TRT] node_of_595 [Gather] outputs: [595 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_596 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 592 [07/07/2021-20:00:59] [V] [TRT] node_of_596 [Shape] inputs: [592 -> (2, 128, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_596 for ONNX node: node_of_596 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 596 for ONNX tensor: 596 [07/07/2021-20:00:59] [V] [TRT] node_of_596 [Shape] outputs: [596 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_597 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_597 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_597 [Constant] outputs: [597 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_598 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 596 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 597 [07/07/2021-20:00:59] [V] [TRT] node_of_598 [Gather] inputs: [596 -> (4)], [597 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 597 for ONNX node: 597 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_598 for ONNX node: node_of_598 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 598 for ONNX tensor: 598 [07/07/2021-20:00:59] [V] [TRT] node_of_598 [Gather] outputs: [598 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_599 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 592 [07/07/2021-20:00:59] [V] [TRT] node_of_599 [Shape] inputs: [592 -> (2, 128, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_599 for ONNX node: node_of_599 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 599 for ONNX tensor: 599 [07/07/2021-20:00:59] [V] [TRT] node_of_599 [Shape] outputs: [599 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_600 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_600 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_600 [Constant] outputs: [600 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_601 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 599 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 600 [07/07/2021-20:00:59] [V] [TRT] node_of_601 [Gather] inputs: [599 -> (4)], [600 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 600 for ONNX node: 600 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_601 for ONNX node: node_of_601 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 601 for ONNX tensor: 601 [07/07/2021-20:00:59] [V] [TRT] node_of_601 [Gather] outputs: [601 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_602 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 592 [07/07/2021-20:00:59] [V] [TRT] node_of_602 [Shape] inputs: [592 -> (2, 128, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_602 for ONNX node: node_of_602 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 602 for ONNX tensor: 602 [07/07/2021-20:00:59] [V] [TRT] node_of_602 [Shape] outputs: [602 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_603 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_603 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_603 [Constant] outputs: [603 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_604 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 602 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 603 [07/07/2021-20:00:59] [V] [TRT] node_of_604 [Gather] inputs: [602 -> (4)], [603 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 603 for ONNX node: 603 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_604 for ONNX node: node_of_604 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 604 for ONNX tensor: 604 [07/07/2021-20:00:59] [V] [TRT] node_of_604 [Gather] outputs: [604 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_607 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 595 [07/07/2021-20:00:59] [V] [TRT] node_of_607 [Unsqueeze] inputs: [595 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_607 for ONNX node: node_of_607 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 607 for ONNX tensor: 607 [07/07/2021-20:00:59] [V] [TRT] node_of_607 [Unsqueeze] outputs: [607 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_608 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 598 [07/07/2021-20:00:59] [V] [TRT] node_of_608 [Unsqueeze] inputs: [598 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_608 for ONNX node: node_of_608 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 608 for ONNX tensor: 608 [07/07/2021-20:00:59] [V] [TRT] node_of_608 [Unsqueeze] outputs: [608 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_609 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 601 [07/07/2021-20:00:59] [V] [TRT] node_of_609 [Unsqueeze] inputs: [601 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_609 for ONNX node: node_of_609 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 609 for ONNX tensor: 609 [07/07/2021-20:00:59] [V] [TRT] node_of_609 [Unsqueeze] outputs: [609 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_611 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 604 [07/07/2021-20:00:59] [V] [TRT] node_of_611 [Unsqueeze] inputs: [604 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_611 for ONNX node: node_of_611 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 611 for ONNX tensor: 611 [07/07/2021-20:00:59] [V] [TRT] node_of_611 [Unsqueeze] outputs: [611 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_613 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 607 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 608 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 609 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 1044 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 611 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 1045 [07/07/2021-20:00:59] [V] [TRT] node_of_613 [Concat] inputs: [607 -> (1)], [608 -> (1)], [609 -> (1)], [1044 -> (1)], [611 -> (1)], [1045 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 1044 for ONNX node: 1044 [07/07/2021-20:00:59] [V] [TRT] Registering layer: 1045 for ONNX node: 1045 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_613 for ONNX node: node_of_613 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 613 for ONNX tensor: 613 [07/07/2021-20:00:59] [V] [TRT] node_of_613 [Concat] outputs: [613 -> (6)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_614 [Reshape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 592 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 613 [07/07/2021-20:00:59] [V] [TRT] node_of_614 [Reshape] inputs: [592 -> (2, 128, 13, 13)], [613 -> (6)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_614 for ONNX node: node_of_614 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 614 for ONNX tensor: 614 [07/07/2021-20:00:59] [V] [TRT] node_of_614 [Reshape] outputs: [614 -> (2, 128, 13, 1, 13, 1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_615 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 592 [07/07/2021-20:00:59] [V] [TRT] node_of_615 [Shape] inputs: [592 -> (2, 128, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_615 for ONNX node: node_of_615 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 615 for ONNX tensor: 615 [07/07/2021-20:00:59] [V] [TRT] node_of_615 [Shape] outputs: [615 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_616 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_616 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_616 [Constant] outputs: [616 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_617 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 615 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 616 [07/07/2021-20:00:59] [V] [TRT] node_of_617 [Gather] inputs: [615 -> (4)], [616 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 616 for ONNX node: 616 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_617 for ONNX node: node_of_617 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 617 for ONNX tensor: 617 [07/07/2021-20:00:59] [V] [TRT] node_of_617 [Gather] outputs: [617 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_618 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 592 [07/07/2021-20:00:59] [V] [TRT] node_of_618 [Shape] inputs: [592 -> (2, 128, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_618 for ONNX node: node_of_618 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 618 for ONNX tensor: 618 [07/07/2021-20:00:59] [V] [TRT] node_of_618 [Shape] outputs: [618 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_619 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_619 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_619 [Constant] outputs: [619 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_620 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 618 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 619 [07/07/2021-20:00:59] [V] [TRT] node_of_620 [Gather] inputs: [618 -> (4)], [619 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 619 for ONNX node: 619 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_620 for ONNX node: node_of_620 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 620 for ONNX tensor: 620 [07/07/2021-20:00:59] [V] [TRT] node_of_620 [Gather] outputs: [620 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_621 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 592 [07/07/2021-20:00:59] [V] [TRT] node_of_621 [Shape] inputs: [592 -> (2, 128, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_621 for ONNX node: node_of_621 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 621 for ONNX tensor: 621 [07/07/2021-20:00:59] [V] [TRT] node_of_621 [Shape] outputs: [621 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_622 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_622 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_622 [Constant] outputs: [622 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_623 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 621 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 622 [07/07/2021-20:00:59] [V] [TRT] node_of_623 [Gather] inputs: [621 -> (4)], [622 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 622 for ONNX node: 622 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_623 for ONNX node: node_of_623 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 623 for ONNX tensor: 623 [07/07/2021-20:00:59] [V] [TRT] node_of_623 [Gather] outputs: [623 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_624 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 592 [07/07/2021-20:00:59] [V] [TRT] node_of_624 [Shape] inputs: [592 -> (2, 128, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_624 for ONNX node: node_of_624 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 624 for ONNX tensor: 624 [07/07/2021-20:00:59] [V] [TRT] node_of_624 [Shape] outputs: [624 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_625 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_625 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_625 [Constant] outputs: [625 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_626 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 624 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 625 [07/07/2021-20:00:59] [V] [TRT] node_of_626 [Gather] inputs: [624 -> (4)], [625 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 625 for ONNX node: 625 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_626 for ONNX node: node_of_626 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 626 for ONNX tensor: 626 [07/07/2021-20:00:59] [V] [TRT] node_of_626 [Gather] outputs: [626 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_629 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 617 [07/07/2021-20:00:59] [V] [TRT] node_of_629 [Unsqueeze] inputs: [617 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_629 for ONNX node: node_of_629 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 629 for ONNX tensor: 629 [07/07/2021-20:00:59] [V] [TRT] node_of_629 [Unsqueeze] outputs: [629 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_630 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 620 [07/07/2021-20:00:59] [V] [TRT] node_of_630 [Unsqueeze] inputs: [620 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_630 for ONNX node: node_of_630 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 630 for ONNX tensor: 630 [07/07/2021-20:00:59] [V] [TRT] node_of_630 [Unsqueeze] outputs: [630 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_631 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 623 [07/07/2021-20:00:59] [V] [TRT] node_of_631 [Unsqueeze] inputs: [623 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_631 for ONNX node: node_of_631 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 631 for ONNX tensor: 631 [07/07/2021-20:00:59] [V] [TRT] node_of_631 [Unsqueeze] outputs: [631 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_633 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 626 [07/07/2021-20:00:59] [V] [TRT] node_of_633 [Unsqueeze] inputs: [626 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_633 for ONNX node: node_of_633 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 633 for ONNX tensor: 633 [07/07/2021-20:00:59] [V] [TRT] node_of_633 [Unsqueeze] outputs: [633 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_635 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 629 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 630 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 631 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 1046 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 633 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 1047 [07/07/2021-20:00:59] [V] [TRT] node_of_635 [Concat] inputs: [629 -> (1)], [630 -> (1)], [631 -> (1)], [1046 -> (1)], [633 -> (1)], [1047 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 1046 for ONNX node: 1046 [07/07/2021-20:00:59] [V] [TRT] Registering layer: 1047 for ONNX node: 1047 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_635 for ONNX node: node_of_635 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 635 for ONNX tensor: 635 [07/07/2021-20:00:59] [V] [TRT] node_of_635 [Concat] outputs: [635 -> (6)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_636 [Expand] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 614 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 635 [07/07/2021-20:00:59] [V] [TRT] node_of_636 [Expand] inputs: [614 -> (2, 128, 13, 1, 13, 1)], [635 -> (6)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_636 for ONNX node: node_of_636 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 636 for ONNX tensor: 636 [07/07/2021-20:00:59] [V] [TRT] node_of_636 [Expand] outputs: [636 -> (2, 128, 13, 2, 13, 2)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_637 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 592 [07/07/2021-20:00:59] [V] [TRT] node_of_637 [Shape] inputs: [592 -> (2, 128, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_637 for ONNX node: node_of_637 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 637 for ONNX tensor: 637 [07/07/2021-20:00:59] [V] [TRT] node_of_637 [Shape] outputs: [637 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_638 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_638 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_638 [Constant] outputs: [638 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_639 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 637 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 638 [07/07/2021-20:00:59] [V] [TRT] node_of_639 [Gather] inputs: [637 -> (4)], [638 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 638 for ONNX node: 638 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_639 for ONNX node: node_of_639 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 639 for ONNX tensor: 639 [07/07/2021-20:00:59] [V] [TRT] node_of_639 [Gather] outputs: [639 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_640 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 592 [07/07/2021-20:00:59] [V] [TRT] node_of_640 [Shape] inputs: [592 -> (2, 128, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_640 for ONNX node: node_of_640 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 640 for ONNX tensor: 640 [07/07/2021-20:00:59] [V] [TRT] node_of_640 [Shape] outputs: [640 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_641 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_641 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_641 [Constant] outputs: [641 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_642 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 640 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 641 [07/07/2021-20:00:59] [V] [TRT] node_of_642 [Gather] inputs: [640 -> (4)], [641 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 641 for ONNX node: 641 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_642 for ONNX node: node_of_642 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 642 for ONNX tensor: 642 [07/07/2021-20:00:59] [V] [TRT] node_of_642 [Gather] outputs: [642 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_643 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 592 [07/07/2021-20:00:59] [V] [TRT] node_of_643 [Shape] inputs: [592 -> (2, 128, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_643 for ONNX node: node_of_643 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 643 for ONNX tensor: 643 [07/07/2021-20:00:59] [V] [TRT] node_of_643 [Shape] outputs: [643 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_644 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_644 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_644 [Constant] outputs: [644 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_645 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 643 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 644 [07/07/2021-20:00:59] [V] [TRT] node_of_645 [Gather] inputs: [643 -> (4)], [644 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 644 for ONNX node: 644 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_645 for ONNX node: node_of_645 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 645 for ONNX tensor: 645 [07/07/2021-20:00:59] [V] [TRT] node_of_645 [Gather] outputs: [645 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_646 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_646 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_646 [Constant] outputs: [646 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_647 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 645 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 646 [07/07/2021-20:00:59] [V] [TRT] node_of_647 [Mul] inputs: [645 -> ()], [646 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 646 for ONNX node: 646 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_647 for ONNX node: node_of_647 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 647 for ONNX tensor: 647 [07/07/2021-20:00:59] [V] [TRT] node_of_647 [Mul] outputs: [647 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_648 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 592 [07/07/2021-20:00:59] [V] [TRT] node_of_648 [Shape] inputs: [592 -> (2, 128, 13, 13)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_648 for ONNX node: node_of_648 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 648 for ONNX tensor: 648 [07/07/2021-20:00:59] [V] [TRT] node_of_648 [Shape] outputs: [648 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_649 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_649 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_649 [Constant] outputs: [649 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_650 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 648 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 649 [07/07/2021-20:00:59] [V] [TRT] node_of_650 [Gather] inputs: [648 -> (4)], [649 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 649 for ONNX node: 649 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_650 for ONNX node: node_of_650 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 650 for ONNX tensor: 650 [07/07/2021-20:00:59] [V] [TRT] node_of_650 [Gather] outputs: [650 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_651 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_651 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_651 [Constant] outputs: [651 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_652 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 650 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 651 [07/07/2021-20:00:59] [V] [TRT] node_of_652 [Mul] inputs: [650 -> ()], [651 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 651 for ONNX node: 651 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_652 for ONNX node: node_of_652 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 652 for ONNX tensor: 652 [07/07/2021-20:00:59] [V] [TRT] node_of_652 [Mul] outputs: [652 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_653 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 639 [07/07/2021-20:00:59] [V] [TRT] node_of_653 [Unsqueeze] inputs: [639 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_653 for ONNX node: node_of_653 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 653 for ONNX tensor: 653 [07/07/2021-20:00:59] [V] [TRT] node_of_653 [Unsqueeze] outputs: [653 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_654 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 642 [07/07/2021-20:00:59] [V] [TRT] node_of_654 [Unsqueeze] inputs: [642 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_654 for ONNX node: node_of_654 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 654 for ONNX tensor: 654 [07/07/2021-20:00:59] [V] [TRT] node_of_654 [Unsqueeze] outputs: [654 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_655 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 647 [07/07/2021-20:00:59] [V] [TRT] node_of_655 [Unsqueeze] inputs: [647 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_655 for ONNX node: node_of_655 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 655 for ONNX tensor: 655 [07/07/2021-20:00:59] [V] [TRT] node_of_655 [Unsqueeze] outputs: [655 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_656 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 652 [07/07/2021-20:00:59] [V] [TRT] node_of_656 [Unsqueeze] inputs: [652 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_656 for ONNX node: node_of_656 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 656 for ONNX tensor: 656 [07/07/2021-20:00:59] [V] [TRT] node_of_656 [Unsqueeze] outputs: [656 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_657 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 653 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 654 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 655 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 656 [07/07/2021-20:00:59] [V] [TRT] node_of_657 [Concat] inputs: [653 -> (1)], [654 -> (1)], [655 -> (1)], [656 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_657 for ONNX node: node_of_657 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 657 for ONNX tensor: 657 [07/07/2021-20:00:59] [V] [TRT] node_of_657 [Concat] outputs: [657 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_658 [Reshape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 636 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 657 [07/07/2021-20:00:59] [V] [TRT] node_of_658 [Reshape] inputs: [636 -> (2, 128, 13, 2, 13, 2)], [657 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_658 for ONNX node: node_of_658 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 658 for ONNX tensor: 658 [07/07/2021-20:00:59] [V] [TRT] node_of_658 [Reshape] outputs: [658 -> (2, 128, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_659 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 658 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 212 [07/07/2021-20:00:59] [V] [TRT] node_of_659 [Concat] inputs: [658 -> (2, 128, 26, 26)], [212 -> (2, 256, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_659 for ONNX node: node_of_659 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 659 for ONNX tensor: 659 [07/07/2021-20:00:59] [V] [TRT] node_of_659 [Concat] outputs: [659 -> (2, 384, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_660 [Conv] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 659 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.35.conv20.weight [07/07/2021-20:00:59] [V] [TRT] node_of_660 [Conv] inputs: [659 -> (2, 384, 26, 26)], [models.35.conv20.weight -> (256, 384, 3, 3)], [07/07/2021-20:00:59] [V] [TRT] Convolution input dimensions: (2, 384, 26, 26) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_660 for ONNX node: node_of_660 [07/07/2021-20:00:59] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [07/07/2021-20:00:59] [V] [TRT] Convolution output dimensions: (2, 256, 26, 26) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 660 for ONNX tensor: 660 [07/07/2021-20:00:59] [V] [TRT] node_of_660 [Conv] outputs: [660 -> (2, 256, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_661 [BatchNormalization] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 660 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.35.bn20.weight [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.35.bn20.bias [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.35.bn20.running_mean [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.35.bn20.running_var [07/07/2021-20:00:59] [V] [TRT] node_of_661 [BatchNormalization] inputs: [660 -> (2, 256, 26, 26)], [models.35.bn20.weight -> (256)], [models.35.bn20.bias -> (256)], [models.35.bn20.running_mean -> (256)], [models.35.bn20.running_var -> (256)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_661 for ONNX node: node_of_661 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 661 for ONNX tensor: 661 [07/07/2021-20:00:59] [V] [TRT] node_of_661 [BatchNormalization] outputs: [661 -> (2, 256, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_662 [LeakyRelu] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 661 [07/07/2021-20:00:59] [V] [TRT] node_of_662 [LeakyRelu] inputs: [661 -> (2, 256, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_662 for ONNX node: node_of_662 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 662 for ONNX tensor: 662 [07/07/2021-20:00:59] [V] [TRT] node_of_662 [LeakyRelu] outputs: [662 -> (2, 256, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_663 [Conv] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 662 [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.36.conv21.weight [07/07/2021-20:00:59] [V] [TRT] Searching for input: models.36.conv21.bias [07/07/2021-20:00:59] [V] [TRT] node_of_663 [Conv] inputs: [662 -> (2, 256, 26, 26)], [models.36.conv21.weight -> (18, 256, 1, 1)], [models.36.conv21.bias -> (18)], [07/07/2021-20:00:59] [V] [TRT] Convolution input dimensions: (2, 256, 26, 26) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_663 for ONNX node: node_of_663 [07/07/2021-20:00:59] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 18 [07/07/2021-20:00:59] [V] [TRT] Convolution output dimensions: (2, 18, 26, 26) [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 663 for ONNX tensor: 663 [07/07/2021-20:00:59] [V] [TRT] node_of_663 [Conv] outputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_664 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_664 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_664 [Constant] outputs: [664 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_665 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_665 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_665 [Constant] outputs: [665 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_666 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_666 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_666 [Constant] outputs: [666 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_667 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_667 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_667 [Constant] outputs: [667 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_668 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 663 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 665 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 666 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 664 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 667 [07/07/2021-20:00:59] [V] [TRT] node_of_668 [Slice] inputs: [663 -> (2, 18, 26, 26)], [665 -> (1)], [666 -> (1)], [664 -> (1)], [667 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_668 for ONNX node: node_of_668 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 668 for ONNX tensor: 668 [07/07/2021-20:00:59] [V] [TRT] node_of_668 [Slice] outputs: [668 -> (2, 2, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_669 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_669 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_669 [Constant] outputs: [669 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_670 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_670 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_670 [Constant] outputs: [670 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_671 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_671 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_671 [Constant] outputs: [671 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_672 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_672 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_672 [Constant] outputs: [672 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_673 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 663 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 670 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 671 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 669 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 672 [07/07/2021-20:00:59] [V] [TRT] node_of_673 [Slice] inputs: [663 -> (2, 18, 26, 26)], [670 -> (1)], [671 -> (1)], [669 -> (1)], [672 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_673 for ONNX node: node_of_673 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 673 for ONNX tensor: 673 [07/07/2021-20:00:59] [V] [TRT] node_of_673 [Slice] outputs: [673 -> (2, 2, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_674 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_674 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_674 [Constant] outputs: [674 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_675 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_675 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_675 [Constant] outputs: [675 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_676 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_676 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_676 [Constant] outputs: [676 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_677 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_677 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_677 [Constant] outputs: [677 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_678 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 663 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 675 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 676 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 674 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 677 [07/07/2021-20:00:59] [V] [TRT] node_of_678 [Slice] inputs: [663 -> (2, 18, 26, 26)], [675 -> (1)], [676 -> (1)], [674 -> (1)], [677 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_678 for ONNX node: node_of_678 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 678 for ONNX tensor: 678 [07/07/2021-20:00:59] [V] [TRT] node_of_678 [Slice] outputs: [678 -> (2, 1, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_679 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_679 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_679 [Constant] outputs: [679 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_680 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_680 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_680 [Constant] outputs: [680 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_681 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_681 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_681 [Constant] outputs: [681 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_682 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_682 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_682 [Constant] outputs: [682 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_683 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 663 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 680 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 681 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 679 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 682 [07/07/2021-20:00:59] [V] [TRT] node_of_683 [Slice] inputs: [663 -> (2, 18, 26, 26)], [680 -> (1)], [681 -> (1)], [679 -> (1)], [682 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_683 for ONNX node: node_of_683 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 683 for ONNX tensor: 683 [07/07/2021-20:00:59] [V] [TRT] node_of_683 [Slice] outputs: [683 -> (2, 1, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_684 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_684 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_684 [Constant] outputs: [684 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_685 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_685 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_685 [Constant] outputs: [685 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_686 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_686 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_686 [Constant] outputs: [686 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_687 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_687 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_687 [Constant] outputs: [687 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_688 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 663 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 685 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 686 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 684 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 687 [07/07/2021-20:00:59] [V] [TRT] node_of_688 [Slice] inputs: [663 -> (2, 18, 26, 26)], [685 -> (1)], [686 -> (1)], [684 -> (1)], [687 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_688 for ONNX node: node_of_688 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 688 for ONNX tensor: 688 [07/07/2021-20:00:59] [V] [TRT] node_of_688 [Slice] outputs: [688 -> (2, 2, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_689 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_689 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_689 [Constant] outputs: [689 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_690 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_690 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_690 [Constant] outputs: [690 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_691 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_691 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_691 [Constant] outputs: [691 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_692 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_692 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_692 [Constant] outputs: [692 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_693 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 663 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 690 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 691 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 689 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 692 [07/07/2021-20:00:59] [V] [TRT] node_of_693 [Slice] inputs: [663 -> (2, 18, 26, 26)], [690 -> (1)], [691 -> (1)], [689 -> (1)], [692 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_693 for ONNX node: node_of_693 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 693 for ONNX tensor: 693 [07/07/2021-20:00:59] [V] [TRT] node_of_693 [Slice] outputs: [693 -> (2, 2, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_694 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_694 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_694 [Constant] outputs: [694 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_695 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_695 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_695 [Constant] outputs: [695 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_696 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_696 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_696 [Constant] outputs: [696 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_697 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_697 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_697 [Constant] outputs: [697 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_698 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 663 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 695 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 696 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 694 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 697 [07/07/2021-20:00:59] [V] [TRT] node_of_698 [Slice] inputs: [663 -> (2, 18, 26, 26)], [695 -> (1)], [696 -> (1)], [694 -> (1)], [697 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_698 for ONNX node: node_of_698 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 698 for ONNX tensor: 698 [07/07/2021-20:00:59] [V] [TRT] node_of_698 [Slice] outputs: [698 -> (2, 1, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_699 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_699 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_699 [Constant] outputs: [699 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_700 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_700 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_700 [Constant] outputs: [700 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_701 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_701 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_701 [Constant] outputs: [701 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_702 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_702 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_702 [Constant] outputs: [702 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_703 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 663 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 700 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 701 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 699 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 702 [07/07/2021-20:00:59] [V] [TRT] node_of_703 [Slice] inputs: [663 -> (2, 18, 26, 26)], [700 -> (1)], [701 -> (1)], [699 -> (1)], [702 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_703 for ONNX node: node_of_703 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 703 for ONNX tensor: 703 [07/07/2021-20:00:59] [V] [TRT] node_of_703 [Slice] outputs: [703 -> (2, 1, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_704 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_704 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_704 [Constant] outputs: [704 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_705 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_705 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_705 [Constant] outputs: [705 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_706 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_706 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_706 [Constant] outputs: [706 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_707 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_707 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_707 [Constant] outputs: [707 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_708 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 663 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 705 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 706 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 704 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 707 [07/07/2021-20:00:59] [V] [TRT] node_of_708 [Slice] inputs: [663 -> (2, 18, 26, 26)], [705 -> (1)], [706 -> (1)], [704 -> (1)], [707 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_708 for ONNX node: node_of_708 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 708 for ONNX tensor: 708 [07/07/2021-20:00:59] [V] [TRT] node_of_708 [Slice] outputs: [708 -> (2, 2, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_709 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_709 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_709 [Constant] outputs: [709 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_710 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_710 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_710 [Constant] outputs: [710 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_711 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_711 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_711 [Constant] outputs: [711 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_712 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_712 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_712 [Constant] outputs: [712 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_713 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 663 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 710 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 711 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 709 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 712 [07/07/2021-20:00:59] [V] [TRT] node_of_713 [Slice] inputs: [663 -> (2, 18, 26, 26)], [710 -> (1)], [711 -> (1)], [709 -> (1)], [712 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_713 for ONNX node: node_of_713 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 713 for ONNX tensor: 713 [07/07/2021-20:00:59] [V] [TRT] node_of_713 [Slice] outputs: [713 -> (2, 2, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_714 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_714 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_714 [Constant] outputs: [714 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_715 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_715 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_715 [Constant] outputs: [715 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_716 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_716 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_716 [Constant] outputs: [716 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_717 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_717 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_717 [Constant] outputs: [717 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_718 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 663 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 715 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 716 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 714 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 717 [07/07/2021-20:00:59] [V] [TRT] node_of_718 [Slice] inputs: [663 -> (2, 18, 26, 26)], [715 -> (1)], [716 -> (1)], [714 -> (1)], [717 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_718 for ONNX node: node_of_718 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 718 for ONNX tensor: 718 [07/07/2021-20:00:59] [V] [TRT] node_of_718 [Slice] outputs: [718 -> (2, 1, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_719 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_719 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_719 [Constant] outputs: [719 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_720 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_720 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_720 [Constant] outputs: [720 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_721 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_721 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_721 [Constant] outputs: [721 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_722 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_722 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_722 [Constant] outputs: [722 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_723 [Slice] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 663 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 720 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 721 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 719 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 722 [07/07/2021-20:00:59] [V] [TRT] node_of_723 [Slice] inputs: [663 -> (2, 18, 26, 26)], [720 -> (1)], [721 -> (1)], [719 -> (1)], [722 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_723 for ONNX node: node_of_723 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 723 for ONNX tensor: 723 [07/07/2021-20:00:59] [V] [TRT] node_of_723 [Slice] outputs: [723 -> (2, 1, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_724 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 668 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 688 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 708 [07/07/2021-20:00:59] [V] [TRT] node_of_724 [Concat] inputs: [668 -> (2, 2, 26, 26)], [688 -> (2, 2, 26, 26)], [708 -> (2, 2, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_724 for ONNX node: node_of_724 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 724 for ONNX tensor: 724 [07/07/2021-20:00:59] [V] [TRT] node_of_724 [Concat] outputs: [724 -> (2, 6, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_725 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 673 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 693 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 713 [07/07/2021-20:00:59] [V] [TRT] node_of_725 [Concat] inputs: [673 -> (2, 2, 26, 26)], [693 -> (2, 2, 26, 26)], [713 -> (2, 2, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_725 for ONNX node: node_of_725 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 725 for ONNX tensor: 725 [07/07/2021-20:00:59] [V] [TRT] node_of_725 [Concat] outputs: [725 -> (2, 6, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_726 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 678 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 698 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 718 [07/07/2021-20:00:59] [V] [TRT] node_of_726 [Concat] inputs: [678 -> (2, 1, 26, 26)], [698 -> (2, 1, 26, 26)], [718 -> (2, 1, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_726 for ONNX node: node_of_726 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 726 for ONNX tensor: 726 [07/07/2021-20:00:59] [V] [TRT] node_of_726 [Concat] outputs: [726 -> (2, 3, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_727 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 663 [07/07/2021-20:00:59] [V] [TRT] node_of_727 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_727 for ONNX node: node_of_727 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 727 for ONNX tensor: 727 [07/07/2021-20:00:59] [V] [TRT] node_of_727 [Shape] outputs: [727 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_728 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_728 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_728 [Constant] outputs: [728 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_729 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 727 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 728 [07/07/2021-20:00:59] [V] [TRT] node_of_729 [Gather] inputs: [727 -> (4)], [728 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 728 for ONNX node: 728 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_729 for ONNX node: node_of_729 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 729 for ONNX tensor: 729 [07/07/2021-20:00:59] [V] [TRT] node_of_729 [Gather] outputs: [729 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_730 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 663 [07/07/2021-20:00:59] [V] [TRT] node_of_730 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_730 for ONNX node: node_of_730 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 730 for ONNX tensor: 730 [07/07/2021-20:00:59] [V] [TRT] node_of_730 [Shape] outputs: [730 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_731 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_731 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_731 [Constant] outputs: [731 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_732 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 730 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 731 [07/07/2021-20:00:59] [V] [TRT] node_of_732 [Gather] inputs: [730 -> (4)], [731 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 731 for ONNX node: 731 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_732 for ONNX node: node_of_732 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 732 for ONNX tensor: 732 [07/07/2021-20:00:59] [V] [TRT] node_of_732 [Gather] outputs: [732 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_733 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_733 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_733 [Constant] outputs: [733 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_734 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 732 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 733 [07/07/2021-20:00:59] [V] [TRT] node_of_734 [Mul] inputs: [732 -> ()], [733 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 733 for ONNX node: 733 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_734 for ONNX node: node_of_734 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 734 for ONNX tensor: 734 [07/07/2021-20:00:59] [V] [TRT] node_of_734 [Mul] outputs: [734 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_735 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 663 [07/07/2021-20:00:59] [V] [TRT] node_of_735 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_735 for ONNX node: node_of_735 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 735 for ONNX tensor: 735 [07/07/2021-20:00:59] [V] [TRT] node_of_735 [Shape] outputs: [735 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_736 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_736 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_736 [Constant] outputs: [736 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_737 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 735 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 736 [07/07/2021-20:00:59] [V] [TRT] node_of_737 [Gather] inputs: [735 -> (4)], [736 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 736 for ONNX node: 736 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_737 for ONNX node: node_of_737 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 737 for ONNX tensor: 737 [07/07/2021-20:00:59] [V] [TRT] node_of_737 [Gather] outputs: [737 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_738 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 734 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 737 [07/07/2021-20:00:59] [V] [TRT] node_of_738 [Mul] inputs: [734 -> ()], [737 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_738 for ONNX node: node_of_738 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 738 for ONNX tensor: 738 [07/07/2021-20:00:59] [V] [TRT] node_of_738 [Mul] outputs: [738 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_739 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 729 [07/07/2021-20:00:59] [V] [TRT] node_of_739 [Unsqueeze] inputs: [729 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_739 for ONNX node: node_of_739 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 739 for ONNX tensor: 739 [07/07/2021-20:00:59] [V] [TRT] node_of_739 [Unsqueeze] outputs: [739 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_740 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 738 [07/07/2021-20:00:59] [V] [TRT] node_of_740 [Unsqueeze] inputs: [738 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_740 for ONNX node: node_of_740 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 740 for ONNX tensor: 740 [07/07/2021-20:00:59] [V] [TRT] node_of_740 [Unsqueeze] outputs: [740 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_741 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 739 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 740 [07/07/2021-20:00:59] [V] [TRT] node_of_741 [Concat] inputs: [739 -> (1)], [740 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_741 for ONNX node: node_of_741 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 741 for ONNX tensor: 741 [07/07/2021-20:00:59] [V] [TRT] node_of_741 [Concat] outputs: [741 -> (2)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_742 [Reshape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 726 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 741 [07/07/2021-20:00:59] [V] [TRT] node_of_742 [Reshape] inputs: [726 -> (2, 3, 26, 26)], [741 -> (2)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_742 for ONNX node: node_of_742 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 742 for ONNX tensor: 742 [07/07/2021-20:00:59] [V] [TRT] node_of_742 [Reshape] outputs: [742 -> (2, 2028)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_743 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 683 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 703 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 723 [07/07/2021-20:00:59] [V] [TRT] node_of_743 [Concat] inputs: [683 -> (2, 1, 26, 26)], [703 -> (2, 1, 26, 26)], [723 -> (2, 1, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_743 for ONNX node: node_of_743 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 743 for ONNX tensor: 743 [07/07/2021-20:00:59] [V] [TRT] node_of_743 [Concat] outputs: [743 -> (2, 3, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_744 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 663 [07/07/2021-20:00:59] [V] [TRT] node_of_744 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_744 for ONNX node: node_of_744 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 744 for ONNX tensor: 744 [07/07/2021-20:00:59] [V] [TRT] node_of_744 [Shape] outputs: [744 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_745 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_745 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_745 [Constant] outputs: [745 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_746 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 744 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 745 [07/07/2021-20:00:59] [V] [TRT] node_of_746 [Gather] inputs: [744 -> (4)], [745 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 745 for ONNX node: 745 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_746 for ONNX node: node_of_746 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 746 for ONNX tensor: 746 [07/07/2021-20:00:59] [V] [TRT] node_of_746 [Gather] outputs: [746 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_747 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 663 [07/07/2021-20:00:59] [V] [TRT] node_of_747 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_747 for ONNX node: node_of_747 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 747 for ONNX tensor: 747 [07/07/2021-20:00:59] [V] [TRT] node_of_747 [Shape] outputs: [747 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_748 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_748 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_748 [Constant] outputs: [748 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_749 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 747 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 748 [07/07/2021-20:00:59] [V] [TRT] node_of_749 [Gather] inputs: [747 -> (4)], [748 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 748 for ONNX node: 748 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_749 for ONNX node: node_of_749 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 749 for ONNX tensor: 749 [07/07/2021-20:00:59] [V] [TRT] node_of_749 [Gather] outputs: [749 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_750 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 663 [07/07/2021-20:00:59] [V] [TRT] node_of_750 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_750 for ONNX node: node_of_750 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 750 for ONNX tensor: 750 [07/07/2021-20:00:59] [V] [TRT] node_of_750 [Shape] outputs: [750 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_751 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_751 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_751 [Constant] outputs: [751 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_752 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 750 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 751 [07/07/2021-20:00:59] [V] [TRT] node_of_752 [Gather] inputs: [750 -> (4)], [751 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 751 for ONNX node: 751 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_752 for ONNX node: node_of_752 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 752 for ONNX tensor: 752 [07/07/2021-20:00:59] [V] [TRT] node_of_752 [Gather] outputs: [752 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_753 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 749 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 752 [07/07/2021-20:00:59] [V] [TRT] node_of_753 [Mul] inputs: [749 -> ()], [752 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_753 for ONNX node: node_of_753 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 753 for ONNX tensor: 753 [07/07/2021-20:00:59] [V] [TRT] node_of_753 [Mul] outputs: [753 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_756 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 746 [07/07/2021-20:00:59] [V] [TRT] node_of_756 [Unsqueeze] inputs: [746 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_756 for ONNX node: node_of_756 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 756 for ONNX tensor: 756 [07/07/2021-20:00:59] [V] [TRT] node_of_756 [Unsqueeze] outputs: [756 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_759 [Unsqueeze] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 753 [07/07/2021-20:00:59] [V] [TRT] node_of_759 [Unsqueeze] inputs: [753 -> ()], [07/07/2021-20:00:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_759 for ONNX node: node_of_759 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 759 for ONNX tensor: 759 [07/07/2021-20:00:59] [V] [TRT] node_of_759 [Unsqueeze] outputs: [759 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_760 [Concat] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 756 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 1048 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 1049 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 759 [07/07/2021-20:00:59] [V] [TRT] node_of_760 [Concat] inputs: [756 -> (1)], [1048 -> (1)], [1049 -> (1)], [759 -> (1)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 1048 for ONNX node: 1048 [07/07/2021-20:00:59] [V] [TRT] Registering layer: 1049 for ONNX node: 1049 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_760 for ONNX node: node_of_760 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 760 for ONNX tensor: 760 [07/07/2021-20:00:59] [V] [TRT] node_of_760 [Concat] outputs: [760 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_761 [Reshape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 743 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 760 [07/07/2021-20:00:59] [V] [TRT] node_of_761 [Reshape] inputs: [743 -> (2, 3, 26, 26)], [760 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_761 for ONNX node: node_of_761 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 761 for ONNX tensor: 761 [07/07/2021-20:00:59] [V] [TRT] node_of_761 [Reshape] outputs: [761 -> (2, 3, 1, 676)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_762 [Transpose] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 761 [07/07/2021-20:00:59] [V] [TRT] node_of_762 [Transpose] inputs: [761 -> (2, 3, 1, 676)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_762 for ONNX node: node_of_762 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 762 for ONNX tensor: 762 [07/07/2021-20:00:59] [V] [TRT] node_of_762 [Transpose] outputs: [762 -> (2, 3, 676, 1)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_763 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 663 [07/07/2021-20:00:59] [V] [TRT] node_of_763 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_763 for ONNX node: node_of_763 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 763 for ONNX tensor: 763 [07/07/2021-20:00:59] [V] [TRT] node_of_763 [Shape] outputs: [763 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_764 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_764 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_764 [Constant] outputs: [764 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_765 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 763 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 764 [07/07/2021-20:00:59] [V] [TRT] node_of_765 [Gather] inputs: [763 -> (4)], [764 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 764 for ONNX node: 764 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_765 for ONNX node: node_of_765 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 765 for ONNX tensor: 765 [07/07/2021-20:00:59] [V] [TRT] node_of_765 [Gather] outputs: [765 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_766 [Shape] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 663 [07/07/2021-20:00:59] [V] [TRT] node_of_766 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_766 for ONNX node: node_of_766 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 766 for ONNX tensor: 766 [07/07/2021-20:00:59] [V] [TRT] node_of_766 [Shape] outputs: [766 -> (4)], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_767 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_767 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_767 [Constant] outputs: [767 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_768 [Gather] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 766 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 767 [07/07/2021-20:00:59] [V] [TRT] node_of_768 [Gather] inputs: [766 -> (4)], [767 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 767 for ONNX node: 767 [07/07/2021-20:00:59] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_768 for ONNX node: node_of_768 [07/07/2021-20:00:59] [V] [TRT] Registering tensor: 768 for ONNX tensor: 768 [07/07/2021-20:00:59] [V] [TRT] node_of_768 [Gather] outputs: [768 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_769 [Constant] [07/07/2021-20:00:59] [V] [TRT] node_of_769 [Constant] inputs: [07/07/2021-20:00:59] [V] [TRT] node_of_769 [Constant] outputs: [769 -> ()], [07/07/2021-20:00:59] [V] [TRT] Parsing node: node_of_770 [Mul] [07/07/2021-20:00:59] [V] [TRT] Searching for input: 768 [07/07/2021-20:00:59] [V] [TRT] Searching for input: 769 [07/07/2021-20:00:59] [V] [TRT] node_of_770 [Mul] inputs: [768 -> ()], [769 -> ()], [07/07/2021-20:00:59] [V] [TRT] Registering layer: 769 for ONNX node: 769 [07/07/2021-20:00:59] [V] [TRT] Registering layer: node_of_770 for ONNX node: node_of_770 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 770 for ONNX tensor: 770 [07/07/2021-20:01:00] [V] [TRT] node_of_770 [Mul] outputs: [770 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_771 [Shape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 663 [07/07/2021-20:01:00] [V] [TRT] node_of_771 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_771 for ONNX node: node_of_771 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 771 for ONNX tensor: 771 [07/07/2021-20:01:00] [V] [TRT] node_of_771 [Shape] outputs: [771 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_772 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_772 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_772 [Constant] outputs: [772 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_773 [Gather] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 771 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 772 [07/07/2021-20:01:00] [V] [TRT] node_of_773 [Gather] inputs: [771 -> (4)], [772 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 772 for ONNX node: 772 [07/07/2021-20:01:00] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_773 for ONNX node: node_of_773 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 773 for ONNX tensor: 773 [07/07/2021-20:01:00] [V] [TRT] node_of_773 [Gather] outputs: [773 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_774 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 770 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 773 [07/07/2021-20:01:00] [V] [TRT] node_of_774 [Mul] inputs: [770 -> ()], [773 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_774 for ONNX node: node_of_774 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 774 for ONNX tensor: 774 [07/07/2021-20:01:00] [V] [TRT] node_of_774 [Mul] outputs: [774 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_776 [Unsqueeze] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 765 [07/07/2021-20:01:00] [V] [TRT] node_of_776 [Unsqueeze] inputs: [765 -> ()], [07/07/2021-20:01:00] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_776 for ONNX node: node_of_776 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 776 for ONNX tensor: 776 [07/07/2021-20:01:00] [V] [TRT] node_of_776 [Unsqueeze] outputs: [776 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_777 [Unsqueeze] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 774 [07/07/2021-20:01:00] [V] [TRT] node_of_777 [Unsqueeze] inputs: [774 -> ()], [07/07/2021-20:01:00] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_777 for ONNX node: node_of_777 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 777 for ONNX tensor: 777 [07/07/2021-20:01:00] [V] [TRT] node_of_777 [Unsqueeze] outputs: [777 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_779 [Concat] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 776 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 777 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1050 [07/07/2021-20:01:00] [V] [TRT] node_of_779 [Concat] inputs: [776 -> (1)], [777 -> (1)], [1050 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 1050 for ONNX node: 1050 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_779 for ONNX node: node_of_779 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 779 for ONNX tensor: 779 [07/07/2021-20:01:00] [V] [TRT] node_of_779 [Concat] outputs: [779 -> (3)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_780 [Reshape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 762 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 779 [07/07/2021-20:01:00] [V] [TRT] node_of_780 [Reshape] inputs: [762 -> (2, 3, 676, 1)], [779 -> (3)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_780 for ONNX node: node_of_780 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 780 for ONNX tensor: 780 [07/07/2021-20:01:00] [V] [TRT] node_of_780 [Reshape] outputs: [780 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_781 [Sigmoid] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 724 [07/07/2021-20:01:00] [V] [TRT] node_of_781 [Sigmoid] inputs: [724 -> (2, 6, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_781 for ONNX node: node_of_781 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 781 for ONNX tensor: 781 [07/07/2021-20:01:00] [V] [TRT] node_of_781 [Sigmoid] outputs: [781 -> (2, 6, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_782 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_782 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_782 [Constant] outputs: [782 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_783 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 781 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 782 [07/07/2021-20:01:00] [V] [TRT] node_of_783 [Mul] inputs: [781 -> (2, 6, 26, 26)], [782 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 782 for ONNX node: 782 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_783 for ONNX node: node_of_783 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 783 for ONNX tensor: 783 [07/07/2021-20:01:00] [V] [TRT] node_of_783 [Mul] outputs: [783 -> (2, 6, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_784 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_784 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_784 [Constant] outputs: [784 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_785 [Sub] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 783 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 784 [07/07/2021-20:01:00] [V] [TRT] node_of_785 [Sub] inputs: [783 -> (2, 6, 26, 26)], [784 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 784 for ONNX node: 784 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_785 for ONNX node: node_of_785 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 785 for ONNX tensor: 785 [07/07/2021-20:01:00] [V] [TRT] node_of_785 [Sub] outputs: [785 -> (2, 6, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_786 [Exp] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 725 [07/07/2021-20:01:00] [V] [TRT] node_of_786 [Exp] inputs: [725 -> (2, 6, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_786 for ONNX node: node_of_786 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 786 for ONNX tensor: 786 [07/07/2021-20:01:00] [V] [TRT] node_of_786 [Exp] outputs: [786 -> (2, 6, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_787 [Sigmoid] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 742 [07/07/2021-20:01:00] [V] [TRT] node_of_787 [Sigmoid] inputs: [742 -> (2, 2028)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_787 for ONNX node: node_of_787 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 787 for ONNX tensor: 787 [07/07/2021-20:01:00] [V] [TRT] node_of_787 [Sigmoid] outputs: [787 -> (2, 2028)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_788 [Sigmoid] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 780 [07/07/2021-20:01:00] [V] [TRT] node_of_788 [Sigmoid] inputs: [780 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_788 for ONNX node: node_of_788 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 788 for ONNX tensor: 788 [07/07/2021-20:01:00] [V] [TRT] node_of_788 [Sigmoid] outputs: [788 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_789 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_789 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_789 [Constant] outputs: [789 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_790 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_790 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_790 [Constant] outputs: [790 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_791 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_791 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_791 [Constant] outputs: [791 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_792 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_792 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_792 [Constant] outputs: [792 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_793 [Slice] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 785 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 790 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 791 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 789 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 792 [07/07/2021-20:01:00] [V] [TRT] node_of_793 [Slice] inputs: [785 -> (2, 6, 26, 26)], [790 -> (1)], [791 -> (1)], [789 -> (1)], [792 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_793 for ONNX node: node_of_793 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 793 for ONNX tensor: 793 [07/07/2021-20:01:00] [V] [TRT] node_of_793 [Slice] outputs: [793 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_794 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_794 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_794 [Constant] outputs: [794 -> (1, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_795 [Add] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 793 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 794 [07/07/2021-20:01:00] [V] [TRT] node_of_795 [Add] inputs: [793 -> (2, 1, 26, 26)], [794 -> (1, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 794 for ONNX node: 794 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_795 for ONNX node: node_of_795 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 795 for ONNX tensor: 795 [07/07/2021-20:01:00] [V] [TRT] node_of_795 [Add] outputs: [795 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_796 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_796 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_796 [Constant] outputs: [796 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_797 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_797 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_797 [Constant] outputs: [797 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_798 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_798 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_798 [Constant] outputs: [798 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_799 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_799 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_799 [Constant] outputs: [799 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_800 [Slice] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 785 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 797 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 798 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 796 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 799 [07/07/2021-20:01:00] [V] [TRT] node_of_800 [Slice] inputs: [785 -> (2, 6, 26, 26)], [797 -> (1)], [798 -> (1)], [796 -> (1)], [799 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_800 for ONNX node: node_of_800 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 800 for ONNX tensor: 800 [07/07/2021-20:01:00] [V] [TRT] node_of_800 [Slice] outputs: [800 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_801 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_801 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_801 [Constant] outputs: [801 -> (1, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_802 [Add] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 800 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 801 [07/07/2021-20:01:00] [V] [TRT] node_of_802 [Add] inputs: [800 -> (2, 1, 26, 26)], [801 -> (1, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 801 for ONNX node: 801 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_802 for ONNX node: node_of_802 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 802 for ONNX tensor: 802 [07/07/2021-20:01:00] [V] [TRT] node_of_802 [Add] outputs: [802 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_803 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_803 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_803 [Constant] outputs: [803 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_804 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_804 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_804 [Constant] outputs: [804 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_805 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_805 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_805 [Constant] outputs: [805 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_806 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_806 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_806 [Constant] outputs: [806 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_807 [Slice] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 786 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 804 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 805 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 803 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 806 [07/07/2021-20:01:00] [V] [TRT] node_of_807 [Slice] inputs: [786 -> (2, 6, 26, 26)], [804 -> (1)], [805 -> (1)], [803 -> (1)], [806 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_807 for ONNX node: node_of_807 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 807 for ONNX tensor: 807 [07/07/2021-20:01:00] [V] [TRT] node_of_807 [Slice] outputs: [807 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_808 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_808 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_808 [Constant] outputs: [808 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_809 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 807 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 808 [07/07/2021-20:01:00] [V] [TRT] node_of_809 [Mul] inputs: [807 -> (2, 1, 26, 26)], [808 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 808 for ONNX node: 808 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_809 for ONNX node: node_of_809 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 809 for ONNX tensor: 809 [07/07/2021-20:01:00] [V] [TRT] node_of_809 [Mul] outputs: [809 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_810 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_810 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_810 [Constant] outputs: [810 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_811 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_811 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_811 [Constant] outputs: [811 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_812 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_812 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_812 [Constant] outputs: [812 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_813 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_813 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_813 [Constant] outputs: [813 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_814 [Slice] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 786 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 811 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 812 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 810 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 813 [07/07/2021-20:01:00] [V] [TRT] node_of_814 [Slice] inputs: [786 -> (2, 6, 26, 26)], [811 -> (1)], [812 -> (1)], [810 -> (1)], [813 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_814 for ONNX node: node_of_814 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 814 for ONNX tensor: 814 [07/07/2021-20:01:00] [V] [TRT] node_of_814 [Slice] outputs: [814 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_815 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_815 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_815 [Constant] outputs: [815 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_816 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 814 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 815 [07/07/2021-20:01:00] [V] [TRT] node_of_816 [Mul] inputs: [814 -> (2, 1, 26, 26)], [815 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 815 for ONNX node: 815 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_816 for ONNX node: node_of_816 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 816 for ONNX tensor: 816 [07/07/2021-20:01:00] [V] [TRT] node_of_816 [Mul] outputs: [816 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_817 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_817 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_817 [Constant] outputs: [817 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_818 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_818 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_818 [Constant] outputs: [818 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_819 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_819 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_819 [Constant] outputs: [819 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_820 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_820 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_820 [Constant] outputs: [820 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_821 [Slice] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 785 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 818 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 819 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 817 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 820 [07/07/2021-20:01:00] [V] [TRT] node_of_821 [Slice] inputs: [785 -> (2, 6, 26, 26)], [818 -> (1)], [819 -> (1)], [817 -> (1)], [820 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_821 for ONNX node: node_of_821 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 821 for ONNX tensor: 821 [07/07/2021-20:01:00] [V] [TRT] node_of_821 [Slice] outputs: [821 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_822 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_822 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_822 [Constant] outputs: [822 -> (1, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_823 [Add] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 821 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 822 [07/07/2021-20:01:00] [V] [TRT] node_of_823 [Add] inputs: [821 -> (2, 1, 26, 26)], [822 -> (1, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 822 for ONNX node: 822 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_823 for ONNX node: node_of_823 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 823 for ONNX tensor: 823 [07/07/2021-20:01:00] [V] [TRT] node_of_823 [Add] outputs: [823 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_824 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_824 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_824 [Constant] outputs: [824 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_825 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_825 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_825 [Constant] outputs: [825 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_826 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_826 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_826 [Constant] outputs: [826 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_827 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_827 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_827 [Constant] outputs: [827 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_828 [Slice] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 785 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 825 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 826 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 824 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 827 [07/07/2021-20:01:00] [V] [TRT] node_of_828 [Slice] inputs: [785 -> (2, 6, 26, 26)], [825 -> (1)], [826 -> (1)], [824 -> (1)], [827 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_828 for ONNX node: node_of_828 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 828 for ONNX tensor: 828 [07/07/2021-20:01:00] [V] [TRT] node_of_828 [Slice] outputs: [828 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_829 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_829 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_829 [Constant] outputs: [829 -> (1, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_830 [Add] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 828 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 829 [07/07/2021-20:01:00] [V] [TRT] node_of_830 [Add] inputs: [828 -> (2, 1, 26, 26)], [829 -> (1, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 829 for ONNX node: 829 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_830 for ONNX node: node_of_830 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 830 for ONNX tensor: 830 [07/07/2021-20:01:00] [V] [TRT] node_of_830 [Add] outputs: [830 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_831 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_831 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_831 [Constant] outputs: [831 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_832 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_832 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_832 [Constant] outputs: [832 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_833 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_833 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_833 [Constant] outputs: [833 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_834 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_834 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_834 [Constant] outputs: [834 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_835 [Slice] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 786 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 832 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 833 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 831 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 834 [07/07/2021-20:01:00] [V] [TRT] node_of_835 [Slice] inputs: [786 -> (2, 6, 26, 26)], [832 -> (1)], [833 -> (1)], [831 -> (1)], [834 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_835 for ONNX node: node_of_835 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 835 for ONNX tensor: 835 [07/07/2021-20:01:00] [V] [TRT] node_of_835 [Slice] outputs: [835 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_836 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_836 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_836 [Constant] outputs: [836 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_837 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 835 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 836 [07/07/2021-20:01:00] [V] [TRT] node_of_837 [Mul] inputs: [835 -> (2, 1, 26, 26)], [836 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 836 for ONNX node: 836 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_837 for ONNX node: node_of_837 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 837 for ONNX tensor: 837 [07/07/2021-20:01:00] [V] [TRT] node_of_837 [Mul] outputs: [837 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_838 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_838 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_838 [Constant] outputs: [838 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_839 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_839 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_839 [Constant] outputs: [839 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_840 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_840 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_840 [Constant] outputs: [840 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_841 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_841 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_841 [Constant] outputs: [841 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_842 [Slice] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 786 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 839 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 840 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 838 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 841 [07/07/2021-20:01:00] [V] [TRT] node_of_842 [Slice] inputs: [786 -> (2, 6, 26, 26)], [839 -> (1)], [840 -> (1)], [838 -> (1)], [841 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_842 for ONNX node: node_of_842 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 842 for ONNX tensor: 842 [07/07/2021-20:01:00] [V] [TRT] node_of_842 [Slice] outputs: [842 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_843 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_843 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_843 [Constant] outputs: [843 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_844 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 842 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 843 [07/07/2021-20:01:00] [V] [TRT] node_of_844 [Mul] inputs: [842 -> (2, 1, 26, 26)], [843 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 843 for ONNX node: 843 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_844 for ONNX node: node_of_844 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 844 for ONNX tensor: 844 [07/07/2021-20:01:00] [V] [TRT] node_of_844 [Mul] outputs: [844 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_845 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_845 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_845 [Constant] outputs: [845 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_846 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_846 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_846 [Constant] outputs: [846 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_847 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_847 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_847 [Constant] outputs: [847 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_848 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_848 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_848 [Constant] outputs: [848 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_849 [Slice] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 785 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 846 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 847 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 845 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 848 [07/07/2021-20:01:00] [V] [TRT] node_of_849 [Slice] inputs: [785 -> (2, 6, 26, 26)], [846 -> (1)], [847 -> (1)], [845 -> (1)], [848 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_849 for ONNX node: node_of_849 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 849 for ONNX tensor: 849 [07/07/2021-20:01:00] [V] [TRT] node_of_849 [Slice] outputs: [849 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_850 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_850 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_850 [Constant] outputs: [850 -> (1, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_851 [Add] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 849 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 850 [07/07/2021-20:01:00] [V] [TRT] node_of_851 [Add] inputs: [849 -> (2, 1, 26, 26)], [850 -> (1, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 850 for ONNX node: 850 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_851 for ONNX node: node_of_851 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 851 for ONNX tensor: 851 [07/07/2021-20:01:00] [V] [TRT] node_of_851 [Add] outputs: [851 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_852 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_852 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_852 [Constant] outputs: [852 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_853 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_853 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_853 [Constant] outputs: [853 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_854 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_854 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_854 [Constant] outputs: [854 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_855 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_855 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_855 [Constant] outputs: [855 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_856 [Slice] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 785 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 853 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 854 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 852 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 855 [07/07/2021-20:01:00] [V] [TRT] node_of_856 [Slice] inputs: [785 -> (2, 6, 26, 26)], [853 -> (1)], [854 -> (1)], [852 -> (1)], [855 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_856 for ONNX node: node_of_856 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 856 for ONNX tensor: 856 [07/07/2021-20:01:00] [V] [TRT] node_of_856 [Slice] outputs: [856 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_857 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_857 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_857 [Constant] outputs: [857 -> (1, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_858 [Add] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 856 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 857 [07/07/2021-20:01:00] [V] [TRT] node_of_858 [Add] inputs: [856 -> (2, 1, 26, 26)], [857 -> (1, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 857 for ONNX node: 857 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_858 for ONNX node: node_of_858 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 858 for ONNX tensor: 858 [07/07/2021-20:01:00] [V] [TRT] node_of_858 [Add] outputs: [858 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_859 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_859 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_859 [Constant] outputs: [859 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_860 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_860 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_860 [Constant] outputs: [860 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_861 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_861 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_861 [Constant] outputs: [861 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_862 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_862 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_862 [Constant] outputs: [862 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_863 [Slice] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 786 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 860 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 861 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 859 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 862 [07/07/2021-20:01:00] [V] [TRT] node_of_863 [Slice] inputs: [786 -> (2, 6, 26, 26)], [860 -> (1)], [861 -> (1)], [859 -> (1)], [862 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_863 for ONNX node: node_of_863 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 863 for ONNX tensor: 863 [07/07/2021-20:01:00] [V] [TRT] node_of_863 [Slice] outputs: [863 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_864 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_864 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_864 [Constant] outputs: [864 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_865 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 863 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 864 [07/07/2021-20:01:00] [V] [TRT] node_of_865 [Mul] inputs: [863 -> (2, 1, 26, 26)], [864 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 864 for ONNX node: 864 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_865 for ONNX node: node_of_865 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 865 for ONNX tensor: 865 [07/07/2021-20:01:00] [V] [TRT] node_of_865 [Mul] outputs: [865 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_866 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_866 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_866 [Constant] outputs: [866 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_867 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_867 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_867 [Constant] outputs: [867 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_868 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_868 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_868 [Constant] outputs: [868 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_869 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_869 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_869 [Constant] outputs: [869 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_870 [Slice] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 786 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 867 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 868 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 866 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 869 [07/07/2021-20:01:00] [V] [TRT] node_of_870 [Slice] inputs: [786 -> (2, 6, 26, 26)], [867 -> (1)], [868 -> (1)], [866 -> (1)], [869 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_870 for ONNX node: node_of_870 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 870 for ONNX tensor: 870 [07/07/2021-20:01:00] [V] [TRT] node_of_870 [Slice] outputs: [870 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_871 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_871 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_871 [Constant] outputs: [871 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_872 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 870 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 871 [07/07/2021-20:01:00] [V] [TRT] node_of_872 [Mul] inputs: [870 -> (2, 1, 26, 26)], [871 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 871 for ONNX node: 871 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_872 for ONNX node: node_of_872 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 872 for ONNX tensor: 872 [07/07/2021-20:01:00] [V] [TRT] node_of_872 [Mul] outputs: [872 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_873 [Concat] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 795 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 823 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 851 [07/07/2021-20:01:00] [V] [TRT] node_of_873 [Concat] inputs: [795 -> (2, 1, 26, 26)], [823 -> (2, 1, 26, 26)], [851 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_873 for ONNX node: node_of_873 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 873 for ONNX tensor: 873 [07/07/2021-20:01:00] [V] [TRT] node_of_873 [Concat] outputs: [873 -> (2, 3, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_874 [Concat] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 802 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 830 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 858 [07/07/2021-20:01:00] [V] [TRT] node_of_874 [Concat] inputs: [802 -> (2, 1, 26, 26)], [830 -> (2, 1, 26, 26)], [858 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_874 for ONNX node: node_of_874 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 874 for ONNX tensor: 874 [07/07/2021-20:01:00] [V] [TRT] node_of_874 [Concat] outputs: [874 -> (2, 3, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_875 [Concat] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 809 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 837 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 865 [07/07/2021-20:01:00] [V] [TRT] node_of_875 [Concat] inputs: [809 -> (2, 1, 26, 26)], [837 -> (2, 1, 26, 26)], [865 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_875 for ONNX node: node_of_875 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 875 for ONNX tensor: 875 [07/07/2021-20:01:00] [V] [TRT] node_of_875 [Concat] outputs: [875 -> (2, 3, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_876 [Concat] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 816 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 844 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 872 [07/07/2021-20:01:00] [V] [TRT] node_of_876 [Concat] inputs: [816 -> (2, 1, 26, 26)], [844 -> (2, 1, 26, 26)], [872 -> (2, 1, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_876 for ONNX node: node_of_876 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 876 for ONNX tensor: 876 [07/07/2021-20:01:00] [V] [TRT] node_of_876 [Concat] outputs: [876 -> (2, 3, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_877 [Concat] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 873 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 875 [07/07/2021-20:01:00] [V] [TRT] node_of_877 [Concat] inputs: [873 -> (2, 3, 26, 26)], [875 -> (2, 3, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_877 for ONNX node: node_of_877 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 877 for ONNX tensor: 877 [07/07/2021-20:01:00] [V] [TRT] node_of_877 [Concat] outputs: [877 -> (2, 6, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_878 [Concat] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 874 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 876 [07/07/2021-20:01:00] [V] [TRT] node_of_878 [Concat] inputs: [874 -> (2, 3, 26, 26)], [876 -> (2, 3, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_878 for ONNX node: node_of_878 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 878 for ONNX tensor: 878 [07/07/2021-20:01:00] [V] [TRT] node_of_878 [Concat] outputs: [878 -> (2, 6, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_879 [Shape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 663 [07/07/2021-20:01:00] [V] [TRT] node_of_879 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_879 for ONNX node: node_of_879 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 879 for ONNX tensor: 879 [07/07/2021-20:01:00] [V] [TRT] node_of_879 [Shape] outputs: [879 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_880 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_880 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_880 [Constant] outputs: [880 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_881 [Gather] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 879 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 880 [07/07/2021-20:01:00] [V] [TRT] node_of_881 [Gather] inputs: [879 -> (4)], [880 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 880 for ONNX node: 880 [07/07/2021-20:01:00] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_881 for ONNX node: node_of_881 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 881 for ONNX tensor: 881 [07/07/2021-20:01:00] [V] [TRT] node_of_881 [Gather] outputs: [881 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_882 [Cast] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 881 [07/07/2021-20:01:00] [V] [TRT] node_of_882 [Cast] inputs: [881 -> ()], [07/07/2021-20:01:00] [V] [TRT] Casting to type: float32 [07/07/2021-20:01:00] [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_882 for ONNX node: node_of_882 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 882 for ONNX tensor: 882 [07/07/2021-20:01:00] [V] [TRT] node_of_882 [Cast] outputs: [882 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_883 [Div] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 877 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 882 [07/07/2021-20:01:00] [V] [TRT] node_of_883 [Div] inputs: [877 -> (2, 6, 26, 26)], [882 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_883 for ONNX node: node_of_883 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 883 for ONNX tensor: 883 [07/07/2021-20:01:00] [V] [TRT] node_of_883 [Div] outputs: [883 -> (2, 6, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_884 [Shape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 663 [07/07/2021-20:01:00] [V] [TRT] node_of_884 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_884 for ONNX node: node_of_884 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 884 for ONNX tensor: 884 [07/07/2021-20:01:00] [V] [TRT] node_of_884 [Shape] outputs: [884 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_885 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_885 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_885 [Constant] outputs: [885 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_886 [Gather] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 884 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 885 [07/07/2021-20:01:00] [V] [TRT] node_of_886 [Gather] inputs: [884 -> (4)], [885 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 885 for ONNX node: 885 [07/07/2021-20:01:00] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_886 for ONNX node: node_of_886 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 886 for ONNX tensor: 886 [07/07/2021-20:01:00] [V] [TRT] node_of_886 [Gather] outputs: [886 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_887 [Cast] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 886 [07/07/2021-20:01:00] [V] [TRT] node_of_887 [Cast] inputs: [886 -> ()], [07/07/2021-20:01:00] [V] [TRT] Casting to type: float32 [07/07/2021-20:01:00] [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_887 for ONNX node: node_of_887 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 887 for ONNX tensor: 887 [07/07/2021-20:01:00] [V] [TRT] node_of_887 [Cast] outputs: [887 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_888 [Div] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 878 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 887 [07/07/2021-20:01:00] [V] [TRT] node_of_888 [Div] inputs: [878 -> (2, 6, 26, 26)], [887 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_888 for ONNX node: node_of_888 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 888 for ONNX tensor: 888 [07/07/2021-20:01:00] [V] [TRT] node_of_888 [Div] outputs: [888 -> (2, 6, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_889 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_889 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_889 [Constant] outputs: [889 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_890 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_890 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_890 [Constant] outputs: [890 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_891 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_891 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_891 [Constant] outputs: [891 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_892 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_892 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_892 [Constant] outputs: [892 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_893 [Slice] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 883 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 890 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 891 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 889 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 892 [07/07/2021-20:01:00] [V] [TRT] node_of_893 [Slice] inputs: [883 -> (2, 6, 26, 26)], [890 -> (1)], [891 -> (1)], [889 -> (1)], [892 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_893 for ONNX node: node_of_893 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 893 for ONNX tensor: 893 [07/07/2021-20:01:00] [V] [TRT] node_of_893 [Slice] outputs: [893 -> (2, 3, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_894 [Shape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 663 [07/07/2021-20:01:00] [V] [TRT] node_of_894 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_894 for ONNX node: node_of_894 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 894 for ONNX tensor: 894 [07/07/2021-20:01:00] [V] [TRT] node_of_894 [Shape] outputs: [894 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_895 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_895 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_895 [Constant] outputs: [895 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_896 [Gather] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 894 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 895 [07/07/2021-20:01:00] [V] [TRT] node_of_896 [Gather] inputs: [894 -> (4)], [895 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 895 for ONNX node: 895 [07/07/2021-20:01:00] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_896 for ONNX node: node_of_896 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 896 for ONNX tensor: 896 [07/07/2021-20:01:00] [V] [TRT] node_of_896 [Gather] outputs: [896 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_897 [Shape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 663 [07/07/2021-20:01:00] [V] [TRT] node_of_897 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_897 for ONNX node: node_of_897 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 897 for ONNX tensor: 897 [07/07/2021-20:01:00] [V] [TRT] node_of_897 [Shape] outputs: [897 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_898 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_898 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_898 [Constant] outputs: [898 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_899 [Gather] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 897 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 898 [07/07/2021-20:01:00] [V] [TRT] node_of_899 [Gather] inputs: [897 -> (4)], [898 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 898 for ONNX node: 898 [07/07/2021-20:01:00] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_899 for ONNX node: node_of_899 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 899 for ONNX tensor: 899 [07/07/2021-20:01:00] [V] [TRT] node_of_899 [Gather] outputs: [899 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_900 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_900 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_900 [Constant] outputs: [900 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_901 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 899 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 900 [07/07/2021-20:01:00] [V] [TRT] node_of_901 [Mul] inputs: [899 -> ()], [900 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 900 for ONNX node: 900 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_901 for ONNX node: node_of_901 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 901 for ONNX tensor: 901 [07/07/2021-20:01:00] [V] [TRT] node_of_901 [Mul] outputs: [901 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_902 [Shape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 663 [07/07/2021-20:01:00] [V] [TRT] node_of_902 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_902 for ONNX node: node_of_902 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 902 for ONNX tensor: 902 [07/07/2021-20:01:00] [V] [TRT] node_of_902 [Shape] outputs: [902 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_903 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_903 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_903 [Constant] outputs: [903 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_904 [Gather] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 902 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 903 [07/07/2021-20:01:00] [V] [TRT] node_of_904 [Gather] inputs: [902 -> (4)], [903 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 903 for ONNX node: 903 [07/07/2021-20:01:00] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_904 for ONNX node: node_of_904 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 904 for ONNX tensor: 904 [07/07/2021-20:01:00] [V] [TRT] node_of_904 [Gather] outputs: [904 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_905 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 901 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 904 [07/07/2021-20:01:00] [V] [TRT] node_of_905 [Mul] inputs: [901 -> ()], [904 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_905 for ONNX node: node_of_905 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 905 for ONNX tensor: 905 [07/07/2021-20:01:00] [V] [TRT] node_of_905 [Mul] outputs: [905 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_907 [Unsqueeze] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 896 [07/07/2021-20:01:00] [V] [TRT] node_of_907 [Unsqueeze] inputs: [896 -> ()], [07/07/2021-20:01:00] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_907 for ONNX node: node_of_907 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 907 for ONNX tensor: 907 [07/07/2021-20:01:00] [V] [TRT] node_of_907 [Unsqueeze] outputs: [907 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_908 [Unsqueeze] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 905 [07/07/2021-20:01:00] [V] [TRT] node_of_908 [Unsqueeze] inputs: [905 -> ()], [07/07/2021-20:01:00] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_908 for ONNX node: node_of_908 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 908 for ONNX tensor: 908 [07/07/2021-20:01:00] [V] [TRT] node_of_908 [Unsqueeze] outputs: [908 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_910 [Concat] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 907 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 908 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1051 [07/07/2021-20:01:00] [V] [TRT] node_of_910 [Concat] inputs: [907 -> (1)], [908 -> (1)], [1051 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 1051 for ONNX node: 1051 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_910 for ONNX node: node_of_910 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 910 for ONNX tensor: 910 [07/07/2021-20:01:00] [V] [TRT] node_of_910 [Concat] outputs: [910 -> (3)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_911 [Reshape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 893 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 910 [07/07/2021-20:01:00] [V] [TRT] node_of_911 [Reshape] inputs: [893 -> (2, 3, 26, 26)], [910 -> (3)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_911 for ONNX node: node_of_911 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 911 for ONNX tensor: 911 [07/07/2021-20:01:00] [V] [TRT] node_of_911 [Reshape] outputs: [911 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_912 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_912 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_912 [Constant] outputs: [912 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_913 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_913 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_913 [Constant] outputs: [913 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_914 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_914 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_914 [Constant] outputs: [914 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_915 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_915 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_915 [Constant] outputs: [915 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_916 [Slice] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 888 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 913 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 914 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 912 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 915 [07/07/2021-20:01:00] [V] [TRT] node_of_916 [Slice] inputs: [888 -> (2, 6, 26, 26)], [913 -> (1)], [914 -> (1)], [912 -> (1)], [915 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_916 for ONNX node: node_of_916 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 916 for ONNX tensor: 916 [07/07/2021-20:01:00] [V] [TRT] node_of_916 [Slice] outputs: [916 -> (2, 3, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_917 [Shape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 663 [07/07/2021-20:01:00] [V] [TRT] node_of_917 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_917 for ONNX node: node_of_917 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 917 for ONNX tensor: 917 [07/07/2021-20:01:00] [V] [TRT] node_of_917 [Shape] outputs: [917 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_918 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_918 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_918 [Constant] outputs: [918 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_919 [Gather] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 917 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 918 [07/07/2021-20:01:00] [V] [TRT] node_of_919 [Gather] inputs: [917 -> (4)], [918 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 918 for ONNX node: 918 [07/07/2021-20:01:00] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_919 for ONNX node: node_of_919 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 919 for ONNX tensor: 919 [07/07/2021-20:01:00] [V] [TRT] node_of_919 [Gather] outputs: [919 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_920 [Shape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 663 [07/07/2021-20:01:00] [V] [TRT] node_of_920 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_920 for ONNX node: node_of_920 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 920 for ONNX tensor: 920 [07/07/2021-20:01:00] [V] [TRT] node_of_920 [Shape] outputs: [920 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_921 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_921 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_921 [Constant] outputs: [921 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_922 [Gather] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 920 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 921 [07/07/2021-20:01:00] [V] [TRT] node_of_922 [Gather] inputs: [920 -> (4)], [921 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 921 for ONNX node: 921 [07/07/2021-20:01:00] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_922 for ONNX node: node_of_922 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 922 for ONNX tensor: 922 [07/07/2021-20:01:00] [V] [TRT] node_of_922 [Gather] outputs: [922 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_923 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_923 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_923 [Constant] outputs: [923 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_924 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 922 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 923 [07/07/2021-20:01:00] [V] [TRT] node_of_924 [Mul] inputs: [922 -> ()], [923 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 923 for ONNX node: 923 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_924 for ONNX node: node_of_924 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 924 for ONNX tensor: 924 [07/07/2021-20:01:00] [V] [TRT] node_of_924 [Mul] outputs: [924 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_925 [Shape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 663 [07/07/2021-20:01:00] [V] [TRT] node_of_925 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_925 for ONNX node: node_of_925 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 925 for ONNX tensor: 925 [07/07/2021-20:01:00] [V] [TRT] node_of_925 [Shape] outputs: [925 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_926 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_926 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_926 [Constant] outputs: [926 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_927 [Gather] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 925 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 926 [07/07/2021-20:01:00] [V] [TRT] node_of_927 [Gather] inputs: [925 -> (4)], [926 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 926 for ONNX node: 926 [07/07/2021-20:01:00] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_927 for ONNX node: node_of_927 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 927 for ONNX tensor: 927 [07/07/2021-20:01:00] [V] [TRT] node_of_927 [Gather] outputs: [927 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_928 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 924 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 927 [07/07/2021-20:01:00] [V] [TRT] node_of_928 [Mul] inputs: [924 -> ()], [927 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_928 for ONNX node: node_of_928 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 928 for ONNX tensor: 928 [07/07/2021-20:01:00] [V] [TRT] node_of_928 [Mul] outputs: [928 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_930 [Unsqueeze] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 919 [07/07/2021-20:01:00] [V] [TRT] node_of_930 [Unsqueeze] inputs: [919 -> ()], [07/07/2021-20:01:00] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_930 for ONNX node: node_of_930 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 930 for ONNX tensor: 930 [07/07/2021-20:01:00] [V] [TRT] node_of_930 [Unsqueeze] outputs: [930 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_931 [Unsqueeze] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 928 [07/07/2021-20:01:00] [V] [TRT] node_of_931 [Unsqueeze] inputs: [928 -> ()], [07/07/2021-20:01:00] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_931 for ONNX node: node_of_931 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 931 for ONNX tensor: 931 [07/07/2021-20:01:00] [V] [TRT] node_of_931 [Unsqueeze] outputs: [931 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_933 [Concat] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 930 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 931 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1052 [07/07/2021-20:01:00] [V] [TRT] node_of_933 [Concat] inputs: [930 -> (1)], [931 -> (1)], [1052 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 1052 for ONNX node: 1052 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_933 for ONNX node: node_of_933 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 933 for ONNX tensor: 933 [07/07/2021-20:01:00] [V] [TRT] node_of_933 [Concat] outputs: [933 -> (3)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_934 [Reshape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 916 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 933 [07/07/2021-20:01:00] [V] [TRT] node_of_934 [Reshape] inputs: [916 -> (2, 3, 26, 26)], [933 -> (3)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_934 for ONNX node: node_of_934 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 934 for ONNX tensor: 934 [07/07/2021-20:01:00] [V] [TRT] node_of_934 [Reshape] outputs: [934 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_935 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_935 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_935 [Constant] outputs: [935 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_936 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_936 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_936 [Constant] outputs: [936 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_937 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_937 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/07/2021-20:01:00] [07/07/2021-20:01:00] [V] [TRT] node_of_937 [Constant] outputs: [937 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_938 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_938 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_938 [Constant] outputs: [938 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_939 [Slice] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 883 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 936 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 937 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 935 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 938 [07/07/2021-20:01:00] [V] [TRT] node_of_939 [Slice] inputs: [883 -> (2, 6, 26, 26)], [936 -> (1)], [937 -> (1)], [935 -> (1)], [938 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_939 for ONNX node: node_of_939 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 939 for ONNX tensor: 939 [07/07/2021-20:01:00] [V] [TRT] node_of_939 [Slice] outputs: [939 -> (2, 3, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_940 [Shape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 663 [07/07/2021-20:01:00] [V] [TRT] node_of_940 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_940 for ONNX node: node_of_940 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 940 for ONNX tensor: 940 [07/07/2021-20:01:00] [V] [TRT] node_of_940 [Shape] outputs: [940 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_941 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_941 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_941 [Constant] outputs: [941 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_942 [Gather] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 940 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 941 [07/07/2021-20:01:00] [V] [TRT] node_of_942 [Gather] inputs: [940 -> (4)], [941 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 941 for ONNX node: 941 [07/07/2021-20:01:00] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_942 for ONNX node: node_of_942 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 942 for ONNX tensor: 942 [07/07/2021-20:01:00] [V] [TRT] node_of_942 [Gather] outputs: [942 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_943 [Shape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 663 [07/07/2021-20:01:00] [V] [TRT] node_of_943 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_943 for ONNX node: node_of_943 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 943 for ONNX tensor: 943 [07/07/2021-20:01:00] [V] [TRT] node_of_943 [Shape] outputs: [943 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_944 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_944 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_944 [Constant] outputs: [944 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_945 [Gather] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 943 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 944 [07/07/2021-20:01:00] [V] [TRT] node_of_945 [Gather] inputs: [943 -> (4)], [944 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 944 for ONNX node: 944 [07/07/2021-20:01:00] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_945 for ONNX node: node_of_945 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 945 for ONNX tensor: 945 [07/07/2021-20:01:00] [V] [TRT] node_of_945 [Gather] outputs: [945 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_946 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_946 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_946 [Constant] outputs: [946 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_947 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 945 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 946 [07/07/2021-20:01:00] [V] [TRT] node_of_947 [Mul] inputs: [945 -> ()], [946 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 946 for ONNX node: 946 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_947 for ONNX node: node_of_947 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 947 for ONNX tensor: 947 [07/07/2021-20:01:00] [V] [TRT] node_of_947 [Mul] outputs: [947 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_948 [Shape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 663 [07/07/2021-20:01:00] [V] [TRT] node_of_948 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_948 for ONNX node: node_of_948 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 948 for ONNX tensor: 948 [07/07/2021-20:01:00] [V] [TRT] node_of_948 [Shape] outputs: [948 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_949 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_949 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_949 [Constant] outputs: [949 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_950 [Gather] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 948 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 949 [07/07/2021-20:01:00] [V] [TRT] node_of_950 [Gather] inputs: [948 -> (4)], [949 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 949 for ONNX node: 949 [07/07/2021-20:01:00] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_950 for ONNX node: node_of_950 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 950 for ONNX tensor: 950 [07/07/2021-20:01:00] [V] [TRT] node_of_950 [Gather] outputs: [950 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_951 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 947 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 950 [07/07/2021-20:01:00] [V] [TRT] node_of_951 [Mul] inputs: [947 -> ()], [950 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_951 for ONNX node: node_of_951 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 951 for ONNX tensor: 951 [07/07/2021-20:01:00] [V] [TRT] node_of_951 [Mul] outputs: [951 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_953 [Unsqueeze] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 942 [07/07/2021-20:01:00] [V] [TRT] node_of_953 [Unsqueeze] inputs: [942 -> ()], [07/07/2021-20:01:00] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_953 for ONNX node: node_of_953 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 953 for ONNX tensor: 953 [07/07/2021-20:01:00] [V] [TRT] node_of_953 [Unsqueeze] outputs: [953 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_954 [Unsqueeze] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 951 [07/07/2021-20:01:00] [V] [TRT] node_of_954 [Unsqueeze] inputs: [951 -> ()], [07/07/2021-20:01:00] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_954 for ONNX node: node_of_954 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 954 for ONNX tensor: 954 [07/07/2021-20:01:00] [V] [TRT] node_of_954 [Unsqueeze] outputs: [954 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_956 [Concat] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 953 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 954 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1053 [07/07/2021-20:01:00] [V] [TRT] node_of_956 [Concat] inputs: [953 -> (1)], [954 -> (1)], [1053 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 1053 for ONNX node: 1053 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_956 for ONNX node: node_of_956 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 956 for ONNX tensor: 956 [07/07/2021-20:01:00] [V] [TRT] node_of_956 [Concat] outputs: [956 -> (3)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_957 [Reshape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 939 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 956 [07/07/2021-20:01:00] [V] [TRT] node_of_957 [Reshape] inputs: [939 -> (2, 3, 26, 26)], [956 -> (3)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_957 for ONNX node: node_of_957 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 957 for ONNX tensor: 957 [07/07/2021-20:01:00] [V] [TRT] node_of_957 [Reshape] outputs: [957 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_958 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_958 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_958 [Constant] outputs: [958 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_959 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_959 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_959 [Constant] outputs: [959 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_960 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_960 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/07/2021-20:01:00] [07/07/2021-20:01:00] [V] [TRT] node_of_960 [Constant] outputs: [960 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_961 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_961 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_961 [Constant] outputs: [961 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_962 [Slice] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 888 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 959 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 960 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 958 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 961 [07/07/2021-20:01:00] [V] [TRT] node_of_962 [Slice] inputs: [888 -> (2, 6, 26, 26)], [959 -> (1)], [960 -> (1)], [958 -> (1)], [961 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_962 for ONNX node: node_of_962 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 962 for ONNX tensor: 962 [07/07/2021-20:01:00] [V] [TRT] node_of_962 [Slice] outputs: [962 -> (2, 3, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_963 [Shape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 663 [07/07/2021-20:01:00] [V] [TRT] node_of_963 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_963 for ONNX node: node_of_963 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 963 for ONNX tensor: 963 [07/07/2021-20:01:00] [V] [TRT] node_of_963 [Shape] outputs: [963 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_964 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_964 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_964 [Constant] outputs: [964 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_965 [Gather] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 963 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 964 [07/07/2021-20:01:00] [V] [TRT] node_of_965 [Gather] inputs: [963 -> (4)], [964 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 964 for ONNX node: 964 [07/07/2021-20:01:00] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_965 for ONNX node: node_of_965 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 965 for ONNX tensor: 965 [07/07/2021-20:01:00] [V] [TRT] node_of_965 [Gather] outputs: [965 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_966 [Shape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 663 [07/07/2021-20:01:00] [V] [TRT] node_of_966 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_966 for ONNX node: node_of_966 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 966 for ONNX tensor: 966 [07/07/2021-20:01:00] [V] [TRT] node_of_966 [Shape] outputs: [966 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_967 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_967 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_967 [Constant] outputs: [967 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_968 [Gather] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 966 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 967 [07/07/2021-20:01:00] [V] [TRT] node_of_968 [Gather] inputs: [966 -> (4)], [967 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 967 for ONNX node: 967 [07/07/2021-20:01:00] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_968 for ONNX node: node_of_968 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 968 for ONNX tensor: 968 [07/07/2021-20:01:00] [V] [TRT] node_of_968 [Gather] outputs: [968 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_969 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_969 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_969 [Constant] outputs: [969 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_970 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 968 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 969 [07/07/2021-20:01:00] [V] [TRT] node_of_970 [Mul] inputs: [968 -> ()], [969 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 969 for ONNX node: 969 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_970 for ONNX node: node_of_970 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 970 for ONNX tensor: 970 [07/07/2021-20:01:00] [V] [TRT] node_of_970 [Mul] outputs: [970 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_971 [Shape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 663 [07/07/2021-20:01:00] [V] [TRT] node_of_971 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_971 for ONNX node: node_of_971 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 971 for ONNX tensor: 971 [07/07/2021-20:01:00] [V] [TRT] node_of_971 [Shape] outputs: [971 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_972 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_972 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_972 [Constant] outputs: [972 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_973 [Gather] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 971 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 972 [07/07/2021-20:01:00] [V] [TRT] node_of_973 [Gather] inputs: [971 -> (4)], [972 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 972 for ONNX node: 972 [07/07/2021-20:01:00] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_973 for ONNX node: node_of_973 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 973 for ONNX tensor: 973 [07/07/2021-20:01:00] [V] [TRT] node_of_973 [Gather] outputs: [973 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_974 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 970 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 973 [07/07/2021-20:01:00] [V] [TRT] node_of_974 [Mul] inputs: [970 -> ()], [973 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_974 for ONNX node: node_of_974 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 974 for ONNX tensor: 974 [07/07/2021-20:01:00] [V] [TRT] node_of_974 [Mul] outputs: [974 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_976 [Unsqueeze] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 965 [07/07/2021-20:01:00] [V] [TRT] node_of_976 [Unsqueeze] inputs: [965 -> ()], [07/07/2021-20:01:00] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_976 for ONNX node: node_of_976 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 976 for ONNX tensor: 976 [07/07/2021-20:01:00] [V] [TRT] node_of_976 [Unsqueeze] outputs: [976 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_977 [Unsqueeze] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 974 [07/07/2021-20:01:00] [V] [TRT] node_of_977 [Unsqueeze] inputs: [974 -> ()], [07/07/2021-20:01:00] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_977 for ONNX node: node_of_977 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 977 for ONNX tensor: 977 [07/07/2021-20:01:00] [V] [TRT] node_of_977 [Unsqueeze] outputs: [977 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_979 [Concat] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 976 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 977 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1054 [07/07/2021-20:01:00] [V] [TRT] node_of_979 [Concat] inputs: [976 -> (1)], [977 -> (1)], [1054 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 1054 for ONNX node: 1054 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_979 for ONNX node: node_of_979 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 979 for ONNX tensor: 979 [07/07/2021-20:01:00] [V] [TRT] node_of_979 [Concat] outputs: [979 -> (3)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_980 [Reshape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 962 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 979 [07/07/2021-20:01:00] [V] [TRT] node_of_980 [Reshape] inputs: [962 -> (2, 3, 26, 26)], [979 -> (3)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_980 for ONNX node: node_of_980 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 980 for ONNX tensor: 980 [07/07/2021-20:01:00] [V] [TRT] node_of_980 [Reshape] outputs: [980 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_981 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_981 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_981 [Constant] outputs: [981 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_982 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 957 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 981 [07/07/2021-20:01:00] [V] [TRT] node_of_982 [Mul] inputs: [957 -> (2, 2028, 1)], [981 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 981 for ONNX node: 981 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_982 for ONNX node: node_of_982 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 982 for ONNX tensor: 982 [07/07/2021-20:01:00] [V] [TRT] node_of_982 [Mul] outputs: [982 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_983 [Sub] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 911 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 982 [07/07/2021-20:01:00] [V] [TRT] node_of_983 [Sub] inputs: [911 -> (2, 2028, 1)], [982 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_983 for ONNX node: node_of_983 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 983 for ONNX tensor: 983 [07/07/2021-20:01:00] [V] [TRT] node_of_983 [Sub] outputs: [983 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_984 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_984 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_984 [Constant] outputs: [984 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_985 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 980 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 984 [07/07/2021-20:01:00] [V] [TRT] node_of_985 [Mul] inputs: [980 -> (2, 2028, 1)], [984 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 984 for ONNX node: 984 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_985 for ONNX node: node_of_985 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 985 for ONNX tensor: 985 [07/07/2021-20:01:00] [V] [TRT] node_of_985 [Mul] outputs: [985 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_986 [Sub] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 934 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 985 [07/07/2021-20:01:00] [V] [TRT] node_of_986 [Sub] inputs: [934 -> (2, 2028, 1)], [985 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_986 for ONNX node: node_of_986 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 986 for ONNX tensor: 986 [07/07/2021-20:01:00] [V] [TRT] node_of_986 [Sub] outputs: [986 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_987 [Add] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 983 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 957 [07/07/2021-20:01:00] [V] [TRT] node_of_987 [Add] inputs: [983 -> (2, 2028, 1)], [957 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_987 for ONNX node: node_of_987 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 987 for ONNX tensor: 987 [07/07/2021-20:01:00] [V] [TRT] node_of_987 [Add] outputs: [987 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_988 [Add] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 986 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 980 [07/07/2021-20:01:00] [V] [TRT] node_of_988 [Add] inputs: [986 -> (2, 2028, 1)], [980 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_988 for ONNX node: node_of_988 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 988 for ONNX tensor: 988 [07/07/2021-20:01:00] [V] [TRT] node_of_988 [Add] outputs: [988 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_989 [Concat] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 983 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 986 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 987 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 988 [07/07/2021-20:01:00] [V] [TRT] node_of_989 [Concat] inputs: [983 -> (2, 2028, 1)], [986 -> (2, 2028, 1)], [987 -> (2, 2028, 1)], [988 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_989 for ONNX node: node_of_989 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 989 for ONNX tensor: 989 [07/07/2021-20:01:00] [V] [TRT] node_of_989 [Concat] outputs: [989 -> (2, 2028, 4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_990 [Shape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 663 [07/07/2021-20:01:00] [V] [TRT] node_of_990 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_990 for ONNX node: node_of_990 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 990 for ONNX tensor: 990 [07/07/2021-20:01:00] [V] [TRT] node_of_990 [Shape] outputs: [990 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_991 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_991 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_991 [Constant] outputs: [991 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_992 [Gather] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 990 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 991 [07/07/2021-20:01:00] [V] [TRT] node_of_992 [Gather] inputs: [990 -> (4)], [991 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 991 for ONNX node: 991 [07/07/2021-20:01:00] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_992 for ONNX node: node_of_992 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 992 for ONNX tensor: 992 [07/07/2021-20:01:00] [V] [TRT] node_of_992 [Gather] outputs: [992 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_993 [Shape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 663 [07/07/2021-20:01:00] [V] [TRT] node_of_993 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_993 for ONNX node: node_of_993 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 993 for ONNX tensor: 993 [07/07/2021-20:01:00] [V] [TRT] node_of_993 [Shape] outputs: [993 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_994 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_994 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_994 [Constant] outputs: [994 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_995 [Gather] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 993 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 994 [07/07/2021-20:01:00] [V] [TRT] node_of_995 [Gather] inputs: [993 -> (4)], [994 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 994 for ONNX node: 994 [07/07/2021-20:01:00] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_995 for ONNX node: node_of_995 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 995 for ONNX tensor: 995 [07/07/2021-20:01:00] [V] [TRT] node_of_995 [Gather] outputs: [995 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_996 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_996 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_996 [Constant] outputs: [996 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_997 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 995 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 996 [07/07/2021-20:01:00] [V] [TRT] node_of_997 [Mul] inputs: [995 -> ()], [996 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 996 for ONNX node: 996 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_997 for ONNX node: node_of_997 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 997 for ONNX tensor: 997 [07/07/2021-20:01:00] [V] [TRT] node_of_997 [Mul] outputs: [997 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_998 [Shape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 663 [07/07/2021-20:01:00] [V] [TRT] node_of_998 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_998 for ONNX node: node_of_998 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 998 for ONNX tensor: 998 [07/07/2021-20:01:00] [V] [TRT] node_of_998 [Shape] outputs: [998 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_999 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_999 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_999 [Constant] outputs: [999 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1000 [Gather] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 998 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 999 [07/07/2021-20:01:00] [V] [TRT] node_of_1000 [Gather] inputs: [998 -> (4)], [999 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 999 for ONNX node: 999 [07/07/2021-20:01:00] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_1000 for ONNX node: node_of_1000 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 1000 for ONNX tensor: 1000 [07/07/2021-20:01:00] [V] [TRT] node_of_1000 [Gather] outputs: [1000 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1001 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 997 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1000 [07/07/2021-20:01:00] [V] [TRT] node_of_1001 [Mul] inputs: [997 -> ()], [1000 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_1001 for ONNX node: node_of_1001 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 1001 for ONNX tensor: 1001 [07/07/2021-20:01:00] [V] [TRT] node_of_1001 [Mul] outputs: [1001 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1004 [Unsqueeze] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 992 [07/07/2021-20:01:00] [V] [TRT] node_of_1004 [Unsqueeze] inputs: [992 -> ()], [07/07/2021-20:01:00] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_1004 for ONNX node: node_of_1004 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 1004 for ONNX tensor: 1004 [07/07/2021-20:01:00] [V] [TRT] node_of_1004 [Unsqueeze] outputs: [1004 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1005 [Unsqueeze] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1001 [07/07/2021-20:01:00] [V] [TRT] node_of_1005 [Unsqueeze] inputs: [1001 -> ()], [07/07/2021-20:01:00] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_1005 for ONNX node: node_of_1005 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 1005 for ONNX tensor: 1005 [07/07/2021-20:01:00] [V] [TRT] node_of_1005 [Unsqueeze] outputs: [1005 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1008 [Concat] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1004 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1005 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1055 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1056 [07/07/2021-20:01:00] [V] [TRT] node_of_1008 [Concat] inputs: [1004 -> (1)], [1005 -> (1)], [1055 -> (1)], [1056 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 1055 for ONNX node: 1055 [07/07/2021-20:01:00] [V] [TRT] Registering layer: 1056 for ONNX node: 1056 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_1008 for ONNX node: node_of_1008 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 1008 for ONNX tensor: 1008 [07/07/2021-20:01:00] [V] [TRT] node_of_1008 [Concat] outputs: [1008 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1009 [Reshape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 989 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1008 [07/07/2021-20:01:00] [V] [TRT] node_of_1009 [Reshape] inputs: [989 -> (2, 2028, 4)], [1008 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_1009 for ONNX node: node_of_1009 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 1009 for ONNX tensor: 1009 [07/07/2021-20:01:00] [V] [TRT] node_of_1009 [Reshape] outputs: [1009 -> (2, 2028, 1, 4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1010 [Shape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 663 [07/07/2021-20:01:00] [V] [TRT] node_of_1010 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_1010 for ONNX node: node_of_1010 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 1010 for ONNX tensor: 1010 [07/07/2021-20:01:00] [V] [TRT] node_of_1010 [Shape] outputs: [1010 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1011 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_1011 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_1011 [Constant] outputs: [1011 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1012 [Gather] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1010 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1011 [07/07/2021-20:01:00] [V] [TRT] node_of_1012 [Gather] inputs: [1010 -> (4)], [1011 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 1011 for ONNX node: 1011 [07/07/2021-20:01:00] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_1012 for ONNX node: node_of_1012 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 1012 for ONNX tensor: 1012 [07/07/2021-20:01:00] [V] [TRT] node_of_1012 [Gather] outputs: [1012 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1013 [Shape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 663 [07/07/2021-20:01:00] [V] [TRT] node_of_1013 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_1013 for ONNX node: node_of_1013 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 1013 for ONNX tensor: 1013 [07/07/2021-20:01:00] [V] [TRT] node_of_1013 [Shape] outputs: [1013 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1014 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_1014 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_1014 [Constant] outputs: [1014 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1015 [Gather] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1013 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1014 [07/07/2021-20:01:00] [V] [TRT] node_of_1015 [Gather] inputs: [1013 -> (4)], [1014 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 1014 for ONNX node: 1014 [07/07/2021-20:01:00] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_1015 for ONNX node: node_of_1015 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 1015 for ONNX tensor: 1015 [07/07/2021-20:01:00] [V] [TRT] node_of_1015 [Gather] outputs: [1015 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1016 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_1016 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_1016 [Constant] outputs: [1016 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1017 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1015 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1016 [07/07/2021-20:01:00] [V] [TRT] node_of_1017 [Mul] inputs: [1015 -> ()], [1016 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 1016 for ONNX node: 1016 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_1017 for ONNX node: node_of_1017 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 1017 for ONNX tensor: 1017 [07/07/2021-20:01:00] [V] [TRT] node_of_1017 [Mul] outputs: [1017 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1018 [Shape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 663 [07/07/2021-20:01:00] [V] [TRT] node_of_1018 [Shape] inputs: [663 -> (2, 18, 26, 26)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_1018 for ONNX node: node_of_1018 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 1018 for ONNX tensor: 1018 [07/07/2021-20:01:00] [V] [TRT] node_of_1018 [Shape] outputs: [1018 -> (4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1019 [Constant] [07/07/2021-20:01:00] [V] [TRT] node_of_1019 [Constant] inputs: [07/07/2021-20:01:00] [V] [TRT] node_of_1019 [Constant] outputs: [1019 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1020 [Gather] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1018 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1019 [07/07/2021-20:01:00] [V] [TRT] node_of_1020 [Gather] inputs: [1018 -> (4)], [1019 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 1019 for ONNX node: 1019 [07/07/2021-20:01:00] [V] [TRT] Using Gather axis: 0 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_1020 for ONNX node: node_of_1020 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 1020 for ONNX tensor: 1020 [07/07/2021-20:01:00] [V] [TRT] node_of_1020 [Gather] outputs: [1020 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1021 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1017 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1020 [07/07/2021-20:01:00] [V] [TRT] node_of_1021 [Mul] inputs: [1017 -> ()], [1020 -> ()], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_1021 for ONNX node: node_of_1021 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 1021 for ONNX tensor: 1021 [07/07/2021-20:01:00] [V] [TRT] node_of_1021 [Mul] outputs: [1021 -> ()], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1023 [Unsqueeze] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1012 [07/07/2021-20:01:00] [V] [TRT] node_of_1023 [Unsqueeze] inputs: [1012 -> ()], [07/07/2021-20:01:00] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_1023 for ONNX node: node_of_1023 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 1023 for ONNX tensor: 1023 [07/07/2021-20:01:00] [V] [TRT] node_of_1023 [Unsqueeze] outputs: [1023 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1024 [Unsqueeze] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1021 [07/07/2021-20:01:00] [V] [TRT] node_of_1024 [Unsqueeze] inputs: [1021 -> ()], [07/07/2021-20:01:00] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_1024 for ONNX node: node_of_1024 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 1024 for ONNX tensor: 1024 [07/07/2021-20:01:00] [V] [TRT] node_of_1024 [Unsqueeze] outputs: [1024 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1026 [Concat] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1023 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1024 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1057 [07/07/2021-20:01:00] [V] [TRT] node_of_1026 [Concat] inputs: [1023 -> (1)], [1024 -> (1)], [1057 -> (1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: 1057 for ONNX node: 1057 [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_1026 for ONNX node: node_of_1026 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 1026 for ONNX tensor: 1026 [07/07/2021-20:01:00] [V] [TRT] node_of_1026 [Concat] outputs: [1026 -> (3)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1027 [Reshape] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 787 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1026 [07/07/2021-20:01:00] [V] [TRT] node_of_1027 [Reshape] inputs: [787 -> (2, 2028)], [1026 -> (3)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_1027 for ONNX node: node_of_1027 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 1027 for ONNX tensor: 1027 [07/07/2021-20:01:00] [V] [TRT] node_of_1027 [Reshape] outputs: [1027 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_1028 [Mul] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 788 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1027 [07/07/2021-20:01:00] [V] [TRT] node_of_1028 [Mul] inputs: [788 -> (2, 2028, 1)], [1027 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_1028 for ONNX node: node_of_1028 [07/07/2021-20:01:00] [V] [TRT] Registering tensor: 1028 for ONNX tensor: 1028 [07/07/2021-20:01:00] [V] [TRT] node_of_1028 [Mul] outputs: [1028 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_boxes [Concat] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 570 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1009 [07/07/2021-20:01:00] [V] [TRT] node_of_boxes [Concat] inputs: [570 -> (2, 507, 1, 4)], [1009 -> (2, 2028, 1, 4)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_boxes for ONNX node: node_of_boxes [07/07/2021-20:01:00] [V] [TRT] Registering tensor: boxes_0 for ONNX tensor: boxes [07/07/2021-20:01:00] [V] [TRT] node_of_boxes [Concat] outputs: [boxes -> (2, 2535, 1, 4)], [07/07/2021-20:01:00] [V] [TRT] Parsing node: node_of_confs [Concat] [07/07/2021-20:01:00] [V] [TRT] Searching for input: 589 [07/07/2021-20:01:00] [V] [TRT] Searching for input: 1028 [07/07/2021-20:01:00] [V] [TRT] node_of_confs [Concat] inputs: [589 -> (2, 507, 1)], [1028 -> (2, 2028, 1)], [07/07/2021-20:01:00] [V] [TRT] Registering layer: node_of_confs for ONNX node: node_of_confs [07/07/2021-20:01:00] [V] [TRT] Registering tensor: confs_1 for ONNX tensor: confs [07/07/2021-20:01:00] [V] [TRT] node_of_confs [Concat] outputs: [confs -> (2, 2535, 1)], [07/07/2021-20:01:00] [V] [TRT] Marking boxes_0 as output: boxes [07/07/2021-20:01:00] [V] [TRT] Marking confs_1 as output: confs [07/07/2021-20:01:00] [I] [TRT] [MemUsageChange] Init CUDA: CPU +0, GPU +0, now: CPU 177, GPU 877 (MiB) [07/07/2021-20:01:00] [I] [TRT] [MemUsageSnapshot] Builder begin: CPU 177 MiB, GPU 877 MiB [07/07/2021-20:01:00] [07/07/2021-20:01:00] [V] [TRT] Applying generic optimizations to the graph for inference. [07/07/2021-20:01:00] [V] [TRT] Original: 291 layers [07/07/2021-20:01:00] [V] [TRT] After dead-layer removal: 291 layers [07/07/2021-20:01:00] [V] [TRT] ConstShuffleFusion: Fusing 343 with (Unnamed Layer* 243) [Shuffle] [07/07/2021-20:01:00] [V] [TRT] ConstShuffleFusion: Fusing 345 with (Unnamed Layer* 246) [Shuffle] [07/07/2021-20:01:00] [V] [TRT] ConstShuffleFusion: Fusing 369 with (Unnamed Layer* 259) [Shuffle] [07/07/2021-20:01:00] [V] [TRT] ConstShuffleFusion: Fusing 376 with (Unnamed Layer* 263) [Shuffle] [07/07/2021-20:01:00] [V] [TRT] ConstShuffleFusion: Fusing 397 with (Unnamed Layer* 273) [Shuffle] [07/07/2021-20:01:00] [V] [TRT] ConstShuffleFusion: Fusing 404 with (Unnamed Layer* 277) [Shuffle] [07/07/2021-20:01:00] [V] [TRT] ConstShuffleFusion: Fusing 425 with (Unnamed Layer* 287) [Shuffle] [07/07/2021-20:01:00] [V] [TRT] ConstShuffleFusion: Fusing 432 with (Unnamed Layer* 291) [Shuffle] [07/07/2021-20:01:00] [V] [TRT] ConstShuffleFusion: Fusing 542 with (Unnamed Layer* 384) [Shuffle] [07/07/2021-20:01:00] [V] [TRT] ConstShuffleFusion: Fusing 545 with (Unnamed Layer* 388) [Shuffle] [07/07/2021-20:01:00] [V] [TRT] ConstShuffleFusion: Fusing 782 with (Unnamed Layer* 574) [Shuffle] [07/07/2021-20:01:00] [V] [TRT] ConstShuffleFusion: Fusing 784 with (Unnamed Layer* 577) [Shuffle] [07/07/2021-20:01:00] [V] [TRT] ConstShuffleFusion: Fusing 808 with (Unnamed Layer* 590) [Shuffle] [07/07/2021-20:01:00] [V] [TRT] ConstShuffleFusion: Fusing 815 with (Unnamed Layer* 594) [Shuffle] [07/07/2021-20:01:00] [V] [TRT] ConstShuffleFusion: Fusing 836 with (Unnamed Layer* 604) [Shuffle] [07/07/2021-20:01:00] [V] [TRT] ConstShuffleFusion: Fusing 843 with (Unnamed Layer* 608) [Shuffle] [07/07/2021-20:01:00] [V] [TRT] ConstShuffleFusion: Fusing 864 with (Unnamed Layer* 618) [Shuffle] [07/07/2021-20:01:00] [V] [TRT] ConstShuffleFusion: Fusing 871 with (Unnamed Layer* 622) [Shuffle] [07/07/2021-20:01:00] [V] [TRT] ConstShuffleFusion: Fusing 981 with (Unnamed Layer* 715) [Shuffle] [07/07/2021-20:01:00] [V] [TRT] ConstShuffleFusion: Fusing 984 with (Unnamed Layer* 719) [Shuffle] [07/07/2021-20:01:00] [V] [TRT] ShuffleShuffleFusion: Fusing node_of_322 with node_of_323 [07/07/2021-20:01:00] [V] [TRT] ShuffleShuffleFusion: Fusing node_of_322 + node_of_323 with node_of_341 [07/07/2021-20:01:00] [V] [TRT] ShuffleShuffleFusion: Fusing node_of_761 with node_of_762 [07/07/2021-20:01:00] [V] [TRT] ShuffleShuffleFusion: Fusing node_of_761 + node_of_762 with node_of_780 [07/07/2021-20:01:00] [V] [TRT] After Myelin optimization: 267 layers [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 343 + (Unnamed Layer* 243) [Shuffle] with node_of_344 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 369 + (Unnamed Layer* 259) [Shuffle] with node_of_370 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 376 + (Unnamed Layer* 263) [Shuffle] with node_of_377 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 397 + (Unnamed Layer* 273) [Shuffle] with node_of_398 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 404 + (Unnamed Layer* 277) [Shuffle] with node_of_405 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 425 + (Unnamed Layer* 287) [Shuffle] with node_of_426 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 432 + (Unnamed Layer* 291) [Shuffle] with node_of_433 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 782 + (Unnamed Layer* 574) [Shuffle] with node_of_783 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 808 + (Unnamed Layer* 590) [Shuffle] with node_of_809 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 815 + (Unnamed Layer* 594) [Shuffle] with node_of_816 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 836 + (Unnamed Layer* 604) [Shuffle] with node_of_837 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 843 + (Unnamed Layer* 608) [Shuffle] with node_of_844 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 864 + (Unnamed Layer* 618) [Shuffle] with node_of_865 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 871 + (Unnamed Layer* 622) [Shuffle] with node_of_872 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 355 with node_of_356 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 362 with node_of_363 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 383 with node_of_384 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 390 with node_of_391 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 411 with node_of_412 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 418 with node_of_419 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 794 with node_of_795 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 801 with node_of_802 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 822 with node_of_823 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 829 with node_of_830 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 850 with node_of_851 [07/07/2021-20:01:00] [V] [TRT] ConstEltFusion: Fusing 857 with node_of_858 [07/07/2021-20:01:00] [V] [TRT] Fusing convolution weights from node_of_119 with scale node_of_120 [07/07/2021-20:01:00] [V] [TRT] Fusing convolution weights from node_of_122 with scale node_of_123 [07/07/2021-20:01:00] [V] [TRT] Fusing convolution weights from node_of_125 with scale node_of_126 [07/07/2021-20:01:00] [V] [TRT] Fusing convolution weights from node_of_143 with scale node_of_144 [07/07/2021-20:01:00] [V] [TRT] Fusing convolution weights from node_of_146 with scale node_of_147 [07/07/2021-20:01:00] [V] [TRT] Fusing convolution weights from node_of_150 with scale node_of_151 [07/07/2021-20:01:00] [V] [TRT] Fusing convolution weights from node_of_155 with scale node_of_156 [07/07/2021-20:01:00] [V] [TRT] Fusing convolution weights from node_of_173 with scale node_of_174 [07/07/2021-20:01:00] [V] [TRT] Fusing convolution weights from node_of_176 with scale node_of_177 [07/07/2021-20:01:00] [V] [TRT] Fusing convolution weights from node_of_180 with scale node_of_181 [07/07/2021-20:01:00] [V] [TRT] Fusing convolution weights from node_of_185 with scale node_of_186 [07/07/2021-20:01:00] [V] [TRT] Fusing convolution weights from node_of_203 with scale node_of_204 [07/07/2021-20:01:00] [V] [TRT] Fusing convolution weights from node_of_206 with scale node_of_207 [07/07/2021-20:01:00] [V] [TRT] Fusing convolution weights from node_of_210 with scale node_of_211 [07/07/2021-20:01:00] [V] [TRT] Fusing convolution weights from node_of_215 with scale node_of_216 [07/07/2021-20:01:00] [V] [TRT] Fusing convolution weights from node_of_218 with scale node_of_219 [07/07/2021-20:01:00] [V] [TRT] Fusing convolution weights from node_of_221 with scale node_of_222 [07/07/2021-20:01:00] [V] [TRT] Fusing convolution weights from node_of_590 with scale node_of_591 [07/07/2021-20:01:00] [V] [TRT] Fusing convolution weights from node_of_660 with scale node_of_661 [07/07/2021-20:01:00] [V] [TRT] After scale fusion: 222 layers [07/07/2021-20:01:00] [V] [TRT] Swap the layer type of node_of_788 from ACTIVATION to POINT_WISE [07/07/2021-20:01:00] [V] [TRT] Swap the layer type of node_of_787 from ACTIVATION to POINT_WISE [07/07/2021-20:01:00] [V] [TRT] Swap the layer type of node_of_781 from ACTIVATION to POINT_WISE [07/07/2021-20:01:00] [V] [TRT] Swap the layer type of node_of_349 from ACTIVATION to POINT_WISE [07/07/2021-20:01:00] [V] [TRT] Swap the layer type of node_of_348 from ACTIVATION to POINT_WISE [07/07/2021-20:01:00] [V] [TRT] Swap the layer type of node_of_342 from ACTIVATION to POINT_WISE [07/07/2021-20:01:00] [V] [TRT] PointWiseFusion: Fusing PWN(node_of_788) with node_of_1028 [07/07/2021-20:01:00] [V] [TRT] PointWiseFusion: Fusing PWN(node_of_781) with 782 + (Unnamed Layer* 574) [Shuffle] + node_of_783 [07/07/2021-20:01:00] [V] [TRT] PointWiseFusion: Fusing PWN(node_of_349) with node_of_589 [07/07/2021-20:01:00] [V] [TRT] PointWiseFusion: Fusing PWN(node_of_342) with 343 + (Unnamed Layer* 243) [Shuffle] + node_of_344 [07/07/2021-20:01:00] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(node_of_781), 782 + (Unnamed Layer* 574) [Shuffle] + node_of_783) with node_of_785 [07/07/2021-20:01:00] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(node_of_342), 343 + (Unnamed Layer* 243) [Shuffle] + node_of_344) with node_of_346 [07/07/2021-20:01:00] [V] [TRT] PointWiseFusion: Fusing 345 + (Unnamed Layer* 246) [Shuffle] with PWN(PWN(PWN(node_of_342), 343 + (Unnamed Layer* 243) [Shuffle] + node_of_344), node_of_346) [07/07/2021-20:01:00] [V] [TRT] PointWiseFusion: Fusing 784 + (Unnamed Layer* 577) [Shuffle] with PWN(PWN(PWN(node_of_781), 782 + (Unnamed Layer* 574) [Shuffle] + node_of_783), node_of_785) [07/07/2021-20:01:00] [V] [TRT] PointWiseFusion: Fusing 542 + (Unnamed Layer* 384) [Shuffle] with node_of_543 [07/07/2021-20:01:00] [V] [TRT] PointWiseFusion: Fusing 545 + (Unnamed Layer* 388) [Shuffle] with node_of_546 [07/07/2021-20:01:00] [V] [TRT] PointWiseFusion: Fusing 981 + (Unnamed Layer* 715) [Shuffle] with node_of_982 [07/07/2021-20:01:00] [V] [TRT] PointWiseFusion: Fusing 984 + (Unnamed Layer* 719) [Shuffle] with node_of_985 [07/07/2021-20:01:00] [V] [TRT] PointWiseFusion: Fusing PWN(984 + (Unnamed Layer* 719) [Shuffle], node_of_985) with node_of_986 [07/07/2021-20:01:00] [V] [TRT] PointWiseFusion: Fusing PWN(981 + (Unnamed Layer* 715) [Shuffle], node_of_982) with node_of_983 [07/07/2021-20:01:00] [V] [TRT] PointWiseFusion: Fusing PWN(545 + (Unnamed Layer* 388) [Shuffle], node_of_546) with node_of_547 [07/07/2021-20:01:00] [V] [TRT] PointWiseFusion: Fusing PWN(542 + (Unnamed Layer* 384) [Shuffle], node_of_543) with node_of_544 [07/07/2021-20:01:00] [V] [TRT] After vertical fusions: 206 layers [07/07/2021-20:01:00] [V] [TRT] After dupe layer removal: 206 layers [07/07/2021-20:01:00] [V] [TRT] After final dead-layer removal: 206 layers [07/07/2021-20:01:00] [V] [TRT] After tensor merging: 206 layers [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_142 with copy from 127 to 142 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_172 with copy from 157 to 172 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_202 with copy from 187 to 202 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_723 with copy from 663 to 723 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_718 with copy from 663 to 718 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_713 with copy from 663 to 713 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_708 with copy from 663 to 708 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_703 with copy from 663 to 703 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_698 with copy from 663 to 698 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_693 with copy from 663 to 693 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_688 with copy from 663 to 688 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_683 with copy from 663 to 683 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_678 with copy from 663 to 678 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_673 with copy from 663 to 673 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_870 with copy from 786 to 870 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_863 with copy from 786 to 863 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_842 with copy from 786 to 842 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_835 with copy from 786 to 835 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_814 with copy from 786 to 814 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_807 with copy from 786 to 807 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_668 with copy from 663 to 668 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_284 with copy from 224 to 284 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_279 with copy from 224 to 279 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_274 with copy from 224 to 274 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_269 with copy from 224 to 269 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_264 with copy from 224 to 264 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_259 with copy from 224 to 259 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_254 with copy from 224 to 254 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_249 with copy from 224 to 249 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_244 with copy from 224 to 244 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_239 with copy from 224 to 239 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_234 with copy from 224 to 234 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_431 with copy from 347 to 431 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_424 with copy from 347 to 424 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_403 with copy from 347 to 403 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_396 with copy from 347 to 396 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_375 with copy from 347 to 375 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_368 with copy from 347 to 368 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_229 with copy from 224 to 229 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_856 with copy from 785 to 856 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_849 with copy from 785 to 849 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_828 with copy from 785 to 828 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_821 with copy from 785 to 821 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_800 with copy from 785 to 800 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_793 with copy from 785 to 793 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_417 with copy from 346 to 417 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_410 with copy from 346 to 410 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_389 with copy from 346 to 389 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_382 with copy from 346 to 382 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_361 with copy from 346 to 361 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_354 with copy from 346 to 354 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_962 with copy from 888 to 962 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_916 with copy from 888 to 916 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_939 with copy from 883 to 939 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_893 with copy from 883 to 893 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_523 with copy from 449 to 523 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_477 with copy from 449 to 477 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_500 with copy from 444 to 500 [07/07/2021-20:01:00] [V] [TRT] Replacing slice node_of_454 with copy from 444 to 454 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_149 [07/07/2021-20:01:00] [V] [TRT] Retargeting 148 to 149 [07/07/2021-20:01:00] [V] [TRT] Retargeting 145 to 149 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_153 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 127 to 153 because input is not movable. [07/07/2021-20:01:00] [V] [TRT] Retargeting 152 to 153 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_179 [07/07/2021-20:01:00] [V] [TRT] Retargeting 178 to 179 [07/07/2021-20:01:00] [V] [TRT] Retargeting 175 to 179 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_183 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 157 to 183 because input is not movable. [07/07/2021-20:01:00] [V] [TRT] Retargeting 182 to 183 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_209 [07/07/2021-20:01:00] [V] [TRT] Retargeting 208 to 209 [07/07/2021-20:01:00] [V] [TRT] Retargeting 205 to 209 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_213 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 187 to 213 because input is not movable. [07/07/2021-20:01:00] [V] [TRT] Retargeting 212 to 213 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_659 [07/07/2021-20:01:00] [V] [TRT] Retargeting 658 to 659 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 213 to 659 because input is not movable. [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_743 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 683 to 743 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 703 to 743 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Retargeting 723 to 743 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_726 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 678 to 726 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 698 to 726 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Retargeting 718 to 726 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_725 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 673 to 725 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 693 to 725 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Retargeting 713 to 725 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_724 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 668 to 724 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 688 to 724 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Retargeting 708 to 724 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_304 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 244 to 304 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 264 to 304 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Retargeting 284 to 304 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_287 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 239 to 287 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 259 to 287 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Retargeting 279 to 287 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_confs [07/07/2021-20:01:00] [V] [TRT] Generating copy for 589 to confs because copy elision not implemented for axis. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 1028 to confs because copy elision not implemented for axis. [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_286 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 234 to 286 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 254 to 286 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Retargeting 274 to 286 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_285 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 229 to 285 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 249 to 285 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Retargeting 269 to 285 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_876 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 816 to 876 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 844 to 876 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Retargeting 872 to 876 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_875 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 809 to 875 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 837 to 875 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Retargeting 865 to 875 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_437 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 377 to 437 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 405 to 437 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Retargeting 433 to 437 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_436 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 370 to 436 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 398 to 436 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Retargeting 426 to 436 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_874 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 802 to 874 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 830 to 874 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Retargeting 858 to 874 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_878 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 874 to 878 because input is not movable. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 876 to 878 because input is not movable. [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_873 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 795 to 873 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 823 to 873 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Retargeting 851 to 873 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_877 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 873 to 877 because input is not movable. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 875 to 877 because input is not movable. [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_435 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 363 to 435 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 391 to 435 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Retargeting 419 to 435 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_439 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 435 to 439 because input is not movable. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 437 to 439 because input is not movable. [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_434 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 356 to 434 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 384 to 434 because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Retargeting 412 to 434 [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_438 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 434 to 438 because input is not movable. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 436 to 438 because input is not movable. [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_989 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 983 to 989 because concat input is consumed by producer of another input. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 986 to 989 because concat input is consumed by producer of another input. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 987 to 989 because copy elision not implemented for axis. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 988 to 989 because copy elision not implemented for axis. [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_550 [07/07/2021-20:01:00] [V] [TRT] Generating copy for 544 to 550 because concat input is consumed by producer of another input. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 547 to 550 because concat input is consumed by producer of another input. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 548 to 550 because copy elision not implemented for axis. [07/07/2021-20:01:00] [V] [TRT] Generating copy for 549 to 550 because copy elision not implemented for axis. [07/07/2021-20:01:00] [V] [TRT] Eliminating concatenation node_of_boxes [07/07/2021-20:01:00] [V] [TRT] Generating copy for 570 to boxes because of stomping hazard. [07/07/2021-20:01:00] [V] [TRT] Retargeting 1009 to boxes [07/07/2021-20:01:00] [V] [TRT] After concat removal: 230 layers [07/07/2021-20:01:00] [V] [TRT] Graph construction and optimization completed in 0.223852 seconds. [07/07/2021-20:01:00] [V] [TRT] Using cublas a tactic source [07/07/2021-20:01:00] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +231, GPU +94, now: CPU 431, GPU 971 (MiB) [07/07/2021-20:01:00] [V] [TRT] Using cuDNN as a tactic source [07/07/2021-20:01:00] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +185, GPU +82, now: CPU 616, GPU 1053 (MiB) [07/07/2021-20:01:00] [07/07/2021-20:01:00] [V] [TRT] Constructing optimization profile number 0 [1/1]. [07/07/2021-20:01:00] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 229 [07/07/2021-20:01:00] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 234 [07/07/2021-20:01:00] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 239 [07/07/2021-20:01:00] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 244 [07/07/2021-20:01:00] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 249 [07/07/2021-20:01:00] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 254 [07/07/2021-20:01:00] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 259 [07/07/2021-20:01:00] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 264 [07/07/2021-20:01:00] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 668 [07/07/2021-20:01:00] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 673 [07/07/2021-20:01:00] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 678 [07/07/2021-20:01:00] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 683 [07/07/2021-20:01:00] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 688 [07/07/2021-20:01:00] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 693 [07/07/2021-20:01:00] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 698 [07/07/2021-20:01:00] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 703 [07/07/2021-20:01:00] [V] [TRT] *************** Autotuning format combination: -> Int32() *************** [07/07/2021-20:01:00] [V] [TRT] *************** Autotuning format combination: -> Int32() *************** [07/07/2021-20:01:00] [V] [TRT] --------------- Timing Runner: reformat: Float(519168,173056,416,1) -> Float(519168,1,1248,3) (Reformat) [07/07/2021-20:01:00] [V] [TRT] Tactic: 0 Time: 0.06168 [07/07/2021-20:01:00] [V] [TRT] Fastest Tactic: 0 Time: 0.06168 [07/07/2021-20:01:00] [V] [TRT] --------------- Timing Runner: reformat: Float(519168,173056,416,1) -> Half(519168,173056,416,1) (Reformat) [07/07/2021-20:01:00] [V] [TRT] Tactic: 0 Time: 0.0663 [07/07/2021-20:01:00] [V] [TRT] Fastest Tactic: 0 Time: 0.0663 [07/07/2021-20:01:00] [V] [TRT] *************** Autotuning format combination: Float(519168,173056,416,1) -> Float(1384448,43264,208,1) *************** [07/07/2021-20:01:00] [V] [TRT] --------------- Timing Runner: node_of_119 (CudaDepthwiseConvolution) [07/07/2021-20:01:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:00] [V] [TRT] --------------- Timing Runner: node_of_119 (FusedConvActConvolution) [07/07/2021-20:01:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:00] [V] [TRT] --------------- Timing Runner: node_of_119 (CudnnConvolution) [07/07/2021-20:01:00] [V] [TRT] Tactic: 0 Time: 0.278836 [07/07/2021-20:01:00] [V] [TRT] Tactic: 1 Time: 0.2487 [07/07/2021-20:01:00] [V] [TRT] Tactic: 2 Time: 0.522856 [07/07/2021-20:01:01] [V] [TRT] Tactic: 5 Time: 5.6743 [07/07/2021-20:01:01] [V] [TRT] Fastest Tactic: 1 Time: 0.2487 [07/07/2021-20:01:01] [V] [TRT] --------------- Timing Runner: node_of_119 (CaskConvolution) [07/07/2021-20:01:01] [V] [TRT] node_of_119 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [07/07/2021-20:01:01] [V] [TRT] Tactic: 1062367460111450758 Time: 0.103776 [07/07/2021-20:01:01] [V] [TRT] node_of_119 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [07/07/2021-20:01:01] [V] [TRT] Tactic: 1754984623894446479 Time: 0.114176 [07/07/2021-20:01:01] [V] [TRT] node_of_119 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [07/07/2021-20:01:01] [V] [TRT] Tactic: 3611739942397549984 Time: 0.265856 [07/07/2021-20:01:01] [V] [TRT] node_of_119 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [07/07/2021-20:01:01] [V] [TRT] Tactic: 4337000649858996379 Time: 0.136164 [07/07/2021-20:01:01] [V] [TRT] node_of_119 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [07/07/2021-20:01:01] [V] [TRT] Tactic: 4501471010995462441 Time: 0.252544 [07/07/2021-20:01:01] [V] [TRT] node_of_119 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:01:01] [V] [TRT] Tactic: 5137655947464784826 Time: 0.132548 [07/07/2021-20:01:01] [V] [TRT] node_of_119 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [07/07/2021-20:01:01] [V] [TRT] Tactic: 5288347012147084929 Time: 0.263484 [07/07/2021-20:01:01] [V] [TRT] node_of_119 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [07/07/2021-20:01:01] [V] [TRT] Tactic: 6645123197870846056 Time: 0.13426 [07/07/2021-20:01:01] [V] [TRT] node_of_119 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [07/07/2021-20:01:01] [V] [TRT] Tactic: 7144526460361122478 Time: 0.113656 [07/07/2021-20:01:01] [V] [TRT] node_of_119 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [07/07/2021-20:01:01] [V] [TRT] Tactic: -9137461792520977713 Time: 0.253036 [07/07/2021-20:01:01] [V] [TRT] node_of_119 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [07/07/2021-20:01:01] [V] [TRT] Tactic: -8262349710178828730 Time: 0.264696 [07/07/2021-20:01:01] [V] [TRT] node_of_119 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [07/07/2021-20:01:01] [V] [TRT] Tactic: -8133971918129952780 Time: 0.141636 [07/07/2021-20:01:01] [V] [TRT] node_of_119 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [07/07/2021-20:01:01] [V] [TRT] Tactic: -6092040395344634144 Time: 0.105272 [07/07/2021-20:01:01] [V] [TRT] node_of_119 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [07/07/2021-20:01:01] [V] [TRT] Tactic: -4787320710726427159 Time: 0.113384 [07/07/2021-20:01:01] [V] [TRT] node_of_119 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:01:01] [V] [TRT] Tactic: -3456450830548107839 Time: 0.101308 [07/07/2021-20:01:01] [V] [TRT] node_of_119 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [07/07/2021-20:01:01] [V] [TRT] Tactic: -1218658103698133241 Time: 0.13678 [07/07/2021-20:01:01] [V] [TRT] node_of_119 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [07/07/2021-20:01:01] [V] [TRT] Tactic: -836875257600482091 Time: 0.135356 [07/07/2021-20:01:01] [V] [TRT] node_of_119 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:01:01] [V] [TRT] Tactic: -410470605513481746 Time: 0.235184 [07/07/2021-20:01:01] [V] [TRT] Fastest Tactic: -3456450830548107839 Time: 0.101308 [07/07/2021-20:01:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3456450830548107839 [07/07/2021-20:01:01] [V] [TRT] *************** Autotuning format combination: Float(519168,1,1248,3) -> Float(1384448,1,6656,32) *************** [07/07/2021-20:01:01] [V] [TRT] --------------- Timing Runner: node_of_119 (CudnnConvolution) [07/07/2021-20:01:01] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:01] [V] [TRT] --------------- Timing Runner: node_of_119 (CaskConvolution) [07/07/2021-20:01:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:01] [V] [TRT] *************** Autotuning format combination: Half(519168,173056,416,1) -> Half(1384448,43264,208,1) *************** [07/07/2021-20:01:01] [V] [TRT] --------------- Timing Runner: node_of_119 (CudnnConvolution) [07/07/2021-20:01:01] [V] [TRT] Tactic: 0 Time: 0.231872 [07/07/2021-20:01:01] [V] [TRT] Tactic: 1 Time: 0.26798 [07/07/2021-20:01:01] [V] [TRT] Tactic: 2 Time: 0.450368 [07/07/2021-20:01:01] [V] [TRT] Tactic: 5 Time: 5.15949 [07/07/2021-20:01:01] [V] [TRT] Fastest Tactic: 0 Time: 0.231872 [07/07/2021-20:01:01] [V] [TRT] --------------- Timing Runner: node_of_119 (CaskConvolution) [07/07/2021-20:01:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [07/07/2021-20:01:01] [V] [TRT] --------------- Timing Runner: reformat: Float(1384448,43264,208,1) -> Float(1384448,1,6656,32) (Reformat) [07/07/2021-20:01:01] [V] [TRT] Tactic: 0 Time: 0.206592 [07/07/2021-20:01:01] [V] [TRT] Fastest Tactic: 0 Time: 0.206592 [07/07/2021-20:01:01] [V] [TRT] --------------- Timing Runner: reformat: Float(1384448,43264,208,1) -> Float(43264,43264:32,208,1) (Reformat) [07/07/2021-20:01:01] [V] [TRT] Tactic: 0 Time: 0.810164 [07/07/2021-20:01:01] [V] [TRT] Fastest Tactic: 0 Time: 0.810164 [07/07/2021-20:01:01] [V] [TRT] --------------- Timing Runner: reformat: Float(1384448,43264,208,1) -> Half(1384448,43264,208,1) (Reformat) [07/07/2021-20:01:01] [V] [TRT] Tactic: 0 Time: 0.121936 [07/07/2021-20:01:01] [V] [TRT] Fastest Tactic: 0 Time: 0.121936 [07/07/2021-20:01:01] [V] [TRT] --------------- Timing Runner: reformat: Float(1384448,1,6656,32) -> Float(1384448,43264,208,1) (Reformat) [07/07/2021-20:01:01] [V] [TRT] Tactic: 0 Time: 0.482684 [07/07/2021-20:01:01] [V] [TRT] Fastest Tactic: 0 Time: 0.482684 [07/07/2021-20:01:01] [V] [TRT] --------------- Timing Runner: reformat: Float(1384448,1,6656,32) -> Float(43264,43264:32,208,1) (Reformat) [07/07/2021-20:01:01] [V] [TRT] Tactic: 0 Time: 1.29074 [07/07/2021-20:01:01] [V] [TRT] Fastest Tactic: 0 Time: 1.29074 [07/07/2021-20:01:01] [V] [TRT] --------------- Timing Runner: reformat: Float(1384448,1,6656,32) -> Half(1384448,43264,208,1) (Reformat) [07/07/2021-20:01:01] [V] [TRT] Tactic: 0 Time: 0.454764 [07/07/2021-20:01:01] [V] [TRT] Fastest Tactic: 0 Time: 0.454764 [07/07/2021-20:01:01] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,43264:32,208,1) -> Float(1384448,43264,208,1) (Reformat) [07/07/2021-20:01:01] [V] [TRT] Tactic: 0 Time: 0.482308 [07/07/2021-20:01:01] [V] [TRT] Fastest Tactic: 0 Time: 0.482308 [07/07/2021-20:01:01] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,43264:32,208,1) -> Float(1384448,1,6656,32) (Reformat) [07/07/2021-20:01:01] [V] [TRT] Tactic: 0 Time: 0.150528 [07/07/2021-20:01:01] [V] [TRT] Fastest Tactic: 0 Time: 0.150528 [07/07/2021-20:01:01] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,43264:32,208,1) -> Half(1384448,43264,208,1) (Reformat) [07/07/2021-20:01:01] [V] [TRT] Tactic: 0 Time: 0.4544 [07/07/2021-20:01:01] [V] [TRT] Fastest Tactic: 0 Time: 0.4544 [07/07/2021-20:01:01] [V] [TRT] --------------- Timing Runner: reformat: Half(1384448,43264,208,1) -> Float(1384448,43264,208,1) (Reformat) [07/07/2021-20:01:01] [V] [TRT] Tactic: 0 Time: 0.092416 [07/07/2021-20:01:01] [V] [TRT] Fastest Tactic: 0 Time: 0.092416 [07/07/2021-20:01:01] [V] [TRT] --------------- Timing Runner: reformat: Half(1384448,43264,208,1) -> Float(1384448,1,6656,32) (Reformat) [07/07/2021-20:01:01] [V] [TRT] Tactic: 0 Time: 0.18088 [07/07/2021-20:01:01] [V] [TRT] Fastest Tactic: 0 Time: 0.18088 [07/07/2021-20:01:01] [V] [TRT] --------------- Timing Runner: reformat: Half(1384448,43264,208,1) -> Float(43264,43264:32,208,1) (Reformat) [07/07/2021-20:01:01] [V] [TRT] Tactic: 0 Time: 0.798464 [07/07/2021-20:01:01] [V] [TRT] Fastest Tactic: 0 Time: 0.798464 [07/07/2021-20:01:01] [V] [TRT] *************** Autotuning format combination: Float(1384448,43264,208,1) -> Float(1384448,43264,208,1) *************** [07/07/2021-20:01:01] [V] [TRT] --------------- Timing Runner: node_of_121 (PointWiseV2) [07/07/2021-20:01:01] [V] [TRT] Tactic: 0 Time: 0.114688 [07/07/2021-20:01:01] [V] [TRT] Tactic: 1 Time: 0.112688 [07/07/2021-20:01:02] [V] [TRT] Tactic: 2 Time: 0.113744 [07/07/2021-20:01:02] [V] [TRT] Tactic: 3 Time: 0.112508 [07/07/2021-20:01:02] [V] [TRT] Tactic: 4 Time: 0.113336 [07/07/2021-20:01:02] [V] [TRT] Tactic: 5 Time: 0.112768 [07/07/2021-20:01:02] [V] [TRT] Tactic: 6 Time: 0.11276 [07/07/2021-20:01:03] [V] [TRT] Tactic: 7 Time: 0.113288 [07/07/2021-20:01:03] [V] [TRT] Tactic: 8 Time: 0.113096 [07/07/2021-20:01:03] [V] [TRT] Tactic: 9 Time: 0.11276 [07/07/2021-20:01:03] [V] [TRT] Tactic: 28 Time: 0.113916 [07/07/2021-20:01:03] [V] [TRT] Fastest Tactic: 3 Time: 0.112508 [07/07/2021-20:01:03] [V] [TRT] --------------- Timing Runner: node_of_121 (PointWise) [07/07/2021-20:01:03] [V] [TRT] Tactic: 128 Time: 0.154064 [07/07/2021-20:01:03] [V] [TRT] Tactic: 256 Time: 0.154176 [07/07/2021-20:01:03] [V] [TRT] Tactic: 512 Time: 0.156736 [07/07/2021-20:01:03] [V] [TRT] Fastest Tactic: 128 Time: 0.154064 [07/07/2021-20:01:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [07/07/2021-20:01:03] [V] [TRT] *************** Autotuning format combination: Float(1384448,1,6656,32) -> Float(1384448,1,6656,32) *************** [07/07/2021-20:01:03] [V] [TRT] --------------- Timing Runner: node_of_121 (PointWiseV2) [07/07/2021-20:01:03] [V] [TRT] Tactic: 0 Time: 0.11352 [07/07/2021-20:01:03] [V] [TRT] Tactic: 1 Time: 0.112956 [07/07/2021-20:01:03] [V] [TRT] Tactic: 2 Time: 0.11336 [07/07/2021-20:01:03] [V] [TRT] Tactic: 3 Time: 0.111796 [07/07/2021-20:01:03] [V] [TRT] Tactic: 4 Time: 0.111784 [07/07/2021-20:01:03] [V] [TRT] Tactic: 5 Time: 0.112572 [07/07/2021-20:01:03] [V] [TRT] Tactic: 6 Time: 0.112352 [07/07/2021-20:01:03] [V] [TRT] Tactic: 7 Time: 0.112728 [07/07/2021-20:01:03] [V] [TRT] Tactic: 8 Time: 0.111616 [07/07/2021-20:01:03] [V] [TRT] Tactic: 9 Time: 0.112068 [07/07/2021-20:01:03] [V] [TRT] Tactic: 28 Time: 0.114528 [07/07/2021-20:01:03] [V] [TRT] Fastest Tactic: 8 Time: 0.111616 [07/07/2021-20:01:03] [V] [TRT] --------------- Timing Runner: node_of_121 (PointWise) [07/07/2021-20:01:03] [V] [TRT] Tactic: 128 Time: 0.153796 [07/07/2021-20:01:03] [V] [TRT] Tactic: 256 Time: 0.153728 [07/07/2021-20:01:03] [V] [TRT] Tactic: 512 Time: 0.156656 [07/07/2021-20:01:03] [V] [TRT] Fastest Tactic: 256 Time: 0.153728 [07/07/2021-20:01:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [07/07/2021-20:01:03] [V] [TRT] *************** Autotuning format combination: Float(43264,43264:32,208,1) -> Float(43264,43264:32,208,1) *************** [07/07/2021-20:01:03] [V] [TRT] --------------- Timing Runner: node_of_121 (PointWiseV2) [07/07/2021-20:01:03] [V] [TRT] Tactic: 24 Time: 0.112252 [07/07/2021-20:01:04] [V] [TRT] Tactic: 25 Time: 0.112316 [07/07/2021-20:01:04] [V] [TRT] Tactic: 26 Time: 0.112316 [07/07/2021-20:01:04] [V] [TRT] Tactic: 27 Time: 0.11296 [07/07/2021-20:01:04] [V] [TRT] Tactic: 31 Time: 0.112064 [07/07/2021-20:01:04] [V] [TRT] Fastest Tactic: 31 Time: 0.112064 [07/07/2021-20:01:04] [V] [TRT] --------------- Timing Runner: node_of_121 (PointWise) [07/07/2021-20:01:04] [V] [TRT] Tactic: 128 Time: 0.154024 [07/07/2021-20:01:04] [V] [TRT] Tactic: 256 Time: 0.154112 [07/07/2021-20:01:04] [V] [TRT] Tactic: 512 Time: 0.1568 [07/07/2021-20:01:04] [V] [TRT] Fastest Tactic: 128 Time: 0.154024 [07/07/2021-20:01:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [07/07/2021-20:01:04] [V] [TRT] *************** Autotuning format combination: Half(1384448,43264,208,1) -> Half(1384448,43264,208,1) *************** [07/07/2021-20:01:04] [V] [TRT] --------------- Timing Runner: node_of_121 (PointWiseV2) [07/07/2021-20:01:04] [V] [TRT] Tactic: 0 Time: 0.078412 [07/07/2021-20:01:05] [V] [TRT] Tactic: 1 Time: 0.065104 [07/07/2021-20:01:05] [V] [TRT] Tactic: 2 Time: 0.06048 [07/07/2021-20:01:05] [V] [TRT] Tactic: 3 Time: 0.06048 [07/07/2021-20:01:05] [V] [TRT] Tactic: 4 Time: 0.057984 [07/07/2021-20:01:05] [V] [TRT] Tactic: 5 Time: 0.05766 [07/07/2021-20:01:05] [V] [TRT] Tactic: 6 Time: 0.060352 [07/07/2021-20:01:06] [V] [TRT] Tactic: 7 Time: 0.057792 [07/07/2021-20:01:06] [V] [TRT] Tactic: 8 Time: 0.057852 [07/07/2021-20:01:06] [V] [TRT] Tactic: 9 Time: 0.057856 [07/07/2021-20:01:06] [V] [TRT] Tactic: 28 Time: 0.0768 [07/07/2021-20:01:06] [V] [TRT] Fastest Tactic: 5 Time: 0.05766 [07/07/2021-20:01:06] [V] [TRT] --------------- Timing Runner: node_of_121 (PointWise) [07/07/2021-20:01:06] [V] [TRT] Tactic: 128 Time: 0.137 [07/07/2021-20:01:06] [V] [TRT] Tactic: 256 Time: 0.135036 [07/07/2021-20:01:06] [V] [TRT] Tactic: 512 Time: 0.133816 [07/07/2021-20:01:06] [V] [TRT] Fastest Tactic: 512 Time: 0.133816 [07/07/2021-20:01:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [07/07/2021-20:01:06] [V] [TRT] *************** Autotuning format combination: Float(1384448,43264,208,1) -> Float(692224,10816,104,1) *************** [07/07/2021-20:01:06] [V] [TRT] --------------- Timing Runner: node_of_122 (CudaDepthwiseConvolution) [07/07/2021-20:01:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:06] [V] [TRT] --------------- Timing Runner: node_of_122 (FusedConvActConvolution) [07/07/2021-20:01:06] [V] [TRT] Tactic: 458751 Time: 0.342272 [07/07/2021-20:01:06] [V] [TRT] Fastest Tactic: 458751 Time: 0.342272 [07/07/2021-20:01:06] [V] [TRT] --------------- Timing Runner: node_of_122 (CudnnConvolution) [07/07/2021-20:01:06] [V] [TRT] Tactic: 0 Time: 0.52358 [07/07/2021-20:01:06] [V] [TRT] Tactic: 1 Time: 0.229416 [07/07/2021-20:01:06] [V] [TRT] Tactic: 2 skipped. Scratch requested: 24920064, available: 16777216 [07/07/2021-20:01:06] [V] [TRT] Tactic: 5 Time: 4.42624 [07/07/2021-20:01:06] [I] [TRT] Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output. [07/07/2021-20:01:06] [V] [TRT] Fastest Tactic: 1 Time: 0.229416 [07/07/2021-20:01:06] [V] [TRT] --------------- Timing Runner: node_of_122 (CaskConvolution) [07/07/2021-20:01:06] [V] [TRT] node_of_122 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [07/07/2021-20:01:06] [V] [TRT] Tactic: 1062367460111450758 Time: 0.194156 [07/07/2021-20:01:06] [V] [TRT] node_of_122 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [07/07/2021-20:01:06] [V] [TRT] Tactic: 1754984623894446479 Time: 0.237048 [07/07/2021-20:01:06] [V] [TRT] node_of_122 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [07/07/2021-20:01:06] [V] [TRT] Tactic: 3611739942397549984 Time: 0.297152 [07/07/2021-20:01:06] [V] [TRT] node_of_122 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [07/07/2021-20:01:06] [V] [TRT] Tactic: 4337000649858996379 Time: 0.164736 [07/07/2021-20:01:06] [V] [TRT] node_of_122 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [07/07/2021-20:01:06] [V] [TRT] Tactic: 4501471010995462441 Time: 0.29376 [07/07/2021-20:01:06] [V] [TRT] node_of_122 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:01:07] [V] [TRT] Tactic: 5137655947464784826 Time: 0.157552 [07/07/2021-20:01:07] [V] [TRT] node_of_122 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [07/07/2021-20:01:07] [V] [TRT] Tactic: 5288347012147084929 Time: 0.294856 [07/07/2021-20:01:07] [V] [TRT] node_of_122 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [07/07/2021-20:01:07] [V] [TRT] Tactic: 6645123197870846056 Time: 0.162176 [07/07/2021-20:01:07] [V] [TRT] node_of_122 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [07/07/2021-20:01:07] [V] [TRT] Tactic: 7144526460361122478 Time: 0.233972 [07/07/2021-20:01:07] [V] [TRT] node_of_122 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [07/07/2021-20:01:07] [V] [TRT] Tactic: -9137461792520977713 Time: 0.29836 [07/07/2021-20:01:07] [V] [TRT] node_of_122 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [07/07/2021-20:01:07] [V] [TRT] Tactic: -8262349710178828730 Time: 0.298484 [07/07/2021-20:01:07] [V] [TRT] node_of_122 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [07/07/2021-20:01:07] [V] [TRT] Tactic: -8133971918129952780 Time: 0.180596 [07/07/2021-20:01:07] [V] [TRT] node_of_122 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [07/07/2021-20:01:07] [V] [TRT] Tactic: -6092040395344634144 Time: 0.198836 [07/07/2021-20:01:07] [V] [TRT] node_of_122 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [07/07/2021-20:01:07] [V] [TRT] Tactic: -4787320710726427159 Time: 0.237172 [07/07/2021-20:01:07] [V] [TRT] node_of_122 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:01:07] [V] [TRT] Tactic: -3456450830548107839 Time: 0.187572 [07/07/2021-20:01:07] [V] [TRT] node_of_122 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [07/07/2021-20:01:07] [V] [TRT] Tactic: -1218658103698133241 Time: 0.179956 [07/07/2021-20:01:07] [V] [TRT] node_of_122 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [07/07/2021-20:01:07] [V] [TRT] Tactic: -836875257600482091 Time: 0.175928 [07/07/2021-20:01:07] [V] [TRT] node_of_122 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:01:07] [V] [TRT] Tactic: -410470605513481746 Time: 0.28942 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.157552 [07/07/2021-20:01:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [07/07/2021-20:01:07] [V] [TRT] *************** Autotuning format combination: Float(1384448,1,6656,32) -> Float(692224,1,6656,64) *************** [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: node_of_122 (CudnnConvolution) [07/07/2021-20:01:07] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: node_of_122 (CaskConvolution) [07/07/2021-20:01:07] [V] [TRT] node_of_122 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [07/07/2021-20:01:07] [V] [TRT] Tactic: -9153228964338181824 Time: 0.18304 [07/07/2021-20:01:07] [V] [TRT] node_of_122 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [07/07/2021-20:01:07] [V] [TRT] Tactic: -7394439838318485025 Time: 0.159708 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.159708 [07/07/2021-20:01:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [07/07/2021-20:01:07] [V] [TRT] *************** Autotuning format combination: Half(1384448,43264,208,1) -> Half(692224,10816,104,1) *************** [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: node_of_122 (CudnnConvolution) [07/07/2021-20:01:07] [V] [TRT] Tactic: 0 Time: 0.573004 [07/07/2021-20:01:07] [V] [TRT] Tactic: 1 Time: 0.236928 [07/07/2021-20:01:07] [V] [TRT] Tactic: 2 Time: 0.564912 [07/07/2021-20:01:07] [V] [TRT] Tactic: 5 Time: 4.64256 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 1 Time: 0.236928 [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: node_of_122 (CaskConvolution) [07/07/2021-20:01:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,10816,104,1) -> Float(692224,1,6656,64) (Reformat) [07/07/2021-20:01:07] [V] [TRT] Tactic: 0 Time: 0.099712 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 0 Time: 0.099712 [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,10816,104,1) -> Float(21632,10816:32,104,1) (Reformat) [07/07/2021-20:01:07] [V] [TRT] Tactic: 0 Time: 0.113792 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 0 Time: 0.113792 [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,10816,104,1) -> Half(692224,10816,104,1) (Reformat) [07/07/2021-20:01:07] [V] [TRT] Tactic: 0 Time: 0.068992 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 0 Time: 0.068992 [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,1,6656,64) -> Float(692224,10816,104,1) (Reformat) [07/07/2021-20:01:07] [V] [TRT] Tactic: 0 Time: 0.08816 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 0 Time: 0.08816 [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,1,6656,64) -> Float(21632,10816:32,104,1) (Reformat) [07/07/2021-20:01:07] [V] [TRT] Tactic: 0 Time: 0.298176 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 0 Time: 0.298176 [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,1,6656,64) -> Half(692224,10816,104,1) (Reformat) [07/07/2021-20:01:07] [V] [TRT] Tactic: 0 Time: 0.086528 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 0 Time: 0.086528 [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,10816:32,104,1) -> Float(692224,10816,104,1) (Reformat) [07/07/2021-20:01:07] [V] [TRT] Tactic: 0 Time: 0.09452 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 0 Time: 0.09452 [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,10816:32,104,1) -> Float(692224,1,6656,64) (Reformat) [07/07/2021-20:01:07] [V] [TRT] Tactic: 0 Time: 0.0777 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 0 Time: 0.0777 [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,10816:32,104,1) -> Half(692224,10816,104,1) (Reformat) [07/07/2021-20:01:07] [V] [TRT] Tactic: 0 Time: 0.093956 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 0 Time: 0.093956 [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: reformat: Half(692224,10816,104,1) -> Float(692224,10816,104,1) (Reformat) [07/07/2021-20:01:07] [V] [TRT] Tactic: 0 Time: 0.048076 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 0 Time: 0.048076 [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: reformat: Half(692224,10816,104,1) -> Float(692224,1,6656,64) (Reformat) [07/07/2021-20:01:07] [V] [TRT] Tactic: 0 Time: 0.087548 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 0 Time: 0.087548 [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: reformat: Half(692224,10816,104,1) -> Float(21632,10816:32,104,1) (Reformat) [07/07/2021-20:01:07] [V] [TRT] Tactic: 0 Time: 0.1163 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 0 Time: 0.1163 [07/07/2021-20:01:07] [V] [TRT] *************** Autotuning format combination: Float(692224,10816,104,1) -> Float(692224,10816,104,1) *************** [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: node_of_124 (PointWiseV2) [07/07/2021-20:01:07] [V] [TRT] Tactic: 0 Time: 0.057548 [07/07/2021-20:01:07] [V] [TRT] Tactic: 1 Time: 0.057576 [07/07/2021-20:01:07] [V] [TRT] Tactic: 2 Time: 0.057012 [07/07/2021-20:01:07] [V] [TRT] Tactic: 3 Time: 0.057048 [07/07/2021-20:01:07] [V] [TRT] Tactic: 4 Time: 0.056904 [07/07/2021-20:01:07] [V] [TRT] Tactic: 5 Time: 0.057148 [07/07/2021-20:01:07] [V] [TRT] Tactic: 6 Time: 0.0576 [07/07/2021-20:01:07] [V] [TRT] Tactic: 7 Time: 0.058252 [07/07/2021-20:01:07] [V] [TRT] Tactic: 8 Time: 0.057268 [07/07/2021-20:01:07] [V] [TRT] Tactic: 9 Time: 0.056632 [07/07/2021-20:01:07] [V] [TRT] Tactic: 28 Time: 0.058048 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 9 Time: 0.056632 [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: node_of_124 (PointWise) [07/07/2021-20:01:07] [V] [TRT] Tactic: 128 Time: 0.079116 [07/07/2021-20:01:07] [V] [TRT] Tactic: 256 Time: 0.079072 [07/07/2021-20:01:07] [V] [TRT] Tactic: 512 Time: 0.080424 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 256 Time: 0.079072 [07/07/2021-20:01:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [07/07/2021-20:01:07] [V] [TRT] *************** Autotuning format combination: Float(692224,1,6656,64) -> Float(692224,1,6656,64) *************** [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: node_of_124 (PointWiseV2) [07/07/2021-20:01:07] [V] [TRT] Tactic: 0 Time: 0.057908 [07/07/2021-20:01:07] [V] [TRT] Tactic: 1 Time: 0.057588 [07/07/2021-20:01:07] [V] [TRT] Tactic: 2 Time: 0.057468 [07/07/2021-20:01:07] [V] [TRT] Tactic: 3 Time: 0.057392 [07/07/2021-20:01:07] [V] [TRT] Tactic: 4 Time: 0.05712 [07/07/2021-20:01:07] [V] [TRT] Tactic: 5 Time: 0.057336 [07/07/2021-20:01:07] [V] [TRT] Tactic: 6 Time: 0.057652 [07/07/2021-20:01:07] [V] [TRT] Tactic: 7 Time: 0.057928 [07/07/2021-20:01:07] [V] [TRT] Tactic: 8 Time: 0.057352 [07/07/2021-20:01:07] [V] [TRT] Tactic: 9 Time: 0.056704 [07/07/2021-20:01:07] [V] [TRT] Tactic: 28 Time: 0.0576 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 9 Time: 0.056704 [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: node_of_124 (PointWise) [07/07/2021-20:01:07] [V] [TRT] Tactic: 128 Time: 0.078848 [07/07/2021-20:01:07] [V] [TRT] Tactic: 256 Time: 0.078976 [07/07/2021-20:01:07] [V] [TRT] Tactic: 512 Time: 0.080384 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 128 Time: 0.078848 [07/07/2021-20:01:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [07/07/2021-20:01:07] [V] [TRT] *************** Autotuning format combination: Float(21632,10816:32,104,1) -> Float(21632,10816:32,104,1) *************** [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: node_of_124 (PointWiseV2) [07/07/2021-20:01:07] [V] [TRT] Tactic: 24 Time: 0.05696 [07/07/2021-20:01:07] [V] [TRT] Tactic: 25 Time: 0.056832 [07/07/2021-20:01:07] [V] [TRT] Tactic: 26 Time: 0.056832 [07/07/2021-20:01:07] [V] [TRT] Tactic: 27 Time: 0.057836 [07/07/2021-20:01:07] [V] [TRT] Tactic: 31 Time: 0.05674 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 31 Time: 0.05674 [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: node_of_124 (PointWise) [07/07/2021-20:01:07] [V] [TRT] Tactic: 128 Time: 0.079104 [07/07/2021-20:01:07] [V] [TRT] Tactic: 256 Time: 0.079036 [07/07/2021-20:01:07] [V] [TRT] Tactic: 512 Time: 0.080368 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 256 Time: 0.079036 [07/07/2021-20:01:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [07/07/2021-20:01:07] [V] [TRT] *************** Autotuning format combination: Half(692224,10816,104,1) -> Half(692224,10816,104,1) *************** [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: node_of_124 (PointWiseV2) [07/07/2021-20:01:07] [V] [TRT] Tactic: 0 Time: 0.040832 [07/07/2021-20:01:07] [V] [TRT] Tactic: 1 Time: 0.033852 [07/07/2021-20:01:07] [V] [TRT] Tactic: 2 Time: 0.03064 [07/07/2021-20:01:07] [V] [TRT] Tactic: 3 Time: 0.032096 [07/07/2021-20:01:07] [V] [TRT] Tactic: 4 Time: 0.030252 [07/07/2021-20:01:07] [V] [TRT] Tactic: 5 Time: 0.02942 [07/07/2021-20:01:07] [V] [TRT] Tactic: 6 Time: 0.0321 [07/07/2021-20:01:07] [V] [TRT] Tactic: 7 Time: 0.030192 [07/07/2021-20:01:07] [V] [TRT] Tactic: 8 Time: 0.029936 [07/07/2021-20:01:07] [V] [TRT] Tactic: 9 Time: 0.029776 [07/07/2021-20:01:07] [V] [TRT] Tactic: 28 Time: 0.039828 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 5 Time: 0.02942 [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: node_of_124 (PointWise) [07/07/2021-20:01:07] [V] [TRT] Tactic: 128 Time: 0.07072 [07/07/2021-20:01:07] [V] [TRT] Tactic: 256 Time: 0.07 [07/07/2021-20:01:07] [V] [TRT] Tactic: 512 Time: 0.069956 [07/07/2021-20:01:07] [V] [TRT] Fastest Tactic: 512 Time: 0.069956 [07/07/2021-20:01:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [07/07/2021-20:01:07] [V] [TRT] *************** Autotuning format combination: Float(692224,10816,104,1) -> Float(692224,10816,104,1) *************** [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: node_of_125 (CudaDepthwiseConvolution) [07/07/2021-20:01:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:07] [V] [TRT] --------------- Timing Runner: node_of_125 (FusedConvActConvolution) [07/07/2021-20:01:07] [V] [TRT] Tactic: 524287 Time: 0.381024 [07/07/2021-20:01:07] [V] [TRT] Tactic: 720895 Time: 0.344636 [07/07/2021-20:01:07] [V] [TRT] Tactic: 983039 Time: 0.32228 [07/07/2021-20:01:08] [V] [TRT] Tactic: 1048575 Time: 0.342884 [07/07/2021-20:01:08] [V] [TRT] Tactic: 1703935 Time: 0.328752 [07/07/2021-20:01:08] [V] [TRT] Tactic: 1769471 Time: 0.367616 [07/07/2021-20:01:08] [V] [TRT] Tactic: 1966079 Time: 0.37284 [07/07/2021-20:01:08] [V] [TRT] Tactic: 2031615 Time: 0.365924 [07/07/2021-20:01:08] [V] [TRT] Tactic: 2228223 Time: 0.442368 [07/07/2021-20:01:08] [V] [TRT] Tactic: 2424831 Time: 0.578424 [07/07/2021-20:01:08] [V] [TRT] Tactic: 2621439 Time: 0.3584 [07/07/2021-20:01:08] [V] [TRT] Tactic: 2752511 Time: 0.37184 [07/07/2021-20:01:08] [V] [TRT] Tactic: 2818047 Time: 0.902784 [07/07/2021-20:01:08] [V] [TRT] Tactic: 2883583 Time: 0.708332 [07/07/2021-20:01:08] [V] [TRT] Tactic: 3014655 Time: 0.339328 [07/07/2021-20:01:08] [V] [TRT] Tactic: 3145727 Time: 0.351692 [07/07/2021-20:01:08] [V] [TRT] Tactic: 3473407 Time: 0.65088 [07/07/2021-20:01:08] [V] [TRT] Tactic: 3604479 Time: 0.328832 [07/07/2021-20:01:08] [V] [TRT] Tactic: 3735551 Time: 0.581244 [07/07/2021-20:01:08] [V] [TRT] Tactic: 4390911 Time: 0.412608 [07/07/2021-20:01:08] [V] [TRT] Tactic: 5046271 Time: 0.349312 [07/07/2021-20:01:08] [V] [TRT] Tactic: 5963775 Time: 0.368424 [07/07/2021-20:01:08] [V] [TRT] Tactic: 6160383 Time: 0.39932 [07/07/2021-20:01:08] [V] [TRT] Tactic: 6488063 Time: 0.357632 [07/07/2021-20:01:08] [V] [TRT] Tactic: 6881279 Time: 0.382548 [07/07/2021-20:01:08] [V] [TRT] Tactic: 7274495 Time: 0.406656 [07/07/2021-20:01:09] [V] [TRT] Tactic: 7864319 Time: 0.409216 [07/07/2021-20:01:09] [V] [TRT] Tactic: 7995391 Time: 0.347904 [07/07/2021-20:01:09] [V] [TRT] Tactic: 8585215 Time: 0.384884 [07/07/2021-20:01:09] [V] [TRT] Tactic: 8847359 Time: 0.387888 [07/07/2021-20:01:09] [V] [TRT] Tactic: 8978431 Time: 0.367308 [07/07/2021-20:01:09] [V] [TRT] Tactic: 9043967 Time: 0.345032 [07/07/2021-20:01:09] [V] [TRT] Tactic: 9175039 Time: 0.328576 [07/07/2021-20:01:09] [V] [TRT] Tactic: 9502719 Time: 0.418048 [07/07/2021-20:01:09] [V] [TRT] Tactic: 9830399 Time: 0.579776 [07/07/2021-20:01:09] [V] [TRT] Tactic: 9961471 Time: 0.542252 [07/07/2021-20:01:09] [V] [TRT] Tactic: 10027007 Time: 0.34094 [07/07/2021-20:01:09] [V] [TRT] Tactic: 10092543 Time: 0.412544 [07/07/2021-20:01:09] [V] [TRT] Tactic: 10289151 Time: 0.373612 [07/07/2021-20:01:09] [V] [TRT] Tactic: 10485759 Time: 0.329088 [07/07/2021-20:01:09] [V] [TRT] Tactic: 10682367 Time: 0.353136 [07/07/2021-20:01:09] [V] [TRT] Tactic: 10813439 Time: 0.326528 [07/07/2021-20:01:09] [V] [TRT] Fastest Tactic: 983039 Time: 0.32228 [07/07/2021-20:01:09] [V] [TRT] --------------- Timing Runner: node_of_125 (CudnnConvolution) [07/07/2021-20:01:09] [V] [TRT] Tactic: 0 Time: 0.961496 [07/07/2021-20:01:09] [V] [TRT] Tactic: 1 Time: 0.368112 [07/07/2021-20:01:09] [V] [TRT] Tactic: 2 skipped. Scratch requested: 49840128, available: 16777216 [07/07/2021-20:01:09] [V] [TRT] Tactic: 4 skipped. Scratch requested: 562446336, available: 16777216 [07/07/2021-20:01:09] [V] [TRT] Tactic: 5 skipped. Scratch requested: 20054016, available: 16777216 [07/07/2021-20:01:09] [V] [TRT] Tactic: 6 Time: 0.249344 [07/07/2021-20:01:09] [V] [TRT] Fastest Tactic: 6 Time: 0.249344 [07/07/2021-20:01:09] [V] [TRT] --------------- Timing Runner: node_of_125 (CaskConvolution) [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [07/07/2021-20:01:09] [V] [TRT] Tactic: 1062367460111450758 Time: 0.331932 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [07/07/2021-20:01:09] [V] [TRT] Tactic: 1754984623894446479 Time: 0.398616 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [07/07/2021-20:01:09] [V] [TRT] Tactic: 3611739942397549984 Time: 0.551008 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [07/07/2021-20:01:09] [V] [TRT] Tactic: 3827454225649558724 Time: 0.18464 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [07/07/2021-20:01:09] [V] [TRT] Tactic: 4337000649858996379 Time: 0.29824 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [07/07/2021-20:01:09] [V] [TRT] Tactic: 4501471010995462441 Time: 0.54988 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:01:09] [V] [TRT] Tactic: 5137655947464784826 Time: 0.28742 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [07/07/2021-20:01:09] [V] [TRT] Tactic: 5288347012147084929 Time: 0.54272 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [07/07/2021-20:01:09] [V] [TRT] Tactic: 5921334924264294896 Time: 0.190336 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [07/07/2021-20:01:09] [V] [TRT] Tactic: 6645123197870846056 Time: 0.293692 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [07/07/2021-20:01:09] [V] [TRT] Tactic: 7144526460361122478 Time: 0.382192 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [07/07/2021-20:01:09] [V] [TRT] Tactic: 7852627285308570038 Time: 0.199104 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [07/07/2021-20:01:09] [V] [TRT] Tactic: -9137461792520977713 Time: 0.55648 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [07/07/2021-20:01:09] [V] [TRT] Tactic: -8776506421218919509 Time: 0.185184 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [07/07/2021-20:01:09] [V] [TRT] Tactic: -8262349710178828730 Time: 0.55246 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [07/07/2021-20:01:09] [V] [TRT] Tactic: -8133971918129952780 Time: 0.317484 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [07/07/2021-20:01:09] [V] [TRT] Tactic: -6092040395344634144 Time: 0.341832 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [07/07/2021-20:01:09] [V] [TRT] Tactic: -4787320710726427159 Time: 0.397996 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:01:09] [V] [TRT] Tactic: -3456450830548107839 Time: 0.318848 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [07/07/2021-20:01:09] [V] [TRT] Tactic: -2318106587342035239 Time: 0.192512 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [07/07/2021-20:01:09] [V] [TRT] Tactic: -1343271414618805657 Time: 0.18304 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [07/07/2021-20:01:09] [V] [TRT] Tactic: -1218658103698133241 Time: 0.31504 [07/07/2021-20:01:09] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [07/07/2021-20:01:10] [V] [TRT] Tactic: -836875257600482091 Time: 0.304112 [07/07/2021-20:01:10] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:01:10] [V] [TRT] Tactic: -410470605513481746 Time: 0.539264 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: -1343271414618805657 Time: 0.18304 [07/07/2021-20:01:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1343271414618805657 [07/07/2021-20:01:10] [V] [TRT] *************** Autotuning format combination: Float(692224,1,6656,64) -> Float(692224,1,6656,64) *************** [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: node_of_125 (CudnnConvolution) [07/07/2021-20:01:10] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: node_of_125 (CaskConvolution) [07/07/2021-20:01:10] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [07/07/2021-20:01:10] [V] [TRT] Tactic: -9153228964338181824 Time: 0.29638 [07/07/2021-20:01:10] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [07/07/2021-20:01:10] [V] [TRT] Tactic: -7394439838318485025 Time: 0.280508 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.280508 [07/07/2021-20:01:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [07/07/2021-20:01:10] [V] [TRT] *************** Autotuning format combination: Half(692224,10816,104,1) -> Half(692224,10816,104,1) *************** [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: node_of_125 (CudnnConvolution) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 1.02194 [07/07/2021-20:01:10] [V] [TRT] Tactic: 1 Time: 0.385876 [07/07/2021-20:01:10] [V] [TRT] Tactic: 2 skipped. Scratch requested: 24920064, available: 16777216 [07/07/2021-20:01:10] [V] [TRT] Tactic: 4 skipped. Scratch requested: 562446336, available: 16777216 [07/07/2021-20:01:10] [V] [TRT] Tactic: 5 skipped. Scratch requested: 20054016, available: 16777216 [07/07/2021-20:01:10] [V] [TRT] Tactic: 6 Time: 0.37188 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 6 Time: 0.37188 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: node_of_125 (CaskConvolution) [07/07/2021-20:01:10] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 6 [07/07/2021-20:01:10] [V] [TRT] *************** Autotuning format combination: Float(692224,10816,104,1) -> Float(692224,10816,104,1) *************** [07/07/2021-20:01:10] [V] [TRT] *************** Autotuning format combination: Float(692224,1,6656,64) -> Float(692224,1,6656,64) *************** [07/07/2021-20:01:10] [V] [TRT] *************** Autotuning format combination: Float(21632,10816:32,104,1) -> Float(21632,10816:32,104,1) *************** [07/07/2021-20:01:10] [V] [TRT] *************** Autotuning format combination: Half(692224,10816,104,1) -> Half(692224,10816,104,1) *************** [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,10816,104,1) -> Float(692224,1,6656,64) (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.099952 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.099952 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,10816,104,1) -> Float(21632,10816:32,104,1) (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.114304 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.114304 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,10816,104,1) -> Half(692224,10816,104,1) (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.069184 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.069184 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,1,6656,64) -> Float(692224,10816,104,1) (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.088256 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.088256 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,1,6656,64) -> Float(21632,10816:32,104,1) (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.29874 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.29874 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,1,6656,64) -> Half(692224,10816,104,1) (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.0871 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.0871 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,10816:32,104,1) -> Float(692224,10816,104,1) (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.09514 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.09514 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,10816:32,104,1) -> Float(692224,1,6656,64) (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.078188 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.078188 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,10816:32,104,1) -> Half(692224,10816,104,1) (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.093808 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.093808 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: reformat: Half(692224,10816,104,1) -> Float(692224,10816,104,1) (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.048464 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.048464 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: reformat: Half(692224,10816,104,1) -> Float(692224,1,6656,64) (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.08842 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.08842 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: reformat: Half(692224,10816,104,1) -> Float(21632,10816:32,104,1) (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.116544 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.116544 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: node_of_142 (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.06492 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.06492 [07/07/2021-20:01:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: node_of_142 (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.05388 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.05388 [07/07/2021-20:01:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: node_of_142 (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.033584 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.033584 [07/07/2021-20:01:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: node_of_142 (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.046196 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.046196 [07/07/2021-20:01:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: node_of_142 (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.03484 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.03484 [07/07/2021-20:01:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: node_of_142 (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.045356 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.045356 [07/07/2021-20:01:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: node_of_142 (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.049516 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.049516 [07/07/2021-20:01:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: node_of_142 (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.040508 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.040508 [07/07/2021-20:01:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: node_of_142 (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.048768 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.048768 [07/07/2021-20:01:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: node_of_142 (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.026504 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.026504 [07/07/2021-20:01:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: node_of_142 (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.048768 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.048768 [07/07/2021-20:01:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: node_of_142 (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.033772 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.033772 [07/07/2021-20:01:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,10816,104,1) -> Float(346112,1,3328,32) (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.05374 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.05374 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,10816,104,1) -> Half(346112,10816,104,1) (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.040064 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.040064 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,1,3328,32) -> Float(346112,10816,104,1) (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.045424 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.045424 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,1,3328,32) -> Half(346112,10816,104,1) (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.045064 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.045064 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: reformat: Half(346112,10816,104,1) -> Float(346112,10816,104,1) (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.026548 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.026548 [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: reformat: Half(346112,10816,104,1) -> Float(346112,1,3328,32) (Reformat) [07/07/2021-20:01:10] [V] [TRT] Tactic: 0 Time: 0.04876 [07/07/2021-20:01:10] [V] [TRT] Fastest Tactic: 0 Time: 0.04876 [07/07/2021-20:01:10] [V] [TRT] *************** Autotuning format combination: Float(346112,10816,104,1) -> Float(346112,10816,104,1) *************** [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: node_of_143 (CudaDepthwiseConvolution) [07/07/2021-20:01:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:10] [V] [TRT] --------------- Timing Runner: node_of_143 (FusedConvActConvolution) [07/07/2021-20:01:10] [V] [TRT] Tactic: 524287 Time: 0.139264 [07/07/2021-20:01:10] [V] [TRT] Tactic: 720895 Time: 0.18482 [07/07/2021-20:01:10] [V] [TRT] Tactic: 983039 Time: 0.17446 [07/07/2021-20:01:10] [V] [TRT] Tactic: 1048575 Time: 0.125456 [07/07/2021-20:01:10] [V] [TRT] Tactic: 1703935 Time: 0.112784 [07/07/2021-20:01:10] [V] [TRT] Tactic: 1769471 Time: 0.20288 [07/07/2021-20:01:10] [V] [TRT] Tactic: 1966079 Time: 0.205676 [07/07/2021-20:01:10] [V] [TRT] Tactic: 2031615 Time: 0.201088 [07/07/2021-20:01:10] [V] [TRT] Tactic: 2228223 Time: 0.158012 [07/07/2021-20:01:10] [V] [TRT] Tactic: 2424831 Time: 0.1867 [07/07/2021-20:01:10] [V] [TRT] Tactic: 2621439 Time: 0.116776 [07/07/2021-20:01:10] [V] [TRT] Tactic: 2752511 Time: 0.206784 [07/07/2021-20:01:10] [V] [TRT] Tactic: 2818047 Time: 0.477564 [07/07/2021-20:01:10] [V] [TRT] Tactic: 2883583 Time: 0.382888 [07/07/2021-20:01:10] [V] [TRT] Tactic: 3014655 Time: 0.119884 [07/07/2021-20:01:10] [V] [TRT] Tactic: 3145727 Time: 0.202368 [07/07/2021-20:01:10] [V] [TRT] Tactic: 3473407 Time: 0.355436 [07/07/2021-20:01:10] [V] [TRT] Tactic: 3604479 Time: 0.115944 [07/07/2021-20:01:10] [V] [TRT] Tactic: 3735551 Time: 0.301696 [07/07/2021-20:01:10] [V] [TRT] Tactic: 4390911 Time: 0.224512 [07/07/2021-20:01:10] [V] [TRT] Tactic: 5046271 Time: 0.124544 [07/07/2021-20:01:10] [V] [TRT] Tactic: 5963775 Time: 0.201216 [07/07/2021-20:01:10] [V] [TRT] Tactic: 6160383 Time: 0.143936 [07/07/2021-20:01:10] [V] [TRT] Tactic: 6488063 Time: 0.132672 [07/07/2021-20:01:10] [V] [TRT] Tactic: 6881279 Time: 0.200192 [07/07/2021-20:01:10] [V] [TRT] Tactic: 7274495 Time: 0.22138 [07/07/2021-20:01:10] [V] [TRT] Tactic: 7864319 Time: 0.136576 [07/07/2021-20:01:10] [V] [TRT] Tactic: 7995391 Time: 0.18334 [07/07/2021-20:01:10] [V] [TRT] Tactic: 8585215 Time: 0.156176 [07/07/2021-20:01:10] [V] [TRT] Tactic: 8847359 Time: 0.134976 [07/07/2021-20:01:10] [V] [TRT] Tactic: 8978431 Time: 0.1952 [07/07/2021-20:01:11] [V] [TRT] Tactic: 9043967 Time: 0.120148 [07/07/2021-20:01:11] [V] [TRT] Tactic: 9175039 Time: 0.11616 [07/07/2021-20:01:11] [V] [TRT] Tactic: 9502719 Time: 0.228468 [07/07/2021-20:01:11] [V] [TRT] Tactic: 9830399 Time: 0.305724 [07/07/2021-20:01:11] [V] [TRT] Tactic: 9961471 Time: 0.177648 [07/07/2021-20:01:11] [V] [TRT] Tactic: 10027007 Time: 0.123712 [07/07/2021-20:01:11] [V] [TRT] Tactic: 10092543 Time: 0.226612 [07/07/2021-20:01:11] [V] [TRT] Tactic: 10289151 Time: 0.2041 [07/07/2021-20:01:11] [V] [TRT] Tactic: 10485759 Time: 0.11136 [07/07/2021-20:01:11] [V] [TRT] Tactic: 10682367 Time: 0.114696 [07/07/2021-20:01:11] [V] [TRT] Tactic: 10813439 Time: 0.174656 [07/07/2021-20:01:11] [V] [TRT] Fastest Tactic: 10485759 Time: 0.11136 [07/07/2021-20:01:11] [V] [TRT] --------------- Timing Runner: node_of_143 (CudnnConvolution) [07/07/2021-20:01:11] [V] [TRT] Tactic: 0 Time: 0.49048 [07/07/2021-20:01:11] [V] [TRT] Tactic: 1 Time: 0.131672 [07/07/2021-20:01:11] [V] [TRT] Tactic: 2 skipped. Scratch requested: 24920064, available: 16777216 [07/07/2021-20:01:11] [V] [TRT] Tactic: 4 skipped. Scratch requested: 144871424, available: 16777216 [07/07/2021-20:01:11] [V] [TRT] Tactic: 5 Time: 0.887532 [07/07/2021-20:01:11] [V] [TRT] Tactic: 6 Time: 0.101648 [07/07/2021-20:01:11] [V] [TRT] Fastest Tactic: 6 Time: 0.101648 [07/07/2021-20:01:11] [V] [TRT] --------------- Timing Runner: node_of_143 (CaskConvolution) [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [07/07/2021-20:01:11] [V] [TRT] Tactic: 1062367460111450758 Time: 0.1016 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [07/07/2021-20:01:11] [V] [TRT] Tactic: 1754984623894446479 Time: 0.119516 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [07/07/2021-20:01:11] [V] [TRT] Tactic: 3611739942397549984 Time: 0.296832 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [07/07/2021-20:01:11] [V] [TRT] Tactic: 3827454225649558724 Time: 0.068088 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [07/07/2021-20:01:11] [V] [TRT] Tactic: 4337000649858996379 Time: 0.163328 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [07/07/2021-20:01:11] [V] [TRT] Tactic: 4501471010995462441 Time: 0.29464 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:01:11] [V] [TRT] Tactic: 5137655947464784826 Time: 0.1564 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [07/07/2021-20:01:11] [V] [TRT] Tactic: 5288347012147084929 Time: 0.292072 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [07/07/2021-20:01:11] [V] [TRT] Tactic: 5921334924264294896 Time: 0.06784 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [07/07/2021-20:01:11] [V] [TRT] Tactic: 6645123197870846056 Time: 0.160788 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [07/07/2021-20:01:11] [V] [TRT] Tactic: 7144526460361122478 Time: 0.115772 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [07/07/2021-20:01:11] [V] [TRT] Tactic: 7852627285308570038 Time: 0.071096 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [07/07/2021-20:01:11] [V] [TRT] Tactic: -9137461792520977713 Time: 0.298572 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [07/07/2021-20:01:11] [V] [TRT] Tactic: -8776506421218919509 Time: 0.069248 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [07/07/2021-20:01:11] [V] [TRT] Tactic: -8262349710178828730 Time: 0.297272 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [07/07/2021-20:01:11] [V] [TRT] Tactic: -8133971918129952780 Time: 0.174588 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [07/07/2021-20:01:11] [V] [TRT] Tactic: -6092040395344634144 Time: 0.105672 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [07/07/2021-20:01:11] [V] [TRT] Tactic: -4787320710726427159 Time: 0.119156 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:01:11] [V] [TRT] Tactic: -3456450830548107839 Time: 0.09896 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [07/07/2021-20:01:11] [V] [TRT] Tactic: -2318106587342035239 Time: 0.069564 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [07/07/2021-20:01:11] [V] [TRT] Tactic: -1343271414618805657 Time: 0.063864 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [07/07/2021-20:01:11] [V] [TRT] Tactic: -1218658103698133241 Time: 0.173696 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [07/07/2021-20:01:11] [V] [TRT] Tactic: -836875257600482091 Time: 0.168768 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:01:11] [V] [TRT] Tactic: -410470605513481746 Time: 0.288664 [07/07/2021-20:01:11] [V] [TRT] Fastest Tactic: -1343271414618805657 Time: 0.063864 [07/07/2021-20:01:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1343271414618805657 [07/07/2021-20:01:11] [V] [TRT] *************** Autotuning format combination: Float(346112,1,3328,32) -> Float(346112,1,3328,32) *************** [07/07/2021-20:01:11] [V] [TRT] --------------- Timing Runner: node_of_143 (CudnnConvolution) [07/07/2021-20:01:11] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:11] [V] [TRT] --------------- Timing Runner: node_of_143 (CaskConvolution) [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [07/07/2021-20:01:11] [V] [TRT] Tactic: -9153228964338181824 Time: 0.097664 [07/07/2021-20:01:11] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [07/07/2021-20:01:11] [V] [TRT] Tactic: -7394439838318485025 Time: 0.15494 [07/07/2021-20:01:11] [V] [TRT] Fastest Tactic: -9153228964338181824 Time: 0.097664 [07/07/2021-20:01:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824 [07/07/2021-20:01:11] [V] [TRT] *************** Autotuning format combination: Half(346112,10816,104,1) -> Half(346112,10816,104,1) *************** [07/07/2021-20:01:11] [V] [TRT] --------------- Timing Runner: node_of_143 (CudnnConvolution) [07/07/2021-20:01:11] [V] [TRT] Tactic: 0 Time: 0.219396 [07/07/2021-20:01:11] [V] [TRT] Tactic: 1 Time: 0.202816 [07/07/2021-20:01:11] [V] [TRT] Tactic: 2 Time: 0.520328 [07/07/2021-20:01:11] [V] [TRT] Tactic: 4 skipped. Scratch requested: 144871424, available: 16777216 [07/07/2021-20:01:11] [V] [TRT] Tactic: 5 Time: 0.90896 [07/07/2021-20:01:11] [V] [TRT] Tactic: 6 Time: 0.17732 [07/07/2021-20:01:11] [V] [TRT] Fastest Tactic: 6 Time: 0.17732 [07/07/2021-20:01:11] [V] [TRT] --------------- Timing Runner: node_of_143 (CaskConvolution) [07/07/2021-20:01:11] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 6 [07/07/2021-20:01:11] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,10816,104,1) -> Float(10816,10816:32,104,1) (Reformat) [07/07/2021-20:01:11] [V] [TRT] Tactic: 0 Time: 0.0592 [07/07/2021-20:01:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0592 [07/07/2021-20:01:11] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,1,3328,32) -> Float(10816,10816:32,104,1) (Reformat) [07/07/2021-20:01:11] [V] [TRT] Tactic: 0 Time: 0.134744 [07/07/2021-20:01:11] [V] [TRT] Fastest Tactic: 0 Time: 0.134744 [07/07/2021-20:01:11] [V] [TRT] --------------- Timing Runner: reformat: Float(10816,10816:32,104,1) -> Float(346112,10816,104,1) (Reformat) [07/07/2021-20:01:11] [V] [TRT] Tactic: 0 Time: 0.049152 [07/07/2021-20:01:11] [V] [TRT] Fastest Tactic: 0 Time: 0.049152 [07/07/2021-20:01:11] [V] [TRT] --------------- Timing Runner: reformat: Float(10816,10816:32,104,1) -> Float(346112,1,3328,32) (Reformat) [07/07/2021-20:01:11] [V] [TRT] Tactic: 0 Time: 0.040516 [07/07/2021-20:01:11] [V] [TRT] Fastest Tactic: 0 Time: 0.040516 [07/07/2021-20:01:11] [V] [TRT] --------------- Timing Runner: reformat: Float(10816,10816:32,104,1) -> Half(346112,10816,104,1) (Reformat) [07/07/2021-20:01:11] [V] [TRT] Tactic: 0 Time: 0.048756 [07/07/2021-20:01:11] [V] [TRT] Fastest Tactic: 0 Time: 0.048756 [07/07/2021-20:01:11] [V] [TRT] --------------- Timing Runner: reformat: Half(346112,10816,104,1) -> Float(10816,10816:32,104,1) (Reformat) [07/07/2021-20:01:11] [V] [TRT] Tactic: 0 Time: 0.059836 [07/07/2021-20:01:11] [V] [TRT] Fastest Tactic: 0 Time: 0.059836 [07/07/2021-20:01:11] [V] [TRT] *************** Autotuning format combination: Float(346112,10816,104,1) -> Float(692224,10816,104,1) *************** [07/07/2021-20:01:11] [V] [TRT] --------------- Timing Runner: node_of_145 (PointWiseV2) [07/07/2021-20:01:11] [V] [TRT] Tactic: 0 Time: 0.030716 [07/07/2021-20:01:11] [V] [TRT] Tactic: 1 Time: 0.030272 [07/07/2021-20:01:12] [V] [TRT] Tactic: 2 Time: 0.02962 [07/07/2021-20:01:12] [V] [TRT] Tactic: 3 Time: 0.030416 [07/07/2021-20:01:12] [V] [TRT] Tactic: 4 Time: 0.030652 [07/07/2021-20:01:12] [V] [TRT] Tactic: 5 Time: 0.029112 [07/07/2021-20:01:12] [V] [TRT] Tactic: 6 Time: 0.030208 [07/07/2021-20:01:13] [V] [TRT] Tactic: 7 Time: 0.030392 [07/07/2021-20:01:13] [V] [TRT] Tactic: 8 Time: 0.029496 [07/07/2021-20:01:13] [V] [TRT] Tactic: 9 Time: 0.029052 [07/07/2021-20:01:13] [V] [TRT] Tactic: 28 Time: 0.030464 [07/07/2021-20:01:13] [V] [TRT] Fastest Tactic: 9 Time: 0.029052 [07/07/2021-20:01:13] [V] [TRT] --------------- Timing Runner: node_of_145 (PointWise) [07/07/2021-20:01:13] [V] [TRT] Tactic: 128 Time: 0.052932 [07/07/2021-20:01:13] [V] [TRT] Tactic: 256 Time: 0.053492 [07/07/2021-20:01:13] [V] [TRT] Tactic: 512 Time: 0.053696 [07/07/2021-20:01:13] [V] [TRT] Fastest Tactic: 128 Time: 0.052932 [07/07/2021-20:01:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [07/07/2021-20:01:13] [V] [TRT] *************** Autotuning format combination: Float(346112,1,3328,32) -> Float(692224,1,6656,64) *************** [07/07/2021-20:01:13] [V] [TRT] --------------- Timing Runner: node_of_145 (PointWiseV2) [07/07/2021-20:01:13] [V] [TRT] Tactic: 0 Time: 0.030528 [07/07/2021-20:01:13] [V] [TRT] Tactic: 1 Time: 0.041344 [07/07/2021-20:01:13] [V] [TRT] Tactic: 2 Time: 0.032124 [07/07/2021-20:01:13] [V] [TRT] Tactic: 3 Time: 0.050556 [07/07/2021-20:01:13] [V] [TRT] Tactic: 4 Time: 0.038196 [07/07/2021-20:01:13] [V] [TRT] Tactic: 5 Time: 0.033428 [07/07/2021-20:01:13] [V] [TRT] Tactic: 6 Time: 0.064432 [07/07/2021-20:01:13] [V] [TRT] Tactic: 7 Time: 0.048884 [07/07/2021-20:01:13] [V] [TRT] Tactic: 8 Time: 0.039296 [07/07/2021-20:01:13] [V] [TRT] Tactic: 9 Time: 0.03584 [07/07/2021-20:01:13] [V] [TRT] Tactic: 28 Time: 0.030204 [07/07/2021-20:01:13] [V] [TRT] Fastest Tactic: 28 Time: 0.030204 [07/07/2021-20:01:13] [V] [TRT] --------------- Timing Runner: node_of_145 (PointWise) [07/07/2021-20:01:13] [V] [TRT] Tactic: 128 Time: 0.053216 [07/07/2021-20:01:13] [V] [TRT] Tactic: 256 Time: 0.053248 [07/07/2021-20:01:13] [V] [TRT] Tactic: 512 Time: 0.05348 [07/07/2021-20:01:13] [V] [TRT] Fastest Tactic: 128 Time: 0.053216 [07/07/2021-20:01:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [07/07/2021-20:01:13] [V] [TRT] *************** Autotuning format combination: Float(10816,10816:32,104,1) -> Float(21632,10816:32,104,1) *************** [07/07/2021-20:01:13] [V] [TRT] --------------- Timing Runner: node_of_145 (PointWiseV2) [07/07/2021-20:01:13] [V] [TRT] Tactic: 24 Time: 0.02912 [07/07/2021-20:01:14] [V] [TRT] Tactic: 25 Time: 0.029152 [07/07/2021-20:01:14] [V] [TRT] Tactic: 26 Time: 0.02976 [07/07/2021-20:01:14] [V] [TRT] Tactic: 27 Time: 0.029648 [07/07/2021-20:01:14] [V] [TRT] Tactic: 31 Time: 0.029556 [07/07/2021-20:01:14] [V] [TRT] Fastest Tactic: 24 Time: 0.02912 [07/07/2021-20:01:14] [V] [TRT] --------------- Timing Runner: node_of_145 (PointWise) [07/07/2021-20:01:14] [V] [TRT] Tactic: 128 Time: 0.052988 [07/07/2021-20:01:14] [V] [TRT] Tactic: 256 Time: 0.05318 [07/07/2021-20:01:14] [V] [TRT] Tactic: 512 Time: 0.053628 [07/07/2021-20:01:14] [V] [TRT] Fastest Tactic: 128 Time: 0.052988 [07/07/2021-20:01:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [07/07/2021-20:01:14] [V] [TRT] *************** Autotuning format combination: Half(346112,10816,104,1) -> Half(692224,10816,104,1) *************** [07/07/2021-20:01:14] [V] [TRT] --------------- Timing Runner: node_of_145 (PointWiseV2) [07/07/2021-20:01:14] [V] [TRT] Tactic: 0 Time: 0.028032 [07/07/2021-20:01:15] [V] [TRT] Tactic: 1 Time: 0.020796 [07/07/2021-20:01:15] [V] [TRT] Tactic: 2 Time: 0.018864 [07/07/2021-20:01:15] [V] [TRT] Tactic: 3 Time: 0.018164 [07/07/2021-20:01:15] [V] [TRT] Tactic: 4 Time: 0.016896 [07/07/2021-20:01:15] [V] [TRT] Tactic: 5 Time: 0.01632 [07/07/2021-20:01:16] [V] [TRT] Tactic: 6 Time: 0.018176 [07/07/2021-20:01:16] [V] [TRT] Tactic: 7 Time: 0.017024 [07/07/2021-20:01:16] [V] [TRT] Tactic: 8 Time: 0.016736 [07/07/2021-20:01:16] [V] [TRT] Tactic: 9 Time: 0.016 [07/07/2021-20:01:16] [V] [TRT] Tactic: 28 Time: 0.026264 [07/07/2021-20:01:16] [V] [TRT] Fastest Tactic: 9 Time: 0.016 [07/07/2021-20:01:16] [V] [TRT] --------------- Timing Runner: node_of_145 (PointWise) [07/07/2021-20:01:16] [V] [TRT] Tactic: 128 Time: 0.041592 [07/07/2021-20:01:16] [V] [TRT] Tactic: 256 Time: 0.041336 [07/07/2021-20:01:16] [V] [TRT] Tactic: 512 Time: 0.04004 [07/07/2021-20:01:16] [V] [TRT] Fastest Tactic: 512 Time: 0.04004 [07/07/2021-20:01:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [07/07/2021-20:01:16] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,10816,104,1) -> Float(692224,1,6656,64) (Reformat) [07/07/2021-20:01:16] [V] [TRT] Tactic: 0 Time: 0.05382 [07/07/2021-20:01:16] [V] [TRT] Fastest Tactic: 0 Time: 0.05382 [07/07/2021-20:01:16] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,10816,104,1) -> Float(21632,10816:32,104,1) (Reformat) [07/07/2021-20:01:16] [V] [TRT] Tactic: 0 Time: 0.059088 [07/07/2021-20:01:16] [V] [TRT] Fastest Tactic: 0 Time: 0.059088 [07/07/2021-20:01:16] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,10816,104,1) -> Half(692224,10816,104,1) (Reformat) [07/07/2021-20:01:16] [V] [TRT] Tactic: 0 Time: 0.034036 [07/07/2021-20:01:16] [V] [TRT] Fastest Tactic: 0 Time: 0.034036 [07/07/2021-20:01:16] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,1,6656,64) -> Float(692224,10816,104,1) (Reformat) [07/07/2021-20:01:16] [V] [TRT] Tactic: 0 Time: 0.045884 [07/07/2021-20:01:16] [V] [TRT] Fastest Tactic: 0 Time: 0.045884 [07/07/2021-20:01:16] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,1,6656,64) -> Float(21632,10816:32,104,1) (Reformat) [07/07/2021-20:01:16] [V] [TRT] Tactic: 0 Time: 0.134208 [07/07/2021-20:01:16] [V] [TRT] Fastest Tactic: 0 Time: 0.134208 [07/07/2021-20:01:16] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,1,6656,64) -> Half(692224,10816,104,1) (Reformat) [07/07/2021-20:01:16] [V] [TRT] Tactic: 0 Time: 0.045344 [07/07/2021-20:01:16] [V] [TRT] Fastest Tactic: 0 Time: 0.045344 [07/07/2021-20:01:16] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,10816:32,104,1) -> Float(692224,10816,104,1) (Reformat) [07/07/2021-20:01:16] [V] [TRT] Tactic: 0 Time: 0.049216 [07/07/2021-20:01:16] [V] [TRT] Fastest Tactic: 0 Time: 0.049216 [07/07/2021-20:01:16] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,10816:32,104,1) -> Float(692224,1,6656,64) (Reformat) [07/07/2021-20:01:16] [V] [TRT] Tactic: 0 Time: 0.040512 [07/07/2021-20:01:16] [V] [TRT] Fastest Tactic: 0 Time: 0.040512 [07/07/2021-20:01:16] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,10816:32,104,1) -> Half(692224,10816,104,1) (Reformat) [07/07/2021-20:01:16] [V] [TRT] Tactic: 0 Time: 0.048896 [07/07/2021-20:01:16] [V] [TRT] Fastest Tactic: 0 Time: 0.048896 [07/07/2021-20:01:16] [V] [TRT] --------------- Timing Runner: reformat: Half(692224,10816,104,1) -> Float(692224,10816,104,1) (Reformat) [07/07/2021-20:01:16] [V] [TRT] Tactic: 0 Time: 0.033792 [07/07/2021-20:01:16] [V] [TRT] Fastest Tactic: 0 Time: 0.033792 [07/07/2021-20:01:16] [V] [TRT] --------------- Timing Runner: reformat: Half(692224,10816,104,1) -> Float(692224,1,6656,64) (Reformat) [07/07/2021-20:01:16] [V] [TRT] Tactic: 0 Time: 0.04864 [07/07/2021-20:01:16] [V] [TRT] Fastest Tactic: 0 Time: 0.04864 [07/07/2021-20:01:16] [V] [TRT] --------------- Timing Runner: reformat: Half(692224,10816,104,1) -> Float(21632,10816:32,104,1) (Reformat) [07/07/2021-20:01:16] [V] [TRT] Tactic: 0 Time: 0.06016 [07/07/2021-20:01:16] [V] [TRT] Fastest Tactic: 0 Time: 0.06016 [07/07/2021-20:01:16] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,10816,104,1) -> Float(692224,1,6656,64) (Reformat) [07/07/2021-20:01:16] [V] [TRT] Tactic: 0 Time: 0.053488 [07/07/2021-20:01:16] [V] [TRT] Fastest Tactic: 0 Time: 0.053488 [07/07/2021-20:01:16] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,10816,104,1) -> Half(692224,10816,104,1) (Reformat) [07/07/2021-20:01:16] [V] [TRT] Tactic: 0 Time: 0.033792 [07/07/2021-20:01:16] [V] [TRT] Fastest Tactic: 0 Time: 0.033792 [07/07/2021-20:01:16] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,1,6656,64) -> Float(692224,10816,104,1) (Reformat) [07/07/2021-20:01:17] [V] [TRT] Tactic: 0 Time: 0.045824 [07/07/2021-20:01:17] [V] [TRT] Fastest Tactic: 0 Time: 0.045824 [07/07/2021-20:01:17] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,1,6656,64) -> Half(692224,10816,104,1) (Reformat) [07/07/2021-20:01:17] [V] [TRT] Tactic: 0 Time: 0.045256 [07/07/2021-20:01:17] [V] [TRT] Fastest Tactic: 0 Time: 0.045256 [07/07/2021-20:01:17] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,10816:32,104,1) -> Float(692224,10816,104,1) (Reformat) [07/07/2021-20:01:17] [V] [TRT] Tactic: 0 Time: 0.049504 [07/07/2021-20:01:17] [V] [TRT] Fastest Tactic: 0 Time: 0.049504 [07/07/2021-20:01:17] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,10816:32,104,1) -> Float(692224,1,6656,64) (Reformat) [07/07/2021-20:01:17] [V] [TRT] Tactic: 0 Time: 0.040952 [07/07/2021-20:01:17] [V] [TRT] Fastest Tactic: 0 Time: 0.040952 [07/07/2021-20:01:17] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,10816:32,104,1) -> Half(692224,10816,104,1) (Reformat) [07/07/2021-20:01:17] [V] [TRT] Tactic: 0 Time: 0.04914 [07/07/2021-20:01:17] [V] [TRT] Fastest Tactic: 0 Time: 0.04914 [07/07/2021-20:01:17] [V] [TRT] --------------- Timing Runner: reformat: Half(692224,10816,104,1) -> Float(692224,10816,104,1) (Reformat) [07/07/2021-20:01:17] [V] [TRT] Tactic: 0 Time: 0.026736 [07/07/2021-20:01:17] [V] [TRT] Fastest Tactic: 0 Time: 0.026736 [07/07/2021-20:01:17] [V] [TRT] --------------- Timing Runner: reformat: Half(692224,10816,104,1) -> Float(692224,1,6656,64) (Reformat) [07/07/2021-20:01:17] [V] [TRT] Tactic: 0 Time: 0.048884 [07/07/2021-20:01:17] [V] [TRT] Fastest Tactic: 0 Time: 0.048884 [07/07/2021-20:01:17] [V] [TRT] *************** Autotuning format combination: Float(692224,10816,104,1) -> Float(346112,10816,104,1) *************** [07/07/2021-20:01:17] [V] [TRT] --------------- Timing Runner: node_of_146 (CudaDepthwiseConvolution) [07/07/2021-20:01:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:17] [V] [TRT] --------------- Timing Runner: node_of_146 (FusedConvActConvolution) [07/07/2021-20:01:17] [V] [TRT] Tactic: 524287 Time: 0.139648 [07/07/2021-20:01:17] [V] [TRT] Tactic: 720895 Time: 0.18536 [07/07/2021-20:01:17] [V] [TRT] Tactic: 983039 Time: 0.174644 [07/07/2021-20:01:17] [V] [TRT] Tactic: 1048575 Time: 0.125532 [07/07/2021-20:01:17] [V] [TRT] Tactic: 1703935 Time: 0.11296 [07/07/2021-20:01:17] [V] [TRT] Tactic: 1769471 Time: 0.203072 [07/07/2021-20:01:17] [V] [TRT] Tactic: 1966079 Time: 0.206012 [07/07/2021-20:01:17] [V] [TRT] Tactic: 2031615 Time: 0.200584 [07/07/2021-20:01:17] [V] [TRT] Tactic: 2228223 Time: 0.157332 [07/07/2021-20:01:17] [V] [TRT] Tactic: 2424831 Time: 0.186624 [07/07/2021-20:01:17] [V] [TRT] Tactic: 2621439 Time: 0.116412 [07/07/2021-20:01:17] [V] [TRT] Tactic: 2752511 Time: 0.207744 [07/07/2021-20:01:17] [V] [TRT] Tactic: 2818047 Time: 0.475548 [07/07/2021-20:01:17] [V] [TRT] Tactic: 2883583 Time: 0.381312 [07/07/2021-20:01:17] [V] [TRT] Tactic: 3014655 Time: 0.11904 [07/07/2021-20:01:17] [V] [TRT] Tactic: 3145727 Time: 0.201208 [07/07/2021-20:01:17] [V] [TRT] Tactic: 3473407 Time: 0.355464 [07/07/2021-20:01:17] [V] [TRT] Tactic: 3604479 Time: 0.115156 [07/07/2021-20:01:17] [V] [TRT] Tactic: 3735551 Time: 0.300276 [07/07/2021-20:01:17] [V] [TRT] Tactic: 4390911 Time: 0.224256 [07/07/2021-20:01:17] [V] [TRT] Tactic: 5046271 Time: 0.123392 [07/07/2021-20:01:17] [V] [TRT] Tactic: 5963775 Time: 0.200256 [07/07/2021-20:01:17] [V] [TRT] Tactic: 6160383 Time: 0.142904 [07/07/2021-20:01:17] [V] [TRT] Tactic: 6488063 Time: 0.130752 [07/07/2021-20:01:17] [V] [TRT] Tactic: 6881279 Time: 0.196848 [07/07/2021-20:01:17] [V] [TRT] Tactic: 7274495 Time: 0.220616 [07/07/2021-20:01:17] [V] [TRT] Tactic: 7864319 Time: 0.13632 [07/07/2021-20:01:17] [V] [TRT] Tactic: 7995391 Time: 0.182908 [07/07/2021-20:01:17] [V] [TRT] Tactic: 8585215 Time: 0.15596 [07/07/2021-20:01:17] [V] [TRT] Tactic: 8847359 Time: 0.132992 [07/07/2021-20:01:17] [V] [TRT] Tactic: 8978431 Time: 0.193856 [07/07/2021-20:01:17] [V] [TRT] Tactic: 9043967 Time: 0.119676 [07/07/2021-20:01:17] [V] [TRT] Tactic: 9175039 Time: 0.115672 [07/07/2021-20:01:17] [V] [TRT] Tactic: 9502719 Time: 0.228364 [07/07/2021-20:01:17] [V] [TRT] Tactic: 9830399 Time: 0.304888 [07/07/2021-20:01:17] [V] [TRT] Tactic: 9961471 Time: 0.17606 [07/07/2021-20:01:17] [V] [TRT] Tactic: 10027007 Time: 0.122812 [07/07/2021-20:01:17] [V] [TRT] Tactic: 10092543 Time: 0.22282 [07/07/2021-20:01:17] [V] [TRT] Tactic: 10289151 Time: 0.20454 [07/07/2021-20:01:17] [V] [TRT] Tactic: 10485759 Time: 0.110392 [07/07/2021-20:01:17] [V] [TRT] Tactic: 10682367 Time: 0.113852 [07/07/2021-20:01:17] [V] [TRT] Tactic: 10813439 Time: 0.173964 [07/07/2021-20:01:17] [V] [TRT] Fastest Tactic: 10485759 Time: 0.110392 [07/07/2021-20:01:17] [V] [TRT] --------------- Timing Runner: node_of_146 (CudnnConvolution) [07/07/2021-20:01:17] [V] [TRT] Tactic: 0 Time: 0.489408 [07/07/2021-20:01:17] [V] [TRT] Tactic: 1 Time: 0.129216 [07/07/2021-20:01:17] [V] [TRT] Tactic: 2 skipped. Scratch requested: 24920064, available: 16777216 [07/07/2021-20:01:17] [V] [TRT] Tactic: 4 skipped. Scratch requested: 147640832, available: 16777216 [07/07/2021-20:01:17] [V] [TRT] Tactic: 5 Time: 1.91047 [07/07/2021-20:01:17] [V] [TRT] Tactic: 6 Time: 1.12134 [07/07/2021-20:01:17] [V] [TRT] Fastest Tactic: 1 Time: 0.129216 [07/07/2021-20:01:17] [V] [TRT] --------------- Timing Runner: node_of_146 (CaskConvolution) [07/07/2021-20:01:17] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [07/07/2021-20:01:17] [V] [TRT] Tactic: 1062367460111450758 Time: 0.102708 [07/07/2021-20:01:17] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [07/07/2021-20:01:17] [V] [TRT] Tactic: 1754984623894446479 Time: 0.11874 [07/07/2021-20:01:17] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [07/07/2021-20:01:17] [V] [TRT] Tactic: 3611739942397549984 Time: 0.295648 [07/07/2021-20:01:17] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [07/07/2021-20:01:17] [V] [TRT] Tactic: 3827454225649558724 Time: 0.067828 [07/07/2021-20:01:17] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [07/07/2021-20:01:17] [V] [TRT] Tactic: 4337000649858996379 Time: 0.161864 [07/07/2021-20:01:17] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [07/07/2021-20:01:17] [V] [TRT] Tactic: 4501471010995462441 Time: 0.29278 [07/07/2021-20:01:17] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:01:17] [V] [TRT] Tactic: 5137655947464784826 Time: 0.155264 [07/07/2021-20:01:17] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [07/07/2021-20:01:18] [V] [TRT] Tactic: 5288347012147084929 Time: 0.290048 [07/07/2021-20:01:18] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [07/07/2021-20:01:18] [V] [TRT] Tactic: 5921334924264294896 Time: 0.067316 [07/07/2021-20:01:18] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [07/07/2021-20:01:18] [V] [TRT] Tactic: 6645123197870846056 Time: 0.159744 [07/07/2021-20:01:18] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [07/07/2021-20:01:18] [V] [TRT] Tactic: 7144526460361122478 Time: 0.115864 [07/07/2021-20:01:18] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [07/07/2021-20:01:18] [V] [TRT] Tactic: 7852627285308570038 Time: 0.070648 [07/07/2021-20:01:18] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [07/07/2021-20:01:18] [V] [TRT] Tactic: -9137461792520977713 Time: 0.296704 [07/07/2021-20:01:18] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [07/07/2021-20:01:18] [V] [TRT] Tactic: -8776506421218919509 Time: 0.06804 [07/07/2021-20:01:18] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [07/07/2021-20:01:18] [V] [TRT] Tactic: -8262349710178828730 Time: 0.295156 [07/07/2021-20:01:18] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [07/07/2021-20:01:18] [V] [TRT] Tactic: -8133971918129952780 Time: 0.173572 [07/07/2021-20:01:18] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [07/07/2021-20:01:18] [V] [TRT] Tactic: -6092040395344634144 Time: 0.10534 [07/07/2021-20:01:18] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [07/07/2021-20:01:18] [V] [TRT] Tactic: -4787320710726427159 Time: 0.118788 [07/07/2021-20:01:18] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:01:18] [V] [TRT] Tactic: -3456450830548107839 Time: 0.094456 [07/07/2021-20:01:18] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [07/07/2021-20:01:18] [V] [TRT] Tactic: -2318106587342035239 Time: 0.068872 [07/07/2021-20:01:18] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [07/07/2021-20:01:18] [V] [TRT] Tactic: -1343271414618805657 Time: 0.063548 [07/07/2021-20:01:18] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [07/07/2021-20:01:18] [V] [TRT] Tactic: -1218658103698133241 Time: 0.172924 [07/07/2021-20:01:18] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [07/07/2021-20:01:18] [V] [TRT] Tactic: -836875257600482091 Time: 0.167936 [07/07/2021-20:01:18] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:01:18] [V] [TRT] Tactic: -410470605513481746 Time: 0.286976 [07/07/2021-20:01:18] [V] [TRT] Fastest Tactic: -1343271414618805657 Time: 0.063548 [07/07/2021-20:01:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1343271414618805657 [07/07/2021-20:01:18] [V] [TRT] *************** Autotuning format combination: Float(692224,1,6656,64) -> Float(346112,1,3328,32) *************** [07/07/2021-20:01:18] [V] [TRT] --------------- Timing Runner: node_of_146 (CudnnConvolution) [07/07/2021-20:01:18] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:18] [V] [TRT] --------------- Timing Runner: node_of_146 (CaskConvolution) [07/07/2021-20:01:18] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [07/07/2021-20:01:18] [V] [TRT] Tactic: -9153228964338181824 Time: 0.096564 [07/07/2021-20:01:18] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [07/07/2021-20:01:18] [V] [TRT] Tactic: -7394439838318485025 Time: 0.153928 [07/07/2021-20:01:18] [V] [TRT] Fastest Tactic: -9153228964338181824 Time: 0.096564 [07/07/2021-20:01:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824 [07/07/2021-20:01:18] [V] [TRT] *************** Autotuning format combination: Half(692224,10816,104,1) -> Half(346112,10816,104,1) *************** [07/07/2021-20:01:18] [V] [TRT] --------------- Timing Runner: node_of_146 (CudnnConvolution) [07/07/2021-20:01:18] [V] [TRT] Tactic: 0 Time: 0.218112 [07/07/2021-20:01:18] [V] [TRT] Tactic: 1 Time: 0.200828 [07/07/2021-20:01:18] [V] [TRT] Tactic: 2 Time: 0.519216 [07/07/2021-20:01:18] [V] [TRT] Tactic: 4 skipped. Scratch requested: 146256384, available: 16777216 [07/07/2021-20:01:18] [V] [TRT] Tactic: 5 Time: 1.90563 [07/07/2021-20:01:18] [V] [TRT] Tactic: 6 Time: 1.15643 [07/07/2021-20:01:18] [V] [TRT] Fastest Tactic: 1 Time: 0.200828 [07/07/2021-20:01:18] [V] [TRT] --------------- Timing Runner: node_of_146 (CaskConvolution) [07/07/2021-20:01:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [07/07/2021-20:01:18] [V] [TRT] *************** Autotuning format combination: Float(346112,10816,104,1) -> Float(692224,10816,104,1) *************** [07/07/2021-20:01:18] [V] [TRT] *************** Autotuning format combination: Float(346112,1,3328,32) -> Float(692224,1,6656,64) *************** [07/07/2021-20:01:18] [V] [TRT] *************** Autotuning format combination: Float(10816,10816:32,104,1) -> Float(21632,10816:32,104,1) *************** [07/07/2021-20:01:18] [V] [TRT] *************** Autotuning format combination: Half(346112,10816,104,1) -> Half(692224,10816,104,1) *************** [07/07/2021-20:01:18] [V] [TRT] *************** Autotuning format combination: Float(692224,10816,104,1) -> Float(692224,10816,104,1) *************** [07/07/2021-20:01:18] [V] [TRT] --------------- Timing Runner: node_of_150 (CudaDepthwiseConvolution) [07/07/2021-20:01:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:18] [V] [TRT] --------------- Timing Runner: node_of_150 (FusedConvActConvolution) [07/07/2021-20:01:18] [V] [TRT] Tactic: 589823 Time: 0.232756 [07/07/2021-20:01:18] [V] [TRT] Tactic: 655359 Time: 0.2167 [07/07/2021-20:01:18] [V] [TRT] Tactic: 786431 Time: 0.190208 [07/07/2021-20:01:18] [V] [TRT] Tactic: 851967 Time: 0.242796 [07/07/2021-20:01:18] [V] [TRT] Tactic: 1179647 Time: 0.185656 [07/07/2021-20:01:18] [V] [TRT] Tactic: 1310719 Time: 0.192356 [07/07/2021-20:01:18] [V] [TRT] Tactic: 1376255 Time: 0.186752 [07/07/2021-20:01:18] [V] [TRT] Tactic: 1441791 Time: 0.237568 [07/07/2021-20:01:18] [V] [TRT] Tactic: 1507327 Time: 0.225408 [07/07/2021-20:01:18] [V] [TRT] Tactic: 1638399 Time: 0.199164 [07/07/2021-20:01:18] [V] [TRT] Tactic: 1835007 Time: 0.193664 [07/07/2021-20:01:18] [V] [TRT] Tactic: 1900543 Time: 0.242304 [07/07/2021-20:01:18] [V] [TRT] Tactic: 2097151 Time: 0.21928 [07/07/2021-20:01:18] [V] [TRT] Tactic: 2162687 Time: 0.189888 [07/07/2021-20:01:18] [V] [TRT] Tactic: 2293759 Time: 0.211536 [07/07/2021-20:01:18] [V] [TRT] Tactic: 2359295 Time: 0.176 [07/07/2021-20:01:18] [V] [TRT] Tactic: 2686975 Time: 0.192576 [07/07/2021-20:01:18] [V] [TRT] Tactic: 3080191 Time: 0.218176 [07/07/2021-20:01:18] [V] [TRT] Tactic: 3342335 Time: 0.22482 [07/07/2021-20:01:18] [V] [TRT] Tactic: 3407871 Time: 0.165648 [07/07/2021-20:01:18] [V] [TRT] Tactic: 3538943 Time: 0.163196 [07/07/2021-20:01:18] [V] [TRT] Tactic: 3670015 Time: 0.238588 [07/07/2021-20:01:18] [V] [TRT] Tactic: 3932159 Time: 0.224192 [07/07/2021-20:01:18] [V] [TRT] Tactic: 3997695 Time: 0.190848 [07/07/2021-20:01:18] [V] [TRT] Tactic: 4063231 Time: 0.238132 [07/07/2021-20:01:18] [V] [TRT] Tactic: 4194303 Time: 0.195796 [07/07/2021-20:01:18] [V] [TRT] Tactic: 4259839 Time: 0.213504 [07/07/2021-20:01:18] [V] [TRT] Tactic: 4325375 Time: 0.187392 [07/07/2021-20:01:18] [V] [TRT] Tactic: 4521983 Time: 0.20384 [07/07/2021-20:01:18] [V] [TRT] Tactic: 4587519 Time: 0.184448 [07/07/2021-20:01:18] [V] [TRT] Tactic: 4653055 Time: 0.1888 [07/07/2021-20:01:18] [V] [TRT] Tactic: 4915199 Time: 0.19384 [07/07/2021-20:01:18] [V] [TRT] Tactic: 4980735 Time: 0.196092 [07/07/2021-20:01:18] [V] [TRT] Tactic: 5177343 Time: 0.188352 [07/07/2021-20:01:18] [V] [TRT] Tactic: 5242879 Time: 0.174656 [07/07/2021-20:01:18] [V] [TRT] Tactic: 5373951 Time: 0.200892 [07/07/2021-20:01:18] [V] [TRT] Tactic: 5439487 Time: 0.260092 [07/07/2021-20:01:18] [V] [TRT] Tactic: 5570559 Time: 0.22464 [07/07/2021-20:01:18] [V] [TRT] Tactic: 5636095 Time: 0.238016 [07/07/2021-20:01:18] [V] [TRT] Tactic: 5701631 Time: 0.184064 [07/07/2021-20:01:19] [V] [TRT] Tactic: 5767167 Time: 0.548528 [07/07/2021-20:01:19] [V] [TRT] Tactic: 5832703 Time: 0.169984 [07/07/2021-20:01:19] [V] [TRT] Tactic: 5898239 Time: 0.161868 [07/07/2021-20:01:19] [V] [TRT] Tactic: 6029311 Time: 0.181752 [07/07/2021-20:01:19] [V] [TRT] Tactic: 6225919 Time: 0.169408 [07/07/2021-20:01:19] [V] [TRT] Tactic: 6291455 Time: 0.18592 [07/07/2021-20:01:19] [V] [TRT] Tactic: 6422527 Time: 0.212028 [07/07/2021-20:01:19] [V] [TRT] Tactic: 6750207 Time: 0.200636 [07/07/2021-20:01:19] [V] [TRT] Tactic: 6815743 Time: 0.21184 [07/07/2021-20:01:19] [V] [TRT] Tactic: 6946815 Time: 0.248144 [07/07/2021-20:01:19] [V] [TRT] Tactic: 7012351 Time: 0.219544 [07/07/2021-20:01:19] [V] [TRT] Tactic: 7077887 Time: 0.164156 [07/07/2021-20:01:19] [V] [TRT] Tactic: 7143423 Time: 0.249152 [07/07/2021-20:01:19] [V] [TRT] Tactic: 7208959 Time: 0.174828 [07/07/2021-20:01:19] [V] [TRT] Tactic: 7340031 Time: 0.16128 [07/07/2021-20:01:19] [V] [TRT] Tactic: 7405567 Time: 0.178304 [07/07/2021-20:01:19] [V] [TRT] Tactic: 7536639 Time: 0.21344 [07/07/2021-20:01:19] [V] [TRT] Tactic: 7602175 Time: 0.191872 [07/07/2021-20:01:19] [V] [TRT] Tactic: 7733247 Time: 0.171148 [07/07/2021-20:01:19] [V] [TRT] Tactic: 7798783 Time: 0.19014 [07/07/2021-20:01:19] [V] [TRT] Tactic: 8191999 Time: 0.218112 [07/07/2021-20:01:19] [V] [TRT] Tactic: 8257535 Time: 0.193728 [07/07/2021-20:01:19] [V] [TRT] Tactic: 8323071 Time: 0.197424 [07/07/2021-20:01:19] [V] [TRT] Tactic: 8650751 Time: 0.201592 [07/07/2021-20:01:19] [V] [TRT] Tactic: 8716287 Time: 0.203824 [07/07/2021-20:01:19] [V] [TRT] Tactic: 9109503 Time: 0.212944 [07/07/2021-20:01:19] [V] [TRT] Tactic: 9568255 Time: 0.193932 [07/07/2021-20:01:19] [V] [TRT] Tactic: 9895935 Time: 0.197456 [07/07/2021-20:01:19] [V] [TRT] Tactic: 10223615 Time: 0.192212 [07/07/2021-20:01:19] [V] [TRT] Tactic: 10354687 Time: 0.206408 [07/07/2021-20:01:19] [V] [TRT] Tactic: 10551295 Time: 0.209468 [07/07/2021-20:01:19] [V] [TRT] Tactic: 10747903 Time: 0.170368 [07/07/2021-20:01:19] [V] [TRT] Tactic: 10944511 Time: 0.196992 [07/07/2021-20:01:19] [V] [TRT] Fastest Tactic: 7340031 Time: 0.16128 [07/07/2021-20:01:19] [V] [TRT] --------------- Timing Runner: node_of_150 (CudnnConvolution) [07/07/2021-20:01:19] [V] [TRT] Tactic: 0 Time: 0.188216 [07/07/2021-20:01:19] [V] [TRT] Tactic: 1 Time: 0.127052 [07/07/2021-20:01:19] [V] [TRT] Tactic: 2 Time: 0.229312 [07/07/2021-20:01:19] [V] [TRT] Tactic: 4 skipped. Scratch requested: 562315264, available: 16777216 [07/07/2021-20:01:19] [V] [TRT] Tactic: 5 Time: 0.356752 [07/07/2021-20:01:19] [V] [TRT] Fastest Tactic: 1 Time: 0.127052 [07/07/2021-20:01:19] [V] [TRT] --------------- Timing Runner: node_of_150 (CublasConvolution) [07/07/2021-20:01:19] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:19] [V] [TRT] --------------- Timing Runner: node_of_150 (CaskConvolution) [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [07/07/2021-20:01:19] [V] [TRT] Tactic: 1062367460111450758 Time: 0.094588 [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [07/07/2021-20:01:19] [V] [TRT] Tactic: 1698681053543049347 Time: 0.090756 [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [07/07/2021-20:01:19] [V] [TRT] Tactic: 4501471010995462441 Time: 0.097212 [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:01:19] [V] [TRT] Tactic: 5137655947464784826 Time: 0.06432 [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [07/07/2021-20:01:19] [V] [TRT] Tactic: 5288347012147084929 Time: 0.098816 [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [07/07/2021-20:01:19] [V] [TRT] Tactic: 5326823351883942011 Time: 0.095328 [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [07/07/2021-20:01:19] [V] [TRT] Tactic: 5500448035057547314 Time: 0.066852 [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [07/07/2021-20:01:19] [V] [TRT] Tactic: 6645123197870846056 Time: 0.064508 [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [07/07/2021-20:01:19] [V] [TRT] Tactic: 7144526460361122478 Time: 0.095424 [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [07/07/2021-20:01:19] [V] [TRT] Tactic: -8262349710178828730 Time: 0.1015 [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [07/07/2021-20:01:19] [V] [TRT] Tactic: -6576203419454146580 Time: 0.093128 [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [07/07/2021-20:01:19] [V] [TRT] Tactic: -4787320710726427159 Time: 0.09592 [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:01:19] [V] [TRT] Tactic: -3456450830548107839 Time: 0.093764 [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [07/07/2021-20:01:19] [V] [TRT] Tactic: -1218658103698133241 Time: 0.068396 [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [07/07/2021-20:01:19] [V] [TRT] Tactic: -836875257600482091 Time: 0.067708 [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:01:19] [V] [TRT] Tactic: -410470605513481746 Time: 0.096428 [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [07/07/2021-20:01:19] [V] [TRT] Tactic: -377491875521947884 Time: 0.097284 [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [07/07/2021-20:01:19] [V] [TRT] Tactic: -37215280111360163 Time: 0.062952 [07/07/2021-20:01:19] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.062952 [07/07/2021-20:01:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [07/07/2021-20:01:19] [V] [TRT] *************** Autotuning format combination: Float(692224,1,6656,64) -> Float(692224,1,6656,64) *************** [07/07/2021-20:01:19] [V] [TRT] --------------- Timing Runner: node_of_150 (CudnnConvolution) [07/07/2021-20:01:19] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:19] [V] [TRT] --------------- Timing Runner: node_of_150 (CublasConvolution) [07/07/2021-20:01:19] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:19] [V] [TRT] --------------- Timing Runner: node_of_150 (CaskConvolution) [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [07/07/2021-20:01:19] [V] [TRT] Tactic: 3886731678879822788 Time: 0.071336 [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [07/07/2021-20:01:19] [V] [TRT] Tactic: 6629944304117643200 Time: 0.087232 [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [07/07/2021-20:01:19] [V] [TRT] Tactic: -9153228964338181824 Time: 0.087228 [07/07/2021-20:01:19] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [07/07/2021-20:01:19] [V] [TRT] Tactic: -7394439838318485025 Time: 0.072268 [07/07/2021-20:01:19] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.071336 [07/07/2021-20:01:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [07/07/2021-20:01:19] [V] [TRT] *************** Autotuning format combination: Half(692224,10816,104,1) -> Half(692224,10816,104,1) *************** [07/07/2021-20:01:19] [V] [TRT] --------------- Timing Runner: node_of_150 (CudnnConvolution) [07/07/2021-20:01:19] [V] [TRT] Tactic: 0 Time: 0.156352 [07/07/2021-20:01:19] [V] [TRT] Tactic: 1 Time: 0.12036 [07/07/2021-20:01:19] [V] [TRT] Tactic: 2 Time: 0.217144 [07/07/2021-20:01:19] [V] [TRT] Tactic: 4 skipped. Scratch requested: 562315264, available: 16777216 [07/07/2021-20:01:19] [V] [TRT] Tactic: 5 Time: 0.343616 [07/07/2021-20:01:19] [V] [TRT] Fastest Tactic: 1 Time: 0.12036 [07/07/2021-20:01:19] [V] [TRT] --------------- Timing Runner: node_of_150 (CublasConvolution) [07/07/2021-20:01:19] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:19] [V] [TRT] --------------- Timing Runner: node_of_150 (CaskConvolution) [07/07/2021-20:01:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [07/07/2021-20:01:19] [V] [TRT] *************** Autotuning format combination: Float(692224,10816,104,1) -> Float(1384448,10816,104,1) *************** [07/07/2021-20:01:19] [V] [TRT] --------------- Timing Runner: node_of_152 (PointWiseV2) [07/07/2021-20:01:19] [V] [TRT] Tactic: 0 Time: 0.059148 [07/07/2021-20:01:19] [V] [TRT] Tactic: 1 Time: 0.058024 [07/07/2021-20:01:19] [V] [TRT] Tactic: 2 Time: 0.05736 [07/07/2021-20:01:19] [V] [TRT] Tactic: 3 Time: 0.057088 [07/07/2021-20:01:19] [V] [TRT] Tactic: 4 Time: 0.056976 [07/07/2021-20:01:19] [V] [TRT] Tactic: 5 Time: 0.057216 [07/07/2021-20:01:19] [V] [TRT] Tactic: 6 Time: 0.057904 [07/07/2021-20:01:19] [V] [TRT] Tactic: 7 Time: 0.057344 [07/07/2021-20:01:19] [V] [TRT] Tactic: 8 Time: 0.057076 [07/07/2021-20:01:19] [V] [TRT] Tactic: 9 Time: 0.057152 [07/07/2021-20:01:19] [V] [TRT] Tactic: 28 Time: 0.058684 [07/07/2021-20:01:19] [V] [TRT] Fastest Tactic: 4 Time: 0.056976 [07/07/2021-20:01:19] [V] [TRT] --------------- Timing Runner: node_of_152 (PointWise) [07/07/2021-20:01:19] [V] [TRT] Tactic: 128 Time: 0.1024 [07/07/2021-20:01:19] [V] [TRT] Tactic: 256 Time: 0.102384 [07/07/2021-20:01:19] [V] [TRT] Tactic: 512 Time: 0.102528 [07/07/2021-20:01:19] [V] [TRT] Fastest Tactic: 256 Time: 0.102384 [07/07/2021-20:01:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [07/07/2021-20:01:19] [V] [TRT] *************** Autotuning format combination: Float(692224,1,6656,64) -> Float(1384448,1,13312,128) *************** [07/07/2021-20:01:19] [V] [TRT] --------------- Timing Runner: node_of_152 (PointWiseV2) [07/07/2021-20:01:19] [V] [TRT] Tactic: 0 Time: 0.0585 [07/07/2021-20:01:19] [V] [TRT] Tactic: 1 Time: 0.057864 [07/07/2021-20:01:19] [V] [TRT] Tactic: 2 Time: 0.057336 [07/07/2021-20:01:19] [V] [TRT] Tactic: 3 Time: 0.064316 [07/07/2021-20:01:19] [V] [TRT] Tactic: 4 Time: 0.058256 [07/07/2021-20:01:19] [V] [TRT] Tactic: 5 Time: 0.05766 [07/07/2021-20:01:19] [V] [TRT] Tactic: 6 Time: 0.07804 [07/07/2021-20:01:19] [V] [TRT] Tactic: 7 Time: 0.060408 [07/07/2021-20:01:19] [V] [TRT] Tactic: 8 Time: 0.058484 [07/07/2021-20:01:19] [V] [TRT] Tactic: 9 Time: 0.05878 [07/07/2021-20:01:19] [V] [TRT] Tactic: 28 Time: 0.058588 [07/07/2021-20:01:19] [V] [TRT] Fastest Tactic: 2 Time: 0.057336 [07/07/2021-20:01:19] [V] [TRT] --------------- Timing Runner: node_of_152 (PointWise) [07/07/2021-20:01:19] [V] [TRT] Tactic: 128 Time: 0.102144 [07/07/2021-20:01:20] [V] [TRT] Tactic: 256 Time: 0.102304 [07/07/2021-20:01:20] [V] [TRT] Tactic: 512 Time: 0.102784 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 128 Time: 0.102144 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [07/07/2021-20:01:20] [V] [TRT] *************** Autotuning format combination: Float(21632,10816:32,104,1) -> Float(43264,10816:32,104,1) *************** [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: node_of_152 (PointWiseV2) [07/07/2021-20:01:20] [V] [TRT] Tactic: 24 Time: 0.057012 [07/07/2021-20:01:20] [V] [TRT] Tactic: 25 Time: 0.056764 [07/07/2021-20:01:20] [V] [TRT] Tactic: 26 Time: 0.056708 [07/07/2021-20:01:20] [V] [TRT] Tactic: 27 Time: 0.057844 [07/07/2021-20:01:20] [V] [TRT] Tactic: 31 Time: 0.056776 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 26 Time: 0.056708 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: node_of_152 (PointWise) [07/07/2021-20:01:20] [V] [TRT] Tactic: 128 Time: 0.101936 [07/07/2021-20:01:20] [V] [TRT] Tactic: 256 Time: 0.102216 [07/07/2021-20:01:20] [V] [TRT] Tactic: 512 Time: 0.102592 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 128 Time: 0.101936 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [07/07/2021-20:01:20] [V] [TRT] *************** Autotuning format combination: Half(692224,10816,104,1) -> Half(1384448,10816,104,1) *************** [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: node_of_152 (PointWiseV2) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.052224 [07/07/2021-20:01:20] [V] [TRT] Tactic: 1 Time: 0.03718 [07/07/2021-20:01:20] [V] [TRT] Tactic: 2 Time: 0.03378 [07/07/2021-20:01:20] [V] [TRT] Tactic: 3 Time: 0.032348 [07/07/2021-20:01:20] [V] [TRT] Tactic: 4 Time: 0.029924 [07/07/2021-20:01:20] [V] [TRT] Tactic: 5 Time: 0.029492 [07/07/2021-20:01:20] [V] [TRT] Tactic: 6 Time: 0.031744 [07/07/2021-20:01:20] [V] [TRT] Tactic: 7 Time: 0.03032 [07/07/2021-20:01:20] [V] [TRT] Tactic: 8 Time: 0.029824 [07/07/2021-20:01:20] [V] [TRT] Tactic: 9 Time: 0.029824 [07/07/2021-20:01:20] [V] [TRT] Tactic: 28 Time: 0.04922 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 5 Time: 0.029492 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: node_of_152 (PointWise) [07/07/2021-20:01:20] [V] [TRT] Tactic: 128 Time: 0.078968 [07/07/2021-20:01:20] [V] [TRT] Tactic: 256 Time: 0.077568 [07/07/2021-20:01:20] [V] [TRT] Tactic: 512 Time: 0.075136 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 512 Time: 0.075136 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Float(1384448,10816,104,1) -> Float(1384448,1,13312,128) (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.098304 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.098304 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Float(1384448,10816,104,1) -> Float(43264,10816:32,104,1) (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.114372 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.114372 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Float(1384448,10816,104,1) -> Half(1384448,10816,104,1) (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.063548 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.063548 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Float(1384448,1,13312,128) -> Float(1384448,10816,104,1) (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.088212 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.088212 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Float(1384448,1,13312,128) -> Float(43264,10816:32,104,1) (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.299452 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.299452 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Float(1384448,1,13312,128) -> Half(1384448,10816,104,1) (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.086336 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.086336 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,10816:32,104,1) -> Float(1384448,10816,104,1) (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.094448 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.094448 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,10816:32,104,1) -> Float(1384448,1,13312,128) (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.077684 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.077684 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,10816:32,104,1) -> Half(1384448,10816,104,1) (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.093184 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.093184 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Half(1384448,10816,104,1) -> Float(1384448,10816,104,1) (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.063488 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.063488 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Half(1384448,10816,104,1) -> Float(1384448,1,13312,128) (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.087472 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.087472 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Half(1384448,10816,104,1) -> Float(43264,10816:32,104,1) (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.11584 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.11584 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: 127 copy (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.126464 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.126464 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: 127 copy (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.098888 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.098888 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: 127 copy (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.11394 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.11394 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: 127 copy (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.0636 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0636 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: 127 copy (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.088212 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.088212 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: 127 copy (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.066064 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.066064 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: 127 copy (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.29916 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.29916 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: 127 copy (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.086656 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.086656 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: 127 copy (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.095064 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.095064 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: 127 copy (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.077636 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.077636 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: 127 copy (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.12644 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.12644 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: 127 copy (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.0935 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0935 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: 127 copy (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.063612 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.063612 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: 127 copy (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.087616 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.087616 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: 127 copy (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.115656 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.115656 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: 127 copy (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.064556 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.064556 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Float(1384448,10816,104,1) -> Half(1384448,10816,104,1) (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.12038 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.12038 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Float(1384448,1,13312,128) -> Float(1384448,10816,104,1) (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.178232 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.178232 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Float(1384448,1,13312,128) -> Half(1384448,10816,104,1) (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.176256 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.176256 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,10816:32,104,1) -> Float(1384448,10816,104,1) (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.186048 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.186048 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,10816:32,104,1) -> Half(1384448,10816,104,1) (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.184448 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.184448 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Half(1384448,10816,104,1) -> Float(1384448,10816,104,1) (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.092148 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.092148 [07/07/2021-20:01:20] [V] [TRT] *************** Autotuning format combination: Float(1384448,10816,104,1) -> Float(346112,2704,52,1) *************** [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: node_of_154 (TiledPooling) [07/07/2021-20:01:20] [V] [TRT] Tactic: 5505281 Time: 0.108428 [07/07/2021-20:01:20] [V] [TRT] Tactic: 5570817 Time: 0.076828 [07/07/2021-20:01:20] [V] [TRT] Tactic: 5636353 Time: 0.072428 [07/07/2021-20:01:20] [V] [TRT] Tactic: 5701889 Time: 0.072032 [07/07/2021-20:01:20] [V] [TRT] Tactic: 5767425 Time: 0.072064 [07/07/2021-20:01:20] [V] [TRT] Tactic: 5832961 Time: 0.072436 [07/07/2021-20:01:20] [V] [TRT] Tactic: 5898497 Time: 0.072456 [07/07/2021-20:01:20] [V] [TRT] Tactic: 5964033 Time: 0.072064 [07/07/2021-20:01:20] [V] [TRT] Tactic: 6029569 Time: 0.108736 [07/07/2021-20:01:20] [V] [TRT] Tactic: 6095105 Time: 0.088164 [07/07/2021-20:01:20] [V] [TRT] Tactic: 6160641 Time: 0.08702 [07/07/2021-20:01:20] [V] [TRT] Tactic: 6226177 Time: 0.087936 [07/07/2021-20:01:20] [V] [TRT] Tactic: 6291713 Time: 0.088304 [07/07/2021-20:01:20] [V] [TRT] Tactic: 6357249 Time: 0.088936 [07/07/2021-20:01:20] [V] [TRT] Tactic: 6422785 Time: 0.088704 [07/07/2021-20:01:20] [V] [TRT] Tactic: 6488321 Time: 0.089328 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 5701889 Time: 0.072032 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: node_of_154 (CudnnPooling) [07/07/2021-20:01:20] [V] [TRT] Tactic: -1 Time: 0.077696 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: -1 Time: 0.077696 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 5701889 [07/07/2021-20:01:20] [V] [TRT] *************** Autotuning format combination: Half(1384448,10816,104,1) -> Half(346112,2704,52,1) *************** [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: node_of_154 (TiledPooling) [07/07/2021-20:01:20] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: node_of_154 (CudnnPooling) [07/07/2021-20:01:20] [V] [TRT] Tactic: -1 Time: 0.04992 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: -1 Time: 0.04992 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnPooling Tactic: -1 [07/07/2021-20:01:20] [V] [TRT] *************** Autotuning format combination: Int32() -> Float() *************** [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: node_of_443 (Cast) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.002048 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002048 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: node_of_443 (Reformat) [07/07/2021-20:01:20] [V] [TRT] Reformat has no valid tactics for this config, skipping [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Cast Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Float() -> Half() (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.002048 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002048 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Float() -> Half() (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.002112 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002112 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Half() -> Float() (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.00224 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00224 [07/07/2021-20:01:20] [V] [TRT] *************** Autotuning format combination: Float() -> Float(1,1,1,1) *************** [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 303) [Shuffle] (Shuffle) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.002176 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002176 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] *************** Autotuning format combination: Half() -> Half(1,1,1,1) *************** [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 303) [Shuffle] (Shuffle) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.002144 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002144 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] *************** Autotuning format combination: Int32() -> Float() *************** [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: node_of_448 (Cast) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.002164 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002164 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: node_of_448 (Reformat) [07/07/2021-20:01:20] [V] [TRT] Reformat has no valid tactics for this config, skipping [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Cast Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] *************** Autotuning format combination: Float() -> Float(1,1,1,1) *************** [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 309) [Shuffle] (Shuffle) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.002124 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002124 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] *************** Autotuning format combination: Half() -> Half(1,1,1,1) *************** [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 309) [Shuffle] (Shuffle) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.002424 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002424 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] *************** Autotuning format combination: Int32() -> Float() *************** [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: node_of_882 (Cast) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.002412 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002412 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: node_of_882 (Reformat) [07/07/2021-20:01:20] [V] [TRT] Reformat has no valid tactics for this config, skipping [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Cast Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] *************** Autotuning format combination: Float() -> Float(1,1,1,1) *************** [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 634) [Shuffle] (Shuffle) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.002416 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002416 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] *************** Autotuning format combination: Half() -> Half(1,1,1,1) *************** [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 634) [Shuffle] (Shuffle) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.002352 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002352 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] *************** Autotuning format combination: Int32() -> Float() *************** [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: node_of_887 (Cast) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.002432 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002432 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: node_of_887 (Reformat) [07/07/2021-20:01:20] [V] [TRT] Reformat has no valid tactics for this config, skipping [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Cast Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] *************** Autotuning format combination: Float() -> Float(1,1,1,1) *************** [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 640) [Shuffle] (Shuffle) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.002416 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002416 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] *************** Autotuning format combination: Half() -> Half(1,1,1,1) *************** [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 640) [Shuffle] (Shuffle) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.002368 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002368 [07/07/2021-20:01:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,2704,52,1) -> Float(346112,1,6656,128) (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.04714 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.04714 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,2704,52,1) -> Half(346112,2704,52,1) (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.04006 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.04006 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,1,6656,128) -> Float(346112,2704,52,1) (Reformat) [07/07/2021-20:01:20] [V] [TRT] Tactic: 0 Time: 0.041268 [07/07/2021-20:01:20] [V] [TRT] Fastest Tactic: 0 Time: 0.041268 [07/07/2021-20:01:20] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,1,6656,128) -> Half(346112,2704,52,1) (Reformat) [07/07/2021-20:01:21] [V] [TRT] Tactic: 0 Time: 0.038064 [07/07/2021-20:01:21] [V] [TRT] Fastest Tactic: 0 Time: 0.038064 [07/07/2021-20:01:21] [V] [TRT] --------------- Timing Runner: reformat: Half(346112,2704,52,1) -> Float(346112,2704,52,1) (Reformat) [07/07/2021-20:01:21] [V] [TRT] Tactic: 0 Time: 0.026292 [07/07/2021-20:01:21] [V] [TRT] Fastest Tactic: 0 Time: 0.026292 [07/07/2021-20:01:21] [V] [TRT] --------------- Timing Runner: reformat: Half(346112,2704,52,1) -> Float(346112,1,6656,128) (Reformat) [07/07/2021-20:01:21] [V] [TRT] Tactic: 0 Time: 0.042992 [07/07/2021-20:01:21] [V] [TRT] Fastest Tactic: 0 Time: 0.042992 [07/07/2021-20:01:21] [V] [TRT] *************** Autotuning format combination: Float(346112,2704,52,1) -> Float(346112,2704,52,1) *************** [07/07/2021-20:01:21] [V] [TRT] --------------- Timing Runner: node_of_155 (CudaDepthwiseConvolution) [07/07/2021-20:01:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:21] [V] [TRT] --------------- Timing Runner: node_of_155 (FusedConvActConvolution) [07/07/2021-20:01:21] [V] [TRT] Tactic: 524287 Time: 0.359056 [07/07/2021-20:01:21] [V] [TRT] Tactic: 720895 Time: 0.344304 [07/07/2021-20:01:21] [V] [TRT] Tactic: 983039 Time: 0.32102 [07/07/2021-20:01:21] [V] [TRT] Tactic: 1048575 Time: 0.377408 [07/07/2021-20:01:21] [V] [TRT] Tactic: 1703935 Time: 0.348 [07/07/2021-20:01:21] [V] [TRT] Tactic: 1769471 Time: 0.36416 [07/07/2021-20:01:21] [V] [TRT] Tactic: 1966079 Time: 0.43098 [07/07/2021-20:01:21] [V] [TRT] Tactic: 2031615 Time: 0.425984 [07/07/2021-20:01:21] [V] [TRT] Tactic: 2228223 Time: 0.43872 [07/07/2021-20:01:21] [V] [TRT] Tactic: 2424831 Time: 0.553984 [07/07/2021-20:01:21] [V] [TRT] Tactic: 2621439 Time: 0.366676 [07/07/2021-20:01:21] [V] [TRT] Tactic: 2752511 Time: 0.367232 [07/07/2021-20:01:21] [V] [TRT] Tactic: 2818047 Time: 0.550976 [07/07/2021-20:01:21] [V] [TRT] Tactic: 2883583 Time: 0.425792 [07/07/2021-20:01:21] [V] [TRT] Tactic: 3014655 Time: 0.358528 [07/07/2021-20:01:21] [V] [TRT] Tactic: 3145727 Time: 0.346176 [07/07/2021-20:01:21] [V] [TRT] Tactic: 3473407 Time: 0.378964 [07/07/2021-20:01:21] [V] [TRT] Tactic: 3604479 Time: 0.344048 [07/07/2021-20:01:21] [V] [TRT] Tactic: 3735551 Time: 0.34668 [07/07/2021-20:01:21] [V] [TRT] Tactic: 4390911 Time: 0.396544 [07/07/2021-20:01:21] [V] [TRT] Tactic: 5046271 Time: 0.35808 [07/07/2021-20:01:21] [V] [TRT] Tactic: 5963775 Time: 0.372224 [07/07/2021-20:01:21] [V] [TRT] Tactic: 6160383 Time: 0.39808 [07/07/2021-20:01:22] [V] [TRT] Tactic: 6488063 Time: 0.393144 [07/07/2021-20:01:22] [V] [TRT] Tactic: 6881279 Time: 0.404096 [07/07/2021-20:01:22] [V] [TRT] Tactic: 7274495 Time: 0.37952 [07/07/2021-20:01:22] [V] [TRT] Tactic: 7864319 Time: 0.383216 [07/07/2021-20:01:22] [V] [TRT] Tactic: 7995391 Time: 0.361336 [07/07/2021-20:01:22] [V] [TRT] Tactic: 8585215 Time: 0.418432 [07/07/2021-20:01:22] [V] [TRT] Tactic: 8847359 Time: 0.390196 [07/07/2021-20:01:22] [V] [TRT] Tactic: 8978431 Time: 0.372736 [07/07/2021-20:01:22] [V] [TRT] Tactic: 9043967 Time: 0.367232 [07/07/2021-20:01:22] [V] [TRT] Tactic: 9175039 Time: 0.35076 [07/07/2021-20:01:22] [V] [TRT] Tactic: 9502719 Time: 0.4096 [07/07/2021-20:01:22] [V] [TRT] Tactic: 9830399 Time: 0.348672 [07/07/2021-20:01:22] [V] [TRT] Tactic: 9961471 Time: 0.5536 [07/07/2021-20:01:22] [V] [TRT] Tactic: 10027007 Time: 0.368 [07/07/2021-20:01:22] [V] [TRT] Tactic: 10092543 Time: 0.404096 [07/07/2021-20:01:22] [V] [TRT] Tactic: 10289151 Time: 0.42866 [07/07/2021-20:01:22] [V] [TRT] Tactic: 10485759 Time: 0.34366 [07/07/2021-20:01:22] [V] [TRT] Tactic: 10682367 Time: 0.361216 [07/07/2021-20:01:22] [V] [TRT] Tactic: 10813439 Time: 0.340352 [07/07/2021-20:01:22] [V] [TRT] Fastest Tactic: 983039 Time: 0.32102 [07/07/2021-20:01:22] [V] [TRT] --------------- Timing Runner: node_of_155 (CudnnConvolution) [07/07/2021-20:01:22] [V] [TRT] Tactic: 0 Time: 0.49456 [07/07/2021-20:01:22] [V] [TRT] Tactic: 1 Time: 0.37016 [07/07/2021-20:01:22] [V] [TRT] Tactic: 2 skipped. Scratch requested: 24920064, available: 16777216 [07/07/2021-20:01:22] [V] [TRT] Tactic: 4 skipped. Scratch requested: 562888704, available: 16777216 [07/07/2021-20:01:22] [V] [TRT] Tactic: 5 skipped. Scratch requested: 75759616, available: 16777216 [07/07/2021-20:01:22] [V] [TRT] Tactic: 6 Time: 0.240128 [07/07/2021-20:01:22] [V] [TRT] Fastest Tactic: 6 Time: 0.240128 [07/07/2021-20:01:22] [V] [TRT] --------------- Timing Runner: node_of_155 (CaskConvolution) [07/07/2021-20:01:22] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [07/07/2021-20:01:22] [V] [TRT] Tactic: 1062367460111450758 Time: 0.370816 [07/07/2021-20:01:22] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [07/07/2021-20:01:22] [V] [TRT] Tactic: 1754984623894446479 Time: 0.446784 [07/07/2021-20:01:22] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [07/07/2021-20:01:22] [V] [TRT] Tactic: 3611739942397549984 Time: 0.304768 [07/07/2021-20:01:22] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [07/07/2021-20:01:22] [V] [TRT] Tactic: 3827454225649558724 Time: 0.19906 [07/07/2021-20:01:22] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [07/07/2021-20:01:22] [V] [TRT] Tactic: 4337000649858996379 Time: 0.320128 [07/07/2021-20:01:22] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [07/07/2021-20:01:22] [V] [TRT] Tactic: 4501471010995462441 Time: 0.293748 [07/07/2021-20:01:22] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:01:22] [V] [TRT] Tactic: 5137655947464784826 Time: 0.300004 [07/07/2021-20:01:22] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [07/07/2021-20:01:22] [V] [TRT] Tactic: 5288347012147084929 Time: 0.29088 [07/07/2021-20:01:22] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [07/07/2021-20:01:22] [V] [TRT] Tactic: 5921334924264294896 Time: 0.210296 [07/07/2021-20:01:22] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [07/07/2021-20:01:22] [V] [TRT] Tactic: 6645123197870846056 Time: 0.327016 [07/07/2021-20:01:22] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [07/07/2021-20:01:22] [V] [TRT] Tactic: 7144526460361122478 Time: 0.422952 [07/07/2021-20:01:22] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [07/07/2021-20:01:22] [V] [TRT] Tactic: 7852627285308570038 Time: 0.219548 [07/07/2021-20:01:22] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [07/07/2021-20:01:22] [V] [TRT] Tactic: -9137461792520977713 Time: 0.316828 [07/07/2021-20:01:22] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [07/07/2021-20:01:22] [V] [TRT] Tactic: -8776506421218919509 Time: 0.196104 [07/07/2021-20:01:22] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [07/07/2021-20:01:22] [V] [TRT] Tactic: -8262349710178828730 Time: 0.314856 [07/07/2021-20:01:22] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [07/07/2021-20:01:22] [V] [TRT] Tactic: -8133971918129952780 Time: 0.37606 [07/07/2021-20:01:22] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [07/07/2021-20:01:23] [V] [TRT] Tactic: -6092040395344634144 Time: 0.382844 [07/07/2021-20:01:23] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [07/07/2021-20:01:23] [V] [TRT] Tactic: -4787320710726427159 Time: 0.447576 [07/07/2021-20:01:23] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:01:23] [V] [TRT] Tactic: -3456450830548107839 Time: 0.332568 [07/07/2021-20:01:23] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [07/07/2021-20:01:23] [V] [TRT] Tactic: -2318106587342035239 Time: 0.206992 [07/07/2021-20:01:23] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [07/07/2021-20:01:23] [V] [TRT] Tactic: -1343271414618805657 Time: 0.195664 [07/07/2021-20:01:23] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [07/07/2021-20:01:23] [V] [TRT] Tactic: -1218658103698133241 Time: 0.374016 [07/07/2021-20:01:23] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [07/07/2021-20:01:23] [V] [TRT] Tactic: -836875257600482091 Time: 0.361392 [07/07/2021-20:01:23] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:01:23] [V] [TRT] Tactic: -410470605513481746 Time: 0.297216 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: -1343271414618805657 Time: 0.195664 [07/07/2021-20:01:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1343271414618805657 [07/07/2021-20:01:23] [V] [TRT] *************** Autotuning format combination: Float(346112,1,6656,128) -> Float(346112,1,6656,128) *************** [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_155 (CudnnConvolution) [07/07/2021-20:01:23] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_155 (CaskConvolution) [07/07/2021-20:01:23] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [07/07/2021-20:01:23] [V] [TRT] Tactic: -9153228964338181824 Time: 0.284268 [07/07/2021-20:01:23] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [07/07/2021-20:01:23] [V] [TRT] Tactic: -7394439838318485025 Time: 0.26786 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.26786 [07/07/2021-20:01:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [07/07/2021-20:01:23] [V] [TRT] *************** Autotuning format combination: Half(346112,2704,52,1) -> Half(346112,2704,52,1) *************** [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_155 (CudnnConvolution) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.51206 [07/07/2021-20:01:23] [V] [TRT] Tactic: 1 Time: 0.391796 [07/07/2021-20:01:23] [V] [TRT] Tactic: 2 Time: 0.54526 [07/07/2021-20:01:23] [V] [TRT] Tactic: 4 skipped. Scratch requested: 562888704, available: 16777216 [07/07/2021-20:01:23] [V] [TRT] Tactic: 5 skipped. Scratch requested: 75759616, available: 16777216 [07/07/2021-20:01:23] [V] [TRT] Tactic: 6 Time: 0.321256 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 6 Time: 0.321256 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_155 (CaskConvolution) [07/07/2021-20:01:23] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 6 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,2704,52,1) -> Float(10816,2704:32,52,1) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.056492 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.056492 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,1,6656,128) -> Float(10816,2704:32,52,1) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.075328 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.075328 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Float(10816,2704:32,52,1) -> Float(346112,2704,52,1) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.042364 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.042364 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Float(10816,2704:32,52,1) -> Float(346112,1,6656,128) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.040892 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.040892 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Float(10816,2704:32,52,1) -> Half(346112,2704,52,1) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.041108 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.041108 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Half(346112,2704,52,1) -> Float(10816,2704:32,52,1) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.056668 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.056668 [07/07/2021-20:01:23] [V] [TRT] *************** Autotuning format combination: Float(346112,2704,52,1) -> Float(346112,2704,52,1) *************** [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_157 (PointWiseV2) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.03032 [07/07/2021-20:01:23] [V] [TRT] Tactic: 1 Time: 0.030216 [07/07/2021-20:01:23] [V] [TRT] Tactic: 2 Time: 0.029104 [07/07/2021-20:01:23] [V] [TRT] Tactic: 3 Time: 0.029896 [07/07/2021-20:01:23] [V] [TRT] Tactic: 4 Time: 0.029652 [07/07/2021-20:01:23] [V] [TRT] Tactic: 5 Time: 0.028916 [07/07/2021-20:01:23] [V] [TRT] Tactic: 6 Time: 0.029968 [07/07/2021-20:01:23] [V] [TRT] Tactic: 7 Time: 0.029984 [07/07/2021-20:01:23] [V] [TRT] Tactic: 8 Time: 0.029364 [07/07/2021-20:01:23] [V] [TRT] Tactic: 9 Time: 0.028932 [07/07/2021-20:01:23] [V] [TRT] Tactic: 28 Time: 0.030016 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 5 Time: 0.028916 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_157 (PointWise) [07/07/2021-20:01:23] [V] [TRT] Tactic: 128 Time: 0.041884 [07/07/2021-20:01:23] [V] [TRT] Tactic: 256 Time: 0.041404 [07/07/2021-20:01:23] [V] [TRT] Tactic: 512 Time: 0.042316 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 256 Time: 0.041404 [07/07/2021-20:01:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [07/07/2021-20:01:23] [V] [TRT] *************** Autotuning format combination: Float(346112,1,6656,128) -> Float(346112,1,6656,128) *************** [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_157 (PointWiseV2) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.030392 [07/07/2021-20:01:23] [V] [TRT] Tactic: 1 Time: 0.0304 [07/07/2021-20:01:23] [V] [TRT] Tactic: 2 Time: 0.029244 [07/07/2021-20:01:23] [V] [TRT] Tactic: 3 Time: 0.029924 [07/07/2021-20:01:23] [V] [TRT] Tactic: 4 Time: 0.029472 [07/07/2021-20:01:23] [V] [TRT] Tactic: 5 Time: 0.028948 [07/07/2021-20:01:23] [V] [TRT] Tactic: 6 Time: 0.029888 [07/07/2021-20:01:23] [V] [TRT] Tactic: 7 Time: 0.029824 [07/07/2021-20:01:23] [V] [TRT] Tactic: 8 Time: 0.02914 [07/07/2021-20:01:23] [V] [TRT] Tactic: 9 Time: 0.029 [07/07/2021-20:01:23] [V] [TRT] Tactic: 28 Time: 0.030228 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 5 Time: 0.028948 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_157 (PointWise) [07/07/2021-20:01:23] [V] [TRT] Tactic: 128 Time: 0.041148 [07/07/2021-20:01:23] [V] [TRT] Tactic: 256 Time: 0.041276 [07/07/2021-20:01:23] [V] [TRT] Tactic: 512 Time: 0.041984 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 128 Time: 0.041148 [07/07/2021-20:01:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [07/07/2021-20:01:23] [V] [TRT] *************** Autotuning format combination: Float(10816,2704:32,52,1) -> Float(10816,2704:32,52,1) *************** [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_157 (PointWiseV2) [07/07/2021-20:01:23] [V] [TRT] Tactic: 24 Time: 0.028796 [07/07/2021-20:01:23] [V] [TRT] Tactic: 25 Time: 0.028792 [07/07/2021-20:01:23] [V] [TRT] Tactic: 26 Time: 0.029684 [07/07/2021-20:01:23] [V] [TRT] Tactic: 27 Time: 0.029508 [07/07/2021-20:01:23] [V] [TRT] Tactic: 31 Time: 0.028672 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 31 Time: 0.028672 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_157 (PointWise) [07/07/2021-20:01:23] [V] [TRT] Tactic: 128 Time: 0.041716 [07/07/2021-20:01:23] [V] [TRT] Tactic: 256 Time: 0.041344 [07/07/2021-20:01:23] [V] [TRT] Tactic: 512 Time: 0.042112 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 256 Time: 0.041344 [07/07/2021-20:01:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [07/07/2021-20:01:23] [V] [TRT] *************** Autotuning format combination: Half(346112,2704,52,1) -> Half(346112,2704,52,1) *************** [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_157 (PointWiseV2) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.022016 [07/07/2021-20:01:23] [V] [TRT] Tactic: 1 Time: 0.019012 [07/07/2021-20:01:23] [V] [TRT] Tactic: 2 Time: 0.017068 [07/07/2021-20:01:23] [V] [TRT] Tactic: 3 Time: 0.018124 [07/07/2021-20:01:23] [V] [TRT] Tactic: 4 Time: 0.01684 [07/07/2021-20:01:23] [V] [TRT] Tactic: 5 Time: 0.015624 [07/07/2021-20:01:23] [V] [TRT] Tactic: 6 Time: 0.017544 [07/07/2021-20:01:23] [V] [TRT] Tactic: 7 Time: 0.016668 [07/07/2021-20:01:23] [V] [TRT] Tactic: 8 Time: 0.016528 [07/07/2021-20:01:23] [V] [TRT] Tactic: 9 Time: 0.016188 [07/07/2021-20:01:23] [V] [TRT] Tactic: 28 Time: 0.021504 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 5 Time: 0.015624 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_157 (PointWise) [07/07/2021-20:01:23] [V] [TRT] Tactic: 128 Time: 0.037704 [07/07/2021-20:01:23] [V] [TRT] Tactic: 256 Time: 0.037064 [07/07/2021-20:01:23] [V] [TRT] Tactic: 512 Time: 0.037456 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 256 Time: 0.037064 [07/07/2021-20:01:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,2704,52,1) -> Float(346112,1,6656,128) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.047592 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.047592 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,2704,52,1) -> Float(10816,2704:32,52,1) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.056112 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.056112 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,2704,52,1) -> Half(346112,2704,52,1) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.03968 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.03968 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,1,6656,128) -> Float(346112,2704,52,1) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.041672 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.041672 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,1,6656,128) -> Float(10816,2704:32,52,1) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.07564 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.07564 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,1,6656,128) -> Half(346112,2704,52,1) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.03846 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.03846 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Float(10816,2704:32,52,1) -> Float(346112,2704,52,1) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.042112 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.042112 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Float(10816,2704:32,52,1) -> Float(346112,1,6656,128) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.040776 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.040776 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Float(10816,2704:32,52,1) -> Half(346112,2704,52,1) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.040784 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.040784 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Half(346112,2704,52,1) -> Float(346112,2704,52,1) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.026688 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.026688 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Half(346112,2704,52,1) -> Float(346112,1,6656,128) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.043576 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.043576 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Half(346112,2704,52,1) -> Float(10816,2704:32,52,1) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.056556 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.056556 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_172 (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.033748 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.033748 [07/07/2021-20:01:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_172 (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.0261 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0261 [07/07/2021-20:01:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_172 (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.018048 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.018048 [07/07/2021-20:01:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_172 (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.02238 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.02238 [07/07/2021-20:01:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_172 (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.018688 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.018688 [07/07/2021-20:01:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_172 (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.0184 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0184 [07/07/2021-20:01:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_172 (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.022588 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.022588 [07/07/2021-20:01:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_172 (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.021632 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.021632 [07/07/2021-20:01:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_172 (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.020984 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.020984 [07/07/2021-20:01:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_172 (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.01394 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.01394 [07/07/2021-20:01:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_172 (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.02256 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.02256 [07/07/2021-20:01:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: node_of_172 (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.017344 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.017344 [07/07/2021-20:01:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,2704,52,1) -> Float(173056,1,3328,64) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.0261 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0261 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,2704,52,1) -> Half(173056,2704,52,1) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.01662 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.01662 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,1,3328,64) -> Float(173056,2704,52,1) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.021564 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.021564 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,1,3328,64) -> Half(173056,2704,52,1) (Reformat) [07/07/2021-20:01:23] [V] [TRT] Tactic: 0 Time: 0.018412 [07/07/2021-20:01:23] [V] [TRT] Fastest Tactic: 0 Time: 0.018412 [07/07/2021-20:01:23] [V] [TRT] --------------- Timing Runner: reformat: Half(173056,2704,52,1) -> Float(173056,2704,52,1) (Reformat) [07/07/2021-20:01:24] [V] [TRT] Tactic: 0 Time: 0.01408 [07/07/2021-20:01:24] [V] [TRT] Fastest Tactic: 0 Time: 0.01408 [07/07/2021-20:01:24] [V] [TRT] --------------- Timing Runner: reformat: Half(173056,2704,52,1) -> Float(173056,1,3328,64) (Reformat) [07/07/2021-20:01:24] [V] [TRT] Tactic: 0 Time: 0.021768 [07/07/2021-20:01:24] [V] [TRT] Fastest Tactic: 0 Time: 0.021768 [07/07/2021-20:01:24] [V] [TRT] *************** Autotuning format combination: Float(173056,2704,52,1) -> Float(173056,2704,52,1) *************** [07/07/2021-20:01:24] [V] [TRT] --------------- Timing Runner: node_of_173 (CudaDepthwiseConvolution) [07/07/2021-20:01:24] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:24] [V] [TRT] --------------- Timing Runner: node_of_173 (FusedConvActConvolution) [07/07/2021-20:01:24] [V] [TRT] Tactic: 524287 Time: 0.138584 [07/07/2021-20:01:24] [V] [TRT] Tactic: 720895 Time: 0.116736 [07/07/2021-20:01:24] [V] [TRT] Tactic: 983039 Time: 0.098048 [07/07/2021-20:01:24] [V] [TRT] Tactic: 1048575 Time: 0.126544 [07/07/2021-20:01:24] [V] [TRT] Tactic: 1703935 Time: 0.107368 [07/07/2021-20:01:24] [V] [TRT] Tactic: 1769471 Time: 0.107904 [07/07/2021-20:01:24] [V] [TRT] Tactic: 1966079 Time: 0.16174 [07/07/2021-20:01:24] [V] [TRT] Tactic: 2031615 Time: 0.149572 [07/07/2021-20:01:24] [V] [TRT] Tactic: 2228223 Time: 0.151168 [07/07/2021-20:01:24] [V] [TRT] Tactic: 2424831 Time: 0.161792 [07/07/2021-20:01:24] [V] [TRT] Tactic: 2621439 Time: 0.11072 [07/07/2021-20:01:24] [V] [TRT] Tactic: 2752511 Time: 0.115936 [07/07/2021-20:01:24] [V] [TRT] Tactic: 2818047 Time: 0.279024 [07/07/2021-20:01:24] [V] [TRT] Tactic: 2883583 Time: 0.24506 [07/07/2021-20:01:24] [V] [TRT] Tactic: 3014655 Time: 0.114116 [07/07/2021-20:01:24] [V] [TRT] Tactic: 3145727 Time: 0.107004 [07/07/2021-20:01:24] [V] [TRT] Tactic: 3473407 Time: 0.203372 [07/07/2021-20:01:24] [V] [TRT] Tactic: 3604479 Time: 0.109824 [07/07/2021-20:01:24] [V] [TRT] Tactic: 3735551 Time: 0.170604 [07/07/2021-20:01:24] [V] [TRT] Tactic: 4390911 Time: 0.184304 [07/07/2021-20:01:24] [V] [TRT] Tactic: 5046271 Time: 0.116036 [07/07/2021-20:01:24] [V] [TRT] Tactic: 5963775 Time: 0.139748 [07/07/2021-20:01:24] [V] [TRT] Tactic: 6160383 Time: 0.139884 [07/07/2021-20:01:24] [V] [TRT] Tactic: 6488063 Time: 0.136576 [07/07/2021-20:01:24] [V] [TRT] Tactic: 6881279 Time: 0.143548 [07/07/2021-20:01:24] [V] [TRT] Tactic: 7274495 Time: 0.118096 [07/07/2021-20:01:24] [V] [TRT] Tactic: 7864319 Time: 0.116988 [07/07/2021-20:01:24] [V] [TRT] Tactic: 7995391 Time: 0.126 [07/07/2021-20:01:24] [V] [TRT] Tactic: 8585215 Time: 0.1387 [07/07/2021-20:01:24] [V] [TRT] Tactic: 8847359 Time: 0.11826 [07/07/2021-20:01:24] [V] [TRT] Tactic: 8978431 Time: 0.131516 [07/07/2021-20:01:24] [V] [TRT] Tactic: 9043967 Time: 0.113204 [07/07/2021-20:01:24] [V] [TRT] Tactic: 9175039 Time: 0.11008 [07/07/2021-20:01:24] [V] [TRT] Tactic: 9502719 Time: 0.184124 [07/07/2021-20:01:24] [V] [TRT] Tactic: 9830399 Time: 0.18158 [07/07/2021-20:01:24] [V] [TRT] Tactic: 9961471 Time: 0.163568 [07/07/2021-20:01:24] [V] [TRT] Tactic: 10027007 Time: 0.118844 [07/07/2021-20:01:24] [V] [TRT] Tactic: 10092543 Time: 0.179536 [07/07/2021-20:01:24] [V] [TRT] Tactic: 10289151 Time: 0.162868 [07/07/2021-20:01:24] [V] [TRT] Tactic: 10485759 Time: 0.103092 [07/07/2021-20:01:24] [V] [TRT] Tactic: 10682367 Time: 0.108716 [07/07/2021-20:01:24] [V] [TRT] Tactic: 10813439 Time: 0.105596 [07/07/2021-20:01:24] [V] [TRT] Fastest Tactic: 983039 Time: 0.098048 [07/07/2021-20:01:24] [V] [TRT] --------------- Timing Runner: node_of_173 (CudnnConvolution) [07/07/2021-20:01:24] [V] [TRT] Tactic: 0 Time: 0.249408 [07/07/2021-20:01:24] [V] [TRT] Tactic: 1 Time: 0.096952 [07/07/2021-20:01:24] [V] [TRT] Tactic: 2 Time: 0.302636 [07/07/2021-20:01:24] [V] [TRT] Tactic: 4 skipped. Scratch requested: 142884864, available: 16777216 [07/07/2021-20:01:24] [V] [TRT] Tactic: 5 skipped. Scratch requested: 20054016, available: 16777216 [07/07/2021-20:01:24] [V] [TRT] Tactic: 6 Time: 0.081524 [07/07/2021-20:01:24] [V] [TRT] Fastest Tactic: 6 Time: 0.081524 [07/07/2021-20:01:24] [V] [TRT] --------------- Timing Runner: node_of_173 (CaskConvolution) [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [07/07/2021-20:01:24] [V] [TRT] Tactic: 1062367460111450758 Time: 0.099568 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [07/07/2021-20:01:24] [V] [TRT] Tactic: 1754984623894446479 Time: 0.135932 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [07/07/2021-20:01:24] [V] [TRT] Tactic: 3611739942397549984 Time: 0.149428 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [07/07/2021-20:01:24] [V] [TRT] Tactic: 3827454225649558724 Time: 0.060032 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [07/07/2021-20:01:24] [V] [TRT] Tactic: 4337000649858996379 Time: 0.083848 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [07/07/2021-20:01:24] [V] [TRT] Tactic: 4501471010995462441 Time: 0.148084 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:01:24] [V] [TRT] Tactic: 5137655947464784826 Time: 0.07984 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [07/07/2021-20:01:24] [V] [TRT] Tactic: 5288347012147084929 Time: 0.14382 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [07/07/2021-20:01:24] [V] [TRT] Tactic: 5921334924264294896 Time: 0.062716 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [07/07/2021-20:01:24] [V] [TRT] Tactic: 6645123197870846056 Time: 0.08334 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [07/07/2021-20:01:24] [V] [TRT] Tactic: 7144526460361122478 Time: 0.126012 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [07/07/2021-20:01:24] [V] [TRT] Tactic: 7852627285308570038 Time: 0.066048 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [07/07/2021-20:01:24] [V] [TRT] Tactic: -9137461792520977713 Time: 0.152052 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [07/07/2021-20:01:24] [V] [TRT] Tactic: -8776506421218919509 Time: 0.060064 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [07/07/2021-20:01:24] [V] [TRT] Tactic: -8262349710178828730 Time: 0.14898 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [07/07/2021-20:01:24] [V] [TRT] Tactic: -8133971918129952780 Time: 0.0935 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [07/07/2021-20:01:24] [V] [TRT] Tactic: -6092040395344634144 Time: 0.101392 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [07/07/2021-20:01:24] [V] [TRT] Tactic: -4787320710726427159 Time: 0.135568 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:01:24] [V] [TRT] Tactic: -3456450830548107839 Time: 0.092644 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [07/07/2021-20:01:24] [V] [TRT] Tactic: -2318106587342035239 Time: 0.063552 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [07/07/2021-20:01:24] [V] [TRT] Tactic: -1343271414618805657 Time: 0.061888 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [07/07/2021-20:01:24] [V] [TRT] Tactic: -1218658103698133241 Time: 0.093896 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [07/07/2021-20:01:24] [V] [TRT] Tactic: -836875257600482091 Time: 0.089348 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:01:24] [V] [TRT] Tactic: -410470605513481746 Time: 0.143288 [07/07/2021-20:01:24] [V] [TRT] Fastest Tactic: 3827454225649558724 Time: 0.060032 [07/07/2021-20:01:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3827454225649558724 [07/07/2021-20:01:24] [V] [TRT] *************** Autotuning format combination: Float(173056,1,3328,64) -> Float(173056,1,3328,64) *************** [07/07/2021-20:01:24] [V] [TRT] --------------- Timing Runner: node_of_173 (CudnnConvolution) [07/07/2021-20:01:24] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:24] [V] [TRT] --------------- Timing Runner: node_of_173 (CaskConvolution) [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [07/07/2021-20:01:24] [V] [TRT] Tactic: -9153228964338181824 Time: 0.081528 [07/07/2021-20:01:24] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [07/07/2021-20:01:24] [V] [TRT] Tactic: -7394439838318485025 Time: 0.08152 [07/07/2021-20:01:24] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.08152 [07/07/2021-20:01:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [07/07/2021-20:01:24] [V] [TRT] *************** Autotuning format combination: Half(173056,2704,52,1) -> Half(173056,2704,52,1) *************** [07/07/2021-20:01:24] [V] [TRT] --------------- Timing Runner: node_of_173 (CudnnConvolution) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.193792 [07/07/2021-20:01:25] [V] [TRT] Tactic: 1 Time: 0.141692 [07/07/2021-20:01:25] [V] [TRT] Tactic: 2 Time: 0.289356 [07/07/2021-20:01:25] [V] [TRT] Tactic: 4 skipped. Scratch requested: 142884864, available: 16777216 [07/07/2021-20:01:25] [V] [TRT] Tactic: 5 skipped. Scratch requested: 20054016, available: 16777216 [07/07/2021-20:01:25] [V] [TRT] Tactic: 6 Time: 0.139736 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 6 Time: 0.139736 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: node_of_173 (CaskConvolution) [07/07/2021-20:01:25] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 6 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,2704,52,1) -> Float(5408,2704:32,52,1) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.030212 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.030212 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,1,3328,64) -> Float(5408,2704:32,52,1) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.037948 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.037948 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Float(5408,2704:32,52,1) -> Float(173056,2704,52,1) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.022656 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.022656 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Float(5408,2704:32,52,1) -> Float(173056,1,3328,64) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.02162 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.02162 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Float(5408,2704:32,52,1) -> Half(173056,2704,52,1) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.021488 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.021488 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Half(173056,2704,52,1) -> Float(5408,2704:32,52,1) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.029696 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.029696 [07/07/2021-20:01:25] [V] [TRT] *************** Autotuning format combination: Float(173056,2704,52,1) -> Float(346112,2704,52,1) *************** [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: node_of_175 (PointWiseV2) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.016384 [07/07/2021-20:01:25] [V] [TRT] Tactic: 1 Time: 0.016128 [07/07/2021-20:01:25] [V] [TRT] Tactic: 2 Time: 0.014208 [07/07/2021-20:01:25] [V] [TRT] Tactic: 3 Time: 0.01624 [07/07/2021-20:01:25] [V] [TRT] Tactic: 4 Time: 0.014832 [07/07/2021-20:01:25] [V] [TRT] Tactic: 5 Time: 0.01368 [07/07/2021-20:01:25] [V] [TRT] Tactic: 6 Time: 0.016444 [07/07/2021-20:01:25] [V] [TRT] Tactic: 7 Time: 0.0149 [07/07/2021-20:01:25] [V] [TRT] Tactic: 8 Time: 0.014064 [07/07/2021-20:01:25] [V] [TRT] Tactic: 9 Time: 0.013628 [07/07/2021-20:01:25] [V] [TRT] Tactic: 28 Time: 0.016384 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 9 Time: 0.013628 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: node_of_175 (PointWise) [07/07/2021-20:01:25] [V] [TRT] Tactic: 128 Time: 0.02776 [07/07/2021-20:01:25] [V] [TRT] Tactic: 256 Time: 0.027888 [07/07/2021-20:01:25] [V] [TRT] Tactic: 512 Time: 0.028672 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 128 Time: 0.02776 [07/07/2021-20:01:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [07/07/2021-20:01:25] [V] [TRT] *************** Autotuning format combination: Float(173056,1,3328,64) -> Float(346112,1,6656,128) *************** [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: node_of_175 (PointWiseV2) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.016384 [07/07/2021-20:01:25] [V] [TRT] Tactic: 1 Time: 0.015872 [07/07/2021-20:01:25] [V] [TRT] Tactic: 2 Time: 0.014192 [07/07/2021-20:01:25] [V] [TRT] Tactic: 3 Time: 0.018672 [07/07/2021-20:01:25] [V] [TRT] Tactic: 4 Time: 0.01536 [07/07/2021-20:01:25] [V] [TRT] Tactic: 5 Time: 0.01472 [07/07/2021-20:01:25] [V] [TRT] Tactic: 6 Time: 0.02214 [07/07/2021-20:01:25] [V] [TRT] Tactic: 7 Time: 0.017408 [07/07/2021-20:01:25] [V] [TRT] Tactic: 8 Time: 0.016128 [07/07/2021-20:01:25] [V] [TRT] Tactic: 9 Time: 0.016068 [07/07/2021-20:01:25] [V] [TRT] Tactic: 28 Time: 0.016504 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 2 Time: 0.014192 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: node_of_175 (PointWise) [07/07/2021-20:01:25] [V] [TRT] Tactic: 128 Time: 0.028024 [07/07/2021-20:01:25] [V] [TRT] Tactic: 256 Time: 0.02822 [07/07/2021-20:01:25] [V] [TRT] Tactic: 512 Time: 0.028536 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 128 Time: 0.028024 [07/07/2021-20:01:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [07/07/2021-20:01:25] [V] [TRT] *************** Autotuning format combination: Float(5408,2704:32,52,1) -> Float(10816,2704:32,52,1) *************** [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: node_of_175 (PointWiseV2) [07/07/2021-20:01:25] [V] [TRT] Tactic: 24 Time: 0.013624 [07/07/2021-20:01:25] [V] [TRT] Tactic: 25 Time: 0.014456 [07/07/2021-20:01:25] [V] [TRT] Tactic: 26 Time: 0.014316 [07/07/2021-20:01:25] [V] [TRT] Tactic: 27 Time: 0.01514 [07/07/2021-20:01:25] [V] [TRT] Tactic: 31 Time: 0.013232 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 31 Time: 0.013232 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: node_of_175 (PointWise) [07/07/2021-20:01:25] [V] [TRT] Tactic: 128 Time: 0.028036 [07/07/2021-20:01:25] [V] [TRT] Tactic: 256 Time: 0.028152 [07/07/2021-20:01:25] [V] [TRT] Tactic: 512 Time: 0.028732 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 128 Time: 0.028036 [07/07/2021-20:01:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [07/07/2021-20:01:25] [V] [TRT] *************** Autotuning format combination: Half(173056,2704,52,1) -> Half(346112,2704,52,1) *************** [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: node_of_175 (PointWiseV2) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.01478 [07/07/2021-20:01:25] [V] [TRT] Tactic: 1 Time: 0.010808 [07/07/2021-20:01:25] [V] [TRT] Tactic: 2 Time: 0.010424 [07/07/2021-20:01:25] [V] [TRT] Tactic: 3 Time: 0.00816 [07/07/2021-20:01:25] [V] [TRT] Tactic: 4 Time: 0.00728 [07/07/2021-20:01:25] [V] [TRT] Tactic: 5 Time: 0.007168 [07/07/2021-20:01:25] [V] [TRT] Tactic: 6 Time: 0.007036 [07/07/2021-20:01:25] [V] [TRT] Tactic: 7 Time: 0.006112 [07/07/2021-20:01:25] [V] [TRT] Tactic: 8 Time: 0.005248 [07/07/2021-20:01:25] [V] [TRT] Tactic: 9 Time: 0.006128 [07/07/2021-20:01:25] [V] [TRT] Tactic: 28 Time: 0.01432 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 8 Time: 0.005248 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: node_of_175 (PointWise) [07/07/2021-20:01:25] [V] [TRT] Tactic: 128 Time: 0.022272 [07/07/2021-20:01:25] [V] [TRT] Tactic: 256 Time: 0.021616 [07/07/2021-20:01:25] [V] [TRT] Tactic: 512 Time: 0.021504 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 512 Time: 0.021504 [07/07/2021-20:01:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,2704,52,1) -> Float(346112,1,6656,128) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.0256 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0256 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,2704,52,1) -> Float(10816,2704:32,52,1) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.029768 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.029768 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,2704,52,1) -> Half(346112,2704,52,1) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.018412 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.018412 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,1,6656,128) -> Float(346112,2704,52,1) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.021648 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.021648 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,1,6656,128) -> Float(10816,2704:32,52,1) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.037948 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.037948 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,1,6656,128) -> Half(346112,2704,52,1) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.018492 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.018492 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Float(10816,2704:32,52,1) -> Float(346112,2704,52,1) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.022528 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.022528 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Float(10816,2704:32,52,1) -> Float(346112,1,6656,128) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.021804 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.021804 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Float(10816,2704:32,52,1) -> Half(346112,2704,52,1) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.021168 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.021168 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Half(346112,2704,52,1) -> Float(346112,2704,52,1) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.018552 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.018552 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Half(346112,2704,52,1) -> Float(346112,1,6656,128) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.022528 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.022528 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Half(346112,2704,52,1) -> Float(10816,2704:32,52,1) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.029696 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.029696 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,2704,52,1) -> Float(346112,1,6656,128) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.026056 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.026056 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,2704,52,1) -> Half(346112,2704,52,1) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.018336 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.018336 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,1,6656,128) -> Float(346112,2704,52,1) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.02256 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.02256 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,1,6656,128) -> Half(346112,2704,52,1) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.018472 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.018472 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Float(10816,2704:32,52,1) -> Float(346112,2704,52,1) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.022636 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.022636 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Float(10816,2704:32,52,1) -> Float(346112,1,6656,128) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.021632 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.021632 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Float(10816,2704:32,52,1) -> Half(346112,2704,52,1) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.021064 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.021064 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Half(346112,2704,52,1) -> Float(346112,2704,52,1) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.01408 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.01408 [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: reformat: Half(346112,2704,52,1) -> Float(346112,1,6656,128) (Reformat) [07/07/2021-20:01:25] [V] [TRT] Tactic: 0 Time: 0.022416 [07/07/2021-20:01:25] [V] [TRT] Fastest Tactic: 0 Time: 0.022416 [07/07/2021-20:01:25] [V] [TRT] *************** Autotuning format combination: Float(346112,2704,52,1) -> Float(173056,2704,52,1) *************** [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: node_of_176 (CudaDepthwiseConvolution) [07/07/2021-20:01:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:25] [V] [TRT] --------------- Timing Runner: node_of_176 (FusedConvActConvolution) [07/07/2021-20:01:25] [V] [TRT] Tactic: 524287 Time: 0.1397 [07/07/2021-20:01:25] [V] [TRT] Tactic: 720895 Time: 0.117464 [07/07/2021-20:01:25] [V] [TRT] Tactic: 983039 Time: 0.09996 [07/07/2021-20:01:25] [V] [TRT] Tactic: 1048575 Time: 0.126988 [07/07/2021-20:01:25] [V] [TRT] Tactic: 1703935 Time: 0.107584 [07/07/2021-20:01:25] [V] [TRT] Tactic: 1769471 Time: 0.110844 [07/07/2021-20:01:25] [V] [TRT] Tactic: 1966079 Time: 0.163356 [07/07/2021-20:01:25] [V] [TRT] Tactic: 2031615 Time: 0.150896 [07/07/2021-20:01:25] [V] [TRT] Tactic: 2228223 Time: 0.152956 [07/07/2021-20:01:25] [V] [TRT] Tactic: 2424831 Time: 0.16222 [07/07/2021-20:01:26] [V] [TRT] Tactic: 2621439 Time: 0.110644 [07/07/2021-20:01:26] [V] [TRT] Tactic: 2752511 Time: 0.115284 [07/07/2021-20:01:26] [V] [TRT] Tactic: 2818047 Time: 0.280204 [07/07/2021-20:01:26] [V] [TRT] Tactic: 2883583 Time: 0.248464 [07/07/2021-20:01:26] [V] [TRT] Tactic: 3014655 Time: 0.11404 [07/07/2021-20:01:26] [V] [TRT] Tactic: 3145727 Time: 0.107008 [07/07/2021-20:01:26] [V] [TRT] Tactic: 3473407 Time: 0.200092 [07/07/2021-20:01:26] [V] [TRT] Tactic: 3604479 Time: 0.1098 [07/07/2021-20:01:26] [V] [TRT] Tactic: 3735551 Time: 0.170724 [07/07/2021-20:01:26] [V] [TRT] Tactic: 4390911 Time: 0.18208 [07/07/2021-20:01:26] [V] [TRT] Tactic: 5046271 Time: 0.116204 [07/07/2021-20:01:26] [V] [TRT] Tactic: 5963775 Time: 0.139112 [07/07/2021-20:01:26] [V] [TRT] Tactic: 6160383 Time: 0.139264 [07/07/2021-20:01:26] [V] [TRT] Tactic: 6488063 Time: 0.1376 [07/07/2021-20:01:26] [V] [TRT] Tactic: 6881279 Time: 0.143964 [07/07/2021-20:01:26] [V] [TRT] Tactic: 7274495 Time: 0.11776 [07/07/2021-20:01:26] [V] [TRT] Tactic: 7864319 Time: 0.116884 [07/07/2021-20:01:26] [V] [TRT] Tactic: 7995391 Time: 0.126296 [07/07/2021-20:01:26] [V] [TRT] Tactic: 8585215 Time: 0.139244 [07/07/2021-20:01:26] [V] [TRT] Tactic: 8847359 Time: 0.118628 [07/07/2021-20:01:26] [V] [TRT] Tactic: 8978431 Time: 0.133308 [07/07/2021-20:01:26] [V] [TRT] Tactic: 9043967 Time: 0.113012 [07/07/2021-20:01:26] [V] [TRT] Tactic: 9175039 Time: 0.11008 [07/07/2021-20:01:26] [V] [TRT] Tactic: 9502719 Time: 0.182116 [07/07/2021-20:01:26] [V] [TRT] Tactic: 9830399 Time: 0.17628 [07/07/2021-20:01:26] [V] [TRT] Tactic: 9961471 Time: 0.163968 [07/07/2021-20:01:26] [V] [TRT] Tactic: 10027007 Time: 0.118204 [07/07/2021-20:01:26] [V] [TRT] Tactic: 10092543 Time: 0.181004 [07/07/2021-20:01:26] [V] [TRT] Tactic: 10289151 Time: 0.162392 [07/07/2021-20:01:26] [V] [TRT] Tactic: 10485759 Time: 0.10348 [07/07/2021-20:01:26] [V] [TRT] Tactic: 10682367 Time: 0.109044 [07/07/2021-20:01:26] [V] [TRT] Tactic: 10813439 Time: 0.106596 [07/07/2021-20:01:26] [V] [TRT] Fastest Tactic: 983039 Time: 0.09996 [07/07/2021-20:01:26] [V] [TRT] --------------- Timing Runner: node_of_176 (CudnnConvolution) [07/07/2021-20:01:26] [V] [TRT] Tactic: 0 Time: 0.251256 [07/07/2021-20:01:26] [V] [TRT] Tactic: 1 Time: 0.100708 [07/07/2021-20:01:26] [V] [TRT] Tactic: 2 Time: 0.302364 [07/07/2021-20:01:26] [V] [TRT] Tactic: 4 skipped. Scratch requested: 144269824, available: 16777216 [07/07/2021-20:01:26] [V] [TRT] Tactic: 5 skipped. Scratch requested: 21438976, available: 16777216 [07/07/2021-20:01:26] [V] [TRT] Tactic: 6 Time: 0.593412 [07/07/2021-20:01:26] [V] [TRT] Fastest Tactic: 1 Time: 0.100708 [07/07/2021-20:01:26] [V] [TRT] --------------- Timing Runner: node_of_176 (CaskConvolution) [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [07/07/2021-20:01:26] [V] [TRT] Tactic: 1062367460111450758 Time: 0.100028 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [07/07/2021-20:01:26] [V] [TRT] Tactic: 1754984623894446479 Time: 0.13516 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [07/07/2021-20:01:26] [V] [TRT] Tactic: 3611739942397549984 Time: 0.1512 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [07/07/2021-20:01:26] [V] [TRT] Tactic: 3827454225649558724 Time: 0.060244 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [07/07/2021-20:01:26] [V] [TRT] Tactic: 4337000649858996379 Time: 0.084424 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [07/07/2021-20:01:26] [V] [TRT] Tactic: 4501471010995462441 Time: 0.152608 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:01:26] [V] [TRT] Tactic: 5137655947464784826 Time: 0.079816 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [07/07/2021-20:01:26] [V] [TRT] Tactic: 5288347012147084929 Time: 0.14384 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [07/07/2021-20:01:26] [V] [TRT] Tactic: 5921334924264294896 Time: 0.062732 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [07/07/2021-20:01:26] [V] [TRT] Tactic: 6645123197870846056 Time: 0.083884 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [07/07/2021-20:01:26] [V] [TRT] Tactic: 7144526460361122478 Time: 0.125452 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [07/07/2021-20:01:26] [V] [TRT] Tactic: 7852627285308570038 Time: 0.066088 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [07/07/2021-20:01:26] [V] [TRT] Tactic: -9137461792520977713 Time: 0.150568 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [07/07/2021-20:01:26] [V] [TRT] Tactic: -8776506421218919509 Time: 0.059604 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [07/07/2021-20:01:26] [V] [TRT] Tactic: -8262349710178828730 Time: 0.152952 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [07/07/2021-20:01:26] [V] [TRT] Tactic: -8133971918129952780 Time: 0.09356 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [07/07/2021-20:01:26] [V] [TRT] Tactic: -6092040395344634144 Time: 0.101804 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [07/07/2021-20:01:26] [V] [TRT] Tactic: -4787320710726427159 Time: 0.133696 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:01:26] [V] [TRT] Tactic: -3456450830548107839 Time: 0.091624 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [07/07/2021-20:01:26] [V] [TRT] Tactic: -2318106587342035239 Time: 0.062896 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [07/07/2021-20:01:26] [V] [TRT] Tactic: -1343271414618805657 Time: 0.061424 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [07/07/2021-20:01:26] [V] [TRT] Tactic: -1218658103698133241 Time: 0.092228 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [07/07/2021-20:01:26] [V] [TRT] Tactic: -836875257600482091 Time: 0.089076 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:01:26] [V] [TRT] Tactic: -410470605513481746 Time: 0.141788 [07/07/2021-20:01:26] [V] [TRT] Fastest Tactic: -8776506421218919509 Time: 0.059604 [07/07/2021-20:01:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8776506421218919509 [07/07/2021-20:01:26] [V] [TRT] *************** Autotuning format combination: Float(346112,1,6656,128) -> Float(173056,1,3328,64) *************** [07/07/2021-20:01:26] [V] [TRT] --------------- Timing Runner: node_of_176 (CudnnConvolution) [07/07/2021-20:01:26] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:26] [V] [TRT] --------------- Timing Runner: node_of_176 (CaskConvolution) [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [07/07/2021-20:01:26] [V] [TRT] Tactic: -9153228964338181824 Time: 0.080928 [07/07/2021-20:01:26] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [07/07/2021-20:01:26] [V] [TRT] Tactic: -7394439838318485025 Time: 0.08088 [07/07/2021-20:01:26] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.08088 [07/07/2021-20:01:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [07/07/2021-20:01:26] [V] [TRT] *************** Autotuning format combination: Half(346112,2704,52,1) -> Half(173056,2704,52,1) *************** [07/07/2021-20:01:26] [V] [TRT] --------------- Timing Runner: node_of_176 (CudnnConvolution) [07/07/2021-20:01:26] [V] [TRT] Tactic: 0 Time: 0.192824 [07/07/2021-20:01:26] [V] [TRT] Tactic: 1 Time: 0.650744 [07/07/2021-20:01:26] [V] [TRT] Tactic: 2 Time: 0.28768 [07/07/2021-20:01:26] [V] [TRT] Tactic: 4 skipped. Scratch requested: 143577600, available: 16777216 [07/07/2021-20:01:26] [V] [TRT] Tactic: 5 skipped. Scratch requested: 20746752, available: 16777216 [07/07/2021-20:01:26] [V] [TRT] Tactic: 6 Time: 0.624088 [07/07/2021-20:01:26] [V] [TRT] Fastest Tactic: 0 Time: 0.192824 [07/07/2021-20:01:26] [V] [TRT] --------------- Timing Runner: node_of_176 (CaskConvolution) [07/07/2021-20:01:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [07/07/2021-20:01:26] [V] [TRT] *************** Autotuning format combination: Float(173056,2704,52,1) -> Float(346112,2704,52,1) *************** [07/07/2021-20:01:26] [V] [TRT] *************** Autotuning format combination: Float(173056,1,3328,64) -> Float(346112,1,6656,128) *************** [07/07/2021-20:01:26] [V] [TRT] *************** Autotuning format combination: Float(5408,2704:32,52,1) -> Float(10816,2704:32,52,1) *************** [07/07/2021-20:01:26] [V] [TRT] *************** Autotuning format combination: Half(173056,2704,52,1) -> Half(346112,2704,52,1) *************** [07/07/2021-20:01:26] [V] [TRT] *************** Autotuning format combination: Float(346112,2704,52,1) -> Float(346112,2704,52,1) *************** [07/07/2021-20:01:26] [V] [TRT] --------------- Timing Runner: node_of_180 (CudaDepthwiseConvolution) [07/07/2021-20:01:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:26] [V] [TRT] --------------- Timing Runner: node_of_180 (FusedConvActConvolution) [07/07/2021-20:01:26] [V] [TRT] Tactic: 589823 Time: 0.155504 [07/07/2021-20:01:26] [V] [TRT] Tactic: 655359 Time: 0.147124 [07/07/2021-20:01:26] [V] [TRT] Tactic: 786431 Time: 0.148728 [07/07/2021-20:01:26] [V] [TRT] Tactic: 851967 Time: 0.125876 [07/07/2021-20:01:27] [V] [TRT] Tactic: 1179647 Time: 0.120824 [07/07/2021-20:01:27] [V] [TRT] Tactic: 1310719 Time: 0.165832 [07/07/2021-20:01:27] [V] [TRT] Tactic: 1376255 Time: 0.124032 [07/07/2021-20:01:27] [V] [TRT] Tactic: 1441791 Time: 0.171892 [07/07/2021-20:01:27] [V] [TRT] Tactic: 1507327 Time: 0.135612 [07/07/2021-20:01:27] [V] [TRT] Tactic: 1638399 Time: 0.145664 [07/07/2021-20:01:27] [V] [TRT] Tactic: 1835007 Time: 0.140732 [07/07/2021-20:01:27] [V] [TRT] Tactic: 1900543 Time: 0.159776 [07/07/2021-20:01:27] [V] [TRT] Tactic: 2097151 Time: 0.14552 [07/07/2021-20:01:27] [V] [TRT] Tactic: 2162687 Time: 0.131176 [07/07/2021-20:01:27] [V] [TRT] Tactic: 2293759 Time: 0.124184 [07/07/2021-20:01:27] [V] [TRT] Tactic: 2359295 Time: 0.128444 [07/07/2021-20:01:27] [V] [TRT] Tactic: 2686975 Time: 0.13274 [07/07/2021-20:01:27] [V] [TRT] Tactic: 3080191 Time: 0.131264 [07/07/2021-20:01:27] [V] [TRT] Tactic: 3342335 Time: 0.131908 [07/07/2021-20:01:27] [V] [TRT] Tactic: 3407871 Time: 0.119196 [07/07/2021-20:01:27] [V] [TRT] Tactic: 3538943 Time: 0.107612 [07/07/2021-20:01:27] [V] [TRT] Tactic: 3670015 Time: 0.166964 [07/07/2021-20:01:27] [V] [TRT] Tactic: 3932159 Time: 0.14962 [07/07/2021-20:01:27] [V] [TRT] Tactic: 3997695 Time: 0.140156 [07/07/2021-20:01:27] [V] [TRT] Tactic: 4063231 Time: 0.125664 [07/07/2021-20:01:27] [V] [TRT] Tactic: 4194303 Time: 0.138684 [07/07/2021-20:01:27] [V] [TRT] Tactic: 4259839 Time: 0.143416 [07/07/2021-20:01:27] [V] [TRT] Tactic: 4325375 Time: 0.144908 [07/07/2021-20:01:27] [V] [TRT] Tactic: 4521983 Time: 0.176248 [07/07/2021-20:01:27] [V] [TRT] Tactic: 4587519 Time: 0.130112 [07/07/2021-20:01:27] [V] [TRT] Tactic: 4653055 Time: 0.123724 [07/07/2021-20:01:27] [V] [TRT] Tactic: 4915199 Time: 0.137496 [07/07/2021-20:01:27] [V] [TRT] Tactic: 4980735 Time: 0.15146 [07/07/2021-20:01:27] [V] [TRT] Tactic: 5177343 Time: 0.119552 [07/07/2021-20:01:27] [V] [TRT] Tactic: 5242879 Time: 0.119716 [07/07/2021-20:01:27] [V] [TRT] Tactic: 5373951 Time: 0.139856 [07/07/2021-20:01:27] [V] [TRT] Tactic: 5439487 Time: 0.203196 [07/07/2021-20:01:27] [V] [TRT] Tactic: 5570559 Time: 0.133592 [07/07/2021-20:01:27] [V] [TRT] Tactic: 5636095 Time: 0.125312 [07/07/2021-20:01:27] [V] [TRT] Tactic: 5701631 Time: 0.124208 [07/07/2021-20:01:27] [V] [TRT] Tactic: 5767167 Time: 0.418788 [07/07/2021-20:01:27] [V] [TRT] Tactic: 5832703 Time: 0.118612 [07/07/2021-20:01:27] [V] [TRT] Tactic: 5898239 Time: 0.103076 [07/07/2021-20:01:27] [V] [TRT] Tactic: 6029311 Time: 0.123048 [07/07/2021-20:01:27] [V] [TRT] Tactic: 6225919 Time: 0.11684 [07/07/2021-20:01:27] [V] [TRT] Tactic: 6291455 Time: 0.121676 [07/07/2021-20:01:27] [V] [TRT] Tactic: 6422527 Time: 0.128324 [07/07/2021-20:01:27] [V] [TRT] Tactic: 6750207 Time: 0.14016 [07/07/2021-20:01:27] [V] [TRT] Tactic: 6815743 Time: 0.1395 [07/07/2021-20:01:27] [V] [TRT] Tactic: 6946815 Time: 0.183488 [07/07/2021-20:01:27] [V] [TRT] Tactic: 7012351 Time: 0.145532 [07/07/2021-20:01:27] [V] [TRT] Tactic: 7077887 Time: 0.111384 [07/07/2021-20:01:27] [V] [TRT] Tactic: 7143423 Time: 0.198872 [07/07/2021-20:01:27] [V] [TRT] Tactic: 7208959 Time: 0.118656 [07/07/2021-20:01:27] [V] [TRT] Tactic: 7340031 Time: 0.103752 [07/07/2021-20:01:27] [V] [TRT] Tactic: 7405567 Time: 0.123228 [07/07/2021-20:01:27] [V] [TRT] Tactic: 7536639 Time: 0.163764 [07/07/2021-20:01:27] [V] [TRT] Tactic: 7602175 Time: 0.141116 [07/07/2021-20:01:27] [V] [TRT] Tactic: 7733247 Time: 0.115776 [07/07/2021-20:01:27] [V] [TRT] Tactic: 7798783 Time: 0.14852 [07/07/2021-20:01:27] [V] [TRT] Tactic: 8191999 Time: 0.170664 [07/07/2021-20:01:27] [V] [TRT] Tactic: 8257535 Time: 0.136428 [07/07/2021-20:01:28] [V] [TRT] Tactic: 8323071 Time: 0.14572 [07/07/2021-20:01:28] [V] [TRT] Tactic: 8650751 Time: 0.137216 [07/07/2021-20:01:28] [V] [TRT] Tactic: 8716287 Time: 0.145844 [07/07/2021-20:01:28] [V] [TRT] Tactic: 9109503 Time: 0.146868 [07/07/2021-20:01:28] [V] [TRT] Tactic: 9568255 Time: 0.137068 [07/07/2021-20:01:28] [V] [TRT] Tactic: 9895935 Time: 0.139252 [07/07/2021-20:01:28] [V] [TRT] Tactic: 10223615 Time: 0.132192 [07/07/2021-20:01:28] [V] [TRT] Tactic: 10354687 Time: 0.141388 [07/07/2021-20:01:28] [V] [TRT] Tactic: 10551295 Time: 0.163716 [07/07/2021-20:01:28] [V] [TRT] Tactic: 10747903 Time: 0.115328 [07/07/2021-20:01:28] [V] [TRT] Tactic: 10944511 Time: 0.15136 [07/07/2021-20:01:28] [V] [TRT] Fastest Tactic: 5898239 Time: 0.103076 [07/07/2021-20:01:28] [V] [TRT] --------------- Timing Runner: node_of_180 (CudnnConvolution) [07/07/2021-20:01:28] [V] [TRT] Tactic: 0 Time: 0.114948 [07/07/2021-20:01:28] [V] [TRT] Tactic: 1 Time: 0.087656 [07/07/2021-20:01:28] [V] [TRT] Tactic: 2 Time: 0.159872 [07/07/2021-20:01:28] [V] [TRT] Tactic: 4 skipped. Scratch requested: 562364416, available: 16777216 [07/07/2021-20:01:28] [V] [TRT] Tactic: 5 Time: 0.242592 [07/07/2021-20:01:28] [V] [TRT] Fastest Tactic: 1 Time: 0.087656 [07/07/2021-20:01:28] [V] [TRT] --------------- Timing Runner: node_of_180 (CublasConvolution) [07/07/2021-20:01:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:28] [V] [TRT] --------------- Timing Runner: node_of_180 (CaskConvolution) [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [07/07/2021-20:01:28] [V] [TRT] Tactic: 1062367460111450758 Time: 0.060108 [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [07/07/2021-20:01:28] [V] [TRT] Tactic: 1698681053543049347 Time: 0.056836 [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [07/07/2021-20:01:28] [V] [TRT] Tactic: 4501471010995462441 Time: 0.049768 [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:01:28] [V] [TRT] Tactic: 5137655947464784826 Time: 0.053128 [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [07/07/2021-20:01:28] [V] [TRT] Tactic: 5288347012147084929 Time: 0.051164 [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [07/07/2021-20:01:28] [V] [TRT] Tactic: 5326823351883942011 Time: 0.04746 [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [07/07/2021-20:01:28] [V] [TRT] Tactic: 5500448035057547314 Time: 0.060788 [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [07/07/2021-20:01:28] [V] [TRT] Tactic: 6645123197870846056 Time: 0.052588 [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [07/07/2021-20:01:28] [V] [TRT] Tactic: 7144526460361122478 Time: 0.075716 [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [07/07/2021-20:01:28] [V] [TRT] Tactic: -8262349710178828730 Time: 0.049912 [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [07/07/2021-20:01:28] [V] [TRT] Tactic: -6576203419454146580 Time: 0.059168 [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [07/07/2021-20:01:28] [V] [TRT] Tactic: -4787320710726427159 Time: 0.074116 [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:01:28] [V] [TRT] Tactic: -3456450830548107839 Time: 0.05886 [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [07/07/2021-20:01:28] [V] [TRT] Tactic: -1218658103698133241 Time: 0.064764 [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [07/07/2021-20:01:28] [V] [TRT] Tactic: -836875257600482091 Time: 0.062856 [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:01:28] [V] [TRT] Tactic: -410470605513481746 Time: 0.04682 [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [07/07/2021-20:01:28] [V] [TRT] Tactic: -377491875521947884 Time: 0.057132 [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [07/07/2021-20:01:28] [V] [TRT] Tactic: -37215280111360163 Time: 0.049864 [07/07/2021-20:01:28] [V] [TRT] Fastest Tactic: -410470605513481746 Time: 0.04682 [07/07/2021-20:01:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -410470605513481746 [07/07/2021-20:01:28] [V] [TRT] *************** Autotuning format combination: Float(346112,1,6656,128) -> Float(346112,1,6656,128) *************** [07/07/2021-20:01:28] [V] [TRT] --------------- Timing Runner: node_of_180 (CudnnConvolution) [07/07/2021-20:01:28] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:28] [V] [TRT] --------------- Timing Runner: node_of_180 (CublasConvolution) [07/07/2021-20:01:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:28] [V] [TRT] --------------- Timing Runner: node_of_180 (CaskConvolution) [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [07/07/2021-20:01:28] [V] [TRT] Tactic: 3886731678879822788 Time: 0.047404 [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [07/07/2021-20:01:28] [V] [TRT] Tactic: 6629944304117643200 Time: 0.057536 [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [07/07/2021-20:01:28] [V] [TRT] Tactic: -9153228964338181824 Time: 0.057344 [07/07/2021-20:01:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [07/07/2021-20:01:28] [V] [TRT] Tactic: -7394439838318485025 Time: 0.047156 [07/07/2021-20:01:28] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.047156 [07/07/2021-20:01:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [07/07/2021-20:01:28] [V] [TRT] *************** Autotuning format combination: Half(346112,2704,52,1) -> Half(346112,2704,52,1) *************** [07/07/2021-20:01:28] [V] [TRT] --------------- Timing Runner: node_of_180 (CudnnConvolution) [07/07/2021-20:01:28] [V] [TRT] Tactic: 0 Time: 0.10724 [07/07/2021-20:01:28] [V] [TRT] Tactic: 1 Time: 0.075948 [07/07/2021-20:01:28] [V] [TRT] Tactic: 2 Time: 0.146148 [07/07/2021-20:01:28] [V] [TRT] Tactic: 4 skipped. Scratch requested: 562364416, available: 16777216 [07/07/2021-20:01:28] [V] [TRT] Tactic: 5 Time: 0.235012 [07/07/2021-20:01:28] [V] [TRT] Fastest Tactic: 1 Time: 0.075948 [07/07/2021-20:01:28] [V] [TRT] --------------- Timing Runner: node_of_180 (CublasConvolution) [07/07/2021-20:01:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:28] [V] [TRT] --------------- Timing Runner: node_of_180 (CaskConvolution) [07/07/2021-20:01:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [07/07/2021-20:01:28] [V] [TRT] *************** Autotuning format combination: Float(346112,2704,52,1) -> Float(692224,2704,52,1) *************** [07/07/2021-20:01:28] [V] [TRT] --------------- Timing Runner: node_of_182 (PointWiseV2) [07/07/2021-20:01:28] [V] [TRT] Tactic: 0 Time: 0.030464 [07/07/2021-20:01:28] [V] [TRT] Tactic: 1 Time: 0.029964 [07/07/2021-20:01:28] [V] [TRT] Tactic: 2 Time: 0.029256 [07/07/2021-20:01:28] [V] [TRT] Tactic: 3 Time: 0.030052 [07/07/2021-20:01:28] [V] [TRT] Tactic: 4 Time: 0.029248 [07/07/2021-20:01:28] [V] [TRT] Tactic: 5 Time: 0.028916 [07/07/2021-20:01:28] [V] [TRT] Tactic: 6 Time: 0.029896 [07/07/2021-20:01:28] [V] [TRT] Tactic: 7 Time: 0.030084 [07/07/2021-20:01:28] [V] [TRT] Tactic: 8 Time: 0.0293 [07/07/2021-20:01:28] [V] [TRT] Tactic: 9 Time: 0.02912 [07/07/2021-20:01:28] [V] [TRT] Tactic: 28 Time: 0.03028 [07/07/2021-20:01:28] [V] [TRT] Fastest Tactic: 5 Time: 0.028916 [07/07/2021-20:01:28] [V] [TRT] --------------- Timing Runner: node_of_182 (PointWise) [07/07/2021-20:01:28] [V] [TRT] Tactic: 128 Time: 0.0525 [07/07/2021-20:01:28] [V] [TRT] Tactic: 256 Time: 0.052468 [07/07/2021-20:01:28] [V] [TRT] Tactic: 512 Time: 0.053236 [07/07/2021-20:01:28] [V] [TRT] Fastest Tactic: 256 Time: 0.052468 [07/07/2021-20:01:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [07/07/2021-20:01:28] [V] [TRT] *************** Autotuning format combination: Float(346112,1,6656,128) -> Float(692224,1,13312,256) *************** [07/07/2021-20:01:28] [V] [TRT] --------------- Timing Runner: node_of_182 (PointWiseV2) [07/07/2021-20:01:28] [V] [TRT] Tactic: 0 Time: 0.030208 [07/07/2021-20:01:28] [V] [TRT] Tactic: 1 Time: 0.029876 [07/07/2021-20:01:28] [V] [TRT] Tactic: 2 Time: 0.029044 [07/07/2021-20:01:28] [V] [TRT] Tactic: 3 Time: 0.03026 [07/07/2021-20:01:28] [V] [TRT] Tactic: 4 Time: 0.029568 [07/07/2021-20:01:28] [V] [TRT] Tactic: 5 Time: 0.0288 [07/07/2021-20:01:28] [V] [TRT] Tactic: 6 Time: 0.033536 [07/07/2021-20:01:28] [V] [TRT] Tactic: 7 Time: 0.029824 [07/07/2021-20:01:28] [V] [TRT] Tactic: 8 Time: 0.0296 [07/07/2021-20:01:28] [V] [TRT] Tactic: 9 Time: 0.029384 [07/07/2021-20:01:28] [V] [TRT] Tactic: 28 Time: 0.030408 [07/07/2021-20:01:28] [V] [TRT] Fastest Tactic: 5 Time: 0.0288 [07/07/2021-20:01:28] [V] [TRT] --------------- Timing Runner: node_of_182 (PointWise) [07/07/2021-20:01:28] [V] [TRT] Tactic: 128 Time: 0.05294 [07/07/2021-20:01:28] [V] [TRT] Tactic: 256 Time: 0.052736 [07/07/2021-20:01:28] [V] [TRT] Tactic: 512 Time: 0.05338 [07/07/2021-20:01:28] [V] [TRT] Fastest Tactic: 256 Time: 0.052736 [07/07/2021-20:01:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [07/07/2021-20:01:28] [V] [TRT] *************** Autotuning format combination: Float(10816,2704:32,52,1) -> Float(21632,2704:32,52,1) *************** [07/07/2021-20:01:28] [V] [TRT] --------------- Timing Runner: node_of_182 (PointWiseV2) [07/07/2021-20:01:28] [V] [TRT] Tactic: 24 Time: 0.029056 [07/07/2021-20:01:28] [V] [TRT] Tactic: 25 Time: 0.029856 [07/07/2021-20:01:28] [V] [TRT] Tactic: 26 Time: 0.029764 [07/07/2021-20:01:28] [V] [TRT] Tactic: 27 Time: 0.029932 [07/07/2021-20:01:28] [V] [TRT] Tactic: 31 Time: 0.029184 [07/07/2021-20:01:28] [V] [TRT] Fastest Tactic: 24 Time: 0.029056 [07/07/2021-20:01:28] [V] [TRT] --------------- Timing Runner: node_of_182 (PointWise) [07/07/2021-20:01:28] [V] [TRT] Tactic: 128 Time: 0.053088 [07/07/2021-20:01:28] [V] [TRT] Tactic: 256 Time: 0.052848 [07/07/2021-20:01:28] [V] [TRT] Tactic: 512 Time: 0.053632 [07/07/2021-20:01:28] [V] [TRT] Fastest Tactic: 256 Time: 0.052848 [07/07/2021-20:01:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [07/07/2021-20:01:28] [V] [TRT] *************** Autotuning format combination: Half(346112,2704,52,1) -> Half(692224,2704,52,1) *************** [07/07/2021-20:01:28] [V] [TRT] --------------- Timing Runner: node_of_182 (PointWiseV2) [07/07/2021-20:01:28] [V] [TRT] Tactic: 0 Time: 0.02784 [07/07/2021-20:01:28] [V] [TRT] Tactic: 1 Time: 0.02046 [07/07/2021-20:01:28] [V] [TRT] Tactic: 2 Time: 0.018568 [07/07/2021-20:01:28] [V] [TRT] Tactic: 3 Time: 0.018432 [07/07/2021-20:01:28] [V] [TRT] Tactic: 4 Time: 0.0165 [07/07/2021-20:01:28] [V] [TRT] Tactic: 5 Time: 0.016416 [07/07/2021-20:01:28] [V] [TRT] Tactic: 6 Time: 0.017716 [07/07/2021-20:01:28] [V] [TRT] Tactic: 7 Time: 0.016696 [07/07/2021-20:01:28] [V] [TRT] Tactic: 8 Time: 0.016872 [07/07/2021-20:01:28] [V] [TRT] Tactic: 9 Time: 0.016504 [07/07/2021-20:01:28] [V] [TRT] Tactic: 28 Time: 0.026528 [07/07/2021-20:01:28] [V] [TRT] Fastest Tactic: 5 Time: 0.016416 [07/07/2021-20:01:28] [V] [TRT] --------------- Timing Runner: node_of_182 (PointWise) [07/07/2021-20:01:28] [V] [TRT] Tactic: 128 Time: 0.042332 [07/07/2021-20:01:28] [V] [TRT] Tactic: 256 Time: 0.041056 [07/07/2021-20:01:28] [V] [TRT] Tactic: 512 Time: 0.039664 [07/07/2021-20:01:28] [V] [TRT] Fastest Tactic: 512 Time: 0.039664 [07/07/2021-20:01:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [07/07/2021-20:01:28] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,2704,52,1) -> Float(692224,1,13312,256) (Reformat) [07/07/2021-20:01:28] [V] [TRT] Tactic: 0 Time: 0.04678 [07/07/2021-20:01:28] [V] [TRT] Fastest Tactic: 0 Time: 0.04678 [07/07/2021-20:01:28] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,2704,52,1) -> Float(21632,2704:32,52,1) (Reformat) [07/07/2021-20:01:28] [V] [TRT] Tactic: 0 Time: 0.05554 [07/07/2021-20:01:28] [V] [TRT] Fastest Tactic: 0 Time: 0.05554 [07/07/2021-20:01:28] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,2704,52,1) -> Half(692224,2704,52,1) (Reformat) [07/07/2021-20:01:28] [V] [TRT] Tactic: 0 Time: 0.032952 [07/07/2021-20:01:28] [V] [TRT] Fastest Tactic: 0 Time: 0.032952 [07/07/2021-20:01:28] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,1,13312,256) -> Float(692224,2704,52,1) (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.041404 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.041404 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,1,13312,256) -> Float(21632,2704:32,52,1) (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.074404 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.074404 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,1,13312,256) -> Half(692224,2704,52,1) (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.038212 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.038212 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,2704:32,52,1) -> Float(692224,2704,52,1) (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.041716 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.041716 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,2704:32,52,1) -> Float(692224,1,13312,256) (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.039936 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.039936 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,2704:32,52,1) -> Half(692224,2704,52,1) (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.04024 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.04024 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: reformat: Half(692224,2704,52,1) -> Float(692224,2704,52,1) (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.03328 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.03328 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: reformat: Half(692224,2704,52,1) -> Float(692224,1,13312,256) (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.042956 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.042956 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: reformat: Half(692224,2704,52,1) -> Float(21632,2704:32,52,1) (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.056064 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.056064 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: 157 copy (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.064512 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.064512 [07/07/2021-20:01:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: 157 copy (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.046776 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.046776 [07/07/2021-20:01:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: 157 copy (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.05568 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.05568 [07/07/2021-20:01:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: 157 copy (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.032896 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.032896 [07/07/2021-20:01:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: 157 copy (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.041216 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.041216 [07/07/2021-20:01:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: 157 copy (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.034688 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.034688 [07/07/2021-20:01:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: 157 copy (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.074672 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.074672 [07/07/2021-20:01:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: 157 copy (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.038216 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.038216 [07/07/2021-20:01:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: 157 copy (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.041728 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.041728 [07/07/2021-20:01:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: 157 copy (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.040184 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.040184 [07/07/2021-20:01:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: 157 copy (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.064532 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.064532 [07/07/2021-20:01:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: 157 copy (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.03994 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.03994 [07/07/2021-20:01:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: 157 copy (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.03336 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.03336 [07/07/2021-20:01:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: 157 copy (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.04294 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.04294 [07/07/2021-20:01:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: 157 copy (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.056248 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.056248 [07/07/2021-20:01:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: 157 copy (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.033552 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.033552 [07/07/2021-20:01:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,2704,52,1) -> Half(692224,2704,52,1) (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.06932 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.06932 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,1,13312,256) -> Float(692224,2704,52,1) (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.098496 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.098496 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: reformat: Float(692224,1,13312,256) -> Half(692224,2704,52,1) (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.090088 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.090088 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,2704:32,52,1) -> Float(692224,2704,52,1) (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.080296 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.080296 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,2704:32,52,1) -> Half(692224,2704,52,1) (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.077568 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.077568 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: reformat: Half(692224,2704,52,1) -> Float(692224,2704,52,1) (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.048188 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.048188 [07/07/2021-20:01:29] [V] [TRT] *************** Autotuning format combination: Float(692224,2704,52,1) -> Float(173056,676,26,1) *************** [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: node_of_184 (TiledPooling) [07/07/2021-20:01:29] [V] [TRT] Tactic: 5505281 Time: 0.052536 [07/07/2021-20:01:29] [V] [TRT] Tactic: 5570817 Time: 0.038144 [07/07/2021-20:01:29] [V] [TRT] Tactic: 5636353 Time: 0.036352 [07/07/2021-20:01:29] [V] [TRT] Tactic: 5701889 Time: 0.036352 [07/07/2021-20:01:29] [V] [TRT] Tactic: 5767425 Time: 0.036252 [07/07/2021-20:01:29] [V] [TRT] Tactic: 5832961 Time: 0.03646 [07/07/2021-20:01:29] [V] [TRT] Tactic: 5898497 Time: 0.036352 [07/07/2021-20:01:29] [V] [TRT] Tactic: 5964033 Time: 0.036704 [07/07/2021-20:01:29] [V] [TRT] Tactic: 6029569 Time: 0.054932 [07/07/2021-20:01:29] [V] [TRT] Tactic: 6095105 Time: 0.045312 [07/07/2021-20:01:29] [V] [TRT] Tactic: 6160641 Time: 0.044836 [07/07/2021-20:01:29] [V] [TRT] Tactic: 6226177 Time: 0.044536 [07/07/2021-20:01:29] [V] [TRT] Tactic: 6291713 Time: 0.045044 [07/07/2021-20:01:29] [V] [TRT] Tactic: 6357249 Time: 0.045892 [07/07/2021-20:01:29] [V] [TRT] Tactic: 6422785 Time: 0.04492 [07/07/2021-20:01:29] [V] [TRT] Tactic: 6488321 Time: 0.044656 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 5767425 Time: 0.036252 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: node_of_184 (CudnnPooling) [07/07/2021-20:01:29] [V] [TRT] Tactic: -1 Time: 0.042736 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: -1 Time: 0.042736 [07/07/2021-20:01:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 5767425 [07/07/2021-20:01:29] [V] [TRT] *************** Autotuning format combination: Half(692224,2704,52,1) -> Half(173056,676,26,1) *************** [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: node_of_184 (TiledPooling) [07/07/2021-20:01:29] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: node_of_184 (CudnnPooling) [07/07/2021-20:01:29] [V] [TRT] Tactic: -1 Time: 0.028672 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: -1 Time: 0.028672 [07/07/2021-20:01:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnPooling Tactic: -1 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,676,26,1) -> Float(173056,1,6656,256) (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.024508 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.024508 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,676,26,1) -> Half(173056,676,26,1) (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.018308 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.018308 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,1,6656,256) -> Float(173056,676,26,1) (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.02246 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.02246 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,1,6656,256) -> Half(173056,676,26,1) (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.018456 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.018456 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: reformat: Half(173056,676,26,1) -> Float(173056,676,26,1) (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.014052 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.014052 [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: reformat: Half(173056,676,26,1) -> Float(173056,1,6656,256) (Reformat) [07/07/2021-20:01:29] [V] [TRT] Tactic: 0 Time: 0.019456 [07/07/2021-20:01:29] [V] [TRT] Fastest Tactic: 0 Time: 0.019456 [07/07/2021-20:01:29] [V] [TRT] *************** Autotuning format combination: Float(173056,676,26,1) -> Float(173056,676,26,1) *************** [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: node_of_185 (CudaDepthwiseConvolution) [07/07/2021-20:01:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:29] [V] [TRT] --------------- Timing Runner: node_of_185 (FusedConvActConvolution) [07/07/2021-20:01:30] [V] [TRT] Tactic: 524287 Time: 0.401708 [07/07/2021-20:01:30] [V] [TRT] Tactic: 720895 Time: 0.374316 [07/07/2021-20:01:30] [V] [TRT] Tactic: 983039 Time: 0.354944 [07/07/2021-20:01:30] [V] [TRT] Tactic: 1048575 Time: 0.492416 [07/07/2021-20:01:30] [V] [TRT] Tactic: 1703935 Time: 0.438068 [07/07/2021-20:01:30] [V] [TRT] Tactic: 1769471 Time: 0.40664 [07/07/2021-20:01:30] [V] [TRT] Tactic: 1966079 Time: 0.504064 [07/07/2021-20:01:30] [V] [TRT] Tactic: 2031615 Time: 0.479724 [07/07/2021-20:01:30] [V] [TRT] Tactic: 2228223 Time: 0.556032 [07/07/2021-20:01:30] [V] [TRT] Tactic: 2424831 Time: 0.726608 [07/07/2021-20:01:30] [V] [TRT] Tactic: 2621439 Time: 0.454508 [07/07/2021-20:01:30] [V] [TRT] Tactic: 2752511 Time: 0.517336 [07/07/2021-20:01:30] [V] [TRT] Tactic: 2818047 Time: 0.612708 [07/07/2021-20:01:30] [V] [TRT] Tactic: 2883583 Time: 0.627072 [07/07/2021-20:01:30] [V] [TRT] Tactic: 3014655 Time: 0.448256 [07/07/2021-20:01:30] [V] [TRT] Tactic: 3145727 Time: 0.396656 [07/07/2021-20:01:30] [V] [TRT] Tactic: 3473407 Time: 0.400748 [07/07/2021-20:01:30] [V] [TRT] Tactic: 3604479 Time: 0.4211 [07/07/2021-20:01:31] [V] [TRT] Tactic: 3735551 Time: 0.478192 [07/07/2021-20:01:31] [V] [TRT] Tactic: 4390911 Time: 0.55424 [07/07/2021-20:01:31] [V] [TRT] Tactic: 5046271 Time: 0.404992 [07/07/2021-20:01:31] [V] [TRT] Tactic: 5963775 Time: 0.40332 [07/07/2021-20:01:31] [V] [TRT] Tactic: 6160383 Time: 0.410084 [07/07/2021-20:01:31] [V] [TRT] Tactic: 6488063 Time: 0.4705 [07/07/2021-20:01:31] [V] [TRT] Tactic: 6881279 Time: 0.417216 [07/07/2021-20:01:31] [V] [TRT] Tactic: 7274495 Time: 0.358676 [07/07/2021-20:01:31] [V] [TRT] Tactic: 7864319 Time: 0.423424 [07/07/2021-20:01:31] [V] [TRT] Tactic: 7995391 Time: 0.41144 [07/07/2021-20:01:31] [V] [TRT] Tactic: 8585215 Time: 0.468608 [07/07/2021-20:01:31] [V] [TRT] Tactic: 8847359 Time: 0.381096 [07/07/2021-20:01:31] [V] [TRT] Tactic: 8978431 Time: 0.408608 [07/07/2021-20:01:31] [V] [TRT] Tactic: 9043967 Time: 0.395016 [07/07/2021-20:01:31] [V] [TRT] Tactic: 9175039 Time: 0.424832 [07/07/2021-20:01:31] [V] [TRT] Tactic: 9502719 Time: 0.561504 [07/07/2021-20:01:31] [V] [TRT] Tactic: 9830399 Time: 0.349248 [07/07/2021-20:01:31] [V] [TRT] Tactic: 9961471 Time: 0.628844 [07/07/2021-20:01:31] [V] [TRT] Tactic: 10027007 Time: 0.425832 [07/07/2021-20:01:31] [V] [TRT] Tactic: 10092543 Time: 0.555648 [07/07/2021-20:01:32] [V] [TRT] Tactic: 10289151 Time: 0.492148 [07/07/2021-20:01:32] [V] [TRT] Tactic: 10485759 Time: 0.380532 [07/07/2021-20:01:32] [V] [TRT] Tactic: 10682367 Time: 0.43904 [07/07/2021-20:01:32] [V] [TRT] Tactic: 10813439 Time: 0.407944 [07/07/2021-20:01:32] [V] [TRT] Fastest Tactic: 9830399 Time: 0.349248 [07/07/2021-20:01:32] [V] [TRT] --------------- Timing Runner: node_of_185 (CudnnConvolution) [07/07/2021-20:01:32] [V] [TRT] Tactic: 0 Time: 0.47172 [07/07/2021-20:01:32] [V] [TRT] Tactic: 1 Time: 0.369064 [07/07/2021-20:01:32] [V] [TRT] Tactic: 2 Time: 0.479208 [07/07/2021-20:01:32] [V] [TRT] Tactic: 4 skipped. Scratch requested: 577241088, available: 16777216 [07/07/2021-20:01:32] [V] [TRT] Tactic: 5 skipped. Scratch requested: 289669120, available: 16777216 [07/07/2021-20:01:32] [V] [TRT] Tactic: 6 Time: 0.241368 [07/07/2021-20:01:32] [V] [TRT] Fastest Tactic: 6 Time: 0.241368 [07/07/2021-20:01:32] [V] [TRT] --------------- Timing Runner: node_of_185 (CaskConvolution) [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [07/07/2021-20:01:32] [V] [TRT] Tactic: 1062367460111450758 Time: 0.353792 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [07/07/2021-20:01:32] [V] [TRT] Tactic: 1754984623894446479 Time: 0.56152 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [07/07/2021-20:01:32] [V] [TRT] Tactic: 3611739942397549984 Time: 0.359084 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [07/07/2021-20:01:32] [V] [TRT] Tactic: 3827454225649558724 Time: 0.224232 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [07/07/2021-20:01:32] [V] [TRT] Tactic: 4337000649858996379 Time: 0.307376 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [07/07/2021-20:01:32] [V] [TRT] Tactic: 4501471010995462441 Time: 0.358344 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:01:32] [V] [TRT] Tactic: 5137655947464784826 Time: 0.2853 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [07/07/2021-20:01:32] [V] [TRT] Tactic: 5288347012147084929 Time: 0.348848 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [07/07/2021-20:01:32] [V] [TRT] Tactic: 5921334924264294896 Time: 0.23768 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [07/07/2021-20:01:32] [V] [TRT] Tactic: 6645123197870846056 Time: 0.304124 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [07/07/2021-20:01:32] [V] [TRT] Tactic: 7144526460361122478 Time: 0.504408 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [07/07/2021-20:01:32] [V] [TRT] Tactic: 7852627285308570038 Time: 0.251412 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [07/07/2021-20:01:32] [V] [TRT] Tactic: -9137461792520977713 Time: 0.364984 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [07/07/2021-20:01:32] [V] [TRT] Tactic: -8776506421218919509 Time: 0.221684 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [07/07/2021-20:01:32] [V] [TRT] Tactic: -8262349710178828730 Time: 0.358448 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [07/07/2021-20:01:32] [V] [TRT] Tactic: -8133971918129952780 Time: 0.333116 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [07/07/2021-20:01:32] [V] [TRT] Tactic: -6092040395344634144 Time: 0.36932 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [07/07/2021-20:01:32] [V] [TRT] Tactic: -4787320710726427159 Time: 0.560084 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:01:32] [V] [TRT] Tactic: -3456450830548107839 Time: 0.314812 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [07/07/2021-20:01:32] [V] [TRT] Tactic: -2318106587342035239 Time: 0.2327 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [07/07/2021-20:01:32] [V] [TRT] Tactic: -1343271414618805657 Time: 0.236732 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [07/07/2021-20:01:32] [V] [TRT] Tactic: -1218658103698133241 Time: 0.330812 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [07/07/2021-20:01:32] [V] [TRT] Tactic: -836875257600482091 Time: 0.312104 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:01:32] [V] [TRT] Tactic: -410470605513481746 Time: 0.348136 [07/07/2021-20:01:32] [V] [TRT] Fastest Tactic: -8776506421218919509 Time: 0.221684 [07/07/2021-20:01:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8776506421218919509 [07/07/2021-20:01:32] [V] [TRT] *************** Autotuning format combination: Float(173056,1,6656,256) -> Float(173056,1,6656,256) *************** [07/07/2021-20:01:32] [V] [TRT] --------------- Timing Runner: node_of_185 (CudnnConvolution) [07/07/2021-20:01:32] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:32] [V] [TRT] --------------- Timing Runner: node_of_185 (CaskConvolution) [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [07/07/2021-20:01:32] [V] [TRT] Tactic: -9153228964338181824 Time: 0.271996 [07/07/2021-20:01:32] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [07/07/2021-20:01:32] [V] [TRT] Tactic: -7394439838318485025 Time: 0.292232 [07/07/2021-20:01:32] [V] [TRT] Fastest Tactic: -9153228964338181824 Time: 0.271996 [07/07/2021-20:01:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824 [07/07/2021-20:01:32] [V] [TRT] *************** Autotuning format combination: Half(173056,676,26,1) -> Half(173056,676,26,1) *************** [07/07/2021-20:01:32] [V] [TRT] --------------- Timing Runner: node_of_185 (CudnnConvolution) [07/07/2021-20:01:32] [V] [TRT] Tactic: 0 Time: 0.680036 [07/07/2021-20:01:32] [V] [TRT] Tactic: 1 Time: 0.548116 [07/07/2021-20:01:32] [V] [TRT] Tactic: 2 Time: 0.473824 [07/07/2021-20:01:32] [V] [TRT] Tactic: 4 skipped. Scratch requested: 577241088, available: 16777216 [07/07/2021-20:01:32] [V] [TRT] Tactic: 5 skipped. Scratch requested: 289669120, available: 16777216 [07/07/2021-20:01:32] [V] [TRT] Tactic: 6 Time: 0.349568 [07/07/2021-20:01:32] [V] [TRT] Fastest Tactic: 6 Time: 0.349568 [07/07/2021-20:01:32] [V] [TRT] --------------- Timing Runner: node_of_185 (CaskConvolution) [07/07/2021-20:01:32] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 6 [07/07/2021-20:01:32] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,676,26,1) -> Float(5408,676:32,26,1) (Reformat) [07/07/2021-20:01:32] [V] [TRT] Tactic: 0 Time: 0.03006 [07/07/2021-20:01:32] [V] [TRT] Fastest Tactic: 0 Time: 0.03006 [07/07/2021-20:01:32] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,1,6656,256) -> Float(5408,676:32,26,1) (Reformat) [07/07/2021-20:01:32] [V] [TRT] Tactic: 0 Time: 0.038892 [07/07/2021-20:01:32] [V] [TRT] Fastest Tactic: 0 Time: 0.038892 [07/07/2021-20:01:32] [V] [TRT] --------------- Timing Runner: reformat: Float(5408,676:32,26,1) -> Float(173056,676,26,1) (Reformat) [07/07/2021-20:01:32] [V] [TRT] Tactic: 0 Time: 0.02194 [07/07/2021-20:01:32] [V] [TRT] Fastest Tactic: 0 Time: 0.02194 [07/07/2021-20:01:32] [V] [TRT] --------------- Timing Runner: reformat: Float(5408,676:32,26,1) -> Float(173056,1,6656,256) (Reformat) [07/07/2021-20:01:32] [V] [TRT] Tactic: 0 Time: 0.021888 [07/07/2021-20:01:32] [V] [TRT] Fastest Tactic: 0 Time: 0.021888 [07/07/2021-20:01:32] [V] [TRT] --------------- Timing Runner: reformat: Float(5408,676:32,26,1) -> Half(173056,676,26,1) (Reformat) [07/07/2021-20:01:32] [V] [TRT] Tactic: 0 Time: 0.021572 [07/07/2021-20:01:32] [V] [TRT] Fastest Tactic: 0 Time: 0.021572 [07/07/2021-20:01:32] [V] [TRT] --------------- Timing Runner: reformat: Half(173056,676,26,1) -> Float(5408,676:32,26,1) (Reformat) [07/07/2021-20:01:32] [V] [TRT] Tactic: 0 Time: 0.029696 [07/07/2021-20:01:32] [V] [TRT] Fastest Tactic: 0 Time: 0.029696 [07/07/2021-20:01:32] [V] [TRT] *************** Autotuning format combination: Float(173056,676,26,1) -> Float(173056,676,26,1) *************** [07/07/2021-20:01:32] [V] [TRT] --------------- Timing Runner: node_of_187 (PointWiseV2) [07/07/2021-20:01:32] [V] [TRT] Tactic: 0 Time: 0.015704 [07/07/2021-20:01:32] [V] [TRT] Tactic: 1 Time: 0.015616 [07/07/2021-20:01:32] [V] [TRT] Tactic: 2 Time: 0.0143 [07/07/2021-20:01:32] [V] [TRT] Tactic: 3 Time: 0.016 [07/07/2021-20:01:32] [V] [TRT] Tactic: 4 Time: 0.014464 [07/07/2021-20:01:32] [V] [TRT] Tactic: 5 Time: 0.013628 [07/07/2021-20:01:32] [V] [TRT] Tactic: 6 Time: 0.015836 [07/07/2021-20:01:32] [V] [TRT] Tactic: 7 Time: 0.014848 [07/07/2021-20:01:32] [V] [TRT] Tactic: 8 Time: 0.01408 [07/07/2021-20:01:32] [V] [TRT] Tactic: 9 Time: 0.013568 [07/07/2021-20:01:32] [V] [TRT] Tactic: 28 Time: 0.015684 [07/07/2021-20:01:32] [V] [TRT] Fastest Tactic: 9 Time: 0.013568 [07/07/2021-20:01:32] [V] [TRT] --------------- Timing Runner: node_of_187 (PointWise) [07/07/2021-20:01:32] [V] [TRT] Tactic: 128 Time: 0.022528 [07/07/2021-20:01:32] [V] [TRT] Tactic: 256 Time: 0.022524 [07/07/2021-20:01:32] [V] [TRT] Tactic: 512 Time: 0.022528 [07/07/2021-20:01:32] [V] [TRT] Fastest Tactic: 256 Time: 0.022524 [07/07/2021-20:01:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [07/07/2021-20:01:32] [V] [TRT] *************** Autotuning format combination: Float(173056,1,6656,256) -> Float(173056,1,6656,256) *************** [07/07/2021-20:01:32] [V] [TRT] --------------- Timing Runner: node_of_187 (PointWiseV2) [07/07/2021-20:01:32] [V] [TRT] Tactic: 0 Time: 0.016048 [07/07/2021-20:01:32] [V] [TRT] Tactic: 1 Time: 0.015984 [07/07/2021-20:01:33] [V] [TRT] Tactic: 2 Time: 0.014272 [07/07/2021-20:01:33] [V] [TRT] Tactic: 3 Time: 0.01536 [07/07/2021-20:01:33] [V] [TRT] Tactic: 4 Time: 0.0144 [07/07/2021-20:01:33] [V] [TRT] Tactic: 5 Time: 0.013504 [07/07/2021-20:01:33] [V] [TRT] Tactic: 6 Time: 0.015488 [07/07/2021-20:01:33] [V] [TRT] Tactic: 7 Time: 0.014576 [07/07/2021-20:01:33] [V] [TRT] Tactic: 8 Time: 0.013944 [07/07/2021-20:01:33] [V] [TRT] Tactic: 9 Time: 0.013644 [07/07/2021-20:01:33] [V] [TRT] Tactic: 28 Time: 0.016 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 5 Time: 0.013504 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: node_of_187 (PointWise) [07/07/2021-20:01:33] [V] [TRT] Tactic: 128 Time: 0.022332 [07/07/2021-20:01:33] [V] [TRT] Tactic: 256 Time: 0.022016 [07/07/2021-20:01:33] [V] [TRT] Tactic: 512 Time: 0.022972 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 256 Time: 0.022016 [07/07/2021-20:01:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [07/07/2021-20:01:33] [V] [TRT] *************** Autotuning format combination: Float(5408,676:32,26,1) -> Float(5408,676:32,26,1) *************** [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: node_of_187 (PointWiseV2) [07/07/2021-20:01:33] [V] [TRT] Tactic: 24 Time: 0.01362 [07/07/2021-20:01:33] [V] [TRT] Tactic: 25 Time: 0.014328 [07/07/2021-20:01:33] [V] [TRT] Tactic: 26 Time: 0.01432 [07/07/2021-20:01:33] [V] [TRT] Tactic: 27 Time: 0.015304 [07/07/2021-20:01:33] [V] [TRT] Tactic: 31 Time: 0.012928 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 31 Time: 0.012928 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: node_of_187 (PointWise) [07/07/2021-20:01:33] [V] [TRT] Tactic: 128 Time: 0.022524 [07/07/2021-20:01:33] [V] [TRT] Tactic: 256 Time: 0.022344 [07/07/2021-20:01:33] [V] [TRT] Tactic: 512 Time: 0.022528 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 256 Time: 0.022344 [07/07/2021-20:01:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [07/07/2021-20:01:33] [V] [TRT] *************** Autotuning format combination: Half(173056,676,26,1) -> Half(173056,676,26,1) *************** [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: node_of_187 (PointWiseV2) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.011332 [07/07/2021-20:01:33] [V] [TRT] Tactic: 1 Time: 0.0091 [07/07/2021-20:01:33] [V] [TRT] Tactic: 2 Time: 0.008192 [07/07/2021-20:01:33] [V] [TRT] Tactic: 3 Time: 0.007168 [07/07/2021-20:01:33] [V] [TRT] Tactic: 4 Time: 0.006144 [07/07/2021-20:01:33] [V] [TRT] Tactic: 5 Time: 0.006272 [07/07/2021-20:01:33] [V] [TRT] Tactic: 6 Time: 0.006144 [07/07/2021-20:01:33] [V] [TRT] Tactic: 7 Time: 0.005252 [07/07/2021-20:01:33] [V] [TRT] Tactic: 8 Time: 0.00544 [07/07/2021-20:01:33] [V] [TRT] Tactic: 9 Time: 0.005616 [07/07/2021-20:01:33] [V] [TRT] Tactic: 28 Time: 0.010856 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 7 Time: 0.005252 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: node_of_187 (PointWise) [07/07/2021-20:01:33] [V] [TRT] Tactic: 128 Time: 0.020092 [07/07/2021-20:01:33] [V] [TRT] Tactic: 256 Time: 0.019904 [07/07/2021-20:01:33] [V] [TRT] Tactic: 512 Time: 0.019904 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 256 Time: 0.019904 [07/07/2021-20:01:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,676,26,1) -> Float(173056,1,6656,256) (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.02438 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.02438 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,676,26,1) -> Float(5408,676:32,26,1) (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.030144 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.030144 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,676,26,1) -> Half(173056,676,26,1) (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.016848 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.016848 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,1,6656,256) -> Float(173056,676,26,1) (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.022812 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.022812 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,1,6656,256) -> Float(5408,676:32,26,1) (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.03838 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.03838 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,1,6656,256) -> Half(173056,676,26,1) (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.018944 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.018944 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: reformat: Float(5408,676:32,26,1) -> Float(173056,676,26,1) (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.021248 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.021248 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: reformat: Float(5408,676:32,26,1) -> Float(173056,1,6656,256) (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.021888 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.021888 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: reformat: Float(5408,676:32,26,1) -> Half(173056,676,26,1) (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.021428 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.021428 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: reformat: Half(173056,676,26,1) -> Float(173056,676,26,1) (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.013876 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.013876 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: reformat: Half(173056,676,26,1) -> Float(173056,1,6656,256) (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.019692 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.019692 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: reformat: Half(173056,676,26,1) -> Float(5408,676:32,26,1) (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.029696 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.029696 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: node_of_202 (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.017388 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.017388 [07/07/2021-20:01:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: node_of_202 (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.01122 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.01122 [07/07/2021-20:01:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: node_of_202 (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.01024 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [07/07/2021-20:01:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: node_of_202 (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.01024 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [07/07/2021-20:01:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: node_of_202 (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.010416 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.010416 [07/07/2021-20:01:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: node_of_202 (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.01024 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [07/07/2021-20:01:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: node_of_202 (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.011392 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.011392 [07/07/2021-20:01:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: node_of_202 (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.012264 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.012264 [07/07/2021-20:01:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: node_of_202 (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.012264 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.012264 [07/07/2021-20:01:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: node_of_202 (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.008176 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.008176 [07/07/2021-20:01:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: node_of_202 (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.011216 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.011216 [07/07/2021-20:01:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: node_of_202 (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.009612 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.009612 [07/07/2021-20:01:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: reformat: Float(86528,676,26,1) -> Float(86528,1,3328,128) (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.011136 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.011136 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: reformat: Float(86528,676,26,1) -> Half(86528,676,26,1) (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.009156 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.009156 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: reformat: Float(86528,1,3328,128) -> Float(86528,676,26,1) (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.01024 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: reformat: Float(86528,1,3328,128) -> Half(86528,676,26,1) (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.01024 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: reformat: Half(86528,676,26,1) -> Float(86528,676,26,1) (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.008176 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.008176 [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: reformat: Half(86528,676,26,1) -> Float(86528,1,3328,128) (Reformat) [07/07/2021-20:01:33] [V] [TRT] Tactic: 0 Time: 0.011228 [07/07/2021-20:01:33] [V] [TRT] Fastest Tactic: 0 Time: 0.011228 [07/07/2021-20:01:33] [V] [TRT] *************** Autotuning format combination: Float(86528,676,26,1) -> Float(86528,676,26,1) *************** [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: node_of_203 (CudaDepthwiseConvolution) [07/07/2021-20:01:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:33] [V] [TRT] --------------- Timing Runner: node_of_203 (FusedConvActConvolution) [07/07/2021-20:01:33] [V] [TRT] Tactic: 524287 Time: 0.155264 [07/07/2021-20:01:33] [V] [TRT] Tactic: 720895 Time: 0.124928 [07/07/2021-20:01:33] [V] [TRT] Tactic: 983039 Time: 0.099712 [07/07/2021-20:01:33] [V] [TRT] Tactic: 1048575 Time: 0.15168 [07/07/2021-20:01:33] [V] [TRT] Tactic: 1703935 Time: 0.126016 [07/07/2021-20:01:33] [V] [TRT] Tactic: 1769471 Time: 0.11872 [07/07/2021-20:01:33] [V] [TRT] Tactic: 1966079 Time: 0.162016 [07/07/2021-20:01:33] [V] [TRT] Tactic: 2031615 Time: 0.178428 [07/07/2021-20:01:33] [V] [TRT] Tactic: 2228223 Time: 0.15456 [07/07/2021-20:01:33] [V] [TRT] Tactic: 2424831 Time: 0.182844 [07/07/2021-20:01:33] [V] [TRT] Tactic: 2621439 Time: 0.125772 [07/07/2021-20:01:33] [V] [TRT] Tactic: 2752511 Time: 0.147408 [07/07/2021-20:01:33] [V] [TRT] Tactic: 2818047 Time: 0.18848 [07/07/2021-20:01:33] [V] [TRT] Tactic: 2883583 Time: 0.243704 [07/07/2021-20:01:33] [V] [TRT] Tactic: 3014655 Time: 0.13164 [07/07/2021-20:01:33] [V] [TRT] Tactic: 3145727 Time: 0.122108 [07/07/2021-20:01:33] [V] [TRT] Tactic: 3473407 Time: 0.166784 [07/07/2021-20:01:33] [V] [TRT] Tactic: 3604479 Time: 0.12676 [07/07/2021-20:01:33] [V] [TRT] Tactic: 3735551 Time: 0.122224 [07/07/2021-20:01:34] [V] [TRT] Tactic: 4390911 Time: 0.190448 [07/07/2021-20:01:34] [V] [TRT] Tactic: 5046271 Time: 0.117552 [07/07/2021-20:01:34] [V] [TRT] Tactic: 5963775 Time: 0.146748 [07/07/2021-20:01:34] [V] [TRT] Tactic: 6160383 Time: 0.143808 [07/07/2021-20:01:34] [V] [TRT] Tactic: 6488063 Time: 0.147784 [07/07/2021-20:01:34] [V] [TRT] Tactic: 6881279 Time: 0.175952 [07/07/2021-20:01:34] [V] [TRT] Tactic: 7274495 Time: 0.101264 [07/07/2021-20:01:34] [V] [TRT] Tactic: 7864319 Time: 0.1186 [07/07/2021-20:01:34] [V] [TRT] Tactic: 7995391 Time: 0.134048 [07/07/2021-20:01:34] [V] [TRT] Tactic: 8585215 Time: 0.177104 [07/07/2021-20:01:34] [V] [TRT] Tactic: 8847359 Time: 0.112956 [07/07/2021-20:01:34] [V] [TRT] Tactic: 8978431 Time: 0.14906 [07/07/2021-20:01:34] [V] [TRT] Tactic: 9043967 Time: 0.117312 [07/07/2021-20:01:34] [V] [TRT] Tactic: 9175039 Time: 0.12658 [07/07/2021-20:01:34] [V] [TRT] Tactic: 9502719 Time: 0.1824 [07/07/2021-20:01:34] [V] [TRT] Tactic: 9830399 Time: 0.113524 [07/07/2021-20:01:34] [V] [TRT] Tactic: 9961471 Time: 0.167872 [07/07/2021-20:01:34] [V] [TRT] Tactic: 10027007 Time: 0.133488 [07/07/2021-20:01:34] [V] [TRT] Tactic: 10092543 Time: 0.189952 [07/07/2021-20:01:34] [V] [TRT] Tactic: 10289151 Time: 0.16192 [07/07/2021-20:01:34] [V] [TRT] Tactic: 10485759 Time: 0.110592 [07/07/2021-20:01:34] [V] [TRT] Tactic: 10682367 Time: 0.124 [07/07/2021-20:01:34] [V] [TRT] Tactic: 10813439 Time: 0.113132 [07/07/2021-20:01:34] [V] [TRT] Fastest Tactic: 983039 Time: 0.099712 [07/07/2021-20:01:34] [V] [TRT] --------------- Timing Runner: node_of_203 (CudnnConvolution) [07/07/2021-20:01:34] [V] [TRT] Tactic: 0 Time: 0.188476 [07/07/2021-20:01:34] [V] [TRT] Tactic: 1 Time: 0.116804 [07/07/2021-20:01:34] [V] [TRT] Tactic: 2 Time: 0.21248 [07/07/2021-20:01:34] [V] [TRT] Tactic: 4 skipped. Scratch requested: 145424384, available: 16777216 [07/07/2021-20:01:34] [V] [TRT] Tactic: 5 skipped. Scratch requested: 73531392, available: 16777216 [07/07/2021-20:01:34] [V] [TRT] Tactic: 6 Time: 0.068984 [07/07/2021-20:01:34] [V] [TRT] Fastest Tactic: 6 Time: 0.068984 [07/07/2021-20:01:34] [V] [TRT] --------------- Timing Runner: node_of_203 (CaskConvolution) [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [07/07/2021-20:01:34] [V] [TRT] Tactic: 1062367460111450758 Time: 0.143044 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [07/07/2021-20:01:34] [V] [TRT] Tactic: 1754984623894446479 Time: 0.119208 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [07/07/2021-20:01:34] [V] [TRT] Tactic: 3611739942397549984 Time: 0.104312 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [07/07/2021-20:01:34] [V] [TRT] Tactic: 3827454225649558724 Time: 0.064244 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [07/07/2021-20:01:34] [V] [TRT] Tactic: 4337000649858996379 Time: 0.118336 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [07/07/2021-20:01:34] [V] [TRT] Tactic: 4501471010995462441 Time: 0.106568 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:01:34] [V] [TRT] Tactic: 5137655947464784826 Time: 0.103168 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [07/07/2021-20:01:34] [V] [TRT] Tactic: 5288347012147084929 Time: 0.099756 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [07/07/2021-20:01:34] [V] [TRT] Tactic: 5921334924264294896 Time: 0.069672 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [07/07/2021-20:01:34] [V] [TRT] Tactic: 6645123197870846056 Time: 0.115576 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [07/07/2021-20:01:34] [V] [TRT] Tactic: 7144526460361122478 Time: 0.105592 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [07/07/2021-20:01:34] [V] [TRT] Tactic: 7852627285308570038 Time: 0.072 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [07/07/2021-20:01:34] [V] [TRT] Tactic: -9137461792520977713 Time: 0.111352 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [07/07/2021-20:01:34] [V] [TRT] Tactic: -8776506421218919509 Time: 0.063416 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [07/07/2021-20:01:34] [V] [TRT] Tactic: -8262349710178828730 Time: 0.106412 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [07/07/2021-20:01:34] [V] [TRT] Tactic: -8133971918129952780 Time: 0.14324 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [07/07/2021-20:01:34] [V] [TRT] Tactic: -6092040395344634144 Time: 0.149184 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [07/07/2021-20:01:34] [V] [TRT] Tactic: -4787320710726427159 Time: 0.11768 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:01:34] [V] [TRT] Tactic: -3456450830548107839 Time: 0.116908 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [07/07/2021-20:01:34] [V] [TRT] Tactic: -2318106587342035239 Time: 0.0686 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [07/07/2021-20:01:34] [V] [TRT] Tactic: -1343271414618805657 Time: 0.067632 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [07/07/2021-20:01:34] [V] [TRT] Tactic: -1218658103698133241 Time: 0.142908 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [07/07/2021-20:01:34] [V] [TRT] Tactic: -836875257600482091 Time: 0.137532 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:01:34] [V] [TRT] Tactic: -410470605513481746 Time: 0.102004 [07/07/2021-20:01:34] [V] [TRT] Fastest Tactic: -8776506421218919509 Time: 0.063416 [07/07/2021-20:01:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8776506421218919509 [07/07/2021-20:01:34] [V] [TRT] *************** Autotuning format combination: Float(86528,1,3328,128) -> Float(86528,1,3328,128) *************** [07/07/2021-20:01:34] [V] [TRT] --------------- Timing Runner: node_of_203 (CudnnConvolution) [07/07/2021-20:01:34] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:34] [V] [TRT] --------------- Timing Runner: node_of_203 (CaskConvolution) [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [07/07/2021-20:01:34] [V] [TRT] Tactic: -9153228964338181824 Time: 0.076012 [07/07/2021-20:01:34] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [07/07/2021-20:01:34] [V] [TRT] Tactic: -7394439838318485025 Time: 0.090632 [07/07/2021-20:01:34] [V] [TRT] Fastest Tactic: -9153228964338181824 Time: 0.076012 [07/07/2021-20:01:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824 [07/07/2021-20:01:34] [V] [TRT] *************** Autotuning format combination: Half(86528,676,26,1) -> Half(86528,676,26,1) *************** [07/07/2021-20:01:34] [V] [TRT] --------------- Timing Runner: node_of_203 (CudnnConvolution) [07/07/2021-20:01:34] [V] [TRT] Tactic: 0 Time: 0.192184 [07/07/2021-20:01:34] [V] [TRT] Tactic: 1 Time: 0.127232 [07/07/2021-20:01:34] [V] [TRT] Tactic: 2 Time: 0.213376 [07/07/2021-20:01:34] [V] [TRT] Tactic: 4 skipped. Scratch requested: 145424384, available: 16777216 [07/07/2021-20:01:34] [V] [TRT] Tactic: 5 skipped. Scratch requested: 73531392, available: 16777216 [07/07/2021-20:01:34] [V] [TRT] Tactic: 6 Time: 0.133492 [07/07/2021-20:01:34] [V] [TRT] Fastest Tactic: 1 Time: 0.127232 [07/07/2021-20:01:34] [V] [TRT] --------------- Timing Runner: node_of_203 (CaskConvolution) [07/07/2021-20:01:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [07/07/2021-20:01:34] [V] [TRT] --------------- Timing Runner: reformat: Float(86528,676,26,1) -> Float(2704,676:32,26,1) (Reformat) [07/07/2021-20:01:34] [V] [TRT] Tactic: 0 Time: 0.016612 [07/07/2021-20:01:34] [V] [TRT] Fastest Tactic: 0 Time: 0.016612 [07/07/2021-20:01:34] [V] [TRT] --------------- Timing Runner: reformat: Float(86528,1,3328,128) -> Float(2704,676:32,26,1) (Reformat) [07/07/2021-20:01:34] [V] [TRT] Tactic: 0 Time: 0.02054 [07/07/2021-20:01:34] [V] [TRT] Fastest Tactic: 0 Time: 0.02054 [07/07/2021-20:01:34] [V] [TRT] --------------- Timing Runner: reformat: Float(2704,676:32,26,1) -> Float(86528,676,26,1) (Reformat) [07/07/2021-20:01:34] [V] [TRT] Tactic: 0 Time: 0.011388 [07/07/2021-20:01:34] [V] [TRT] Fastest Tactic: 0 Time: 0.011388 [07/07/2021-20:01:34] [V] [TRT] --------------- Timing Runner: reformat: Float(2704,676:32,26,1) -> Float(86528,1,3328,128) (Reformat) [07/07/2021-20:01:34] [V] [TRT] Tactic: 0 Time: 0.012288 [07/07/2021-20:01:34] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [07/07/2021-20:01:34] [V] [TRT] --------------- Timing Runner: reformat: Float(2704,676:32,26,1) -> Half(86528,676,26,1) (Reformat) [07/07/2021-20:01:34] [V] [TRT] Tactic: 0 Time: 0.012288 [07/07/2021-20:01:34] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [07/07/2021-20:01:34] [V] [TRT] --------------- Timing Runner: reformat: Half(86528,676,26,1) -> Float(2704,676:32,26,1) (Reformat) [07/07/2021-20:01:34] [V] [TRT] Tactic: 0 Time: 0.016352 [07/07/2021-20:01:34] [V] [TRT] Fastest Tactic: 0 Time: 0.016352 [07/07/2021-20:01:34] [V] [TRT] *************** Autotuning format combination: Float(86528,676,26,1) -> Float(173056,676,26,1) *************** [07/07/2021-20:01:34] [V] [TRT] --------------- Timing Runner: node_of_205 (PointWiseV2) [07/07/2021-20:01:34] [V] [TRT] Tactic: 0 Time: 0.008676 [07/07/2021-20:01:34] [V] [TRT] Tactic: 1 Time: 0.00704 [07/07/2021-20:01:34] [V] [TRT] Tactic: 2 Time: 0.006144 [07/07/2021-20:01:34] [V] [TRT] Tactic: 3 Time: 0.00512 [07/07/2021-20:01:34] [V] [TRT] Tactic: 4 Time: 0.00512 [07/07/2021-20:01:34] [V] [TRT] Tactic: 5 Time: 0.005104 [07/07/2021-20:01:34] [V] [TRT] Tactic: 6 Time: 0.005116 [07/07/2021-20:01:34] [V] [TRT] Tactic: 7 Time: 0.004096 [07/07/2021-20:01:34] [V] [TRT] Tactic: 8 Time: 0.004096 [07/07/2021-20:01:34] [V] [TRT] Tactic: 9 Time: 0.00416 [07/07/2021-20:01:34] [V] [TRT] Tactic: 28 Time: 0.008192 [07/07/2021-20:01:34] [V] [TRT] Fastest Tactic: 7 Time: 0.004096 [07/07/2021-20:01:34] [V] [TRT] --------------- Timing Runner: node_of_205 (PointWise) [07/07/2021-20:01:34] [V] [TRT] Tactic: 128 Time: 0.01536 [07/07/2021-20:01:34] [V] [TRT] Tactic: 256 Time: 0.015424 [07/07/2021-20:01:34] [V] [TRT] Tactic: 512 Time: 0.01536 [07/07/2021-20:01:34] [V] [TRT] Fastest Tactic: 128 Time: 0.01536 [07/07/2021-20:01:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [07/07/2021-20:01:34] [V] [TRT] *************** Autotuning format combination: Float(86528,1,3328,128) -> Float(173056,1,6656,256) *************** [07/07/2021-20:01:34] [V] [TRT] --------------- Timing Runner: node_of_205 (PointWiseV2) [07/07/2021-20:01:34] [V] [TRT] Tactic: 0 Time: 0.008832 [07/07/2021-20:01:34] [V] [TRT] Tactic: 1 Time: 0.00704 [07/07/2021-20:01:34] [V] [TRT] Tactic: 2 Time: 0.00624 [07/07/2021-20:01:34] [V] [TRT] Tactic: 3 Time: 0.005184 [07/07/2021-20:01:35] [V] [TRT] Tactic: 4 Time: 0.005084 [07/07/2021-20:01:35] [V] [TRT] Tactic: 5 Time: 0.0051 [07/07/2021-20:01:35] [V] [TRT] Tactic: 6 Time: 0.006144 [07/07/2021-20:01:35] [V] [TRT] Tactic: 7 Time: 0.005328 [07/07/2021-20:01:35] [V] [TRT] Tactic: 8 Time: 0.005108 [07/07/2021-20:01:35] [V] [TRT] Tactic: 9 Time: 0.0052 [07/07/2021-20:01:35] [V] [TRT] Tactic: 28 Time: 0.008568 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 4 Time: 0.005084 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: node_of_205 (PointWise) [07/07/2021-20:01:35] [V] [TRT] Tactic: 128 Time: 0.015728 [07/07/2021-20:01:35] [V] [TRT] Tactic: 256 Time: 0.015868 [07/07/2021-20:01:35] [V] [TRT] Tactic: 512 Time: 0.01568 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 512 Time: 0.01568 [07/07/2021-20:01:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [07/07/2021-20:01:35] [V] [TRT] *************** Autotuning format combination: Float(2704,676:32,26,1) -> Float(5408,676:32,26,1) *************** [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: node_of_205 (PointWiseV2) [07/07/2021-20:01:35] [V] [TRT] Tactic: 24 Time: 0.004416 [07/07/2021-20:01:35] [V] [TRT] Tactic: 25 Time: 0.004376 [07/07/2021-20:01:35] [V] [TRT] Tactic: 26 Time: 0.004276 [07/07/2021-20:01:35] [V] [TRT] Tactic: 27 Time: 0.004284 [07/07/2021-20:01:35] [V] [TRT] Tactic: 31 Time: 0.004528 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 26 Time: 0.004276 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: node_of_205 (PointWise) [07/07/2021-20:01:35] [V] [TRT] Tactic: 128 Time: 0.015368 [07/07/2021-20:01:35] [V] [TRT] Tactic: 256 Time: 0.015472 [07/07/2021-20:01:35] [V] [TRT] Tactic: 512 Time: 0.01536 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 512 Time: 0.01536 [07/07/2021-20:01:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [07/07/2021-20:01:35] [V] [TRT] *************** Autotuning format combination: Half(86528,676,26,1) -> Half(173056,676,26,1) *************** [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: node_of_205 (PointWiseV2) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.00858 [07/07/2021-20:01:35] [V] [TRT] Tactic: 1 Time: 0.006912 [07/07/2021-20:01:35] [V] [TRT] Tactic: 2 Time: 0.006272 [07/07/2021-20:01:35] [V] [TRT] Tactic: 3 Time: 0.005248 [07/07/2021-20:01:35] [V] [TRT] Tactic: 4 Time: 0.00512 [07/07/2021-20:01:35] [V] [TRT] Tactic: 5 Time: 0.005108 [07/07/2021-20:01:35] [V] [TRT] Tactic: 6 Time: 0.005104 [07/07/2021-20:01:35] [V] [TRT] Tactic: 7 Time: 0.004096 [07/07/2021-20:01:35] [V] [TRT] Tactic: 8 Time: 0.004096 [07/07/2021-20:01:35] [V] [TRT] Tactic: 9 Time: 0.004208 [07/07/2021-20:01:35] [V] [TRT] Tactic: 28 Time: 0.008192 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 7 Time: 0.004096 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: node_of_205 (PointWise) [07/07/2021-20:01:35] [V] [TRT] Tactic: 128 Time: 0.012352 [07/07/2021-20:01:35] [V] [TRT] Tactic: 256 Time: 0.012372 [07/07/2021-20:01:35] [V] [TRT] Tactic: 512 Time: 0.012412 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 128 Time: 0.012352 [07/07/2021-20:01:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,676,26,1) -> Float(173056,1,6656,256) (Reformat) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.01074 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 0 Time: 0.01074 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,676,26,1) -> Float(5408,676:32,26,1) (Reformat) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.016384 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 0 Time: 0.016384 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,676,26,1) -> Half(173056,676,26,1) (Reformat) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.01024 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,1,6656,256) -> Float(173056,676,26,1) (Reformat) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.01024 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,1,6656,256) -> Float(5408,676:32,26,1) (Reformat) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.02048 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 0 Time: 0.02048 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,1,6656,256) -> Half(173056,676,26,1) (Reformat) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.010356 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 0 Time: 0.010356 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: reformat: Float(5408,676:32,26,1) -> Float(173056,676,26,1) (Reformat) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.011508 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 0 Time: 0.011508 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: reformat: Float(5408,676:32,26,1) -> Float(173056,1,6656,256) (Reformat) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.012288 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: reformat: Float(5408,676:32,26,1) -> Half(173056,676,26,1) (Reformat) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.01184 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 0 Time: 0.01184 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: reformat: Half(173056,676,26,1) -> Float(173056,676,26,1) (Reformat) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.010228 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 0 Time: 0.010228 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: reformat: Half(173056,676,26,1) -> Float(173056,1,6656,256) (Reformat) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.0111 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0111 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: reformat: Half(173056,676,26,1) -> Float(5408,676:32,26,1) (Reformat) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.01636 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 0 Time: 0.01636 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,676,26,1) -> Float(173056,1,6656,256) (Reformat) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.010368 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 0 Time: 0.010368 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,676,26,1) -> Half(173056,676,26,1) (Reformat) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.01022 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 0 Time: 0.01022 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,1,6656,256) -> Float(173056,676,26,1) (Reformat) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.010216 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 0 Time: 0.010216 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: reformat: Float(173056,1,6656,256) -> Half(173056,676,26,1) (Reformat) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.010368 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 0 Time: 0.010368 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: reformat: Float(5408,676:32,26,1) -> Float(173056,676,26,1) (Reformat) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.011392 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 0 Time: 0.011392 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: reformat: Float(5408,676:32,26,1) -> Float(173056,1,6656,256) (Reformat) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.012196 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 0 Time: 0.012196 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: reformat: Float(5408,676:32,26,1) -> Half(173056,676,26,1) (Reformat) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.012084 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 0 Time: 0.012084 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: reformat: Half(173056,676,26,1) -> Float(173056,676,26,1) (Reformat) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.008256 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 0 Time: 0.008256 [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: reformat: Half(173056,676,26,1) -> Float(173056,1,6656,256) (Reformat) [07/07/2021-20:01:35] [V] [TRT] Tactic: 0 Time: 0.011264 [07/07/2021-20:01:35] [V] [TRT] Fastest Tactic: 0 Time: 0.011264 [07/07/2021-20:01:35] [V] [TRT] *************** Autotuning format combination: Float(173056,676,26,1) -> Float(86528,676,26,1) *************** [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: node_of_206 (CudaDepthwiseConvolution) [07/07/2021-20:01:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:35] [V] [TRT] --------------- Timing Runner: node_of_206 (FusedConvActConvolution) [07/07/2021-20:01:35] [V] [TRT] Tactic: 524287 Time: 0.155088 [07/07/2021-20:01:35] [V] [TRT] Tactic: 720895 Time: 0.123376 [07/07/2021-20:01:35] [V] [TRT] Tactic: 983039 Time: 0.099964 [07/07/2021-20:01:35] [V] [TRT] Tactic: 1048575 Time: 0.151932 [07/07/2021-20:01:35] [V] [TRT] Tactic: 1703935 Time: 0.126308 [07/07/2021-20:01:35] [V] [TRT] Tactic: 1769471 Time: 0.118932 [07/07/2021-20:01:35] [V] [TRT] Tactic: 1966079 Time: 0.162624 [07/07/2021-20:01:35] [V] [TRT] Tactic: 2031615 Time: 0.17856 [07/07/2021-20:01:35] [V] [TRT] Tactic: 2228223 Time: 0.153856 [07/07/2021-20:01:35] [V] [TRT] Tactic: 2424831 Time: 0.183364 [07/07/2021-20:01:35] [V] [TRT] Tactic: 2621439 Time: 0.125824 [07/07/2021-20:01:35] [V] [TRT] Tactic: 2752511 Time: 0.148572 [07/07/2021-20:01:35] [V] [TRT] Tactic: 2818047 Time: 0.1888 [07/07/2021-20:01:35] [V] [TRT] Tactic: 2883583 Time: 0.244096 [07/07/2021-20:01:35] [V] [TRT] Tactic: 3014655 Time: 0.131072 [07/07/2021-20:01:35] [V] [TRT] Tactic: 3145727 Time: 0.123648 [07/07/2021-20:01:35] [V] [TRT] Tactic: 3473407 Time: 0.167104 [07/07/2021-20:01:35] [V] [TRT] Tactic: 3604479 Time: 0.126572 [07/07/2021-20:01:35] [V] [TRT] Tactic: 3735551 Time: 0.125824 [07/07/2021-20:01:35] [V] [TRT] Tactic: 4390911 Time: 0.189668 [07/07/2021-20:01:36] [V] [TRT] Tactic: 5046271 Time: 0.117696 [07/07/2021-20:01:36] [V] [TRT] Tactic: 5963775 Time: 0.14696 [07/07/2021-20:01:36] [V] [TRT] Tactic: 6160383 Time: 0.144508 [07/07/2021-20:01:36] [V] [TRT] Tactic: 6488063 Time: 0.144512 [07/07/2021-20:01:36] [V] [TRT] Tactic: 6881279 Time: 0.1774 [07/07/2021-20:01:36] [V] [TRT] Tactic: 7274495 Time: 0.10144 [07/07/2021-20:01:36] [V] [TRT] Tactic: 7864319 Time: 0.118912 [07/07/2021-20:01:36] [V] [TRT] Tactic: 7995391 Time: 0.134264 [07/07/2021-20:01:36] [V] [TRT] Tactic: 8585215 Time: 0.176832 [07/07/2021-20:01:36] [V] [TRT] Tactic: 8847359 Time: 0.113032 [07/07/2021-20:01:36] [V] [TRT] Tactic: 8978431 Time: 0.149752 [07/07/2021-20:01:36] [V] [TRT] Tactic: 9043967 Time: 0.117504 [07/07/2021-20:01:36] [V] [TRT] Tactic: 9175039 Time: 0.126784 [07/07/2021-20:01:36] [V] [TRT] Tactic: 9502719 Time: 0.183472 [07/07/2021-20:01:36] [V] [TRT] Tactic: 9830399 Time: 0.11392 [07/07/2021-20:01:36] [V] [TRT] Tactic: 9961471 Time: 0.167936 [07/07/2021-20:01:36] [V] [TRT] Tactic: 10027007 Time: 0.13436 [07/07/2021-20:01:36] [V] [TRT] Tactic: 10092543 Time: 0.19136 [07/07/2021-20:01:36] [V] [TRT] Tactic: 10289151 Time: 0.162688 [07/07/2021-20:01:36] [V] [TRT] Tactic: 10485759 Time: 0.111164 [07/07/2021-20:01:36] [V] [TRT] Tactic: 10682367 Time: 0.12414 [07/07/2021-20:01:36] [V] [TRT] Tactic: 10813439 Time: 0.114304 [07/07/2021-20:01:36] [V] [TRT] Fastest Tactic: 983039 Time: 0.099964 [07/07/2021-20:01:36] [V] [TRT] --------------- Timing Runner: node_of_206 (CudnnConvolution) [07/07/2021-20:01:36] [V] [TRT] Tactic: 0 Time: 0.189312 [07/07/2021-20:01:36] [V] [TRT] Tactic: 1 Time: 0.211628 [07/07/2021-20:01:36] [V] [TRT] Tactic: 2 Time: 0.213568 [07/07/2021-20:01:36] [V] [TRT] Tactic: 4 skipped. Scratch requested: 146117120, available: 16777216 [07/07/2021-20:01:36] [V] [TRT] Tactic: 5 skipped. Scratch requested: 74224128, available: 16777216 [07/07/2021-20:01:36] [V] [TRT] Tactic: 6 Time: 0.32536 [07/07/2021-20:01:36] [V] [TRT] Fastest Tactic: 0 Time: 0.189312 [07/07/2021-20:01:36] [V] [TRT] --------------- Timing Runner: node_of_206 (CaskConvolution) [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [07/07/2021-20:01:36] [V] [TRT] Tactic: 1062367460111450758 Time: 0.137648 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [07/07/2021-20:01:36] [V] [TRT] Tactic: 1754984623894446479 Time: 0.118656 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [07/07/2021-20:01:36] [V] [TRT] Tactic: 3611739942397549984 Time: 0.1041 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [07/07/2021-20:01:36] [V] [TRT] Tactic: 3827454225649558724 Time: 0.064896 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [07/07/2021-20:01:36] [V] [TRT] Tactic: 4337000649858996379 Time: 0.11782 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [07/07/2021-20:01:36] [V] [TRT] Tactic: 4501471010995462441 Time: 0.106304 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:01:36] [V] [TRT] Tactic: 5137655947464784826 Time: 0.102464 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [07/07/2021-20:01:36] [V] [TRT] Tactic: 5288347012147084929 Time: 0.099252 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [07/07/2021-20:01:36] [V] [TRT] Tactic: 5921334924264294896 Time: 0.069468 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [07/07/2021-20:01:36] [V] [TRT] Tactic: 6645123197870846056 Time: 0.115716 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [07/07/2021-20:01:36] [V] [TRT] Tactic: 7144526460361122478 Time: 0.10298 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [07/07/2021-20:01:36] [V] [TRT] Tactic: 7852627285308570038 Time: 0.072048 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [07/07/2021-20:01:36] [V] [TRT] Tactic: -9137461792520977713 Time: 0.110544 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [07/07/2021-20:01:36] [V] [TRT] Tactic: -8776506421218919509 Time: 0.06354 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [07/07/2021-20:01:36] [V] [TRT] Tactic: -8262349710178828730 Time: 0.104576 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [07/07/2021-20:01:36] [V] [TRT] Tactic: -8133971918129952780 Time: 0.143096 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [07/07/2021-20:01:36] [V] [TRT] Tactic: -6092040395344634144 Time: 0.144632 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [07/07/2021-20:01:36] [V] [TRT] Tactic: -4787320710726427159 Time: 0.117556 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:01:36] [V] [TRT] Tactic: -3456450830548107839 Time: 0.116156 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [07/07/2021-20:01:36] [V] [TRT] Tactic: -2318106587342035239 Time: 0.068412 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [07/07/2021-20:01:36] [V] [TRT] Tactic: -1343271414618805657 Time: 0.067516 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [07/07/2021-20:01:36] [V] [TRT] Tactic: -1218658103698133241 Time: 0.142976 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [07/07/2021-20:01:36] [V] [TRT] Tactic: -836875257600482091 Time: 0.13426 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:01:36] [V] [TRT] Tactic: -410470605513481746 Time: 0.098952 [07/07/2021-20:01:36] [V] [TRT] Fastest Tactic: -8776506421218919509 Time: 0.06354 [07/07/2021-20:01:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8776506421218919509 [07/07/2021-20:01:36] [V] [TRT] *************** Autotuning format combination: Float(173056,1,6656,256) -> Float(86528,1,3328,128) *************** [07/07/2021-20:01:36] [V] [TRT] --------------- Timing Runner: node_of_206 (CudnnConvolution) [07/07/2021-20:01:36] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:36] [V] [TRT] --------------- Timing Runner: node_of_206 (CaskConvolution) [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [07/07/2021-20:01:36] [V] [TRT] Tactic: -9153228964338181824 Time: 0.078484 [07/07/2021-20:01:36] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [07/07/2021-20:01:36] [V] [TRT] Tactic: -7394439838318485025 Time: 0.0904 [07/07/2021-20:01:36] [V] [TRT] Fastest Tactic: -9153228964338181824 Time: 0.078484 [07/07/2021-20:01:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824 [07/07/2021-20:01:36] [V] [TRT] *************** Autotuning format combination: Half(173056,676,26,1) -> Half(86528,676,26,1) *************** [07/07/2021-20:01:36] [V] [TRT] --------------- Timing Runner: node_of_206 (CudnnConvolution) [07/07/2021-20:01:36] [V] [TRT] Tactic: 0 Time: 0.192448 [07/07/2021-20:01:36] [V] [TRT] Tactic: 1 Time: 0.3888 [07/07/2021-20:01:36] [V] [TRT] Tactic: 2 Time: 0.212736 [07/07/2021-20:01:36] [V] [TRT] Tactic: 4 skipped. Scratch requested: 145771008, available: 16777216 [07/07/2021-20:01:36] [V] [TRT] Tactic: 5 skipped. Scratch requested: 73878016, available: 16777216 [07/07/2021-20:01:36] [V] [TRT] Tactic: 6 Time: 0.367548 [07/07/2021-20:01:36] [V] [TRT] Fastest Tactic: 0 Time: 0.192448 [07/07/2021-20:01:36] [V] [TRT] --------------- Timing Runner: node_of_206 (CaskConvolution) [07/07/2021-20:01:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [07/07/2021-20:01:36] [V] [TRT] *************** Autotuning format combination: Float(86528,676,26,1) -> Float(173056,676,26,1) *************** [07/07/2021-20:01:36] [V] [TRT] *************** Autotuning format combination: Float(86528,1,3328,128) -> Float(173056,1,6656,256) *************** [07/07/2021-20:01:36] [V] [TRT] *************** Autotuning format combination: Float(2704,676:32,26,1) -> Float(5408,676:32,26,1) *************** [07/07/2021-20:01:36] [V] [TRT] *************** Autotuning format combination: Half(86528,676,26,1) -> Half(173056,676,26,1) *************** [07/07/2021-20:01:36] [V] [TRT] *************** Autotuning format combination: Float(173056,676,26,1) -> Float(173056,676,26,1) *************** [07/07/2021-20:01:36] [V] [TRT] --------------- Timing Runner: node_of_210 (CudaDepthwiseConvolution) [07/07/2021-20:01:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:36] [V] [TRT] --------------- Timing Runner: node_of_210 (FusedConvActConvolution) [07/07/2021-20:01:36] [V] [TRT] Tactic: 589823 Time: 0.195332 [07/07/2021-20:01:36] [V] [TRT] Tactic: 655359 Time: 0.13 [07/07/2021-20:01:36] [V] [TRT] Tactic: 786431 Time: 0.12584 [07/07/2021-20:01:36] [V] [TRT] Tactic: 851967 Time: 0.1063 [07/07/2021-20:01:36] [V] [TRT] Tactic: 1179647 Time: 0.099464 [07/07/2021-20:01:36] [V] [TRT] Tactic: 1310719 Time: 0.120824 [07/07/2021-20:01:36] [V] [TRT] Tactic: 1376255 Time: 0.136448 [07/07/2021-20:01:36] [V] [TRT] Tactic: 1441791 Time: 0.132988 [07/07/2021-20:01:36] [V] [TRT] Tactic: 1507327 Time: 0.123156 [07/07/2021-20:01:36] [V] [TRT] Tactic: 1638399 Time: 0.11552 [07/07/2021-20:01:36] [V] [TRT] Tactic: 1835007 Time: 0.12116 [07/07/2021-20:01:36] [V] [TRT] Tactic: 1900543 Time: 0.134848 [07/07/2021-20:01:36] [V] [TRT] Tactic: 2097151 Time: 0.119444 [07/07/2021-20:01:36] [V] [TRT] Tactic: 2162687 Time: 0.137808 [07/07/2021-20:01:36] [V] [TRT] Tactic: 2293759 Time: 0.129532 [07/07/2021-20:01:36] [V] [TRT] Tactic: 2359295 Time: 0.09342 [07/07/2021-20:01:36] [V] [TRT] Tactic: 2686975 Time: 0.132684 [07/07/2021-20:01:36] [V] [TRT] Tactic: 3080191 Time: 0.120192 [07/07/2021-20:01:36] [V] [TRT] Tactic: 3342335 Time: 0.123712 [07/07/2021-20:01:36] [V] [TRT] Tactic: 3407871 Time: 0.090176 [07/07/2021-20:01:37] [V] [TRT] Tactic: 3538943 Time: 0.086072 [07/07/2021-20:01:37] [V] [TRT] Tactic: 3670015 Time: 0.2228 [07/07/2021-20:01:37] [V] [TRT] Tactic: 3932159 Time: 0.12234 [07/07/2021-20:01:37] [V] [TRT] Tactic: 3997695 Time: 0.131768 [07/07/2021-20:01:37] [V] [TRT] Tactic: 4063231 Time: 0.102264 [07/07/2021-20:01:37] [V] [TRT] Tactic: 4194303 Time: 0.12704 [07/07/2021-20:01:37] [V] [TRT] Tactic: 4259839 Time: 0.130492 [07/07/2021-20:01:37] [V] [TRT] Tactic: 4325375 Time: 0.112976 [07/07/2021-20:01:37] [V] [TRT] Tactic: 4521983 Time: 0.134716 [07/07/2021-20:01:37] [V] [TRT] Tactic: 4587519 Time: 0.105088 [07/07/2021-20:01:37] [V] [TRT] Tactic: 4653055 Time: 0.092032 [07/07/2021-20:01:37] [V] [TRT] Tactic: 4915199 Time: 0.107488 [07/07/2021-20:01:37] [V] [TRT] Tactic: 4980735 Time: 0.108732 [07/07/2021-20:01:37] [V] [TRT] Tactic: 5177343 Time: 0.0992 [07/07/2021-20:01:37] [V] [TRT] Tactic: 5242879 Time: 0.091712 [07/07/2021-20:01:37] [V] [TRT] Tactic: 5373951 Time: 0.1107 [07/07/2021-20:01:37] [V] [TRT] Tactic: 5439487 Time: 0.13312 [07/07/2021-20:01:37] [V] [TRT] Tactic: 5570559 Time: 0.123008 [07/07/2021-20:01:37] [V] [TRT] Tactic: 5636095 Time: 0.102508 [07/07/2021-20:01:37] [V] [TRT] Tactic: 5701631 Time: 0.132096 [07/07/2021-20:01:37] [V] [TRT] Tactic: 5767167 Time: 0.180608 [07/07/2021-20:01:37] [V] [TRT] Tactic: 5832703 Time: 0.09598 [07/07/2021-20:01:37] [V] [TRT] Tactic: 5898239 Time: 0.08088 [07/07/2021-20:01:37] [V] [TRT] Tactic: 6029311 Time: 0.126316 [07/07/2021-20:01:37] [V] [TRT] Tactic: 6225919 Time: 0.09056 [07/07/2021-20:01:37] [V] [TRT] Tactic: 6291455 Time: 0.09968 [07/07/2021-20:01:37] [V] [TRT] Tactic: 6422527 Time: 0.116716 [07/07/2021-20:01:37] [V] [TRT] Tactic: 6750207 Time: 0.119552 [07/07/2021-20:01:37] [V] [TRT] Tactic: 6815743 Time: 0.100084 [07/07/2021-20:01:37] [V] [TRT] Tactic: 6946815 Time: 0.145984 [07/07/2021-20:01:37] [V] [TRT] Tactic: 7012351 Time: 0.118936 [07/07/2021-20:01:37] [V] [TRT] Tactic: 7077887 Time: 0.092928 [07/07/2021-20:01:37] [V] [TRT] Tactic: 7143423 Time: 0.164416 [07/07/2021-20:01:37] [V] [TRT] Tactic: 7208959 Time: 0.096372 [07/07/2021-20:01:37] [V] [TRT] Tactic: 7340031 Time: 0.082028 [07/07/2021-20:01:37] [V] [TRT] Tactic: 7405567 Time: 0.100544 [07/07/2021-20:01:37] [V] [TRT] Tactic: 7536639 Time: 0.12952 [07/07/2021-20:01:37] [V] [TRT] Tactic: 7602175 Time: 0.126848 [07/07/2021-20:01:37] [V] [TRT] Tactic: 7733247 Time: 0.091352 [07/07/2021-20:01:37] [V] [TRT] Tactic: 7798783 Time: 0.125568 [07/07/2021-20:01:37] [V] [TRT] Tactic: 8191999 Time: 0.158592 [07/07/2021-20:01:37] [V] [TRT] Tactic: 8257535 Time: 0.107136 [07/07/2021-20:01:37] [V] [TRT] Tactic: 8323071 Time: 0.110572 [07/07/2021-20:01:37] [V] [TRT] Tactic: 8650751 Time: 0.126208 [07/07/2021-20:01:37] [V] [TRT] Tactic: 8716287 Time: 0.106624 [07/07/2021-20:01:37] [V] [TRT] Tactic: 9109503 Time: 0.122112 [07/07/2021-20:01:38] [V] [TRT] Tactic: 9568255 Time: 0.107392 [07/07/2021-20:01:38] [V] [TRT] Tactic: 9895935 Time: 0.125884 [07/07/2021-20:01:38] [V] [TRT] Tactic: 10223615 Time: 0.132968 [07/07/2021-20:01:38] [V] [TRT] Tactic: 10354687 Time: 0.121964 [07/07/2021-20:01:38] [V] [TRT] Tactic: 10551295 Time: 0.154468 [07/07/2021-20:01:38] [V] [TRT] Tactic: 10747903 Time: 0.091648 [07/07/2021-20:01:38] [V] [TRT] Tactic: 10944511 Time: 0.108788 [07/07/2021-20:01:38] [V] [TRT] Fastest Tactic: 5898239 Time: 0.08088 [07/07/2021-20:01:38] [V] [TRT] --------------- Timing Runner: node_of_210 (CudnnConvolution) [07/07/2021-20:01:38] [V] [TRT] Tactic: 0 Time: 0.09828 [07/07/2021-20:01:38] [V] [TRT] Tactic: 1 Time: 0.076168 [07/07/2021-20:01:38] [V] [TRT] Tactic: 2 Time: 0.176112 [07/07/2021-20:01:38] [V] [TRT] Tactic: 4 skipped. Scratch requested: 575143936, available: 16777216 [07/07/2021-20:01:38] [V] [TRT] Tactic: 5 Time: 0.276092 [07/07/2021-20:01:38] [V] [TRT] Fastest Tactic: 1 Time: 0.076168 [07/07/2021-20:01:38] [V] [TRT] --------------- Timing Runner: node_of_210 (CublasConvolution) [07/07/2021-20:01:38] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:38] [V] [TRT] --------------- Timing Runner: node_of_210 (CaskConvolution) [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [07/07/2021-20:01:38] [V] [TRT] Tactic: 1062367460111450758 Time: 0.04928 [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [07/07/2021-20:01:38] [V] [TRT] Tactic: 1698681053543049347 Time: 0.044528 [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [07/07/2021-20:01:38] [V] [TRT] Tactic: 4501471010995462441 Time: 0.0485 [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:01:38] [V] [TRT] Tactic: 5137655947464784826 Time: 0.041076 [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [07/07/2021-20:01:38] [V] [TRT] Tactic: 5288347012147084929 Time: 0.048248 [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [07/07/2021-20:01:38] [V] [TRT] Tactic: 5326823351883942011 Time: 0.04728 [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [07/07/2021-20:01:38] [V] [TRT] Tactic: 5500448035057547314 Time: 0.045228 [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [07/07/2021-20:01:38] [V] [TRT] Tactic: 6645123197870846056 Time: 0.041916 [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [07/07/2021-20:01:38] [V] [TRT] Tactic: 7144526460361122478 Time: 0.068204 [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [07/07/2021-20:01:38] [V] [TRT] Tactic: -8262349710178828730 Time: 0.04908 [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [07/07/2021-20:01:38] [V] [TRT] Tactic: -6576203419454146580 Time: 0.045112 [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [07/07/2021-20:01:38] [V] [TRT] Tactic: -4787320710726427159 Time: 0.07018 [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:01:38] [V] [TRT] Tactic: -3456450830548107839 Time: 0.047872 [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [07/07/2021-20:01:38] [V] [TRT] Tactic: -1218658103698133241 Time: 0.0483 [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [07/07/2021-20:01:38] [V] [TRT] Tactic: -836875257600482091 Time: 0.046664 [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:01:38] [V] [TRT] Tactic: -410470605513481746 Time: 0.047852 [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [07/07/2021-20:01:38] [V] [TRT] Tactic: -377491875521947884 Time: 0.047764 [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [07/07/2021-20:01:38] [V] [TRT] Tactic: -37215280111360163 Time: 0.040108 [07/07/2021-20:01:38] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.040108 [07/07/2021-20:01:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [07/07/2021-20:01:38] [V] [TRT] *************** Autotuning format combination: Float(173056,1,6656,256) -> Float(173056,1,6656,256) *************** [07/07/2021-20:01:38] [V] [TRT] --------------- Timing Runner: node_of_210 (CudnnConvolution) [07/07/2021-20:01:38] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:38] [V] [TRT] --------------- Timing Runner: node_of_210 (CublasConvolution) [07/07/2021-20:01:38] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:38] [V] [TRT] --------------- Timing Runner: node_of_210 (CaskConvolution) [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [07/07/2021-20:01:38] [V] [TRT] Tactic: 3886731678879822788 Time: 0.03996 [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [07/07/2021-20:01:38] [V] [TRT] Tactic: 6629944304117643200 Time: 0.044956 [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [07/07/2021-20:01:38] [V] [TRT] Tactic: -9153228964338181824 Time: 0.045512 [07/07/2021-20:01:38] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [07/07/2021-20:01:38] [V] [TRT] Tactic: -7394439838318485025 Time: 0.041784 [07/07/2021-20:01:38] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.03996 [07/07/2021-20:01:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [07/07/2021-20:01:38] [V] [TRT] *************** Autotuning format combination: Half(173056,676,26,1) -> Half(173056,676,26,1) *************** [07/07/2021-20:01:38] [V] [TRT] --------------- Timing Runner: node_of_210 (CudnnConvolution) [07/07/2021-20:01:38] [V] [TRT] Tactic: 0 Time: 0.079104 [07/07/2021-20:01:38] [V] [TRT] Tactic: 1 Time: 0.085036 [07/07/2021-20:01:38] [V] [TRT] Tactic: 2 Time: 0.167532 [07/07/2021-20:01:38] [V] [TRT] Tactic: 4 skipped. Scratch requested: 575143936, available: 16777216 [07/07/2021-20:01:38] [V] [TRT] Tactic: 5 Time: 0.273856 [07/07/2021-20:01:38] [V] [TRT] Fastest Tactic: 0 Time: 0.079104 [07/07/2021-20:01:38] [V] [TRT] --------------- Timing Runner: node_of_210 (CublasConvolution) [07/07/2021-20:01:38] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:38] [V] [TRT] --------------- Timing Runner: node_of_210 (CaskConvolution) [07/07/2021-20:01:38] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [07/07/2021-20:01:38] [V] [TRT] *************** Autotuning format combination: Float(173056,676,26,1) -> Float(346112,676,26,1) *************** [07/07/2021-20:01:38] [V] [TRT] --------------- Timing Runner: node_of_212 (PointWiseV2) [07/07/2021-20:01:38] [V] [TRT] Tactic: 0 Time: 0.016876 [07/07/2021-20:01:38] [V] [TRT] Tactic: 1 Time: 0.016696 [07/07/2021-20:01:38] [V] [TRT] Tactic: 2 Time: 0.01472 [07/07/2021-20:01:38] [V] [TRT] Tactic: 3 Time: 0.016512 [07/07/2021-20:01:38] [V] [TRT] Tactic: 4 Time: 0.014712 [07/07/2021-20:01:38] [V] [TRT] Tactic: 5 Time: 0.013876 [07/07/2021-20:01:38] [V] [TRT] Tactic: 6 Time: 0.01656 [07/07/2021-20:01:38] [V] [TRT] Tactic: 7 Time: 0.015164 [07/07/2021-20:01:38] [V] [TRT] Tactic: 8 Time: 0.014392 [07/07/2021-20:01:38] [V] [TRT] Tactic: 9 Time: 0.014072 [07/07/2021-20:01:38] [V] [TRT] Tactic: 28 Time: 0.016568 [07/07/2021-20:01:38] [V] [TRT] Fastest Tactic: 5 Time: 0.013876 [07/07/2021-20:01:38] [V] [TRT] --------------- Timing Runner: node_of_212 (PointWise) [07/07/2021-20:01:38] [V] [TRT] Tactic: 128 Time: 0.028152 [07/07/2021-20:01:38] [V] [TRT] Tactic: 256 Time: 0.028268 [07/07/2021-20:01:38] [V] [TRT] Tactic: 512 Time: 0.0288 [07/07/2021-20:01:38] [V] [TRT] Fastest Tactic: 128 Time: 0.028152 [07/07/2021-20:01:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [07/07/2021-20:01:38] [V] [TRT] *************** Autotuning format combination: Float(173056,1,6656,256) -> Float(346112,1,13312,512) *************** [07/07/2021-20:01:38] [V] [TRT] --------------- Timing Runner: node_of_212 (PointWiseV2) [07/07/2021-20:01:38] [V] [TRT] Tactic: 0 Time: 0.01682 [07/07/2021-20:01:38] [V] [TRT] Tactic: 1 Time: 0.016184 [07/07/2021-20:01:38] [V] [TRT] Tactic: 2 Time: 0.014588 [07/07/2021-20:01:38] [V] [TRT] Tactic: 3 Time: 0.016376 [07/07/2021-20:01:38] [V] [TRT] Tactic: 4 Time: 0.014912 [07/07/2021-20:01:38] [V] [TRT] Tactic: 5 Time: 0.013628 [07/07/2021-20:01:38] [V] [TRT] Tactic: 6 Time: 0.016388 [07/07/2021-20:01:38] [V] [TRT] Tactic: 7 Time: 0.015124 [07/07/2021-20:01:38] [V] [TRT] Tactic: 8 Time: 0.014136 [07/07/2021-20:01:38] [V] [TRT] Tactic: 9 Time: 0.013616 [07/07/2021-20:01:38] [V] [TRT] Tactic: 28 Time: 0.016256 [07/07/2021-20:01:38] [V] [TRT] Fastest Tactic: 9 Time: 0.013616 [07/07/2021-20:01:38] [V] [TRT] --------------- Timing Runner: node_of_212 (PointWise) [07/07/2021-20:01:38] [V] [TRT] Tactic: 128 Time: 0.028152 [07/07/2021-20:01:38] [V] [TRT] Tactic: 256 Time: 0.028492 [07/07/2021-20:01:38] [V] [TRT] Tactic: 512 Time: 0.028672 [07/07/2021-20:01:38] [V] [TRT] Fastest Tactic: 128 Time: 0.028152 [07/07/2021-20:01:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [07/07/2021-20:01:38] [V] [TRT] *************** Autotuning format combination: Float(5408,676:32,26,1) -> Float(10816,676:32,26,1) *************** [07/07/2021-20:01:38] [V] [TRT] --------------- Timing Runner: node_of_212 (PointWiseV2) [07/07/2021-20:01:38] [V] [TRT] Tactic: 24 Time: 0.013528 [07/07/2021-20:01:38] [V] [TRT] Tactic: 25 Time: 0.01438 [07/07/2021-20:01:38] [V] [TRT] Tactic: 26 Time: 0.014208 [07/07/2021-20:01:38] [V] [TRT] Tactic: 27 Time: 0.015104 [07/07/2021-20:01:38] [V] [TRT] Tactic: 31 Time: 0.013184 [07/07/2021-20:01:38] [V] [TRT] Fastest Tactic: 31 Time: 0.013184 [07/07/2021-20:01:38] [V] [TRT] --------------- Timing Runner: node_of_212 (PointWise) [07/07/2021-20:01:38] [V] [TRT] Tactic: 128 Time: 0.028392 [07/07/2021-20:01:38] [V] [TRT] Tactic: 256 Time: 0.028396 [07/07/2021-20:01:38] [V] [TRT] Tactic: 512 Time: 0.028608 [07/07/2021-20:01:38] [V] [TRT] Fastest Tactic: 128 Time: 0.028392 [07/07/2021-20:01:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [07/07/2021-20:01:38] [V] [TRT] *************** Autotuning format combination: Half(173056,676,26,1) -> Half(346112,676,26,1) *************** [07/07/2021-20:01:38] [V] [TRT] --------------- Timing Runner: node_of_212 (PointWiseV2) [07/07/2021-20:01:38] [V] [TRT] Tactic: 0 Time: 0.01534 [07/07/2021-20:01:38] [V] [TRT] Tactic: 1 Time: 0.01122 [07/07/2021-20:01:38] [V] [TRT] Tactic: 2 Time: 0.01024 [07/07/2021-20:01:38] [V] [TRT] Tactic: 3 Time: 0.008172 [07/07/2021-20:01:38] [V] [TRT] Tactic: 4 Time: 0.007168 [07/07/2021-20:01:38] [V] [TRT] Tactic: 5 Time: 0.007168 [07/07/2021-20:01:38] [V] [TRT] Tactic: 6 Time: 0.007132 [07/07/2021-20:01:38] [V] [TRT] Tactic: 7 Time: 0.006128 [07/07/2021-20:01:38] [V] [TRT] Tactic: 8 Time: 0.005184 [07/07/2021-20:01:38] [V] [TRT] Tactic: 9 Time: 0.006144 [07/07/2021-20:01:38] [V] [TRT] Tactic: 28 Time: 0.01432 [07/07/2021-20:01:38] [V] [TRT] Fastest Tactic: 8 Time: 0.005184 [07/07/2021-20:01:38] [V] [TRT] --------------- Timing Runner: node_of_212 (PointWise) [07/07/2021-20:01:38] [V] [TRT] Tactic: 128 Time: 0.022528 [07/07/2021-20:01:38] [V] [TRT] Tactic: 256 Time: 0.021504 [07/07/2021-20:01:38] [V] [TRT] Tactic: 512 Time: 0.0215 [07/07/2021-20:01:38] [V] [TRT] Fastest Tactic: 512 Time: 0.0215 [07/07/2021-20:01:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [07/07/2021-20:01:38] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,676,26,1) -> Float(346112,1,13312,512) (Reformat) [07/07/2021-20:01:38] [V] [TRT] Tactic: 0 Time: 0.024544 [07/07/2021-20:01:38] [V] [TRT] Fastest Tactic: 0 Time: 0.024544 [07/07/2021-20:01:38] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,676,26,1) -> Float(10816,676:32,26,1) (Reformat) [07/07/2021-20:01:38] [V] [TRT] Tactic: 0 Time: 0.029684 [07/07/2021-20:01:38] [V] [TRT] Fastest Tactic: 0 Time: 0.029684 [07/07/2021-20:01:38] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,676,26,1) -> Half(346112,676,26,1) (Reformat) [07/07/2021-20:01:38] [V] [TRT] Tactic: 0 Time: 0.018468 [07/07/2021-20:01:38] [V] [TRT] Fastest Tactic: 0 Time: 0.018468 [07/07/2021-20:01:38] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,1,13312,512) -> Float(346112,676,26,1) (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.022516 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.022516 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,1,13312,512) -> Float(10816,676:32,26,1) (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.037992 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.037992 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,1,13312,512) -> Half(346112,676,26,1) (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.018432 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.018432 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: reformat: Float(10816,676:32,26,1) -> Float(346112,676,26,1) (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.021488 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.021488 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: reformat: Float(10816,676:32,26,1) -> Float(346112,1,13312,512) (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.021828 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.021828 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: reformat: Float(10816,676:32,26,1) -> Half(346112,676,26,1) (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.021504 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.021504 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: reformat: Half(346112,676,26,1) -> Float(346112,676,26,1) (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.01846 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.01846 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: reformat: Half(346112,676,26,1) -> Float(346112,1,13312,512) (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.019456 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.019456 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: reformat: Half(346112,676,26,1) -> Float(10816,676:32,26,1) (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.029692 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.029692 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: 187 copy (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.03382 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.03382 [07/07/2021-20:01:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: 187 copy (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.024192 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.024192 [07/07/2021-20:01:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: 187 copy (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.029696 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.029696 [07/07/2021-20:01:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: 187 copy (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.018384 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.018384 [07/07/2021-20:01:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: 187 copy (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.022312 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.022312 [07/07/2021-20:01:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: 187 copy (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.01916 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.01916 [07/07/2021-20:01:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: 187 copy (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.038256 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.038256 [07/07/2021-20:01:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: 187 copy (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.018416 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.018416 [07/07/2021-20:01:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: 187 copy (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.021512 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.021512 [07/07/2021-20:01:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: 187 copy (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.02176 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.02176 [07/07/2021-20:01:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: 187 copy (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.03378 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.03378 [07/07/2021-20:01:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: 187 copy (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.021044 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.021044 [07/07/2021-20:01:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: 187 copy (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.018236 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.018236 [07/07/2021-20:01:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: 187 copy (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.019456 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.019456 [07/07/2021-20:01:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: 187 copy (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.029696 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.029696 [07/07/2021-20:01:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: 187 copy (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.017396 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.017396 [07/07/2021-20:01:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,676,26,1) -> Half(346112,676,26,1) (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.03968 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.03968 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,1,13312,512) -> Float(346112,676,26,1) (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.042368 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.042368 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: reformat: Float(346112,1,13312,512) -> Half(346112,676,26,1) (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.037632 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.037632 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: reformat: Float(10816,676:32,26,1) -> Float(346112,676,26,1) (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.039356 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.039356 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: reformat: Float(10816,676:32,26,1) -> Half(346112,676,26,1) (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.039424 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.039424 [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: reformat: Half(346112,676,26,1) -> Float(346112,676,26,1) (Reformat) [07/07/2021-20:01:39] [V] [TRT] Tactic: 0 Time: 0.026288 [07/07/2021-20:01:39] [V] [TRT] Fastest Tactic: 0 Time: 0.026288 [07/07/2021-20:01:39] [V] [TRT] *************** Autotuning format combination: Float(346112,676,26,1) -> Float(86528,169,13,1) *************** [07/07/2021-20:01:39] [V] [TRT] --------------- Timing Runner: node_of_214 (TiledPooling) [07/07/2021-20:01:39] [V] [TRT] Tactic: 5505281 Time: 0.053256 [07/07/2021-20:01:39] [V] [TRT] Tactic: 5570817 Time: 0.030592 [07/07/2021-20:01:39] [V] [TRT] Tactic: 5636353 Time: 0.024652 [07/07/2021-20:01:39] [V] [TRT] Tactic: 5701889 Time: 0.022636 [07/07/2021-20:01:39] [V] [TRT] Tactic: 5767425 Time: 0.021504 [07/07/2021-20:01:39] [V] [TRT] Tactic: 5832961 Time: 0.0208 [07/07/2021-20:01:39] [V] [TRT] Tactic: 5898497 Time: 0.020608 [07/07/2021-20:01:39] [V] [TRT] Tactic: 5964033 Time: 0.020736 [07/07/2021-20:01:39] [V] [TRT] Tactic: 6029569 Time: 0.028772 [07/07/2021-20:01:39] [V] [TRT] Tactic: 6095105 Time: 0.020844 [07/07/2021-20:01:39] [V] [TRT] Tactic: 6160641 Time: 0.020096 [07/07/2021-20:01:39] [V] [TRT] Tactic: 6226177 Time: 0.019712 [07/07/2021-20:01:39] [V] [TRT] Tactic: 6291713 Time: 0.019568 [07/07/2021-20:01:39] [V] [TRT] Tactic: 6357249 Time: 0.019788 [07/07/2021-20:01:39] [V] [TRT] Tactic: 6422785 Time: 0.019892 [07/07/2021-20:01:40] [V] [TRT] Tactic: 6488321 Time: 0.020332 [07/07/2021-20:01:40] [V] [TRT] Fastest Tactic: 6291713 Time: 0.019568 [07/07/2021-20:01:40] [V] [TRT] --------------- Timing Runner: node_of_214 (CudnnPooling) [07/07/2021-20:01:40] [V] [TRT] Tactic: -1 Time: 0.023296 [07/07/2021-20:01:40] [V] [TRT] Fastest Tactic: -1 Time: 0.023296 [07/07/2021-20:01:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 6291713 [07/07/2021-20:01:40] [V] [TRT] *************** Autotuning format combination: Half(346112,676,26,1) -> Half(86528,169,13,1) *************** [07/07/2021-20:01:40] [V] [TRT] --------------- Timing Runner: node_of_214 (TiledPooling) [07/07/2021-20:01:40] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [07/07/2021-20:01:40] [V] [TRT] --------------- Timing Runner: node_of_214 (CudnnPooling) [07/07/2021-20:01:40] [V] [TRT] Tactic: -1 Time: 0.013264 [07/07/2021-20:01:40] [V] [TRT] Fastest Tactic: -1 Time: 0.013264 [07/07/2021-20:01:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnPooling Tactic: -1 [07/07/2021-20:01:40] [V] [TRT] --------------- Timing Runner: reformat: Float(86528,169,13,1) -> Float(86528,1,6656,512) (Reformat) [07/07/2021-20:01:40] [V] [TRT] Tactic: 0 Time: 0.010964 [07/07/2021-20:01:40] [V] [TRT] Fastest Tactic: 0 Time: 0.010964 [07/07/2021-20:01:40] [V] [TRT] --------------- Timing Runner: reformat: Float(86528,169,13,1) -> Half(86528,169,13,1) (Reformat) [07/07/2021-20:01:40] [V] [TRT] Tactic: 0 Time: 0.008768 [07/07/2021-20:01:40] [V] [TRT] Fastest Tactic: 0 Time: 0.008768 [07/07/2021-20:01:40] [V] [TRT] --------------- Timing Runner: reformat: Float(86528,1,6656,512) -> Float(86528,169,13,1) (Reformat) [07/07/2021-20:01:40] [V] [TRT] Tactic: 0 Time: 0.010356 [07/07/2021-20:01:40] [V] [TRT] Fastest Tactic: 0 Time: 0.010356 [07/07/2021-20:01:40] [V] [TRT] --------------- Timing Runner: reformat: Float(86528,1,6656,512) -> Half(86528,169,13,1) (Reformat) [07/07/2021-20:01:40] [V] [TRT] Tactic: 0 Time: 0.010488 [07/07/2021-20:01:40] [V] [TRT] Fastest Tactic: 0 Time: 0.010488 [07/07/2021-20:01:40] [V] [TRT] --------------- Timing Runner: reformat: Half(86528,169,13,1) -> Float(86528,169,13,1) (Reformat) [07/07/2021-20:01:40] [V] [TRT] Tactic: 0 Time: 0.008192 [07/07/2021-20:01:40] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [07/07/2021-20:01:40] [V] [TRT] --------------- Timing Runner: reformat: Half(86528,169,13,1) -> Float(86528,1,6656,512) (Reformat) [07/07/2021-20:01:40] [V] [TRT] Tactic: 0 Time: 0.010948 [07/07/2021-20:01:40] [V] [TRT] Fastest Tactic: 0 Time: 0.010948 [07/07/2021-20:01:40] [V] [TRT] *************** Autotuning format combination: Float(86528,169,13,1) -> Float(86528,169,13,1) *************** [07/07/2021-20:01:40] [V] [TRT] --------------- Timing Runner: node_of_215 (CudaDepthwiseConvolution) [07/07/2021-20:01:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:40] [V] [TRT] --------------- Timing Runner: node_of_215 (FusedConvActConvolution) [07/07/2021-20:01:40] [V] [TRT] Tactic: 524287 Time: 0.664176 [07/07/2021-20:01:40] [V] [TRT] Tactic: 720895 Time: 0.55 [07/07/2021-20:01:40] [V] [TRT] Tactic: 983039 Time: 0.499828 [07/07/2021-20:01:40] [V] [TRT] Tactic: 1048575 Time: 0.5251 [07/07/2021-20:01:40] [V] [TRT] Tactic: 1703935 Time: 0.521892 [07/07/2021-20:01:40] [V] [TRT] Tactic: 1769471 Time: 0.443376 [07/07/2021-20:01:40] [V] [TRT] Tactic: 1966079 Time: 0.953656 [07/07/2021-20:01:40] [V] [TRT] Tactic: 2031615 Time: 0.644348 [07/07/2021-20:01:40] [V] [TRT] Tactic: 2228223 Time: 0.967616 [07/07/2021-20:01:40] [V] [TRT] Tactic: 2424831 Time: 0.844656 [07/07/2021-20:01:41] [V] [TRT] Tactic: 2621439 Time: 0.500736 [07/07/2021-20:01:41] [V] [TRT] Tactic: 2752511 Time: 0.472556 [07/07/2021-20:01:41] [V] [TRT] Tactic: 2818047 Time: 0.683008 [07/07/2021-20:01:41] [V] [TRT] Tactic: 2883583 Time: 0.997304 [07/07/2021-20:01:41] [V] [TRT] Tactic: 3014655 Time: 0.532184 [07/07/2021-20:01:41] [V] [TRT] Tactic: 3145727 Time: 0.486656 [07/07/2021-20:01:41] [V] [TRT] Tactic: 3473407 Time: 0.600896 [07/07/2021-20:01:41] [V] [TRT] Tactic: 3604479 Time: 0.51726 [07/07/2021-20:01:41] [V] [TRT] Tactic: 3735551 Time: 0.453836 [07/07/2021-20:01:41] [V] [TRT] Tactic: 4390911 Time: 0.794868 [07/07/2021-20:01:41] [V] [TRT] Tactic: 5046271 Time: 0.50202 [07/07/2021-20:01:41] [V] [TRT] Tactic: 5963775 Time: 0.742116 [07/07/2021-20:01:41] [V] [TRT] Tactic: 6160383 Time: 0.614656 [07/07/2021-20:01:42] [V] [TRT] Tactic: 6488063 Time: 0.512192 [07/07/2021-20:01:42] [V] [TRT] Tactic: 6881279 Time: 0.646136 [07/07/2021-20:01:42] [V] [TRT] Tactic: 7274495 Time: 0.447364 [07/07/2021-20:01:42] [V] [TRT] Tactic: 7864319 Time: 0.558972 [07/07/2021-20:01:42] [V] [TRT] Tactic: 7995391 Time: 0.630324 [07/07/2021-20:01:42] [V] [TRT] Tactic: 8585215 Time: 0.67036 [07/07/2021-20:01:42] [V] [TRT] Tactic: 8847359 Time: 0.428672 [07/07/2021-20:01:42] [V] [TRT] Tactic: 8978431 Time: 0.762956 [07/07/2021-20:01:42] [V] [TRT] Tactic: 9043967 Time: 0.488812 [07/07/2021-20:01:42] [V] [TRT] Tactic: 9175039 Time: 0.525944 [07/07/2021-20:01:42] [V] [TRT] Tactic: 9502719 Time: 0.79936 [07/07/2021-20:01:42] [V] [TRT] Tactic: 9830399 Time: 0.4138 [07/07/2021-20:01:42] [V] [TRT] Tactic: 9961471 Time: 0.66098 [07/07/2021-20:01:42] [V] [TRT] Tactic: 10027007 Time: 0.468596 [07/07/2021-20:01:43] [V] [TRT] Tactic: 10092543 Time: 0.793136 [07/07/2021-20:01:43] [V] [TRT] Tactic: 10289151 Time: 0.960832 [07/07/2021-20:01:43] [V] [TRT] Tactic: 10485759 Time: 0.472392 [07/07/2021-20:01:43] [V] [TRT] Tactic: 10682367 Time: 0.511856 [07/07/2021-20:01:43] [V] [TRT] Tactic: 10813439 Time: 0.556544 [07/07/2021-20:01:43] [V] [TRT] Fastest Tactic: 9830399 Time: 0.4138 [07/07/2021-20:01:43] [V] [TRT] --------------- Timing Runner: node_of_215 (CudnnConvolution) [07/07/2021-20:01:43] [V] [TRT] Tactic: 0 Time: 0.752828 [07/07/2021-20:01:43] [V] [TRT] Tactic: 1 Time: 0.558076 [07/07/2021-20:01:43] [V] [TRT] Tactic: 2 Time: 0.601608 [07/07/2021-20:01:43] [V] [TRT] Tactic: 4 skipped. Scratch requested: 615776256, available: 16777216 [07/07/2021-20:01:43] [V] [TRT] Tactic: 5 skipped. Scratch requested: 1149763584, available: 16777216 [07/07/2021-20:01:43] [V] [TRT] Tactic: 6 skipped. Scratch requested: 26218496, available: 16777216 [07/07/2021-20:01:43] [V] [TRT] Fastest Tactic: 1 Time: 0.558076 [07/07/2021-20:01:43] [V] [TRT] --------------- Timing Runner: node_of_215 (CaskConvolution) [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [07/07/2021-20:01:43] [V] [TRT] Tactic: 1062367460111450758 Time: 0.6026 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [07/07/2021-20:01:43] [V] [TRT] Tactic: 1754984623894446479 Time: 0.586496 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [07/07/2021-20:01:43] [V] [TRT] Tactic: 3611739942397549984 Time: 0.48696 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [07/07/2021-20:01:43] [V] [TRT] Tactic: 3827454225649558724 Time: 0.258884 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [07/07/2021-20:01:43] [V] [TRT] Tactic: 4337000649858996379 Time: 0.5171 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [07/07/2021-20:01:43] [V] [TRT] Tactic: 4501471010995462441 Time: 0.485216 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:01:43] [V] [TRT] Tactic: 5137655947464784826 Time: 0.440636 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [07/07/2021-20:01:43] [V] [TRT] Tactic: 5288347012147084929 Time: 0.455132 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [07/07/2021-20:01:43] [V] [TRT] Tactic: 5921334924264294896 Time: 0.274948 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [07/07/2021-20:01:43] [V] [TRT] Tactic: 6645123197870846056 Time: 0.495836 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [07/07/2021-20:01:43] [V] [TRT] Tactic: 7144526460361122478 Time: 0.523392 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [07/07/2021-20:01:43] [V] [TRT] Tactic: 7852627285308570038 Time: 0.277232 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [07/07/2021-20:01:43] [V] [TRT] Tactic: -9137461792520977713 Time: 0.5233 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [07/07/2021-20:01:43] [V] [TRT] Tactic: -8776506421218919509 Time: 0.258584 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [07/07/2021-20:01:43] [V] [TRT] Tactic: -8262349710178828730 Time: 0.460004 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [07/07/2021-20:01:43] [V] [TRT] Tactic: -8133971918129952780 Time: 0.60504 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [07/07/2021-20:01:43] [V] [TRT] Tactic: -6092040395344634144 Time: 0.631084 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [07/07/2021-20:01:43] [V] [TRT] Tactic: -4787320710726427159 Time: 0.586124 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:01:43] [V] [TRT] Tactic: -3456450830548107839 Time: 0.479276 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [07/07/2021-20:01:43] [V] [TRT] Tactic: -2318106587342035239 Time: 0.263492 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [07/07/2021-20:01:43] [V] [TRT] Tactic: -1343271414618805657 Time: 0.255552 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [07/07/2021-20:01:43] [V] [TRT] Tactic: -1218658103698133241 Time: 0.577276 [07/07/2021-20:01:43] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [07/07/2021-20:01:44] [V] [TRT] Tactic: -836875257600482091 Time: 0.652544 [07/07/2021-20:01:44] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:01:44] [V] [TRT] Tactic: -410470605513481746 Time: 0.469836 [07/07/2021-20:01:44] [V] [TRT] Fastest Tactic: -1343271414618805657 Time: 0.255552 [07/07/2021-20:01:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1343271414618805657 [07/07/2021-20:01:44] [V] [TRT] *************** Autotuning format combination: Float(86528,1,6656,512) -> Float(86528,1,6656,512) *************** [07/07/2021-20:01:44] [V] [TRT] --------------- Timing Runner: node_of_215 (CudnnConvolution) [07/07/2021-20:01:44] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:44] [V] [TRT] --------------- Timing Runner: node_of_215 (CaskConvolution) [07/07/2021-20:01:44] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [07/07/2021-20:01:44] [V] [TRT] Tactic: -9153228964338181824 Time: 0.347648 [07/07/2021-20:01:44] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [07/07/2021-20:01:44] [V] [TRT] Tactic: -7394439838318485025 Time: 0.341504 [07/07/2021-20:01:44] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.341504 [07/07/2021-20:01:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [07/07/2021-20:01:44] [V] [TRT] *************** Autotuning format combination: Half(86528,169,13,1) -> Half(86528,169,13,1) *************** [07/07/2021-20:01:44] [V] [TRT] --------------- Timing Runner: node_of_215 (CudnnConvolution) [07/07/2021-20:01:44] [V] [TRT] Tactic: 0 Time: 0.661876 [07/07/2021-20:01:44] [V] [TRT] Tactic: 1 Time: 0.664176 [07/07/2021-20:01:44] [V] [TRT] Tactic: 2 Time: 0.620828 [07/07/2021-20:01:44] [V] [TRT] Tactic: 4 skipped. Scratch requested: 615776256, available: 16777216 [07/07/2021-20:01:44] [V] [TRT] Tactic: 5 skipped. Scratch requested: 1149763584, available: 16777216 [07/07/2021-20:01:44] [V] [TRT] Tactic: 6 skipped. Scratch requested: 37040640, available: 16777216 [07/07/2021-20:01:44] [V] [TRT] Fastest Tactic: 2 Time: 0.620828 [07/07/2021-20:01:44] [V] [TRT] --------------- Timing Runner: node_of_215 (CaskConvolution) [07/07/2021-20:01:44] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:44] [V] [TRT] Setting workspace to 37040640enables more tactics for profiling [07/07/2021-20:01:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 2 [07/07/2021-20:01:44] [V] [TRT] --------------- Timing Runner: reformat: Float(86528,169,13,1) -> Float(2704,169:32,13,1) (Reformat) [07/07/2021-20:01:44] [V] [TRT] Tactic: 0 Time: 0.016444 [07/07/2021-20:01:44] [V] [TRT] Fastest Tactic: 0 Time: 0.016444 [07/07/2021-20:01:44] [V] [TRT] --------------- Timing Runner: reformat: Float(86528,1,6656,512) -> Float(2704,169:32,13,1) (Reformat) [07/07/2021-20:01:44] [V] [TRT] Tactic: 0 Time: 0.021472 [07/07/2021-20:01:44] [V] [TRT] Fastest Tactic: 0 Time: 0.021472 [07/07/2021-20:01:44] [V] [TRT] --------------- Timing Runner: reformat: Float(2704,169:32,13,1) -> Float(86528,169,13,1) (Reformat) [07/07/2021-20:01:44] [V] [TRT] Tactic: 0 Time: 0.011888 [07/07/2021-20:01:44] [V] [TRT] Fastest Tactic: 0 Time: 0.011888 [07/07/2021-20:01:44] [V] [TRT] --------------- Timing Runner: reformat: Float(2704,169:32,13,1) -> Float(86528,1,6656,512) (Reformat) [07/07/2021-20:01:44] [V] [TRT] Tactic: 0 Time: 0.012532 [07/07/2021-20:01:44] [V] [TRT] Fastest Tactic: 0 Time: 0.012532 [07/07/2021-20:01:44] [V] [TRT] --------------- Timing Runner: reformat: Float(2704,169:32,13,1) -> Half(86528,169,13,1) (Reformat) [07/07/2021-20:01:44] [V] [TRT] Tactic: 0 Time: 0.0117 [07/07/2021-20:01:44] [V] [TRT] Fastest Tactic: 0 Time: 0.0117 [07/07/2021-20:01:44] [V] [TRT] --------------- Timing Runner: reformat: Half(86528,169,13,1) -> Float(2704,169:32,13,1) (Reformat) [07/07/2021-20:01:44] [V] [TRT] Tactic: 0 Time: 0.016572 [07/07/2021-20:01:44] [V] [TRT] Fastest Tactic: 0 Time: 0.016572 [07/07/2021-20:01:44] [V] [TRT] *************** Autotuning format combination: Float(86528,169,13,1) -> Float(86528,169,13,1) *************** [07/07/2021-20:01:44] [V] [TRT] --------------- Timing Runner: node_of_217 (PointWiseV2) [07/07/2021-20:01:44] [V] [TRT] Tactic: 0 Time: 0.00716 [07/07/2021-20:01:44] [V] [TRT] Tactic: 1 Time: 0.005604 [07/07/2021-20:01:44] [V] [TRT] Tactic: 2 Time: 0.005308 [07/07/2021-20:01:44] [V] [TRT] Tactic: 3 Time: 0.004616 [07/07/2021-20:01:44] [V] [TRT] Tactic: 4 Time: 0.00434 [07/07/2021-20:01:44] [V] [TRT] Tactic: 5 Time: 0.004216 [07/07/2021-20:01:44] [V] [TRT] Tactic: 6 Time: 0.004276 [07/07/2021-20:01:44] [V] [TRT] Tactic: 7 Time: 0.004084 [07/07/2021-20:01:44] [V] [TRT] Tactic: 8 Time: 0.004064 [07/07/2021-20:01:44] [V] [TRT] Tactic: 9 Time: 0.004096 [07/07/2021-20:01:44] [V] [TRT] Tactic: 28 Time: 0.006768 [07/07/2021-20:01:44] [V] [TRT] Fastest Tactic: 8 Time: 0.004064 [07/07/2021-20:01:44] [V] [TRT] --------------- Timing Runner: node_of_217 (PointWise) [07/07/2021-20:01:44] [V] [TRT] Tactic: 128 Time: 0.012464 [07/07/2021-20:01:44] [V] [TRT] Tactic: 256 Time: 0.012288 [07/07/2021-20:01:44] [V] [TRT] Tactic: 512 Time: 0.012288 [07/07/2021-20:01:44] [V] [TRT] Fastest Tactic: 256 Time: 0.012288 [07/07/2021-20:01:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [07/07/2021-20:01:44] [V] [TRT] *************** Autotuning format combination: Float(86528,1,6656,512) -> Float(86528,1,6656,512) *************** [07/07/2021-20:01:44] [V] [TRT] --------------- Timing Runner: node_of_217 (PointWiseV2) [07/07/2021-20:01:44] [V] [TRT] Tactic: 0 Time: 0.007048 [07/07/2021-20:01:44] [V] [TRT] Tactic: 1 Time: 0.005504 [07/07/2021-20:01:44] [V] [TRT] Tactic: 2 Time: 0.005316 [07/07/2021-20:01:44] [V] [TRT] Tactic: 3 Time: 0.005068 [07/07/2021-20:01:44] [V] [TRT] Tactic: 4 Time: 0.004312 [07/07/2021-20:01:44] [V] [TRT] Tactic: 5 Time: 0.004224 [07/07/2021-20:01:44] [V] [TRT] Tactic: 6 Time: 0.004096 [07/07/2021-20:01:44] [V] [TRT] Tactic: 7 Time: 0.004284 [07/07/2021-20:01:44] [V] [TRT] Tactic: 8 Time: 0.004028 [07/07/2021-20:01:44] [V] [TRT] Tactic: 9 Time: 0.004152 [07/07/2021-20:01:44] [V] [TRT] Tactic: 28 Time: 0.006472 [07/07/2021-20:01:44] [V] [TRT] Fastest Tactic: 8 Time: 0.004028 [07/07/2021-20:01:44] [V] [TRT] --------------- Timing Runner: node_of_217 (PointWise) [07/07/2021-20:01:44] [V] [TRT] Tactic: 128 Time: 0.012276 [07/07/2021-20:01:44] [V] [TRT] Tactic: 256 Time: 0.012288 [07/07/2021-20:01:44] [V] [TRT] Tactic: 512 Time: 0.012412 [07/07/2021-20:01:44] [V] [TRT] Fastest Tactic: 128 Time: 0.012276 [07/07/2021-20:01:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [07/07/2021-20:01:44] [V] [TRT] *************** Autotuning format combination: Float(2704,169:32,13,1) -> Float(2704,169:32,13,1) *************** [07/07/2021-20:01:44] [V] [TRT] --------------- Timing Runner: node_of_217 (PointWiseV2) [07/07/2021-20:01:44] [V] [TRT] Tactic: 24 Time: 0.004096 [07/07/2021-20:01:44] [V] [TRT] Tactic: 25 Time: 0.00416 [07/07/2021-20:01:44] [V] [TRT] Tactic: 26 Time: 0.00404 [07/07/2021-20:01:44] [V] [TRT] Tactic: 27 Time: 0.004084 [07/07/2021-20:01:44] [V] [TRT] Tactic: 31 Time: 0.004096 [07/07/2021-20:01:44] [V] [TRT] Fastest Tactic: 26 Time: 0.00404 [07/07/2021-20:01:44] [V] [TRT] --------------- Timing Runner: node_of_217 (PointWise) [07/07/2021-20:01:44] [V] [TRT] Tactic: 128 Time: 0.012256 [07/07/2021-20:01:44] [V] [TRT] Tactic: 256 Time: 0.012576 [07/07/2021-20:01:44] [V] [TRT] Tactic: 512 Time: 0.012656 [07/07/2021-20:01:44] [V] [TRT] Fastest Tactic: 128 Time: 0.012256 [07/07/2021-20:01:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [07/07/2021-20:01:44] [V] [TRT] *************** Autotuning format combination: Half(86528,169,13,1) -> Half(86528,169,13,1) *************** [07/07/2021-20:01:44] [V] [TRT] --------------- Timing Runner: node_of_217 (PointWiseV2) [07/07/2021-20:01:44] [V] [TRT] Tactic: 0 Time: 0.007204 [07/07/2021-20:01:44] [V] [TRT] Tactic: 1 Time: 0.005896 [07/07/2021-20:01:44] [V] [TRT] Tactic: 2 Time: 0.005308 [07/07/2021-20:01:44] [V] [TRT] Tactic: 3 Time: 0.00512 [07/07/2021-20:01:44] [V] [TRT] Tactic: 4 Time: 0.004688 [07/07/2021-20:01:44] [V] [TRT] Tactic: 5 Time: 0.004572 [07/07/2021-20:01:44] [V] [TRT] Tactic: 6 Time: 0.004824 [07/07/2021-20:01:44] [V] [TRT] Tactic: 7 Time: 0.003996 [07/07/2021-20:01:44] [V] [TRT] Tactic: 8 Time: 0.004524 [07/07/2021-20:01:44] [V] [TRT] Tactic: 9 Time: 0.004224 [07/07/2021-20:01:44] [V] [TRT] Tactic: 28 Time: 0.007096 [07/07/2021-20:01:44] [V] [TRT] Fastest Tactic: 7 Time: 0.003996 [07/07/2021-20:01:44] [V] [TRT] --------------- Timing Runner: node_of_217 (PointWise) [07/07/2021-20:01:44] [V] [TRT] Tactic: 128 Time: 0.011764 [07/07/2021-20:01:44] [V] [TRT] Tactic: 256 Time: 0.012032 [07/07/2021-20:01:44] [V] [TRT] Tactic: 512 Time: 0.012136 [07/07/2021-20:01:44] [V] [TRT] Fastest Tactic: 128 Time: 0.011764 [07/07/2021-20:01:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [07/07/2021-20:01:44] [V] [TRT] *************** Autotuning format combination: Float(86528,169,13,1) -> Float(43264,169,13,1) *************** [07/07/2021-20:01:44] [V] [TRT] --------------- Timing Runner: node_of_218 (CudaDepthwiseConvolution) [07/07/2021-20:01:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:44] [V] [TRT] --------------- Timing Runner: node_of_218 (FusedConvActConvolution) [07/07/2021-20:01:44] [V] [TRT] Tactic: 589823 Time: 0.278772 [07/07/2021-20:01:44] [V] [TRT] Tactic: 655359 Time: 0.145152 [07/07/2021-20:01:44] [V] [TRT] Tactic: 786431 Time: 0.066816 [07/07/2021-20:01:44] [V] [TRT] Tactic: 851967 Time: 0.057564 [07/07/2021-20:01:44] [V] [TRT] Tactic: 1179647 Time: 0.052696 [07/07/2021-20:01:44] [V] [TRT] Tactic: 1310719 Time: 0.127716 [07/07/2021-20:01:44] [V] [TRT] Tactic: 1376255 Time: 0.159072 [07/07/2021-20:01:44] [V] [TRT] Tactic: 1441791 Time: 0.076648 [07/07/2021-20:01:44] [V] [TRT] Tactic: 1507327 Time: 0.082816 [07/07/2021-20:01:44] [V] [TRT] Tactic: 1638399 Time: 0.093068 [07/07/2021-20:01:45] [V] [TRT] Tactic: 1835007 Time: 0.065012 [07/07/2021-20:01:45] [V] [TRT] Tactic: 1900543 Time: 0.145688 [07/07/2021-20:01:45] [V] [TRT] Tactic: 2097151 Time: 0.067812 [07/07/2021-20:01:45] [V] [TRT] Tactic: 2162687 Time: 0.157736 [07/07/2021-20:01:45] [V] [TRT] Tactic: 2293759 Time: 0.131132 [07/07/2021-20:01:45] [V] [TRT] Tactic: 2359295 Time: 0.084168 [07/07/2021-20:01:45] [V] [TRT] Tactic: 2686975 Time: 0.142976 [07/07/2021-20:01:45] [V] [TRT] Tactic: 3080191 Time: 0.073648 [07/07/2021-20:01:45] [V] [TRT] Tactic: 3342335 Time: 0.07734 [07/07/2021-20:01:45] [V] [TRT] Tactic: 3407871 Time: 0.07878 [07/07/2021-20:01:45] [V] [TRT] Tactic: 3538943 Time: 0.052864 [07/07/2021-20:01:45] [V] [TRT] Tactic: 3670015 Time: 0.2652 [07/07/2021-20:01:45] [V] [TRT] Tactic: 3932159 Time: 0.1239 [07/07/2021-20:01:45] [V] [TRT] Tactic: 3997695 Time: 0.054804 [07/07/2021-20:01:45] [V] [TRT] Tactic: 4063231 Time: 0.055292 [07/07/2021-20:01:45] [V] [TRT] Tactic: 4194303 Time: 0.069248 [07/07/2021-20:01:45] [V] [TRT] Tactic: 4259839 Time: 0.073216 [07/07/2021-20:01:45] [V] [TRT] Tactic: 4325375 Time: 0.073912 [07/07/2021-20:01:45] [V] [TRT] Tactic: 4521983 Time: 0.151044 [07/07/2021-20:01:45] [V] [TRT] Tactic: 4587519 Time: 0.06592 [07/07/2021-20:01:45] [V] [TRT] Tactic: 4653055 Time: 0.055824 [07/07/2021-20:01:45] [V] [TRT] Tactic: 4915199 Time: 0.061316 [07/07/2021-20:01:45] [V] [TRT] Tactic: 4980735 Time: 0.105464 [07/07/2021-20:01:45] [V] [TRT] Tactic: 5177343 Time: 0.057212 [07/07/2021-20:01:45] [V] [TRT] Tactic: 5242879 Time: 0.074876 [07/07/2021-20:01:45] [V] [TRT] Tactic: 5373951 Time: 0.053824 [07/07/2021-20:01:45] [V] [TRT] Tactic: 5439487 Time: 0.062712 [07/07/2021-20:01:45] [V] [TRT] Tactic: 5570559 Time: 0.075704 [07/07/2021-20:01:45] [V] [TRT] Tactic: 5636095 Time: 0.055232 [07/07/2021-20:01:45] [V] [TRT] Tactic: 5701631 Time: 0.133376 [07/07/2021-20:01:45] [V] [TRT] Tactic: 5767167 Time: 0.081272 [07/07/2021-20:01:45] [V] [TRT] Tactic: 5832703 Time: 0.076476 [07/07/2021-20:01:45] [V] [TRT] Tactic: 5898239 Time: 0.049148 [07/07/2021-20:01:45] [V] [TRT] Tactic: 6029311 Time: 0.126524 [07/07/2021-20:01:45] [V] [TRT] Tactic: 6225919 Time: 0.048768 [07/07/2021-20:01:45] [V] [TRT] Tactic: 6291455 Time: 0.051456 [07/07/2021-20:01:45] [V] [TRT] Tactic: 6422527 Time: 0.069968 [07/07/2021-20:01:45] [V] [TRT] Tactic: 6750207 Time: 0.049788 [07/07/2021-20:01:45] [V] [TRT] Tactic: 6815743 Time: 0.07584 [07/07/2021-20:01:45] [V] [TRT] Tactic: 6946815 Time: 0.060284 [07/07/2021-20:01:45] [V] [TRT] Tactic: 7012351 Time: 0.068556 [07/07/2021-20:01:45] [V] [TRT] Tactic: 7077887 Time: 0.053012 [07/07/2021-20:01:45] [V] [TRT] Tactic: 7143423 Time: 0.084928 [07/07/2021-20:01:45] [V] [TRT] Tactic: 7208959 Time: 0.081664 [07/07/2021-20:01:45] [V] [TRT] Tactic: 7340031 Time: 0.049536 [07/07/2021-20:01:45] [V] [TRT] Tactic: 7405567 Time: 0.049472 [07/07/2021-20:01:45] [V] [TRT] Tactic: 7536639 Time: 0.116028 [07/07/2021-20:01:45] [V] [TRT] Tactic: 7602175 Time: 0.058816 [07/07/2021-20:01:45] [V] [TRT] Tactic: 7733247 Time: 0.0576 [07/07/2021-20:01:45] [V] [TRT] Tactic: 7798783 Time: 0.06496 [07/07/2021-20:01:45] [V] [TRT] Tactic: 8191999 Time: 0.068736 [07/07/2021-20:01:45] [V] [TRT] Tactic: 8257535 Time: 0.060992 [07/07/2021-20:01:45] [V] [TRT] Tactic: 8323071 Time: 0.061692 [07/07/2021-20:01:45] [V] [TRT] Tactic: 8650751 Time: 0.06848 [07/07/2021-20:01:45] [V] [TRT] Tactic: 8716287 Time: 0.050812 [07/07/2021-20:01:45] [V] [TRT] Tactic: 9109503 Time: 0.067888 [07/07/2021-20:01:45] [V] [TRT] Tactic: 9568255 Time: 0.061184 [07/07/2021-20:01:45] [V] [TRT] Tactic: 9895935 Time: 0.06918 [07/07/2021-20:01:45] [V] [TRT] Tactic: 10223615 Time: 0.134128 [07/07/2021-20:01:45] [V] [TRT] Tactic: 10354687 Time: 0.07506 [07/07/2021-20:01:45] [V] [TRT] Tactic: 10551295 Time: 0.092632 [07/07/2021-20:01:45] [V] [TRT] Tactic: 10747903 Time: 0.058356 [07/07/2021-20:01:45] [V] [TRT] Tactic: 10944511 Time: 0.106632 [07/07/2021-20:01:45] [V] [TRT] Fastest Tactic: 6225919 Time: 0.048768 [07/07/2021-20:01:45] [V] [TRT] --------------- Timing Runner: node_of_218 (CudnnConvolution) [07/07/2021-20:01:45] [V] [TRT] Tactic: 0 Time: 0.054352 [07/07/2021-20:01:45] [V] [TRT] Tactic: 1 Time: 0.044532 [07/07/2021-20:01:45] [V] [TRT] Tactic: 2 Time: 0.150064 [07/07/2021-20:01:45] [V] [TRT] Tactic: 4 skipped. Scratch requested: 304873472, available: 16777216 [07/07/2021-20:01:45] [V] [TRT] Tactic: 5 skipped. Scratch requested: 20541440, available: 16777216 [07/07/2021-20:01:45] [V] [TRT] Fastest Tactic: 1 Time: 0.044532 [07/07/2021-20:01:45] [V] [TRT] --------------- Timing Runner: node_of_218 (CublasConvolution) [07/07/2021-20:01:45] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:45] [V] [TRT] --------------- Timing Runner: node_of_218 (CaskConvolution) [07/07/2021-20:01:45] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [07/07/2021-20:01:45] [V] [TRT] Tactic: 1062367460111450758 Time: 0.04902 [07/07/2021-20:01:45] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [07/07/2021-20:01:45] [V] [TRT] Tactic: 1698681053543049347 Time: 0.045564 [07/07/2021-20:01:45] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [07/07/2021-20:01:45] [V] [TRT] Tactic: 4501471010995462441 Time: 0.049524 [07/07/2021-20:01:45] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:01:45] [V] [TRT] Tactic: 5137655947464784826 Time: 0.034748 [07/07/2021-20:01:45] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [07/07/2021-20:01:46] [V] [TRT] Tactic: 5288347012147084929 Time: 0.048448 [07/07/2021-20:01:46] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [07/07/2021-20:01:46] [V] [TRT] Tactic: 5326823351883942011 Time: 0.04828 [07/07/2021-20:01:46] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [07/07/2021-20:01:46] [V] [TRT] Tactic: 5500448035057547314 Time: 0.047508 [07/07/2021-20:01:46] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [07/07/2021-20:01:46] [V] [TRT] Tactic: 6645123197870846056 Time: 0.037104 [07/07/2021-20:01:46] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [07/07/2021-20:01:46] [V] [TRT] Tactic: 7144526460361122478 Time: 0.047088 [07/07/2021-20:01:46] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [07/07/2021-20:01:46] [V] [TRT] Tactic: -8262349710178828730 Time: 0.04914 [07/07/2021-20:01:46] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [07/07/2021-20:01:46] [V] [TRT] Tactic: -6576203419454146580 Time: 0.038144 [07/07/2021-20:01:46] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [07/07/2021-20:01:46] [V] [TRT] Tactic: -4787320710726427159 Time: 0.047172 [07/07/2021-20:01:46] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:01:46] [V] [TRT] Tactic: -3456450830548107839 Time: 0.0428 [07/07/2021-20:01:46] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [07/07/2021-20:01:46] [V] [TRT] Tactic: -1218658103698133241 Time: 0.05144 [07/07/2021-20:01:46] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [07/07/2021-20:01:46] [V] [TRT] Tactic: -836875257600482091 Time: 0.049384 [07/07/2021-20:01:46] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:01:46] [V] [TRT] Tactic: -410470605513481746 Time: 0.0475 [07/07/2021-20:01:46] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [07/07/2021-20:01:46] [V] [TRT] Tactic: -377491875521947884 Time: 0.048948 [07/07/2021-20:01:46] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [07/07/2021-20:01:46] [V] [TRT] Tactic: -37215280111360163 Time: 0.033736 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.033736 [07/07/2021-20:01:46] [V] [TRT] Setting workspace to 20541440enables more tactics for profiling [07/07/2021-20:01:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [07/07/2021-20:01:46] [V] [TRT] *************** Autotuning format combination: Float(86528,1,6656,512) -> Float(43264,1,3328,256) *************** [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: node_of_218 (CudnnConvolution) [07/07/2021-20:01:46] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: node_of_218 (CublasConvolution) [07/07/2021-20:01:46] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: node_of_218 (CaskConvolution) [07/07/2021-20:01:46] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [07/07/2021-20:01:46] [V] [TRT] Tactic: 3886731678879822788 Time: 0.026848 [07/07/2021-20:01:46] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [07/07/2021-20:01:46] [V] [TRT] Tactic: 6629944304117643200 Time: 0.02674 [07/07/2021-20:01:46] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [07/07/2021-20:01:46] [V] [TRT] Tactic: -9153228964338181824 Time: 0.026944 [07/07/2021-20:01:46] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [07/07/2021-20:01:46] [V] [TRT] Tactic: -7394439838318485025 Time: 0.027784 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 6629944304117643200 Time: 0.02674 [07/07/2021-20:01:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6629944304117643200 [07/07/2021-20:01:46] [V] [TRT] *************** Autotuning format combination: Half(86528,169,13,1) -> Half(43264,169,13,1) *************** [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: node_of_218 (CudnnConvolution) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.058164 [07/07/2021-20:01:46] [V] [TRT] Tactic: 1 Time: 0.053464 [07/07/2021-20:01:46] [V] [TRT] Tactic: 2 Time: 0.134288 [07/07/2021-20:01:46] [V] [TRT] Tactic: 4 skipped. Scratch requested: 304873472, available: 16777216 [07/07/2021-20:01:46] [V] [TRT] Tactic: 5 skipped. Scratch requested: 20541440, available: 16777216 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 1 Time: 0.053464 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: node_of_218 (CublasConvolution) [07/07/2021-20:01:46] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: node_of_218 (CaskConvolution) [07/07/2021-20:01:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:46] [V] [TRT] Setting workspace to 20541440enables more tactics for profiling [07/07/2021-20:01:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,169,13,1) -> Float(43264,1,3328,256) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.007296 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.007296 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,169,13,1) -> Float(1352,169:32,13,1) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.010168 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.010168 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,169,13,1) -> Half(43264,169,13,1) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.00606 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.00606 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,1,3328,256) -> Float(43264,169,13,1) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.006396 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.006396 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,1,3328,256) -> Float(1352,169:32,13,1) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.012288 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,1,3328,256) -> Half(43264,169,13,1) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.006652 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.006652 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Float(1352,169:32,13,1) -> Float(43264,169,13,1) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.007548 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.007548 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Float(1352,169:32,13,1) -> Float(43264,1,3328,256) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.007676 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.007676 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Float(1352,169:32,13,1) -> Half(43264,169,13,1) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.007672 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.007672 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Half(43264,169,13,1) -> Float(43264,169,13,1) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.005448 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.005448 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Half(43264,169,13,1) -> Float(43264,1,3328,256) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.006712 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.006712 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Half(43264,169,13,1) -> Float(1352,169:32,13,1) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.009848 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.009848 [07/07/2021-20:01:46] [V] [TRT] *************** Autotuning format combination: Float(43264,169,13,1) -> Float(43264,169,13,1) *************** [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: node_of_220 (PointWiseV2) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.00472 [07/07/2021-20:01:46] [V] [TRT] Tactic: 1 Time: 0.004456 [07/07/2021-20:01:46] [V] [TRT] Tactic: 2 Time: 0.004352 [07/07/2021-20:01:46] [V] [TRT] Tactic: 3 Time: 0.003712 [07/07/2021-20:01:46] [V] [TRT] Tactic: 4 Time: 0.003752 [07/07/2021-20:01:46] [V] [TRT] Tactic: 5 Time: 0.003488 [07/07/2021-20:01:46] [V] [TRT] Tactic: 6 Time: 0.00442 [07/07/2021-20:01:46] [V] [TRT] Tactic: 7 Time: 0.003468 [07/07/2021-20:01:46] [V] [TRT] Tactic: 8 Time: 0.00334 [07/07/2021-20:01:46] [V] [TRT] Tactic: 9 Time: 0.003444 [07/07/2021-20:01:46] [V] [TRT] Tactic: 28 Time: 0.004468 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 8 Time: 0.00334 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: node_of_220 (PointWise) [07/07/2021-20:01:46] [V] [TRT] Tactic: 128 Time: 0.007592 [07/07/2021-20:01:46] [V] [TRT] Tactic: 256 Time: 0.0076 [07/07/2021-20:01:46] [V] [TRT] Tactic: 512 Time: 0.008024 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 128 Time: 0.007592 [07/07/2021-20:01:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [07/07/2021-20:01:46] [V] [TRT] *************** Autotuning format combination: Float(43264,1,3328,256) -> Float(43264,1,3328,256) *************** [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: node_of_220 (PointWiseV2) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.004672 [07/07/2021-20:01:46] [V] [TRT] Tactic: 1 Time: 0.00434 [07/07/2021-20:01:46] [V] [TRT] Tactic: 2 Time: 0.004044 [07/07/2021-20:01:46] [V] [TRT] Tactic: 3 Time: 0.003664 [07/07/2021-20:01:46] [V] [TRT] Tactic: 4 Time: 0.003568 [07/07/2021-20:01:46] [V] [TRT] Tactic: 5 Time: 0.003468 [07/07/2021-20:01:46] [V] [TRT] Tactic: 6 Time: 0.004072 [07/07/2021-20:01:46] [V] [TRT] Tactic: 7 Time: 0.0035 [07/07/2021-20:01:46] [V] [TRT] Tactic: 8 Time: 0.003436 [07/07/2021-20:01:46] [V] [TRT] Tactic: 9 Time: 0.003516 [07/07/2021-20:01:46] [V] [TRT] Tactic: 28 Time: 0.00464 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 8 Time: 0.003436 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: node_of_220 (PointWise) [07/07/2021-20:01:46] [V] [TRT] Tactic: 128 Time: 0.008332 [07/07/2021-20:01:46] [V] [TRT] Tactic: 256 Time: 0.007544 [07/07/2021-20:01:46] [V] [TRT] Tactic: 512 Time: 0.00774 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 256 Time: 0.007544 [07/07/2021-20:01:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [07/07/2021-20:01:46] [V] [TRT] *************** Autotuning format combination: Float(1352,169:32,13,1) -> Float(1352,169:32,13,1) *************** [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: node_of_220 (PointWiseV2) [07/07/2021-20:01:46] [V] [TRT] Tactic: 24 Time: 0.003444 [07/07/2021-20:01:46] [V] [TRT] Tactic: 25 Time: 0.003452 [07/07/2021-20:01:46] [V] [TRT] Tactic: 26 Time: 0.003472 [07/07/2021-20:01:46] [V] [TRT] Tactic: 27 Time: 0.004464 [07/07/2021-20:01:46] [V] [TRT] Tactic: 31 Time: 0.00344 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 31 Time: 0.00344 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: node_of_220 (PointWise) [07/07/2021-20:01:46] [V] [TRT] Tactic: 128 Time: 0.007536 [07/07/2021-20:01:46] [V] [TRT] Tactic: 256 Time: 0.008772 [07/07/2021-20:01:46] [V] [TRT] Tactic: 512 Time: 0.007736 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 128 Time: 0.007536 [07/07/2021-20:01:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [07/07/2021-20:01:46] [V] [TRT] *************** Autotuning format combination: Half(43264,169,13,1) -> Half(43264,169,13,1) *************** [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: node_of_220 (PointWiseV2) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.004592 [07/07/2021-20:01:46] [V] [TRT] Tactic: 1 Time: 0.004224 [07/07/2021-20:01:46] [V] [TRT] Tactic: 2 Time: 0.00426 [07/07/2021-20:01:46] [V] [TRT] Tactic: 3 Time: 0.00344 [07/07/2021-20:01:46] [V] [TRT] Tactic: 4 Time: 0.003584 [07/07/2021-20:01:46] [V] [TRT] Tactic: 5 Time: 0.003628 [07/07/2021-20:01:46] [V] [TRT] Tactic: 6 Time: 0.00414 [07/07/2021-20:01:46] [V] [TRT] Tactic: 7 Time: 0.003836 [07/07/2021-20:01:46] [V] [TRT] Tactic: 8 Time: 0.003376 [07/07/2021-20:01:46] [V] [TRT] Tactic: 9 Time: 0.00326 [07/07/2021-20:01:46] [V] [TRT] Tactic: 28 Time: 0.004536 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 9 Time: 0.00326 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: node_of_220 (PointWise) [07/07/2021-20:01:46] [V] [TRT] Tactic: 128 Time: 0.007616 [07/07/2021-20:01:46] [V] [TRT] Tactic: 256 Time: 0.007408 [07/07/2021-20:01:46] [V] [TRT] Tactic: 512 Time: 0.007288 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 512 Time: 0.007288 [07/07/2021-20:01:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,169,13,1) -> Float(43264,1,3328,256) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.006508 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.006508 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,169,13,1) -> Float(1352,169:32,13,1) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.009716 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.009716 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,169,13,1) -> Half(43264,169,13,1) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.00588 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.00588 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,1,3328,256) -> Float(43264,169,13,1) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.006392 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.006392 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,1,3328,256) -> Float(1352,169:32,13,1) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.011904 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.011904 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,1,3328,256) -> Half(43264,169,13,1) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.00672 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.00672 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Float(1352,169:32,13,1) -> Float(43264,169,13,1) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.007256 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.007256 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Float(1352,169:32,13,1) -> Float(43264,1,3328,256) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.00748 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.00748 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Float(1352,169:32,13,1) -> Half(43264,169,13,1) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.007464 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.007464 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Half(43264,169,13,1) -> Float(43264,169,13,1) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.005528 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.005528 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Half(43264,169,13,1) -> Float(43264,1,3328,256) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.006692 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.006692 [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: reformat: Half(43264,169,13,1) -> Float(1352,169:32,13,1) (Reformat) [07/07/2021-20:01:46] [V] [TRT] Tactic: 0 Time: 0.009892 [07/07/2021-20:01:46] [V] [TRT] Fastest Tactic: 0 Time: 0.009892 [07/07/2021-20:01:46] [V] [TRT] *************** Autotuning format combination: Float(43264,169,13,1) -> Float(86528,169,13,1) *************** [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: node_of_221 (CudaDepthwiseConvolution) [07/07/2021-20:01:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:46] [V] [TRT] --------------- Timing Runner: node_of_221 (FusedConvActConvolution) [07/07/2021-20:01:46] [V] [TRT] Tactic: 524287 Time: 0.346168 [07/07/2021-20:01:46] [V] [TRT] Tactic: 720895 Time: 0.299768 [07/07/2021-20:01:47] [V] [TRT] Tactic: 983039 Time: 0.24552 [07/07/2021-20:01:47] [V] [TRT] Tactic: 1048575 Time: 0.289008 [07/07/2021-20:01:47] [V] [TRT] Tactic: 1703935 Time: 0.259584 [07/07/2021-20:01:47] [V] [TRT] Tactic: 1769471 Time: 0.235388 [07/07/2021-20:01:47] [V] [TRT] Tactic: 1966079 Time: 0.483328 [07/07/2021-20:01:47] [V] [TRT] Tactic: 2031615 Time: 0.338692 [07/07/2021-20:01:47] [V] [TRT] Tactic: 2228223 Time: 0.49158 [07/07/2021-20:01:47] [V] [TRT] Tactic: 2424831 Time: 0.446 [07/07/2021-20:01:47] [V] [TRT] Tactic: 2621439 Time: 0.271472 [07/07/2021-20:01:47] [V] [TRT] Tactic: 2752511 Time: 0.255548 [07/07/2021-20:01:47] [V] [TRT] Tactic: 2818047 Time: 0.35398 [07/07/2021-20:01:47] [V] [TRT] Tactic: 2883583 Time: 0.516016 [07/07/2021-20:01:47] [V] [TRT] Tactic: 3014655 Time: 0.266476 [07/07/2021-20:01:47] [V] [TRT] Tactic: 3145727 Time: 0.246636 [07/07/2021-20:01:47] [V] [TRT] Tactic: 3473407 Time: 0.312448 [07/07/2021-20:01:47] [V] [TRT] Tactic: 3604479 Time: 0.25982 [07/07/2021-20:01:47] [V] [TRT] Tactic: 3735551 Time: 0.243448 [07/07/2021-20:01:47] [V] [TRT] Tactic: 4390911 Time: 0.403072 [07/07/2021-20:01:47] [V] [TRT] Tactic: 5046271 Time: 0.257644 [07/07/2021-20:01:47] [V] [TRT] Tactic: 5963775 Time: 0.378368 [07/07/2021-20:01:47] [V] [TRT] Tactic: 6160383 Time: 0.328608 [07/07/2021-20:01:48] [V] [TRT] Tactic: 6488063 Time: 0.264764 [07/07/2021-20:01:48] [V] [TRT] Tactic: 6881279 Time: 0.332028 [07/07/2021-20:01:48] [V] [TRT] Tactic: 7274495 Time: 0.233732 [07/07/2021-20:01:48] [V] [TRT] Tactic: 7864319 Time: 0.284216 [07/07/2021-20:01:48] [V] [TRT] Tactic: 7995391 Time: 0.324464 [07/07/2021-20:01:48] [V] [TRT] Tactic: 8585215 Time: 0.34802 [07/07/2021-20:01:48] [V] [TRT] Tactic: 8847359 Time: 0.22336 [07/07/2021-20:01:48] [V] [TRT] Tactic: 8978431 Time: 0.385272 [07/07/2021-20:01:48] [V] [TRT] Tactic: 9043967 Time: 0.239596 [07/07/2021-20:01:48] [V] [TRT] Tactic: 9175039 Time: 0.256704 [07/07/2021-20:01:48] [V] [TRT] Tactic: 9502719 Time: 0.4083 [07/07/2021-20:01:48] [V] [TRT] Tactic: 9830399 Time: 0.21888 [07/07/2021-20:01:48] [V] [TRT] Tactic: 9961471 Time: 0.341116 [07/07/2021-20:01:48] [V] [TRT] Tactic: 10027007 Time: 0.253564 [07/07/2021-20:01:48] [V] [TRT] Tactic: 10092543 Time: 0.402804 [07/07/2021-20:01:48] [V] [TRT] Tactic: 10289151 Time: 0.480244 [07/07/2021-20:01:48] [V] [TRT] Tactic: 10485759 Time: 0.2353 [07/07/2021-20:01:48] [V] [TRT] Tactic: 10682367 Time: 0.26246 [07/07/2021-20:01:48] [V] [TRT] Tactic: 10813439 Time: 0.274044 [07/07/2021-20:01:48] [V] [TRT] Fastest Tactic: 9830399 Time: 0.21888 [07/07/2021-20:01:48] [V] [TRT] --------------- Timing Runner: node_of_221 (CudnnConvolution) [07/07/2021-20:01:48] [V] [TRT] Tactic: 0 Time: 0.385544 [07/07/2021-20:01:48] [V] [TRT] Tactic: 1 Time: 0.234104 [07/07/2021-20:01:48] [V] [TRT] Tactic: 2 Time: 0.335636 [07/07/2021-20:01:48] [V] [TRT] Tactic: 4 skipped. Scratch requested: 307888128, available: 16777216 [07/07/2021-20:01:48] [V] [TRT] Tactic: 5 skipped. Scratch requested: 577110016, available: 16777216 [07/07/2021-20:01:48] [V] [TRT] Tactic: 6 Time: 0.230304 [07/07/2021-20:01:48] [V] [TRT] Fastest Tactic: 6 Time: 0.230304 [07/07/2021-20:01:48] [V] [TRT] --------------- Timing Runner: node_of_221 (CaskConvolution) [07/07/2021-20:01:48] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [07/07/2021-20:01:48] [V] [TRT] Tactic: 1062367460111450758 Time: 0.304056 [07/07/2021-20:01:48] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [07/07/2021-20:01:48] [V] [TRT] Tactic: 1754984623894446479 Time: 0.302828 [07/07/2021-20:01:48] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [07/07/2021-20:01:48] [V] [TRT] Tactic: 3611739942397549984 Time: 0.2544 [07/07/2021-20:01:48] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [07/07/2021-20:01:48] [V] [TRT] Tactic: 3827454225649558724 Time: 0.145888 [07/07/2021-20:01:48] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [07/07/2021-20:01:48] [V] [TRT] Tactic: 4337000649858996379 Time: 0.265224 [07/07/2021-20:01:48] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [07/07/2021-20:01:48] [V] [TRT] Tactic: 4501471010995462441 Time: 0.243728 [07/07/2021-20:01:48] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:01:48] [V] [TRT] Tactic: 5137655947464784826 Time: 0.223632 [07/07/2021-20:01:48] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [07/07/2021-20:01:48] [V] [TRT] Tactic: 5288347012147084929 Time: 0.231352 [07/07/2021-20:01:48] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [07/07/2021-20:01:48] [V] [TRT] Tactic: 5921334924264294896 Time: 0.152688 [07/07/2021-20:01:48] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [07/07/2021-20:01:48] [V] [TRT] Tactic: 6645123197870846056 Time: 0.253692 [07/07/2021-20:01:48] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [07/07/2021-20:01:48] [V] [TRT] Tactic: 7144526460361122478 Time: 0.266472 [07/07/2021-20:01:48] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [07/07/2021-20:01:48] [V] [TRT] Tactic: 7852627285308570038 Time: 0.149696 [07/07/2021-20:01:48] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [07/07/2021-20:01:48] [V] [TRT] Tactic: -9137461792520977713 Time: 0.260796 [07/07/2021-20:01:48] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [07/07/2021-20:01:48] [V] [TRT] Tactic: -8776506421218919509 Time: 0.135488 [07/07/2021-20:01:48] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [07/07/2021-20:01:48] [V] [TRT] Tactic: -8262349710178828730 Time: 0.23352 [07/07/2021-20:01:48] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [07/07/2021-20:01:48] [V] [TRT] Tactic: -8133971918129952780 Time: 0.304384 [07/07/2021-20:01:48] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [07/07/2021-20:01:48] [V] [TRT] Tactic: -6092040395344634144 Time: 0.320264 [07/07/2021-20:01:48] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [07/07/2021-20:01:48] [V] [TRT] Tactic: -4787320710726427159 Time: 0.3005 [07/07/2021-20:01:48] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:01:48] [V] [TRT] Tactic: -3456450830548107839 Time: 0.246772 [07/07/2021-20:01:48] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [07/07/2021-20:01:49] [V] [TRT] Tactic: -2318106587342035239 Time: 0.145728 [07/07/2021-20:01:49] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [07/07/2021-20:01:49] [V] [TRT] Tactic: -1343271414618805657 Time: 0.139824 [07/07/2021-20:01:49] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [07/07/2021-20:01:49] [V] [TRT] Tactic: -1218658103698133241 Time: 0.294216 [07/07/2021-20:01:49] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [07/07/2021-20:01:49] [V] [TRT] Tactic: -836875257600482091 Time: 0.33134 [07/07/2021-20:01:49] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:01:49] [V] [TRT] Tactic: -410470605513481746 Time: 0.235772 [07/07/2021-20:01:49] [V] [TRT] Fastest Tactic: -8776506421218919509 Time: 0.135488 [07/07/2021-20:01:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8776506421218919509 [07/07/2021-20:01:49] [V] [TRT] *************** Autotuning format combination: Float(43264,1,3328,256) -> Float(86528,1,6656,512) *************** [07/07/2021-20:01:49] [V] [TRT] --------------- Timing Runner: node_of_221 (CudnnConvolution) [07/07/2021-20:01:49] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:49] [V] [TRT] --------------- Timing Runner: node_of_221 (CaskConvolution) [07/07/2021-20:01:49] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [07/07/2021-20:01:49] [V] [TRT] Tactic: -9153228964338181824 Time: 0.183276 [07/07/2021-20:01:49] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [07/07/2021-20:01:49] [V] [TRT] Tactic: -7394439838318485025 Time: 0.174912 [07/07/2021-20:01:49] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.174912 [07/07/2021-20:01:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [07/07/2021-20:01:49] [V] [TRT] *************** Autotuning format combination: Half(43264,169,13,1) -> Half(86528,169,13,1) *************** [07/07/2021-20:01:49] [V] [TRT] --------------- Timing Runner: node_of_221 (CudnnConvolution) [07/07/2021-20:01:49] [V] [TRT] Tactic: 0 Time: 0.343984 [07/07/2021-20:01:49] [V] [TRT] Tactic: 1 Time: 0.344024 [07/07/2021-20:01:49] [V] [TRT] Tactic: 2 Time: 0.343276 [07/07/2021-20:01:49] [V] [TRT] Tactic: 4 skipped. Scratch requested: 307888128, available: 16777216 [07/07/2021-20:01:49] [V] [TRT] Tactic: 5 skipped. Scratch requested: 577110016, available: 16777216 [07/07/2021-20:01:49] [V] [TRT] Tactic: 6 skipped. Scratch requested: 18868736, available: 16777216 [07/07/2021-20:01:49] [V] [TRT] Fastest Tactic: 2 Time: 0.343276 [07/07/2021-20:01:49] [V] [TRT] --------------- Timing Runner: node_of_221 (CaskConvolution) [07/07/2021-20:01:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:49] [V] [TRT] Setting workspace to 18868736enables more tactics for profiling [07/07/2021-20:01:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 2 [07/07/2021-20:01:49] [V] [TRT] *************** Autotuning format combination: Float(86528,169,13,1) -> Float(86528,169,13,1) *************** [07/07/2021-20:01:49] [V] [TRT] *************** Autotuning format combination: Float(86528,1,6656,512) -> Float(86528,1,6656,512) *************** [07/07/2021-20:01:49] [V] [TRT] *************** Autotuning format combination: Float(2704,169:32,13,1) -> Float(2704,169:32,13,1) *************** [07/07/2021-20:01:49] [V] [TRT] *************** Autotuning format combination: Half(86528,169,13,1) -> Half(86528,169,13,1) *************** [07/07/2021-20:01:49] [V] [TRT] *************** Autotuning format combination: Float(43264,169,13,1) -> Float(21632,169,13,1) *************** [07/07/2021-20:01:49] [V] [TRT] --------------- Timing Runner: node_of_590 (CudaDepthwiseConvolution) [07/07/2021-20:01:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:49] [V] [TRT] --------------- Timing Runner: node_of_590 (FusedConvActConvolution) [07/07/2021-20:01:49] [V] [TRT] Tactic: 589823 Time: 0.117288 [07/07/2021-20:01:49] [V] [TRT] Tactic: 655359 Time: 0.072028 [07/07/2021-20:01:49] [V] [TRT] Tactic: 786431 Time: 0.034348 [07/07/2021-20:01:49] [V] [TRT] Tactic: 851967 Time: 0.027964 [07/07/2021-20:01:49] [V] [TRT] Tactic: 1179647 Time: 0.019772 [07/07/2021-20:01:49] [V] [TRT] Tactic: 1310719 Time: 0.063296 [07/07/2021-20:01:49] [V] [TRT] Tactic: 1376255 Time: 0.077708 [07/07/2021-20:01:49] [V] [TRT] Tactic: 1441791 Time: 0.029948 [07/07/2021-20:01:49] [V] [TRT] Tactic: 1507327 Time: 0.044348 [07/07/2021-20:01:49] [V] [TRT] Tactic: 1638399 Time: 0.027256 [07/07/2021-20:01:49] [V] [TRT] Tactic: 1835007 Time: 0.030124 [07/07/2021-20:01:49] [V] [TRT] Tactic: 1900543 Time: 0.074184 [07/07/2021-20:01:49] [V] [TRT] Tactic: 2097151 Time: 0.026168 [07/07/2021-20:01:49] [V] [TRT] Tactic: 2162687 Time: 0.081208 [07/07/2021-20:01:49] [V] [TRT] Tactic: 2293759 Time: 0.07084 [07/07/2021-20:01:49] [V] [TRT] Tactic: 2359295 Time: 0.044464 [07/07/2021-20:01:49] [V] [TRT] Tactic: 2686975 Time: 0.073072 [07/07/2021-20:01:49] [V] [TRT] Tactic: 3080191 Time: 0.040596 [07/07/2021-20:01:49] [V] [TRT] Tactic: 3342335 Time: 0.04434 [07/07/2021-20:01:49] [V] [TRT] Tactic: 3407871 Time: 0.04026 [07/07/2021-20:01:49] [V] [TRT] Tactic: 3538943 Time: 0.027056 [07/07/2021-20:01:49] [V] [TRT] Tactic: 3670015 Time: 0.140088 [07/07/2021-20:01:49] [V] [TRT] Tactic: 3932159 Time: 0.058744 [07/07/2021-20:01:49] [V] [TRT] Tactic: 3997695 Time: 0.022948 [07/07/2021-20:01:49] [V] [TRT] Tactic: 4063231 Time: 0.028396 [07/07/2021-20:01:49] [V] [TRT] Tactic: 4194303 Time: 0.033988 [07/07/2021-20:01:49] [V] [TRT] Tactic: 4259839 Time: 0.027984 [07/07/2021-20:01:49] [V] [TRT] Tactic: 4325375 Time: 0.033136 [07/07/2021-20:01:49] [V] [TRT] Tactic: 4521983 Time: 0.078132 [07/07/2021-20:01:49] [V] [TRT] Tactic: 4587519 Time: 0.023868 [07/07/2021-20:01:49] [V] [TRT] Tactic: 4653055 Time: 0.022844 [07/07/2021-20:01:49] [V] [TRT] Tactic: 4915199 Time: 0.02398 [07/07/2021-20:01:49] [V] [TRT] Tactic: 4980735 Time: 0.052596 [07/07/2021-20:01:49] [V] [TRT] Tactic: 5177343 Time: 0.022836 [07/07/2021-20:01:49] [V] [TRT] Tactic: 5242879 Time: 0.03622 [07/07/2021-20:01:49] [V] [TRT] Tactic: 5373951 Time: 0.019952 [07/07/2021-20:01:49] [V] [TRT] Tactic: 5439487 Time: 0.03122 [07/07/2021-20:01:49] [V] [TRT] Tactic: 5570559 Time: 0.043432 [07/07/2021-20:01:49] [V] [TRT] Tactic: 5636095 Time: 0.028284 [07/07/2021-20:01:49] [V] [TRT] Tactic: 5701631 Time: 0.072044 [07/07/2021-20:01:49] [V] [TRT] Tactic: 5767167 Time: 0.040824 [07/07/2021-20:01:49] [V] [TRT] Tactic: 5832703 Time: 0.038144 [07/07/2021-20:01:49] [V] [TRT] Tactic: 5898239 Time: 0.022852 [07/07/2021-20:01:49] [V] [TRT] Tactic: 6029311 Time: 0.066932 [07/07/2021-20:01:49] [V] [TRT] Tactic: 6225919 Time: 0.025024 [07/07/2021-20:01:49] [V] [TRT] Tactic: 6291455 Time: 0.01966 [07/07/2021-20:01:49] [V] [TRT] Tactic: 6422527 Time: 0.036224 [07/07/2021-20:01:49] [V] [TRT] Tactic: 6750207 Time: 0.02146 [07/07/2021-20:01:49] [V] [TRT] Tactic: 6815743 Time: 0.037232 [07/07/2021-20:01:49] [V] [TRT] Tactic: 6946815 Time: 0.028152 [07/07/2021-20:01:49] [V] [TRT] Tactic: 7012351 Time: 0.026664 [07/07/2021-20:01:49] [V] [TRT] Tactic: 7077887 Time: 0.0259 [07/07/2021-20:01:49] [V] [TRT] Tactic: 7143423 Time: 0.040448 [07/07/2021-20:01:49] [V] [TRT] Tactic: 7208959 Time: 0.040188 [07/07/2021-20:01:49] [V] [TRT] Tactic: 7340031 Time: 0.022968 [07/07/2021-20:01:49] [V] [TRT] Tactic: 7405567 Time: 0.028196 [07/07/2021-20:01:49] [V] [TRT] Tactic: 7536639 Time: 0.058432 [07/07/2021-20:01:49] [V] [TRT] Tactic: 7602175 Time: 0.02752 [07/07/2021-20:01:49] [V] [TRT] Tactic: 7733247 Time: 0.029116 [07/07/2021-20:01:49] [V] [TRT] Tactic: 7798783 Time: 0.034492 [07/07/2021-20:01:49] [V] [TRT] Tactic: 8191999 Time: 0.030676 [07/07/2021-20:01:49] [V] [TRT] Tactic: 8257535 Time: 0.023544 [07/07/2021-20:01:50] [V] [TRT] Tactic: 8323071 Time: 0.030216 [07/07/2021-20:01:50] [V] [TRT] Tactic: 8650751 Time: 0.028672 [07/07/2021-20:01:50] [V] [TRT] Tactic: 8716287 Time: 0.024696 [07/07/2021-20:01:50] [V] [TRT] Tactic: 9109503 Time: 0.026364 [07/07/2021-20:01:50] [V] [TRT] Tactic: 9568255 Time: 0.023868 [07/07/2021-20:01:50] [V] [TRT] Tactic: 9895935 Time: 0.034156 [07/07/2021-20:01:50] [V] [TRT] Tactic: 10223615 Time: 0.073016 [07/07/2021-20:01:50] [V] [TRT] Tactic: 10354687 Time: 0.0263 [07/07/2021-20:01:50] [V] [TRT] Tactic: 10551295 Time: 0.046464 [07/07/2021-20:01:50] [V] [TRT] Tactic: 10747903 Time: 0.028784 [07/07/2021-20:01:50] [V] [TRT] Tactic: 10944511 Time: 0.052976 [07/07/2021-20:01:50] [V] [TRT] Fastest Tactic: 6291455 Time: 0.01966 [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: node_of_590 (CudnnConvolution) [07/07/2021-20:01:50] [V] [TRT] Tactic: 0 Time: 0.026352 [07/07/2021-20:01:50] [V] [TRT] Tactic: 1 Time: 0.024108 [07/07/2021-20:01:50] [V] [TRT] Tactic: 2 Time: 0.102504 [07/07/2021-20:01:50] [V] [TRT] Tactic: 4 skipped. Scratch requested: 76808192, available: 16777216 [07/07/2021-20:01:50] [V] [TRT] Tactic: 5 Time: 0.127964 [07/07/2021-20:01:50] [V] [TRT] Fastest Tactic: 1 Time: 0.024108 [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: node_of_590 (CublasConvolution) [07/07/2021-20:01:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: node_of_590 (CaskConvolution) [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [07/07/2021-20:01:50] [V] [TRT] Tactic: 1062367460111450758 Time: 0.028964 [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [07/07/2021-20:01:50] [V] [TRT] Tactic: 1698681053543049347 Time: 0.022908 [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [07/07/2021-20:01:50] [V] [TRT] Tactic: 4501471010995462441 Time: 0.03114 [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:01:50] [V] [TRT] Tactic: 5137655947464784826 Time: 0.021176 [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [07/07/2021-20:01:50] [V] [TRT] Tactic: 5288347012147084929 Time: 0.029824 [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [07/07/2021-20:01:50] [V] [TRT] Tactic: 5326823351883942011 Time: 0.028264 [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [07/07/2021-20:01:50] [V] [TRT] Tactic: 5500448035057547314 Time: 0.027176 [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [07/07/2021-20:01:50] [V] [TRT] Tactic: 6645123197870846056 Time: 0.02226 [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [07/07/2021-20:01:50] [V] [TRT] Tactic: 7144526460361122478 Time: 0.02272 [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [07/07/2021-20:01:50] [V] [TRT] Tactic: -8262349710178828730 Time: 0.028776 [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [07/07/2021-20:01:50] [V] [TRT] Tactic: -6576203419454146580 Time: 0.022976 [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [07/07/2021-20:01:50] [V] [TRT] Tactic: -4787320710726427159 Time: 0.023992 [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:01:50] [V] [TRT] Tactic: -3456450830548107839 Time: 0.0242 [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [07/07/2021-20:01:50] [V] [TRT] Tactic: -1218658103698133241 Time: 0.029172 [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [07/07/2021-20:01:50] [V] [TRT] Tactic: -836875257600482091 Time: 0.02802 [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:01:50] [V] [TRT] Tactic: -410470605513481746 Time: 0.029872 [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [07/07/2021-20:01:50] [V] [TRT] Tactic: -377491875521947884 Time: 0.028024 [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [07/07/2021-20:01:50] [V] [TRT] Tactic: -37215280111360163 Time: 0.02054 [07/07/2021-20:01:50] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.02054 [07/07/2021-20:01:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 6291455 [07/07/2021-20:01:50] [V] [TRT] *************** Autotuning format combination: Float(43264,1,3328,256) -> Float(21632,1,1664,128) *************** [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: node_of_590 (CudnnConvolution) [07/07/2021-20:01:50] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: node_of_590 (CublasConvolution) [07/07/2021-20:01:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: node_of_590 (CaskConvolution) [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [07/07/2021-20:01:50] [V] [TRT] Tactic: 3886731678879822788 Time: 0.016656 [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [07/07/2021-20:01:50] [V] [TRT] Tactic: 6629944304117643200 Time: 0.01174 [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [07/07/2021-20:01:50] [V] [TRT] Tactic: -9153228964338181824 Time: 0.011644 [07/07/2021-20:01:50] [V] [TRT] node_of_590 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [07/07/2021-20:01:50] [V] [TRT] Tactic: -7394439838318485025 Time: 0.01772 [07/07/2021-20:01:50] [V] [TRT] Fastest Tactic: -9153228964338181824 Time: 0.011644 [07/07/2021-20:01:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824 [07/07/2021-20:01:50] [V] [TRT] *************** Autotuning format combination: Half(43264,169,13,1) -> Half(21632,169,13,1) *************** [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: node_of_590 (CudnnConvolution) [07/07/2021-20:01:50] [V] [TRT] Tactic: 0 Time: 0.029484 [07/07/2021-20:01:50] [V] [TRT] Tactic: 1 Time: 0.026416 [07/07/2021-20:01:50] [V] [TRT] Tactic: 2 Time: 0.098736 [07/07/2021-20:01:50] [V] [TRT] Tactic: 4 skipped. Scratch requested: 76808192, available: 16777216 [07/07/2021-20:01:50] [V] [TRT] Tactic: 5 Time: 0.128588 [07/07/2021-20:01:50] [V] [TRT] Fastest Tactic: 1 Time: 0.026416 [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: node_of_590 (CublasConvolution) [07/07/2021-20:01:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: node_of_590 (CaskConvolution) [07/07/2021-20:01:50] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,169,13,1) -> Float(21632,1,1664,128) (Reformat) [07/07/2021-20:01:50] [V] [TRT] Tactic: 0 Time: 0.00466 [07/07/2021-20:01:50] [V] [TRT] Fastest Tactic: 0 Time: 0.00466 [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,169,13,1) -> Float(676,169:32,13,1) (Reformat) [07/07/2021-20:01:50] [V] [TRT] Tactic: 0 Time: 0.006392 [07/07/2021-20:01:50] [V] [TRT] Fastest Tactic: 0 Time: 0.006392 [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,169,13,1) -> Half(21632,169,13,1) (Reformat) [07/07/2021-20:01:50] [V] [TRT] Tactic: 0 Time: 0.004848 [07/07/2021-20:01:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004848 [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,1,1664,128) -> Float(21632,169,13,1) (Reformat) [07/07/2021-20:01:50] [V] [TRT] Tactic: 0 Time: 0.004736 [07/07/2021-20:01:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004736 [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,1,1664,128) -> Float(676,169:32,13,1) (Reformat) [07/07/2021-20:01:50] [V] [TRT] Tactic: 0 Time: 0.007608 [07/07/2021-20:01:50] [V] [TRT] Fastest Tactic: 0 Time: 0.007608 [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,1,1664,128) -> Half(21632,169,13,1) (Reformat) [07/07/2021-20:01:50] [V] [TRT] Tactic: 0 Time: 0.004792 [07/07/2021-20:01:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004792 [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: reformat: Float(676,169:32,13,1) -> Float(21632,169,13,1) (Reformat) [07/07/2021-20:01:50] [V] [TRT] Tactic: 0 Time: 0.005276 [07/07/2021-20:01:50] [V] [TRT] Fastest Tactic: 0 Time: 0.005276 [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: reformat: Float(676,169:32,13,1) -> Float(21632,1,1664,128) (Reformat) [07/07/2021-20:01:50] [V] [TRT] Tactic: 0 Time: 0.005304 [07/07/2021-20:01:50] [V] [TRT] Fastest Tactic: 0 Time: 0.005304 [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: reformat: Float(676,169:32,13,1) -> Half(21632,169,13,1) (Reformat) [07/07/2021-20:01:50] [V] [TRT] Tactic: 0 Time: 0.005232 [07/07/2021-20:01:50] [V] [TRT] Fastest Tactic: 0 Time: 0.005232 [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: reformat: Half(21632,169,13,1) -> Float(21632,169,13,1) (Reformat) [07/07/2021-20:01:50] [V] [TRT] Tactic: 0 Time: 0.004112 [07/07/2021-20:01:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004112 [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: reformat: Half(21632,169,13,1) -> Float(21632,1,1664,128) (Reformat) [07/07/2021-20:01:50] [V] [TRT] Tactic: 0 Time: 0.004792 [07/07/2021-20:01:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004792 [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: reformat: Half(21632,169,13,1) -> Float(676,169:32,13,1) (Reformat) [07/07/2021-20:01:50] [V] [TRT] Tactic: 0 Time: 0.006444 [07/07/2021-20:01:50] [V] [TRT] Fastest Tactic: 0 Time: 0.006444 [07/07/2021-20:01:50] [V] [TRT] *************** Autotuning format combination: Float(21632,169,13,1) -> Float(21632,169,13,1) *************** [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: node_of_592 (PointWiseV2) [07/07/2021-20:01:50] [V] [TRT] Tactic: 0 Time: 0.003388 [07/07/2021-20:01:50] [V] [TRT] Tactic: 1 Time: 0.003324 [07/07/2021-20:01:50] [V] [TRT] Tactic: 2 Time: 0.00332 [07/07/2021-20:01:50] [V] [TRT] Tactic: 3 Time: 0.00326 [07/07/2021-20:01:50] [V] [TRT] Tactic: 4 Time: 0.003428 [07/07/2021-20:01:50] [V] [TRT] Tactic: 5 Time: 0.00348 [07/07/2021-20:01:50] [V] [TRT] Tactic: 6 Time: 0.00364 [07/07/2021-20:01:50] [V] [TRT] Tactic: 7 Time: 0.00338 [07/07/2021-20:01:50] [V] [TRT] Tactic: 8 Time: 0.003324 [07/07/2021-20:01:50] [V] [TRT] Tactic: 9 Time: 0.003304 [07/07/2021-20:01:50] [V] [TRT] Tactic: 28 Time: 0.003572 [07/07/2021-20:01:50] [V] [TRT] Fastest Tactic: 3 Time: 0.00326 [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: node_of_592 (PointWise) [07/07/2021-20:01:50] [V] [TRT] Tactic: 128 Time: 0.0051 [07/07/2021-20:01:50] [V] [TRT] Tactic: 256 Time: 0.005428 [07/07/2021-20:01:50] [V] [TRT] Tactic: 512 Time: 0.005368 [07/07/2021-20:01:50] [V] [TRT] Fastest Tactic: 128 Time: 0.0051 [07/07/2021-20:01:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [07/07/2021-20:01:50] [V] [TRT] *************** Autotuning format combination: Float(21632,1,1664,128) -> Float(21632,1,1664,128) *************** [07/07/2021-20:01:50] [V] [TRT] --------------- Timing Runner: node_of_592 (PointWiseV2) [07/07/2021-20:01:50] [V] [TRT] Tactic: 0 Time: 0.003516 [07/07/2021-20:01:50] [V] [TRT] Tactic: 1 Time: 0.003444 [07/07/2021-20:01:50] [V] [TRT] Tactic: 2 Time: 0.003388 [07/07/2021-20:01:50] [V] [TRT] Tactic: 3 Time: 0.00342 [07/07/2021-20:01:50] [V] [TRT] Tactic: 4 Time: 0.003316 [07/07/2021-20:01:50] [V] [TRT] Tactic: 5 Time: 0.003376 [07/07/2021-20:01:50] [V] [TRT] Tactic: 6 Time: 0.003772 [07/07/2021-20:01:50] [V] [TRT] Tactic: 7 Time: 0.003452 [07/07/2021-20:01:50] [V] [TRT] Tactic: 8 Time: 0.003512 [07/07/2021-20:01:51] [V] [TRT] Tactic: 9 Time: 0.003284 [07/07/2021-20:01:51] [V] [TRT] Tactic: 28 Time: 0.003648 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 9 Time: 0.003284 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: node_of_592 (PointWise) [07/07/2021-20:01:51] [V] [TRT] Tactic: 128 Time: 0.005492 [07/07/2021-20:01:51] [V] [TRT] Tactic: 256 Time: 0.005488 [07/07/2021-20:01:51] [V] [TRT] Tactic: 512 Time: 0.006472 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 256 Time: 0.005488 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [07/07/2021-20:01:51] [V] [TRT] *************** Autotuning format combination: Float(676,169:32,13,1) -> Float(676,169:32,13,1) *************** [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: node_of_592 (PointWiseV2) [07/07/2021-20:01:51] [V] [TRT] Tactic: 24 Time: 0.003188 [07/07/2021-20:01:51] [V] [TRT] Tactic: 25 Time: 0.00338 [07/07/2021-20:01:51] [V] [TRT] Tactic: 26 Time: 0.00332 [07/07/2021-20:01:51] [V] [TRT] Tactic: 27 Time: 0.00424 [07/07/2021-20:01:51] [V] [TRT] Tactic: 31 Time: 0.003452 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 24 Time: 0.003188 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: node_of_592 (PointWise) [07/07/2021-20:01:51] [V] [TRT] Tactic: 128 Time: 0.005452 [07/07/2021-20:01:51] [V] [TRT] Tactic: 256 Time: 0.005504 [07/07/2021-20:01:51] [V] [TRT] Tactic: 512 Time: 0.005436 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 512 Time: 0.005436 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [07/07/2021-20:01:51] [V] [TRT] *************** Autotuning format combination: Half(21632,169,13,1) -> Half(21632,169,13,1) *************** [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: node_of_592 (PointWiseV2) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.00352 [07/07/2021-20:01:51] [V] [TRT] Tactic: 1 Time: 0.003404 [07/07/2021-20:01:51] [V] [TRT] Tactic: 2 Time: 0.003452 [07/07/2021-20:01:51] [V] [TRT] Tactic: 3 Time: 0.003384 [07/07/2021-20:01:51] [V] [TRT] Tactic: 4 Time: 0.00466 [07/07/2021-20:01:51] [V] [TRT] Tactic: 5 Time: 0.003076 [07/07/2021-20:01:51] [V] [TRT] Tactic: 6 Time: 0.003444 [07/07/2021-20:01:51] [V] [TRT] Tactic: 7 Time: 0.003252 [07/07/2021-20:01:51] [V] [TRT] Tactic: 8 Time: 0.003268 [07/07/2021-20:01:51] [V] [TRT] Tactic: 9 Time: 0.003412 [07/07/2021-20:01:51] [V] [TRT] Tactic: 28 Time: 0.00356 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 5 Time: 0.003076 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: node_of_592 (PointWise) [07/07/2021-20:01:51] [V] [TRT] Tactic: 128 Time: 0.00548 [07/07/2021-20:01:51] [V] [TRT] Tactic: 256 Time: 0.005504 [07/07/2021-20:01:51] [V] [TRT] Tactic: 512 Time: 0.005564 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 128 Time: 0.00548 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [07/07/2021-20:01:51] [V] [TRT] *************** Autotuning format combination: Float(21632,169,13,1) -> Float(21632,169,13,13,1,1) *************** [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: node_of_614 (Shuffle) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.00258 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.00258 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] *************** Autotuning format combination: Float(21632,1,1664,128) -> Float(21632,169,13,1,1,1) *************** [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: node_of_614 (Shuffle) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.005476 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.005476 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] *************** Autotuning format combination: Float(676,169:32,13,1) -> Float(21632,169,13,13:32,1,1) *************** [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: node_of_614 (Shuffle) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.1248 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.1248 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] *************** Autotuning format combination: Half(21632,169,13,1) -> Half(21632,169,13,13,1,1) *************** [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: node_of_614 (Shuffle) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.002416 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.002416 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,169,13,13,1,1) -> Half(21632,169,13,13,1,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.004808 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.004808 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,169,13,1,1,1) -> Float(21632,169,13,13,1,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.004224 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.004224 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,169,13,1,1,1) -> Half(21632,169,13,13,1,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.004096 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,169,13,13:32,1,1) -> Float(21632,169,13,13,1,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.01088 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.01088 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(21632,169,13,13:32,1,1) -> Half(21632,169,13,13,1,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.01024 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Half(21632,169,13,13,1,1) -> Float(21632,169,13,13,1,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.004096 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [07/07/2021-20:01:51] [V] [TRT] *************** Autotuning format combination: Float(21632,169,13,13,1,1) -> Float(86528,676,52,26,2,1) *************** [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: node_of_636 (Slice) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.031744 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.031744 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] *************** Autotuning format combination: Half(21632,169,13,13,1,1) -> Half(86528,676,52,26,2,1) *************** [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: node_of_636 (Slice) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.03172 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.03172 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(86528,676,52,26,2,1) -> Float(86528,676,52,1,4,2) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.010488 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.010488 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(86528,676,52,26,2,1) -> Float(43264,338,26,26:32,2,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.225696 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.225696 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(86528,676,52,26,2,1) -> Half(86528,676,52,26,2,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.009024 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.009024 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(86528,676,52,1,4,2) -> Float(86528,676,52,26,2,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.01024 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(86528,676,52,1,4,2) -> Float(43264,338,26,26:32,2,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.22552 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.22552 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(86528,676,52,1,4,2) -> Half(86528,676,52,26,2,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.01024 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,338,26,26:32,2,1) -> Float(86528,676,52,26,2,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.020452 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.020452 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,338,26,26:32,2,1) -> Float(86528,676,52,1,4,2) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.020204 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.020204 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(43264,338,26,26:32,2,1) -> Half(86528,676,52,26,2,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.01854 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.01854 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Half(86528,676,52,26,2,1) -> Float(86528,676,52,26,2,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.008192 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Half(86528,676,52,26,2,1) -> Float(86528,676,52,1,4,2) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.01088 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.01088 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Half(86528,676,52,26,2,1) -> Float(43264,338,26,26:32,2,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.22464 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.22464 [07/07/2021-20:01:51] [V] [TRT] *************** Autotuning format combination: Float(86528,676,52,26,2,1) -> Float(259584,676,26,1) *************** [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: node_of_658 (Shuffle) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.017488 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.017488 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] *************** Autotuning format combination: Float(86528,676,52,1,4,2) -> Float(259584,1,9984,384) *************** [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: node_of_658 (Shuffle) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.020444 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.020444 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] *************** Autotuning format combination: Float(43264,338,26,26:32,2,1) -> Float(8112,676:32,26,1) *************** [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: node_of_658 (Shuffle) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.022144 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.022144 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] *************** Autotuning format combination: Half(86528,676,52,26,2,1) -> Half(259584,676,26,1) *************** [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: node_of_658 (Shuffle) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.009756 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.009756 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(259584,676,26,1) -> Float(259584,1,9984,384) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.011236 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.011236 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(259584,676,26,1) -> Float(8112,676:32,26,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.016384 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.016384 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(259584,676,26,1) -> Half(259584,676,26,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.010368 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.010368 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(259584,1,9984,384) -> Float(259584,676,26,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.01024 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(259584,1,9984,384) -> Float(8112,676:32,26,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.02048 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.02048 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(259584,1,9984,384) -> Half(259584,676,26,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.010352 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.010352 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(8112,676:32,26,1) -> Float(259584,676,26,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.01216 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.01216 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(8112,676:32,26,1) -> Float(259584,1,9984,384) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.012256 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.012256 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(8112,676:32,26,1) -> Half(259584,676,26,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.012236 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.012236 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Half(259584,676,26,1) -> Float(259584,676,26,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.01024 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Half(259584,676,26,1) -> Float(259584,1,9984,384) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.01126 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.01126 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Half(259584,676,26,1) -> Float(8112,676:32,26,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.016384 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.016384 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: 212 copy (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.03394 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.03394 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: 212 copy (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.026532 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.026532 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: 212 copy (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.035948 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.035948 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: 212 copy (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.0225 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.0225 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: 212 copy (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.025216 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.025216 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: 212 copy (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.023512 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.023512 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: 212 copy (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.048364 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.048364 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: 212 copy (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.022624 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.022624 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: 212 copy (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.025784 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.025784 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: 212 copy (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.026624 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.026624 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: 212 copy (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.041036 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.041036 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: 212 copy (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.0256 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.0256 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: 212 copy (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.022532 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.022532 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: 212 copy (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.023576 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.023576 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: 212 copy (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.036148 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.036148 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: 212 copy (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.021104 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.021104 [07/07/2021-20:01:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(259584,676,26,1) -> Float(259584,1,9984,384) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.039104 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.039104 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(259584,676,26,1) -> Half(259584,676,26,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.038772 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.038772 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(259584,1,9984,384) -> Float(259584,676,26,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.03876 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.03876 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(259584,1,9984,384) -> Half(259584,676,26,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.035548 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.035548 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(8112,676:32,26,1) -> Float(259584,676,26,1) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.03684 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.03684 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(8112,676:32,26,1) -> Float(259584,1,9984,384) (Reformat) [07/07/2021-20:01:51] [V] [TRT] Tactic: 0 Time: 0.037888 [07/07/2021-20:01:51] [V] [TRT] Fastest Tactic: 0 Time: 0.037888 [07/07/2021-20:01:51] [V] [TRT] --------------- Timing Runner: reformat: Float(8112,676:32,26,1) -> Half(259584,676,26,1) (Reformat) [07/07/2021-20:01:52] [V] [TRT] Tactic: 0 Time: 0.036864 [07/07/2021-20:01:52] [V] [TRT] Fastest Tactic: 0 Time: 0.036864 [07/07/2021-20:01:52] [V] [TRT] --------------- Timing Runner: reformat: Half(259584,676,26,1) -> Float(259584,676,26,1) (Reformat) [07/07/2021-20:01:52] [V] [TRT] Tactic: 0 Time: 0.024532 [07/07/2021-20:01:52] [V] [TRT] Fastest Tactic: 0 Time: 0.024532 [07/07/2021-20:01:52] [V] [TRT] --------------- Timing Runner: reformat: Half(259584,676,26,1) -> Float(259584,1,9984,384) (Reformat) [07/07/2021-20:01:52] [V] [TRT] Tactic: 0 Time: 0.03392 [07/07/2021-20:01:52] [V] [TRT] Fastest Tactic: 0 Time: 0.03392 [07/07/2021-20:01:52] [V] [TRT] *************** Autotuning format combination: Float(259584,676,26,1) -> Float(173056,676,26,1) *************** [07/07/2021-20:01:52] [V] [TRT] --------------- Timing Runner: node_of_660 (CudaDepthwiseConvolution) [07/07/2021-20:01:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:52] [V] [TRT] --------------- Timing Runner: node_of_660 (FusedConvActConvolution) [07/07/2021-20:01:52] [V] [TRT] Tactic: 524287 Time: 0.70462 [07/07/2021-20:01:52] [V] [TRT] Tactic: 720895 Time: 0.658732 [07/07/2021-20:01:52] [V] [TRT] Tactic: 983039 Time: 0.626128 [07/07/2021-20:01:52] [V] [TRT] Tactic: 1048575 Time: 0.870384 [07/07/2021-20:01:52] [V] [TRT] Tactic: 1703935 Time: 0.77002 [07/07/2021-20:01:52] [V] [TRT] Tactic: 1769471 Time: 0.686396 [07/07/2021-20:01:52] [V] [TRT] Tactic: 1966079 Time: 0.755712 [07/07/2021-20:01:52] [V] [TRT] Tactic: 2031615 Time: 0.726272 [07/07/2021-20:01:52] [V] [TRT] Tactic: 2228223 Time: 0.786024 [07/07/2021-20:01:52] [V] [TRT] Tactic: 2424831 Time: 1.06476 [07/07/2021-20:01:52] [V] [TRT] Tactic: 2621439 Time: 0.675252 [07/07/2021-20:01:52] [V] [TRT] Tactic: 2752511 Time: 0.767472 [07/07/2021-20:01:52] [V] [TRT] Tactic: 2818047 Time: 0.871416 [07/07/2021-20:01:53] [V] [TRT] Tactic: 2883583 Time: 0.900352 [07/07/2021-20:01:53] [V] [TRT] Tactic: 3014655 Time: 0.66052 [07/07/2021-20:01:53] [V] [TRT] Tactic: 3145727 Time: 0.6088 [07/07/2021-20:01:53] [V] [TRT] Tactic: 3473407 Time: 0.569408 [07/07/2021-20:01:53] [V] [TRT] Tactic: 3604479 Time: 0.637172 [07/07/2021-20:01:53] [V] [TRT] Tactic: 3735551 Time: 0.724364 [07/07/2021-20:01:53] [V] [TRT] Tactic: 4390911 Time: 0.802368 [07/07/2021-20:01:53] [V] [TRT] Tactic: 5046271 Time: 0.641008 [07/07/2021-20:01:53] [V] [TRT] Tactic: 5963775 Time: 0.581504 [07/07/2021-20:01:53] [V] [TRT] Tactic: 6160383 Time: 0.571704 [07/07/2021-20:01:53] [V] [TRT] Tactic: 6488063 Time: 0.708404 [07/07/2021-20:01:53] [V] [TRT] Tactic: 6881279 Time: 0.61842 [07/07/2021-20:01:53] [V] [TRT] Tactic: 7274495 Time: 0.530928 [07/07/2021-20:01:53] [V] [TRT] Tactic: 7864319 Time: 0.631552 [07/07/2021-20:01:53] [V] [TRT] Tactic: 7995391 Time: 0.586752 [07/07/2021-20:01:53] [V] [TRT] Tactic: 8585215 Time: 0.674304 [07/07/2021-20:01:54] [V] [TRT] Tactic: 8847359 Time: 0.567936 [07/07/2021-20:01:54] [V] [TRT] Tactic: 8978431 Time: 0.586368 [07/07/2021-20:01:54] [V] [TRT] Tactic: 9043967 Time: 0.592268 [07/07/2021-20:01:54] [V] [TRT] Tactic: 9175039 Time: 0.645656 [07/07/2021-20:01:54] [V] [TRT] Tactic: 9502719 Time: 0.80522 [07/07/2021-20:01:54] [V] [TRT] Tactic: 9830399 Time: 0.501812 [07/07/2021-20:01:54] [V] [TRT] Tactic: 9961471 Time: 0.931328 [07/07/2021-20:01:54] [V] [TRT] Tactic: 10027007 Time: 0.672488 [07/07/2021-20:01:54] [V] [TRT] Tactic: 10092543 Time: 0.801536 [07/07/2021-20:01:54] [V] [TRT] Tactic: 10289151 Time: 0.714728 [07/07/2021-20:01:54] [V] [TRT] Tactic: 10485759 Time: 0.570092 [07/07/2021-20:01:54] [V] [TRT] Tactic: 10682367 Time: 0.667904 [07/07/2021-20:01:54] [V] [TRT] Tactic: 10813439 Time: 0.582012 [07/07/2021-20:01:54] [V] [TRT] Fastest Tactic: 9830399 Time: 0.501812 [07/07/2021-20:01:54] [V] [TRT] --------------- Timing Runner: node_of_660 (CudnnConvolution) [07/07/2021-20:01:54] [V] [TRT] Tactic: 0 Time: 0.688376 [07/07/2021-20:01:54] [V] [TRT] Tactic: 1 Time: 0.437112 [07/07/2021-20:01:54] [V] [TRT] Tactic: 2 skipped. Scratch requested: 18690048, available: 16777216 [07/07/2021-20:01:54] [V] [TRT] Tactic: 4 skipped. Scratch requested: 865861632, available: 16777216 [07/07/2021-20:01:54] [V] [TRT] Tactic: 5 skipped. Scratch requested: 433389568, available: 16777216 [07/07/2021-20:01:54] [V] [TRT] Tactic: 6 Time: 0.344884 [07/07/2021-20:01:54] [V] [TRT] Fastest Tactic: 6 Time: 0.344884 [07/07/2021-20:01:54] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskConvolution) [07/07/2021-20:01:54] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [07/07/2021-20:01:54] [V] [TRT] Tactic: 1062367460111450758 Time: 0.52462 [07/07/2021-20:01:54] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [07/07/2021-20:01:54] [V] [TRT] Tactic: 1754984623894446479 Time: 0.837572 [07/07/2021-20:01:54] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [07/07/2021-20:01:54] [V] [TRT] Tactic: 3611739942397549984 Time: 0.533804 [07/07/2021-20:01:54] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [07/07/2021-20:01:54] [V] [TRT] Tactic: 3827454225649558724 Time: 0.3246 [07/07/2021-20:01:54] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [07/07/2021-20:01:54] [V] [TRT] Tactic: 4337000649858996379 Time: 0.4551 [07/07/2021-20:01:54] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [07/07/2021-20:01:54] [V] [TRT] Tactic: 4501471010995462441 Time: 0.533832 [07/07/2021-20:01:54] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:01:55] [V] [TRT] Tactic: 5137655947464784826 Time: 0.420476 [07/07/2021-20:01:55] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [07/07/2021-20:01:55] [V] [TRT] Tactic: 5288347012147084929 Time: 0.519424 [07/07/2021-20:01:55] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [07/07/2021-20:01:55] [V] [TRT] Tactic: 5921334924264294896 Time: 0.346496 [07/07/2021-20:01:55] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [07/07/2021-20:01:55] [V] [TRT] Tactic: 6645123197870846056 Time: 0.449024 [07/07/2021-20:01:55] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [07/07/2021-20:01:55] [V] [TRT] Tactic: 7144526460361122478 Time: 0.74546 [07/07/2021-20:01:55] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [07/07/2021-20:01:55] [V] [TRT] Tactic: 7852627285308570038 Time: 0.366784 [07/07/2021-20:01:55] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [07/07/2021-20:01:55] [V] [TRT] Tactic: -9137461792520977713 Time: 0.542572 [07/07/2021-20:01:55] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [07/07/2021-20:01:55] [V] [TRT] Tactic: -8776506421218919509 Time: 0.317492 [07/07/2021-20:01:55] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [07/07/2021-20:01:55] [V] [TRT] Tactic: -8262349710178828730 Time: 0.533376 [07/07/2021-20:01:55] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [07/07/2021-20:01:55] [V] [TRT] Tactic: -8133971918129952780 Time: 0.494064 [07/07/2021-20:01:55] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [07/07/2021-20:01:55] [V] [TRT] Tactic: -6092040395344634144 Time: 0.544384 [07/07/2021-20:01:55] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [07/07/2021-20:01:55] [V] [TRT] Tactic: -4787320710726427159 Time: 0.835136 [07/07/2021-20:01:55] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:01:55] [V] [TRT] Tactic: -3456450830548107839 Time: 0.462316 [07/07/2021-20:01:55] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [07/07/2021-20:01:55] [V] [TRT] Tactic: -2318106587342035239 Time: 0.341296 [07/07/2021-20:01:55] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [07/07/2021-20:01:55] [V] [TRT] Tactic: -1343271414618805657 Time: 0.34496 [07/07/2021-20:01:55] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [07/07/2021-20:01:55] [V] [TRT] Tactic: -1218658103698133241 Time: 0.490228 [07/07/2021-20:01:55] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [07/07/2021-20:01:55] [V] [TRT] Tactic: -836875257600482091 Time: 0.462052 [07/07/2021-20:01:55] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:01:55] [V] [TRT] Tactic: -410470605513481746 Time: 0.517692 [07/07/2021-20:01:55] [V] [TRT] Fastest Tactic: -8776506421218919509 Time: 0.317492 [07/07/2021-20:01:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8776506421218919509 [07/07/2021-20:01:55] [V] [TRT] *************** Autotuning format combination: Float(259584,1,9984,384) -> Float(173056,1,6656,256) *************** [07/07/2021-20:01:55] [V] [TRT] --------------- Timing Runner: node_of_660 (CudnnConvolution) [07/07/2021-20:01:55] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:55] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskConvolution) [07/07/2021-20:01:55] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [07/07/2021-20:01:55] [V] [TRT] Tactic: -9153228964338181824 Time: 0.398268 [07/07/2021-20:01:55] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [07/07/2021-20:01:55] [V] [TRT] Tactic: -7394439838318485025 Time: 0.45664 [07/07/2021-20:01:55] [V] [TRT] Fastest Tactic: -9153228964338181824 Time: 0.398268 [07/07/2021-20:01:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824 [07/07/2021-20:01:55] [V] [TRT] *************** Autotuning format combination: Half(259584,676,26,1) -> Half(173056,676,26,1) *************** [07/07/2021-20:01:55] [V] [TRT] --------------- Timing Runner: node_of_660 (CudnnConvolution) [07/07/2021-20:01:55] [V] [TRT] Tactic: 0 Time: 0.996396 [07/07/2021-20:01:55] [V] [TRT] Tactic: 1 Time: 0.835584 [07/07/2021-20:01:55] [V] [TRT] Tactic: 2 Time: 0.674176 [07/07/2021-20:01:55] [V] [TRT] Tactic: 4 skipped. Scratch requested: 865861632, available: 16777216 [07/07/2021-20:01:55] [V] [TRT] Tactic: 5 skipped. Scratch requested: 433389568, available: 16777216 [07/07/2021-20:01:55] [V] [TRT] Tactic: 6 skipped. Scratch requested: 16833024, available: 16777216 [07/07/2021-20:01:55] [V] [TRT] Fastest Tactic: 2 Time: 0.674176 [07/07/2021-20:01:55] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskConvolution) [07/07/2021-20:01:55] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:55] [V] [TRT] Setting workspace to 16833024enables more tactics for profiling [07/07/2021-20:01:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 2 [07/07/2021-20:01:55] [V] [TRT] *************** Autotuning format combination: Float(173056,676,26,1) -> Float(173056,676,26,1) *************** [07/07/2021-20:01:55] [V] [TRT] *************** Autotuning format combination: Float(173056,1,6656,256) -> Float(173056,1,6656,256) *************** [07/07/2021-20:01:55] [V] [TRT] *************** Autotuning format combination: Float(5408,676:32,26,1) -> Float(5408,676:32,26,1) *************** [07/07/2021-20:01:55] [V] [TRT] *************** Autotuning format combination: Half(173056,676,26,1) -> Half(173056,676,26,1) *************** [07/07/2021-20:01:55] [V] [TRT] *************** Autotuning format combination: Float(173056,676,26,1) -> Float(12168,676,26,1) *************** [07/07/2021-20:01:55] [V] [TRT] --------------- Timing Runner: node_of_663 (CudaDepthwiseConvolution) [07/07/2021-20:01:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:55] [V] [TRT] --------------- Timing Runner: node_of_663 (FusedConvActConvolution) [07/07/2021-20:01:55] [V] [TRT] Tactic: 589823 Time: 0.111616 [07/07/2021-20:01:55] [V] [TRT] Tactic: 786431 Time: 0.03392 [07/07/2021-20:01:55] [V] [TRT] Tactic: 1179647 Time: 0.028288 [07/07/2021-20:01:55] [V] [TRT] Tactic: 1310719 Time: 0.062576 [07/07/2021-20:01:55] [V] [TRT] Tactic: 1376255 Time: 0.077824 [07/07/2021-20:01:55] [V] [TRT] Tactic: 1441791 Time: 0.030892 [07/07/2021-20:01:55] [V] [TRT] Tactic: 1638399 Time: 0.024548 [07/07/2021-20:01:55] [V] [TRT] Tactic: 1835007 Time: 0.029696 [07/07/2021-20:01:55] [V] [TRT] Tactic: 2097151 Time: 0.01738 [07/07/2021-20:01:55] [V] [TRT] Tactic: 2162687 Time: 0.082144 [07/07/2021-20:01:55] [V] [TRT] Tactic: 2293759 Time: 0.070784 [07/07/2021-20:01:55] [V] [TRT] Tactic: 2359295 Time: 0.044032 [07/07/2021-20:01:55] [V] [TRT] Tactic: 2686975 Time: 0.072704 [07/07/2021-20:01:55] [V] [TRT] Tactic: 3407871 Time: 0.04096 [07/07/2021-20:01:55] [V] [TRT] Tactic: 3538943 Time: 0.026116 [07/07/2021-20:01:55] [V] [TRT] Tactic: 3997695 Time: 0.021616 [07/07/2021-20:01:55] [V] [TRT] Tactic: 4194303 Time: 0.032704 [07/07/2021-20:01:55] [V] [TRT] Tactic: 4259839 Time: 0.018676 [07/07/2021-20:01:55] [V] [TRT] Tactic: 4325375 Time: 0.028672 [07/07/2021-20:01:55] [V] [TRT] Tactic: 4521983 Time: 0.077812 [07/07/2021-20:01:55] [V] [TRT] Tactic: 4587519 Time: 0.020672 [07/07/2021-20:01:55] [V] [TRT] Tactic: 4653055 Time: 0.021816 [07/07/2021-20:01:55] [V] [TRT] Tactic: 4915199 Time: 0.02066 [07/07/2021-20:01:55] [V] [TRT] Tactic: 4980735 Time: 0.04224 [07/07/2021-20:01:55] [V] [TRT] Tactic: 5177343 Time: 0.029228 [07/07/2021-20:01:55] [V] [TRT] Tactic: 5242879 Time: 0.039228 [07/07/2021-20:01:55] [V] [TRT] Tactic: 5373951 Time: 0.031984 [07/07/2021-20:01:55] [V] [TRT] Tactic: 5439487 Time: 0.030704 [07/07/2021-20:01:56] [V] [TRT] Tactic: 5701631 Time: 0.07168 [07/07/2021-20:01:56] [V] [TRT] Tactic: 5767167 Time: 0.045056 [07/07/2021-20:01:56] [V] [TRT] Tactic: 5832703 Time: 0.040032 [07/07/2021-20:01:56] [V] [TRT] Tactic: 5898239 Time: 0.021956 [07/07/2021-20:01:56] [V] [TRT] Tactic: 6029311 Time: 0.066524 [07/07/2021-20:01:56] [V] [TRT] Tactic: 6225919 Time: 0.0256 [07/07/2021-20:01:56] [V] [TRT] Tactic: 6291455 Time: 0.028352 [07/07/2021-20:01:56] [V] [TRT] Tactic: 6750207 Time: 0.020148 [07/07/2021-20:01:56] [V] [TRT] Tactic: 6815743 Time: 0.039996 [07/07/2021-20:01:56] [V] [TRT] Tactic: 6946815 Time: 0.028072 [07/07/2021-20:01:56] [V] [TRT] Tactic: 7012351 Time: 0.01746 [07/07/2021-20:01:56] [V] [TRT] Tactic: 7077887 Time: 0.026624 [07/07/2021-20:01:56] [V] [TRT] Tactic: 7143423 Time: 0.039552 [07/07/2021-20:01:56] [V] [TRT] Tactic: 7208959 Time: 0.040064 [07/07/2021-20:01:56] [V] [TRT] Tactic: 7340031 Time: 0.02176 [07/07/2021-20:01:56] [V] [TRT] Tactic: 7405567 Time: 0.026624 [07/07/2021-20:01:56] [V] [TRT] Tactic: 7536639 Time: 0.061568 [07/07/2021-20:01:56] [V] [TRT] Tactic: 7602175 Time: 0.026624 [07/07/2021-20:01:56] [V] [TRT] Tactic: 7733247 Time: 0.0284 [07/07/2021-20:01:56] [V] [TRT] Tactic: 7798783 Time: 0.034012 [07/07/2021-20:01:56] [V] [TRT] Tactic: 8191999 Time: 0.029696 [07/07/2021-20:01:56] [V] [TRT] Tactic: 8257535 Time: 0.020324 [07/07/2021-20:01:56] [V] [TRT] Tactic: 8323071 Time: 0.029696 [07/07/2021-20:01:56] [V] [TRT] Tactic: 8650751 Time: 0.026824 [07/07/2021-20:01:56] [V] [TRT] Tactic: 8716287 Time: 0.027372 [07/07/2021-20:01:56] [V] [TRT] Tactic: 9109503 Time: 0.01762 [07/07/2021-20:01:56] [V] [TRT] Tactic: 9568255 Time: 0.020532 [07/07/2021-20:01:56] [V] [TRT] Tactic: 9895935 Time: 0.03222 [07/07/2021-20:01:56] [V] [TRT] Tactic: 10223615 Time: 0.072936 [07/07/2021-20:01:56] [V] [TRT] Tactic: 10354687 Time: 0.0192 [07/07/2021-20:01:56] [V] [TRT] Tactic: 10551295 Time: 0.0464 [07/07/2021-20:01:56] [V] [TRT] Tactic: 10747903 Time: 0.02816 [07/07/2021-20:01:56] [V] [TRT] Tactic: 10944511 Time: 0.042432 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 2097151 Time: 0.01738 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_663 (CudnnConvolution) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.023936 [07/07/2021-20:01:56] [V] [TRT] Tactic: 1 Time: 0.021952 [07/07/2021-20:01:56] [V] [TRT] Tactic: 2 Time: 0.140716 [07/07/2021-20:01:56] [V] [TRT] Tactic: 4 skipped. Scratch requested: 44582912, available: 16777216 [07/07/2021-20:01:56] [V] [TRT] Tactic: 5 Time: 0.08202 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 1 Time: 0.021952 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_663 (CublasConvolution) [07/07/2021-20:01:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_663 (CaskConvolution) [07/07/2021-20:01:56] [V] [TRT] node_of_663 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [07/07/2021-20:01:56] [V] [TRT] Tactic: 1062367460111450758 Time: 0.027708 [07/07/2021-20:01:56] [V] [TRT] node_of_663 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [07/07/2021-20:01:56] [V] [TRT] Tactic: 1698681053543049347 Time: 0.021 [07/07/2021-20:01:56] [V] [TRT] node_of_663 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [07/07/2021-20:01:56] [V] [TRT] Tactic: 4501471010995462441 Time: 0.0279 [07/07/2021-20:01:56] [V] [TRT] node_of_663 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:01:56] [V] [TRT] Tactic: 5137655947464784826 Time: 0.02048 [07/07/2021-20:01:56] [V] [TRT] node_of_663 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [07/07/2021-20:01:56] [V] [TRT] Tactic: 5288347012147084929 Time: 0.027708 [07/07/2021-20:01:56] [V] [TRT] node_of_663 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [07/07/2021-20:01:56] [V] [TRT] Tactic: 5326823351883942011 Time: 0.027784 [07/07/2021-20:01:56] [V] [TRT] node_of_663 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [07/07/2021-20:01:56] [V] [TRT] Tactic: 5500448035057547314 Time: 0.026352 [07/07/2021-20:01:56] [V] [TRT] node_of_663 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [07/07/2021-20:01:56] [V] [TRT] Tactic: 6645123197870846056 Time: 0.021888 [07/07/2021-20:01:56] [V] [TRT] node_of_663 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [07/07/2021-20:01:56] [V] [TRT] Tactic: 7144526460361122478 Time: 0.022072 [07/07/2021-20:01:56] [V] [TRT] node_of_663 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [07/07/2021-20:01:56] [V] [TRT] Tactic: -8262349710178828730 Time: 0.02808 [07/07/2021-20:01:56] [V] [TRT] node_of_663 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [07/07/2021-20:01:56] [V] [TRT] Tactic: -6576203419454146580 Time: 0.022776 [07/07/2021-20:01:56] [V] [TRT] node_of_663 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [07/07/2021-20:01:56] [V] [TRT] Tactic: -4787320710726427159 Time: 0.023528 [07/07/2021-20:01:56] [V] [TRT] node_of_663 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:01:56] [V] [TRT] Tactic: -3456450830548107839 Time: 0.02374 [07/07/2021-20:01:56] [V] [TRT] node_of_663 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [07/07/2021-20:01:56] [V] [TRT] Tactic: -1218658103698133241 Time: 0.027892 [07/07/2021-20:01:56] [V] [TRT] node_of_663 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [07/07/2021-20:01:56] [V] [TRT] Tactic: -836875257600482091 Time: 0.02708 [07/07/2021-20:01:56] [V] [TRT] node_of_663 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:01:56] [V] [TRT] Tactic: -410470605513481746 Time: 0.027264 [07/07/2021-20:01:56] [V] [TRT] node_of_663 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [07/07/2021-20:01:56] [V] [TRT] Tactic: -377491875521947884 Time: 0.027124 [07/07/2021-20:01:56] [V] [TRT] node_of_663 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [07/07/2021-20:01:56] [V] [TRT] Tactic: -37215280111360163 Time: 0.019892 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.019892 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2097151 [07/07/2021-20:01:56] [V] [TRT] *************** Autotuning format combination: Float(173056,1,6656,256) -> Float(12168,1,468,18) *************** [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_663 (CudnnConvolution) [07/07/2021-20:01:56] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_663 (CublasConvolution) [07/07/2021-20:01:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_663 (CaskConvolution) [07/07/2021-20:01:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:56] [V] [TRT] *************** Autotuning format combination: Half(173056,676,26,1) -> Half(12168,676,26,1) *************** [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_663 (CudnnConvolution) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.026608 [07/07/2021-20:01:56] [V] [TRT] Tactic: 1 Time: 0.024908 [07/07/2021-20:01:56] [V] [TRT] Tactic: 2 Time: 0.1079 [07/07/2021-20:01:56] [V] [TRT] Tactic: 4 skipped. Scratch requested: 44582912, available: 16777216 [07/07/2021-20:01:56] [V] [TRT] Tactic: 5 Time: 0.08276 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 1 Time: 0.024908 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_663 (CublasConvolution) [07/07/2021-20:01:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_663 (CaskConvolution) [07/07/2021-20:01:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: reformat: Float(12168,676,26,1) -> Float(12168,1,468,18) (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.003912 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.003912 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: reformat: Float(12168,676,26,1) -> Half(12168,676,26,1) (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.004096 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: reformat: Float(12168,1,468,18) -> Float(12168,676,26,1) (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.003304 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.003304 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: reformat: Float(12168,1,468,18) -> Half(12168,676,26,1) (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.0032 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.0032 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: reformat: Half(12168,676,26,1) -> Float(12168,676,26,1) (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.0032 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.0032 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: reformat: Half(12168,676,26,1) -> Float(12168,1,468,18) (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.003856 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.003856 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_723 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.001892 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.001892 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_723 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.003048 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.003048 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_723 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.005748 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.005748 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_723 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.002864 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.002864 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_723 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.003132 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.003132 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_723 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.00312 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.00312 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_723 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.00558 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.00558 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_723 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.003048 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.003048 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_723 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_723 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_723 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.005688 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.005688 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_723 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.001816 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.001816 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_718 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.001896 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.001896 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_718 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.002708 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.002708 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_718 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.002868 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.002868 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_718 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.003456 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_718 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.002748 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.002748 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_718 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.001808 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.001808 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_713 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.001996 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.001996 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_713 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.002868 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.002868 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_713 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.003452 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.003452 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_713 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.003232 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.003232 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_713 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.002872 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.002872 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_713 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.001876 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.001876 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_708 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.002016 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.002016 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_708 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.002752 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_708 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.005616 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.005616 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_708 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.0027 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.0027 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_708 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.003376 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.003376 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_708 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.003444 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.003444 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_708 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.005296 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.005296 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_708 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.00312 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.00312 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_708 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.003036 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.003036 [07/07/2021-20:01:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:56] [V] [TRT] --------------- Timing Runner: node_of_708 (Reformat) [07/07/2021-20:01:56] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:01:56] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_708 (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.005376 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.005376 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_708 (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.001924 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.001924 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_703 (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.001924 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.001924 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_703 (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_703 (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_698 (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.001924 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.001924 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_698 (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_698 (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_693 (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.002036 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.002036 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_693 (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.003144 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003144 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_693 (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.003064 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003064 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_688 (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.002 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.002 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_688 (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_688 (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.00304 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_683 (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.001884 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.001884 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_683 (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.003016 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003016 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_683 (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: 683 copy (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.00188 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00188 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: 683 copy (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: 683 copy (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.00304 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: 683 copy (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.002992 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.002992 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: 703 copy (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.001876 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.001876 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: 703 copy (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: 703 copy (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.003104 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003104 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: 703 copy (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: reformat: Float(2028,676,26,1) -> Float(2028,1,78,3) (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: reformat: Float(2028,676,26,1) -> Float(676,676:32,26,1) (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.006132 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.006132 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: reformat: Float(2028,676,26,1) -> Half(2028,676,26,1) (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.003984 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003984 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: reformat: Float(2028,1,78,3) -> Float(2028,676,26,1) (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: reformat: Float(2028,1,78,3) -> Float(676,676:32,26,1) (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.006132 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.006132 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: reformat: Float(2028,1,78,3) -> Half(2028,676,26,1) (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: reformat: Float(676,676:32,26,1) -> Float(2028,676,26,1) (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.003124 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003124 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: reformat: Float(676,676:32,26,1) -> Float(2028,1,78,3) (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.003036 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003036 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: reformat: Float(676,676:32,26,1) -> Half(2028,676,26,1) (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.003048 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003048 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: reformat: Half(2028,676,26,1) -> Float(2028,676,26,1) (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: reformat: Half(2028,676,26,1) -> Float(2028,1,78,3) (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.00312 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00312 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: reformat: Half(2028,676,26,1) -> Float(676,676:32,26,1) (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.006132 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.006132 [07/07/2021-20:01:57] [V] [TRT] *************** Autotuning format combination: Float(2028,676,26,1) -> Float(2028,1,1) *************** [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_761 + node_of_762 + node_of_780 (Shuffle) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.00218 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00218 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] *************** Autotuning format combination: Float(2028,1,78,3) -> Float(1,2,2) *************** [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_761 + node_of_762 + node_of_780 (Shuffle) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.003124 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003124 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] *************** Autotuning format combination: Float(676,676:32,26,1) -> Float(2028:32,1,1) *************** [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_761 + node_of_762 + node_of_780 (Shuffle) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.007356 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.007356 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] *************** Autotuning format combination: Half(2028,676,26,1) -> Half(2028,1,1) *************** [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_761 + node_of_762 + node_of_780 (Shuffle) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.002048 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.002048 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_678 (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.001888 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.001888 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_678 (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.00314 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00314 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_678 (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.003548 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003548 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: 678 copy (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.001864 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.001864 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: 678 copy (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.002624 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: 698 copy (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.001876 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.001876 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: 698 copy (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.002832 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.002832 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] *************** Autotuning format combination: Float(2028,676,26,1) -> Float(2028,1) *************** [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_742 (Shuffle) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.002428 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.002428 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] *************** Autotuning format combination: Half(2028,676,26,1) -> Half(2028,1) *************** [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: node_of_742 (Shuffle) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.002356 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.002356 [07/07/2021-20:01:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: reformat: Float(2028,1) -> Half(2028,1) (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.003576 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003576 [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: reformat: Half(2028,1) -> Float(2028,1) (Reformat) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.003324 [07/07/2021-20:01:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003324 [07/07/2021-20:01:57] [V] [TRT] *************** Autotuning format combination: Float(2028,1) -> Float(2028,1) *************** [07/07/2021-20:01:57] [V] [TRT] --------------- Timing Runner: PWN(node_of_787) (PointWiseV2) [07/07/2021-20:01:57] [V] [TRT] Tactic: 0 Time: 0.0038 [07/07/2021-20:01:57] [V] [TRT] Tactic: 1 Time: 0.002676 [07/07/2021-20:01:57] [V] [TRT] Tactic: 2 Time: 0.00262 [07/07/2021-20:01:58] [V] [TRT] Tactic: 3 Time: 0.003456 [07/07/2021-20:01:58] [V] [TRT] Tactic: 4 Time: 0.003344 [07/07/2021-20:01:58] [V] [TRT] Tactic: 5 Time: 0.003404 [07/07/2021-20:01:58] [V] [TRT] Tactic: 6 Time: 0.004416 [07/07/2021-20:01:58] [V] [TRT] Tactic: 7 Time: 0.00352 [07/07/2021-20:01:59] [V] [TRT] Tactic: 8 Time: 0.003452 [07/07/2021-20:01:59] [V] [TRT] Tactic: 9 Time: 0.003544 [07/07/2021-20:01:59] [V] [TRT] Tactic: 28 Time: 0.00256 [07/07/2021-20:01:59] [V] [TRT] Fastest Tactic: 28 Time: 0.00256 [07/07/2021-20:01:59] [V] [TRT] --------------- Timing Runner: PWN(node_of_787) (PointWise) [07/07/2021-20:01:59] [V] [TRT] Tactic: 128 Time: 0.003152 [07/07/2021-20:01:59] [V] [TRT] Tactic: 256 Time: 0.003408 [07/07/2021-20:01:59] [V] [TRT] Tactic: 512 Time: 0.00348 [07/07/2021-20:01:59] [V] [TRT] Fastest Tactic: 128 Time: 0.003152 [07/07/2021-20:01:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [07/07/2021-20:01:59] [V] [TRT] *************** Autotuning format combination: Half(2028,1) -> Half(2028,1) *************** [07/07/2021-20:01:59] [V] [TRT] --------------- Timing Runner: PWN(node_of_787) (PointWiseV2) [07/07/2021-20:01:59] [V] [TRT] Tactic: 0 Time: 0.002556 [07/07/2021-20:01:59] [V] [TRT] Tactic: 1 Time: 0.002812 [07/07/2021-20:02:00] [V] [TRT] Tactic: 2 Time: 0.002688 [07/07/2021-20:02:00] [V] [TRT] Tactic: 3 Time: 0.003328 [07/07/2021-20:02:00] [V] [TRT] Tactic: 4 Time: 0.003456 [07/07/2021-20:02:00] [V] [TRT] Tactic: 5 Time: 0.00352 [07/07/2021-20:02:00] [V] [TRT] Tactic: 6 Time: 0.004416 [07/07/2021-20:02:01] [V] [TRT] Tactic: 7 Time: 0.003516 [07/07/2021-20:02:01] [V] [TRT] Tactic: 8 Time: 0.003384 [07/07/2021-20:02:01] [V] [TRT] Tactic: 9 Time: 0.003316 [07/07/2021-20:02:01] [V] [TRT] Tactic: 28 Time: 0.002688 [07/07/2021-20:02:01] [V] [TRT] Fastest Tactic: 0 Time: 0.002556 [07/07/2021-20:02:01] [V] [TRT] --------------- Timing Runner: PWN(node_of_787) (PointWise) [07/07/2021-20:02:01] [V] [TRT] Tactic: 128 Time: 0.004416 [07/07/2021-20:02:01] [V] [TRT] Tactic: 256 Time: 0.004288 [07/07/2021-20:02:01] [V] [TRT] Tactic: 512 Time: 0.004528 [07/07/2021-20:02:01] [V] [TRT] Fastest Tactic: 256 Time: 0.004288 [07/07/2021-20:02:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [07/07/2021-20:02:01] [V] [TRT] *************** Autotuning format combination: Float(2028,1) -> Float(2028,1,1) *************** [07/07/2021-20:02:01] [V] [TRT] --------------- Timing Runner: node_of_1027 (Shuffle) [07/07/2021-20:02:01] [V] [TRT] Tactic: 0 Time: 0.002496 [07/07/2021-20:02:01] [V] [TRT] Fastest Tactic: 0 Time: 0.002496 [07/07/2021-20:02:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:01] [V] [TRT] *************** Autotuning format combination: Half(2028,1) -> Half(2028,1,1) *************** [07/07/2021-20:02:01] [V] [TRT] --------------- Timing Runner: node_of_1027 (Shuffle) [07/07/2021-20:02:01] [V] [TRT] Tactic: 0 Time: 0.002368 [07/07/2021-20:02:01] [V] [TRT] Fastest Tactic: 0 Time: 0.002368 [07/07/2021-20:02:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:01] [V] [TRT] --------------- Timing Runner: reformat: Float(2028,1,1) -> Float(1,2,2) (Reformat) [07/07/2021-20:02:01] [V] [TRT] Tactic: 0 Time: 0.00338 [07/07/2021-20:02:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00338 [07/07/2021-20:02:01] [V] [TRT] --------------- Timing Runner: reformat: Float(2028,1,1) -> Float(2028:32,1,1) (Reformat) [07/07/2021-20:02:01] [V] [TRT] Tactic: 0 Time: 0.007616 [07/07/2021-20:02:01] [V] [TRT] Fastest Tactic: 0 Time: 0.007616 [07/07/2021-20:02:01] [V] [TRT] --------------- Timing Runner: reformat: Float(2028,1,1) -> Half(2028,1,1) (Reformat) [07/07/2021-20:02:01] [V] [TRT] Tactic: 0 Time: 0.003744 [07/07/2021-20:02:01] [V] [TRT] Fastest Tactic: 0 Time: 0.003744 [07/07/2021-20:02:01] [V] [TRT] --------------- Timing Runner: reformat: Float(1,2,2) -> Float(2028,1,1) (Reformat) [07/07/2021-20:02:01] [V] [TRT] Tactic: 0 Time: 0.003312 [07/07/2021-20:02:01] [V] [TRT] Fastest Tactic: 0 Time: 0.003312 [07/07/2021-20:02:01] [V] [TRT] --------------- Timing Runner: reformat: Float(1,2,2) -> Float(2028:32,1,1) (Reformat) [07/07/2021-20:02:01] [V] [TRT] Tactic: 0 Time: 0.007676 [07/07/2021-20:02:01] [V] [TRT] Fastest Tactic: 0 Time: 0.007676 [07/07/2021-20:02:01] [V] [TRT] --------------- Timing Runner: reformat: Float(1,2,2) -> Half(2028,1,1) (Reformat) [07/07/2021-20:02:01] [V] [TRT] Tactic: 0 Time: 0.003444 [07/07/2021-20:02:01] [V] [TRT] Fastest Tactic: 0 Time: 0.003444 [07/07/2021-20:02:01] [V] [TRT] --------------- Timing Runner: reformat: Float(2028:32,1,1) -> Float(2028,1,1) (Reformat) [07/07/2021-20:02:01] [V] [TRT] Tactic: 0 Time: 0.00344 [07/07/2021-20:02:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00344 [07/07/2021-20:02:01] [V] [TRT] --------------- Timing Runner: reformat: Float(2028:32,1,1) -> Float(1,2,2) (Reformat) [07/07/2021-20:02:01] [V] [TRT] Tactic: 0 Time: 0.003512 [07/07/2021-20:02:01] [V] [TRT] Fastest Tactic: 0 Time: 0.003512 [07/07/2021-20:02:01] [V] [TRT] --------------- Timing Runner: reformat: Float(2028:32,1,1) -> Half(2028,1,1) (Reformat) [07/07/2021-20:02:01] [V] [TRT] Tactic: 0 Time: 0.003584 [07/07/2021-20:02:01] [V] [TRT] Fastest Tactic: 0 Time: 0.003584 [07/07/2021-20:02:01] [V] [TRT] --------------- Timing Runner: reformat: Half(2028,1,1) -> Float(2028,1,1) (Reformat) [07/07/2021-20:02:01] [V] [TRT] Tactic: 0 Time: 0.003452 [07/07/2021-20:02:01] [V] [TRT] Fastest Tactic: 0 Time: 0.003452 [07/07/2021-20:02:01] [V] [TRT] --------------- Timing Runner: reformat: Half(2028,1,1) -> Float(1,2,2) (Reformat) [07/07/2021-20:02:01] [V] [TRT] Tactic: 0 Time: 0.00338 [07/07/2021-20:02:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00338 [07/07/2021-20:02:01] [V] [TRT] --------------- Timing Runner: reformat: Half(2028,1,1) -> Float(2028:32,1,1) (Reformat) [07/07/2021-20:02:01] [V] [TRT] Tactic: 0 Time: 0.007616 [07/07/2021-20:02:01] [V] [TRT] Fastest Tactic: 0 Time: 0.007616 [07/07/2021-20:02:01] [V] [TRT] *************** Autotuning format combination: Float(2028,1,1), Float(2028,1,1) -> Float(2028,1,1) *************** [07/07/2021-20:02:01] [V] [TRT] --------------- Timing Runner: PWN(PWN(node_of_788), node_of_1028) (PointWiseV2) [07/07/2021-20:02:01] [V] [TRT] Tactic: 0 Time: 0.002612 [07/07/2021-20:02:02] [V] [TRT] Tactic: 1 Time: 0.003392 [07/07/2021-20:02:02] [V] [TRT] Tactic: 2 Time: 0.00358 [07/07/2021-20:02:02] [V] [TRT] Tactic: 3 Time: 0.003516 [07/07/2021-20:02:02] [V] [TRT] Tactic: 4 Time: 0.003512 [07/07/2021-20:02:02] [V] [TRT] Tactic: 5 Time: 0.00344 [07/07/2021-20:02:03] [V] [TRT] Tactic: 6 Time: 0.004592 [07/07/2021-20:02:03] [V] [TRT] Tactic: 7 Time: 0.003452 [07/07/2021-20:02:03] [V] [TRT] Tactic: 8 Time: 0.003388 [07/07/2021-20:02:03] [V] [TRT] Tactic: 9 Time: 0.003392 [07/07/2021-20:02:03] [V] [TRT] Tactic: 28 Time: 0.00262 [07/07/2021-20:02:03] [V] [TRT] Fastest Tactic: 0 Time: 0.002612 [07/07/2021-20:02:03] [V] [TRT] --------------- Timing Runner: PWN(PWN(node_of_788), node_of_1028) (PointWise) [07/07/2021-20:02:03] [V] [TRT] Tactic: 128 Time: 0.003492 [07/07/2021-20:02:03] [V] [TRT] Tactic: 256 Time: 0.003452 [07/07/2021-20:02:03] [V] [TRT] Tactic: 512 Time: 0.003448 [07/07/2021-20:02:03] [V] [TRT] Fastest Tactic: 512 Time: 0.003448 [07/07/2021-20:02:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [07/07/2021-20:02:03] [V] [TRT] *************** Autotuning format combination: Float(1,2,2), Float(1,2,2) -> Float(1,2,2) *************** [07/07/2021-20:02:03] [V] [TRT] --------------- Timing Runner: PWN(PWN(node_of_788), node_of_1028) (PointWiseV2) [07/07/2021-20:02:03] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/07/2021-20:02:03] [V] [TRT] --------------- Timing Runner: PWN(PWN(node_of_788), node_of_1028) (PointWise) [07/07/2021-20:02:03] [V] [TRT] Tactic: 128 Time: 0.003384 [07/07/2021-20:02:03] [V] [TRT] Tactic: 256 Time: 0.003436 [07/07/2021-20:02:03] [V] [TRT] Tactic: 512 Time: 0.003524 [07/07/2021-20:02:03] [V] [TRT] Fastest Tactic: 128 Time: 0.003384 [07/07/2021-20:02:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [07/07/2021-20:02:03] [V] [TRT] *************** Autotuning format combination: Float(2028:32,1,1), Float(2028:32,1,1) -> Float(2028:32,1,1) *************** [07/07/2021-20:02:03] [V] [TRT] --------------- Timing Runner: PWN(PWN(node_of_788), node_of_1028) (PointWiseV2) [07/07/2021-20:02:04] [V] [TRT] Tactic: 24 Time: 0.004544 [07/07/2021-20:02:04] [V] [TRT] Tactic: 25 Time: 0.005376 [07/07/2021-20:02:04] [V] [TRT] Tactic: 26 Time: 0.006512 [07/07/2021-20:02:04] [V] [TRT] Tactic: 27 Time: 0.009592 [07/07/2021-20:02:04] [V] [TRT] Tactic: 31 Time: 0.004608 [07/07/2021-20:02:04] [V] [TRT] Fastest Tactic: 24 Time: 0.004544 [07/07/2021-20:02:04] [V] [TRT] --------------- Timing Runner: PWN(PWN(node_of_788), node_of_1028) (PointWise) [07/07/2021-20:02:04] [V] [TRT] Tactic: 128 Time: 0.007776 [07/07/2021-20:02:04] [V] [TRT] Tactic: 256 Time: 0.007808 [07/07/2021-20:02:04] [V] [TRT] Tactic: 512 Time: 0.009656 [07/07/2021-20:02:04] [V] [TRT] Fastest Tactic: 128 Time: 0.007776 [07/07/2021-20:02:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [07/07/2021-20:02:04] [V] [TRT] *************** Autotuning format combination: Half(2028,1,1), Half(2028,1,1) -> Half(2028,1,1) *************** [07/07/2021-20:02:04] [V] [TRT] --------------- Timing Runner: PWN(PWN(node_of_788), node_of_1028) (PointWiseV2) [07/07/2021-20:02:05] [V] [TRT] Tactic: 0 Time: 0.00262 [07/07/2021-20:02:05] [V] [TRT] Tactic: 1 Time: 0.003396 [07/07/2021-20:02:05] [V] [TRT] Tactic: 2 Time: 0.002684 [07/07/2021-20:02:05] [V] [TRT] Tactic: 3 Time: 0.00354 [07/07/2021-20:02:05] [V] [TRT] Tactic: 4 Time: 0.003512 [07/07/2021-20:02:06] [V] [TRT] Tactic: 5 Time: 0.003312 [07/07/2021-20:02:06] [V] [TRT] Tactic: 6 Time: 0.006072 [07/07/2021-20:02:06] [V] [TRT] Tactic: 7 Time: 0.003524 [07/07/2021-20:02:06] [V] [TRT] Tactic: 8 Time: 0.003452 [07/07/2021-20:02:06] [V] [TRT] Tactic: 9 Time: 0.003516 [07/07/2021-20:02:07] [V] [TRT] Tactic: 28 Time: 0.002644 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00262 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: PWN(PWN(node_of_788), node_of_1028) (PointWise) [07/07/2021-20:02:07] [V] [TRT] Tactic: 128 Time: 0.00544 [07/07/2021-20:02:07] [V] [TRT] Tactic: 256 Time: 0.005496 [07/07/2021-20:02:07] [V] [TRT] Tactic: 512 Time: 0.00556 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 128 Time: 0.00544 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_673 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.002 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.002 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_673 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.003408 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003408 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_673 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.003312 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003312 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: 673 copy (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.001984 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.001984 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: 673 copy (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.003176 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003176 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: 693 copy (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.002012 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.002012 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: 693 copy (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.003016 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003016 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: reformat: Float(4056,676,26,1) -> Half(4056,676,26,1) (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.004076 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004076 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: reformat: Half(4056,676,26,1) -> Float(4056,676,26,1) (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:07] [V] [TRT] *************** Autotuning format combination: Float(4056,676,26,1) -> Float(4056,676,26,1) *************** [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_786 (Unary) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.002292 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.002292 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Unary Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] *************** Autotuning format combination: Half(4056,676,26,1) -> Half(4056,676,26,1) *************** [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_786 (Unary) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.002176 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.002176 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Unary Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: reformat: Float(4056,676,26,1) -> Half(4056,676,26,1) (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.004096 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: reformat: Half(4056,676,26,1) -> Float(4056,676,26,1) (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_870 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.001928 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.001928 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_870 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_870 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_870 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.003096 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003096 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_870 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.003008 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_870 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.001852 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.001852 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_863 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.001924 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.001924 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_863 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_863 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.003048 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003048 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_863 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_863 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.003048 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003048 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_863 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.001868 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.001868 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_842 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.001908 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.001908 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_842 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.00304 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_842 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.00304 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_842 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_842 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.00304 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_842 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.001804 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.001804 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_835 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.001868 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.001868 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_835 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.002552 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.002552 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_835 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.002816 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_835 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.003456 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_835 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.00272 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00272 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_835 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.001824 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.001824 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_814 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.001884 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.001884 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_814 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.00274 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00274 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_814 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.002816 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_814 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.003452 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003452 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_814 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.00264 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00264 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_814 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.001848 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.001848 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_807 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.001868 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.001868 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_807 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.002652 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.002652 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_807 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.002688 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_807 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.003496 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003496 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_807 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.002824 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.002824 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_807 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.001804 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.001804 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_668 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.002 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.002 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_668 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.00352 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00352 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_668 (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.003384 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003384 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: 668 copy (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.002008 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.002008 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: 668 copy (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.003004 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003004 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: 668 copy (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.003096 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003096 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: 668 copy (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.002992 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.002992 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: 688 copy (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.00202 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00202 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: 688 copy (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.003152 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003152 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: 688 copy (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: 688 copy (Reformat) [07/07/2021-20:02:07] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:07] [V] [TRT] *************** Autotuning format combination: Float(86528,169,13,1) -> Float(3042,169,13,1) *************** [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_224 (CudaDepthwiseConvolution) [07/07/2021-20:02:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2021-20:02:07] [V] [TRT] --------------- Timing Runner: node_of_224 (FusedConvActConvolution) [07/07/2021-20:02:07] [V] [TRT] Tactic: 589823 Time: 0.205632 [07/07/2021-20:02:07] [V] [TRT] Tactic: 786431 Time: 0.053304 [07/07/2021-20:02:07] [V] [TRT] Tactic: 1179647 Time: 0.023052 [07/07/2021-20:02:07] [V] [TRT] Tactic: 1310719 Time: 0.105472 [07/07/2021-20:02:07] [V] [TRT] Tactic: 1376255 Time: 0.140256 [07/07/2021-20:02:07] [V] [TRT] Tactic: 1441791 Time: 0.026624 [07/07/2021-20:02:07] [V] [TRT] Tactic: 1638399 Time: 0.036864 [07/07/2021-20:02:07] [V] [TRT] Tactic: 1835007 Time: 0.04548 [07/07/2021-20:02:07] [V] [TRT] Tactic: 2097151 Time: 0.01856 [07/07/2021-20:02:07] [V] [TRT] Tactic: 2162687 Time: 0.143596 [07/07/2021-20:02:07] [V] [TRT] Tactic: 2293759 Time: 0.129008 [07/07/2021-20:02:07] [V] [TRT] Tactic: 2359295 Time: 0.0767 [07/07/2021-20:02:07] [V] [TRT] Tactic: 2686975 Time: 0.131584 [07/07/2021-20:02:07] [V] [TRT] Tactic: 3407871 Time: 0.067584 [07/07/2021-20:02:07] [V] [TRT] Tactic: 3538943 Time: 0.036736 [07/07/2021-20:02:07] [V] [TRT] Tactic: 3997695 Time: 0.027648 [07/07/2021-20:02:07] [V] [TRT] Tactic: 4194303 Time: 0.05322 [07/07/2021-20:02:07] [V] [TRT] Tactic: 4259839 Time: 0.019436 [07/07/2021-20:02:07] [V] [TRT] Tactic: 4325375 Time: 0.03882 [07/07/2021-20:02:07] [V] [TRT] Tactic: 4521983 Time: 0.134124 [07/07/2021-20:02:07] [V] [TRT] Tactic: 4587519 Time: 0.028672 [07/07/2021-20:02:08] [V] [TRT] Tactic: 4653055 Time: 0.026624 [07/07/2021-20:02:08] [V] [TRT] Tactic: 4915199 Time: 0.02864 [07/07/2021-20:02:08] [V] [TRT] Tactic: 4980735 Time: 0.072696 [07/07/2021-20:02:08] [V] [TRT] Tactic: 5177343 Time: 0.025856 [07/07/2021-20:02:08] [V] [TRT] Tactic: 5242879 Time: 0.06144 [07/07/2021-20:02:08] [V] [TRT] Tactic: 5373951 Time: 0.023424 [07/07/2021-20:02:08] [V] [TRT] Tactic: 5439487 Time: 0.049088 [07/07/2021-20:02:08] [V] [TRT] Tactic: 5701631 Time: 0.129472 [07/07/2021-20:02:08] [V] [TRT] Tactic: 5767167 Time: 0.070656 [07/07/2021-20:02:08] [V] [TRT] Tactic: 5832703 Time: 0.064512 [07/07/2021-20:02:08] [V] [TRT] Tactic: 5898239 Time: 0.027776 [07/07/2021-20:02:08] [V] [TRT] Tactic: 6029311 Time: 0.119808 [07/07/2021-20:02:08] [V] [TRT] Tactic: 6225919 Time: 0.033756 [07/07/2021-20:02:08] [V] [TRT] Tactic: 6291455 Time: 0.023016 [07/07/2021-20:02:08] [V] [TRT] Tactic: 6750207 Time: 0.026592 [07/07/2021-20:02:08] [V] [TRT] Tactic: 6815743 Time: 0.063488 [07/07/2021-20:02:08] [V] [TRT] Tactic: 6946815 Time: 0.0432 [07/07/2021-20:02:08] [V] [TRT] Tactic: 7012351 Time: 0.018432 [07/07/2021-20:02:08] [V] [TRT] Tactic: 7077887 Time: 0.034816 [07/07/2021-20:02:08] [V] [TRT] Tactic: 7143423 Time: 0.068216 [07/07/2021-20:02:08] [V] [TRT] Tactic: 7208959 Time: 0.065536 [07/07/2021-20:02:08] [V] [TRT] Tactic: 7340031 Time: 0.02816 [07/07/2021-20:02:08] [V] [TRT] Tactic: 7405567 Time: 0.034756 [07/07/2021-20:02:08] [V] [TRT] Tactic: 7536639 Time: 0.10456 [07/07/2021-20:02:08] [V] [TRT] Tactic: 7602175 Time: 0.041072 [07/07/2021-20:02:08] [V] [TRT] Tactic: 7733247 Time: 0.041984 [07/07/2021-20:02:08] [V] [TRT] Tactic: 7798783 Time: 0.053248 [07/07/2021-20:02:08] [V] [TRT] Tactic: 8191999 Time: 0.045124 [07/07/2021-20:02:08] [V] [TRT] Tactic: 8257535 Time: 0.028636 [07/07/2021-20:02:08] [V] [TRT] Tactic: 8323071 Time: 0.0471 [07/07/2021-20:02:08] [V] [TRT] Tactic: 8650751 Time: 0.041984 [07/07/2021-20:02:08] [V] [TRT] Tactic: 8716287 Time: 0.034816 [07/07/2021-20:02:08] [V] [TRT] Tactic: 9109503 Time: 0.019452 [07/07/2021-20:02:08] [V] [TRT] Tactic: 9568255 Time: 0.028668 [07/07/2021-20:02:08] [V] [TRT] Tactic: 9895935 Time: 0.052852 [07/07/2021-20:02:08] [V] [TRT] Tactic: 10223615 Time: 0.131636 [07/07/2021-20:02:08] [V] [TRT] Tactic: 10354687 Time: 0.025016 [07/07/2021-20:02:08] [V] [TRT] Tactic: 10551295 Time: 0.079884 [07/07/2021-20:02:08] [V] [TRT] Tactic: 10747903 Time: 0.042172 [07/07/2021-20:02:08] [V] [TRT] Tactic: 10944511 Time: 0.073012 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 7012351 Time: 0.018432 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_224 (CudnnConvolution) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.031424 [07/07/2021-20:02:08] [V] [TRT] Tactic: 1 Time: 0.028992 [07/07/2021-20:02:08] [V] [TRT] Tactic: 2 Time: 0.110204 [07/07/2021-20:02:08] [V] [TRT] Tactic: 4 skipped. Scratch requested: 23629824, available: 16777216 [07/07/2021-20:02:08] [V] [TRT] Tactic: 5 Time: 0.10664 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 1 Time: 0.028992 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_224 (CublasConvolution) [07/07/2021-20:02:08] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_224 (CaskConvolution) [07/07/2021-20:02:08] [V] [TRT] node_of_224 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [07/07/2021-20:02:08] [V] [TRT] Tactic: 1062367460111450758 Time: 0.04856 [07/07/2021-20:02:08] [V] [TRT] node_of_224 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [07/07/2021-20:02:08] [V] [TRT] Tactic: 1698681053543049347 Time: 0.037304 [07/07/2021-20:02:08] [V] [TRT] node_of_224 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [07/07/2021-20:02:08] [V] [TRT] Tactic: 4501471010995462441 Time: 0.04864 [07/07/2021-20:02:08] [V] [TRT] node_of_224 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:02:08] [V] [TRT] Tactic: 5137655947464784826 Time: 0.034172 [07/07/2021-20:02:08] [V] [TRT] node_of_224 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [07/07/2021-20:02:08] [V] [TRT] Tactic: 5288347012147084929 Time: 0.048268 [07/07/2021-20:02:08] [V] [TRT] node_of_224 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [07/07/2021-20:02:08] [V] [TRT] Tactic: 5326823351883942011 Time: 0.047424 [07/07/2021-20:02:08] [V] [TRT] node_of_224 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [07/07/2021-20:02:08] [V] [TRT] Tactic: 5500448035057547314 Time: 0.046208 [07/07/2021-20:02:08] [V] [TRT] node_of_224 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [07/07/2021-20:02:08] [V] [TRT] Tactic: 6645123197870846056 Time: 0.037164 [07/07/2021-20:02:08] [V] [TRT] node_of_224 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [07/07/2021-20:02:08] [V] [TRT] Tactic: 7144526460361122478 Time: 0.039048 [07/07/2021-20:02:08] [V] [TRT] node_of_224 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [07/07/2021-20:02:08] [V] [TRT] Tactic: -8262349710178828730 Time: 0.048828 [07/07/2021-20:02:08] [V] [TRT] node_of_224 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [07/07/2021-20:02:08] [V] [TRT] Tactic: -6576203419454146580 Time: 0.03826 [07/07/2021-20:02:08] [V] [TRT] node_of_224 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [07/07/2021-20:02:08] [V] [TRT] Tactic: -4787320710726427159 Time: 0.04178 [07/07/2021-20:02:08] [V] [TRT] node_of_224 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:02:08] [V] [TRT] Tactic: -3456450830548107839 Time: 0.040368 [07/07/2021-20:02:08] [V] [TRT] node_of_224 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [07/07/2021-20:02:08] [V] [TRT] Tactic: -1218658103698133241 Time: 0.049968 [07/07/2021-20:02:08] [V] [TRT] node_of_224 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [07/07/2021-20:02:08] [V] [TRT] Tactic: -836875257600482091 Time: 0.047732 [07/07/2021-20:02:08] [V] [TRT] node_of_224 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:02:08] [V] [TRT] Tactic: -410470605513481746 Time: 0.047444 [07/07/2021-20:02:08] [V] [TRT] node_of_224 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [07/07/2021-20:02:08] [V] [TRT] Tactic: -377491875521947884 Time: 0.047128 [07/07/2021-20:02:08] [V] [TRT] node_of_224 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [07/07/2021-20:02:08] [V] [TRT] Tactic: -37215280111360163 Time: 0.032896 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.032896 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7012351 [07/07/2021-20:02:08] [V] [TRT] *************** Autotuning format combination: Float(86528,1,6656,512) -> Float(3042,1,234,18) *************** [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_224 (CudnnConvolution) [07/07/2021-20:02:08] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_224 (CublasConvolution) [07/07/2021-20:02:08] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_224 (CaskConvolution) [07/07/2021-20:02:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:02:08] [V] [TRT] *************** Autotuning format combination: Half(86528,169,13,1) -> Half(3042,169,13,1) *************** [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_224 (CudnnConvolution) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.039924 [07/07/2021-20:02:08] [V] [TRT] Tactic: 1 Time: 0.036852 [07/07/2021-20:02:08] [V] [TRT] Tactic: 2 Time: 0.115912 [07/07/2021-20:02:08] [V] [TRT] Tactic: 4 skipped. Scratch requested: 23629824, available: 16777216 [07/07/2021-20:02:08] [V] [TRT] Tactic: 5 Time: 0.106208 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 1 Time: 0.036852 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_224 (CublasConvolution) [07/07/2021-20:02:08] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_224 (CaskConvolution) [07/07/2021-20:02:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: reformat: Float(3042,169,13,1) -> Float(3042,1,234,18) (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.003044 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003044 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: reformat: Float(3042,169,13,1) -> Half(3042,169,13,1) (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.004084 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.004084 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: reformat: Float(3042,1,234,18) -> Float(3042,169,13,1) (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: reformat: Float(3042,1,234,18) -> Half(3042,169,13,1) (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.003184 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003184 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: reformat: Half(3042,169,13,1) -> Float(3042,169,13,1) (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: reformat: Half(3042,169,13,1) -> Float(3042,1,234,18) (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_284 (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.001796 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.001796 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_284 (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_284 (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.00326 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.00326 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_284 (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.002992 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.002992 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_284 (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.003064 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003064 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_284 (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.00302 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.00302 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_284 (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.003264 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003264 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_284 (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.003016 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003016 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_284 (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.00304 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_284 (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.003032 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003032 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_284 (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.003196 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003196 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_284 (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.002296 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.002296 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_279 (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.001796 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.001796 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_279 (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.003004 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003004 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_279 (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.003052 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003052 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_279 (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.003016 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003016 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_279 (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.00308 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.00308 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_279 (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.002368 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.002368 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_274 (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.001832 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.001832 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_274 (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_274 (Reformat) [07/07/2021-20:02:08] [V] [TRT] Tactic: 0 Time: 0.00302 [07/07/2021-20:02:08] [V] [TRT] Fastest Tactic: 0 Time: 0.00302 [07/07/2021-20:02:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:08] [V] [TRT] --------------- Timing Runner: node_of_274 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.00302 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00302 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_274 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.00296 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00296 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_274 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.0018 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0018 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_269 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.001828 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.001828 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_269 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_269 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003136 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003136 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_269 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003016 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003016 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_269 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003016 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003016 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_269 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.002984 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.002984 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_269 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.0032 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0032 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_269 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.002972 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.002972 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_269 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_269 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003032 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003032 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_269 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003132 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003132 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_269 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.001804 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.001804 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_264 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.001808 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.001808 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_264 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003028 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003028 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_264 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003128 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003128 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_259 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.001832 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.001832 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_259 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.0031 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0031 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_259 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.00304 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_254 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.001828 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.001828 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_254 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.00312 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00312 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_254 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_249 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.00184 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00184 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_249 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_249 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003048 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003048 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_244 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.001792 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.001792 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_244 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.002948 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.002948 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_244 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.00312 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00312 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: 244 copy (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.001804 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.001804 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: 244 copy (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: 244 copy (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: 244 copy (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.00294 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00294 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: 264 copy (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.001776 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.001776 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: 264 copy (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.002616 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.002616 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: 264 copy (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.002676 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.002676 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: 264 copy (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.00268 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00268 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Float(507,169,13,1) -> Float(507,1,39,3) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.002936 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.002936 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Float(507,169,13,1) -> Float(169,169:32,13,1) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003132 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003132 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Float(507,169,13,1) -> Half(507,169,13,1) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003772 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003772 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Float(507,1,39,3) -> Float(507,169,13,1) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.002904 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.002904 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Float(507,1,39,3) -> Float(169,169:32,13,1) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.0032 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0032 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Float(507,1,39,3) -> Half(507,169,13,1) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003052 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003052 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Float(169,169:32,13,1) -> Float(507,169,13,1) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Float(169,169:32,13,1) -> Float(507,1,39,3) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Float(169,169:32,13,1) -> Half(507,169,13,1) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003064 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003064 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Half(507,169,13,1) -> Float(507,169,13,1) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Half(507,169,13,1) -> Float(507,1,39,3) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003052 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003052 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Half(507,169,13,1) -> Float(169,169:32,13,1) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.0032 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0032 [07/07/2021-20:02:09] [V] [TRT] *************** Autotuning format combination: Float(507,169,13,1) -> Float(507,1,1) *************** [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_322 + node_of_323 + node_of_341 (Shuffle) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.002176 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.002176 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] *************** Autotuning format combination: Float(507,1,39,3) -> Float(1,2,2) *************** [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_322 + node_of_323 + node_of_341 (Shuffle) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] *************** Autotuning format combination: Float(169,169:32,13,1) -> Float(507:32,1,1) *************** [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_322 + node_of_323 + node_of_341 (Shuffle) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.00408 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00408 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] *************** Autotuning format combination: Half(507,169,13,1) -> Half(507,1,1) *************** [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_322 + node_of_323 + node_of_341 (Shuffle) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.002172 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.002172 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_239 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.001804 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.001804 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_239 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003084 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003084 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_239 (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003048 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003048 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: 239 copy (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.001804 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.001804 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: 239 copy (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003076 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003076 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: 259 copy (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.001852 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.001852 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: 259 copy (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] *************** Autotuning format combination: Float(507,169,13,1) -> Float(507,1) *************** [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_303 (Shuffle) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.00212 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00212 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] *************** Autotuning format combination: Half(507,169,13,1) -> Half(507,1) *************** [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_303 (Shuffle) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.002048 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.002048 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Float(507,1) -> Half(507,1) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.004076 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004076 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Half(507,1) -> Float(507,1) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:09] [V] [TRT] *************** Autotuning format combination: Float(507,1) -> Float(507,1) *************** [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: PWN(node_of_348) (PointWiseV2) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.002236 [07/07/2021-20:02:09] [V] [TRT] Tactic: 1 Time: 0.003 [07/07/2021-20:02:09] [V] [TRT] Tactic: 2 Time: 0.002368 [07/07/2021-20:02:09] [V] [TRT] Tactic: 3 Time: 0.003132 [07/07/2021-20:02:09] [V] [TRT] Tactic: 4 Time: 0.003136 [07/07/2021-20:02:09] [V] [TRT] Tactic: 5 Time: 0.003072 [07/07/2021-20:02:09] [V] [TRT] Tactic: 6 Time: 0.00418 [07/07/2021-20:02:09] [V] [TRT] Tactic: 7 Time: 0.003072 [07/07/2021-20:02:09] [V] [TRT] Tactic: 8 Time: 0.003144 [07/07/2021-20:02:09] [V] [TRT] Tactic: 9 Time: 0.003144 [07/07/2021-20:02:09] [V] [TRT] Tactic: 28 Time: 0.002304 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.002236 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: PWN(node_of_348) (PointWise) [07/07/2021-20:02:09] [V] [TRT] Tactic: 128 Time: 0.003072 [07/07/2021-20:02:09] [V] [TRT] Tactic: 256 Time: 0.003072 [07/07/2021-20:02:09] [V] [TRT] Tactic: 512 Time: 0.003052 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 512 Time: 0.003052 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] *************** Autotuning format combination: Half(507,1) -> Half(507,1) *************** [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: PWN(node_of_348) (PointWiseV2) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.002236 [07/07/2021-20:02:09] [V] [TRT] Tactic: 1 Time: 0.003076 [07/07/2021-20:02:09] [V] [TRT] Tactic: 2 Time: 0.002616 [07/07/2021-20:02:09] [V] [TRT] Tactic: 3 Time: 0.003132 [07/07/2021-20:02:09] [V] [TRT] Tactic: 4 Time: 0.003072 [07/07/2021-20:02:09] [V] [TRT] Tactic: 5 Time: 0.003072 [07/07/2021-20:02:09] [V] [TRT] Tactic: 6 Time: 0.004148 [07/07/2021-20:02:09] [V] [TRT] Tactic: 7 Time: 0.003516 [07/07/2021-20:02:09] [V] [TRT] Tactic: 8 Time: 0.003384 [07/07/2021-20:02:09] [V] [TRT] Tactic: 9 Time: 0.003452 [07/07/2021-20:02:09] [V] [TRT] Tactic: 28 Time: 0.002508 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.002236 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: PWN(node_of_348) (PointWise) [07/07/2021-20:02:09] [V] [TRT] Tactic: 128 Time: 0.003448 [07/07/2021-20:02:09] [V] [TRT] Tactic: 256 Time: 0.00344 [07/07/2021-20:02:09] [V] [TRT] Tactic: 512 Time: 0.003272 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 512 Time: 0.003272 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] *************** Autotuning format combination: Float(507,1) -> Float(507,1,1) *************** [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_588 (Shuffle) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.002048 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.002048 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] *************** Autotuning format combination: Half(507,1) -> Half(507,1,1) *************** [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: node_of_588 (Shuffle) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.002048 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.002048 [07/07/2021-20:02:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Float(507,1,1) -> Float(1,2,2) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.002996 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.002996 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Float(507,1,1) -> Float(507:32,1,1) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.004016 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004016 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Float(507,1,1) -> Half(507,1,1) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.00378 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00378 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Float(1,2,2) -> Float(507,1,1) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003028 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003028 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Float(1,2,2) -> Float(507:32,1,1) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.004028 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004028 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Float(1,2,2) -> Half(507,1,1) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003016 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003016 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Float(507:32,1,1) -> Float(507,1,1) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003124 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003124 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Float(507:32,1,1) -> Float(1,2,2) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003048 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003048 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Float(507:32,1,1) -> Half(507,1,1) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003064 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003064 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Half(507,1,1) -> Float(507,1,1) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003052 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003052 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Half(507,1,1) -> Float(1,2,2) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.003016 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.003016 [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: reformat: Half(507,1,1) -> Float(507:32,1,1) (Reformat) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.00402 [07/07/2021-20:02:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00402 [07/07/2021-20:02:09] [V] [TRT] *************** Autotuning format combination: Float(507,1,1), Float(507,1,1) -> Float(507,1,1) *************** [07/07/2021-20:02:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(node_of_349), node_of_589) (PointWiseV2) [07/07/2021-20:02:09] [V] [TRT] Tactic: 0 Time: 0.00238 [07/07/2021-20:02:09] [V] [TRT] Tactic: 1 Time: 0.003016 [07/07/2021-20:02:09] [V] [TRT] Tactic: 2 Time: 0.003116 [07/07/2021-20:02:09] [V] [TRT] Tactic: 3 Time: 0.003072 [07/07/2021-20:02:09] [V] [TRT] Tactic: 4 Time: 0.003056 [07/07/2021-20:02:09] [V] [TRT] Tactic: 5 Time: 0.003072 [07/07/2021-20:02:09] [V] [TRT] Tactic: 6 Time: 0.004096 [07/07/2021-20:02:10] [V] [TRT] Tactic: 7 Time: 0.0032 [07/07/2021-20:02:10] [V] [TRT] Tactic: 8 Time: 0.003184 [07/07/2021-20:02:10] [V] [TRT] Tactic: 9 Time: 0.0032 [07/07/2021-20:02:10] [V] [TRT] Tactic: 28 Time: 0.003056 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00238 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(node_of_349), node_of_589) (PointWise) [07/07/2021-20:02:10] [V] [TRT] Tactic: 128 Time: 0.003184 [07/07/2021-20:02:10] [V] [TRT] Tactic: 256 Time: 0.003184 [07/07/2021-20:02:10] [V] [TRT] Tactic: 512 Time: 0.00306 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 512 Time: 0.00306 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] *************** Autotuning format combination: Float(1,2,2), Float(1,2,2) -> Float(1,2,2) *************** [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(node_of_349), node_of_589) (PointWiseV2) [07/07/2021-20:02:10] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(node_of_349), node_of_589) (PointWise) [07/07/2021-20:02:10] [V] [TRT] Tactic: 128 Time: 0.003188 [07/07/2021-20:02:10] [V] [TRT] Tactic: 256 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] Tactic: 512 Time: 0.003132 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 256 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 256 [07/07/2021-20:02:10] [V] [TRT] *************** Autotuning format combination: Float(507:32,1,1), Float(507:32,1,1) -> Float(507:32,1,1) *************** [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(node_of_349), node_of_589) (PointWiseV2) [07/07/2021-20:02:10] [V] [TRT] Tactic: 24 Time: 0.003584 [07/07/2021-20:02:10] [V] [TRT] Tactic: 25 Time: 0.004476 [07/07/2021-20:02:10] [V] [TRT] Tactic: 26 Time: 0.005564 [07/07/2021-20:02:10] [V] [TRT] Tactic: 27 Time: 0.009252 [07/07/2021-20:02:10] [V] [TRT] Tactic: 31 Time: 0.003576 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 31 Time: 0.003576 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(node_of_349), node_of_589) (PointWise) [07/07/2021-20:02:10] [V] [TRT] Tactic: 128 Time: 0.004528 [07/07/2021-20:02:10] [V] [TRT] Tactic: 256 Time: 0.004364 [07/07/2021-20:02:10] [V] [TRT] Tactic: 512 Time: 0.004532 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 256 Time: 0.004364 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [07/07/2021-20:02:10] [V] [TRT] *************** Autotuning format combination: Half(507,1,1), Half(507,1,1) -> Half(507,1,1) *************** [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(node_of_349), node_of_589) (PointWiseV2) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.00262 [07/07/2021-20:02:10] [V] [TRT] Tactic: 1 Time: 0.003388 [07/07/2021-20:02:10] [V] [TRT] Tactic: 2 Time: 0.00274 [07/07/2021-20:02:10] [V] [TRT] Tactic: 3 Time: 0.003584 [07/07/2021-20:02:10] [V] [TRT] Tactic: 4 Time: 0.003356 [07/07/2021-20:02:10] [V] [TRT] Tactic: 5 Time: 0.004552 [07/07/2021-20:02:10] [V] [TRT] Tactic: 6 Time: 0.004396 [07/07/2021-20:02:10] [V] [TRT] Tactic: 7 Time: 0.003648 [07/07/2021-20:02:10] [V] [TRT] Tactic: 8 Time: 0.003376 [07/07/2021-20:02:10] [V] [TRT] Tactic: 9 Time: 0.003644 [07/07/2021-20:02:10] [V] [TRT] Tactic: 28 Time: 0.00268 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00262 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(node_of_349), node_of_589) (PointWise) [07/07/2021-20:02:10] [V] [TRT] Tactic: 128 Time: 0.004428 [07/07/2021-20:02:10] [V] [TRT] Tactic: 256 Time: 0.004304 [07/07/2021-20:02:10] [V] [TRT] Tactic: 512 Time: 0.004412 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 256 Time: 0.004304 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 589 copy (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.002748 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.002748 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 589 copy (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.002816 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 589 copy (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.00334 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00334 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 589 copy (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.002824 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.002824 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 1028 copy (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003332 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003332 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 1028 copy (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.00326 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00326 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 1028 copy (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003196 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003196 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 1028 copy (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_234 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.001864 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.001864 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_234 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003032 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003032 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_234 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 234 copy (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.001896 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.001896 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 234 copy (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 254 copy (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.001868 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.001868 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 254 copy (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: reformat: Float(1014,169,13,1) -> Half(1014,169,13,1) (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.00396 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00396 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: reformat: Half(1014,169,13,1) -> Float(1014,169,13,1) (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] *************** Autotuning format combination: Float(1014,169,13,1) -> Float(1014,169,13,1) *************** [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_347 (Unary) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.00242 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00242 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Unary Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] *************** Autotuning format combination: Half(1014,169,13,1) -> Half(1014,169,13,1) *************** [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_347 (Unary) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.00216 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00216 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Unary Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: reformat: Float(1014,169,13,1) -> Half(1014,169,13,1) (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.004072 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.004072 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: reformat: Half(1014,169,13,1) -> Float(1014,169,13,1) (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003068 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003068 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_431 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.001872 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.001872 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_431 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_431 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_431 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003048 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003048 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_431 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_431 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.002424 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.002424 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_424 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.001848 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.001848 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_424 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_424 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003048 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003048 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_424 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_424 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003036 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003036 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_424 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.002304 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.002304 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_403 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.001828 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.001828 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_403 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_403 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_403 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003044 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003044 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_403 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003048 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003048 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_403 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.002244 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.002244 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_396 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.001844 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.001844 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_396 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_396 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003048 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003048 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_396 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003052 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003052 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_396 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_396 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.002352 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.002352 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_375 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.001864 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.001864 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_375 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003032 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003032 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_375 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003048 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003048 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_375 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_375 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_375 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.002372 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.002372 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_368 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.00184 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00184 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_368 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003048 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003048 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_368 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003068 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003068 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_368 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_368 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_368 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.002248 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.002248 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_229 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.001832 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.001832 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_229 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003048 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003048 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: node_of_229 (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 229 copy (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.001828 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.001828 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 229 copy (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 229 copy (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003124 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003124 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 229 copy (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 249 copy (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.001836 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.001836 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 249 copy (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.00312 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00312 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 249 copy (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.00304 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 249 copy (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: reformat: Float(676,676,26,1) -> Float(676,1,26,1) (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003016 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003016 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: reformat: Float(676,676,26,1) -> Half(676,676,26,1) (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003976 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003976 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: reformat: Float(676,1,26,1) -> Float(676,676,26,1) (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: reformat: Float(676,1,26,1) -> Half(676,676,26,1) (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: reformat: Half(676,676,26,1) -> Float(676,676,26,1) (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003032 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003032 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: reformat: Half(676,676,26,1) -> Float(676,1,26,1) (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] *************** Autotuning format combination: Float(676,676,26,1) -> Float(2028,676,26,1) *************** [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 871 + (Unnamed Layer* 622) [Shuffle] + node_of_872 (Scale) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003052 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003052 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] *************** Autotuning format combination: Float(676,1,26,1) -> Float(2028,1,78,3) *************** [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 871 + (Unnamed Layer* 622) [Shuffle] + node_of_872 (Scale) [07/07/2021-20:02:10] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:10] [V] [TRT] *************** Autotuning format combination: Half(676,676,26,1) -> Half(2028,676,26,1) *************** [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 871 + (Unnamed Layer* 622) [Shuffle] + node_of_872 (Scale) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.00314 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00314 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: reformat: Float(2028,676,26,1) -> Float(2028,1,78,3) (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003004 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003004 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: reformat: Float(2028,676,26,1) -> Half(2028,676,26,1) (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003108 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003108 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: reformat: Float(2028,1,78,3) -> Float(2028,676,26,1) (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: reformat: Float(2028,1,78,3) -> Half(2028,676,26,1) (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003016 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003016 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: reformat: Half(2028,676,26,1) -> Float(2028,676,26,1) (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003016 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003016 [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: reformat: Half(2028,676,26,1) -> Float(2028,1,78,3) (Reformat) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003 [07/07/2021-20:02:10] [V] [TRT] *************** Autotuning format combination: Float(676,676,26,1) -> Float(2028,676,26,1) *************** [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 864 + (Unnamed Layer* 618) [Shuffle] + node_of_865 (Scale) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] *************** Autotuning format combination: Float(676,1,26,1) -> Float(2028,1,78,3) *************** [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 864 + (Unnamed Layer* 618) [Shuffle] + node_of_865 (Scale) [07/07/2021-20:02:10] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:10] [V] [TRT] *************** Autotuning format combination: Half(676,676,26,1) -> Half(2028,676,26,1) *************** [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 864 + (Unnamed Layer* 618) [Shuffle] + node_of_865 (Scale) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.003132 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.003132 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] *************** Autotuning format combination: Float(676,676,26,1) -> Float(676,676,26,1) *************** [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 843 + (Unnamed Layer* 608) [Shuffle] + node_of_844 (Scale) [07/07/2021-20:02:10] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:10] [V] [TRT] *************** Autotuning format combination: Float(676,1,26,1) -> Float(676,1,26,1) *************** [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 843 + (Unnamed Layer* 608) [Shuffle] + node_of_844 (Scale) [07/07/2021-20:02:10] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:10] [V] [TRT] *************** Autotuning format combination: Half(676,676,26,1) -> Half(676,676,26,1) *************** [07/07/2021-20:02:10] [V] [TRT] --------------- Timing Runner: 843 + (Unnamed Layer* 608) [Shuffle] + node_of_844 (Scale) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003048 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003048 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Float(676,676,26,1) -> Float(676,676,26,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 836 + (Unnamed Layer* 604) [Shuffle] + node_of_837 (Scale) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Float(676,1,26,1) -> Float(676,1,26,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 836 + (Unnamed Layer* 604) [Shuffle] + node_of_837 (Scale) [07/07/2021-20:02:11] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Half(676,676,26,1) -> Half(676,676,26,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 836 + (Unnamed Layer* 604) [Shuffle] + node_of_837 (Scale) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Float(676,676,26,1) -> Float(676,676,26,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 815 + (Unnamed Layer* 594) [Shuffle] + node_of_816 (Scale) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Float(676,1,26,1) -> Float(676,1,26,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 815 + (Unnamed Layer* 594) [Shuffle] + node_of_816 (Scale) [07/07/2021-20:02:11] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Half(676,676,26,1) -> Half(676,676,26,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 815 + (Unnamed Layer* 594) [Shuffle] + node_of_816 (Scale) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003328 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003328 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 816 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.001868 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.001868 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 816 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003172 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003172 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 816 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002552 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002552 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 816 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002624 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 816 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002624 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 816 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002688 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 816 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002808 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002808 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 816 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002688 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 816 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.001812 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.001812 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 844 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.001864 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.001864 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 844 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002808 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002808 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 844 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002776 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002776 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 844 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002828 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002828 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 844 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002816 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 844 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.0029 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0029 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 844 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002688 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 844 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002744 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002744 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 844 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.001808 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.001808 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Float(676,676,26,1) -> Float(676,676,26,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 808 + (Unnamed Layer* 590) [Shuffle] + node_of_809 (Scale) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003324 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003324 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Float(676,1,26,1) -> Float(676,1,26,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 808 + (Unnamed Layer* 590) [Shuffle] + node_of_809 (Scale) [07/07/2021-20:02:11] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Half(676,676,26,1) -> Half(676,676,26,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 808 + (Unnamed Layer* 590) [Shuffle] + node_of_809 (Scale) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003388 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003388 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 809 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.00186 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00186 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 809 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002684 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002684 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 809 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002684 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002684 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 809 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002812 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002812 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 809 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002744 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002744 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 809 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002856 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002856 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 809 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002692 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002692 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 809 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002924 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002924 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 809 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.001816 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.001816 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 837 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.0019 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0019 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 837 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 837 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003008 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 837 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 837 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.0031 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0031 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 837 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 837 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 837 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 837 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.001892 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.001892 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Float(169,169,13,1) -> Float(169,1,13,1) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Float(169,169,13,1) -> Half(169,169,13,1) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.00384 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00384 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Float(169,1,13,1) -> Float(169,169,13,1) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Float(169,1,13,1) -> Half(169,169,13,1) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003052 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003052 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Half(169,169,13,1) -> Float(169,169,13,1) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Half(169,169,13,1) -> Float(169,1,13,1) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.00304 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Float(169,169,13,1) -> Float(507,169,13,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 432 + (Unnamed Layer* 291) [Shuffle] + node_of_433 (Scale) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002672 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002672 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Float(169,1,13,1) -> Float(507,1,39,3) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 432 + (Unnamed Layer* 291) [Shuffle] + node_of_433 (Scale) [07/07/2021-20:02:11] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Half(169,169,13,1) -> Half(507,169,13,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 432 + (Unnamed Layer* 291) [Shuffle] + node_of_433 (Scale) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002116 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002116 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Float(507,169,13,1) -> Float(507,1,39,3) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Float(507,169,13,1) -> Half(507,169,13,1) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Float(507,1,39,3) -> Float(507,169,13,1) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003044 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003044 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Float(507,1,39,3) -> Half(507,169,13,1) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003052 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003052 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Half(507,169,13,1) -> Float(507,169,13,1) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003024 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003024 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Half(507,169,13,1) -> Float(507,1,39,3) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Float(169,169,13,1) -> Float(507,169,13,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 425 + (Unnamed Layer* 287) [Shuffle] + node_of_426 (Scale) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002416 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002416 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Float(169,1,13,1) -> Float(507,1,39,3) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 425 + (Unnamed Layer* 287) [Shuffle] + node_of_426 (Scale) [07/07/2021-20:02:11] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Half(169,169,13,1) -> Half(507,169,13,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 425 + (Unnamed Layer* 287) [Shuffle] + node_of_426 (Scale) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002432 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002432 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Float(169,169,13,1) -> Float(169,169,13,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 404 + (Unnamed Layer* 277) [Shuffle] + node_of_405 (Scale) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002476 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002476 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Float(169,1,13,1) -> Float(169,1,13,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 404 + (Unnamed Layer* 277) [Shuffle] + node_of_405 (Scale) [07/07/2021-20:02:11] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Half(169,169,13,1) -> Half(169,169,13,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 404 + (Unnamed Layer* 277) [Shuffle] + node_of_405 (Scale) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002224 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002224 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Float(169,169,13,1) -> Float(169,169,13,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 397 + (Unnamed Layer* 273) [Shuffle] + node_of_398 (Scale) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002404 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002404 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Float(169,1,13,1) -> Float(169,1,13,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 397 + (Unnamed Layer* 273) [Shuffle] + node_of_398 (Scale) [07/07/2021-20:02:11] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Half(169,169,13,1) -> Half(169,169,13,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 397 + (Unnamed Layer* 273) [Shuffle] + node_of_398 (Scale) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002176 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002176 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Float(169,169,13,1) -> Float(169,169,13,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 376 + (Unnamed Layer* 263) [Shuffle] + node_of_377 (Scale) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.00254 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00254 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Float(169,1,13,1) -> Float(169,1,13,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 376 + (Unnamed Layer* 263) [Shuffle] + node_of_377 (Scale) [07/07/2021-20:02:11] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Half(169,169,13,1) -> Half(169,169,13,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 376 + (Unnamed Layer* 263) [Shuffle] + node_of_377 (Scale) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002252 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002252 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 377 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.00178 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00178 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 377 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003052 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003052 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 377 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003036 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003036 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 377 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003008 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 377 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003052 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003052 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 377 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003016 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003016 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 377 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003076 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003076 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 377 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003004 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003004 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 377 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002236 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002236 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 405 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.001796 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.001796 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 405 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 405 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.00294 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00294 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 405 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002688 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 405 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002872 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002872 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 405 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002688 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 405 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.00256 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00256 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 405 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.00256 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00256 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 405 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.00254 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00254 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Float(169,169,13,1) -> Float(169,169,13,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 369 + (Unnamed Layer* 259) [Shuffle] + node_of_370 (Scale) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.00242 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00242 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Float(169,1,13,1) -> Float(169,1,13,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 369 + (Unnamed Layer* 259) [Shuffle] + node_of_370 (Scale) [07/07/2021-20:02:11] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Half(169,169,13,1) -> Half(169,169,13,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 369 + (Unnamed Layer* 259) [Shuffle] + node_of_370 (Scale) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002488 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002488 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 370 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.001836 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.001836 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 370 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.00268 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00268 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 370 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002556 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002556 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 370 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002704 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002704 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 370 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.00262 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00262 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 370 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002684 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002684 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 370 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002684 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002684 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 370 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002944 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002944 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 370 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002568 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002568 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 398 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.001776 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.001776 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 398 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002688 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 398 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002768 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002768 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 398 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002752 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 398 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002552 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002552 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 398 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002652 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002652 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 398 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002684 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002684 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 398 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002852 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002852 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: 398 copy (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.002496 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.002496 [07/07/2021-20:02:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Float(4056,676,26,1) -> Float(4056,1,156,6) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003392 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003392 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Float(4056,676,26,1) -> Float(676,676:32,26,1) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.006528 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.006528 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Float(4056,1,156,6) -> Float(4056,676,26,1) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003512 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003512 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Float(4056,1,156,6) -> Float(676,676:32,26,1) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.006456 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.006456 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Float(4056,1,156,6) -> Half(4056,676,26,1) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003376 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003376 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Float(676,676:32,26,1) -> Float(4056,676,26,1) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003312 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003312 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Float(676,676:32,26,1) -> Float(4056,1,156,6) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003444 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003444 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Float(676,676:32,26,1) -> Half(4056,676,26,1) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003372 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003372 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Half(4056,676,26,1) -> Float(4056,1,156,6) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.003316 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.003316 [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: reformat: Half(4056,676,26,1) -> Float(676,676:32,26,1) (Reformat) [07/07/2021-20:02:11] [V] [TRT] Tactic: 0 Time: 0.006384 [07/07/2021-20:02:11] [V] [TRT] Fastest Tactic: 0 Time: 0.006384 [07/07/2021-20:02:11] [V] [TRT] *************** Autotuning format combination: Float(4056,676,26,1) -> Float(4056,676,26,1) *************** [07/07/2021-20:02:11] [V] [TRT] --------------- Timing Runner: PWN(784 + (Unnamed Layer* 577) [Shuffle], PWN(PWN(PWN(node_of_781), 782 + (Unnamed Layer* 574) [Shuffle] + node_of_783), node_of_785)) (PointWiseV2) [07/07/2021-20:02:12] [V] [TRT] Tactic: 0 Time: 0.00268 [07/07/2021-20:02:12] [V] [TRT] Tactic: 1 Time: 0.003348 [07/07/2021-20:02:12] [V] [TRT] Tactic: 2 Time: 0.003408 [07/07/2021-20:02:12] [V] [TRT] Tactic: 3 Time: 0.00358 [07/07/2021-20:02:12] [V] [TRT] Tactic: 4 Time: 0.003432 [07/07/2021-20:02:13] [V] [TRT] Tactic: 5 Time: 0.00352 [07/07/2021-20:02:13] [V] [TRT] Tactic: 6 Time: 0.004544 [07/07/2021-20:02:13] [V] [TRT] Tactic: 7 Time: 0.003896 [07/07/2021-20:02:13] [V] [TRT] Tactic: 8 Time: 0.00358 [07/07/2021-20:02:13] [V] [TRT] Tactic: 9 Time: 0.003584 [07/07/2021-20:02:13] [V] [TRT] Tactic: 28 Time: 0.002752 [07/07/2021-20:02:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00268 [07/07/2021-20:02:13] [V] [TRT] --------------- Timing Runner: PWN(784 + (Unnamed Layer* 577) [Shuffle], PWN(PWN(PWN(node_of_781), 782 + (Unnamed Layer* 574) [Shuffle] + node_of_783), node_of_785)) (PointWise) [07/07/2021-20:02:14] [V] [TRT] Tactic: 128 Time: 0.003584 [07/07/2021-20:02:14] [V] [TRT] Tactic: 256 Time: 0.003664 [07/07/2021-20:02:14] [V] [TRT] Tactic: 512 Time: 0.004416 [07/07/2021-20:02:14] [V] [TRT] Fastest Tactic: 128 Time: 0.003584 [07/07/2021-20:02:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [07/07/2021-20:02:14] [V] [TRT] *************** Autotuning format combination: Float(4056,1,156,6) -> Float(4056,1,156,6) *************** [07/07/2021-20:02:14] [V] [TRT] --------------- Timing Runner: PWN(784 + (Unnamed Layer* 577) [Shuffle], PWN(PWN(PWN(node_of_781), 782 + (Unnamed Layer* 574) [Shuffle] + node_of_783), node_of_785)) (PointWiseV2) [07/07/2021-20:02:14] [V] [TRT] Tactic: 0 Time: 0.00256 [07/07/2021-20:02:14] [V] [TRT] Tactic: 1 Time: 0.003316 [07/07/2021-20:02:14] [V] [TRT] Tactic: 2 Time: 0.00336 [07/07/2021-20:02:14] [V] [TRT] Tactic: 3 Time: 0.003452 [07/07/2021-20:02:14] [V] [TRT] Tactic: 4 Time: 0.003268 [07/07/2021-20:02:14] [V] [TRT] Tactic: 5 Time: 0.003456 [07/07/2021-20:02:14] [V] [TRT] Tactic: 6 Time: 0.00448 [07/07/2021-20:02:14] [V] [TRT] Tactic: 7 Time: 0.003772 [07/07/2021-20:02:14] [V] [TRT] Tactic: 8 Time: 0.003568 [07/07/2021-20:02:14] [V] [TRT] Tactic: 9 Time: 0.003448 [07/07/2021-20:02:14] [V] [TRT] Tactic: 28 Time: 0.002764 [07/07/2021-20:02:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00256 [07/07/2021-20:02:14] [V] [TRT] --------------- Timing Runner: PWN(784 + (Unnamed Layer* 577) [Shuffle], PWN(PWN(PWN(node_of_781), 782 + (Unnamed Layer* 574) [Shuffle] + node_of_783), node_of_785)) (PointWise) [07/07/2021-20:02:14] [V] [TRT] Tactic: 128 Time: 0.003576 [07/07/2021-20:02:14] [V] [TRT] Tactic: 256 Time: 0.00362 [07/07/2021-20:02:14] [V] [TRT] Tactic: 512 Time: 0.004212 [07/07/2021-20:02:14] [V] [TRT] Fastest Tactic: 128 Time: 0.003576 [07/07/2021-20:02:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [07/07/2021-20:02:14] [V] [TRT] *************** Autotuning format combination: Float(676,676:32,26,1) -> Float(676,676:32,26,1) *************** [07/07/2021-20:02:14] [V] [TRT] --------------- Timing Runner: PWN(784 + (Unnamed Layer* 577) [Shuffle], PWN(PWN(PWN(node_of_781), 782 + (Unnamed Layer* 574) [Shuffle] + node_of_783), node_of_785)) (PointWiseV2) [07/07/2021-20:02:14] [V] [TRT] Tactic: 24 Time: 0.00358 [07/07/2021-20:02:14] [V] [TRT] Tactic: 25 Time: 0.00422 [07/07/2021-20:02:14] [V] [TRT] Tactic: 26 Time: 0.005392 [07/07/2021-20:02:14] [V] [TRT] Tactic: 27 Time: 0.007428 [07/07/2021-20:02:15] [V] [TRT] Tactic: 31 Time: 0.004624 [07/07/2021-20:02:15] [V] [TRT] Fastest Tactic: 24 Time: 0.00358 [07/07/2021-20:02:15] [V] [TRT] --------------- Timing Runner: PWN(784 + (Unnamed Layer* 577) [Shuffle], PWN(PWN(PWN(node_of_781), 782 + (Unnamed Layer* 574) [Shuffle] + node_of_783), node_of_785)) (PointWise) [07/07/2021-20:02:15] [V] [TRT] Tactic: 128 Time: 0.007372 [07/07/2021-20:02:15] [V] [TRT] Tactic: 256 Time: 0.007612 [07/07/2021-20:02:15] [V] [TRT] Tactic: 512 Time: 0.007412 [07/07/2021-20:02:15] [V] [TRT] Fastest Tactic: 128 Time: 0.007372 [07/07/2021-20:02:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [07/07/2021-20:02:15] [V] [TRT] *************** Autotuning format combination: Half(4056,676,26,1) -> Half(4056,676,26,1) *************** [07/07/2021-20:02:15] [V] [TRT] --------------- Timing Runner: PWN(784 + (Unnamed Layer* 577) [Shuffle], PWN(PWN(PWN(node_of_781), 782 + (Unnamed Layer* 574) [Shuffle] + node_of_783), node_of_785)) (PointWiseV2) [07/07/2021-20:02:15] [V] [TRT] Tactic: 0 Time: 0.002804 [07/07/2021-20:02:15] [V] [TRT] Tactic: 1 Time: 0.003344 [07/07/2021-20:02:15] [V] [TRT] Tactic: 2 Time: 0.00352 [07/07/2021-20:02:15] [V] [TRT] Tactic: 3 Time: 0.004664 [07/07/2021-20:02:16] [V] [TRT] Tactic: 4 Time: 0.003384 [07/07/2021-20:02:16] [V] [TRT] Tactic: 5 Time: 0.003392 [07/07/2021-20:02:16] [V] [TRT] Tactic: 6 Time: 0.004544 [07/07/2021-20:02:16] [V] [TRT] Tactic: 7 Time: 0.004348 [07/07/2021-20:02:16] [V] [TRT] Tactic: 8 Time: 0.003708 [07/07/2021-20:02:17] [V] [TRT] Tactic: 9 Time: 0.00352 [07/07/2021-20:02:17] [V] [TRT] Tactic: 28 Time: 0.002668 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 28 Time: 0.002668 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: PWN(784 + (Unnamed Layer* 577) [Shuffle], PWN(PWN(PWN(node_of_781), 782 + (Unnamed Layer* 574) [Shuffle] + node_of_783), node_of_785)) (PointWise) [07/07/2021-20:02:17] [V] [TRT] Tactic: 128 Time: 0.007744 [07/07/2021-20:02:17] [V] [TRT] Tactic: 256 Time: 0.006776 [07/07/2021-20:02:17] [V] [TRT] Tactic: 512 Time: 0.007616 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 256 Time: 0.006776 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: reformat: Float(4056,676,26,1) -> Float(4056,1,156,6) (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.00352 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00352 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: reformat: Float(4056,676,26,1) -> Float(676,676:32,26,1) (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.006484 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.006484 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: reformat: Float(4056,1,156,6) -> Float(4056,676,26,1) (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003372 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003372 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: reformat: Float(4056,1,156,6) -> Float(676,676:32,26,1) (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.006448 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.006448 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: reformat: Float(4056,1,156,6) -> Half(4056,676,26,1) (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003244 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003244 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: reformat: Float(676,676:32,26,1) -> Float(4056,676,26,1) (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003196 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003196 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: reformat: Float(676,676:32,26,1) -> Float(4056,1,156,6) (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: reformat: Float(676,676:32,26,1) -> Half(4056,676,26,1) (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003148 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003148 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: reformat: Half(4056,676,26,1) -> Float(4056,1,156,6) (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: reformat: Half(4056,676,26,1) -> Float(676,676:32,26,1) (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.006144 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_856 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.001872 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.001872 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_856 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.002968 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.002968 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_856 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_856 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.00298 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00298 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_856 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_856 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_856 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003064 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003064 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_856 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.00302 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00302 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_856 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003384 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003384 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_856 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003448 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003448 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_856 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.002636 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.002636 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_856 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.0018 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0018 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_849 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.001868 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.001868 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_849 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.002688 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_849 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.002768 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.002768 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_849 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.00268 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00268 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_849 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.002624 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_849 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.002576 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.002576 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_849 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003212 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003212 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_849 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.004256 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.004256 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_849 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003316 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003316 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_849 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003256 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003256 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_849 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.0028 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0028 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_849 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.001812 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.001812 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_828 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.001876 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.001876 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_828 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.002808 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.002808 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_828 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.00274 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00274 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_828 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.002752 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_828 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.002808 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.002808 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_828 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_828 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.00304 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_828 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003132 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003132 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_828 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.00304 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_828 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_828 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_828 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.00186 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00186 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_821 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.001916 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.001916 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_821 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_821 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_821 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003032 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003032 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_821 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_821 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_821 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_821 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_821 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003032 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003032 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_821 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_821 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003052 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003052 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_821 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.001864 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.001864 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_800 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.001916 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.001916 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_800 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_800 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.002992 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.002992 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_800 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003036 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003036 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_800 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003004 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003004 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_800 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_800 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_800 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003004 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003004 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_800 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_800 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.00304 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_800 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003008 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_800 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.00182 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00182 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_793 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.001884 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.001884 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_793 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_793 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_793 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_793 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_793 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003044 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003044 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_793 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003048 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003048 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_793 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003252 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003252 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_793 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003468 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003468 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_793 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003504 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003504 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_793 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.00288 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00288 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: node_of_793 (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.0018 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0018 [07/07/2021-20:02:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: reformat: Float(1014,169,13,1) -> Float(1014,1,78,6) (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.002816 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: reformat: Float(1014,169,13,1) -> Float(169,169:32,13,1) (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003384 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003384 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: reformat: Float(1014,1,78,6) -> Float(1014,169,13,1) (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.00344 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00344 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: reformat: Float(1014,1,78,6) -> Float(169,169:32,13,1) (Reformat) [07/07/2021-20:02:17] [V] [TRT] Tactic: 0 Time: 0.003572 [07/07/2021-20:02:17] [V] [TRT] Fastest Tactic: 0 Time: 0.003572 [07/07/2021-20:02:17] [V] [TRT] --------------- Timing Runner: reformat: Float(1014,1,78,6) -> Half(1014,169,13,1) (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003436 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003436 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: reformat: Float(169,169:32,13,1) -> Float(1014,169,13,1) (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003384 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003384 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: reformat: Float(169,169:32,13,1) -> Float(1014,1,78,6) (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003144 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003144 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: reformat: Float(169,169:32,13,1) -> Half(1014,169,13,1) (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003392 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003392 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: reformat: Half(1014,169,13,1) -> Float(1014,1,78,6) (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.00334 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00334 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: reformat: Half(1014,169,13,1) -> Float(169,169:32,13,1) (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003504 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003504 [07/07/2021-20:02:18] [V] [TRT] *************** Autotuning format combination: Float(1014,169,13,1) -> Float(1014,169,13,1) *************** [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: PWN(345 + (Unnamed Layer* 246) [Shuffle], PWN(PWN(PWN(node_of_342), 343 + (Unnamed Layer* 243) [Shuffle] + node_of_344), node_of_346)) (PointWiseV2) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.00264 [07/07/2021-20:02:18] [V] [TRT] Tactic: 1 Time: 0.00338 [07/07/2021-20:02:18] [V] [TRT] Tactic: 2 Time: 0.002748 [07/07/2021-20:02:18] [V] [TRT] Tactic: 3 Time: 0.003448 [07/07/2021-20:02:18] [V] [TRT] Tactic: 4 Time: 0.003576 [07/07/2021-20:02:18] [V] [TRT] Tactic: 5 Time: 0.003516 [07/07/2021-20:02:18] [V] [TRT] Tactic: 6 Time: 0.004412 [07/07/2021-20:02:18] [V] [TRT] Tactic: 7 Time: 0.0037 [07/07/2021-20:02:18] [V] [TRT] Tactic: 8 Time: 0.003392 [07/07/2021-20:02:18] [V] [TRT] Tactic: 9 Time: 0.003452 [07/07/2021-20:02:18] [V] [TRT] Tactic: 28 Time: 0.002688 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00264 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: PWN(345 + (Unnamed Layer* 246) [Shuffle], PWN(PWN(PWN(node_of_342), 343 + (Unnamed Layer* 243) [Shuffle] + node_of_344), node_of_346)) (PointWise) [07/07/2021-20:02:18] [V] [TRT] Tactic: 128 Time: 0.003628 [07/07/2021-20:02:18] [V] [TRT] Tactic: 256 Time: 0.003516 [07/07/2021-20:02:18] [V] [TRT] Tactic: 512 Time: 0.00364 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 256 Time: 0.003516 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] *************** Autotuning format combination: Float(1014,1,78,6) -> Float(1014,1,78,6) *************** [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: PWN(345 + (Unnamed Layer* 246) [Shuffle], PWN(PWN(PWN(node_of_342), 343 + (Unnamed Layer* 243) [Shuffle] + node_of_344), node_of_346)) (PointWiseV2) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.002592 [07/07/2021-20:02:18] [V] [TRT] Tactic: 1 Time: 0.003096 [07/07/2021-20:02:18] [V] [TRT] Tactic: 2 Time: 0.00288 [07/07/2021-20:02:18] [V] [TRT] Tactic: 3 Time: 0.003392 [07/07/2021-20:02:18] [V] [TRT] Tactic: 4 Time: 0.003368 [07/07/2021-20:02:18] [V] [TRT] Tactic: 5 Time: 0.003172 [07/07/2021-20:02:18] [V] [TRT] Tactic: 6 Time: 0.00428 [07/07/2021-20:02:18] [V] [TRT] Tactic: 7 Time: 0.003584 [07/07/2021-20:02:18] [V] [TRT] Tactic: 8 Time: 0.003452 [07/07/2021-20:02:18] [V] [TRT] Tactic: 9 Time: 0.003508 [07/07/2021-20:02:18] [V] [TRT] Tactic: 28 Time: 0.002496 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 28 Time: 0.002496 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: PWN(345 + (Unnamed Layer* 246) [Shuffle], PWN(PWN(PWN(node_of_342), 343 + (Unnamed Layer* 243) [Shuffle] + node_of_344), node_of_346)) (PointWise) [07/07/2021-20:02:18] [V] [TRT] Tactic: 128 Time: 0.003264 [07/07/2021-20:02:18] [V] [TRT] Tactic: 256 Time: 0.003272 [07/07/2021-20:02:18] [V] [TRT] Tactic: 512 Time: 0.003456 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 128 Time: 0.003264 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [07/07/2021-20:02:18] [V] [TRT] *************** Autotuning format combination: Float(169,169:32,13,1) -> Float(169,169:32,13,1) *************** [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: PWN(345 + (Unnamed Layer* 246) [Shuffle], PWN(PWN(PWN(node_of_342), 343 + (Unnamed Layer* 243) [Shuffle] + node_of_344), node_of_346)) (PointWiseV2) [07/07/2021-20:02:18] [V] [TRT] Tactic: 24 Time: 0.003072 [07/07/2021-20:02:18] [V] [TRT] Tactic: 25 Time: 0.004156 [07/07/2021-20:02:18] [V] [TRT] Tactic: 26 Time: 0.00512 [07/07/2021-20:02:18] [V] [TRT] Tactic: 27 Time: 0.007152 [07/07/2021-20:02:18] [V] [TRT] Tactic: 31 Time: 0.003172 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 24 Time: 0.003072 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: PWN(345 + (Unnamed Layer* 246) [Shuffle], PWN(PWN(PWN(node_of_342), 343 + (Unnamed Layer* 243) [Shuffle] + node_of_344), node_of_346)) (PointWise) [07/07/2021-20:02:18] [V] [TRT] Tactic: 128 Time: 0.00408 [07/07/2021-20:02:18] [V] [TRT] Tactic: 256 Time: 0.00408 [07/07/2021-20:02:18] [V] [TRT] Tactic: 512 Time: 0.004092 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 128 Time: 0.00408 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [07/07/2021-20:02:18] [V] [TRT] *************** Autotuning format combination: Half(1014,169,13,1) -> Half(1014,169,13,1) *************** [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: PWN(345 + (Unnamed Layer* 246) [Shuffle], PWN(PWN(PWN(node_of_342), 343 + (Unnamed Layer* 243) [Shuffle] + node_of_344), node_of_346)) (PointWiseV2) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.002936 [07/07/2021-20:02:18] [V] [TRT] Tactic: 1 Time: 0.003072 [07/07/2021-20:02:18] [V] [TRT] Tactic: 2 Time: 0.00304 [07/07/2021-20:02:18] [V] [TRT] Tactic: 3 Time: 0.003072 [07/07/2021-20:02:18] [V] [TRT] Tactic: 4 Time: 0.003056 [07/07/2021-20:02:18] [V] [TRT] Tactic: 5 Time: 0.003072 [07/07/2021-20:02:18] [V] [TRT] Tactic: 6 Time: 0.004224 [07/07/2021-20:02:18] [V] [TRT] Tactic: 7 Time: 0.004024 [07/07/2021-20:02:18] [V] [TRT] Tactic: 8 Time: 0.003512 [07/07/2021-20:02:18] [V] [TRT] Tactic: 9 Time: 0.003708 [07/07/2021-20:02:18] [V] [TRT] Tactic: 28 Time: 0.002616 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 28 Time: 0.002616 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: PWN(345 + (Unnamed Layer* 246) [Shuffle], PWN(PWN(PWN(node_of_342), 343 + (Unnamed Layer* 243) [Shuffle] + node_of_344), node_of_346)) (PointWise) [07/07/2021-20:02:18] [V] [TRT] Tactic: 128 Time: 0.008288 [07/07/2021-20:02:18] [V] [TRT] Tactic: 256 Time: 0.007816 [07/07/2021-20:02:18] [V] [TRT] Tactic: 512 Time: 0.007524 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 512 Time: 0.007524 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: reformat: Float(1014,169,13,1) -> Float(1014,1,78,6) (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.00256 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00256 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: reformat: Float(1014,169,13,1) -> Float(169,169:32,13,1) (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003392 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003392 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: reformat: Float(1014,1,78,6) -> Float(1014,169,13,1) (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003388 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003388 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: reformat: Float(1014,1,78,6) -> Float(169,169:32,13,1) (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003444 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003444 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: reformat: Float(1014,1,78,6) -> Half(1014,169,13,1) (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003136 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003136 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: reformat: Float(169,169:32,13,1) -> Float(1014,169,13,1) (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003444 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003444 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: reformat: Float(169,169:32,13,1) -> Float(1014,1,78,6) (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003388 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003388 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: reformat: Float(169,169:32,13,1) -> Half(1014,169,13,1) (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.00346 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00346 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: reformat: Half(1014,169,13,1) -> Float(1014,1,78,6) (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003312 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003312 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: reformat: Half(1014,169,13,1) -> Float(169,169:32,13,1) (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003372 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003372 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_417 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.001804 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.001804 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_417 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.002952 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.002952 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_417 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003004 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003004 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_417 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_417 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003076 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003076 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_417 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003084 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003084 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_417 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_417 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_417 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_417 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_417 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_417 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.002048 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.002048 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_410 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.001816 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.001816 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_410 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003052 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003052 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_410 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_410 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003036 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003036 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_410 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003008 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_410 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003132 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003132 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_410 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_410 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003036 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003036 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_410 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_410 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_410 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_410 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.002176 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.002176 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_389 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.001824 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.001824 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_389 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_389 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.002956 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.002956 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_389 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.002944 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.002944 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_389 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003016 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003016 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_389 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_389 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_389 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003404 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003404 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_389 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003456 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_389 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003336 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003336 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_389 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.00274 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00274 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_389 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.002556 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.002556 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_382 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.001796 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.001796 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_382 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.002692 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.002692 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_382 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.00256 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00256 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_382 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.002748 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.002748 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_382 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.00268 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00268 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_382 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.002624 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_382 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.00328 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00328 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_382 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003264 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003264 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_382 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003452 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003452 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_382 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003384 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003384 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_382 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.00262 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00262 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_382 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.002352 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.002352 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_361 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.001788 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.001788 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_361 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003016 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003016 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_361 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003052 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003052 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_361 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_361 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003044 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003044 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_361 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_361 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_361 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_361 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.003124 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.003124 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_361 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.0034 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.0034 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_361 (Reformat) [07/07/2021-20:02:18] [V] [TRT] Tactic: 0 Time: 0.002684 [07/07/2021-20:02:18] [V] [TRT] Fastest Tactic: 0 Time: 0.002684 [07/07/2021-20:02:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:18] [V] [TRT] --------------- Timing Runner: node_of_361 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002432 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002432 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_354 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.001772 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.001772 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_354 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002816 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_354 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002612 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002612 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_354 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002684 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002684 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_354 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002684 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002684 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_354 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002684 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002684 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_354 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00334 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00334 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_354 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003324 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003324 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_354 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003228 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003228 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_354 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.0034 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.0034 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_354 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002604 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002604 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_354 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002552 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002552 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Float(676,676,26,1) -> Float(2028,676,26,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 857 + node_of_858 (Scale) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003436 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003436 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Float(676,1,26,1) -> Float(2028,1,78,3) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 857 + node_of_858 (Scale) [07/07/2021-20:02:19] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Half(676,676,26,1) -> Half(2028,676,26,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 857 + node_of_858 (Scale) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003452 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003452 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Float(676,676,26,1) -> Float(2028,676,26,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 850 + node_of_851 (Scale) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003388 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003388 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Float(676,1,26,1) -> Float(2028,1,78,3) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 850 + node_of_851 (Scale) [07/07/2021-20:02:19] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Half(676,676,26,1) -> Half(2028,676,26,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 850 + node_of_851 (Scale) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003536 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003536 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Float(676,676,26,1) -> Float(676,676,26,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 829 + node_of_830 (Scale) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003348 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003348 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Float(676,1,26,1) -> Float(676,1,26,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 829 + node_of_830 (Scale) [07/07/2021-20:02:19] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Half(676,676,26,1) -> Half(676,676,26,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 829 + node_of_830 (Scale) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003444 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003444 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Float(676,676,26,1) -> Float(676,676,26,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 822 + node_of_823 (Scale) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003104 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003104 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Float(676,1,26,1) -> Float(676,1,26,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 822 + node_of_823 (Scale) [07/07/2021-20:02:19] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Half(676,676,26,1) -> Half(676,676,26,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 822 + node_of_823 (Scale) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Float(676,676,26,1) -> Float(676,676,26,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 801 + node_of_802 (Scale) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Float(676,1,26,1) -> Float(676,1,26,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 801 + node_of_802 (Scale) [07/07/2021-20:02:19] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Half(676,676,26,1) -> Half(676,676,26,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 801 + node_of_802 (Scale) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 802 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.001956 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.001956 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 802 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003032 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003032 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 802 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 802 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003048 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003048 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 802 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003052 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003052 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 802 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 802 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003044 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003044 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 802 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 802 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.001888 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.001888 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 830 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.001952 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.001952 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 830 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003044 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003044 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 830 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 830 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00302 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00302 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 830 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 830 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003016 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003016 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 830 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003052 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003052 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 830 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003032 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003032 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 830 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.001816 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.001816 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 874 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002116 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002116 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 874 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003052 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003052 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 874 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003048 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003048 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 874 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 874 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 874 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 874 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 874 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 874 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.001944 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.001944 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 876 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002112 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002112 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 876 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.005632 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.005632 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 876 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00326 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00326 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 876 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00332 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00332 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 876 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.005568 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.005568 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 876 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003344 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003344 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 876 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003472 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003472 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 876 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.005628 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.005628 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 876 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.001928 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.001928 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: reformat: Float(1,1,1,1) -> Float(1,1:32,1,1) (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00328 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00328 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: reformat: Float(1,1,1,1) -> Half(1,1,1,1) (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002168 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002168 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: reformat: Float(1,1:32,1,1) -> Float(1,1,1,1) (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003044 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003044 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: reformat: Float(1,1:32,1,1) -> Half(1,1,1,1) (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003136 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003136 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: reformat: Half(1,1,1,1) -> Float(1,1,1,1) (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002048 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002048 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: reformat: Half(1,1,1,1) -> Float(1,1:32,1,1) (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Float(4056,676,26,1), Float(1,1,1,1) -> Float(4056,676,26,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_888 (ElementWise) [07/07/2021-20:02:19] [V] [TRT] Tactic: 1 Time: 0.003072 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 1 Time: 0.003072 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Float(676,676:32,26,1), Float(1,1:32,1,1) -> Float(676,676:32,26,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_888 (ElementWise) [07/07/2021-20:02:19] [V] [TRT] Tactic: 1 Time: 0.004156 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 1 Time: 0.004156 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Half(4056,676,26,1), Half(1,1,1,1) -> Half(4056,676,26,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_888 (ElementWise) [07/07/2021-20:02:19] [V] [TRT] Tactic: 1 Time: 0.003072 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 1 Time: 0.003072 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_962 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002136 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002136 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_962 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_962 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00618 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00618 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_962 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003452 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003452 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_962 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00338 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00338 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_962 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003284 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003284 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_962 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.006504 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.006504 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_962 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00352 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00352 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_962 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003448 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003448 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_962 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003584 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003584 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_962 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.006592 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.006592 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_962 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00194 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00194 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Float(2028,676,26,1) -> Float(2028,1,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_980 (Shuffle) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002364 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002364 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Float(2028,1,78,3) -> Float(1,2,2) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_980 (Shuffle) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003372 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003372 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Float(676,676:32,26,1) -> Float(2028:32,1,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_980 (Shuffle) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.007656 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.007656 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Half(2028,676,26,1) -> Half(2028,1,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_980 (Shuffle) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00248 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00248 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: reformat: Float(2028,1,1) -> Float(1,2,2) (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00328 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00328 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: reformat: Float(2028,1,1) -> Float(2028:32,1,1) (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.0076 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.0076 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: reformat: Float(2028,1,1) -> Half(2028,1,1) (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003568 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003568 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: reformat: Float(1,2,2) -> Float(2028,1,1) (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003252 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003252 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: reformat: Float(1,2,2) -> Float(2028:32,1,1) (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00766 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00766 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: reformat: Float(1,2,2) -> Half(2028,1,1) (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00318 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00318 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: reformat: Float(2028:32,1,1) -> Float(2028,1,1) (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003312 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003312 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: reformat: Float(2028:32,1,1) -> Float(1,2,2) (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003368 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003368 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: reformat: Float(2028:32,1,1) -> Half(2028,1,1) (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003312 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003312 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: reformat: Half(2028,1,1) -> Float(2028,1,1) (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003252 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003252 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: reformat: Half(2028,1,1) -> Float(1,2,2) (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00352 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00352 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: reformat: Half(2028,1,1) -> Float(2028:32,1,1) (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00774 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00774 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_916 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002116 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002116 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_916 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003268 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003268 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_916 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.006484 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.006484 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_916 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003344 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003344 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_916 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003512 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003512 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_916 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003516 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003516 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_916 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.006472 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.006472 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_916 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00346 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00346 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_916 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003512 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003512 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_916 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00344 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00344 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_916 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.006588 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.006588 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_916 (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.001936 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.001936 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Float(2028,676,26,1) -> Float(2028,1,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_934 (Shuffle) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00248 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00248 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Float(2028,1,78,3) -> Float(1,2,2) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_934 (Shuffle) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003456 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Float(676,676:32,26,1) -> Float(2028:32,1,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_934 (Shuffle) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00778 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00778 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Half(2028,676,26,1) -> Half(2028,1,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: node_of_934 (Shuffle) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002372 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002372 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Float(676,676,26,1) -> Float(676,676,26,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 794 + node_of_795 (Scale) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.003512 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.003512 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Float(676,1,26,1) -> Float(676,1,26,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 794 + node_of_795 (Scale) [07/07/2021-20:02:19] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:19] [V] [TRT] *************** Autotuning format combination: Half(676,676,26,1) -> Half(676,676,26,1) *************** [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 794 + node_of_795 (Scale) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00358 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00358 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 795 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.001868 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.001868 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 795 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002708 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002708 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 795 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002752 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 795 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002752 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 795 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00256 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00256 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 795 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002648 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002648 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 795 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002844 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002844 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 795 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002816 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002816 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 795 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.001804 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.001804 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 823 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00186 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00186 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 823 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002784 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002784 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 823 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002736 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002736 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 823 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002748 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002748 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 823 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002616 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002616 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 823 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002612 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002612 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 823 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.00264 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00264 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 823 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002812 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002812 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 823 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.001796 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.001796 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 873 copy (Reformat) [07/07/2021-20:02:19] [V] [TRT] Tactic: 0 Time: 0.002112 [07/07/2021-20:02:19] [V] [TRT] Fastest Tactic: 0 Time: 0.002112 [07/07/2021-20:02:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:19] [V] [TRT] --------------- Timing Runner: 873 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.00352 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00352 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 873 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003384 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003384 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 873 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003456 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 873 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003528 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003528 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 873 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003268 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003268 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 873 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.0035 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0035 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 873 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003376 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003376 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 873 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.001936 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.001936 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 875 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002112 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002112 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 875 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.005572 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.005572 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 875 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003136 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003136 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 875 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003404 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003404 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 875 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.005624 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.005624 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 875 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003384 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003384 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 875 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003444 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003444 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 875 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.00548 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00548 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 875 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.001952 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.001952 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(4056,676,26,1), Float(1,1,1,1) -> Float(4056,676,26,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_883 (ElementWise) [07/07/2021-20:02:20] [V] [TRT] Tactic: 1 Time: 0.003132 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 1 Time: 0.003132 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(676,676:32,26,1), Float(1,1:32,1,1) -> Float(676,676:32,26,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_883 (ElementWise) [07/07/2021-20:02:20] [V] [TRT] Tactic: 1 Time: 0.004096 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 1 Time: 0.004096 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Half(4056,676,26,1), Half(1,1,1,1) -> Half(4056,676,26,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_883 (ElementWise) [07/07/2021-20:02:20] [V] [TRT] Tactic: 1 Time: 0.003264 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 1 Time: 0.003264 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_939 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002124 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002124 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_939 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_939 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.006136 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.006136 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_939 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003124 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003124 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_939 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_939 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003132 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003132 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_939 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.006144 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_939 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_939 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.0031 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0031 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_939 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003128 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003128 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_939 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.006528 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.006528 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_939 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.001932 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.001932 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(2028,676,26,1) -> Float(2028,1,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_957 (Shuffle) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002356 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002356 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(2028,1,78,3) -> Float(1,2,2) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_957 (Shuffle) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003188 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003188 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(676,676:32,26,1) -> Float(2028:32,1,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_957 (Shuffle) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.009812 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.009812 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Half(2028,676,26,1) -> Half(2028,1,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_957 (Shuffle) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002316 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002316 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_893 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002112 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002112 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_893 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003328 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003328 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_893 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.006408 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.006408 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_893 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003256 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003256 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_893 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.00338 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00338 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_893 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.00338 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00338 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_893 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.006204 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.006204 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_893 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003192 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003192 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_893 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003184 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003184 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_893 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.00326 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00326 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_893 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.006272 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.006272 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_893 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.001936 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.001936 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(2028,676,26,1) -> Float(2028,1,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_911 (Shuffle) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002148 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002148 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(2028,1,78,3) -> Float(1,2,2) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_911 (Shuffle) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003296 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003296 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(676,676:32,26,1) -> Float(2028:32,1,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_911 (Shuffle) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.007588 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.007588 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Half(2028,676,26,1) -> Half(2028,1,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_911 (Shuffle) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002352 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002352 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(169,169,13,1) -> Float(507,169,13,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 418 + node_of_419 (Scale) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.00254 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00254 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(169,1,13,1) -> Float(507,1,39,3) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 418 + node_of_419 (Scale) [07/07/2021-20:02:20] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Half(169,169,13,1) -> Half(507,169,13,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 418 + node_of_419 (Scale) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002428 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002428 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(169,169,13,1) -> Float(507,169,13,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 411 + node_of_412 (Scale) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002108 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002108 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(169,1,13,1) -> Float(507,1,39,3) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 411 + node_of_412 (Scale) [07/07/2021-20:02:20] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Half(169,169,13,1) -> Half(507,169,13,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 411 + node_of_412 (Scale) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.00236 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00236 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(169,169,13,1) -> Float(169,169,13,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 390 + node_of_391 (Scale) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002412 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002412 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(169,1,13,1) -> Float(169,1,13,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 390 + node_of_391 (Scale) [07/07/2021-20:02:20] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Half(169,169,13,1) -> Half(169,169,13,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 390 + node_of_391 (Scale) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002336 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002336 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(169,169,13,1) -> Float(169,169,13,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 383 + node_of_384 (Scale) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.00244 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00244 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(169,1,13,1) -> Float(169,1,13,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 383 + node_of_384 (Scale) [07/07/2021-20:02:20] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Half(169,169,13,1) -> Half(169,169,13,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 383 + node_of_384 (Scale) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002428 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002428 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(169,169,13,1) -> Float(169,169,13,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 362 + node_of_363 (Scale) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002676 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002676 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(169,1,13,1) -> Float(169,1,13,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 362 + node_of_363 (Scale) [07/07/2021-20:02:20] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Half(169,169,13,1) -> Half(169,169,13,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 362 + node_of_363 (Scale) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002544 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002544 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 363 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.001788 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.001788 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 363 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.00308 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00308 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 363 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 363 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002936 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002936 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 363 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003064 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003064 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 363 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002696 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002696 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 363 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002688 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 363 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002748 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002748 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 363 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002492 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002492 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 391 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.001772 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.001772 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 391 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.00256 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00256 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 391 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002552 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002552 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 391 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002684 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002684 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 391 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002872 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002872 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 391 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.00256 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00256 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 391 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002732 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002732 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 391 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.00304 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 391 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002232 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002232 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 435 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.001856 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.001856 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 435 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003008 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 435 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003028 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003028 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 435 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003012 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003012 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 435 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 435 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 435 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 435 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003124 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003124 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 435 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.00256 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00256 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 437 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.001924 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.001924 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 437 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.0032 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0032 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 437 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 437 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003048 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003048 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 437 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003136 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003136 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 437 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003052 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003052 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 437 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003068 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003068 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 437 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003136 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003136 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: 437 copy (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002544 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002544 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(1014,169,13,1), Float(1,1,1,1) -> Float(1014,169,13,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_449 (ElementWise) [07/07/2021-20:02:20] [V] [TRT] Tactic: 1 Time: 0.003064 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 1 Time: 0.003064 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(169,169:32,13,1), Float(1,1:32,1,1) -> Float(169,169:32,13,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_449 (ElementWise) [07/07/2021-20:02:20] [V] [TRT] Tactic: 1 Time: 0.003072 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 1 Time: 0.003072 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Half(1014,169,13,1), Half(1,1,1,1) -> Half(1014,169,13,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_449 (ElementWise) [07/07/2021-20:02:20] [V] [TRT] Tactic: 1 Time: 0.003264 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 1 Time: 0.003264 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_523 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.001868 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.001868 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_523 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003004 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003004 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_523 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.0032 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0032 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_523 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.00302 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00302 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_523 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_523 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002936 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002936 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_523 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.00326 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00326 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_523 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003168 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003168 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_523 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003512 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003512 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_523 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002624 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_523 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003572 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003572 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_523 (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.00256 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00256 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(507,169,13,1) -> Float(507,1,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_541 (Shuffle) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002424 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002424 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(507,1,39,3) -> Float(1,2,2) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_541 (Shuffle) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002736 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002736 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Float(169,169:32,13,1) -> Float(507:32,1,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_541 (Shuffle) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.004096 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] *************** Autotuning format combination: Half(507,169,13,1) -> Half(507,1,1) *************** [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: node_of_541 (Shuffle) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002352 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002352 [07/07/2021-20:02:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: reformat: Float(507,1,1) -> Float(1,2,2) (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002616 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002616 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: reformat: Float(507,1,1) -> Float(507:32,1,1) (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003836 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003836 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: reformat: Float(507,1,1) -> Half(507,1,1) (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003584 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003584 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: reformat: Float(1,2,2) -> Float(507,1,1) (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002952 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002952 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: reformat: Float(1,2,2) -> Float(507:32,1,1) (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003976 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003976 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: reformat: Float(1,2,2) -> Half(507,1,1) (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.002984 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.002984 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: reformat: Float(507:32,1,1) -> Float(507,1,1) (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003092 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003092 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: reformat: Float(507:32,1,1) -> Float(1,2,2) (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: reformat: Float(507:32,1,1) -> Half(507,1,1) (Reformat) [07/07/2021-20:02:20] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:20] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:20] [V] [TRT] --------------- Timing Runner: reformat: Half(507,1,1) -> Float(507,1,1) (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.003044 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003044 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: reformat: Half(507,1,1) -> Float(1,2,2) (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.003008 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003008 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: reformat: Half(507,1,1) -> Float(507:32,1,1) (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.004028 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004028 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_477 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.001828 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.001828 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_477 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002736 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002736 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_477 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.003452 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003452 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_477 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002748 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002748 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_477 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.003336 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003336 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_477 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002616 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002616 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_477 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.003316 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003316 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_477 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.003128 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003128 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_477 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.0032 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.0032 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_477 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.003116 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003116 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_477 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.003312 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003312 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_477 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002488 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002488 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] *************** Autotuning format combination: Float(507,169,13,1) -> Float(507,1,1) *************** [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_495 (Shuffle) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002172 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002172 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] *************** Autotuning format combination: Float(507,1,39,3) -> Float(1,2,2) *************** [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_495 (Shuffle) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002992 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002992 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] *************** Autotuning format combination: Float(169,169:32,13,1) -> Float(507:32,1,1) *************** [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_495 (Shuffle) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.00408 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00408 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] *************** Autotuning format combination: Half(507,169,13,1) -> Half(507,1,1) *************** [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_495 (Shuffle) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002168 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002168 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] *************** Autotuning format combination: Float(169,169,13,1) -> Float(169,169,13,1) *************** [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 355 + node_of_356 (Scale) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002416 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002416 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] *************** Autotuning format combination: Float(169,1,13,1) -> Float(169,1,13,1) *************** [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 355 + node_of_356 (Scale) [07/07/2021-20:02:21] [V] [TRT] Scale has no valid tactics for this config, skipping [07/07/2021-20:02:21] [V] [TRT] *************** Autotuning format combination: Half(169,169,13,1) -> Half(169,169,13,1) *************** [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 355 + node_of_356 (Scale) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002464 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002464 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 356 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.00178 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00178 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 356 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002684 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002684 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 356 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002576 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002576 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 356 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.0026 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.0026 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 356 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002812 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002812 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 356 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002744 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002744 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 356 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.00262 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00262 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 356 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002628 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002628 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 356 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002496 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002496 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 384 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.001772 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.001772 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 384 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002748 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002748 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 384 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002688 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 384 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002688 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 384 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002624 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 384 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002744 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002744 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 384 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002684 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002684 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 384 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002644 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002644 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 384 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.00254 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00254 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 434 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.00184 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00184 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 434 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.00268 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00268 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 434 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.00268 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00268 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 434 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002668 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002668 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 434 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002704 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002704 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 434 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002744 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002744 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 434 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002624 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 434 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.00344 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00344 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 434 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002568 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002568 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 436 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.00184 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00184 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 436 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.003376 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003376 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 436 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002616 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002616 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 436 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002888 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002888 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 436 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.00352 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00352 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 436 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002688 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 436 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.00256 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00256 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 436 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.003424 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003424 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: 436 copy (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002432 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002432 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] *************** Autotuning format combination: Float(1014,169,13,1), Float(1,1,1,1) -> Float(1014,169,13,1) *************** [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_444 (ElementWise) [07/07/2021-20:02:21] [V] [TRT] Tactic: 1 Time: 0.002752 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 1 Time: 0.002752 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:21] [V] [TRT] *************** Autotuning format combination: Float(169,169:32,13,1), Float(1,1:32,1,1) -> Float(169,169:32,13,1) *************** [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_444 (ElementWise) [07/07/2021-20:02:21] [V] [TRT] Tactic: 1 Time: 0.003372 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 1 Time: 0.003372 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:21] [V] [TRT] *************** Autotuning format combination: Half(1014,169,13,1), Half(1,1,1,1) -> Half(1014,169,13,1) *************** [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_444 (ElementWise) [07/07/2021-20:02:21] [V] [TRT] Tactic: 1 Time: 0.003452 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 1 Time: 0.003452 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_500 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.001864 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.001864 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_500 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002624 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002624 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_500 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.00358 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00358 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_500 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002536 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002536 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_500 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.003384 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003384 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_500 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002684 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002684 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_500 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.003384 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003384 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_500 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.003512 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003512 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_500 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.003452 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003452 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_500 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002616 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002616 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_500 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.00352 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00352 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_500 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002556 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002556 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] *************** Autotuning format combination: Float(507,169,13,1) -> Float(507,1,1) *************** [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_518 (Shuffle) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002488 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002488 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] *************** Autotuning format combination: Float(507,1,39,3) -> Float(1,2,2) *************** [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_518 (Shuffle) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002748 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002748 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] *************** Autotuning format combination: Float(169,169:32,13,1) -> Float(507:32,1,1) *************** [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_518 (Shuffle) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.004024 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004024 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] *************** Autotuning format combination: Half(507,169,13,1) -> Half(507,1,1) *************** [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_518 (Shuffle) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002352 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002352 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_454 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.001856 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.001856 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_454 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.00302 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00302 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_454 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.003184 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003184 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_454 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.00302 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00302 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_454 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_454 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_454 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.0032 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.0032 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_454 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_454 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.00326 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00326 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_454 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002852 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002852 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_454 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.003248 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003248 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_454 (Reformat) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002228 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002228 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] *************** Autotuning format combination: Float(507,169,13,1) -> Float(507,1,1) *************** [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_472 (Shuffle) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002232 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002232 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] *************** Autotuning format combination: Float(507,1,39,3) -> Float(1,2,2) *************** [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_472 (Shuffle) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.003064 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.003064 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] *************** Autotuning format combination: Float(169,169:32,13,1) -> Float(507:32,1,1) *************** [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_472 (Shuffle) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.00412 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00412 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] *************** Autotuning format combination: Half(507,169,13,1) -> Half(507,1,1) *************** [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: node_of_472 (Shuffle) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002048 [07/07/2021-20:02:21] [V] [TRT] Fastest Tactic: 0 Time: 0.002048 [07/07/2021-20:02:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:21] [V] [TRT] *************** Autotuning format combination: Float(2028,1,1), Float(2028,1,1) -> Float(2028,1,1) *************** [07/07/2021-20:02:21] [V] [TRT] --------------- Timing Runner: PWN(PWN(984 + (Unnamed Layer* 719) [Shuffle], node_of_985), node_of_986) (PointWiseV2) [07/07/2021-20:02:21] [V] [TRT] Tactic: 0 Time: 0.002496 [07/07/2021-20:02:22] [V] [TRT] Tactic: 1 Time: 0.002876 [07/07/2021-20:02:22] [V] [TRT] Tactic: 2 Time: 0.002496 [07/07/2021-20:02:22] [V] [TRT] Tactic: 3 Time: 0.003448 [07/07/2021-20:02:22] [V] [TRT] Tactic: 4 Time: 0.00256 [07/07/2021-20:02:22] [V] [TRT] Tactic: 5 Time: 0.003468 [07/07/2021-20:02:22] [V] [TRT] Tactic: 6 Time: 0.003328 [07/07/2021-20:02:23] [V] [TRT] Tactic: 7 Time: 0.003328 [07/07/2021-20:02:23] [V] [TRT] Tactic: 8 Time: 0.003444 [07/07/2021-20:02:23] [V] [TRT] Tactic: 9 Time: 0.00352 [07/07/2021-20:02:23] [V] [TRT] Tactic: 28 Time: 0.002632 [07/07/2021-20:02:23] [V] [TRT] Fastest Tactic: 0 Time: 0.002496 [07/07/2021-20:02:23] [V] [TRT] --------------- Timing Runner: PWN(PWN(984 + (Unnamed Layer* 719) [Shuffle], node_of_985), node_of_986) (PointWise) [07/07/2021-20:02:23] [V] [TRT] Tactic: 128 Time: 0.003416 [07/07/2021-20:02:23] [V] [TRT] Tactic: 256 Time: 0.003576 [07/07/2021-20:02:23] [V] [TRT] Tactic: 512 Time: 0.003364 [07/07/2021-20:02:23] [V] [TRT] Fastest Tactic: 512 Time: 0.003364 [07/07/2021-20:02:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [07/07/2021-20:02:23] [V] [TRT] *************** Autotuning format combination: Float(1,2,2), Float(1,2,2) -> Float(1,2,2) *************** [07/07/2021-20:02:23] [V] [TRT] --------------- Timing Runner: PWN(PWN(984 + (Unnamed Layer* 719) [Shuffle], node_of_985), node_of_986) (PointWiseV2) [07/07/2021-20:02:23] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/07/2021-20:02:23] [V] [TRT] --------------- Timing Runner: PWN(PWN(984 + (Unnamed Layer* 719) [Shuffle], node_of_985), node_of_986) (PointWise) [07/07/2021-20:02:23] [V] [TRT] Tactic: 128 Time: 0.004472 [07/07/2021-20:02:23] [V] [TRT] Tactic: 256 Time: 0.003316 [07/07/2021-20:02:23] [V] [TRT] Tactic: 512 Time: 0.003452 [07/07/2021-20:02:23] [V] [TRT] Fastest Tactic: 256 Time: 0.003316 [07/07/2021-20:02:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 256 [07/07/2021-20:02:23] [V] [TRT] *************** Autotuning format combination: Float(2028:32,1,1), Float(2028:32,1,1) -> Float(2028:32,1,1) *************** [07/07/2021-20:02:23] [V] [TRT] --------------- Timing Runner: PWN(PWN(984 + (Unnamed Layer* 719) [Shuffle], node_of_985), node_of_986) (PointWiseV2) [07/07/2021-20:02:23] [V] [TRT] Tactic: 24 Time: 0.004416 [07/07/2021-20:02:24] [V] [TRT] Tactic: 25 Time: 0.004496 [07/07/2021-20:02:24] [V] [TRT] Tactic: 26 Time: 0.005568 [07/07/2021-20:02:24] [V] [TRT] Tactic: 27 Time: 0.00672 [07/07/2021-20:02:24] [V] [TRT] Tactic: 31 Time: 0.004476 [07/07/2021-20:02:24] [V] [TRT] Fastest Tactic: 24 Time: 0.004416 [07/07/2021-20:02:24] [V] [TRT] --------------- Timing Runner: PWN(PWN(984 + (Unnamed Layer* 719) [Shuffle], node_of_985), node_of_986) (PointWise) [07/07/2021-20:02:24] [V] [TRT] Tactic: 128 Time: 0.007548 [07/07/2021-20:02:24] [V] [TRT] Tactic: 256 Time: 0.007484 [07/07/2021-20:02:24] [V] [TRT] Tactic: 512 Time: 0.007548 [07/07/2021-20:02:24] [V] [TRT] Fastest Tactic: 256 Time: 0.007484 [07/07/2021-20:02:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [07/07/2021-20:02:24] [V] [TRT] *************** Autotuning format combination: Half(2028,1,1), Half(2028,1,1) -> Half(2028,1,1) *************** [07/07/2021-20:02:24] [V] [TRT] --------------- Timing Runner: PWN(PWN(984 + (Unnamed Layer* 719) [Shuffle], node_of_985), node_of_986) (PointWiseV2) [07/07/2021-20:02:24] [V] [TRT] Tactic: 0 Time: 0.002624 [07/07/2021-20:02:25] [V] [TRT] Tactic: 1 Time: 0.002516 [07/07/2021-20:02:25] [V] [TRT] Tactic: 2 Time: 0.002624 [07/07/2021-20:02:25] [V] [TRT] Tactic: 3 Time: 0.00332 [07/07/2021-20:02:25] [V] [TRT] Tactic: 4 Time: 0.003392 [07/07/2021-20:02:25] [V] [TRT] Tactic: 5 Time: 0.002616 [07/07/2021-20:02:26] [V] [TRT] Tactic: 6 Time: 0.00352 [07/07/2021-20:02:26] [V] [TRT] Tactic: 7 Time: 0.003328 [07/07/2021-20:02:26] [V] [TRT] Tactic: 8 Time: 0.003516 [07/07/2021-20:02:26] [V] [TRT] Tactic: 9 Time: 0.003404 [07/07/2021-20:02:26] [V] [TRT] Tactic: 28 Time: 0.002496 [07/07/2021-20:02:26] [V] [TRT] Fastest Tactic: 28 Time: 0.002496 [07/07/2021-20:02:26] [V] [TRT] --------------- Timing Runner: PWN(PWN(984 + (Unnamed Layer* 719) [Shuffle], node_of_985), node_of_986) (PointWise) [07/07/2021-20:02:26] [V] [TRT] Tactic: 128 Time: 0.004892 [07/07/2021-20:02:26] [V] [TRT] Tactic: 256 Time: 0.004744 [07/07/2021-20:02:26] [V] [TRT] Tactic: 512 Time: 0.004672 [07/07/2021-20:02:26] [V] [TRT] Fastest Tactic: 512 Time: 0.004672 [07/07/2021-20:02:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [07/07/2021-20:02:26] [V] [TRT] *************** Autotuning format combination: Float(2028,1,1), Float(2028,1,1) -> Float(2028,1,1) *************** [07/07/2021-20:02:26] [V] [TRT] --------------- Timing Runner: node_of_988 (ElementWise) [07/07/2021-20:02:26] [V] [TRT] Tactic: 1 Time: 0.002548 [07/07/2021-20:02:26] [V] [TRT] Fastest Tactic: 1 Time: 0.002548 [07/07/2021-20:02:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:26] [V] [TRT] *************** Autotuning format combination: Float(2028:32,1,1), Float(2028:32,1,1) -> Float(2028:32,1,1) *************** [07/07/2021-20:02:26] [V] [TRT] --------------- Timing Runner: node_of_988 (ElementWise) [07/07/2021-20:02:26] [V] [TRT] Tactic: 1 Time: 0.003564 [07/07/2021-20:02:26] [V] [TRT] Fastest Tactic: 1 Time: 0.003564 [07/07/2021-20:02:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:26] [V] [TRT] *************** Autotuning format combination: Half(2028,1,1), Half(2028,1,1) -> Half(2028,1,1) *************** [07/07/2021-20:02:26] [V] [TRT] --------------- Timing Runner: node_of_988 (ElementWise) [07/07/2021-20:02:26] [V] [TRT] Tactic: 1 Time: 0.002572 [07/07/2021-20:02:26] [V] [TRT] Fastest Tactic: 1 Time: 0.002572 [07/07/2021-20:02:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:26] [V] [TRT] *************** Autotuning format combination: Float(2028,1,1), Float(2028,1,1) -> Float(2028,1,1) *************** [07/07/2021-20:02:26] [V] [TRT] *************** Autotuning format combination: Float(1,2,2), Float(1,2,2) -> Float(1,2,2) *************** [07/07/2021-20:02:26] [V] [TRT] *************** Autotuning format combination: Float(2028:32,1,1), Float(2028:32,1,1) -> Float(2028:32,1,1) *************** [07/07/2021-20:02:26] [V] [TRT] *************** Autotuning format combination: Half(2028,1,1), Half(2028,1,1) -> Half(2028,1,1) *************** [07/07/2021-20:02:26] [V] [TRT] *************** Autotuning format combination: Float(2028,1,1), Float(2028,1,1) -> Float(2028,1,1) *************** [07/07/2021-20:02:26] [V] [TRT] --------------- Timing Runner: node_of_987 (ElementWise) [07/07/2021-20:02:26] [V] [TRT] Tactic: 1 Time: 0.002612 [07/07/2021-20:02:26] [V] [TRT] Fastest Tactic: 1 Time: 0.002612 [07/07/2021-20:02:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:26] [V] [TRT] *************** Autotuning format combination: Float(2028:32,1,1), Float(2028:32,1,1) -> Float(2028:32,1,1) *************** [07/07/2021-20:02:26] [V] [TRT] --------------- Timing Runner: node_of_987 (ElementWise) [07/07/2021-20:02:26] [V] [TRT] Tactic: 1 Time: 0.00356 [07/07/2021-20:02:26] [V] [TRT] Fastest Tactic: 1 Time: 0.00356 [07/07/2021-20:02:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:26] [V] [TRT] *************** Autotuning format combination: Half(2028,1,1), Half(2028,1,1) -> Half(2028,1,1) *************** [07/07/2021-20:02:26] [V] [TRT] --------------- Timing Runner: node_of_987 (ElementWise) [07/07/2021-20:02:26] [V] [TRT] Tactic: 1 Time: 0.002544 [07/07/2021-20:02:26] [V] [TRT] Fastest Tactic: 1 Time: 0.002544 [07/07/2021-20:02:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:26] [V] [TRT] --------------- Timing Runner: 983 copy (Reformat) [07/07/2021-20:02:26] [V] [TRT] Tactic: 0 Time: 0.003052 [07/07/2021-20:02:26] [V] [TRT] Fastest Tactic: 0 Time: 0.003052 [07/07/2021-20:02:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:26] [V] [TRT] --------------- Timing Runner: 983 copy (Reformat) [07/07/2021-20:02:26] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:26] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:26] [V] [TRT] --------------- Timing Runner: 983 copy (Reformat) [07/07/2021-20:02:26] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:26] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:26] [V] [TRT] --------------- Timing Runner: 983 copy (Reformat) [07/07/2021-20:02:26] [V] [TRT] Tactic: 0 Time: 0.003056 [07/07/2021-20:02:26] [V] [TRT] Fastest Tactic: 0 Time: 0.003056 [07/07/2021-20:02:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:26] [V] [TRT] --------------- Timing Runner: 983 copy (Reformat) [07/07/2021-20:02:26] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:26] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:26] [V] [TRT] --------------- Timing Runner: 983 copy (Reformat) [07/07/2021-20:02:26] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:26] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:26] [V] [TRT] --------------- Timing Runner: 983 copy (Reformat) [07/07/2021-20:02:26] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:26] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:26] [V] [TRT] --------------- Timing Runner: 983 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 983 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 983 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003136 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003136 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 983 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 983 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 983 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 983 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 983 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.0032 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.0032 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 983 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003052 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003052 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 986 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 986 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 986 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003136 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003136 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 986 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 986 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 986 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 986 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 986 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003052 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003052 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 986 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 986 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 986 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003132 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003132 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 986 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003252 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003252 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 986 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 986 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003028 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003028 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 986 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 986 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003044 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003044 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 987 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 987 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 987 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 987 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 987 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 987 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.00304 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00304 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 987 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003144 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003144 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 987 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 987 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003192 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003192 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 987 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 987 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 987 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 988 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003132 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003132 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 988 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 988 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.007624 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.007624 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 988 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 988 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003132 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003132 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 988 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003132 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003132 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 988 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.007368 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.007368 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 988 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003192 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003192 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 988 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.00306 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00306 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 988 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 988 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.007168 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.007168 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 988 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.002972 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.002972 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: reformat: Float(8112,4,1) -> Float(1,8,2) (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: reformat: Float(8112,4,1) -> Float(8112:32,4,1) (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.022792 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.022792 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: reformat: Float(8112,4,1) -> Half(8112,4,1) (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.004536 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.004536 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: reformat: Float(1,8,2) -> Float(8112,4,1) (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003468 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003468 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: reformat: Float(1,8,2) -> Float(8112:32,4,1) (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.022608 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.022608 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: reformat: Float(1,8,2) -> Half(8112,4,1) (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003516 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003516 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: reformat: Float(8112:32,4,1) -> Float(8112,4,1) (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003584 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003584 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: reformat: Float(8112:32,4,1) -> Float(1,8,2) (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003516 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003516 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: reformat: Float(8112:32,4,1) -> Half(8112,4,1) (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.00358 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00358 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: reformat: Half(8112,4,1) -> Float(8112,4,1) (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003568 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003568 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: reformat: Half(8112,4,1) -> Float(1,8,2) (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003452 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003452 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: reformat: Half(8112,4,1) -> Float(8112:32,4,1) (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.022444 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.022444 [07/07/2021-20:02:27] [V] [TRT] *************** Autotuning format combination: Float(8112,4,1) -> Float(10140,4,4,1) *************** [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: node_of_1009 (Shuffle) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.00322 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00322 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] *************** Autotuning format combination: Float(1,8,2) -> Float(10140,1,10140,2535) *************** [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: node_of_1009 (Shuffle) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.0036 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.0036 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] *************** Autotuning format combination: Float(8112:32,4,1) -> Float(320,4:32,4,1) *************** [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: node_of_1009 (Shuffle) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.004412 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.004412 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] *************** Autotuning format combination: Half(8112,4,1) -> Half(10140,4,4,1) *************** [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: node_of_1009 (Shuffle) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.00248 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00248 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: reformat: Float(10140,1,10140,2535) -> Float(10140,4,4,1) (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003456 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: reformat: Float(320,4:32,4,1) -> Float(10140,4,4,1) (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.00352 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00352 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: reformat: Half(10140,4,4,1) -> Float(10140,4,4,1) (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003508 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003508 [07/07/2021-20:02:27] [V] [TRT] *************** Autotuning format combination: Float(507,1,1), Float(507,1,1) -> Float(507,1,1) *************** [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: PWN(PWN(545 + (Unnamed Layer* 388) [Shuffle], node_of_546), node_of_547) (PointWiseV2) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.002552 [07/07/2021-20:02:27] [V] [TRT] Tactic: 1 Time: 0.00256 [07/07/2021-20:02:27] [V] [TRT] Tactic: 2 Time: 0.002612 [07/07/2021-20:02:27] [V] [TRT] Tactic: 3 Time: 0.003424 [07/07/2021-20:02:27] [V] [TRT] Tactic: 4 Time: 0.002748 [07/07/2021-20:02:27] [V] [TRT] Tactic: 5 Time: 0.00352 [07/07/2021-20:02:27] [V] [TRT] Tactic: 6 Time: 0.003576 [07/07/2021-20:02:27] [V] [TRT] Tactic: 7 Time: 0.003192 [07/07/2021-20:02:27] [V] [TRT] Tactic: 8 Time: 0.003504 [07/07/2021-20:02:27] [V] [TRT] Tactic: 9 Time: 0.00344 [07/07/2021-20:02:27] [V] [TRT] Tactic: 28 Time: 0.00256 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.002552 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: PWN(PWN(545 + (Unnamed Layer* 388) [Shuffle], node_of_546), node_of_547) (PointWise) [07/07/2021-20:02:27] [V] [TRT] Tactic: 128 Time: 0.00358 [07/07/2021-20:02:27] [V] [TRT] Tactic: 256 Time: 0.003512 [07/07/2021-20:02:27] [V] [TRT] Tactic: 512 Time: 0.003344 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 512 Time: 0.003344 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] *************** Autotuning format combination: Float(1,2,2), Float(1,2,2) -> Float(1,2,2) *************** [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: PWN(PWN(545 + (Unnamed Layer* 388) [Shuffle], node_of_546), node_of_547) (PointWiseV2) [07/07/2021-20:02:27] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: PWN(PWN(545 + (Unnamed Layer* 388) [Shuffle], node_of_546), node_of_547) (PointWise) [07/07/2021-20:02:27] [V] [TRT] Tactic: 128 Time: 0.003512 [07/07/2021-20:02:27] [V] [TRT] Tactic: 256 Time: 0.003388 [07/07/2021-20:02:27] [V] [TRT] Tactic: 512 Time: 0.003516 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 256 Time: 0.003388 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 256 [07/07/2021-20:02:27] [V] [TRT] *************** Autotuning format combination: Float(507:32,1,1), Float(507:32,1,1) -> Float(507:32,1,1) *************** [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: PWN(PWN(545 + (Unnamed Layer* 388) [Shuffle], node_of_546), node_of_547) (PointWiseV2) [07/07/2021-20:02:27] [V] [TRT] Tactic: 24 Time: 0.003388 [07/07/2021-20:02:27] [V] [TRT] Tactic: 25 Time: 0.003708 [07/07/2021-20:02:27] [V] [TRT] Tactic: 26 Time: 0.00454 [07/07/2021-20:02:27] [V] [TRT] Tactic: 27 Time: 0.006368 [07/07/2021-20:02:27] [V] [TRT] Tactic: 31 Time: 0.003496 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 24 Time: 0.003388 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: PWN(PWN(545 + (Unnamed Layer* 388) [Shuffle], node_of_546), node_of_547) (PointWise) [07/07/2021-20:02:27] [V] [TRT] Tactic: 128 Time: 0.004084 [07/07/2021-20:02:27] [V] [TRT] Tactic: 256 Time: 0.00448 [07/07/2021-20:02:27] [V] [TRT] Tactic: 512 Time: 0.004412 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 128 Time: 0.004084 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [07/07/2021-20:02:27] [V] [TRT] *************** Autotuning format combination: Half(507,1,1), Half(507,1,1) -> Half(507,1,1) *************** [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: PWN(PWN(545 + (Unnamed Layer* 388) [Shuffle], node_of_546), node_of_547) (PointWiseV2) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.00256 [07/07/2021-20:02:27] [V] [TRT] Tactic: 1 Time: 0.002736 [07/07/2021-20:02:27] [V] [TRT] Tactic: 2 Time: 0.002676 [07/07/2021-20:02:27] [V] [TRT] Tactic: 3 Time: 0.003392 [07/07/2021-20:02:27] [V] [TRT] Tactic: 4 Time: 0.00352 [07/07/2021-20:02:27] [V] [TRT] Tactic: 5 Time: 0.002548 [07/07/2021-20:02:27] [V] [TRT] Tactic: 6 Time: 0.003708 [07/07/2021-20:02:27] [V] [TRT] Tactic: 7 Time: 0.003516 [07/07/2021-20:02:27] [V] [TRT] Tactic: 8 Time: 0.003384 [07/07/2021-20:02:27] [V] [TRT] Tactic: 9 Time: 0.00338 [07/07/2021-20:02:27] [V] [TRT] Tactic: 28 Time: 0.002508 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 28 Time: 0.002508 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: PWN(PWN(545 + (Unnamed Layer* 388) [Shuffle], node_of_546), node_of_547) (PointWise) [07/07/2021-20:02:27] [V] [TRT] Tactic: 128 Time: 0.003572 [07/07/2021-20:02:27] [V] [TRT] Tactic: 256 Time: 0.003848 [07/07/2021-20:02:27] [V] [TRT] Tactic: 512 Time: 0.003776 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 128 Time: 0.003572 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [07/07/2021-20:02:27] [V] [TRT] *************** Autotuning format combination: Float(507,1,1), Float(507,1,1) -> Float(507,1,1) *************** [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: node_of_549 (ElementWise) [07/07/2021-20:02:27] [V] [TRT] Tactic: 1 Time: 0.00242 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 1 Time: 0.00242 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:27] [V] [TRT] *************** Autotuning format combination: Float(507:32,1,1), Float(507:32,1,1) -> Float(507:32,1,1) *************** [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: node_of_549 (ElementWise) [07/07/2021-20:02:27] [V] [TRT] Tactic: 1 Time: 0.002564 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 1 Time: 0.002564 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:27] [V] [TRT] *************** Autotuning format combination: Half(507,1,1), Half(507,1,1) -> Half(507,1,1) *************** [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: node_of_549 (ElementWise) [07/07/2021-20:02:27] [V] [TRT] Tactic: 1 Time: 0.002572 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 1 Time: 0.002572 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:27] [V] [TRT] *************** Autotuning format combination: Float(507,1,1), Float(507,1,1) -> Float(507,1,1) *************** [07/07/2021-20:02:27] [V] [TRT] *************** Autotuning format combination: Float(1,2,2), Float(1,2,2) -> Float(1,2,2) *************** [07/07/2021-20:02:27] [V] [TRT] *************** Autotuning format combination: Float(507:32,1,1), Float(507:32,1,1) -> Float(507:32,1,1) *************** [07/07/2021-20:02:27] [V] [TRT] *************** Autotuning format combination: Half(507,1,1), Half(507,1,1) -> Half(507,1,1) *************** [07/07/2021-20:02:27] [V] [TRT] *************** Autotuning format combination: Float(507,1,1), Float(507,1,1) -> Float(507,1,1) *************** [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: node_of_548 (ElementWise) [07/07/2021-20:02:27] [V] [TRT] Tactic: 1 Time: 0.002428 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 1 Time: 0.002428 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:27] [V] [TRT] *************** Autotuning format combination: Float(507:32,1,1), Float(507:32,1,1) -> Float(507:32,1,1) *************** [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: node_of_548 (ElementWise) [07/07/2021-20:02:27] [V] [TRT] Tactic: 1 Time: 0.0028 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 1 Time: 0.0028 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:27] [V] [TRT] *************** Autotuning format combination: Half(507,1,1), Half(507,1,1) -> Half(507,1,1) *************** [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: node_of_548 (ElementWise) [07/07/2021-20:02:27] [V] [TRT] Tactic: 1 Time: 0.002496 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 1 Time: 0.002496 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 544 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.002688 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.002688 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 544 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.00262 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00262 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 544 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.002736 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.002736 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 544 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.002752 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.002752 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 544 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.002608 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.002608 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 544 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.00294 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00294 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 544 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.00312 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00312 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 544 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003048 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003048 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 544 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003052 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003052 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 544 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003512 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003512 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 544 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003524 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003524 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 544 copy (Reformat) [07/07/2021-20:02:27] [V] [TRT] Tactic: 0 Time: 0.003216 [07/07/2021-20:02:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003216 [07/07/2021-20:02:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:27] [V] [TRT] --------------- Timing Runner: 544 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.00268 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00268 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 544 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.0031 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.0031 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 544 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003248 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003248 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 544 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002628 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002628 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 547 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.00264 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00264 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 547 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002876 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002876 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 547 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.00256 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00256 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 547 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002736 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002736 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 547 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002772 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002772 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 547 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002832 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002832 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 547 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002576 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002576 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 547 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002676 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002676 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 547 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003328 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003328 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 547 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.00332 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00332 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 547 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003332 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003332 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 547 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003468 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003468 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 547 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002768 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002768 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 547 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002556 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002556 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 547 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003344 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003344 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 547 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.00262 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00262 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 548 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002832 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002832 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 548 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002556 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002556 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 548 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002748 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002748 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 548 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003196 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003196 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 548 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003272 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003272 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 548 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003464 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003464 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 548 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003392 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003392 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 548 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.0033 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.0033 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 548 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002808 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002808 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 548 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002684 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002684 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 548 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003348 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003348 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 548 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002552 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002552 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 549 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002676 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002676 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 549 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002684 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002684 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 549 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003712 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 549 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002556 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002556 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 549 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003344 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003344 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 549 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003452 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003452 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 549 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.004416 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004416 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 549 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003276 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003276 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 549 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002616 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002616 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 549 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.00256 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00256 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 549 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003916 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003916 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 549 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002556 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002556 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: reformat: Float(2028,4,1) -> Float(1,8,2) (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.00344 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00344 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: reformat: Float(2028,4,1) -> Float(2028:32,4,1) (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.007744 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.007744 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: reformat: Float(2028,4,1) -> Half(2028,4,1) (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.0037 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.0037 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: reformat: Float(1,8,2) -> Float(2028,4,1) (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003452 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003452 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: reformat: Float(1,8,2) -> Float(2028:32,4,1) (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.00754 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00754 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: reformat: Float(1,8,2) -> Half(2028,4,1) (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003388 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003388 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: reformat: Float(2028:32,4,1) -> Float(2028,4,1) (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003388 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003388 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: reformat: Float(2028:32,4,1) -> Float(1,8,2) (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003372 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003372 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: reformat: Float(2028:32,4,1) -> Half(2028,4,1) (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003452 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003452 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: reformat: Half(2028,4,1) -> Float(2028,4,1) (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003456 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: reformat: Half(2028,4,1) -> Float(1,8,2) (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003456 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: reformat: Half(2028,4,1) -> Float(2028:32,4,1) (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.007488 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.007488 [07/07/2021-20:02:28] [V] [TRT] *************** Autotuning format combination: Float(2028,4,1) -> Float(2028,4,4,1) *************** [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: node_of_570 (Shuffle) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002496 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002496 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] *************** Autotuning format combination: Float(1,8,2) -> Float(2028,1,2028,507) *************** [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: node_of_570 (Shuffle) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003516 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003516 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] *************** Autotuning format combination: Float(2028:32,4,1) -> Float(64,4:32,4,1) *************** [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: node_of_570 (Shuffle) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003452 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003452 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] *************** Autotuning format combination: Half(2028,4,1) -> Half(2028,4,4,1) *************** [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: node_of_570 (Shuffle) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002384 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002384 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 570 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.002112 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.002112 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 570 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003584 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003584 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 570 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.0034 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.0034 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] --------------- Timing Runner: 570 copy (Reformat) [07/07/2021-20:02:28] [V] [TRT] Tactic: 0 Time: 0.003444 [07/07/2021-20:02:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003444 [07/07/2021-20:02:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [07/07/2021-20:02:28] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to node_of_143 (142) from Half(346112,10816,104,1) to Float(346112,10816,104,1) [07/07/2021-20:02:28] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to node_of_152 (151) from Float(692224,10816,104,1) to Half(692224,10816,104,1) [07/07/2021-20:02:28] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to node_of_155 (154) from Half(346112,2704,52,1) to Float(346112,2704,52,1) [07/07/2021-20:02:28] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to node_of_173 (172) from Half(173056,2704,52,1) to Float(173056,2704,52,1) [07/07/2021-20:02:28] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to node_of_187 (186) from Float(173056,676,26,1) to Half(173056,676,26,1) [07/07/2021-20:02:28] [V] [TRT] For layer node_of_119 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_121 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_122 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_124 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_125 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_127 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_143 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_145 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_146 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_148 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_150 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer (Unnamed Layer* 303) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer (Unnamed Layer* 309) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer (Unnamed Layer* 634) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer (Unnamed Layer* 640) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_155 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_157 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_173 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_175 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_176 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_178 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_180 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_182 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_184 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_185 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_203 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_205 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_206 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_208 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_210 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_212 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_214 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_215 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_217 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_218 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_220 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_221 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_223 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_590 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_592 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_614 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_636 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_658 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_660 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_662 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_663 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_761 + node_of_762 + node_of_780 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_742 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer PWN(node_of_787) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_1027 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer PWN(PWN(node_of_788), node_of_1028) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_786 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_224 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_322 + node_of_323 + node_of_341 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_303 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer PWN(node_of_348) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_588 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer PWN(PWN(node_of_349), node_of_589) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_347 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 871 + (Unnamed Layer* 622) [Shuffle] + node_of_872 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 864 + (Unnamed Layer* 618) [Shuffle] + node_of_865 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 843 + (Unnamed Layer* 608) [Shuffle] + node_of_844 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 836 + (Unnamed Layer* 604) [Shuffle] + node_of_837 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 815 + (Unnamed Layer* 594) [Shuffle] + node_of_816 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 808 + (Unnamed Layer* 590) [Shuffle] + node_of_809 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 432 + (Unnamed Layer* 291) [Shuffle] + node_of_433 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 425 + (Unnamed Layer* 287) [Shuffle] + node_of_426 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 404 + (Unnamed Layer* 277) [Shuffle] + node_of_405 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 397 + (Unnamed Layer* 273) [Shuffle] + node_of_398 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 376 + (Unnamed Layer* 263) [Shuffle] + node_of_377 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 369 + (Unnamed Layer* 259) [Shuffle] + node_of_370 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer PWN(784 + (Unnamed Layer* 577) [Shuffle], PWN(PWN(PWN(node_of_781), 782 + (Unnamed Layer* 574) [Shuffle] + node_of_783), node_of_785)) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer PWN(345 + (Unnamed Layer* 246) [Shuffle], PWN(PWN(PWN(node_of_342), 343 + (Unnamed Layer* 243) [Shuffle] + node_of_344), node_of_346)) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 857 + node_of_858 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 850 + node_of_851 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 829 + node_of_830 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 822 + node_of_823 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 801 + node_of_802 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_888 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_980 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_934 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 794 + node_of_795 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_883 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_957 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_911 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 418 + node_of_419 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 411 + node_of_412 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 390 + node_of_391 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 383 + node_of_384 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 362 + node_of_363 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_449 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_541 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_495 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer 355 + node_of_356 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_444 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_518 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_472 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer PWN(PWN(984 + (Unnamed Layer* 719) [Shuffle], node_of_985), node_of_986) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_988 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer PWN(PWN(981 + (Unnamed Layer* 715) [Shuffle], node_of_982), node_of_983) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_987 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_1009 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer PWN(PWN(545 + (Unnamed Layer* 388) [Shuffle], node_of_546), node_of_547) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_549 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer PWN(PWN(542 + (Unnamed Layer* 384) [Shuffle], node_of_543), node_of_544) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_548 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] For layer node_of_570 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/07/2021-20:02:28] [V] [TRT] Formats and tactics selection completed in 87.7278 seconds. [07/07/2021-20:02:28] [V] [TRT] After reformat layers: 235 layers [07/07/2021-20:02:28] [V] [TRT] Block size 16777216 [07/07/2021-20:02:28] [V] [TRT] Block size 11075584 [07/07/2021-20:02:28] [V] [TRT] Block size 11075584 [07/07/2021-20:02:28] [V] [TRT] Block size 5537792 [07/07/2021-20:02:28] [V] [TRT] Block size 692224 [07/07/2021-20:02:28] [V] [TRT] Block size 346112 [07/07/2021-20:02:28] [V] [TRT] Block size 16384 [07/07/2021-20:02:28] [V] [TRT] Block size 16384 [07/07/2021-20:02:28] [V] [TRT] Block size 11264 [07/07/2021-20:02:28] [V] [TRT] Block size 11264 [07/07/2021-20:02:28] [V] [TRT] Block size 5632 [07/07/2021-20:02:28] [V] [TRT] Block size 5632 [07/07/2021-20:02:28] [V] [TRT] Block size 5632 [07/07/2021-20:02:28] [V] [TRT] Block size 5632 [07/07/2021-20:02:28] [V] [TRT] Block size 4096 [07/07/2021-20:02:28] [V] [TRT] Block size 3072 [07/07/2021-20:02:28] [V] [TRT] Block size 3072 [07/07/2021-20:02:28] [V] [TRT] Block size 1536 [07/07/2021-20:02:28] [V] [TRT] Block size 1536 [07/07/2021-20:02:28] [V] [TRT] Block size 1536 [07/07/2021-20:02:28] [V] [TRT] Block size 1536 [07/07/2021-20:02:28] [V] [TRT] Block size 512 [07/07/2021-20:02:28] [V] [TRT] Block size 512 [07/07/2021-20:02:28] [V] [TRT] Block size 512 [07/07/2021-20:02:28] [V] [TRT] Block size 512 [07/07/2021-20:02:28] [V] [TRT] Block size 1 [07/07/2021-20:02:28] [V] [TRT] Block size 1 [07/07/2021-20:02:28] [V] [TRT] Block size 1 [07/07/2021-20:02:28] [V] [TRT] Block size 1 [07/07/2021-20:02:28] [V] [TRT] Total Activation Memory: 45600772 [07/07/2021-20:02:28] [I] [TRT] Detected 1 inputs and 6 output network tensors. [07/07/2021-20:02:28] [V] [TRT] node_of_119 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [07/07/2021-20:02:28] [V] [TRT] node_of_122 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [07/07/2021-20:02:28] [V] [TRT] node_of_125 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [07/07/2021-20:02:28] [V] [TRT] node_of_143 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [07/07/2021-20:02:28] [V] [TRT] node_of_146 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [07/07/2021-20:02:28] [V] [TRT] node_of_150 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [07/07/2021-20:02:28] [V] [TRT] node_of_155 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [07/07/2021-20:02:28] [V] [TRT] node_of_173 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [07/07/2021-20:02:28] [V] [TRT] node_of_176 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [07/07/2021-20:02:28] [V] [TRT] node_of_180 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [07/07/2021-20:02:28] [V] [TRT] node_of_185 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [07/07/2021-20:02:28] [V] [TRT] node_of_203 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [07/07/2021-20:02:28] [V] [TRT] node_of_206 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [07/07/2021-20:02:28] [V] [TRT] node_of_210 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [07/07/2021-20:02:28] [V] [TRT] node_of_215 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [07/07/2021-20:02:28] [V] [TRT] node_of_218 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [07/07/2021-20:02:28] [V] [TRT] node_of_221 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [07/07/2021-20:02:28] [V] [TRT] node_of_660 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [07/07/2021-20:02:28] [V] [TRT] Layer: 886[Constant] HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 447[Constant] HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_119 HostPersistent: 1664 DevicePersistent: 263680 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_121 HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_122 HostPersistent: 1664 DevicePersistent: 139264 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_124 HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_125 HostPersistent: 512 DevicePersistent: 410112 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_127 HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_142 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to node_of_143 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_143 HostPersistent: 512 DevicePersistent: 102912 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_145 HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_146 HostPersistent: 512 DevicePersistent: 102912 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_148 HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_150 HostPersistent: 3200 DevicePersistent: 81920 [07/07/2021-20:02:28] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to node_of_152 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_152 HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 127 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_154 HostPersistent: 48 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_443 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_448 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_882 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_887 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to node_of_155 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_155 HostPersistent: 512 DevicePersistent: 1638912 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_157 HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_172 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to node_of_173 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_173 HostPersistent: 512 DevicePersistent: 410112 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_175 HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_176 HostPersistent: 512 DevicePersistent: 410112 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_178 HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_180 HostPersistent: 1664 DevicePersistent: 82432 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_182 HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 157 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_184 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_185 HostPersistent: 512 DevicePersistent: 6554624 [07/07/2021-20:02:28] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to node_of_187 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_187 HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_202 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_203 HostPersistent: 512 DevicePersistent: 1638912 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_205 HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_206 HostPersistent: 512 DevicePersistent: 1638912 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_208 HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_210 HostPersistent: 3200 DevicePersistent: 267264 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_212 HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 187 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_214 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_215 HostPersistent: 512 DevicePersistent: 26216448 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_217 HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_218 HostPersistent: 3200 DevicePersistent: 526336 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_220 HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_221 HostPersistent: 512 DevicePersistent: 13109248 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_223 HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_590 HostPersistent: 2192 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_592 HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_636 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_658 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 212 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_660 HostPersistent: 512 DevicePersistent: 9831424 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_662 HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_663 HostPersistent: 2192 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_723 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_718 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_713 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_708 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_703 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_698 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_693 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_688 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_683 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 683 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 703 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_678 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 678 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 698 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: PWN(node_of_787) HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: PWN(PWN(node_of_788), node_of_1028) HostPersistent: 340 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_673 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 673 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 693 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_786 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_870 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_863 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_842 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_835 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_814 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_807 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_668 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 668 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 688 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_224 HostPersistent: 2192 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_284 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_279 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_274 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_269 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_264 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_259 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_254 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_249 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_244 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 244 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 264 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_239 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 239 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 259 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: PWN(node_of_348) HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: PWN(PWN(node_of_349), node_of_589) HostPersistent: 340 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 589 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 1028 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_234 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 234 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 254 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_347 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_431 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_424 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_403 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_396 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_375 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_368 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_229 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 229 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 249 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 871 + (Unnamed Layer* 622) [Shuffle] + node_of_872 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 864 + (Unnamed Layer* 618) [Shuffle] + node_of_865 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 843 + (Unnamed Layer* 608) [Shuffle] + node_of_844 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 836 + (Unnamed Layer* 604) [Shuffle] + node_of_837 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 815 + (Unnamed Layer* 594) [Shuffle] + node_of_816 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 816 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 844 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 808 + (Unnamed Layer* 590) [Shuffle] + node_of_809 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 809 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 837 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 432 + (Unnamed Layer* 291) [Shuffle] + node_of_433 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 425 + (Unnamed Layer* 287) [Shuffle] + node_of_426 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 404 + (Unnamed Layer* 277) [Shuffle] + node_of_405 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 397 + (Unnamed Layer* 273) [Shuffle] + node_of_398 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 376 + (Unnamed Layer* 263) [Shuffle] + node_of_377 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 377 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 405 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 369 + (Unnamed Layer* 259) [Shuffle] + node_of_370 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 370 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 398 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: PWN(784 + (Unnamed Layer* 577) [Shuffle], PWN(PWN(PWN(node_of_781), 782 + (Unnamed Layer* 574) [Shuffle] + node_of_783), node_of_785)) HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_856 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_849 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_828 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_821 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_800 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_793 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: PWN(345 + (Unnamed Layer* 246) [Shuffle], PWN(PWN(PWN(node_of_342), 343 + (Unnamed Layer* 243) [Shuffle] + node_of_344), node_of_346)) HostPersistent: 244 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_417 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_410 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_389 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_382 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_361 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_354 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 857 + node_of_858 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 850 + node_of_851 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 829 + node_of_830 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 822 + node_of_823 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 801 + node_of_802 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 802 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 830 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 874 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 876 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_888 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_962 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_916 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 794 + node_of_795 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 795 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 823 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 873 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 875 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_883 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_939 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_893 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 418 + node_of_419 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 411 + node_of_412 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 390 + node_of_391 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 383 + node_of_384 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 362 + node_of_363 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 363 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 391 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 435 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 437 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_449 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_523 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_477 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 355 + node_of_356 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 356 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 384 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 434 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 436 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_444 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_500 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_454 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: PWN(PWN(984 + (Unnamed Layer* 719) [Shuffle], node_of_985), node_of_986) HostPersistent: 340 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_988 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: PWN(PWN(981 + (Unnamed Layer* 715) [Shuffle], node_of_982), node_of_983) HostPersistent: 340 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_987 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 983 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 986 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 987 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 988 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_1009 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: PWN(PWN(545 + (Unnamed Layer* 388) [Shuffle], node_of_546), node_of_547) HostPersistent: 340 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_549 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: PWN(PWN(542 + (Unnamed Layer* 384) [Shuffle], node_of_543), node_of_544) HostPersistent: 340 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: node_of_548 HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 544 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 547 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 548 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 549 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [V] [TRT] Layer: 570 copy HostPersistent: 0 DevicePersistent: 0 [07/07/2021-20:02:28] [I] [TRT] Total Host Persistent Memory: 35360 [07/07/2021-20:02:28] [I] [TRT] Total Device Persistent Memory: 63425536 [07/07/2021-20:02:28] [I] [TRT] Total Scratch Memory: 0 [07/07/2021-20:02:28] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 31 MiB, GPU 8 MiB [07/07/2021-20:02:28] [V] [TRT] Using cublas a tactic source [07/07/2021-20:02:28] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +8, now: CPU 817, GPU 1153 (MiB) [07/07/2021-20:02:28] [V] [TRT] Using cuDNN as a tactic source [07/07/2021-20:02:28] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +8, now: CPU 817, GPU 1161 (MiB) [07/07/2021-20:02:28] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 817, GPU 1145 (MiB) [07/07/2021-20:02:28] [V] [TRT] Engine generation completed in 88.1572 seconds. [07/07/2021-20:02:28] [V] [TRT] Deleting timing cache: 668 entries, 933 hits [07/07/2021-20:02:28] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 816, GPU 1127 (MiB) [07/07/2021-20:02:28] [V] [TRT] Engine Layer Information: Layer(Constant): 886[Constant], Tactic: 0, -> 886[Int32()] Layer(Constant): 447[Constant], Tactic: 0, -> 447[Int32()] Layer(CaskConvolution): node_of_119, Tactic: -3456450830548107839, input[Float(2,3,416,416)] -> 120[Float(2,32,208,208)] Layer(PointWiseV2): node_of_121, Tactic: 3, 120[Float(2,32,208,208)] -> 121[Float(2,32,208,208)] Layer(CaskConvolution): node_of_122, Tactic: 5137655947464784826, 121[Float(2,32,208,208)] -> 123[Float(2,64,104,104)] Layer(PointWiseV2): node_of_124, Tactic: 9, 123[Float(2,64,104,104)] -> 124[Float(2,64,104,104)] Layer(CaskConvolution): node_of_125, Tactic: -1343271414618805657, 124[Float(2,64,104,104)] -> 126[Float(2,64,104,104)] Layer(PointWiseV2): node_of_127, Tactic: 9, 126[Float(2,64,104,104)] -> 127[Float(2,64,104,104)] Layer(Reformat): node_of_142, Tactic: 0, 127[Float(2,32,104,104)] -> 142[Half(2,32,104,104)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to node_of_143, Tactic: 0, 142[Half(2,32,104,104)] -> Reformatted Input Tensor 0 to node_of_143[Float(2,32,104,104)] Layer(CaskConvolution): node_of_143, Tactic: -1343271414618805657, Reformatted Input Tensor 0 to node_of_143[Float(2,32,104,104)] -> 144[Float(2,32,104,104)] Layer(PointWiseV2): node_of_145, Tactic: 9, 144[Float(2,32,104,104)] -> 149[Float(2,32,104,104)] Layer(CaskConvolution): node_of_146, Tactic: -1343271414618805657, 149[Float(2,32,104,104)] -> 147[Float(2,32,104,104)] Layer(PointWiseV2): node_of_148, Tactic: 9, 147[Float(2,32,104,104)] -> 149[Float(2,32,104,104)] Layer(CaskConvolution): node_of_150, Tactic: -37215280111360163, 149[Float(2,64,104,104)] -> 151[Float(2,64,104,104)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to node_of_152, Tactic: 0, 151[Float(2,64,104,104)] -> Reformatted Input Tensor 0 to node_of_152[Half(2,64,104,104)] Layer(PointWiseV2): node_of_152, Tactic: 5, Reformatted Input Tensor 0 to node_of_152[Half(2,64,104,104)] -> 153[Half(2,64,104,104)] Layer(Reformat): 127 copy, Tactic: 0, 127[Float(2,64,104,104)] -> 153[Half(2,64,104,104)] Layer(CudnnPooling): node_of_154, Tactic: -1, 153[Half(2,128,104,104)] -> 154[Half(2,128,52,52)] Layer(Cast): node_of_443, Tactic: 0, 447[Int32()] -> 443[Float()] Layer(Cast): node_of_448, Tactic: 0, 447[Int32()] -> 448[Float()] Layer(Cast): node_of_882, Tactic: 0, 886[Int32()] -> 882[Float()] Layer(Cast): node_of_887, Tactic: 0, 886[Int32()] -> 887[Float()] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to node_of_155, Tactic: 0, 154[Half(2,128,52,52)] -> Reformatted Input Tensor 0 to node_of_155[Float(2,128,52,52)] Layer(CaskConvolution): node_of_155, Tactic: -1343271414618805657, Reformatted Input Tensor 0 to node_of_155[Float(2,128,52,52)] -> 156[Float(2,128,52,52)] Layer(PointWiseV2): node_of_157, Tactic: 5, 156[Float(2,128,52,52)] -> 157[Float(2,128,52,52)] Layer(Reformat): node_of_172, Tactic: 0, 157[Float(2,64,52,52)] -> 172[Half(2,64,52,52)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to node_of_173, Tactic: 0, 172[Half(2,64,52,52)] -> Reformatted Input Tensor 0 to node_of_173[Float(2,64,52,52)] Layer(CaskConvolution): node_of_173, Tactic: 3827454225649558724, Reformatted Input Tensor 0 to node_of_173[Float(2,64,52,52)] -> 174[Float(2,64,52,52)] Layer(PointWiseV2): node_of_175, Tactic: 9, 174[Float(2,64,52,52)] -> 179[Float(2,64,52,52)] Layer(CaskConvolution): node_of_176, Tactic: -8776506421218919509, 179[Float(2,64,52,52)] -> 177[Float(2,64,52,52)] Layer(PointWiseV2): node_of_178, Tactic: 9, 177[Float(2,64,52,52)] -> 179[Float(2,64,52,52)] Layer(CaskConvolution): node_of_180, Tactic: -410470605513481746, 179[Float(2,128,52,52)] -> 181[Float(2,128,52,52)] Layer(PointWiseV2): node_of_182, Tactic: 5, 181[Float(2,128,52,52)] -> 183[Float(2,128,52,52)] Layer(Reformat): 157 copy, Tactic: 0, 157[Float(2,128,52,52)] -> 183[Float(2,128,52,52)] Layer(TiledPooling): node_of_184, Tactic: 5767425, 183[Float(2,256,52,52)] -> 184[Float(2,256,26,26)] Layer(CaskConvolution): node_of_185, Tactic: -8776506421218919509, 184[Float(2,256,26,26)] -> 186[Float(2,256,26,26)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to node_of_187, Tactic: 0, 186[Float(2,256,26,26)] -> Reformatted Input Tensor 0 to node_of_187[Half(2,256,26,26)] Layer(PointWiseV2): node_of_187, Tactic: 7, Reformatted Input Tensor 0 to node_of_187[Half(2,256,26,26)] -> 187[Half(2,256,26,26)] Layer(Reformat): node_of_202, Tactic: 0, 187[Half(2,128,26,26)] -> 202[Float(2,128,26,26)] Layer(CaskConvolution): node_of_203, Tactic: -8776506421218919509, 202[Float(2,128,26,26)] -> 204[Float(2,128,26,26)] Layer(PointWiseV2): node_of_205, Tactic: 7, 204[Float(2,128,26,26)] -> 209[Float(2,128,26,26)] Layer(CaskConvolution): node_of_206, Tactic: -8776506421218919509, 209[Float(2,128,26,26)] -> 207[Float(2,128,26,26)] Layer(PointWiseV2): node_of_208, Tactic: 7, 207[Float(2,128,26,26)] -> 209[Float(2,128,26,26)] Layer(CaskConvolution): node_of_210, Tactic: -37215280111360163, 209[Float(2,256,26,26)] -> 211[Float(2,256,26,26)] Layer(PointWiseV2): node_of_212, Tactic: 5, 211[Float(2,256,26,26)] -> 213[Float(2,256,26,26)] Layer(Reformat): 187 copy, Tactic: 0, 187[Half(2,256,26,26)] -> 213[Float(2,256,26,26)] Layer(TiledPooling): node_of_214, Tactic: 6291713, 213[Float(2,512,26,26)] -> 214[Float(2,512,13,13)] Layer(CaskConvolution): node_of_215, Tactic: -1343271414618805657, 214[Float(2,512,13,13)] -> 216[Float(2,512,13,13)] Layer(PointWiseV2): node_of_217, Tactic: 8, 216[Float(2,512,13,13)] -> 217[Float(2,512,13,13)] Layer(CaskConvolution): node_of_218, Tactic: -37215280111360163, 217[Float(2,512,13,13)] -> 219[Float(2,256,13,13)] Layer(PointWiseV2): node_of_220, Tactic: 8, 219[Float(2,256,13,13)] -> 220[Float(2,256,13,13)] Layer(CaskConvolution): node_of_221, Tactic: -8776506421218919509, 220[Float(2,256,13,13)] -> 222[Float(2,512,13,13)] Layer(PointWiseV2): node_of_223, Tactic: 8, 222[Float(2,512,13,13)] -> 223[Float(2,512,13,13)] Layer(FusedConvActConvolution): node_of_590, Tactic: 6291455, 220[Float(2,256,13,13)] -> 591[Float(2,128,13,13)] Layer(PointWiseV2): node_of_592, Tactic: 3, 591[Float(2,128,13,13)] -> 592[Float(2,128,13,13)] Layer(Slice): node_of_636, Tactic: 0, 614[Float(2,128,13,1,13,1)] -> 636[Float(2,128,13,2,13,2)] Layer(Shuffle): node_of_658, Tactic: 0, 636[Float(2,128,13,2,13,2)] -> 659[Float(2,128,26,26)] Layer(Reformat): 212 copy, Tactic: 0, 213[Float(2,256,26,26)] -> 659[Float(2,256,26,26)] Layer(CaskConvolution): node_of_660, Tactic: -8776506421218919509, 659[Float(2,384,26,26)] -> 661[Float(2,256,26,26)] Layer(PointWiseV2): node_of_662, Tactic: 9, 661[Float(2,256,26,26)] -> 662[Float(2,256,26,26)] Layer(FusedConvActConvolution): node_of_663, Tactic: 2097151, 662[Float(2,256,26,26)] -> 663[Float(2,18,26,26)] Layer(Reformat): node_of_723, Tactic: 0, 663[Float(2,1,26,26)] -> 743[Float(2,1,26,26)] Layer(Reformat): node_of_718, Tactic: 0, 663[Float(2,1,26,26)] -> 726[Float(2,1,26,26)] Layer(Reformat): node_of_713, Tactic: 0, 663[Float(2,2,26,26)] -> 725[Float(2,2,26,26)] Layer(Reformat): node_of_708, Tactic: 0, 663[Float(2,2,26,26)] -> 724[Float(2,2,26,26)] Layer(Reformat): node_of_703, Tactic: 0, 663[Float(2,1,26,26)] -> 703[Float(2,1,26,26)] Layer(Reformat): node_of_698, Tactic: 0, 663[Float(2,1,26,26)] -> 698[Float(2,1,26,26)] Layer(Reformat): node_of_693, Tactic: 0, 663[Float(2,2,26,26)] -> 693[Float(2,2,26,26)] Layer(Reformat): node_of_688, Tactic: 0, 663[Float(2,2,26,26)] -> 688[Float(2,2,26,26)] Layer(Reformat): node_of_683, Tactic: 0, 663[Float(2,1,26,26)] -> 683[Float(2,1,26,26)] Layer(Reformat): 683 copy, Tactic: 0, 683[Float(2,1,26,26)] -> 743[Float(2,1,26,26)] Layer(Reformat): 703 copy, Tactic: 0, 703[Float(2,1,26,26)] -> 743[Float(2,1,26,26)] Layer(Reformat): node_of_678, Tactic: 0, 663[Float(2,1,26,26)] -> 678[Float(2,1,26,26)] Layer(Reformat): 678 copy, Tactic: 0, 678[Float(2,1,26,26)] -> 726[Float(2,1,26,26)] Layer(Reformat): 698 copy, Tactic: 0, 698[Float(2,1,26,26)] -> 726[Float(2,1,26,26)] Layer(PointWiseV2): PWN(node_of_787), Tactic: 28, 742[Float(2,2028)] -> 787[Float(2,2028)] Layer(PointWiseV2): PWN(PWN(node_of_788), node_of_1028), Tactic: 0, 780[Float(2,2028,1)], 1027[Float(2,2028,1)] -> 1028[Float(2,2028,1)] Layer(Reformat): node_of_673, Tactic: 0, 663[Float(2,2,26,26)] -> 673[Float(2,2,26,26)] Layer(Reformat): 673 copy, Tactic: 0, 673[Float(2,2,26,26)] -> 725[Float(2,2,26,26)] Layer(Reformat): 693 copy, Tactic: 0, 693[Float(2,2,26,26)] -> 725[Float(2,2,26,26)] Layer(Unary): node_of_786, Tactic: 0, 725[Float(2,6,26,26)] -> 786[Float(2,6,26,26)] Layer(Reformat): node_of_870, Tactic: 0, 786[Float(2,1,26,26)] -> 870[Float(2,1,26,26)] Layer(Reformat): node_of_863, Tactic: 0, 786[Float(2,1,26,26)] -> 863[Float(2,1,26,26)] Layer(Reformat): node_of_842, Tactic: 0, 786[Float(2,1,26,26)] -> 842[Float(2,1,26,26)] Layer(Reformat): node_of_835, Tactic: 0, 786[Float(2,1,26,26)] -> 835[Float(2,1,26,26)] Layer(Reformat): node_of_814, Tactic: 0, 786[Float(2,1,26,26)] -> 814[Float(2,1,26,26)] Layer(Reformat): node_of_807, Tactic: 0, 786[Float(2,1,26,26)] -> 807[Float(2,1,26,26)] Layer(Reformat): node_of_668, Tactic: 0, 663[Float(2,2,26,26)] -> 668[Float(2,2,26,26)] Layer(Reformat): 668 copy, Tactic: 0, 668[Float(2,2,26,26)] -> 724[Float(2,2,26,26)] Layer(Reformat): 688 copy, Tactic: 0, 688[Float(2,2,26,26)] -> 724[Float(2,2,26,26)] Layer(FusedConvActConvolution): node_of_224, Tactic: 7012351, 223[Float(2,512,13,13)] -> 224[Float(2,18,13,13)] Layer(Reformat): node_of_284, Tactic: 0, 224[Float(2,1,13,13)] -> 304[Float(2,1,13,13)] Layer(Reformat): node_of_279, Tactic: 0, 224[Float(2,1,13,13)] -> 287[Float(2,1,13,13)] Layer(Reformat): node_of_274, Tactic: 0, 224[Float(2,2,13,13)] -> 286[Float(2,2,13,13)] Layer(Reformat): node_of_269, Tactic: 0, 224[Float(2,2,13,13)] -> 285[Float(2,2,13,13)] Layer(Reformat): node_of_264, Tactic: 0, 224[Float(2,1,13,13)] -> 264[Float(2,1,13,13)] Layer(Reformat): node_of_259, Tactic: 0, 224[Float(2,1,13,13)] -> 259[Float(2,1,13,13)] Layer(Reformat): node_of_254, Tactic: 0, 224[Float(2,2,13,13)] -> 254[Float(2,2,13,13)] Layer(Reformat): node_of_249, Tactic: 0, 224[Float(2,2,13,13)] -> 249[Float(2,2,13,13)] Layer(Reformat): node_of_244, Tactic: 0, 224[Float(2,1,13,13)] -> 244[Float(2,1,13,13)] Layer(Reformat): 244 copy, Tactic: 0, 244[Float(2,1,13,13)] -> 304[Float(2,1,13,13)] Layer(Reformat): 264 copy, Tactic: 0, 264[Float(2,1,13,13)] -> 304[Float(2,1,13,13)] Layer(Reformat): node_of_239, Tactic: 0, 224[Float(2,1,13,13)] -> 239[Float(2,1,13,13)] Layer(Reformat): 239 copy, Tactic: 0, 239[Float(2,1,13,13)] -> 287[Float(2,1,13,13)] Layer(Reformat): 259 copy, Tactic: 0, 259[Float(2,1,13,13)] -> 287[Float(2,1,13,13)] Layer(PointWiseV2): PWN(node_of_348), Tactic: 0, 303[Float(2,507)] -> 348[Float(2,507)] Layer(PointWiseV2): PWN(PWN(node_of_349), node_of_589), Tactic: 0, 341[Float(2,507,1)], 588[Float(2,507,1)] -> 589[Float(2,507,1)] Layer(Reformat): 589 copy, Tactic: 0, 589[Float(2,507,1)] -> confs[Float(2,507,1)] Layer(Reformat): 1028 copy, Tactic: 0, 1028[Float(2,2028,1)] -> confs[Float(2,2028,1)] Layer(Reformat): node_of_234, Tactic: 0, 224[Float(2,2,13,13)] -> 234[Float(2,2,13,13)] Layer(Reformat): 234 copy, Tactic: 0, 234[Float(2,2,13,13)] -> 286[Float(2,2,13,13)] Layer(Reformat): 254 copy, Tactic: 0, 254[Float(2,2,13,13)] -> 286[Float(2,2,13,13)] Layer(Unary): node_of_347, Tactic: 0, 286[Float(2,6,13,13)] -> 347[Float(2,6,13,13)] Layer(Reformat): node_of_431, Tactic: 0, 347[Float(2,1,13,13)] -> 431[Float(2,1,13,13)] Layer(Reformat): node_of_424, Tactic: 0, 347[Float(2,1,13,13)] -> 424[Float(2,1,13,13)] Layer(Reformat): node_of_403, Tactic: 0, 347[Float(2,1,13,13)] -> 403[Float(2,1,13,13)] Layer(Reformat): node_of_396, Tactic: 0, 347[Float(2,1,13,13)] -> 396[Float(2,1,13,13)] Layer(Reformat): node_of_375, Tactic: 0, 347[Float(2,1,13,13)] -> 375[Float(2,1,13,13)] Layer(Reformat): node_of_368, Tactic: 0, 347[Float(2,1,13,13)] -> 368[Float(2,1,13,13)] Layer(Reformat): node_of_229, Tactic: 0, 224[Float(2,2,13,13)] -> 229[Float(2,2,13,13)] Layer(Reformat): 229 copy, Tactic: 0, 229[Float(2,2,13,13)] -> 285[Float(2,2,13,13)] Layer(Reformat): 249 copy, Tactic: 0, 249[Float(2,2,13,13)] -> 285[Float(2,2,13,13)] Layer(Scale): 871 + (Unnamed Layer* 622) [Shuffle] + node_of_872, Tactic: 0, 870[Float(2,1,26,26)] -> 876[Float(2,1,26,26)] Layer(Scale): 864 + (Unnamed Layer* 618) [Shuffle] + node_of_865, Tactic: 0, 863[Float(2,1,26,26)] -> 875[Float(2,1,26,26)] Layer(Scale): 843 + (Unnamed Layer* 608) [Shuffle] + node_of_844, Tactic: 0, 842[Float(2,1,26,26)] -> 844[Float(2,1,26,26)] Layer(Scale): 836 + (Unnamed Layer* 604) [Shuffle] + node_of_837, Tactic: 0, 835[Float(2,1,26,26)] -> 837[Float(2,1,26,26)] Layer(Scale): 815 + (Unnamed Layer* 594) [Shuffle] + node_of_816, Tactic: 0, 814[Float(2,1,26,26)] -> 816[Float(2,1,26,26)] Layer(Reformat): 816 copy, Tactic: 0, 816[Float(2,1,26,26)] -> 876[Float(2,1,26,26)] Layer(Reformat): 844 copy, Tactic: 0, 844[Float(2,1,26,26)] -> 876[Float(2,1,26,26)] Layer(Scale): 808 + (Unnamed Layer* 590) [Shuffle] + node_of_809, Tactic: 0, 807[Float(2,1,26,26)] -> 809[Float(2,1,26,26)] Layer(Reformat): 809 copy, Tactic: 0, 809[Float(2,1,26,26)] -> 875[Float(2,1,26,26)] Layer(Reformat): 837 copy, Tactic: 0, 837[Float(2,1,26,26)] -> 875[Float(2,1,26,26)] Layer(Scale): 432 + (Unnamed Layer* 291) [Shuffle] + node_of_433, Tactic: 0, 431[Float(2,1,13,13)] -> 437[Float(2,1,13,13)] Layer(Scale): 425 + (Unnamed Layer* 287) [Shuffle] + node_of_426, Tactic: 0, 424[Float(2,1,13,13)] -> 436[Float(2,1,13,13)] Layer(Scale): 404 + (Unnamed Layer* 277) [Shuffle] + node_of_405, Tactic: 0, 403[Float(2,1,13,13)] -> 405[Float(2,1,13,13)] Layer(Scale): 397 + (Unnamed Layer* 273) [Shuffle] + node_of_398, Tactic: 0, 396[Float(2,1,13,13)] -> 398[Float(2,1,13,13)] Layer(Scale): 376 + (Unnamed Layer* 263) [Shuffle] + node_of_377, Tactic: 0, 375[Float(2,1,13,13)] -> 377[Float(2,1,13,13)] Layer(Reformat): 377 copy, Tactic: 0, 377[Float(2,1,13,13)] -> 437[Float(2,1,13,13)] Layer(Reformat): 405 copy, Tactic: 0, 405[Float(2,1,13,13)] -> 437[Float(2,1,13,13)] Layer(Scale): 369 + (Unnamed Layer* 259) [Shuffle] + node_of_370, Tactic: 0, 368[Float(2,1,13,13)] -> 370[Float(2,1,13,13)] Layer(Reformat): 370 copy, Tactic: 0, 370[Float(2,1,13,13)] -> 436[Float(2,1,13,13)] Layer(Reformat): 398 copy, Tactic: 0, 398[Float(2,1,13,13)] -> 436[Float(2,1,13,13)] Layer(PointWiseV2): PWN(784 + (Unnamed Layer* 577) [Shuffle], PWN(PWN(PWN(node_of_781), 782 + (Unnamed Layer* 574) [Shuffle] + node_of_783), node_of_785)), Tactic: 0, 724[Float(2,6,26,26)] -> 785[Float(2,6,26,26)] Layer(Reformat): node_of_856, Tactic: 0, 785[Float(2,1,26,26)] -> 856[Float(2,1,26,26)] Layer(Reformat): node_of_849, Tactic: 0, 785[Float(2,1,26,26)] -> 849[Float(2,1,26,26)] Layer(Reformat): node_of_828, Tactic: 0, 785[Float(2,1,26,26)] -> 828[Float(2,1,26,26)] Layer(Reformat): node_of_821, Tactic: 0, 785[Float(2,1,26,26)] -> 821[Float(2,1,26,26)] Layer(Reformat): node_of_800, Tactic: 0, 785[Float(2,1,26,26)] -> 800[Float(2,1,26,26)] Layer(Reformat): node_of_793, Tactic: 0, 785[Float(2,1,26,26)] -> 793[Float(2,1,26,26)] Layer(PointWiseV2): PWN(345 + (Unnamed Layer* 246) [Shuffle], PWN(PWN(PWN(node_of_342), 343 + (Unnamed Layer* 243) [Shuffle] + node_of_344), node_of_346)), Tactic: 0, 285[Float(2,6,13,13)] -> 346[Float(2,6,13,13)] Layer(Reformat): node_of_417, Tactic: 0, 346[Float(2,1,13,13)] -> 417[Float(2,1,13,13)] Layer(Reformat): node_of_410, Tactic: 0, 346[Float(2,1,13,13)] -> 410[Float(2,1,13,13)] Layer(Reformat): node_of_389, Tactic: 0, 346[Float(2,1,13,13)] -> 389[Float(2,1,13,13)] Layer(Reformat): node_of_382, Tactic: 0, 346[Float(2,1,13,13)] -> 382[Float(2,1,13,13)] Layer(Reformat): node_of_361, Tactic: 0, 346[Float(2,1,13,13)] -> 361[Float(2,1,13,13)] Layer(Reformat): node_of_354, Tactic: 0, 346[Float(2,1,13,13)] -> 354[Float(2,1,13,13)] Layer(Scale): 857 + node_of_858, Tactic: 0, 856[Float(2,1,26,26)] -> 874[Float(2,1,26,26)] Layer(Scale): 850 + node_of_851, Tactic: 0, 849[Float(2,1,26,26)] -> 873[Float(2,1,26,26)] Layer(Scale): 829 + node_of_830, Tactic: 0, 828[Float(2,1,26,26)] -> 830[Float(2,1,26,26)] Layer(Scale): 822 + node_of_823, Tactic: 0, 821[Float(2,1,26,26)] -> 823[Float(2,1,26,26)] Layer(Scale): 801 + node_of_802, Tactic: 0, 800[Float(2,1,26,26)] -> 802[Float(2,1,26,26)] Layer(Reformat): 802 copy, Tactic: 0, 802[Float(2,1,26,26)] -> 874[Float(2,1,26,26)] Layer(Reformat): 830 copy, Tactic: 0, 830[Float(2,1,26,26)] -> 874[Float(2,1,26,26)] Layer(Reformat): 874 copy, Tactic: 0, 874[Float(2,3,26,26)] -> 878[Float(2,3,26,26)] Layer(Reformat): 876 copy, Tactic: 0, 876[Float(2,3,26,26)] -> 878[Float(2,3,26,26)] Layer(ElementWise): node_of_888, Tactic: 1, 878[Float(2,6,26,26)], (Unnamed Layer* 640) [Shuffle]_output[Float(1,1,1,1)] -> 888[Float(2,6,26,26)] Layer(Reformat): node_of_962, Tactic: 0, 888[Float(2,3,26,26)] -> 962[Float(2,3,26,26)] Layer(Reformat): node_of_916, Tactic: 0, 888[Float(2,3,26,26)] -> 916[Float(2,3,26,26)] Layer(Scale): 794 + node_of_795, Tactic: 0, 793[Float(2,1,26,26)] -> 795[Float(2,1,26,26)] Layer(Reformat): 795 copy, Tactic: 0, 795[Float(2,1,26,26)] -> 873[Float(2,1,26,26)] Layer(Reformat): 823 copy, Tactic: 0, 823[Float(2,1,26,26)] -> 873[Float(2,1,26,26)] Layer(Reformat): 873 copy, Tactic: 0, 873[Float(2,3,26,26)] -> 877[Float(2,3,26,26)] Layer(Reformat): 875 copy, Tactic: 0, 875[Float(2,3,26,26)] -> 877[Float(2,3,26,26)] Layer(ElementWise): node_of_883, Tactic: 1, 877[Float(2,6,26,26)], (Unnamed Layer* 634) [Shuffle]_output[Float(1,1,1,1)] -> 883[Float(2,6,26,26)] Layer(Reformat): node_of_939, Tactic: 0, 883[Float(2,3,26,26)] -> 939[Float(2,3,26,26)] Layer(Reformat): node_of_893, Tactic: 0, 883[Float(2,3,26,26)] -> 893[Float(2,3,26,26)] Layer(Scale): 418 + node_of_419, Tactic: 0, 417[Float(2,1,13,13)] -> 435[Float(2,1,13,13)] Layer(Scale): 411 + node_of_412, Tactic: 0, 410[Float(2,1,13,13)] -> 434[Float(2,1,13,13)] Layer(Scale): 390 + node_of_391, Tactic: 0, 389[Float(2,1,13,13)] -> 391[Float(2,1,13,13)] Layer(Scale): 383 + node_of_384, Tactic: 0, 382[Float(2,1,13,13)] -> 384[Float(2,1,13,13)] Layer(Scale): 362 + node_of_363, Tactic: 0, 361[Float(2,1,13,13)] -> 363[Float(2,1,13,13)] Layer(Reformat): 363 copy, Tactic: 0, 363[Float(2,1,13,13)] -> 435[Float(2,1,13,13)] Layer(Reformat): 391 copy, Tactic: 0, 391[Float(2,1,13,13)] -> 435[Float(2,1,13,13)] Layer(Reformat): 435 copy, Tactic: 0, 435[Float(2,3,13,13)] -> 439[Float(2,3,13,13)] Layer(Reformat): 437 copy, Tactic: 0, 437[Float(2,3,13,13)] -> 439[Float(2,3,13,13)] Layer(ElementWise): node_of_449, Tactic: 1, 439[Float(2,6,13,13)], (Unnamed Layer* 309) [Shuffle]_output[Float(1,1,1,1)] -> 449[Float(2,6,13,13)] Layer(Reformat): node_of_523, Tactic: 0, 449[Float(2,3,13,13)] -> 523[Float(2,3,13,13)] Layer(Reformat): node_of_477, Tactic: 0, 449[Float(2,3,13,13)] -> 477[Float(2,3,13,13)] Layer(Scale): 355 + node_of_356, Tactic: 0, 354[Float(2,1,13,13)] -> 356[Float(2,1,13,13)] Layer(Reformat): 356 copy, Tactic: 0, 356[Float(2,1,13,13)] -> 434[Float(2,1,13,13)] Layer(Reformat): 384 copy, Tactic: 0, 384[Float(2,1,13,13)] -> 434[Float(2,1,13,13)] Layer(Reformat): 434 copy, Tactic: 0, 434[Float(2,3,13,13)] -> 438[Float(2,3,13,13)] Layer(Reformat): 436 copy, Tactic: 0, 436[Float(2,3,13,13)] -> 438[Float(2,3,13,13)] Layer(ElementWise): node_of_444, Tactic: 1, 438[Float(2,6,13,13)], (Unnamed Layer* 303) [Shuffle]_output[Float(1,1,1,1)] -> 444[Float(2,6,13,13)] Layer(Reformat): node_of_500, Tactic: 0, 444[Float(2,3,13,13)] -> 500[Float(2,3,13,13)] Layer(Reformat): node_of_454, Tactic: 0, 444[Float(2,3,13,13)] -> 454[Float(2,3,13,13)] Layer(PointWiseV2): PWN(PWN(984 + (Unnamed Layer* 719) [Shuffle], node_of_985), node_of_986), Tactic: 0, 980[Float(2,2028,1)], 934[Float(2,2028,1)] -> 986[Float(2,2028,1)] Layer(ElementWise): node_of_988, Tactic: 1, 986[Float(2,2028,1)], 980[Float(2,2028,1)] -> 988[Float(2,2028,1)] Layer(PointWiseV2): PWN(PWN(981 + (Unnamed Layer* 715) [Shuffle], node_of_982), node_of_983), Tactic: 0, 957[Float(2,2028,1)], 911[Float(2,2028,1)] -> 983[Float(2,2028,1)] Layer(ElementWise): node_of_987, Tactic: 1, 983[Float(2,2028,1)], 957[Float(2,2028,1)] -> 987[Float(2,2028,1)] Layer(Reformat): 983 copy, Tactic: 0, 983[Float(2,2028,1)] -> 989[Float(2,2028,1)] Layer(Reformat): 986 copy, Tactic: 0, 986[Float(2,2028,1)] -> 989[Float(2,2028,1)] Layer(Reformat): 987 copy, Tactic: 0, 987[Float(2,2028,1)] -> 989[Float(2,2028,1)] Layer(Reformat): 988 copy, Tactic: 0, 988[Float(2,2028,1)] -> 989[Float(2,2028,1)] Layer(Shuffle): node_of_1009, Tactic: 0, 989[Float(2,2028,4)] -> boxes[Float(2,2028,1,4)] Layer(PointWiseV2): PWN(PWN(545 + (Unnamed Layer* 388) [Shuffle], node_of_546), node_of_547), Tactic: 0, 541[Float(2,507,1)], 495[Float(2,507,1)] -> 547[Float(2,507,1)] Layer(ElementWise): node_of_549, Tactic: 1, 547[Float(2,507,1)], 541[Float(2,507,1)] -> 549[Float(2,507,1)] Layer(PointWiseV2): PWN(PWN(542 + (Unnamed Layer* 384) [Shuffle], node_of_543), node_of_544), Tactic: 0, 518[Float(2,507,1)], 472[Float(2,507,1)] -> 544[Float(2,507,1)] Layer(ElementWise): node_of_548, Tactic: 1, 544[Float(2,507,1)], 518[Float(2,507,1)] -> 548[Float(2,507,1)] Layer(Reformat): 544 copy, Tactic: 0, 544[Float(2,507,1)] -> 550[Float(2,507,1)] Layer(Reformat): 547 copy, Tactic: 0, 547[Float(2,507,1)] -> 550[Float(2,507,1)] Layer(Reformat): 548 copy, Tactic: 0, 548[Float(2,507,1)] -> 550[Float(2,507,1)] Layer(Reformat): 549 copy, Tactic: 0, 549[Float(2,507,1)] -> 550[Float(2,507,1)] Layer(Reformat): 570 copy, Tactic: 0, 570[Float(2,507,1,4)] -> boxes[Float(2,507,1,4)] [07/07/2021-20:02:28] [I] [TRT] [MemUsageSnapshot] Builder end: CPU 816 MiB, GPU 1127 MiB [07/07/2021-20:02:28] [I] Engine built in 89.3243 sec. [07/07/2021-20:02:28] [V] [TRT] Using cublas a tactic source [07/07/2021-20:02:28] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +10, now: CPU 791, GPU 1137 (MiB) [07/07/2021-20:02:28] [V] [TRT] Using cuDNN as a tactic source [07/07/2021-20:02:28] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +8, now: CPU 791, GPU 1145 (MiB) [07/07/2021-20:02:28] [V] [TRT] Total per-runner device memory is 63425536 [07/07/2021-20:02:28] [V] [TRT] Total per-runner host memory is 35360 [07/07/2021-20:02:28] [V] [TRT] Allocated activation device memory of size 30733312 [07/07/2021-20:02:28] [I] Created input binding for input with dimensions 2x3x416x416 [07/07/2021-20:02:28] [I] Created output binding for boxes with dimensions 2x2535x1x4 [07/07/2021-20:02:28] [I] Created output binding for confs with dimensions 2x2535x1 [07/07/2021-20:02:28] [I] Starting inference [07/07/2021-20:02:32] [I] Warmup completed 52 queries over 200 ms [07/07/2021-20:02:32] [I] Timing trace has 765 queries over 3.01298 s [07/07/2021-20:02:32] [I] [07/07/2021-20:02:32] [I] === Trace details === [07/07/2021-20:02:32] [I] Trace averages of 10 runs: [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.98981 ms - Host latency: 4.3742 ms (end to end 7.86555 ms, enqueue 0.540984 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.74845 ms - Host latency: 4.11133 ms (end to end 7.01668 ms, enqueue 0.568237 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.67104 ms - Host latency: 4.03538 ms (end to end 7.19363 ms, enqueue 0.836731 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.68343 ms - Host latency: 4.05606 ms (end to end 7.14967 ms, enqueue 1.64911 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.66254 ms - Host latency: 4.03614 ms (end to end 6.88799 ms, enqueue 2.05676 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.66089 ms - Host latency: 4.03376 ms (end to end 6.48823 ms, enqueue 2.16933 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.64336 ms - Host latency: 4.01523 ms (end to end 6.1527 ms, enqueue 2.14943 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.65351 ms - Host latency: 4.02265 ms (end to end 6.08755 ms, enqueue 2.14222 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.6519 ms - Host latency: 4.02252 ms (end to end 6.60629 ms, enqueue 1.85579 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.62793 ms - Host latency: 4.02001 ms (end to end 6.72849 ms, enqueue 1.5537 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.62507 ms - Host latency: 4.02993 ms (end to end 6.1149 ms, enqueue 1.42808 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.61809 ms - Host latency: 3.98544 ms (end to end 7.01196 ms, enqueue 0.460144 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.61381 ms - Host latency: 3.99668 ms (end to end 7.06885 ms, enqueue 0.594983 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.60519 ms - Host latency: 4.03975 ms (end to end 7.02622 ms, enqueue 1.47469 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.61473 ms - Host latency: 4.07058 ms (end to end 6.66776 ms, enqueue 1.74387 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.60367 ms - Host latency: 4.05832 ms (end to end 6.40579 ms, enqueue 2.02691 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.60603 ms - Host latency: 4.06344 ms (end to end 6.6065 ms, enqueue 1.80282 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.59834 ms - Host latency: 3.96616 ms (end to end 6.6813 ms, enqueue 1.52821 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.59227 ms - Host latency: 3.95771 ms (end to end 6.3845 ms, enqueue 1.50535 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.60714 ms - Host latency: 3.99418 ms (end to end 6.27261 ms, enqueue 1.69349 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.59822 ms - Host latency: 3.97087 ms (end to end 6.70911 ms, enqueue 1.97817 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.59414 ms - Host latency: 3.96908 ms (end to end 6.5502 ms, enqueue 1.97035 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.58051 ms - Host latency: 3.95566 ms (end to end 6.92373 ms, enqueue 1.97225 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.61892 ms - Host latency: 4.02756 ms (end to end 6.50027 ms, enqueue 1.97185 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.60316 ms - Host latency: 4.05554 ms (end to end 6.33796 ms, enqueue 2.03435 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.62039 ms - Host latency: 4.03054 ms (end to end 5.99041 ms, enqueue 2.06064 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.60096 ms - Host latency: 3.97072 ms (end to end 6.90413 ms, enqueue 1.40604 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.59888 ms - Host latency: 3.96842 ms (end to end 6.6106 ms, enqueue 1.39347 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.59633 ms - Host latency: 3.96392 ms (end to end 6.82614 ms, enqueue 1.39283 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.59534 ms - Host latency: 3.97167 ms (end to end 6.59338 ms, enqueue 1.39574 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.59071 ms - Host latency: 3.98668 ms (end to end 6.13864 ms, enqueue 1.97554 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.6054 ms - Host latency: 4.05806 ms (end to end 5.93667 ms, enqueue 2.19275 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.56946 ms - Host latency: 3.99946 ms (end to end 6.4218 ms, enqueue 1.56506 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.56873 ms - Host latency: 3.99734 ms (end to end 6.25139 ms, enqueue 1.57722 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.58749 ms - Host latency: 4.00459 ms (end to end 6.43601 ms, enqueue 1.56503 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.58 ms - Host latency: 3.9614 ms (end to end 6.7072 ms, enqueue 1.54791 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.58737 ms - Host latency: 3.96975 ms (end to end 6.85536 ms, enqueue 1.55609 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.57856 ms - Host latency: 3.94429 ms (end to end 6.94188 ms, enqueue 1.51703 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.58145 ms - Host latency: 3.96746 ms (end to end 6.96239 ms, enqueue 1.54338 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.58073 ms - Host latency: 4.03497 ms (end to end 6.48429 ms, enqueue 2.05209 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.57803 ms - Host latency: 4.01415 ms (end to end 5.58622 ms, enqueue 2.07469 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.53711 ms - Host latency: 3.97426 ms (end to end 6.61064 ms, enqueue 2.01439 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.58687 ms - Host latency: 4.0123 ms (end to end 6.1963 ms, enqueue 1.45853 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.60654 ms - Host latency: 4.02806 ms (end to end 6.52512 ms, enqueue 1.45834 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.60065 ms - Host latency: 4.02703 ms (end to end 6.60814 ms, enqueue 1.4532 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.60205 ms - Host latency: 4.03186 ms (end to end 6.67109 ms, enqueue 1.46 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.59597 ms - Host latency: 4.01105 ms (end to end 6.7359 ms, enqueue 1.43562 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.59336 ms - Host latency: 3.96606 ms (end to end 6.83107 ms, enqueue 1.83754 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.60193 ms - Host latency: 4.00647 ms (end to end 5.96433 ms, enqueue 2.24038 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.54365 ms - Host latency: 3.96809 ms (end to end 5.44766 ms, enqueue 2.24602 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.5343 ms - Host latency: 3.97634 ms (end to end 5.8606 ms, enqueue 2.02917 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.54221 ms - Host latency: 3.95134 ms (end to end 6.10938 ms, enqueue 1.58784 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.57202 ms - Host latency: 3.98335 ms (end to end 5.92122 ms, enqueue 1.56018 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.55881 ms - Host latency: 3.92407 ms (end to end 5.86287 ms, enqueue 1.50056 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.57432 ms - Host latency: 3.93811 ms (end to end 6.21182 ms, enqueue 1.50371 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.59827 ms - Host latency: 4.02432 ms (end to end 6.476 ms, enqueue 1.78611 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.59124 ms - Host latency: 4.04548 ms (end to end 6.50276 ms, enqueue 2.04075 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.6282 ms - Host latency: 4.02661 ms (end to end 5.73694 ms, enqueue 2.08108 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.89653 ms - Host latency: 4.30767 ms (end to end 7.45813 ms, enqueue 1.44312 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.57102 ms - Host latency: 3.94023 ms (end to end 6.29993 ms, enqueue 1.58799 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.59668 ms - Host latency: 3.96792 ms (end to end 6.42148 ms, enqueue 1.79783 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.58633 ms - Host latency: 3.99648 ms (end to end 6.45007 ms, enqueue 1.85488 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.58491 ms - Host latency: 3.96724 ms (end to end 5.86162 ms, enqueue 1.54067 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.59695 ms - Host latency: 3.97012 ms (end to end 7.02737 ms, enqueue 0.48147 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.59973 ms - Host latency: 4.00376 ms (end to end 7.05015 ms, enqueue 0.879687 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.58501 ms - Host latency: 4.00071 ms (end to end 6.94021 ms, enqueue 2.17681 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.58662 ms - Host latency: 3.98916 ms (end to end 6.39504 ms, enqueue 2.2073 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.57466 ms - Host latency: 4.01663 ms (end to end 5.91138 ms, enqueue 2.24294 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.58767 ms - Host latency: 3.98616 ms (end to end 6.39976 ms, enqueue 2.23572 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.59631 ms - Host latency: 3.971 ms (end to end 5.92446 ms, enqueue 2.1968 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.624 ms - Host latency: 4.00095 ms (end to end 6.41318 ms, enqueue 1.83521 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.62295 ms - Host latency: 3.99001 ms (end to end 6.47083 ms, enqueue 1.5061 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.60879 ms - Host latency: 3.97371 ms (end to end 7.01467 ms, enqueue 1.51611 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.60298 ms - Host latency: 3.97212 ms (end to end 6.12402 ms, enqueue 1.86084 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.5959 ms - Host latency: 3.96384 ms (end to end 6.17246 ms, enqueue 1.71724 ms) [07/07/2021-20:02:32] [I] Average on 10 runs - GPU latency: 3.59731 ms - Host latency: 3.97175 ms (end to end 6.62031 ms, enqueue 1.46121 ms) [07/07/2021-20:02:32] [I] [07/07/2021-20:02:32] [I] === Performance summary === [07/07/2021-20:02:32] [I] Throughput: 253.901 qps [07/07/2021-20:02:32] [I] Latency: min = 3.88599 ms, max = 7.26392 ms, mean = 4.00766 ms, median = 3.9917 ms, percentile(99%) = 4.17767 ms [07/07/2021-20:02:32] [I] End-to-End Host Latency: min = 3.90186 ms, max = 10.239 ms, mean = 6.5078 ms, median = 6.95581 ms, percentile(99%) = 7.46497 ms [07/07/2021-20:02:32] [I] Enqueue Time: min = 0.4375 ms, max = 3.17358 ms, mean = 1.665 ms, median = 1.58862 ms, percentile(99%) = 2.42017 ms [07/07/2021-20:02:32] [I] H2D Latency: min = 0.344299 ms, max = 0.737793 ms, mean = 0.383756 ms, median = 0.359955 ms, percentile(99%) = 0.455566 ms [07/07/2021-20:02:32] [I] GPU Compute Time: min = 3.4978 ms, max = 6.84644 ms, mean = 3.61016 ms, median = 3.59521 ms, percentile(99%) = 3.80006 ms [07/07/2021-20:02:32] [I] D2H Latency: min = 0.0100098 ms, max = 0.027832 ms, mean = 0.0137442 ms, median = 0.0118408 ms, percentile(99%) = 0.0224609 ms [07/07/2021-20:02:32] [I] Total Host Walltime: 3.01298 s [07/07/2021-20:02:32] [I] Total GPU Compute Time: 2.76177 s [07/07/2021-20:02:32] [I] Explanations of the performance metrics are printed in the verbose logs. [07/07/2021-20:02:32] [V] [07/07/2021-20:02:32] [V] === Explanations of the performance metrics === [07/07/2021-20:02:32] [V] Total Host Walltime: the host walltime from when the first query (after warmups) is enqueued to when the last query is completed. [07/07/2021-20:02:32] [V] GPU Compute Time: the GPU latency to execute the kernels for a query. [07/07/2021-20:02:32] [V] Total GPU Compute Time: the summation of the GPU Compute Time of all the queries. If this is significantly shorter than Total Host Walltime, the GPU may be under-utilized because of host-side overheads or data transfers. [07/07/2021-20:02:32] [V] Throughput: the observed throughput computed by dividing the number of queries by the Total Host Walltime. If this is significantly lower than the reciprocal of GPU Compute Time, the GPU may be under-utilized because of host-side overheads or data transfers. [07/07/2021-20:02:32] [V] Enqueue Time: the host latency to enqueue a query. If this is longer than GPU Compute Time, the GPU may be under-utilized. [07/07/2021-20:02:32] [V] H2D Latency: the latency for host-to-device data transfers for input tensors of a single query. [07/07/2021-20:02:32] [V] D2H Latency: the latency for device-to-host data transfers for output tensors of a single query. [07/07/2021-20:02:32] [V] Latency: the summation of H2D Latency, GPU Compute Time, and D2H Latency. This is the latency to infer a single query. [07/07/2021-20:02:32] [V] End-to-End Host Latency: the duration from when the H2D of a query is called to when the D2H of the same query is completed, which includes the latency to wait for the completion of the previous query. This is the latency of a query if multiple queries are enqueued consecutively. [07/07/2021-20:02:32] [I] &&&& PASSED TensorRT.trtexec [TensorRT v8000] # trtexec --onnx=/home/htut/Desktop/AltoAI/detection/darknet/yolov4_2_3_416_416_static.onnx --maxBatch=2 --fp16 --saveEngine=yolov4tinychula2-416.trt --verbose [07/07/2021-20:02:32] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 791, GPU 1157 (MiB)