=========================== System information: ======================================== hostname: user: NVIDIA: Sun Mar 13 08:27:44 2022 +-----------------------------------------------------------------------------+ | NVIDIA-SMI 460.27.04 Driver Version: 460.27.04 CUDA Version: 11.2 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |===============================+======================+======================| | 0 GeForce GTX 1650 Off | 00000000:01:00.0 On | N/A | | N/A 38C P8 1W / N/A | 137MiB / 3911MiB | 2% Default | | | | N/A | +-------------------------------+----------------------+----------------------+ +-----------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=============================================================================| | 0 N/A N/A 2318 G /usr/lib/xorg/Xorg 136MiB | +-----------------------------------------------------------------------------+ &&&& RUNNING TensorRT.trtexec # trtexec --onnx=/path/to/model.onnx --saveEngine=/path/to/engine_TRT-7-1-3_CCC-7-5.trt --fp16 --verbose --iterations=10 [03/13/2022-08:27:48] [I] === Model Options === [03/13/2022-08:27:48] [I] Format: ONNX [03/13/2022-08:27:48] [I] Model: /path/to/model.onnx [03/13/2022-08:27:48] [I] Output: [03/13/2022-08:27:48] [I] === Build Options === [03/13/2022-08:27:48] [I] Max batch: 1 [03/13/2022-08:27:48] [I] Workspace: 16 MB [03/13/2022-08:27:48] [I] minTiming: 1 [03/13/2022-08:27:48] [I] avgTiming: 8 [03/13/2022-08:27:48] [I] Precision: FP32+FP16 [03/13/2022-08:27:48] [I] Calibration: [03/13/2022-08:27:48] [I] Safe mode: Disabled [03/13/2022-08:27:48] [I] Save engine: /path/to/engine_TRT-7-1-3_CCC-7-5.trt [03/13/2022-08:27:48] [I] Load engine: [03/13/2022-08:27:48] [I] Builder Cache: Enabled [03/13/2022-08:27:48] [I] NVTX verbosity: 0 [03/13/2022-08:27:48] [I] Inputs format: fp32:CHW [03/13/2022-08:27:48] [I] Outputs format: fp32:CHW [03/13/2022-08:27:48] [I] Input build shapes: model [03/13/2022-08:27:48] [I] Input calibration shapes: model [03/13/2022-08:27:48] [I] === System Options === [03/13/2022-08:27:48] [I] Device: 0 [03/13/2022-08:27:48] [I] DLACore: [03/13/2022-08:27:48] [I] Plugins: [03/13/2022-08:27:48] [I] === Inference Options === [03/13/2022-08:27:48] [I] Batch: 1 [03/13/2022-08:27:48] [I] Input inference shapes: model [03/13/2022-08:27:48] [I] Iterations: 10 [03/13/2022-08:27:48] [I] Duration: 3s (+ 200ms warm up) [03/13/2022-08:27:48] [I] Sleep time: 0ms [03/13/2022-08:27:48] [I] Streams: 1 [03/13/2022-08:27:48] [I] ExposeDMA: Disabled [03/13/2022-08:27:48] [I] Spin-wait: Disabled [03/13/2022-08:27:48] [I] Multithreading: Disabled [03/13/2022-08:27:48] [I] CUDA Graph: Disabled [03/13/2022-08:27:48] [I] Skip inference: Disabled [03/13/2022-08:27:48] [I] Inputs: [03/13/2022-08:27:48] [I] === Reporting Options === [03/13/2022-08:27:48] [I] Verbose: Enabled [03/13/2022-08:27:48] [I] Averages: 10 inferences [03/13/2022-08:27:48] [I] Percentile: 99 [03/13/2022-08:27:48] [I] Dump output: Disabled [03/13/2022-08:27:48] [I] Profile: Disabled [03/13/2022-08:27:48] [I] Export timing to JSON file: [03/13/2022-08:27:48] [I] Export output to JSON file: [03/13/2022-08:27:48] [I] Export profile to JSON file: [03/13/2022-08:27:48] [I] [03/13/2022-08:27:48] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [03/13/2022-08:27:48] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [03/13/2022-08:27:48] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [03/13/2022-08:27:48] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [03/13/2022-08:27:48] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1 [03/13/2022-08:27:48] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [03/13/2022-08:27:48] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [03/13/2022-08:27:48] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [03/13/2022-08:27:48] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [03/13/2022-08:27:48] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [03/13/2022-08:27:48] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [03/13/2022-08:27:48] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [03/13/2022-08:27:48] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [03/13/2022-08:27:48] [V] [TRT] Registered plugin creator - ::Proposal version 1 [03/13/2022-08:27:48] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [03/13/2022-08:27:48] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [03/13/2022-08:27:48] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [03/13/2022-08:27:48] [V] [TRT] Registered plugin creator - ::Split version 1 [03/13/2022-08:27:48] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [03/13/2022-08:27:48] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 ---------------------------------------------------------------- Input filename: /path/to/model.onnx ONNX IR version: 0.0.6 Opset version: 11 Producer name: pytorch Producer version: 1.6 Domain: Model version: 0 Doc string: ---------------------------------------------------------------- [03/13/2022-08:27:49] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1 [03/13/2022-08:27:49] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1 [03/13/2022-08:27:49] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1 [03/13/2022-08:27:49] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1 [03/13/2022-08:27:49] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1 [03/13/2022-08:27:49] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1 [03/13/2022-08:27:49] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1 [03/13/2022-08:27:49] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1 [03/13/2022-08:27:49] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1 [03/13/2022-08:27:49] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1 [03/13/2022-08:27:49] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1 [03/13/2022-08:27:49] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1 [03/13/2022-08:27:49] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1 [03/13/2022-08:27:49] [V] [TRT] Plugin creator already registered - ::Proposal version 1 [03/13/2022-08:27:49] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1 [03/13/2022-08:27:49] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1 [03/13/2022-08:27:49] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1 [03/13/2022-08:27:49] [V] [TRT] Plugin creator already registered - ::Split version 1 [03/13/2022-08:27:49] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1 [03/13/2022-08:27:49] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:202: Adding network input: images with dtype: float32, dimensions: (1, 1, 480, 640) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: images for ONNX tensor: images [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 943 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 948 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 949 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 950 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 951 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.0.Focus.conv.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.0.Focus.conv.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.0.Focus.conv.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.0.Focus.conv.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.0.Focus.conv.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.1.0.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.1.0.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.10.0.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.10.0.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.13.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.14.0.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.14.0.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.17.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.18.Conv2d.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.18.Conv2d.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.2.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.21.0.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.21.0.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.23.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.24.Conv2d.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.24.Conv2d.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.27.0.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.27.0.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.29.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.3.0.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.3.0.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.30.Conv2d.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.30.Conv2d.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.33.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.34.Conv2d.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.34.Conv2d.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.37.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.38.Conv2d.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.38.Conv2d.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.1.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.1.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.1.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.1.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.1.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.1.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.1.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.1.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.1.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.1.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.2.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.2.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.2.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.2.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.2.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.2.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.2.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.2.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.2.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.4.c3.m.2.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.41.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.42.Conv2d.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.42.Conv2d.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.5.0.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.5.0.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.1.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.1.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.1.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.1.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.1.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.1.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.1.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.1.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.1.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.1.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.2.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.2.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.2.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.2.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.2.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.2.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.2.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.2.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.2.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.6.c3.m.2.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.7.0.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.7.0.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.8.y5spp.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.8.y5spp.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.8.y5spp.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.8.y5spp.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.8.y5spp.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.8.y5spp.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.8.y5spp.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.8.y5spp.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.8.y5spp.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.8.y5spp.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: module_list.9.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 427 [03/13/2022-08:27:49] [W] [TRT] onnx2trt_utils.cpp:220: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32. [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 429 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 431 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 433 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 435 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 437 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 439 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 441 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 606 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 641 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 666 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 669 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 672 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 673 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 674 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 675 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 677 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 679 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 681 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 683 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 684 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 685 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 686 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 688 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 693 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 695 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 696 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 697 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 698 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 700 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 701 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 702 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 703 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 706 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 734 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 737 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 740 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 741 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 742 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 743 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 745 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 747 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 749 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 751 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 752 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 753 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 754 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 756 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 761 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 763 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 764 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 765 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 766 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 768 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 769 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 770 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 771 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 774 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 802 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 805 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 808 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 809 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 810 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 811 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 813 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 815 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 817 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 819 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 820 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 821 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 822 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 824 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 829 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 831 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 832 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 833 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 834 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 836 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 837 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 838 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 839 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 842 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 867 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 870 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 872 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 897 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 900 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 902 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 927 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 930 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 932 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1 [Gather] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: images [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 427 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Gather_1 [Gather] inputs: [images -> (1, 1, 480, 640)], [427 -> (240)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:986: Using Gather axis: 2 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Gather_1 for ONNX node: Gather_1 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 428 for ONNX tensor: 428 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Gather_1 [Gather] outputs: [428 -> (1, 1, 240, 640)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_3 [Gather] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 428 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 429 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Gather_3 [Gather] inputs: [428 -> (1, 1, 240, 640)], [429 -> (320)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:986: Using Gather axis: 3 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Gather_3 for ONNX node: Gather_3 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 430 for ONNX tensor: 430 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Gather_3 [Gather] outputs: [430 -> (1, 1, 240, 320)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_5 [Gather] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: images [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 431 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Gather_5 [Gather] inputs: [images -> (1, 1, 480, 640)], [431 -> (240)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:986: Using Gather axis: 2 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Gather_5 for ONNX node: Gather_5 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 432 for ONNX tensor: 432 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Gather_5 [Gather] outputs: [432 -> (1, 1, 240, 640)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_7 [Gather] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 432 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 433 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Gather_7 [Gather] inputs: [432 -> (1, 1, 240, 640)], [433 -> (320)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:986: Using Gather axis: 3 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Gather_7 for ONNX node: Gather_7 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 434 for ONNX tensor: 434 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Gather_7 [Gather] outputs: [434 -> (1, 1, 240, 320)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_9 [Gather] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: images [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 435 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Gather_9 [Gather] inputs: [images -> (1, 1, 480, 640)], [435 -> (240)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:986: Using Gather axis: 2 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Gather_9 for ONNX node: Gather_9 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 436 for ONNX tensor: 436 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Gather_9 [Gather] outputs: [436 -> (1, 1, 240, 640)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_11 [Gather] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 436 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 437 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Gather_11 [Gather] inputs: [436 -> (1, 1, 240, 640)], [437 -> (320)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:986: Using Gather axis: 3 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Gather_11 for ONNX node: Gather_11 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 438 for ONNX tensor: 438 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Gather_11 [Gather] outputs: [438 -> (1, 1, 240, 320)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_13 [Gather] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: images [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 439 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Gather_13 [Gather] inputs: [images -> (1, 1, 480, 640)], [439 -> (240)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:986: Using Gather axis: 2 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Gather_13 for ONNX node: Gather_13 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 440 for ONNX tensor: 440 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Gather_13 [Gather] outputs: [440 -> (1, 1, 240, 640)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_15 [Gather] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 440 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 441 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Gather_15 [Gather] inputs: [440 -> (1, 1, 240, 640)], [441 -> (320)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:986: Using Gather axis: 3 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Gather_15 for ONNX node: Gather_15 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 442 for ONNX tensor: 442 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Gather_15 [Gather] outputs: [442 -> (1, 1, 240, 320)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_16 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 430 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 434 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 438 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 442 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_16 [Concat] inputs: [430 -> (1, 1, 240, 320)], [434 -> (1, 1, 240, 320)], [438 -> (1, 1, 240, 320)], [442 -> (1, 1, 240, 320)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_16 for ONNX node: Concat_16 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 443 for ONNX tensor: 443 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_16 [Concat] outputs: [443 -> (1, 4, 240, 320)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_17 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 443 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.0.Focus.conv.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_17 [Conv] inputs: [443 -> (1, 4, 240, 320)], [module_list.0.Focus.conv.conv.weight -> (40, 4, 3, 3)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 4, 240, 320) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_17 for ONNX node: Conv_17 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 40 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 40, 240, 320) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 444 for ONNX tensor: 444 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_17 [Conv] outputs: [444 -> (1, 40, 240, 320)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_18 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 444 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.0.Focus.conv.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.0.Focus.conv.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.0.Focus.conv.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.0.Focus.conv.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_18 [BatchNormalization] inputs: [444 -> (1, 40, 240, 320)], [module_list.0.Focus.conv.bn.weight -> (40)], [module_list.0.Focus.conv.bn.bias -> (40)], [module_list.0.Focus.conv.bn.running_mean -> (40)], [module_list.0.Focus.conv.bn.running_var -> (40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_18 for ONNX node: BatchNormalization_18 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 445 for ONNX tensor: 445 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_18 [BatchNormalization] outputs: [445 -> (1, 40, 240, 320)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_19 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 445 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_19 [Sigmoid] inputs: [445 -> (1, 40, 240, 320)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_19 for ONNX node: Sigmoid_19 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 446 for ONNX tensor: 446 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_19 [Sigmoid] outputs: [446 -> (1, 40, 240, 320)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_20 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 445 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 446 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_20 [Mul] inputs: [445 -> (1, 40, 240, 320)], [446 -> (1, 40, 240, 320)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_20 for ONNX node: Mul_20 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 447 for ONNX tensor: 447 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_20 [Mul] outputs: [447 -> (1, 40, 240, 320)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_21 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 447 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.1.0.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.1.0.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_21 [Conv] inputs: [447 -> (1, 40, 240, 320)], [module_list.1.0.weight -> (80, 40, 3, 3)], [module_list.1.0.bias -> (80)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 40, 240, 320) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_21 for ONNX node: Conv_21 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 80 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 80, 120, 160) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 448 for ONNX tensor: 448 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_21 [Conv] outputs: [448 -> (1, 80, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_22 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 448 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_22 [Sigmoid] inputs: [448 -> (1, 80, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_22 for ONNX node: Sigmoid_22 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 449 for ONNX tensor: 449 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_22 [Sigmoid] outputs: [449 -> (1, 80, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_23 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 448 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 449 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_23 [Mul] inputs: [448 -> (1, 80, 120, 160)], [449 -> (1, 80, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_23 for ONNX node: Mul_23 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 450 for ONNX tensor: 450 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_23 [Mul] outputs: [450 -> (1, 80, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_24 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 450 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_24 [Conv] inputs: [450 -> (1, 80, 120, 160)], [module_list.2.c3.cv1.conv.weight -> (40, 80, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 80, 120, 160) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_24 for ONNX node: Conv_24 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 40 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 40, 120, 160) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 451 for ONNX tensor: 451 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_24 [Conv] outputs: [451 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_25 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 451 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_25 [BatchNormalization] inputs: [451 -> (1, 40, 120, 160)], [module_list.2.c3.cv1.bn.weight -> (40)], [module_list.2.c3.cv1.bn.bias -> (40)], [module_list.2.c3.cv1.bn.running_mean -> (40)], [module_list.2.c3.cv1.bn.running_var -> (40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_25 for ONNX node: BatchNormalization_25 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 452 for ONNX tensor: 452 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_25 [BatchNormalization] outputs: [452 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_26 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 452 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_26 [Sigmoid] inputs: [452 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_26 for ONNX node: Sigmoid_26 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 453 for ONNX tensor: 453 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_26 [Sigmoid] outputs: [453 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_27 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 452 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 453 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_27 [Mul] inputs: [452 -> (1, 40, 120, 160)], [453 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_27 for ONNX node: Mul_27 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 454 for ONNX tensor: 454 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_27 [Mul] outputs: [454 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_28 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 454 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_28 [Conv] inputs: [454 -> (1, 40, 120, 160)], [module_list.2.c3.m.0.cv1.conv.weight -> (40, 40, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 40, 120, 160) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_28 for ONNX node: Conv_28 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 40 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 40, 120, 160) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 455 for ONNX tensor: 455 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_28 [Conv] outputs: [455 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_29 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 455 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_29 [BatchNormalization] inputs: [455 -> (1, 40, 120, 160)], [module_list.2.c3.m.0.cv1.bn.weight -> (40)], [module_list.2.c3.m.0.cv1.bn.bias -> (40)], [module_list.2.c3.m.0.cv1.bn.running_mean -> (40)], [module_list.2.c3.m.0.cv1.bn.running_var -> (40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_29 for ONNX node: BatchNormalization_29 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 456 for ONNX tensor: 456 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_29 [BatchNormalization] outputs: [456 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_30 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 456 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_30 [Sigmoid] inputs: [456 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_30 for ONNX node: Sigmoid_30 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 457 for ONNX tensor: 457 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_30 [Sigmoid] outputs: [457 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_31 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 456 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 457 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_31 [Mul] inputs: [456 -> (1, 40, 120, 160)], [457 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_31 for ONNX node: Mul_31 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 458 for ONNX tensor: 458 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_31 [Mul] outputs: [458 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_32 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 458 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_32 [Conv] inputs: [458 -> (1, 40, 120, 160)], [module_list.2.c3.m.0.cv2.conv.weight -> (40, 40, 3, 3)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 40, 120, 160) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_32 for ONNX node: Conv_32 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 40 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 40, 120, 160) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 459 for ONNX tensor: 459 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_32 [Conv] outputs: [459 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_33 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 459 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_33 [BatchNormalization] inputs: [459 -> (1, 40, 120, 160)], [module_list.2.c3.m.0.cv2.bn.weight -> (40)], [module_list.2.c3.m.0.cv2.bn.bias -> (40)], [module_list.2.c3.m.0.cv2.bn.running_mean -> (40)], [module_list.2.c3.m.0.cv2.bn.running_var -> (40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_33 for ONNX node: BatchNormalization_33 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 460 for ONNX tensor: 460 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_33 [BatchNormalization] outputs: [460 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_34 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 460 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_34 [Sigmoid] inputs: [460 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_34 for ONNX node: Sigmoid_34 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 461 for ONNX tensor: 461 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_34 [Sigmoid] outputs: [461 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_35 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 460 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 461 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_35 [Mul] inputs: [460 -> (1, 40, 120, 160)], [461 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_35 for ONNX node: Mul_35 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 462 for ONNX tensor: 462 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_35 [Mul] outputs: [462 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_36 [Add] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 454 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 462 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Add_36 [Add] inputs: [454 -> (1, 40, 120, 160)], [462 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_36 for ONNX node: Add_36 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 463 for ONNX tensor: 463 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Add_36 [Add] outputs: [463 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_37 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 450 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_37 [Conv] inputs: [450 -> (1, 80, 120, 160)], [module_list.2.c3.cv2.conv.weight -> (40, 80, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 80, 120, 160) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_37 for ONNX node: Conv_37 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 40 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 40, 120, 160) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 464 for ONNX tensor: 464 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_37 [Conv] outputs: [464 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_38 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 464 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_38 [BatchNormalization] inputs: [464 -> (1, 40, 120, 160)], [module_list.2.c3.cv2.bn.weight -> (40)], [module_list.2.c3.cv2.bn.bias -> (40)], [module_list.2.c3.cv2.bn.running_mean -> (40)], [module_list.2.c3.cv2.bn.running_var -> (40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_38 for ONNX node: BatchNormalization_38 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 465 for ONNX tensor: 465 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_38 [BatchNormalization] outputs: [465 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_39 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 465 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_39 [Sigmoid] inputs: [465 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_39 for ONNX node: Sigmoid_39 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 466 for ONNX tensor: 466 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_39 [Sigmoid] outputs: [466 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_40 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 465 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 466 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_40 [Mul] inputs: [465 -> (1, 40, 120, 160)], [466 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_40 for ONNX node: Mul_40 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 467 for ONNX tensor: 467 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_40 [Mul] outputs: [467 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_41 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 463 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 467 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_41 [Concat] inputs: [463 -> (1, 40, 120, 160)], [467 -> (1, 40, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_41 for ONNX node: Concat_41 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 468 for ONNX tensor: 468 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_41 [Concat] outputs: [468 -> (1, 80, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_42 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 468 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_42 [Conv] inputs: [468 -> (1, 80, 120, 160)], [module_list.2.c3.cv3.conv.weight -> (80, 80, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 80, 120, 160) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_42 for ONNX node: Conv_42 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 80 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 80, 120, 160) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 469 for ONNX tensor: 469 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_42 [Conv] outputs: [469 -> (1, 80, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_43 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 469 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.2.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_43 [BatchNormalization] inputs: [469 -> (1, 80, 120, 160)], [module_list.2.c3.cv3.bn.weight -> (80)], [module_list.2.c3.cv3.bn.bias -> (80)], [module_list.2.c3.cv3.bn.running_mean -> (80)], [module_list.2.c3.cv3.bn.running_var -> (80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_43 for ONNX node: BatchNormalization_43 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 470 for ONNX tensor: 470 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_43 [BatchNormalization] outputs: [470 -> (1, 80, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_44 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 470 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_44 [Sigmoid] inputs: [470 -> (1, 80, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_44 for ONNX node: Sigmoid_44 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 471 for ONNX tensor: 471 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_44 [Sigmoid] outputs: [471 -> (1, 80, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_45 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 470 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 471 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_45 [Mul] inputs: [470 -> (1, 80, 120, 160)], [471 -> (1, 80, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_45 for ONNX node: Mul_45 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 472 for ONNX tensor: 472 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_45 [Mul] outputs: [472 -> (1, 80, 120, 160)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_46 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 472 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.3.0.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.3.0.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_46 [Conv] inputs: [472 -> (1, 80, 120, 160)], [module_list.3.0.weight -> (160, 80, 3, 3)], [module_list.3.0.bias -> (160)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 80, 120, 160) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_46 for ONNX node: Conv_46 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 473 for ONNX tensor: 473 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_46 [Conv] outputs: [473 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_47 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 473 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_47 [Sigmoid] inputs: [473 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_47 for ONNX node: Sigmoid_47 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 474 for ONNX tensor: 474 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_47 [Sigmoid] outputs: [474 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_48 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 473 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 474 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_48 [Mul] inputs: [473 -> (1, 160, 60, 80)], [474 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_48 for ONNX node: Mul_48 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 475 for ONNX tensor: 475 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_48 [Mul] outputs: [475 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_49 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 475 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_49 [Conv] inputs: [475 -> (1, 160, 60, 80)], [module_list.4.c3.cv1.conv.weight -> (80, 160, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 160, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_49 for ONNX node: Conv_49 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 80 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 476 for ONNX tensor: 476 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_49 [Conv] outputs: [476 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_50 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 476 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_50 [BatchNormalization] inputs: [476 -> (1, 80, 60, 80)], [module_list.4.c3.cv1.bn.weight -> (80)], [module_list.4.c3.cv1.bn.bias -> (80)], [module_list.4.c3.cv1.bn.running_mean -> (80)], [module_list.4.c3.cv1.bn.running_var -> (80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_50 for ONNX node: BatchNormalization_50 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 477 for ONNX tensor: 477 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_50 [BatchNormalization] outputs: [477 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_51 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 477 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_51 [Sigmoid] inputs: [477 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_51 for ONNX node: Sigmoid_51 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 478 for ONNX tensor: 478 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_51 [Sigmoid] outputs: [478 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_52 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 477 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 478 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_52 [Mul] inputs: [477 -> (1, 80, 60, 80)], [478 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_52 for ONNX node: Mul_52 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 479 for ONNX tensor: 479 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_52 [Mul] outputs: [479 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_53 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 479 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_53 [Conv] inputs: [479 -> (1, 80, 60, 80)], [module_list.4.c3.m.0.cv1.conv.weight -> (80, 80, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_53 for ONNX node: Conv_53 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 80 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 480 for ONNX tensor: 480 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_53 [Conv] outputs: [480 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_54 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 480 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_54 [BatchNormalization] inputs: [480 -> (1, 80, 60, 80)], [module_list.4.c3.m.0.cv1.bn.weight -> (80)], [module_list.4.c3.m.0.cv1.bn.bias -> (80)], [module_list.4.c3.m.0.cv1.bn.running_mean -> (80)], [module_list.4.c3.m.0.cv1.bn.running_var -> (80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_54 for ONNX node: BatchNormalization_54 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 481 for ONNX tensor: 481 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_54 [BatchNormalization] outputs: [481 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_55 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 481 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_55 [Sigmoid] inputs: [481 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_55 for ONNX node: Sigmoid_55 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 482 for ONNX tensor: 482 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_55 [Sigmoid] outputs: [482 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_56 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 481 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 482 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_56 [Mul] inputs: [481 -> (1, 80, 60, 80)], [482 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_56 for ONNX node: Mul_56 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 483 for ONNX tensor: 483 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_56 [Mul] outputs: [483 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_57 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 483 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_57 [Conv] inputs: [483 -> (1, 80, 60, 80)], [module_list.4.c3.m.0.cv2.conv.weight -> (80, 80, 3, 3)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_57 for ONNX node: Conv_57 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 80 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 484 for ONNX tensor: 484 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_57 [Conv] outputs: [484 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_58 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 484 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_58 [BatchNormalization] inputs: [484 -> (1, 80, 60, 80)], [module_list.4.c3.m.0.cv2.bn.weight -> (80)], [module_list.4.c3.m.0.cv2.bn.bias -> (80)], [module_list.4.c3.m.0.cv2.bn.running_mean -> (80)], [module_list.4.c3.m.0.cv2.bn.running_var -> (80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_58 for ONNX node: BatchNormalization_58 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 485 for ONNX tensor: 485 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_58 [BatchNormalization] outputs: [485 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_59 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 485 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_59 [Sigmoid] inputs: [485 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_59 for ONNX node: Sigmoid_59 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 486 for ONNX tensor: 486 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_59 [Sigmoid] outputs: [486 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_60 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 485 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 486 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_60 [Mul] inputs: [485 -> (1, 80, 60, 80)], [486 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_60 for ONNX node: Mul_60 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 487 for ONNX tensor: 487 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_60 [Mul] outputs: [487 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_61 [Add] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 479 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 487 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Add_61 [Add] inputs: [479 -> (1, 80, 60, 80)], [487 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_61 for ONNX node: Add_61 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 488 for ONNX tensor: 488 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Add_61 [Add] outputs: [488 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_62 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 488 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.1.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_62 [Conv] inputs: [488 -> (1, 80, 60, 80)], [module_list.4.c3.m.1.cv1.conv.weight -> (80, 80, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_62 for ONNX node: Conv_62 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 80 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 489 for ONNX tensor: 489 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_62 [Conv] outputs: [489 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_63 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 489 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.1.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.1.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.1.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.1.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_63 [BatchNormalization] inputs: [489 -> (1, 80, 60, 80)], [module_list.4.c3.m.1.cv1.bn.weight -> (80)], [module_list.4.c3.m.1.cv1.bn.bias -> (80)], [module_list.4.c3.m.1.cv1.bn.running_mean -> (80)], [module_list.4.c3.m.1.cv1.bn.running_var -> (80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_63 for ONNX node: BatchNormalization_63 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 490 for ONNX tensor: 490 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_63 [BatchNormalization] outputs: [490 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_64 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 490 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_64 [Sigmoid] inputs: [490 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_64 for ONNX node: Sigmoid_64 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 491 for ONNX tensor: 491 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_64 [Sigmoid] outputs: [491 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_65 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 490 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 491 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_65 [Mul] inputs: [490 -> (1, 80, 60, 80)], [491 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_65 for ONNX node: Mul_65 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 492 for ONNX tensor: 492 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_65 [Mul] outputs: [492 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_66 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 492 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.1.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_66 [Conv] inputs: [492 -> (1, 80, 60, 80)], [module_list.4.c3.m.1.cv2.conv.weight -> (80, 80, 3, 3)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_66 for ONNX node: Conv_66 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 80 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 493 for ONNX tensor: 493 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_66 [Conv] outputs: [493 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_67 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 493 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.1.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.1.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.1.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.1.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_67 [BatchNormalization] inputs: [493 -> (1, 80, 60, 80)], [module_list.4.c3.m.1.cv2.bn.weight -> (80)], [module_list.4.c3.m.1.cv2.bn.bias -> (80)], [module_list.4.c3.m.1.cv2.bn.running_mean -> (80)], [module_list.4.c3.m.1.cv2.bn.running_var -> (80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_67 for ONNX node: BatchNormalization_67 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 494 for ONNX tensor: 494 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_67 [BatchNormalization] outputs: [494 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_68 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 494 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_68 [Sigmoid] inputs: [494 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_68 for ONNX node: Sigmoid_68 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 495 for ONNX tensor: 495 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_68 [Sigmoid] outputs: [495 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_69 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 494 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 495 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_69 [Mul] inputs: [494 -> (1, 80, 60, 80)], [495 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_69 for ONNX node: Mul_69 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 496 for ONNX tensor: 496 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_69 [Mul] outputs: [496 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_70 [Add] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 488 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 496 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Add_70 [Add] inputs: [488 -> (1, 80, 60, 80)], [496 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_70 for ONNX node: Add_70 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 497 for ONNX tensor: 497 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Add_70 [Add] outputs: [497 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_71 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 497 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.2.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_71 [Conv] inputs: [497 -> (1, 80, 60, 80)], [module_list.4.c3.m.2.cv1.conv.weight -> (80, 80, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_71 for ONNX node: Conv_71 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 80 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 498 for ONNX tensor: 498 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_71 [Conv] outputs: [498 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_72 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 498 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.2.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.2.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.2.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.2.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_72 [BatchNormalization] inputs: [498 -> (1, 80, 60, 80)], [module_list.4.c3.m.2.cv1.bn.weight -> (80)], [module_list.4.c3.m.2.cv1.bn.bias -> (80)], [module_list.4.c3.m.2.cv1.bn.running_mean -> (80)], [module_list.4.c3.m.2.cv1.bn.running_var -> (80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_72 for ONNX node: BatchNormalization_72 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 499 for ONNX tensor: 499 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_72 [BatchNormalization] outputs: [499 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_73 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 499 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_73 [Sigmoid] inputs: [499 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_73 for ONNX node: Sigmoid_73 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 500 for ONNX tensor: 500 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_73 [Sigmoid] outputs: [500 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_74 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 499 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 500 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_74 [Mul] inputs: [499 -> (1, 80, 60, 80)], [500 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_74 for ONNX node: Mul_74 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 501 for ONNX tensor: 501 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_74 [Mul] outputs: [501 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_75 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 501 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.2.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_75 [Conv] inputs: [501 -> (1, 80, 60, 80)], [module_list.4.c3.m.2.cv2.conv.weight -> (80, 80, 3, 3)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_75 for ONNX node: Conv_75 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 80 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 502 for ONNX tensor: 502 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_75 [Conv] outputs: [502 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_76 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 502 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.2.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.2.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.2.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.m.2.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_76 [BatchNormalization] inputs: [502 -> (1, 80, 60, 80)], [module_list.4.c3.m.2.cv2.bn.weight -> (80)], [module_list.4.c3.m.2.cv2.bn.bias -> (80)], [module_list.4.c3.m.2.cv2.bn.running_mean -> (80)], [module_list.4.c3.m.2.cv2.bn.running_var -> (80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_76 for ONNX node: BatchNormalization_76 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 503 for ONNX tensor: 503 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_76 [BatchNormalization] outputs: [503 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_77 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 503 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_77 [Sigmoid] inputs: [503 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_77 for ONNX node: Sigmoid_77 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 504 for ONNX tensor: 504 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_77 [Sigmoid] outputs: [504 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_78 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 503 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 504 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_78 [Mul] inputs: [503 -> (1, 80, 60, 80)], [504 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_78 for ONNX node: Mul_78 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 505 for ONNX tensor: 505 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_78 [Mul] outputs: [505 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_79 [Add] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 497 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 505 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Add_79 [Add] inputs: [497 -> (1, 80, 60, 80)], [505 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_79 for ONNX node: Add_79 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 506 for ONNX tensor: 506 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Add_79 [Add] outputs: [506 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_80 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 475 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_80 [Conv] inputs: [475 -> (1, 160, 60, 80)], [module_list.4.c3.cv2.conv.weight -> (80, 160, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 160, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_80 for ONNX node: Conv_80 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 80 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 507 for ONNX tensor: 507 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_80 [Conv] outputs: [507 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_81 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 507 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_81 [BatchNormalization] inputs: [507 -> (1, 80, 60, 80)], [module_list.4.c3.cv2.bn.weight -> (80)], [module_list.4.c3.cv2.bn.bias -> (80)], [module_list.4.c3.cv2.bn.running_mean -> (80)], [module_list.4.c3.cv2.bn.running_var -> (80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_81 for ONNX node: BatchNormalization_81 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 508 for ONNX tensor: 508 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_81 [BatchNormalization] outputs: [508 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_82 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 508 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_82 [Sigmoid] inputs: [508 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_82 for ONNX node: Sigmoid_82 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 509 for ONNX tensor: 509 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_82 [Sigmoid] outputs: [509 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_83 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 508 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 509 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_83 [Mul] inputs: [508 -> (1, 80, 60, 80)], [509 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_83 for ONNX node: Mul_83 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 510 for ONNX tensor: 510 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_83 [Mul] outputs: [510 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_84 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 506 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 510 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_84 [Concat] inputs: [506 -> (1, 80, 60, 80)], [510 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_84 for ONNX node: Concat_84 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 511 for ONNX tensor: 511 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_84 [Concat] outputs: [511 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_85 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 511 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_85 [Conv] inputs: [511 -> (1, 160, 60, 80)], [module_list.4.c3.cv3.conv.weight -> (160, 160, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 160, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_85 for ONNX node: Conv_85 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 512 for ONNX tensor: 512 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_85 [Conv] outputs: [512 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_86 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 512 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.4.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_86 [BatchNormalization] inputs: [512 -> (1, 160, 60, 80)], [module_list.4.c3.cv3.bn.weight -> (160)], [module_list.4.c3.cv3.bn.bias -> (160)], [module_list.4.c3.cv3.bn.running_mean -> (160)], [module_list.4.c3.cv3.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_86 for ONNX node: BatchNormalization_86 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 513 for ONNX tensor: 513 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_86 [BatchNormalization] outputs: [513 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_87 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 513 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_87 [Sigmoid] inputs: [513 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_87 for ONNX node: Sigmoid_87 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 514 for ONNX tensor: 514 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_87 [Sigmoid] outputs: [514 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_88 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 513 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 514 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_88 [Mul] inputs: [513 -> (1, 160, 60, 80)], [514 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_88 for ONNX node: Mul_88 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 515 for ONNX tensor: 515 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_88 [Mul] outputs: [515 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_89 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 515 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.5.0.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.5.0.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_89 [Conv] inputs: [515 -> (1, 160, 60, 80)], [module_list.5.0.weight -> (320, 160, 3, 3)], [module_list.5.0.bias -> (320)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 160, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_89 for ONNX node: Conv_89 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 320 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 320, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 516 for ONNX tensor: 516 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_89 [Conv] outputs: [516 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_90 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 516 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_90 [Sigmoid] inputs: [516 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_90 for ONNX node: Sigmoid_90 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 517 for ONNX tensor: 517 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_90 [Sigmoid] outputs: [517 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_91 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 516 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 517 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_91 [Mul] inputs: [516 -> (1, 320, 30, 40)], [517 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_91 for ONNX node: Mul_91 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 518 for ONNX tensor: 518 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_91 [Mul] outputs: [518 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_92 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 518 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_92 [Conv] inputs: [518 -> (1, 320, 30, 40)], [module_list.6.c3.cv1.conv.weight -> (160, 320, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_92 for ONNX node: Conv_92 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 519 for ONNX tensor: 519 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_92 [Conv] outputs: [519 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_93 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 519 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_93 [BatchNormalization] inputs: [519 -> (1, 160, 30, 40)], [module_list.6.c3.cv1.bn.weight -> (160)], [module_list.6.c3.cv1.bn.bias -> (160)], [module_list.6.c3.cv1.bn.running_mean -> (160)], [module_list.6.c3.cv1.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_93 for ONNX node: BatchNormalization_93 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 520 for ONNX tensor: 520 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_93 [BatchNormalization] outputs: [520 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_94 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 520 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_94 [Sigmoid] inputs: [520 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_94 for ONNX node: Sigmoid_94 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 521 for ONNX tensor: 521 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_94 [Sigmoid] outputs: [521 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_95 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 520 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 521 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_95 [Mul] inputs: [520 -> (1, 160, 30, 40)], [521 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_95 for ONNX node: Mul_95 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 522 for ONNX tensor: 522 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_95 [Mul] outputs: [522 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_96 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 522 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_96 [Conv] inputs: [522 -> (1, 160, 30, 40)], [module_list.6.c3.m.0.cv1.conv.weight -> (160, 160, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_96 for ONNX node: Conv_96 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 523 for ONNX tensor: 523 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_96 [Conv] outputs: [523 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_97 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 523 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_97 [BatchNormalization] inputs: [523 -> (1, 160, 30, 40)], [module_list.6.c3.m.0.cv1.bn.weight -> (160)], [module_list.6.c3.m.0.cv1.bn.bias -> (160)], [module_list.6.c3.m.0.cv1.bn.running_mean -> (160)], [module_list.6.c3.m.0.cv1.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_97 for ONNX node: BatchNormalization_97 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 524 for ONNX tensor: 524 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_97 [BatchNormalization] outputs: [524 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_98 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 524 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_98 [Sigmoid] inputs: [524 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_98 for ONNX node: Sigmoid_98 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 525 for ONNX tensor: 525 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_98 [Sigmoid] outputs: [525 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_99 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 524 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 525 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_99 [Mul] inputs: [524 -> (1, 160, 30, 40)], [525 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_99 for ONNX node: Mul_99 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 526 for ONNX tensor: 526 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_99 [Mul] outputs: [526 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_100 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 526 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_100 [Conv] inputs: [526 -> (1, 160, 30, 40)], [module_list.6.c3.m.0.cv2.conv.weight -> (160, 160, 3, 3)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_100 for ONNX node: Conv_100 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 527 for ONNX tensor: 527 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_100 [Conv] outputs: [527 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_101 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 527 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_101 [BatchNormalization] inputs: [527 -> (1, 160, 30, 40)], [module_list.6.c3.m.0.cv2.bn.weight -> (160)], [module_list.6.c3.m.0.cv2.bn.bias -> (160)], [module_list.6.c3.m.0.cv2.bn.running_mean -> (160)], [module_list.6.c3.m.0.cv2.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_101 for ONNX node: BatchNormalization_101 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 528 for ONNX tensor: 528 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_101 [BatchNormalization] outputs: [528 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_102 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 528 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_102 [Sigmoid] inputs: [528 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_102 for ONNX node: Sigmoid_102 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 529 for ONNX tensor: 529 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_102 [Sigmoid] outputs: [529 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_103 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 528 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 529 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_103 [Mul] inputs: [528 -> (1, 160, 30, 40)], [529 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_103 for ONNX node: Mul_103 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 530 for ONNX tensor: 530 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_103 [Mul] outputs: [530 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_104 [Add] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 522 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 530 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Add_104 [Add] inputs: [522 -> (1, 160, 30, 40)], [530 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_104 for ONNX node: Add_104 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 531 for ONNX tensor: 531 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Add_104 [Add] outputs: [531 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_105 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 531 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.1.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_105 [Conv] inputs: [531 -> (1, 160, 30, 40)], [module_list.6.c3.m.1.cv1.conv.weight -> (160, 160, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_105 for ONNX node: Conv_105 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 532 for ONNX tensor: 532 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_105 [Conv] outputs: [532 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_106 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 532 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.1.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.1.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.1.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.1.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_106 [BatchNormalization] inputs: [532 -> (1, 160, 30, 40)], [module_list.6.c3.m.1.cv1.bn.weight -> (160)], [module_list.6.c3.m.1.cv1.bn.bias -> (160)], [module_list.6.c3.m.1.cv1.bn.running_mean -> (160)], [module_list.6.c3.m.1.cv1.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_106 for ONNX node: BatchNormalization_106 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 533 for ONNX tensor: 533 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_106 [BatchNormalization] outputs: [533 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_107 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 533 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_107 [Sigmoid] inputs: [533 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_107 for ONNX node: Sigmoid_107 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 534 for ONNX tensor: 534 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_107 [Sigmoid] outputs: [534 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_108 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 533 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 534 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_108 [Mul] inputs: [533 -> (1, 160, 30, 40)], [534 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_108 for ONNX node: Mul_108 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 535 for ONNX tensor: 535 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_108 [Mul] outputs: [535 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_109 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 535 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.1.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_109 [Conv] inputs: [535 -> (1, 160, 30, 40)], [module_list.6.c3.m.1.cv2.conv.weight -> (160, 160, 3, 3)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_109 for ONNX node: Conv_109 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 536 for ONNX tensor: 536 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_109 [Conv] outputs: [536 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_110 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 536 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.1.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.1.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.1.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.1.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_110 [BatchNormalization] inputs: [536 -> (1, 160, 30, 40)], [module_list.6.c3.m.1.cv2.bn.weight -> (160)], [module_list.6.c3.m.1.cv2.bn.bias -> (160)], [module_list.6.c3.m.1.cv2.bn.running_mean -> (160)], [module_list.6.c3.m.1.cv2.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_110 for ONNX node: BatchNormalization_110 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 537 for ONNX tensor: 537 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_110 [BatchNormalization] outputs: [537 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_111 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 537 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_111 [Sigmoid] inputs: [537 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_111 for ONNX node: Sigmoid_111 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 538 for ONNX tensor: 538 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_111 [Sigmoid] outputs: [538 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_112 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 537 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 538 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_112 [Mul] inputs: [537 -> (1, 160, 30, 40)], [538 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_112 for ONNX node: Mul_112 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 539 for ONNX tensor: 539 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_112 [Mul] outputs: [539 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_113 [Add] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 531 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 539 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Add_113 [Add] inputs: [531 -> (1, 160, 30, 40)], [539 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_113 for ONNX node: Add_113 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 540 for ONNX tensor: 540 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Add_113 [Add] outputs: [540 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_114 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 540 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.2.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_114 [Conv] inputs: [540 -> (1, 160, 30, 40)], [module_list.6.c3.m.2.cv1.conv.weight -> (160, 160, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_114 for ONNX node: Conv_114 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 541 for ONNX tensor: 541 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_114 [Conv] outputs: [541 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_115 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 541 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.2.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.2.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.2.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.2.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_115 [BatchNormalization] inputs: [541 -> (1, 160, 30, 40)], [module_list.6.c3.m.2.cv1.bn.weight -> (160)], [module_list.6.c3.m.2.cv1.bn.bias -> (160)], [module_list.6.c3.m.2.cv1.bn.running_mean -> (160)], [module_list.6.c3.m.2.cv1.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_115 for ONNX node: BatchNormalization_115 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 542 for ONNX tensor: 542 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_115 [BatchNormalization] outputs: [542 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_116 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 542 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_116 [Sigmoid] inputs: [542 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_116 for ONNX node: Sigmoid_116 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 543 for ONNX tensor: 543 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_116 [Sigmoid] outputs: [543 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_117 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 542 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 543 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_117 [Mul] inputs: [542 -> (1, 160, 30, 40)], [543 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_117 for ONNX node: Mul_117 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 544 for ONNX tensor: 544 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_117 [Mul] outputs: [544 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_118 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 544 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.2.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_118 [Conv] inputs: [544 -> (1, 160, 30, 40)], [module_list.6.c3.m.2.cv2.conv.weight -> (160, 160, 3, 3)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_118 for ONNX node: Conv_118 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 545 for ONNX tensor: 545 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_118 [Conv] outputs: [545 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_119 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 545 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.2.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.2.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.2.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.m.2.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_119 [BatchNormalization] inputs: [545 -> (1, 160, 30, 40)], [module_list.6.c3.m.2.cv2.bn.weight -> (160)], [module_list.6.c3.m.2.cv2.bn.bias -> (160)], [module_list.6.c3.m.2.cv2.bn.running_mean -> (160)], [module_list.6.c3.m.2.cv2.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_119 for ONNX node: BatchNormalization_119 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 546 for ONNX tensor: 546 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_119 [BatchNormalization] outputs: [546 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_120 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 546 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_120 [Sigmoid] inputs: [546 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_120 for ONNX node: Sigmoid_120 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 547 for ONNX tensor: 547 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_120 [Sigmoid] outputs: [547 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_121 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 546 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 547 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_121 [Mul] inputs: [546 -> (1, 160, 30, 40)], [547 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_121 for ONNX node: Mul_121 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 548 for ONNX tensor: 548 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_121 [Mul] outputs: [548 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_122 [Add] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 540 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 548 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Add_122 [Add] inputs: [540 -> (1, 160, 30, 40)], [548 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_122 for ONNX node: Add_122 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 549 for ONNX tensor: 549 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Add_122 [Add] outputs: [549 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_123 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 518 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_123 [Conv] inputs: [518 -> (1, 320, 30, 40)], [module_list.6.c3.cv2.conv.weight -> (160, 320, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_123 for ONNX node: Conv_123 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 550 for ONNX tensor: 550 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_123 [Conv] outputs: [550 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_124 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 550 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_124 [BatchNormalization] inputs: [550 -> (1, 160, 30, 40)], [module_list.6.c3.cv2.bn.weight -> (160)], [module_list.6.c3.cv2.bn.bias -> (160)], [module_list.6.c3.cv2.bn.running_mean -> (160)], [module_list.6.c3.cv2.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_124 for ONNX node: BatchNormalization_124 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 551 for ONNX tensor: 551 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_124 [BatchNormalization] outputs: [551 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_125 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 551 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_125 [Sigmoid] inputs: [551 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_125 for ONNX node: Sigmoid_125 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 552 for ONNX tensor: 552 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_125 [Sigmoid] outputs: [552 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_126 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 551 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 552 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_126 [Mul] inputs: [551 -> (1, 160, 30, 40)], [552 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_126 for ONNX node: Mul_126 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 553 for ONNX tensor: 553 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_126 [Mul] outputs: [553 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_127 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 549 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 553 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_127 [Concat] inputs: [549 -> (1, 160, 30, 40)], [553 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_127 for ONNX node: Concat_127 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 554 for ONNX tensor: 554 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_127 [Concat] outputs: [554 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_128 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 554 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_128 [Conv] inputs: [554 -> (1, 320, 30, 40)], [module_list.6.c3.cv3.conv.weight -> (320, 320, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_128 for ONNX node: Conv_128 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 320 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 320, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 555 for ONNX tensor: 555 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_128 [Conv] outputs: [555 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_129 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 555 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.6.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_129 [BatchNormalization] inputs: [555 -> (1, 320, 30, 40)], [module_list.6.c3.cv3.bn.weight -> (320)], [module_list.6.c3.cv3.bn.bias -> (320)], [module_list.6.c3.cv3.bn.running_mean -> (320)], [module_list.6.c3.cv3.bn.running_var -> (320)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_129 for ONNX node: BatchNormalization_129 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 556 for ONNX tensor: 556 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_129 [BatchNormalization] outputs: [556 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_130 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 556 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_130 [Sigmoid] inputs: [556 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_130 for ONNX node: Sigmoid_130 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 557 for ONNX tensor: 557 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_130 [Sigmoid] outputs: [557 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_131 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 556 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 557 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_131 [Mul] inputs: [556 -> (1, 320, 30, 40)], [557 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_131 for ONNX node: Mul_131 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 558 for ONNX tensor: 558 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_131 [Mul] outputs: [558 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_132 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 558 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.7.0.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.7.0.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_132 [Conv] inputs: [558 -> (1, 320, 30, 40)], [module_list.7.0.weight -> (640, 320, 3, 3)], [module_list.7.0.bias -> (640)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_132 for ONNX node: Conv_132 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 640 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 640, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 559 for ONNX tensor: 559 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_132 [Conv] outputs: [559 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_133 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 559 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_133 [Sigmoid] inputs: [559 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_133 for ONNX node: Sigmoid_133 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 560 for ONNX tensor: 560 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_133 [Sigmoid] outputs: [560 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_134 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 559 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 560 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_134 [Mul] inputs: [559 -> (1, 640, 15, 20)], [560 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_134 for ONNX node: Mul_134 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 561 for ONNX tensor: 561 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_134 [Mul] outputs: [561 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_135 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 561 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.8.y5spp.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_135 [Conv] inputs: [561 -> (1, 640, 15, 20)], [module_list.8.y5spp.cv1.conv.weight -> (320, 640, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 640, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_135 for ONNX node: Conv_135 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 320 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 320, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 562 for ONNX tensor: 562 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_135 [Conv] outputs: [562 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_136 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 562 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.8.y5spp.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.8.y5spp.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.8.y5spp.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.8.y5spp.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_136 [BatchNormalization] inputs: [562 -> (1, 320, 15, 20)], [module_list.8.y5spp.cv1.bn.weight -> (320)], [module_list.8.y5spp.cv1.bn.bias -> (320)], [module_list.8.y5spp.cv1.bn.running_mean -> (320)], [module_list.8.y5spp.cv1.bn.running_var -> (320)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_136 for ONNX node: BatchNormalization_136 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 563 for ONNX tensor: 563 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_136 [BatchNormalization] outputs: [563 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_137 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 563 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_137 [Sigmoid] inputs: [563 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_137 for ONNX node: Sigmoid_137 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 564 for ONNX tensor: 564 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_137 [Sigmoid] outputs: [564 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_138 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 563 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 564 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_138 [Mul] inputs: [563 -> (1, 320, 15, 20)], [564 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_138 for ONNX node: Mul_138 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 565 for ONNX tensor: 565 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_138 [Mul] outputs: [565 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: MaxPool_139 [MaxPool] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 565 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: MaxPool_139 [MaxPool] inputs: [565 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: MaxPool_139 for ONNX node: MaxPool_139 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 566 for ONNX tensor: 566 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: MaxPool_139 [MaxPool] outputs: [566 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: MaxPool_140 [MaxPool] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 565 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: MaxPool_140 [MaxPool] inputs: [565 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: MaxPool_140 for ONNX node: MaxPool_140 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 567 for ONNX tensor: 567 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: MaxPool_140 [MaxPool] outputs: [567 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: MaxPool_141 [MaxPool] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 565 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: MaxPool_141 [MaxPool] inputs: [565 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: MaxPool_141 for ONNX node: MaxPool_141 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 568 for ONNX tensor: 568 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: MaxPool_141 [MaxPool] outputs: [568 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_142 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 565 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 566 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 567 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 568 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_142 [Concat] inputs: [565 -> (1, 320, 15, 20)], [566 -> (1, 320, 15, 20)], [567 -> (1, 320, 15, 20)], [568 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_142 for ONNX node: Concat_142 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 569 for ONNX tensor: 569 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_142 [Concat] outputs: [569 -> (1, 1280, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_143 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 569 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.8.y5spp.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_143 [Conv] inputs: [569 -> (1, 1280, 15, 20)], [module_list.8.y5spp.cv2.conv.weight -> (640, 1280, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 1280, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_143 for ONNX node: Conv_143 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 640 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 640, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 570 for ONNX tensor: 570 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_143 [Conv] outputs: [570 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_144 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 570 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.8.y5spp.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.8.y5spp.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.8.y5spp.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.8.y5spp.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_144 [BatchNormalization] inputs: [570 -> (1, 640, 15, 20)], [module_list.8.y5spp.cv2.bn.weight -> (640)], [module_list.8.y5spp.cv2.bn.bias -> (640)], [module_list.8.y5spp.cv2.bn.running_mean -> (640)], [module_list.8.y5spp.cv2.bn.running_var -> (640)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_144 for ONNX node: BatchNormalization_144 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 571 for ONNX tensor: 571 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_144 [BatchNormalization] outputs: [571 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_145 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 571 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_145 [Sigmoid] inputs: [571 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_145 for ONNX node: Sigmoid_145 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 572 for ONNX tensor: 572 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_145 [Sigmoid] outputs: [572 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_146 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 571 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 572 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_146 [Mul] inputs: [571 -> (1, 640, 15, 20)], [572 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_146 for ONNX node: Mul_146 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 573 for ONNX tensor: 573 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_146 [Mul] outputs: [573 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_147 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 573 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_147 [Conv] inputs: [573 -> (1, 640, 15, 20)], [module_list.9.c3.cv1.conv.weight -> (320, 640, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 640, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_147 for ONNX node: Conv_147 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 320 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 320, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 574 for ONNX tensor: 574 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_147 [Conv] outputs: [574 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_148 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 574 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_148 [BatchNormalization] inputs: [574 -> (1, 320, 15, 20)], [module_list.9.c3.cv1.bn.weight -> (320)], [module_list.9.c3.cv1.bn.bias -> (320)], [module_list.9.c3.cv1.bn.running_mean -> (320)], [module_list.9.c3.cv1.bn.running_var -> (320)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_148 for ONNX node: BatchNormalization_148 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 575 for ONNX tensor: 575 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_148 [BatchNormalization] outputs: [575 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_149 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 575 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_149 [Sigmoid] inputs: [575 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_149 for ONNX node: Sigmoid_149 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 576 for ONNX tensor: 576 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_149 [Sigmoid] outputs: [576 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_150 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 575 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 576 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_150 [Mul] inputs: [575 -> (1, 320, 15, 20)], [576 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_150 for ONNX node: Mul_150 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 577 for ONNX tensor: 577 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_150 [Mul] outputs: [577 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_151 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 577 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_151 [Conv] inputs: [577 -> (1, 320, 15, 20)], [module_list.9.c3.m.0.cv1.conv.weight -> (320, 320, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_151 for ONNX node: Conv_151 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 320 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 320, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 578 for ONNX tensor: 578 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_151 [Conv] outputs: [578 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_152 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 578 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_152 [BatchNormalization] inputs: [578 -> (1, 320, 15, 20)], [module_list.9.c3.m.0.cv1.bn.weight -> (320)], [module_list.9.c3.m.0.cv1.bn.bias -> (320)], [module_list.9.c3.m.0.cv1.bn.running_mean -> (320)], [module_list.9.c3.m.0.cv1.bn.running_var -> (320)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_152 for ONNX node: BatchNormalization_152 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 579 for ONNX tensor: 579 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_152 [BatchNormalization] outputs: [579 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_153 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 579 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_153 [Sigmoid] inputs: [579 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_153 for ONNX node: Sigmoid_153 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 580 for ONNX tensor: 580 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_153 [Sigmoid] outputs: [580 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_154 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 579 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 580 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_154 [Mul] inputs: [579 -> (1, 320, 15, 20)], [580 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_154 for ONNX node: Mul_154 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 581 for ONNX tensor: 581 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_154 [Mul] outputs: [581 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_155 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 581 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_155 [Conv] inputs: [581 -> (1, 320, 15, 20)], [module_list.9.c3.m.0.cv2.conv.weight -> (320, 320, 3, 3)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_155 for ONNX node: Conv_155 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 320 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 320, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 582 for ONNX tensor: 582 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_155 [Conv] outputs: [582 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_156 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 582 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_156 [BatchNormalization] inputs: [582 -> (1, 320, 15, 20)], [module_list.9.c3.m.0.cv2.bn.weight -> (320)], [module_list.9.c3.m.0.cv2.bn.bias -> (320)], [module_list.9.c3.m.0.cv2.bn.running_mean -> (320)], [module_list.9.c3.m.0.cv2.bn.running_var -> (320)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_156 for ONNX node: BatchNormalization_156 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 583 for ONNX tensor: 583 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_156 [BatchNormalization] outputs: [583 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_157 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 583 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_157 [Sigmoid] inputs: [583 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_157 for ONNX node: Sigmoid_157 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 584 for ONNX tensor: 584 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_157 [Sigmoid] outputs: [584 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_158 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 583 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 584 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_158 [Mul] inputs: [583 -> (1, 320, 15, 20)], [584 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_158 for ONNX node: Mul_158 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 585 for ONNX tensor: 585 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_158 [Mul] outputs: [585 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_159 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 573 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_159 [Conv] inputs: [573 -> (1, 640, 15, 20)], [module_list.9.c3.cv2.conv.weight -> (320, 640, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 640, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_159 for ONNX node: Conv_159 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 320 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 320, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 586 for ONNX tensor: 586 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_159 [Conv] outputs: [586 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_160 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 586 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_160 [BatchNormalization] inputs: [586 -> (1, 320, 15, 20)], [module_list.9.c3.cv2.bn.weight -> (320)], [module_list.9.c3.cv2.bn.bias -> (320)], [module_list.9.c3.cv2.bn.running_mean -> (320)], [module_list.9.c3.cv2.bn.running_var -> (320)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_160 for ONNX node: BatchNormalization_160 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 587 for ONNX tensor: 587 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_160 [BatchNormalization] outputs: [587 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_161 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 587 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_161 [Sigmoid] inputs: [587 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_161 for ONNX node: Sigmoid_161 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 588 for ONNX tensor: 588 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_161 [Sigmoid] outputs: [588 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_162 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 587 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 588 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_162 [Mul] inputs: [587 -> (1, 320, 15, 20)], [588 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_162 for ONNX node: Mul_162 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 589 for ONNX tensor: 589 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_162 [Mul] outputs: [589 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_163 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 585 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 589 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_163 [Concat] inputs: [585 -> (1, 320, 15, 20)], [589 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_163 for ONNX node: Concat_163 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 590 for ONNX tensor: 590 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_163 [Concat] outputs: [590 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_164 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 590 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_164 [Conv] inputs: [590 -> (1, 640, 15, 20)], [module_list.9.c3.cv3.conv.weight -> (640, 640, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 640, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_164 for ONNX node: Conv_164 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 640 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 640, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 591 for ONNX tensor: 591 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_164 [Conv] outputs: [591 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_165 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 591 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.9.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_165 [BatchNormalization] inputs: [591 -> (1, 640, 15, 20)], [module_list.9.c3.cv3.bn.weight -> (640)], [module_list.9.c3.cv3.bn.bias -> (640)], [module_list.9.c3.cv3.bn.running_mean -> (640)], [module_list.9.c3.cv3.bn.running_var -> (640)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_165 for ONNX node: BatchNormalization_165 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 592 for ONNX tensor: 592 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_165 [BatchNormalization] outputs: [592 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_166 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 592 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_166 [Sigmoid] inputs: [592 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_166 for ONNX node: Sigmoid_166 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 593 for ONNX tensor: 593 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_166 [Sigmoid] outputs: [593 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_167 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 592 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 593 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_167 [Mul] inputs: [592 -> (1, 640, 15, 20)], [593 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_167 for ONNX node: Mul_167 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 594 for ONNX tensor: 594 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_167 [Mul] outputs: [594 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_168 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 594 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.10.0.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.10.0.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_168 [Conv] inputs: [594 -> (1, 640, 15, 20)], [module_list.10.0.weight -> (320, 640, 1, 1)], [module_list.10.0.bias -> (320)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 640, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_168 for ONNX node: Conv_168 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 320 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 320, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 595 for ONNX tensor: 595 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_168 [Conv] outputs: [595 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_169 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 595 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_169 [Sigmoid] inputs: [595 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_169 for ONNX node: Sigmoid_169 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 596 for ONNX tensor: 596 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_169 [Sigmoid] outputs: [596 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_170 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 595 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 596 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_170 [Mul] inputs: [595 -> (1, 320, 15, 20)], [596 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_170 for ONNX node: Mul_170 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 597 for ONNX tensor: 597 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_170 [Mul] outputs: [597 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Resize_172 [Resize] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 597 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 606 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 943 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Resize_172 [Resize] inputs: [597 -> (1, 320, 15, 20)], [606 -> ()], [943 -> (4)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Resize_172 for ONNX node: Resize_172 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:2566: Running resize layer with: Transformation mode: asymmetric Resize mode: nearest [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 607 for ONNX tensor: 607 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Resize_172 [Resize] outputs: [607 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_173 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 607 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 558 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_173 [Concat] inputs: [607 -> (1, 320, 30, 40)], [558 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_173 for ONNX node: Concat_173 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 608 for ONNX tensor: 608 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_173 [Concat] outputs: [608 -> (1, 640, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_174 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 608 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_174 [Conv] inputs: [608 -> (1, 640, 30, 40)], [module_list.13.c3.cv1.conv.weight -> (160, 640, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 640, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_174 for ONNX node: Conv_174 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 609 for ONNX tensor: 609 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_174 [Conv] outputs: [609 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_175 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 609 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_175 [BatchNormalization] inputs: [609 -> (1, 160, 30, 40)], [module_list.13.c3.cv1.bn.weight -> (160)], [module_list.13.c3.cv1.bn.bias -> (160)], [module_list.13.c3.cv1.bn.running_mean -> (160)], [module_list.13.c3.cv1.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_175 for ONNX node: BatchNormalization_175 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 610 for ONNX tensor: 610 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_175 [BatchNormalization] outputs: [610 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_176 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 610 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_176 [Sigmoid] inputs: [610 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_176 for ONNX node: Sigmoid_176 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 611 for ONNX tensor: 611 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_176 [Sigmoid] outputs: [611 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_177 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 610 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 611 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_177 [Mul] inputs: [610 -> (1, 160, 30, 40)], [611 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_177 for ONNX node: Mul_177 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 612 for ONNX tensor: 612 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_177 [Mul] outputs: [612 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_178 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 612 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_178 [Conv] inputs: [612 -> (1, 160, 30, 40)], [module_list.13.c3.m.0.cv1.conv.weight -> (160, 160, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_178 for ONNX node: Conv_178 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 613 for ONNX tensor: 613 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_178 [Conv] outputs: [613 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_179 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 613 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_179 [BatchNormalization] inputs: [613 -> (1, 160, 30, 40)], [module_list.13.c3.m.0.cv1.bn.weight -> (160)], [module_list.13.c3.m.0.cv1.bn.bias -> (160)], [module_list.13.c3.m.0.cv1.bn.running_mean -> (160)], [module_list.13.c3.m.0.cv1.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_179 for ONNX node: BatchNormalization_179 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 614 for ONNX tensor: 614 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_179 [BatchNormalization] outputs: [614 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_180 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 614 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_180 [Sigmoid] inputs: [614 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_180 for ONNX node: Sigmoid_180 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 615 for ONNX tensor: 615 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_180 [Sigmoid] outputs: [615 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_181 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 614 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 615 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_181 [Mul] inputs: [614 -> (1, 160, 30, 40)], [615 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_181 for ONNX node: Mul_181 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 616 for ONNX tensor: 616 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_181 [Mul] outputs: [616 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_182 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 616 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_182 [Conv] inputs: [616 -> (1, 160, 30, 40)], [module_list.13.c3.m.0.cv2.conv.weight -> (160, 160, 3, 3)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_182 for ONNX node: Conv_182 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 617 for ONNX tensor: 617 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_182 [Conv] outputs: [617 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_183 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 617 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_183 [BatchNormalization] inputs: [617 -> (1, 160, 30, 40)], [module_list.13.c3.m.0.cv2.bn.weight -> (160)], [module_list.13.c3.m.0.cv2.bn.bias -> (160)], [module_list.13.c3.m.0.cv2.bn.running_mean -> (160)], [module_list.13.c3.m.0.cv2.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_183 for ONNX node: BatchNormalization_183 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 618 for ONNX tensor: 618 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_183 [BatchNormalization] outputs: [618 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_184 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 618 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_184 [Sigmoid] inputs: [618 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_184 for ONNX node: Sigmoid_184 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 619 for ONNX tensor: 619 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_184 [Sigmoid] outputs: [619 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_185 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 618 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 619 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_185 [Mul] inputs: [618 -> (1, 160, 30, 40)], [619 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_185 for ONNX node: Mul_185 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 620 for ONNX tensor: 620 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_185 [Mul] outputs: [620 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_186 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 608 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_186 [Conv] inputs: [608 -> (1, 640, 30, 40)], [module_list.13.c3.cv2.conv.weight -> (160, 640, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 640, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_186 for ONNX node: Conv_186 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 621 for ONNX tensor: 621 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_186 [Conv] outputs: [621 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_187 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 621 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_187 [BatchNormalization] inputs: [621 -> (1, 160, 30, 40)], [module_list.13.c3.cv2.bn.weight -> (160)], [module_list.13.c3.cv2.bn.bias -> (160)], [module_list.13.c3.cv2.bn.running_mean -> (160)], [module_list.13.c3.cv2.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_187 for ONNX node: BatchNormalization_187 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 622 for ONNX tensor: 622 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_187 [BatchNormalization] outputs: [622 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_188 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 622 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_188 [Sigmoid] inputs: [622 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_188 for ONNX node: Sigmoid_188 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 623 for ONNX tensor: 623 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_188 [Sigmoid] outputs: [623 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_189 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 622 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 623 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_189 [Mul] inputs: [622 -> (1, 160, 30, 40)], [623 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_189 for ONNX node: Mul_189 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 624 for ONNX tensor: 624 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_189 [Mul] outputs: [624 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_190 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 620 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 624 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_190 [Concat] inputs: [620 -> (1, 160, 30, 40)], [624 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_190 for ONNX node: Concat_190 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 625 for ONNX tensor: 625 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_190 [Concat] outputs: [625 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_191 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 625 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_191 [Conv] inputs: [625 -> (1, 320, 30, 40)], [module_list.13.c3.cv3.conv.weight -> (320, 320, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_191 for ONNX node: Conv_191 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 320 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 320, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 626 for ONNX tensor: 626 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_191 [Conv] outputs: [626 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_192 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 626 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.13.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_192 [BatchNormalization] inputs: [626 -> (1, 320, 30, 40)], [module_list.13.c3.cv3.bn.weight -> (320)], [module_list.13.c3.cv3.bn.bias -> (320)], [module_list.13.c3.cv3.bn.running_mean -> (320)], [module_list.13.c3.cv3.bn.running_var -> (320)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_192 for ONNX node: BatchNormalization_192 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 627 for ONNX tensor: 627 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_192 [BatchNormalization] outputs: [627 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_193 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 627 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_193 [Sigmoid] inputs: [627 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_193 for ONNX node: Sigmoid_193 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 628 for ONNX tensor: 628 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_193 [Sigmoid] outputs: [628 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_194 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 627 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 628 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_194 [Mul] inputs: [627 -> (1, 320, 30, 40)], [628 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_194 for ONNX node: Mul_194 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 629 for ONNX tensor: 629 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_194 [Mul] outputs: [629 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_195 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 629 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.14.0.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.14.0.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_195 [Conv] inputs: [629 -> (1, 320, 30, 40)], [module_list.14.0.weight -> (160, 320, 1, 1)], [module_list.14.0.bias -> (160)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_195 for ONNX node: Conv_195 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 630 for ONNX tensor: 630 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_195 [Conv] outputs: [630 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_196 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 630 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_196 [Sigmoid] inputs: [630 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_196 for ONNX node: Sigmoid_196 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 631 for ONNX tensor: 631 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_196 [Sigmoid] outputs: [631 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_197 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 630 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 631 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_197 [Mul] inputs: [630 -> (1, 160, 30, 40)], [631 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_197 for ONNX node: Mul_197 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 632 for ONNX tensor: 632 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_197 [Mul] outputs: [632 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Resize_199 [Resize] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 632 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 641 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 948 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Resize_199 [Resize] inputs: [632 -> (1, 160, 30, 40)], [641 -> ()], [948 -> (4)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Resize_199 for ONNX node: Resize_199 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:2566: Running resize layer with: Transformation mode: asymmetric Resize mode: nearest [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 642 for ONNX tensor: 642 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Resize_199 [Resize] outputs: [642 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_200 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 642 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 515 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_200 [Concat] inputs: [642 -> (1, 160, 60, 80)], [515 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_200 for ONNX node: Concat_200 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 643 for ONNX tensor: 643 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_200 [Concat] outputs: [643 -> (1, 320, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_201 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 643 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_201 [Conv] inputs: [643 -> (1, 320, 60, 80)], [module_list.17.c3.cv1.conv.weight -> (80, 320, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_201 for ONNX node: Conv_201 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 80 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 644 for ONNX tensor: 644 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_201 [Conv] outputs: [644 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_202 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 644 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_202 [BatchNormalization] inputs: [644 -> (1, 80, 60, 80)], [module_list.17.c3.cv1.bn.weight -> (80)], [module_list.17.c3.cv1.bn.bias -> (80)], [module_list.17.c3.cv1.bn.running_mean -> (80)], [module_list.17.c3.cv1.bn.running_var -> (80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_202 for ONNX node: BatchNormalization_202 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 645 for ONNX tensor: 645 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_202 [BatchNormalization] outputs: [645 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_203 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 645 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_203 [Sigmoid] inputs: [645 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_203 for ONNX node: Sigmoid_203 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 646 for ONNX tensor: 646 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_203 [Sigmoid] outputs: [646 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_204 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 645 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 646 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_204 [Mul] inputs: [645 -> (1, 80, 60, 80)], [646 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_204 for ONNX node: Mul_204 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 647 for ONNX tensor: 647 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_204 [Mul] outputs: [647 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_205 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 647 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_205 [Conv] inputs: [647 -> (1, 80, 60, 80)], [module_list.17.c3.m.0.cv1.conv.weight -> (80, 80, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_205 for ONNX node: Conv_205 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 80 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 648 for ONNX tensor: 648 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_205 [Conv] outputs: [648 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_206 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 648 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_206 [BatchNormalization] inputs: [648 -> (1, 80, 60, 80)], [module_list.17.c3.m.0.cv1.bn.weight -> (80)], [module_list.17.c3.m.0.cv1.bn.bias -> (80)], [module_list.17.c3.m.0.cv1.bn.running_mean -> (80)], [module_list.17.c3.m.0.cv1.bn.running_var -> (80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_206 for ONNX node: BatchNormalization_206 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 649 for ONNX tensor: 649 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_206 [BatchNormalization] outputs: [649 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_207 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 649 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_207 [Sigmoid] inputs: [649 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_207 for ONNX node: Sigmoid_207 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 650 for ONNX tensor: 650 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_207 [Sigmoid] outputs: [650 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_208 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 649 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 650 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_208 [Mul] inputs: [649 -> (1, 80, 60, 80)], [650 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_208 for ONNX node: Mul_208 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 651 for ONNX tensor: 651 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_208 [Mul] outputs: [651 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_209 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 651 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_209 [Conv] inputs: [651 -> (1, 80, 60, 80)], [module_list.17.c3.m.0.cv2.conv.weight -> (80, 80, 3, 3)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_209 for ONNX node: Conv_209 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 80 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 652 for ONNX tensor: 652 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_209 [Conv] outputs: [652 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_210 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 652 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_210 [BatchNormalization] inputs: [652 -> (1, 80, 60, 80)], [module_list.17.c3.m.0.cv2.bn.weight -> (80)], [module_list.17.c3.m.0.cv2.bn.bias -> (80)], [module_list.17.c3.m.0.cv2.bn.running_mean -> (80)], [module_list.17.c3.m.0.cv2.bn.running_var -> (80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_210 for ONNX node: BatchNormalization_210 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 653 for ONNX tensor: 653 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_210 [BatchNormalization] outputs: [653 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_211 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 653 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_211 [Sigmoid] inputs: [653 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_211 for ONNX node: Sigmoid_211 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 654 for ONNX tensor: 654 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_211 [Sigmoid] outputs: [654 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_212 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 653 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 654 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_212 [Mul] inputs: [653 -> (1, 80, 60, 80)], [654 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_212 for ONNX node: Mul_212 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 655 for ONNX tensor: 655 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_212 [Mul] outputs: [655 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_213 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 643 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_213 [Conv] inputs: [643 -> (1, 320, 60, 80)], [module_list.17.c3.cv2.conv.weight -> (80, 320, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_213 for ONNX node: Conv_213 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 80 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 656 for ONNX tensor: 656 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_213 [Conv] outputs: [656 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_214 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 656 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_214 [BatchNormalization] inputs: [656 -> (1, 80, 60, 80)], [module_list.17.c3.cv2.bn.weight -> (80)], [module_list.17.c3.cv2.bn.bias -> (80)], [module_list.17.c3.cv2.bn.running_mean -> (80)], [module_list.17.c3.cv2.bn.running_var -> (80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_214 for ONNX node: BatchNormalization_214 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 657 for ONNX tensor: 657 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_214 [BatchNormalization] outputs: [657 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_215 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 657 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_215 [Sigmoid] inputs: [657 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_215 for ONNX node: Sigmoid_215 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 658 for ONNX tensor: 658 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_215 [Sigmoid] outputs: [658 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_216 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 657 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 658 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_216 [Mul] inputs: [657 -> (1, 80, 60, 80)], [658 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_216 for ONNX node: Mul_216 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 659 for ONNX tensor: 659 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_216 [Mul] outputs: [659 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_217 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 655 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 659 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_217 [Concat] inputs: [655 -> (1, 80, 60, 80)], [659 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_217 for ONNX node: Concat_217 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 660 for ONNX tensor: 660 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_217 [Concat] outputs: [660 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_218 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 660 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_218 [Conv] inputs: [660 -> (1, 160, 60, 80)], [module_list.17.c3.cv3.conv.weight -> (160, 160, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 160, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_218 for ONNX node: Conv_218 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 661 for ONNX tensor: 661 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_218 [Conv] outputs: [661 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_219 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 661 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.17.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_219 [BatchNormalization] inputs: [661 -> (1, 160, 60, 80)], [module_list.17.c3.cv3.bn.weight -> (160)], [module_list.17.c3.cv3.bn.bias -> (160)], [module_list.17.c3.cv3.bn.running_mean -> (160)], [module_list.17.c3.cv3.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_219 for ONNX node: BatchNormalization_219 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 662 for ONNX tensor: 662 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_219 [BatchNormalization] outputs: [662 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_220 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 662 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_220 [Sigmoid] inputs: [662 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_220 for ONNX node: Sigmoid_220 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 663 for ONNX tensor: 663 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_220 [Sigmoid] outputs: [663 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_221 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 662 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 663 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_221 [Mul] inputs: [662 -> (1, 160, 60, 80)], [663 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_221 for ONNX node: Mul_221 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 664 for ONNX tensor: 664 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_221 [Mul] outputs: [664 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_222 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 664 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.18.Conv2d.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.18.Conv2d.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_222 [Conv] inputs: [664 -> (1, 160, 60, 80)], [module_list.18.Conv2d.weight -> (33, 160, 1, 1)], [module_list.18.Conv2d.bias -> (33)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 160, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_222 for ONNX node: Conv_222 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 33 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 33, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 665 for ONNX tensor: 665 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_222 [Conv] outputs: [665 -> (1, 33, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_224 [Reshape] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 665 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 666 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Reshape_224 [Reshape] inputs: [665 -> (1, 33, 60, 80)], [666 -> (5)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Reshape_224 for ONNX node: Reshape_224 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 667 for ONNX tensor: 667 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Reshape_224 [Reshape] outputs: [667 -> (1, 3, 11, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose_225 [Transpose] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 667 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Transpose_225 [Transpose] inputs: [667 -> (1, 3, 11, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Transpose_225 for ONNX node: Transpose_225 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 668 for ONNX tensor: 668 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Transpose_225 [Transpose] outputs: [668 -> (1, 3, 60, 80, 11)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_227 [Reshape] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 668 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 669 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Reshape_227 [Reshape] inputs: [668 -> (1, 3, 60, 80, 11)], [669 -> (2)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Reshape_227 for ONNX node: Reshape_227 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 670 for ONNX tensor: 670 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Reshape_227 [Reshape] outputs: [670 -> (14400, 11)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_228 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 670 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_228 [Sigmoid] inputs: [670 -> (14400, 11)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_228 for ONNX node: Sigmoid_228 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 671 for ONNX tensor: 671 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_228 [Sigmoid] outputs: [671 -> (14400, 11)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_233 [Slice] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 671 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 673 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 674 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 672 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 675 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Slice_233 [Slice] inputs: [671 -> (14400, 11)], [673 -> (1)], [674 -> (1)], [672 -> (1)], [675 -> (1)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Slice_233 for ONNX node: Slice_233 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 676 for ONNX tensor: 676 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Slice_233 [Slice] outputs: [676 -> (14400, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_235 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 676 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 677 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_235 [Mul] inputs: [676 -> (14400, 2)], [677 -> ()], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_235 for ONNX node: Mul_235 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 678 for ONNX tensor: 678 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_235 [Mul] outputs: [678 -> (14400, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sub_237 [Sub] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 678 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 679 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sub_237 [Sub] inputs: [678 -> (14400, 2)], [679 -> ()], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sub_237 for ONNX node: Sub_237 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 680 for ONNX tensor: 680 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sub_237 [Sub] outputs: [680 -> (14400, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_239 [Add] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 680 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 681 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Add_239 [Add] inputs: [680 -> (14400, 2)], [681 -> (14400, 2)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_239 for ONNX node: Add_239 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 682 for ONNX tensor: 682 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Add_239 [Add] outputs: [682 -> (14400, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_244 [Slice] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 671 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 684 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 685 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 683 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 686 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Slice_244 [Slice] inputs: [671 -> (14400, 11)], [684 -> (1)], [685 -> (1)], [683 -> (1)], [686 -> (1)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Slice_244 for ONNX node: Slice_244 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 687 for ONNX tensor: 687 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Slice_244 [Slice] outputs: [687 -> (14400, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_246 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 687 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 688 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_246 [Mul] inputs: [687 -> (14400, 2)], [688 -> ()], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_246 for ONNX node: Mul_246 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 689 for ONNX tensor: 689 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_246 [Mul] outputs: [689 -> (14400, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Pow_247 [Pow] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 689 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 949 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Pow_247 [Pow] inputs: [689 -> (14400, 2)], [949 -> ()], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Pow_247 for ONNX node: Pow_247 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 692 for ONNX tensor: 692 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Pow_247 [Pow] outputs: [692 -> (14400, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_249 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 692 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 693 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_249 [Mul] inputs: [692 -> (14400, 2)], [693 -> (14400, 2)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_249 for ONNX node: Mul_249 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 694 for ONNX tensor: 694 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_249 [Mul] outputs: [694 -> (14400, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_254 [Slice] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 671 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 696 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 697 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 695 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 698 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Slice_254 [Slice] inputs: [671 -> (14400, 11)], [696 -> (1)], [697 -> (1)], [695 -> (1)], [698 -> (1)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Slice_254 for ONNX node: Slice_254 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 699 for ONNX tensor: 699 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Slice_254 [Slice] outputs: [699 -> (14400, 6)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_259 [Slice] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 671 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 701 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 702 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 700 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 703 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Slice_259 [Slice] inputs: [671 -> (14400, 11)], [701 -> (1)], [702 -> (1)], [700 -> (1)], [703 -> (1)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Slice_259 for ONNX node: Slice_259 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 704 for ONNX tensor: 704 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Slice_259 [Slice] outputs: [704 -> (14400, 1)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_260 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 699 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 704 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_260 [Mul] inputs: [699 -> (14400, 6)], [704 -> (14400, 1)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_260 for ONNX node: Mul_260 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 705 for ONNX tensor: 705 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_260 [Mul] outputs: [705 -> (14400, 6)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_262 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 682 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 706 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_262 [Mul] inputs: [682 -> (14400, 2)], [706 -> (14400, 2)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_262 for ONNX node: Mul_262 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 707 for ONNX tensor: 707 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_262 [Mul] outputs: [707 -> (14400, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_263 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 664 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.21.0.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.21.0.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_263 [Conv] inputs: [664 -> (1, 160, 60, 80)], [module_list.21.0.weight -> (160, 160, 3, 3)], [module_list.21.0.bias -> (160)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 160, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_263 for ONNX node: Conv_263 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 708 for ONNX tensor: 708 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_263 [Conv] outputs: [708 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_264 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 708 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_264 [Sigmoid] inputs: [708 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_264 for ONNX node: Sigmoid_264 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 709 for ONNX tensor: 709 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_264 [Sigmoid] outputs: [709 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_265 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 708 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 709 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_265 [Mul] inputs: [708 -> (1, 160, 30, 40)], [709 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_265 for ONNX node: Mul_265 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 710 for ONNX tensor: 710 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_265 [Mul] outputs: [710 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_266 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 710 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 632 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_266 [Concat] inputs: [710 -> (1, 160, 30, 40)], [632 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_266 for ONNX node: Concat_266 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 711 for ONNX tensor: 711 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_266 [Concat] outputs: [711 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_267 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 711 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_267 [Conv] inputs: [711 -> (1, 320, 30, 40)], [module_list.23.c3.cv1.conv.weight -> (160, 320, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_267 for ONNX node: Conv_267 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 712 for ONNX tensor: 712 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_267 [Conv] outputs: [712 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_268 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 712 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_268 [BatchNormalization] inputs: [712 -> (1, 160, 30, 40)], [module_list.23.c3.cv1.bn.weight -> (160)], [module_list.23.c3.cv1.bn.bias -> (160)], [module_list.23.c3.cv1.bn.running_mean -> (160)], [module_list.23.c3.cv1.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_268 for ONNX node: BatchNormalization_268 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 713 for ONNX tensor: 713 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_268 [BatchNormalization] outputs: [713 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_269 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 713 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_269 [Sigmoid] inputs: [713 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_269 for ONNX node: Sigmoid_269 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 714 for ONNX tensor: 714 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_269 [Sigmoid] outputs: [714 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_270 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 713 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 714 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_270 [Mul] inputs: [713 -> (1, 160, 30, 40)], [714 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_270 for ONNX node: Mul_270 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 715 for ONNX tensor: 715 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_270 [Mul] outputs: [715 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_271 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 715 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_271 [Conv] inputs: [715 -> (1, 160, 30, 40)], [module_list.23.c3.m.0.cv1.conv.weight -> (160, 160, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_271 for ONNX node: Conv_271 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 716 for ONNX tensor: 716 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_271 [Conv] outputs: [716 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_272 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 716 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_272 [BatchNormalization] inputs: [716 -> (1, 160, 30, 40)], [module_list.23.c3.m.0.cv1.bn.weight -> (160)], [module_list.23.c3.m.0.cv1.bn.bias -> (160)], [module_list.23.c3.m.0.cv1.bn.running_mean -> (160)], [module_list.23.c3.m.0.cv1.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_272 for ONNX node: BatchNormalization_272 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 717 for ONNX tensor: 717 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_272 [BatchNormalization] outputs: [717 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_273 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 717 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_273 [Sigmoid] inputs: [717 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_273 for ONNX node: Sigmoid_273 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 718 for ONNX tensor: 718 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_273 [Sigmoid] outputs: [718 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_274 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 717 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 718 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_274 [Mul] inputs: [717 -> (1, 160, 30, 40)], [718 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_274 for ONNX node: Mul_274 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 719 for ONNX tensor: 719 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_274 [Mul] outputs: [719 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_275 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 719 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_275 [Conv] inputs: [719 -> (1, 160, 30, 40)], [module_list.23.c3.m.0.cv2.conv.weight -> (160, 160, 3, 3)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_275 for ONNX node: Conv_275 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 720 for ONNX tensor: 720 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_275 [Conv] outputs: [720 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_276 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 720 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_276 [BatchNormalization] inputs: [720 -> (1, 160, 30, 40)], [module_list.23.c3.m.0.cv2.bn.weight -> (160)], [module_list.23.c3.m.0.cv2.bn.bias -> (160)], [module_list.23.c3.m.0.cv2.bn.running_mean -> (160)], [module_list.23.c3.m.0.cv2.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_276 for ONNX node: BatchNormalization_276 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 721 for ONNX tensor: 721 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_276 [BatchNormalization] outputs: [721 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_277 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 721 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_277 [Sigmoid] inputs: [721 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_277 for ONNX node: Sigmoid_277 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 722 for ONNX tensor: 722 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_277 [Sigmoid] outputs: [722 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_278 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 721 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 722 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_278 [Mul] inputs: [721 -> (1, 160, 30, 40)], [722 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_278 for ONNX node: Mul_278 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 723 for ONNX tensor: 723 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_278 [Mul] outputs: [723 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_279 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 711 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_279 [Conv] inputs: [711 -> (1, 320, 30, 40)], [module_list.23.c3.cv2.conv.weight -> (160, 320, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_279 for ONNX node: Conv_279 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 724 for ONNX tensor: 724 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_279 [Conv] outputs: [724 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_280 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 724 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_280 [BatchNormalization] inputs: [724 -> (1, 160, 30, 40)], [module_list.23.c3.cv2.bn.weight -> (160)], [module_list.23.c3.cv2.bn.bias -> (160)], [module_list.23.c3.cv2.bn.running_mean -> (160)], [module_list.23.c3.cv2.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_280 for ONNX node: BatchNormalization_280 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 725 for ONNX tensor: 725 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_280 [BatchNormalization] outputs: [725 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_281 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 725 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_281 [Sigmoid] inputs: [725 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_281 for ONNX node: Sigmoid_281 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 726 for ONNX tensor: 726 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_281 [Sigmoid] outputs: [726 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_282 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 725 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 726 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_282 [Mul] inputs: [725 -> (1, 160, 30, 40)], [726 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_282 for ONNX node: Mul_282 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 727 for ONNX tensor: 727 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_282 [Mul] outputs: [727 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_283 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 723 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 727 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_283 [Concat] inputs: [723 -> (1, 160, 30, 40)], [727 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_283 for ONNX node: Concat_283 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 728 for ONNX tensor: 728 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_283 [Concat] outputs: [728 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_284 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 728 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_284 [Conv] inputs: [728 -> (1, 320, 30, 40)], [module_list.23.c3.cv3.conv.weight -> (320, 320, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_284 for ONNX node: Conv_284 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 320 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 320, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 729 for ONNX tensor: 729 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_284 [Conv] outputs: [729 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_285 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 729 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.23.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_285 [BatchNormalization] inputs: [729 -> (1, 320, 30, 40)], [module_list.23.c3.cv3.bn.weight -> (320)], [module_list.23.c3.cv3.bn.bias -> (320)], [module_list.23.c3.cv3.bn.running_mean -> (320)], [module_list.23.c3.cv3.bn.running_var -> (320)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_285 for ONNX node: BatchNormalization_285 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 730 for ONNX tensor: 730 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_285 [BatchNormalization] outputs: [730 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_286 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 730 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_286 [Sigmoid] inputs: [730 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_286 for ONNX node: Sigmoid_286 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 731 for ONNX tensor: 731 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_286 [Sigmoid] outputs: [731 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_287 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 730 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 731 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_287 [Mul] inputs: [730 -> (1, 320, 30, 40)], [731 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_287 for ONNX node: Mul_287 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 732 for ONNX tensor: 732 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_287 [Mul] outputs: [732 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_288 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 732 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.24.Conv2d.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.24.Conv2d.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_288 [Conv] inputs: [732 -> (1, 320, 30, 40)], [module_list.24.Conv2d.weight -> (33, 320, 1, 1)], [module_list.24.Conv2d.bias -> (33)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_288 for ONNX node: Conv_288 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 33 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 33, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 733 for ONNX tensor: 733 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_288 [Conv] outputs: [733 -> (1, 33, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_290 [Reshape] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 733 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 734 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Reshape_290 [Reshape] inputs: [733 -> (1, 33, 30, 40)], [734 -> (5)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Reshape_290 for ONNX node: Reshape_290 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 735 for ONNX tensor: 735 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Reshape_290 [Reshape] outputs: [735 -> (1, 3, 11, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose_291 [Transpose] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 735 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Transpose_291 [Transpose] inputs: [735 -> (1, 3, 11, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Transpose_291 for ONNX node: Transpose_291 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 736 for ONNX tensor: 736 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Transpose_291 [Transpose] outputs: [736 -> (1, 3, 30, 40, 11)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_293 [Reshape] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 736 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 737 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Reshape_293 [Reshape] inputs: [736 -> (1, 3, 30, 40, 11)], [737 -> (2)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Reshape_293 for ONNX node: Reshape_293 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 738 for ONNX tensor: 738 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Reshape_293 [Reshape] outputs: [738 -> (3600, 11)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_294 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 738 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_294 [Sigmoid] inputs: [738 -> (3600, 11)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_294 for ONNX node: Sigmoid_294 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 739 for ONNX tensor: 739 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_294 [Sigmoid] outputs: [739 -> (3600, 11)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_299 [Slice] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 739 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 741 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 742 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 740 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 743 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Slice_299 [Slice] inputs: [739 -> (3600, 11)], [741 -> (1)], [742 -> (1)], [740 -> (1)], [743 -> (1)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Slice_299 for ONNX node: Slice_299 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 744 for ONNX tensor: 744 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Slice_299 [Slice] outputs: [744 -> (3600, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_301 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 744 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 745 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_301 [Mul] inputs: [744 -> (3600, 2)], [745 -> ()], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_301 for ONNX node: Mul_301 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 746 for ONNX tensor: 746 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_301 [Mul] outputs: [746 -> (3600, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sub_303 [Sub] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 746 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 747 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sub_303 [Sub] inputs: [746 -> (3600, 2)], [747 -> ()], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sub_303 for ONNX node: Sub_303 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 748 for ONNX tensor: 748 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sub_303 [Sub] outputs: [748 -> (3600, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_305 [Add] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 748 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 749 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Add_305 [Add] inputs: [748 -> (3600, 2)], [749 -> (3600, 2)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_305 for ONNX node: Add_305 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 750 for ONNX tensor: 750 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Add_305 [Add] outputs: [750 -> (3600, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_310 [Slice] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 739 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 752 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 753 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 751 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 754 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Slice_310 [Slice] inputs: [739 -> (3600, 11)], [752 -> (1)], [753 -> (1)], [751 -> (1)], [754 -> (1)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Slice_310 for ONNX node: Slice_310 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 755 for ONNX tensor: 755 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Slice_310 [Slice] outputs: [755 -> (3600, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_312 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 755 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 756 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_312 [Mul] inputs: [755 -> (3600, 2)], [756 -> ()], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_312 for ONNX node: Mul_312 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 757 for ONNX tensor: 757 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_312 [Mul] outputs: [757 -> (3600, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Pow_313 [Pow] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 757 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 950 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Pow_313 [Pow] inputs: [757 -> (3600, 2)], [950 -> ()], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Pow_313 for ONNX node: Pow_313 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 760 for ONNX tensor: 760 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Pow_313 [Pow] outputs: [760 -> (3600, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_315 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 760 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 761 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_315 [Mul] inputs: [760 -> (3600, 2)], [761 -> (3600, 2)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_315 for ONNX node: Mul_315 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 762 for ONNX tensor: 762 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_315 [Mul] outputs: [762 -> (3600, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_320 [Slice] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 739 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 764 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 765 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 763 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 766 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Slice_320 [Slice] inputs: [739 -> (3600, 11)], [764 -> (1)], [765 -> (1)], [763 -> (1)], [766 -> (1)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Slice_320 for ONNX node: Slice_320 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 767 for ONNX tensor: 767 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Slice_320 [Slice] outputs: [767 -> (3600, 6)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_325 [Slice] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 739 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 769 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 770 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 768 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 771 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Slice_325 [Slice] inputs: [739 -> (3600, 11)], [769 -> (1)], [770 -> (1)], [768 -> (1)], [771 -> (1)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Slice_325 for ONNX node: Slice_325 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 772 for ONNX tensor: 772 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Slice_325 [Slice] outputs: [772 -> (3600, 1)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_326 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 767 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 772 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_326 [Mul] inputs: [767 -> (3600, 6)], [772 -> (3600, 1)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_326 for ONNX node: Mul_326 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 773 for ONNX tensor: 773 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_326 [Mul] outputs: [773 -> (3600, 6)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_328 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 750 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 774 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_328 [Mul] inputs: [750 -> (3600, 2)], [774 -> (3600, 2)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_328 for ONNX node: Mul_328 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 775 for ONNX tensor: 775 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_328 [Mul] outputs: [775 -> (3600, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_329 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 732 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.27.0.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.27.0.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_329 [Conv] inputs: [732 -> (1, 320, 30, 40)], [module_list.27.0.weight -> (320, 320, 3, 3)], [module_list.27.0.bias -> (320)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_329 for ONNX node: Conv_329 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 320 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 320, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 776 for ONNX tensor: 776 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_329 [Conv] outputs: [776 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_330 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 776 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_330 [Sigmoid] inputs: [776 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_330 for ONNX node: Sigmoid_330 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 777 for ONNX tensor: 777 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_330 [Sigmoid] outputs: [777 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_331 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 776 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 777 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_331 [Mul] inputs: [776 -> (1, 320, 15, 20)], [777 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_331 for ONNX node: Mul_331 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 778 for ONNX tensor: 778 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_331 [Mul] outputs: [778 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_332 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 778 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 597 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_332 [Concat] inputs: [778 -> (1, 320, 15, 20)], [597 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_332 for ONNX node: Concat_332 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 779 for ONNX tensor: 779 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_332 [Concat] outputs: [779 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_333 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 779 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_333 [Conv] inputs: [779 -> (1, 640, 15, 20)], [module_list.29.c3.cv1.conv.weight -> (320, 640, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 640, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_333 for ONNX node: Conv_333 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 320 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 320, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 780 for ONNX tensor: 780 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_333 [Conv] outputs: [780 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_334 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 780 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_334 [BatchNormalization] inputs: [780 -> (1, 320, 15, 20)], [module_list.29.c3.cv1.bn.weight -> (320)], [module_list.29.c3.cv1.bn.bias -> (320)], [module_list.29.c3.cv1.bn.running_mean -> (320)], [module_list.29.c3.cv1.bn.running_var -> (320)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_334 for ONNX node: BatchNormalization_334 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 781 for ONNX tensor: 781 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_334 [BatchNormalization] outputs: [781 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_335 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 781 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_335 [Sigmoid] inputs: [781 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_335 for ONNX node: Sigmoid_335 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 782 for ONNX tensor: 782 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_335 [Sigmoid] outputs: [782 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_336 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 781 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 782 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_336 [Mul] inputs: [781 -> (1, 320, 15, 20)], [782 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_336 for ONNX node: Mul_336 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 783 for ONNX tensor: 783 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_336 [Mul] outputs: [783 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_337 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 783 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_337 [Conv] inputs: [783 -> (1, 320, 15, 20)], [module_list.29.c3.m.0.cv1.conv.weight -> (320, 320, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_337 for ONNX node: Conv_337 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 320 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 320, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 784 for ONNX tensor: 784 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_337 [Conv] outputs: [784 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_338 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 784 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_338 [BatchNormalization] inputs: [784 -> (1, 320, 15, 20)], [module_list.29.c3.m.0.cv1.bn.weight -> (320)], [module_list.29.c3.m.0.cv1.bn.bias -> (320)], [module_list.29.c3.m.0.cv1.bn.running_mean -> (320)], [module_list.29.c3.m.0.cv1.bn.running_var -> (320)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_338 for ONNX node: BatchNormalization_338 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 785 for ONNX tensor: 785 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_338 [BatchNormalization] outputs: [785 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_339 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 785 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_339 [Sigmoid] inputs: [785 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_339 for ONNX node: Sigmoid_339 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 786 for ONNX tensor: 786 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_339 [Sigmoid] outputs: [786 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_340 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 785 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 786 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_340 [Mul] inputs: [785 -> (1, 320, 15, 20)], [786 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_340 for ONNX node: Mul_340 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 787 for ONNX tensor: 787 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_340 [Mul] outputs: [787 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_341 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 787 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_341 [Conv] inputs: [787 -> (1, 320, 15, 20)], [module_list.29.c3.m.0.cv2.conv.weight -> (320, 320, 3, 3)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_341 for ONNX node: Conv_341 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 320 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 320, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 788 for ONNX tensor: 788 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_341 [Conv] outputs: [788 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_342 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 788 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_342 [BatchNormalization] inputs: [788 -> (1, 320, 15, 20)], [module_list.29.c3.m.0.cv2.bn.weight -> (320)], [module_list.29.c3.m.0.cv2.bn.bias -> (320)], [module_list.29.c3.m.0.cv2.bn.running_mean -> (320)], [module_list.29.c3.m.0.cv2.bn.running_var -> (320)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_342 for ONNX node: BatchNormalization_342 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 789 for ONNX tensor: 789 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_342 [BatchNormalization] outputs: [789 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_343 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 789 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_343 [Sigmoid] inputs: [789 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_343 for ONNX node: Sigmoid_343 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 790 for ONNX tensor: 790 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_343 [Sigmoid] outputs: [790 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_344 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 789 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 790 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_344 [Mul] inputs: [789 -> (1, 320, 15, 20)], [790 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_344 for ONNX node: Mul_344 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 791 for ONNX tensor: 791 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_344 [Mul] outputs: [791 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_345 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 779 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_345 [Conv] inputs: [779 -> (1, 640, 15, 20)], [module_list.29.c3.cv2.conv.weight -> (320, 640, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 640, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_345 for ONNX node: Conv_345 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 320 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 320, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 792 for ONNX tensor: 792 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_345 [Conv] outputs: [792 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_346 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 792 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_346 [BatchNormalization] inputs: [792 -> (1, 320, 15, 20)], [module_list.29.c3.cv2.bn.weight -> (320)], [module_list.29.c3.cv2.bn.bias -> (320)], [module_list.29.c3.cv2.bn.running_mean -> (320)], [module_list.29.c3.cv2.bn.running_var -> (320)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_346 for ONNX node: BatchNormalization_346 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 793 for ONNX tensor: 793 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_346 [BatchNormalization] outputs: [793 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_347 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 793 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_347 [Sigmoid] inputs: [793 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_347 for ONNX node: Sigmoid_347 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 794 for ONNX tensor: 794 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_347 [Sigmoid] outputs: [794 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_348 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 793 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 794 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_348 [Mul] inputs: [793 -> (1, 320, 15, 20)], [794 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_348 for ONNX node: Mul_348 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 795 for ONNX tensor: 795 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_348 [Mul] outputs: [795 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_349 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 791 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 795 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_349 [Concat] inputs: [791 -> (1, 320, 15, 20)], [795 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_349 for ONNX node: Concat_349 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 796 for ONNX tensor: 796 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_349 [Concat] outputs: [796 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_350 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 796 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_350 [Conv] inputs: [796 -> (1, 640, 15, 20)], [module_list.29.c3.cv3.conv.weight -> (640, 640, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 640, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_350 for ONNX node: Conv_350 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 640 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 640, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 797 for ONNX tensor: 797 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_350 [Conv] outputs: [797 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_351 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 797 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.29.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_351 [BatchNormalization] inputs: [797 -> (1, 640, 15, 20)], [module_list.29.c3.cv3.bn.weight -> (640)], [module_list.29.c3.cv3.bn.bias -> (640)], [module_list.29.c3.cv3.bn.running_mean -> (640)], [module_list.29.c3.cv3.bn.running_var -> (640)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_351 for ONNX node: BatchNormalization_351 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 798 for ONNX tensor: 798 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_351 [BatchNormalization] outputs: [798 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_352 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 798 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_352 [Sigmoid] inputs: [798 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_352 for ONNX node: Sigmoid_352 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 799 for ONNX tensor: 799 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_352 [Sigmoid] outputs: [799 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_353 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 798 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 799 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_353 [Mul] inputs: [798 -> (1, 640, 15, 20)], [799 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_353 for ONNX node: Mul_353 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 800 for ONNX tensor: 800 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_353 [Mul] outputs: [800 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_354 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 800 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.30.Conv2d.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.30.Conv2d.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_354 [Conv] inputs: [800 -> (1, 640, 15, 20)], [module_list.30.Conv2d.weight -> (33, 640, 1, 1)], [module_list.30.Conv2d.bias -> (33)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 640, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_354 for ONNX node: Conv_354 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 33 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 33, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 801 for ONNX tensor: 801 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_354 [Conv] outputs: [801 -> (1, 33, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_356 [Reshape] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 801 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 802 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Reshape_356 [Reshape] inputs: [801 -> (1, 33, 15, 20)], [802 -> (5)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Reshape_356 for ONNX node: Reshape_356 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 803 for ONNX tensor: 803 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Reshape_356 [Reshape] outputs: [803 -> (1, 3, 11, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose_357 [Transpose] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 803 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Transpose_357 [Transpose] inputs: [803 -> (1, 3, 11, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Transpose_357 for ONNX node: Transpose_357 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 804 for ONNX tensor: 804 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Transpose_357 [Transpose] outputs: [804 -> (1, 3, 15, 20, 11)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_359 [Reshape] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 804 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 805 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Reshape_359 [Reshape] inputs: [804 -> (1, 3, 15, 20, 11)], [805 -> (2)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Reshape_359 for ONNX node: Reshape_359 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 806 for ONNX tensor: 806 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Reshape_359 [Reshape] outputs: [806 -> (900, 11)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_360 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 806 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_360 [Sigmoid] inputs: [806 -> (900, 11)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_360 for ONNX node: Sigmoid_360 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 807 for ONNX tensor: 807 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_360 [Sigmoid] outputs: [807 -> (900, 11)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_365 [Slice] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 807 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 809 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 810 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 808 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 811 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Slice_365 [Slice] inputs: [807 -> (900, 11)], [809 -> (1)], [810 -> (1)], [808 -> (1)], [811 -> (1)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Slice_365 for ONNX node: Slice_365 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 812 for ONNX tensor: 812 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Slice_365 [Slice] outputs: [812 -> (900, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_367 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 812 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 813 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_367 [Mul] inputs: [812 -> (900, 2)], [813 -> ()], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_367 for ONNX node: Mul_367 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 814 for ONNX tensor: 814 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_367 [Mul] outputs: [814 -> (900, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sub_369 [Sub] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 814 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 815 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sub_369 [Sub] inputs: [814 -> (900, 2)], [815 -> ()], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sub_369 for ONNX node: Sub_369 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 816 for ONNX tensor: 816 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sub_369 [Sub] outputs: [816 -> (900, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_371 [Add] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 816 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 817 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Add_371 [Add] inputs: [816 -> (900, 2)], [817 -> (900, 2)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_371 for ONNX node: Add_371 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 818 for ONNX tensor: 818 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Add_371 [Add] outputs: [818 -> (900, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_376 [Slice] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 807 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 820 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 821 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 819 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 822 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Slice_376 [Slice] inputs: [807 -> (900, 11)], [820 -> (1)], [821 -> (1)], [819 -> (1)], [822 -> (1)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Slice_376 for ONNX node: Slice_376 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 823 for ONNX tensor: 823 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Slice_376 [Slice] outputs: [823 -> (900, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_378 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 823 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 824 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_378 [Mul] inputs: [823 -> (900, 2)], [824 -> ()], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_378 for ONNX node: Mul_378 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 825 for ONNX tensor: 825 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_378 [Mul] outputs: [825 -> (900, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Pow_379 [Pow] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 825 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 951 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Pow_379 [Pow] inputs: [825 -> (900, 2)], [951 -> ()], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Pow_379 for ONNX node: Pow_379 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 828 for ONNX tensor: 828 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Pow_379 [Pow] outputs: [828 -> (900, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_381 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 828 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 829 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_381 [Mul] inputs: [828 -> (900, 2)], [829 -> (900, 2)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_381 for ONNX node: Mul_381 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 830 for ONNX tensor: 830 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_381 [Mul] outputs: [830 -> (900, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_386 [Slice] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 807 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 832 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 833 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 831 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 834 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Slice_386 [Slice] inputs: [807 -> (900, 11)], [832 -> (1)], [833 -> (1)], [831 -> (1)], [834 -> (1)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Slice_386 for ONNX node: Slice_386 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 835 for ONNX tensor: 835 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Slice_386 [Slice] outputs: [835 -> (900, 6)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_391 [Slice] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 807 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 837 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 838 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 836 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 839 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Slice_391 [Slice] inputs: [807 -> (900, 11)], [837 -> (1)], [838 -> (1)], [836 -> (1)], [839 -> (1)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Slice_391 for ONNX node: Slice_391 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 840 for ONNX tensor: 840 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Slice_391 [Slice] outputs: [840 -> (900, 1)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_392 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 835 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 840 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_392 [Mul] inputs: [835 -> (900, 6)], [840 -> (900, 1)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_392 for ONNX node: Mul_392 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 841 for ONNX tensor: 841 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_392 [Mul] outputs: [841 -> (900, 6)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_394 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 818 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 842 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_394 [Mul] inputs: [818 -> (900, 2)], [842 -> (900, 2)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_394 for ONNX node: Mul_394 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 843 for ONNX tensor: 843 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_394 [Mul] outputs: [843 -> (900, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_395 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 778 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 597 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_395 [Concat] inputs: [778 -> (1, 320, 15, 20)], [597 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_395 for ONNX node: Concat_395 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 844 for ONNX tensor: 844 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_395 [Concat] outputs: [844 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_396 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 844 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_396 [Conv] inputs: [844 -> (1, 640, 15, 20)], [module_list.33.c3.cv1.conv.weight -> (320, 640, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 640, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_396 for ONNX node: Conv_396 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 320 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 320, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 845 for ONNX tensor: 845 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_396 [Conv] outputs: [845 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_397 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 845 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_397 [BatchNormalization] inputs: [845 -> (1, 320, 15, 20)], [module_list.33.c3.cv1.bn.weight -> (320)], [module_list.33.c3.cv1.bn.bias -> (320)], [module_list.33.c3.cv1.bn.running_mean -> (320)], [module_list.33.c3.cv1.bn.running_var -> (320)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_397 for ONNX node: BatchNormalization_397 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 846 for ONNX tensor: 846 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_397 [BatchNormalization] outputs: [846 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_398 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 846 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_398 [Sigmoid] inputs: [846 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_398 for ONNX node: Sigmoid_398 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 847 for ONNX tensor: 847 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_398 [Sigmoid] outputs: [847 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_399 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 846 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 847 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_399 [Mul] inputs: [846 -> (1, 320, 15, 20)], [847 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_399 for ONNX node: Mul_399 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 848 for ONNX tensor: 848 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_399 [Mul] outputs: [848 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_400 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 848 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_400 [Conv] inputs: [848 -> (1, 320, 15, 20)], [module_list.33.c3.m.0.cv1.conv.weight -> (320, 320, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_400 for ONNX node: Conv_400 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 320 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 320, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 849 for ONNX tensor: 849 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_400 [Conv] outputs: [849 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_401 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 849 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_401 [BatchNormalization] inputs: [849 -> (1, 320, 15, 20)], [module_list.33.c3.m.0.cv1.bn.weight -> (320)], [module_list.33.c3.m.0.cv1.bn.bias -> (320)], [module_list.33.c3.m.0.cv1.bn.running_mean -> (320)], [module_list.33.c3.m.0.cv1.bn.running_var -> (320)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_401 for ONNX node: BatchNormalization_401 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 850 for ONNX tensor: 850 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_401 [BatchNormalization] outputs: [850 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_402 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 850 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_402 [Sigmoid] inputs: [850 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_402 for ONNX node: Sigmoid_402 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 851 for ONNX tensor: 851 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_402 [Sigmoid] outputs: [851 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_403 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 850 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 851 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_403 [Mul] inputs: [850 -> (1, 320, 15, 20)], [851 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_403 for ONNX node: Mul_403 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 852 for ONNX tensor: 852 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_403 [Mul] outputs: [852 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_404 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 852 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_404 [Conv] inputs: [852 -> (1, 320, 15, 20)], [module_list.33.c3.m.0.cv2.conv.weight -> (320, 320, 3, 3)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_404 for ONNX node: Conv_404 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 320 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 320, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 853 for ONNX tensor: 853 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_404 [Conv] outputs: [853 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_405 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 853 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_405 [BatchNormalization] inputs: [853 -> (1, 320, 15, 20)], [module_list.33.c3.m.0.cv2.bn.weight -> (320)], [module_list.33.c3.m.0.cv2.bn.bias -> (320)], [module_list.33.c3.m.0.cv2.bn.running_mean -> (320)], [module_list.33.c3.m.0.cv2.bn.running_var -> (320)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_405 for ONNX node: BatchNormalization_405 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 854 for ONNX tensor: 854 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_405 [BatchNormalization] outputs: [854 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_406 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 854 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_406 [Sigmoid] inputs: [854 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_406 for ONNX node: Sigmoid_406 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 855 for ONNX tensor: 855 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_406 [Sigmoid] outputs: [855 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_407 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 854 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 855 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_407 [Mul] inputs: [854 -> (1, 320, 15, 20)], [855 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_407 for ONNX node: Mul_407 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 856 for ONNX tensor: 856 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_407 [Mul] outputs: [856 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_408 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 844 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_408 [Conv] inputs: [844 -> (1, 640, 15, 20)], [module_list.33.c3.cv2.conv.weight -> (320, 640, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 640, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_408 for ONNX node: Conv_408 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 320 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 320, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 857 for ONNX tensor: 857 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_408 [Conv] outputs: [857 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_409 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 857 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_409 [BatchNormalization] inputs: [857 -> (1, 320, 15, 20)], [module_list.33.c3.cv2.bn.weight -> (320)], [module_list.33.c3.cv2.bn.bias -> (320)], [module_list.33.c3.cv2.bn.running_mean -> (320)], [module_list.33.c3.cv2.bn.running_var -> (320)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_409 for ONNX node: BatchNormalization_409 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 858 for ONNX tensor: 858 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_409 [BatchNormalization] outputs: [858 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_410 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 858 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_410 [Sigmoid] inputs: [858 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_410 for ONNX node: Sigmoid_410 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 859 for ONNX tensor: 859 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_410 [Sigmoid] outputs: [859 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_411 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 858 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 859 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_411 [Mul] inputs: [858 -> (1, 320, 15, 20)], [859 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_411 for ONNX node: Mul_411 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 860 for ONNX tensor: 860 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_411 [Mul] outputs: [860 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_412 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 856 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 860 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_412 [Concat] inputs: [856 -> (1, 320, 15, 20)], [860 -> (1, 320, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_412 for ONNX node: Concat_412 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 861 for ONNX tensor: 861 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_412 [Concat] outputs: [861 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_413 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 861 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_413 [Conv] inputs: [861 -> (1, 640, 15, 20)], [module_list.33.c3.cv3.conv.weight -> (640, 640, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 640, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_413 for ONNX node: Conv_413 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 640 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 640, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 862 for ONNX tensor: 862 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_413 [Conv] outputs: [862 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_414 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 862 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.33.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_414 [BatchNormalization] inputs: [862 -> (1, 640, 15, 20)], [module_list.33.c3.cv3.bn.weight -> (640)], [module_list.33.c3.cv3.bn.bias -> (640)], [module_list.33.c3.cv3.bn.running_mean -> (640)], [module_list.33.c3.cv3.bn.running_var -> (640)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_414 for ONNX node: BatchNormalization_414 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 863 for ONNX tensor: 863 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_414 [BatchNormalization] outputs: [863 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_415 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 863 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_415 [Sigmoid] inputs: [863 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_415 for ONNX node: Sigmoid_415 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 864 for ONNX tensor: 864 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_415 [Sigmoid] outputs: [864 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_416 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 863 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 864 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_416 [Mul] inputs: [863 -> (1, 640, 15, 20)], [864 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_416 for ONNX node: Mul_416 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 865 for ONNX tensor: 865 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_416 [Mul] outputs: [865 -> (1, 640, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_417 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 865 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.34.Conv2d.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.34.Conv2d.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_417 [Conv] inputs: [865 -> (1, 640, 15, 20)], [module_list.34.Conv2d.weight -> (3, 640, 1, 1)], [module_list.34.Conv2d.bias -> (3)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 640, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_417 for ONNX node: Conv_417 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 3 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 3, 15, 20) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 866 for ONNX tensor: 866 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_417 [Conv] outputs: [866 -> (1, 3, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_419 [Reshape] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 866 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 867 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Reshape_419 [Reshape] inputs: [866 -> (1, 3, 15, 20)], [867 -> (5)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Reshape_419 for ONNX node: Reshape_419 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 868 for ONNX tensor: 868 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Reshape_419 [Reshape] outputs: [868 -> (1, 3, 1, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose_420 [Transpose] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 868 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Transpose_420 [Transpose] inputs: [868 -> (1, 3, 1, 15, 20)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Transpose_420 for ONNX node: Transpose_420 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 869 for ONNX tensor: 869 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Transpose_420 [Transpose] outputs: [869 -> (1, 3, 15, 20, 1)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_422 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 869 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 870 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_422 [Mul] inputs: [869 -> (1, 3, 15, 20, 1)], [870 -> (1, 3, 1, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_422 for ONNX node: Mul_422 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 871 for ONNX tensor: 871 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_422 [Mul] outputs: [871 -> (1, 3, 15, 20, 1)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_424 [Reshape] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 871 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 872 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Reshape_424 [Reshape] inputs: [871 -> (1, 3, 15, 20, 1)], [872 -> (2)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Reshape_424 for ONNX node: Reshape_424 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 873 for ONNX tensor: 873 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Reshape_424 [Reshape] outputs: [873 -> (900, 1)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_425 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 710 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 632 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_425 [Concat] inputs: [710 -> (1, 160, 30, 40)], [632 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_425 for ONNX node: Concat_425 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 874 for ONNX tensor: 874 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_425 [Concat] outputs: [874 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_426 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 874 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_426 [Conv] inputs: [874 -> (1, 320, 30, 40)], [module_list.37.c3.cv1.conv.weight -> (160, 320, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_426 for ONNX node: Conv_426 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 875 for ONNX tensor: 875 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_426 [Conv] outputs: [875 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_427 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 875 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_427 [BatchNormalization] inputs: [875 -> (1, 160, 30, 40)], [module_list.37.c3.cv1.bn.weight -> (160)], [module_list.37.c3.cv1.bn.bias -> (160)], [module_list.37.c3.cv1.bn.running_mean -> (160)], [module_list.37.c3.cv1.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_427 for ONNX node: BatchNormalization_427 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 876 for ONNX tensor: 876 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_427 [BatchNormalization] outputs: [876 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_428 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 876 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_428 [Sigmoid] inputs: [876 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_428 for ONNX node: Sigmoid_428 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 877 for ONNX tensor: 877 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_428 [Sigmoid] outputs: [877 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_429 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 876 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 877 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_429 [Mul] inputs: [876 -> (1, 160, 30, 40)], [877 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_429 for ONNX node: Mul_429 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 878 for ONNX tensor: 878 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_429 [Mul] outputs: [878 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_430 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 878 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_430 [Conv] inputs: [878 -> (1, 160, 30, 40)], [module_list.37.c3.m.0.cv1.conv.weight -> (160, 160, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_430 for ONNX node: Conv_430 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 879 for ONNX tensor: 879 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_430 [Conv] outputs: [879 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_431 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 879 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_431 [BatchNormalization] inputs: [879 -> (1, 160, 30, 40)], [module_list.37.c3.m.0.cv1.bn.weight -> (160)], [module_list.37.c3.m.0.cv1.bn.bias -> (160)], [module_list.37.c3.m.0.cv1.bn.running_mean -> (160)], [module_list.37.c3.m.0.cv1.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_431 for ONNX node: BatchNormalization_431 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 880 for ONNX tensor: 880 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_431 [BatchNormalization] outputs: [880 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_432 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 880 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_432 [Sigmoid] inputs: [880 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_432 for ONNX node: Sigmoid_432 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 881 for ONNX tensor: 881 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_432 [Sigmoid] outputs: [881 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_433 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 880 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 881 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_433 [Mul] inputs: [880 -> (1, 160, 30, 40)], [881 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_433 for ONNX node: Mul_433 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 882 for ONNX tensor: 882 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_433 [Mul] outputs: [882 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_434 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 882 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_434 [Conv] inputs: [882 -> (1, 160, 30, 40)], [module_list.37.c3.m.0.cv2.conv.weight -> (160, 160, 3, 3)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_434 for ONNX node: Conv_434 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 883 for ONNX tensor: 883 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_434 [Conv] outputs: [883 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_435 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 883 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_435 [BatchNormalization] inputs: [883 -> (1, 160, 30, 40)], [module_list.37.c3.m.0.cv2.bn.weight -> (160)], [module_list.37.c3.m.0.cv2.bn.bias -> (160)], [module_list.37.c3.m.0.cv2.bn.running_mean -> (160)], [module_list.37.c3.m.0.cv2.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_435 for ONNX node: BatchNormalization_435 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 884 for ONNX tensor: 884 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_435 [BatchNormalization] outputs: [884 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_436 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 884 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_436 [Sigmoid] inputs: [884 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_436 for ONNX node: Sigmoid_436 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 885 for ONNX tensor: 885 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_436 [Sigmoid] outputs: [885 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_437 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 884 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 885 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_437 [Mul] inputs: [884 -> (1, 160, 30, 40)], [885 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_437 for ONNX node: Mul_437 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 886 for ONNX tensor: 886 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_437 [Mul] outputs: [886 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_438 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 874 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_438 [Conv] inputs: [874 -> (1, 320, 30, 40)], [module_list.37.c3.cv2.conv.weight -> (160, 320, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_438 for ONNX node: Conv_438 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 887 for ONNX tensor: 887 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_438 [Conv] outputs: [887 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_439 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 887 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_439 [BatchNormalization] inputs: [887 -> (1, 160, 30, 40)], [module_list.37.c3.cv2.bn.weight -> (160)], [module_list.37.c3.cv2.bn.bias -> (160)], [module_list.37.c3.cv2.bn.running_mean -> (160)], [module_list.37.c3.cv2.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_439 for ONNX node: BatchNormalization_439 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 888 for ONNX tensor: 888 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_439 [BatchNormalization] outputs: [888 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_440 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 888 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_440 [Sigmoid] inputs: [888 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_440 for ONNX node: Sigmoid_440 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 889 for ONNX tensor: 889 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_440 [Sigmoid] outputs: [889 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_441 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 888 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 889 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_441 [Mul] inputs: [888 -> (1, 160, 30, 40)], [889 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_441 for ONNX node: Mul_441 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 890 for ONNX tensor: 890 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_441 [Mul] outputs: [890 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_442 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 886 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 890 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_442 [Concat] inputs: [886 -> (1, 160, 30, 40)], [890 -> (1, 160, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_442 for ONNX node: Concat_442 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 891 for ONNX tensor: 891 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_442 [Concat] outputs: [891 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_443 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 891 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_443 [Conv] inputs: [891 -> (1, 320, 30, 40)], [module_list.37.c3.cv3.conv.weight -> (320, 320, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_443 for ONNX node: Conv_443 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 320 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 320, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 892 for ONNX tensor: 892 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_443 [Conv] outputs: [892 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_444 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 892 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.37.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_444 [BatchNormalization] inputs: [892 -> (1, 320, 30, 40)], [module_list.37.c3.cv3.bn.weight -> (320)], [module_list.37.c3.cv3.bn.bias -> (320)], [module_list.37.c3.cv3.bn.running_mean -> (320)], [module_list.37.c3.cv3.bn.running_var -> (320)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_444 for ONNX node: BatchNormalization_444 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 893 for ONNX tensor: 893 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_444 [BatchNormalization] outputs: [893 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_445 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 893 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_445 [Sigmoid] inputs: [893 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_445 for ONNX node: Sigmoid_445 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 894 for ONNX tensor: 894 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_445 [Sigmoid] outputs: [894 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_446 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 893 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 894 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_446 [Mul] inputs: [893 -> (1, 320, 30, 40)], [894 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_446 for ONNX node: Mul_446 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 895 for ONNX tensor: 895 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_446 [Mul] outputs: [895 -> (1, 320, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_447 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 895 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.38.Conv2d.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.38.Conv2d.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_447 [Conv] inputs: [895 -> (1, 320, 30, 40)], [module_list.38.Conv2d.weight -> (3, 320, 1, 1)], [module_list.38.Conv2d.bias -> (3)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_447 for ONNX node: Conv_447 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 3 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 3, 30, 40) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 896 for ONNX tensor: 896 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_447 [Conv] outputs: [896 -> (1, 3, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_449 [Reshape] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 896 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 897 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Reshape_449 [Reshape] inputs: [896 -> (1, 3, 30, 40)], [897 -> (5)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Reshape_449 for ONNX node: Reshape_449 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 898 for ONNX tensor: 898 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Reshape_449 [Reshape] outputs: [898 -> (1, 3, 1, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose_450 [Transpose] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 898 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Transpose_450 [Transpose] inputs: [898 -> (1, 3, 1, 30, 40)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Transpose_450 for ONNX node: Transpose_450 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 899 for ONNX tensor: 899 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Transpose_450 [Transpose] outputs: [899 -> (1, 3, 30, 40, 1)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_452 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 899 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 900 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_452 [Mul] inputs: [899 -> (1, 3, 30, 40, 1)], [900 -> (1, 3, 1, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_452 for ONNX node: Mul_452 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 901 for ONNX tensor: 901 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_452 [Mul] outputs: [901 -> (1, 3, 30, 40, 1)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_454 [Reshape] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 901 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 902 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Reshape_454 [Reshape] inputs: [901 -> (1, 3, 30, 40, 1)], [902 -> (2)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Reshape_454 for ONNX node: Reshape_454 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 903 for ONNX tensor: 903 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Reshape_454 [Reshape] outputs: [903 -> (3600, 1)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_455 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 642 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 515 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_455 [Concat] inputs: [642 -> (1, 160, 60, 80)], [515 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_455 for ONNX node: Concat_455 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 904 for ONNX tensor: 904 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_455 [Concat] outputs: [904 -> (1, 320, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_456 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 904 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_456 [Conv] inputs: [904 -> (1, 320, 60, 80)], [module_list.41.c3.cv1.conv.weight -> (80, 320, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_456 for ONNX node: Conv_456 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 80 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 905 for ONNX tensor: 905 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_456 [Conv] outputs: [905 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_457 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 905 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_457 [BatchNormalization] inputs: [905 -> (1, 80, 60, 80)], [module_list.41.c3.cv1.bn.weight -> (80)], [module_list.41.c3.cv1.bn.bias -> (80)], [module_list.41.c3.cv1.bn.running_mean -> (80)], [module_list.41.c3.cv1.bn.running_var -> (80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_457 for ONNX node: BatchNormalization_457 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 906 for ONNX tensor: 906 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_457 [BatchNormalization] outputs: [906 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_458 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 906 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_458 [Sigmoid] inputs: [906 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_458 for ONNX node: Sigmoid_458 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 907 for ONNX tensor: 907 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_458 [Sigmoid] outputs: [907 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_459 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 906 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 907 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_459 [Mul] inputs: [906 -> (1, 80, 60, 80)], [907 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_459 for ONNX node: Mul_459 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 908 for ONNX tensor: 908 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_459 [Mul] outputs: [908 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_460 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 908 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.m.0.cv1.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_460 [Conv] inputs: [908 -> (1, 80, 60, 80)], [module_list.41.c3.m.0.cv1.conv.weight -> (80, 80, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_460 for ONNX node: Conv_460 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 80 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 909 for ONNX tensor: 909 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_460 [Conv] outputs: [909 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_461 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 909 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.m.0.cv1.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.m.0.cv1.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.m.0.cv1.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.m.0.cv1.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_461 [BatchNormalization] inputs: [909 -> (1, 80, 60, 80)], [module_list.41.c3.m.0.cv1.bn.weight -> (80)], [module_list.41.c3.m.0.cv1.bn.bias -> (80)], [module_list.41.c3.m.0.cv1.bn.running_mean -> (80)], [module_list.41.c3.m.0.cv1.bn.running_var -> (80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_461 for ONNX node: BatchNormalization_461 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 910 for ONNX tensor: 910 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_461 [BatchNormalization] outputs: [910 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_462 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 910 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_462 [Sigmoid] inputs: [910 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_462 for ONNX node: Sigmoid_462 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 911 for ONNX tensor: 911 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_462 [Sigmoid] outputs: [911 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_463 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 910 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 911 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_463 [Mul] inputs: [910 -> (1, 80, 60, 80)], [911 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_463 for ONNX node: Mul_463 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 912 for ONNX tensor: 912 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_463 [Mul] outputs: [912 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_464 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 912 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.m.0.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_464 [Conv] inputs: [912 -> (1, 80, 60, 80)], [module_list.41.c3.m.0.cv2.conv.weight -> (80, 80, 3, 3)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_464 for ONNX node: Conv_464 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 80 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 913 for ONNX tensor: 913 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_464 [Conv] outputs: [913 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_465 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 913 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.m.0.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.m.0.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.m.0.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.m.0.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_465 [BatchNormalization] inputs: [913 -> (1, 80, 60, 80)], [module_list.41.c3.m.0.cv2.bn.weight -> (80)], [module_list.41.c3.m.0.cv2.bn.bias -> (80)], [module_list.41.c3.m.0.cv2.bn.running_mean -> (80)], [module_list.41.c3.m.0.cv2.bn.running_var -> (80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_465 for ONNX node: BatchNormalization_465 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 914 for ONNX tensor: 914 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_465 [BatchNormalization] outputs: [914 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_466 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 914 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_466 [Sigmoid] inputs: [914 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_466 for ONNX node: Sigmoid_466 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 915 for ONNX tensor: 915 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_466 [Sigmoid] outputs: [915 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_467 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 914 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 915 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_467 [Mul] inputs: [914 -> (1, 80, 60, 80)], [915 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_467 for ONNX node: Mul_467 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 916 for ONNX tensor: 916 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_467 [Mul] outputs: [916 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_468 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 904 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.cv2.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_468 [Conv] inputs: [904 -> (1, 320, 60, 80)], [module_list.41.c3.cv2.conv.weight -> (80, 320, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_468 for ONNX node: Conv_468 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 80 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 80, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 917 for ONNX tensor: 917 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_468 [Conv] outputs: [917 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_469 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 917 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.cv2.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.cv2.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.cv2.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.cv2.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_469 [BatchNormalization] inputs: [917 -> (1, 80, 60, 80)], [module_list.41.c3.cv2.bn.weight -> (80)], [module_list.41.c3.cv2.bn.bias -> (80)], [module_list.41.c3.cv2.bn.running_mean -> (80)], [module_list.41.c3.cv2.bn.running_var -> (80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_469 for ONNX node: BatchNormalization_469 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 918 for ONNX tensor: 918 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_469 [BatchNormalization] outputs: [918 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_470 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 918 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_470 [Sigmoid] inputs: [918 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_470 for ONNX node: Sigmoid_470 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 919 for ONNX tensor: 919 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_470 [Sigmoid] outputs: [919 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_471 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 918 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 919 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_471 [Mul] inputs: [918 -> (1, 80, 60, 80)], [919 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_471 for ONNX node: Mul_471 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 920 for ONNX tensor: 920 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_471 [Mul] outputs: [920 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_472 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 916 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 920 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_472 [Concat] inputs: [916 -> (1, 80, 60, 80)], [920 -> (1, 80, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_472 for ONNX node: Concat_472 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 921 for ONNX tensor: 921 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_472 [Concat] outputs: [921 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_473 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 921 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.cv3.conv.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_473 [Conv] inputs: [921 -> (1, 160, 60, 80)], [module_list.41.c3.cv3.conv.weight -> (160, 160, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 160, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_473 for ONNX node: Conv_473 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 160, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 922 for ONNX tensor: 922 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_473 [Conv] outputs: [922 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: BatchNormalization_474 [BatchNormalization] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 922 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.cv3.bn.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.cv3.bn.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.cv3.bn.running_mean [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.41.c3.cv3.bn.running_var [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: BatchNormalization_474 [BatchNormalization] inputs: [922 -> (1, 160, 60, 80)], [module_list.41.c3.cv3.bn.weight -> (160)], [module_list.41.c3.cv3.bn.bias -> (160)], [module_list.41.c3.cv3.bn.running_mean -> (160)], [module_list.41.c3.cv3.bn.running_var -> (160)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: BatchNormalization_474 for ONNX node: BatchNormalization_474 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 923 for ONNX tensor: 923 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: BatchNormalization_474 [BatchNormalization] outputs: [923 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_475 [Sigmoid] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 923 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Sigmoid_475 [Sigmoid] inputs: [923 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Sigmoid_475 for ONNX node: Sigmoid_475 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 924 for ONNX tensor: 924 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Sigmoid_475 [Sigmoid] outputs: [924 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_476 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 923 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 924 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_476 [Mul] inputs: [923 -> (1, 160, 60, 80)], [924 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_476 for ONNX node: Mul_476 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 925 for ONNX tensor: 925 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_476 [Mul] outputs: [925 -> (1, 160, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_477 [Conv] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 925 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.42.Conv2d.weight [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: module_list.42.Conv2d.bias [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Conv_477 [Conv] inputs: [925 -> (1, 160, 60, 80)], [module_list.42.Conv2d.weight -> (3, 160, 1, 1)], [module_list.42.Conv2d.bias -> (3)], [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 160, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_477 for ONNX node: Conv_477 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 3 [03/13/2022-08:27:49] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 3, 60, 80) [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 926 for ONNX tensor: 926 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Conv_477 [Conv] outputs: [926 -> (1, 3, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_479 [Reshape] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 926 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 927 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Reshape_479 [Reshape] inputs: [926 -> (1, 3, 60, 80)], [927 -> (5)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Reshape_479 for ONNX node: Reshape_479 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 928 for ONNX tensor: 928 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Reshape_479 [Reshape] outputs: [928 -> (1, 3, 1, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose_480 [Transpose] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 928 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Transpose_480 [Transpose] inputs: [928 -> (1, 3, 1, 60, 80)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Transpose_480 for ONNX node: Transpose_480 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 929 for ONNX tensor: 929 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Transpose_480 [Transpose] outputs: [929 -> (1, 3, 60, 80, 1)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_482 [Mul] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 929 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 930 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Mul_482 [Mul] inputs: [929 -> (1, 3, 60, 80, 1)], [930 -> (1, 3, 1, 1, 1)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Mul_482 for ONNX node: Mul_482 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 931 for ONNX tensor: 931 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Mul_482 [Mul] outputs: [931 -> (1, 3, 60, 80, 1)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_484 [Reshape] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 931 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 932 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Reshape_484 [Reshape] inputs: [931 -> (1, 3, 60, 80, 1)], [932 -> (2)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Reshape_484 for ONNX node: Reshape_484 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 933 for ONNX tensor: 933 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Reshape_484 [Reshape] outputs: [933 -> (14400, 1)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_485 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 705 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 773 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 841 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_485 [Concat] inputs: [705 -> (14400, 6)], [773 -> (3600, 6)], [841 -> (900, 6)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_485 for ONNX node: Concat_485 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: classes_1 for ONNX tensor: classes [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_485 [Concat] outputs: [classes -> (18900, 6)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_486 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 707 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 775 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 843 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_486 [Concat] inputs: [707 -> (14400, 2)], [775 -> (3600, 2)], [843 -> (900, 2)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_486 for ONNX node: Concat_486 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 935 for ONNX tensor: 935 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_486 [Concat] outputs: [935 -> (18900, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_487 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 694 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 762 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 830 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_487 [Concat] inputs: [694 -> (14400, 2)], [762 -> (3600, 2)], [830 -> (900, 2)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_487 for ONNX node: Concat_487 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 936 for ONNX tensor: 936 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_487 [Concat] outputs: [936 -> (18900, 2)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_488 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 933 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 903 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 873 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_488 [Concat] inputs: [933 -> (14400, 1)], [903 -> (3600, 1)], [873 -> (900, 1)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_488 for ONNX node: Concat_488 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: ranges_1 for ONNX tensor: ranges [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_488 [Concat] outputs: [ranges -> (18900, 1)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_489 [Concat] [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 935 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:119: Searching for input: 936 [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:125: Concat_489 [Concat] inputs: [935 -> (18900, 2)], [936 -> (18900, 2)], [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat_489 for ONNX node: Concat_489 [03/13/2022-08:27:49] [V] [TRT] ImporterContext.hpp:116: Registering tensor: boxes_1 for ONNX tensor: boxes [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:179: Concat_489 [Concat] outputs: [boxes -> (18900, 4)], [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:507: Marking classes_1 as output: classes [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:507: Marking boxes_1 as output: boxes [03/13/2022-08:27:49] [V] [TRT] ModelImporter.cpp:507: Marking ranges_1 as output: ranges ----- Parsing of ONNX model /path/to/model.onnx is Done ---- [03/13/2022-08:27:49] [V] [TRT] Applying generic optimizations to the graph for inference. [03/13/2022-08:27:49] [V] [TRT] Original: 443 layers [03/13/2022-08:27:49] [V] [TRT] After dead-layer removal: 443 layers [03/13/2022-08:27:49] [V] [TRT] Fusing Reshape_224 with Transpose_225 [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 226) [Constant] with (Unnamed Layer* 227) [Shuffle] [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 229) [Constant] with (Unnamed Layer* 230) [Shuffle] [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 235) [Constant] with (Unnamed Layer* 236) [Shuffle] [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 238) [Constant] with (Unnamed Layer* 239) [Shuffle] [03/13/2022-08:27:49] [V] [TRT] Fusing Reshape_290 with Transpose_291 [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 279) [Constant] with (Unnamed Layer* 280) [Shuffle] [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 282) [Constant] with (Unnamed Layer* 283) [Shuffle] [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 288) [Constant] with (Unnamed Layer* 289) [Shuffle] [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 291) [Constant] with (Unnamed Layer* 292) [Shuffle] [03/13/2022-08:27:49] [V] [TRT] Fusing Reshape_356 with Transpose_357 [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 332) [Constant] with (Unnamed Layer* 333) [Shuffle] [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 335) [Constant] with (Unnamed Layer* 336) [Shuffle] [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 341) [Constant] with (Unnamed Layer* 342) [Shuffle] [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 344) [Constant] with (Unnamed Layer* 345) [Shuffle] [03/13/2022-08:27:49] [V] [TRT] Fusing Reshape_419 with Transpose_420 [03/13/2022-08:27:49] [V] [TRT] Fusing Reshape_449 with Transpose_450 [03/13/2022-08:27:49] [V] [TRT] Fusing Reshape_479 with Transpose_480 [03/13/2022-08:27:49] [V] [TRT] After Myelin optimization: 425 layers [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_17 with scale BatchNormalization_18 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_37 with scale BatchNormalization_38 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_24 with scale BatchNormalization_25 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_28 with scale BatchNormalization_29 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_32 with scale BatchNormalization_33 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_42 with scale BatchNormalization_43 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_80 with scale BatchNormalization_81 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_49 with scale BatchNormalization_50 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_53 with scale BatchNormalization_54 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_57 with scale BatchNormalization_58 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_62 with scale BatchNormalization_63 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_66 with scale BatchNormalization_67 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_71 with scale BatchNormalization_72 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_75 with scale BatchNormalization_76 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_85 with scale BatchNormalization_86 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_123 with scale BatchNormalization_124 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_92 with scale BatchNormalization_93 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_96 with scale BatchNormalization_97 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_100 with scale BatchNormalization_101 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_105 with scale BatchNormalization_106 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_109 with scale BatchNormalization_110 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_114 with scale BatchNormalization_115 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_118 with scale BatchNormalization_119 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_128 with scale BatchNormalization_129 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_135 with scale BatchNormalization_136 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_143 with scale BatchNormalization_144 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_159 with scale BatchNormalization_160 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_147 with scale BatchNormalization_148 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_151 with scale BatchNormalization_152 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_155 with scale BatchNormalization_156 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_164 with scale BatchNormalization_165 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_186 with scale BatchNormalization_187 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_174 with scale BatchNormalization_175 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_178 with scale BatchNormalization_179 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_182 with scale BatchNormalization_183 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_191 with scale BatchNormalization_192 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_468 with scale BatchNormalization_469 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_456 with scale BatchNormalization_457 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_213 with scale BatchNormalization_214 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_201 with scale BatchNormalization_202 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_205 with scale BatchNormalization_206 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_460 with scale BatchNormalization_461 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_464 with scale BatchNormalization_465 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_209 with scale BatchNormalization_210 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_218 with scale BatchNormalization_219 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_473 with scale BatchNormalization_474 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_438 with scale BatchNormalization_439 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_426 with scale BatchNormalization_427 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_279 with scale BatchNormalization_280 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_267 with scale BatchNormalization_268 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_271 with scale BatchNormalization_272 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_430 with scale BatchNormalization_431 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_434 with scale BatchNormalization_435 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_275 with scale BatchNormalization_276 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_284 with scale BatchNormalization_285 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_443 with scale BatchNormalization_444 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_408 with scale BatchNormalization_409 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_396 with scale BatchNormalization_397 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_345 with scale BatchNormalization_346 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_333 with scale BatchNormalization_334 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_337 with scale BatchNormalization_338 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_400 with scale BatchNormalization_401 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_404 with scale BatchNormalization_405 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_341 with scale BatchNormalization_342 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_350 with scale BatchNormalization_351 [03/13/2022-08:27:49] [V] [TRT] Fusing convolution weights from Conv_413 with scale BatchNormalization_414 [03/13/2022-08:27:49] [V] [TRT] After scale fusion: 359 layers [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_19 with Mul_20 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_22 with Mul_23 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_26 with Mul_27 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_30 with Mul_31 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_34 with Mul_35 [03/13/2022-08:27:49] [V] [TRT] Fusing PWN(Sigmoid_34, Mul_35) with Add_36 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_39 with Mul_40 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_44 with Mul_45 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_47 with Mul_48 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_51 with Mul_52 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_55 with Mul_56 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_59 with Mul_60 [03/13/2022-08:27:49] [V] [TRT] Fusing PWN(Sigmoid_59, Mul_60) with Add_61 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_64 with Mul_65 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_68 with Mul_69 [03/13/2022-08:27:49] [V] [TRT] Fusing PWN(Sigmoid_68, Mul_69) with Add_70 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_73 with Mul_74 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_77 with Mul_78 [03/13/2022-08:27:49] [V] [TRT] Fusing PWN(Sigmoid_77, Mul_78) with Add_79 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_82 with Mul_83 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_87 with Mul_88 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_90 with Mul_91 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_94 with Mul_95 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_98 with Mul_99 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_102 with Mul_103 [03/13/2022-08:27:49] [V] [TRT] Fusing PWN(Sigmoid_102, Mul_103) with Add_104 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_107 with Mul_108 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_111 with Mul_112 [03/13/2022-08:27:49] [V] [TRT] Fusing PWN(Sigmoid_111, Mul_112) with Add_113 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_116 with Mul_117 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_120 with Mul_121 [03/13/2022-08:27:49] [V] [TRT] Fusing PWN(Sigmoid_120, Mul_121) with Add_122 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_125 with Mul_126 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_130 with Mul_131 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_133 with Mul_134 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_137 with Mul_138 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_145 with Mul_146 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_149 with Mul_150 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_153 with Mul_154 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_157 with Mul_158 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_161 with Mul_162 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_166 with Mul_167 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_169 with Mul_170 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_176 with Mul_177 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_180 with Mul_181 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_184 with Mul_185 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_188 with Mul_189 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_193 with Mul_194 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_196 with Mul_197 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_458 with Mul_459 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_203 with Mul_204 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_207 with Mul_208 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_462 with Mul_463 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_466 with Mul_467 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_470 with Mul_471 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_211 with Mul_212 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_215 with Mul_216 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_220 with Mul_221 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_475 with Mul_476 [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 226) [Constant] + (Unnamed Layer* 227) [Shuffle] with Mul_235 [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 235) [Constant] + (Unnamed Layer* 236) [Shuffle] with Mul_246 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_264 with Mul_265 [03/13/2022-08:27:49] [V] [TRT] Fusing PWN((Unnamed Layer* 235) [Constant] + (Unnamed Layer* 236) [Shuffle], Mul_246) with Pow_247 [03/13/2022-08:27:49] [V] [TRT] Fusing PWN((Unnamed Layer* 226) [Constant] + (Unnamed Layer* 227) [Shuffle], Mul_235) with Sub_237 [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 229) [Constant] + (Unnamed Layer* 230) [Shuffle] with PWN(PWN((Unnamed Layer* 226) [Constant] + (Unnamed Layer* 227) [Shuffle], Mul_235), Sub_237) [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 238) [Constant] + (Unnamed Layer* 239) [Shuffle] with PWN(PWN((Unnamed Layer* 235) [Constant] + (Unnamed Layer* 236) [Shuffle], Mul_246), Pow_247) [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_428 with Mul_429 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_269 with Mul_270 [03/13/2022-08:27:49] [V] [TRT] Fusing PWN((Unnamed Layer* 238) [Constant] + (Unnamed Layer* 239) [Shuffle], PWN(PWN((Unnamed Layer* 235) [Constant] + (Unnamed Layer* 236) [Shuffle], Mul_246), Pow_247)) with Mul_249 [03/13/2022-08:27:49] [V] [TRT] Fusing PWN((Unnamed Layer* 229) [Constant] + (Unnamed Layer* 230) [Shuffle], PWN(PWN((Unnamed Layer* 226) [Constant] + (Unnamed Layer* 227) [Shuffle], Mul_235), Sub_237)) with Add_239 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_273 with Mul_274 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_432 with Mul_433 [03/13/2022-08:27:49] [V] [TRT] Fusing PWN(PWN((Unnamed Layer* 229) [Constant] + (Unnamed Layer* 230) [Shuffle], PWN(PWN((Unnamed Layer* 226) [Constant] + (Unnamed Layer* 227) [Shuffle], Mul_235), Sub_237)), Add_239) with Mul_262 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_436 with Mul_437 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_440 with Mul_441 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_277 with Mul_278 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_281 with Mul_282 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_286 with Mul_287 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_445 with Mul_446 [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 279) [Constant] + (Unnamed Layer* 280) [Shuffle] with Mul_301 [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 288) [Constant] + (Unnamed Layer* 289) [Shuffle] with Mul_312 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_330 with Mul_331 [03/13/2022-08:27:49] [V] [TRT] Fusing PWN((Unnamed Layer* 288) [Constant] + (Unnamed Layer* 289) [Shuffle], Mul_312) with Pow_313 [03/13/2022-08:27:49] [V] [TRT] Fusing PWN((Unnamed Layer* 279) [Constant] + (Unnamed Layer* 280) [Shuffle], Mul_301) with Sub_303 [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 282) [Constant] + (Unnamed Layer* 283) [Shuffle] with PWN(PWN((Unnamed Layer* 279) [Constant] + (Unnamed Layer* 280) [Shuffle], Mul_301), Sub_303) [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 291) [Constant] + (Unnamed Layer* 292) [Shuffle] with PWN(PWN((Unnamed Layer* 288) [Constant] + (Unnamed Layer* 289) [Shuffle], Mul_312), Pow_313) [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_398 with Mul_399 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_335 with Mul_336 [03/13/2022-08:27:49] [V] [TRT] Fusing PWN((Unnamed Layer* 291) [Constant] + (Unnamed Layer* 292) [Shuffle], PWN(PWN((Unnamed Layer* 288) [Constant] + (Unnamed Layer* 289) [Shuffle], Mul_312), Pow_313)) with Mul_315 [03/13/2022-08:27:49] [V] [TRT] Fusing PWN((Unnamed Layer* 282) [Constant] + (Unnamed Layer* 283) [Shuffle], PWN(PWN((Unnamed Layer* 279) [Constant] + (Unnamed Layer* 280) [Shuffle], Mul_301), Sub_303)) with Add_305 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_339 with Mul_340 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_402 with Mul_403 [03/13/2022-08:27:49] [V] [TRT] Fusing PWN(PWN((Unnamed Layer* 282) [Constant] + (Unnamed Layer* 283) [Shuffle], PWN(PWN((Unnamed Layer* 279) [Constant] + (Unnamed Layer* 280) [Shuffle], Mul_301), Sub_303)), Add_305) with Mul_328 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_406 with Mul_407 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_410 with Mul_411 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_343 with Mul_344 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_347 with Mul_348 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_352 with Mul_353 [03/13/2022-08:27:49] [V] [TRT] Fusing Sigmoid_415 with Mul_416 [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 332) [Constant] + (Unnamed Layer* 333) [Shuffle] with Mul_367 [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 341) [Constant] + (Unnamed Layer* 342) [Shuffle] with Mul_378 [03/13/2022-08:27:49] [V] [TRT] Fusing PWN((Unnamed Layer* 341) [Constant] + (Unnamed Layer* 342) [Shuffle], Mul_378) with Pow_379 [03/13/2022-08:27:49] [V] [TRT] Fusing PWN((Unnamed Layer* 332) [Constant] + (Unnamed Layer* 333) [Shuffle], Mul_367) with Sub_369 [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 335) [Constant] + (Unnamed Layer* 336) [Shuffle] with PWN(PWN((Unnamed Layer* 332) [Constant] + (Unnamed Layer* 333) [Shuffle], Mul_367), Sub_369) [03/13/2022-08:27:49] [V] [TRT] Fusing (Unnamed Layer* 344) [Constant] + (Unnamed Layer* 345) [Shuffle] with PWN(PWN((Unnamed Layer* 341) [Constant] + (Unnamed Layer* 342) [Shuffle], Mul_378), Pow_379) [03/13/2022-08:27:49] [V] [TRT] Fusing PWN((Unnamed Layer* 344) [Constant] + (Unnamed Layer* 345) [Shuffle], PWN(PWN((Unnamed Layer* 341) [Constant] + (Unnamed Layer* 342) [Shuffle], Mul_378), Pow_379)) with Mul_381 [03/13/2022-08:27:49] [V] [TRT] Fusing PWN((Unnamed Layer* 335) [Constant] + (Unnamed Layer* 336) [Shuffle], PWN(PWN((Unnamed Layer* 332) [Constant] + (Unnamed Layer* 333) [Shuffle], Mul_367), Sub_369)) with Add_371 [03/13/2022-08:27:49] [V] [TRT] Fusing PWN(PWN((Unnamed Layer* 335) [Constant] + (Unnamed Layer* 336) [Shuffle], PWN(PWN((Unnamed Layer* 332) [Constant] + (Unnamed Layer* 333) [Shuffle], Mul_367), Sub_369)), Add_371) with Mul_394 [03/13/2022-08:27:49] [V] [TRT] After vertical fusions: 251 layers [03/13/2022-08:27:49] [V] [TRT] After final dead-layer removal: 251 layers [03/13/2022-08:27:49] [V] [TRT] Merging layers: Conv_37 || Conv_24 [03/13/2022-08:27:49] [V] [TRT] Merging layers: Conv_80 || Conv_49 [03/13/2022-08:27:49] [V] [TRT] Merging layers: Conv_123 || Conv_92 [03/13/2022-08:27:49] [V] [TRT] Merging layers: Conv_159 || Conv_147 [03/13/2022-08:27:49] [V] [TRT] Merging layers: Conv_186 || Conv_174 [03/13/2022-08:27:49] [V] [TRT] Merging layers: Conv_468 || Conv_456 [03/13/2022-08:27:49] [V] [TRT] Merging layers: Conv_213 || Conv_201 [03/13/2022-08:27:49] [V] [TRT] Merging layers: Conv_438 || Conv_426 [03/13/2022-08:27:49] [V] [TRT] Merging layers: Conv_279 || Conv_267 [03/13/2022-08:27:49] [V] [TRT] Merging layers: Conv_408 || Conv_396 [03/13/2022-08:27:49] [V] [TRT] Merging layers: Conv_345 || Conv_333 [03/13/2022-08:27:49] [V] [TRT] After tensor merging: 240 layers [03/13/2022-08:27:49] [V] [TRT] Replacing slice Slice_259 with copy from 671 to 704 [03/13/2022-08:27:49] [V] [TRT] Replacing slice Slice_254 with copy from 671 to 699 [03/13/2022-08:27:49] [V] [TRT] Replacing slice Slice_244 with copy from 671 to 687 [03/13/2022-08:27:49] [V] [TRT] Replacing slice Slice_233 with copy from 671 to 676 [03/13/2022-08:27:49] [V] [TRT] Replacing slice Slice_325 with copy from 739 to 772 [03/13/2022-08:27:49] [V] [TRT] Replacing slice Slice_320 with copy from 739 to 767 [03/13/2022-08:27:49] [V] [TRT] Replacing slice Slice_310 with copy from 739 to 755 [03/13/2022-08:27:49] [V] [TRT] Replacing slice Slice_299 with copy from 739 to 744 [03/13/2022-08:27:49] [V] [TRT] Replacing slice Slice_391 with copy from 807 to 840 [03/13/2022-08:27:49] [V] [TRT] Replacing slice Slice_386 with copy from 807 to 835 [03/13/2022-08:27:49] [V] [TRT] Replacing slice Slice_376 with copy from 807 to 823 [03/13/2022-08:27:49] [V] [TRT] Replacing slice Slice_365 with copy from 807 to 812 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_16 [03/13/2022-08:27:49] [V] [TRT] Retargeting 430 to 443 [03/13/2022-08:27:49] [V] [TRT] Retargeting 434 to 443 [03/13/2022-08:27:49] [V] [TRT] Retargeting 438 to 443 [03/13/2022-08:27:49] [V] [TRT] Retargeting 442 to 443 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_41 [03/13/2022-08:27:49] [V] [TRT] Retargeting 463 to 468 [03/13/2022-08:27:49] [V] [TRT] Retargeting 467 to 468 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_84 [03/13/2022-08:27:49] [V] [TRT] Retargeting 506 to 511 [03/13/2022-08:27:49] [V] [TRT] Retargeting 510 to 511 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_127 [03/13/2022-08:27:49] [V] [TRT] Retargeting 549 to 554 [03/13/2022-08:27:49] [V] [TRT] Retargeting 553 to 554 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_142 [03/13/2022-08:27:49] [V] [TRT] Generating copy for 565 to 569 [03/13/2022-08:27:49] [V] [TRT] Retargeting 566 to 569 [03/13/2022-08:27:49] [V] [TRT] Retargeting 567 to 569 [03/13/2022-08:27:49] [V] [TRT] Retargeting 568 to 569 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_163 [03/13/2022-08:27:49] [V] [TRT] Retargeting 585 to 590 [03/13/2022-08:27:49] [V] [TRT] Retargeting 589 to 590 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_173 [03/13/2022-08:27:49] [V] [TRT] Generating copy for 607 to 608 [03/13/2022-08:27:49] [V] [TRT] Retargeting 558 to 608 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_190 [03/13/2022-08:27:49] [V] [TRT] Retargeting 620 to 625 [03/13/2022-08:27:49] [V] [TRT] Retargeting 624 to 625 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_200 [03/13/2022-08:27:49] [V] [TRT] Generating copy for 642 to 643 [03/13/2022-08:27:49] [V] [TRT] Retargeting 515 to 643 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_455 [03/13/2022-08:27:49] [V] [TRT] Generating copy for 642 to 904 [03/13/2022-08:27:49] [V] [TRT] Generating copy for 643 to 904 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_472 [03/13/2022-08:27:49] [V] [TRT] Retargeting 916 to 921 [03/13/2022-08:27:49] [V] [TRT] Retargeting 920 to 921 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_217 [03/13/2022-08:27:49] [V] [TRT] Retargeting 655 to 660 [03/13/2022-08:27:49] [V] [TRT] Retargeting 659 to 660 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_266 [03/13/2022-08:27:49] [V] [TRT] Retargeting 710 to 711 [03/13/2022-08:27:49] [V] [TRT] Generating copy for 632 to 711 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_425 [03/13/2022-08:27:49] [V] [TRT] Generating copy for 711 to 874 [03/13/2022-08:27:49] [V] [TRT] Generating copy for 632 to 874 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_442 [03/13/2022-08:27:49] [V] [TRT] Retargeting 886 to 891 [03/13/2022-08:27:49] [V] [TRT] Retargeting 890 to 891 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_283 [03/13/2022-08:27:49] [V] [TRT] Retargeting 723 to 728 [03/13/2022-08:27:49] [V] [TRT] Retargeting 727 to 728 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_332 [03/13/2022-08:27:49] [V] [TRT] Retargeting 778 to 779 [03/13/2022-08:27:49] [V] [TRT] Generating copy for 597 to 779 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_395 [03/13/2022-08:27:49] [V] [TRT] Generating copy for 779 to 844 [03/13/2022-08:27:49] [V] [TRT] Generating copy for 597 to 844 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_412 [03/13/2022-08:27:49] [V] [TRT] Retargeting 856 to 861 [03/13/2022-08:27:49] [V] [TRT] Retargeting 860 to 861 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_349 [03/13/2022-08:27:49] [V] [TRT] Retargeting 791 to 796 [03/13/2022-08:27:49] [V] [TRT] Retargeting 795 to 796 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_485 [03/13/2022-08:27:49] [V] [TRT] Generating copy for 705 to classes [03/13/2022-08:27:49] [V] [TRT] Generating copy for 773 to classes [03/13/2022-08:27:49] [V] [TRT] Generating copy for 841 to classes [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_488 [03/13/2022-08:27:49] [V] [TRT] Generating copy for 933 to ranges [03/13/2022-08:27:49] [V] [TRT] Generating copy for 903 to ranges [03/13/2022-08:27:49] [V] [TRT] Generating copy for 873 to ranges [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_487 [03/13/2022-08:27:49] [V] [TRT] Generating copy for 694 to 936 [03/13/2022-08:27:49] [V] [TRT] Generating copy for 762 to 936 [03/13/2022-08:27:49] [V] [TRT] Generating copy for 830 to 936 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_486 [03/13/2022-08:27:49] [V] [TRT] Generating copy for 707 to 935 [03/13/2022-08:27:49] [V] [TRT] Generating copy for 775 to 935 [03/13/2022-08:27:49] [V] [TRT] Generating copy for 843 to 935 [03/13/2022-08:27:49] [V] [TRT] Eliminating concatenation Concat_489 [03/13/2022-08:27:49] [V] [TRT] Generating copy for 935 to boxes [03/13/2022-08:27:49] [V] [TRT] Generating copy for 936 to boxes [03/13/2022-08:27:49] [V] [TRT] After concat removal: 240 layers [03/13/2022-08:27:49] [V] [TRT] Graph construction and optimization completed in 0.160838 seconds. [03/13/2022-08:27:56] [V] [TRT] Constructing optimization profile number 0 [1/1]. [03/13/2022-08:27:56] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 935 [03/13/2022-08:27:56] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 936 [03/13/2022-08:27:56] [V] [TRT] *************** Autotuning format combination: -> Int32(1) *************** [03/13/2022-08:27:56] [V] [TRT] *************** Autotuning format combination: -> Int32(1) *************** [03/13/2022-08:27:56] [V] [TRT] *************** Autotuning format combination: -> Int32(1) *************** [03/13/2022-08:27:56] [V] [TRT] *************** Autotuning format combination: -> Int32(1) *************** [03/13/2022-08:27:56] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:56] [V] [TRT] Tactic: 1002 time 0.02556 [03/13/2022-08:27:56] [V] [TRT] Tactic: 0 time 0.030652 [03/13/2022-08:27:56] [V] [TRT] Fastest Tactic: 1002 Time: 0.02556 [03/13/2022-08:27:56] [V] [TRT] *************** Autotuning format combination: Float(1,640,307200,307200), Int32(1) -> Float(1,640,153600,153600) *************** [03/13/2022-08:27:56] [V] [TRT] --------------- Timing Runner: Gather_13 (Gather) [03/13/2022-08:27:56] [V] [TRT] Tactic: 6 time 0.408104 [03/13/2022-08:27:56] [V] [TRT] Fastest Tactic: 6 Time: 0.408104 [03/13/2022-08:27:56] [V] [TRT] *************** Autotuning format combination: Half(1,640,307200,307200), Int32(1) -> Half(1,640,153600,153600) *************** [03/13/2022-08:27:56] [V] [TRT] --------------- Timing Runner: Gather_13 (Gather) [03/13/2022-08:27:56] [V] [TRT] Tactic: 6 time 0.403536 [03/13/2022-08:27:56] [V] [TRT] Fastest Tactic: 6 Time: 0.403536 [03/13/2022-08:27:56] [V] [TRT] *************** Autotuning format combination: Float(1,640,307200,307200), Int32(1) -> Float(1,640,153600,153600) *************** [03/13/2022-08:27:56] [V] [TRT] --------------- Timing Runner: Gather_9 (Gather) [03/13/2022-08:27:56] [V] [TRT] Tactic: 6 time 0.40724 [03/13/2022-08:27:56] [V] [TRT] Fastest Tactic: 6 Time: 0.40724 [03/13/2022-08:27:56] [V] [TRT] *************** Autotuning format combination: Half(1,640,307200,307200), Int32(1) -> Half(1,640,153600,153600) *************** [03/13/2022-08:27:56] [V] [TRT] --------------- Timing Runner: Gather_9 (Gather) [03/13/2022-08:27:56] [V] [TRT] Tactic: 6 time 0.403948 [03/13/2022-08:27:56] [V] [TRT] Fastest Tactic: 6 Time: 0.403948 [03/13/2022-08:27:56] [V] [TRT] *************** Autotuning format combination: Float(1,640,307200,307200), Int32(1) -> Float(1,640,153600,153600) *************** [03/13/2022-08:27:56] [V] [TRT] --------------- Timing Runner: Gather_5 (Gather) [03/13/2022-08:27:56] [V] [TRT] Tactic: 6 time 0.407396 [03/13/2022-08:27:56] [V] [TRT] Fastest Tactic: 6 Time: 0.407396 [03/13/2022-08:27:56] [V] [TRT] *************** Autotuning format combination: Half(1,640,307200,307200), Int32(1) -> Half(1,640,153600,153600) *************** [03/13/2022-08:27:56] [V] [TRT] --------------- Timing Runner: Gather_5 (Gather) [03/13/2022-08:27:56] [V] [TRT] Tactic: 6 time 0.40704 [03/13/2022-08:27:56] [V] [TRT] Fastest Tactic: 6 Time: 0.40704 [03/13/2022-08:27:56] [V] [TRT] *************** Autotuning format combination: Float(1,640,307200,307200), Int32(1) -> Float(1,640,153600,153600) *************** [03/13/2022-08:27:56] [V] [TRT] --------------- Timing Runner: Gather_1 (Gather) [03/13/2022-08:27:56] [V] [TRT] Tactic: 6 time 0.407252 [03/13/2022-08:27:56] [V] [TRT] Fastest Tactic: 6 Time: 0.407252 [03/13/2022-08:27:56] [V] [TRT] *************** Autotuning format combination: Half(1,640,307200,307200), Int32(1) -> Half(1,640,153600,153600) *************** [03/13/2022-08:27:56] [V] [TRT] --------------- Timing Runner: Gather_1 (Gather) [03/13/2022-08:27:56] [V] [TRT] Tactic: 6 time 0.404944 [03/13/2022-08:27:56] [V] [TRT] Fastest Tactic: 6 Time: 0.404944 [03/13/2022-08:27:56] [V] [TRT] *************** Autotuning format combination: -> Int32(1) *************** [03/13/2022-08:27:56] [V] [TRT] *************** Autotuning format combination: -> Int32(1) *************** [03/13/2022-08:27:56] [V] [TRT] *************** Autotuning format combination: -> Int32(1) *************** [03/13/2022-08:27:56] [V] [TRT] *************** Autotuning format combination: -> Int32(1) *************** [03/13/2022-08:27:56] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:56] [V] [TRT] Tactic: 1002 time 0.010564 [03/13/2022-08:27:56] [V] [TRT] Tactic: 0 time 0.017144 [03/13/2022-08:27:56] [V] [TRT] Fastest Tactic: 1002 Time: 0.010564 [03/13/2022-08:27:56] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:56] [V] [TRT] Tactic: 1002 time 0.011048 [03/13/2022-08:27:56] [V] [TRT] Tactic: 0 time 0.016404 [03/13/2022-08:27:56] [V] [TRT] Fastest Tactic: 1002 Time: 0.011048 [03/13/2022-08:27:56] [V] [TRT] *************** Autotuning format combination: Float(1,640,153600,153600), Int32(1) -> Float(1,320,76800,307200) *************** [03/13/2022-08:27:56] [V] [TRT] --------------- Timing Runner: Gather_15 (Gather) [03/13/2022-08:27:56] [V] [TRT] Tactic: 6 time 0.205692 [03/13/2022-08:27:56] [V] [TRT] Fastest Tactic: 6 Time: 0.205692 [03/13/2022-08:27:56] [V] [TRT] *************** Autotuning format combination: Half(1,640,153600,153600), Int32(1) -> Half(1,320,76800,307200) *************** [03/13/2022-08:27:56] [V] [TRT] --------------- Timing Runner: Gather_15 (Gather) [03/13/2022-08:27:56] [V] [TRT] Tactic: 6 time 0.2051 [03/13/2022-08:27:56] [V] [TRT] Fastest Tactic: 6 Time: 0.2051 [03/13/2022-08:27:56] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:56] [V] [TRT] Tactic: 1002 time 0.0098 [03/13/2022-08:27:56] [V] [TRT] Tactic: 0 time 0.009476 [03/13/2022-08:27:56] [V] [TRT] Fastest Tactic: 0 Time: 0.009476 [03/13/2022-08:27:56] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:56] [V] [TRT] Tactic: 1002 time 0.180844 [03/13/2022-08:27:56] [V] [TRT] Tactic: 0 time 0.010164 [03/13/2022-08:27:56] [V] [TRT] Fastest Tactic: 0 Time: 0.010164 [03/13/2022-08:27:56] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:56] [V] [TRT] Tactic: 1002 time 0.181152 [03/13/2022-08:27:56] [V] [TRT] Tactic: 0 time 0.010312 [03/13/2022-08:27:56] [V] [TRT] Fastest Tactic: 0 Time: 0.010312 [03/13/2022-08:27:56] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:56] [V] [TRT] Tactic: 1002 time 0.186956 [03/13/2022-08:27:56] [V] [TRT] Tactic: 0 time 0.035484 [03/13/2022-08:27:56] [V] [TRT] Fastest Tactic: 0 Time: 0.035484 [03/13/2022-08:27:56] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:56] [V] [TRT] Tactic: 1002 time 0.009864 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.00962 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00962 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.182824 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.009472 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.009472 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.183612 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.009796 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.009796 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.188932 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.034344 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.034344 [03/13/2022-08:27:57] [V] [TRT] *************** Autotuning format combination: Float(1,640,153600,153600), Int32(1) -> Float(1,320,76800,307200) *************** [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: Gather_11 (Gather) [03/13/2022-08:27:57] [V] [TRT] Tactic: 6 time 0.206296 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 6 Time: 0.206296 [03/13/2022-08:27:57] [V] [TRT] *************** Autotuning format combination: Half(1,640,153600,153600), Int32(1) -> Half(1,320,76800,307200) *************** [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: Gather_11 (Gather) [03/13/2022-08:27:57] [V] [TRT] Tactic: 6 time 0.205148 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 6 Time: 0.205148 [03/13/2022-08:27:57] [V] [TRT] *************** Autotuning format combination: Float(1,640,153600,153600), Int32(1) -> Float(1,320,76800,307200) *************** [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: Gather_7 (Gather) [03/13/2022-08:27:57] [V] [TRT] Tactic: 6 time 0.205792 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 6 Time: 0.205792 [03/13/2022-08:27:57] [V] [TRT] *************** Autotuning format combination: Half(1,640,153600,153600), Int32(1) -> Half(1,320,76800,307200) *************** [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: Gather_7 (Gather) [03/13/2022-08:27:57] [V] [TRT] Tactic: 6 time 0.204344 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 6 Time: 0.204344 [03/13/2022-08:27:57] [V] [TRT] *************** Autotuning format combination: Float(1,640,153600,153600), Int32(1) -> Float(1,320,76800,307200) *************** [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: Gather_3 (Gather) [03/13/2022-08:27:57] [V] [TRT] Tactic: 6 time 0.205948 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 6 Time: 0.205948 [03/13/2022-08:27:57] [V] [TRT] *************** Autotuning format combination: Half(1,640,153600,153600), Int32(1) -> Half(1,320,76800,307200) *************** [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: Gather_3 (Gather) [03/13/2022-08:27:57] [V] [TRT] Tactic: 6 time 0.206072 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 6 Time: 0.206072 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.025184 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.03054 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.025184 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.196408 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.022724 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.022724 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.239552 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.02158 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.02158 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.244616 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.02284 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.02284 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.02664 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.028164 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.02664 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.198688 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.0217 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.0217 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.242632 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.021648 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.021648 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.247712 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.022548 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.022548 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.054368 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.01968 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.01968 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.054208 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.018364 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.018364 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.241136 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.029032 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.029032 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.246052 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.021068 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.021068 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.085292 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.027452 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.027452 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.08506 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.023388 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.023388 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.239748 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.027136 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.027136 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.201952 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.038388 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.038388 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.085104 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.019552 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.019552 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.083792 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.01622 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.01622 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.240228 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.015996 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.015996 [03/13/2022-08:27:57] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:27:57] [V] [TRT] Tactic: 1002 time 0.19676 [03/13/2022-08:27:57] [V] [TRT] Tactic: 0 time 0.01754 [03/13/2022-08:27:57] [V] [TRT] Fastest Tactic: 0 Time: 0.01754 [03/13/2022-08:27:57] [V] [TRT] *************** Autotuning format combination: Float(1,320,76800,307200) -> Float(1,320,76800,3072000) *************** [03/13/2022-08:27:57] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:27:57] [V] [TRT] Conv_17 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:27:57] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:27:57] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:27:57] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:27:57] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:27:57] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:27:57] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:27:57] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:28:25] [V] [TRT] --------------- Timing Runner: Conv_17 (FusedConvActConvolution) [03/13/2022-08:28:25] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:25] [V] [TRT] --------------- Timing Runner: Conv_17 (CaskConvolution) [03/13/2022-08:28:25] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:28:25] [V] [TRT] Tactic: 1825138533642645384 time 0.44552 [03/13/2022-08:28:25] [V] [TRT] Conv_17 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:28:25] [V] [TRT] Tactic: 2775507031594384867 time 0.6011 [03/13/2022-08:28:25] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:28:25] [V] [TRT] Tactic: 2842488832350522458 time 0.255168 [03/13/2022-08:28:25] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:28:25] [V] [TRT] Tactic: 3915320020053085238 time 0.444552 [03/13/2022-08:28:25] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:28:25] [V] [TRT] Tactic: 6448355332020552203 time 0.645504 [03/13/2022-08:28:25] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:28:26] [V] [TRT] Tactic: 6808617066150061604 time 0.235172 [03/13/2022-08:28:26] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:28:26] [V] [TRT] Tactic: -8060443123034038864 time 0.237876 [03/13/2022-08:28:26] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:28:26] [V] [TRT] Tactic: -4420849921117327522 time 0.291476 [03/13/2022-08:28:26] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:28:26] [V] [TRT] Tactic: -3946921629105938337 time 0.2427 [03/13/2022-08:28:26] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.235172 [03/13/2022-08:28:26] [V] [TRT] --------------- Timing Runner: Conv_17 (CudaConvolution) [03/13/2022-08:28:36] [V] [TRT] Tactic: 0 time 0.573536 [03/13/2022-08:28:36] [V] [TRT] Tactic: 2 time 0.804548 [03/13/2022-08:28:36] [V] [TRT] Tactic: 5 time 4.25958 [03/13/2022-08:28:36] [V] [TRT] Tactic: 6 time 0.76674 [03/13/2022-08:28:36] [V] [TRT] Tactic: 57 time 0.572684 [03/13/2022-08:28:36] [V] [TRT] Fastest Tactic: 57 Time: 0.572684 [03/13/2022-08:28:36] [V] [TRT] --------------- Timing Runner: Conv_17 (CudaDepthwiseConvolution) [03/13/2022-08:28:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6808617066150061604 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] [03/13/2022-08:28:36] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] *************** Autotuning format combination: Half(1,320,76800,307200) -> Half(1,320,76800,3072000) *************** [03/13/2022-08:28:36] [V] [TRT] --------------- Timing Runner: Conv_17 (FusedConvActConvolution) [03/13/2022-08:28:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:36] [V] [TRT] --------------- Timing Runner: Conv_17 (CaskConvolution) [03/13/2022-08:28:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:36] [V] [TRT] --------------- Timing Runner: Conv_17 (CudaConvolution) [03/13/2022-08:28:36] [V] [TRT] Tactic: 0 time 0.574124 [03/13/2022-08:28:36] [V] [TRT] Tactic: 1 time 0.575 [03/13/2022-08:28:36] [V] [TRT] Tactic: 2 time 0.649164 [03/13/2022-08:28:36] [V] [TRT] Tactic: 5 time 4.21935 [03/13/2022-08:28:36] [V] [TRT] Tactic: 6 time 0.803128 [03/13/2022-08:28:36] [V] [TRT] Fastest Tactic: 0 Time: 0.574124 [03/13/2022-08:28:36] [V] [TRT] --------------- Timing Runner: Conv_17 (CudaDepthwiseConvolution) [03/13/2022-08:28:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0 [03/13/2022-08:28:36] [V] [TRT] [03/13/2022-08:28:36] [V] [TRT] *************** Autotuning format combination: Half(1,320,76800:2,153600) -> Half(1,320,76800:2,1536000) *************** [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:28:36] [V] [TRT] --------------- Timing Runner: Conv_17 (FusedConvActConvolution) [03/13/2022-08:28:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:36] [V] [TRT] --------------- Timing Runner: Conv_17 (CaskConvolution) [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Tactic: 1145226902788474763 time 0.124168 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Tactic: 1651411198763708804 time 0.123868 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Tactic: 2418518597804310654 time 0.12398 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Tactic: 4318470497547290900 time 0.1237 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Tactic: 4653005425971292725 time 0.124572 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Tactic: 4930470141256631146 time 0.152564 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Tactic: 8292881859266835088 time 0.153152 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Tactic: 8401509141903434922 time 0.123056 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Tactic: -8654297089785671176 time 0.327668 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Tactic: -7448936905981214224 time 0.1576 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Tactic: -6004726995029373073 time 0.150792 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Tactic: -5719726816705110014 time 0.327564 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Tactic: -3754890472406891741 time 0.3326 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Tactic: -3689982367035295496 time 0.32716 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:28:36] [V] [TRT] Tactic: -3140347171730126532 time 0.373432 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Tactic: -2894005464278291378 time 0.155416 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Tactic: -2027588946874785071 time 0.150712 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Tactic: -1968398013367819764 time 0.328852 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Tactic: -245090590808296743 time 0.3312 [03/13/2022-08:28:36] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 0.123056 [03/13/2022-08:28:36] [V] [TRT] --------------- Timing Runner: Conv_17 (CudaConvolution) [03/13/2022-08:28:36] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:36] [V] [TRT] --------------- Timing Runner: Conv_17 (CudaDepthwiseConvolution) [03/13/2022-08:28:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8401509141903434922 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:28:36] [V] [TRT] *************** Autotuning format combination: Half(1,320,1:4,76800) -> Half(5,1600,1:8,384000) *************** [03/13/2022-08:28:36] [V] [TRT] --------------- Timing Runner: Conv_17 (FusedConvActConvolution) [03/13/2022-08:28:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:36] [V] [TRT] --------------- Timing Runner: Conv_17 (CaskConvolution) [03/13/2022-08:28:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:36] [V] [TRT] --------------- Timing Runner: Conv_17 (CudaConvolution) [03/13/2022-08:28:36] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:36] [V] [TRT] --------------- Timing Runner: Conv_17 (CudaDepthwiseConvolution) [03/13/2022-08:28:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:36] [V] [TRT] *************** Autotuning format combination: Half(1,320,1:8,76800) -> Float(1,320,76800,3072000) *************** [03/13/2022-08:28:36] [V] [TRT] --------------- Timing Runner: Conv_17 (FusedConvActConvolution) [03/13/2022-08:28:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:36] [V] [TRT] --------------- Timing Runner: Conv_17 (CaskConvolution) [03/13/2022-08:28:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:36] [V] [TRT] --------------- Timing Runner: Conv_17 (CudaConvolution) [03/13/2022-08:28:36] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:36] [V] [TRT] --------------- Timing Runner: Conv_17 (CudaDepthwiseConvolution) [03/13/2022-08:28:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:36] [V] [TRT] *************** Autotuning format combination: Half(1,320,1:8,76800) -> Half(5,1600,1:8,384000) *************** [03/13/2022-08:28:36] [V] [TRT] Conv_17 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:28:36] [V] [TRT] Conv_17 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:28:36] [V] [TRT] Conv_17 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:36] [V] [TRT] --------------- Timing Runner: Conv_17 (FusedConvActConvolution) [03/13/2022-08:28:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:36] [V] [TRT] --------------- Timing Runner: Conv_17 (CaskConvolution) [03/13/2022-08:28:36] [V] [TRT] Conv_17 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:28:36] [V] [TRT] Tactic: 130343752241278875 time 8.25426 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:36] [V] [TRT] Tactic: 2148106709480872763 time 4.21757 [03/13/2022-08:28:36] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:37] [V] [TRT] Tactic: 2410442691266548717 time 16.9341 [03/13/2022-08:28:37] [V] [TRT] Conv_17 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:28:37] [V] [TRT] Tactic: 2921824978225832523 time 8.24757 [03/13/2022-08:28:37] [V] [TRT] Conv_17 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:28:37] [V] [TRT] Tactic: 3030711443478140260 time 15.436 [03/13/2022-08:28:37] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:37] [V] [TRT] Tactic: 3754069740140581927 time 15.4856 [03/13/2022-08:28:37] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:28:37] [V] [TRT] Tactic: 3823144360994712832 time 8.52131 [03/13/2022-08:28:37] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:28:38] [V] [TRT] Tactic: 5635311898703673455 time 16.4628 [03/13/2022-08:28:38] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:38] [V] [TRT] Tactic: 5925270497649423688 time 15.7829 [03/13/2022-08:28:38] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:38] [V] [TRT] Tactic: 6680916730816870145 time 15.7932 [03/13/2022-08:28:38] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:38] [V] [TRT] Tactic: 7158029511300006471 time 7.93779 [03/13/2022-08:28:38] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:39] [V] [TRT] Tactic: 7859952145590271433 time 15.7859 [03/13/2022-08:28:39] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:39] [V] [TRT] Tactic: 8283847742354150423 time 15.501 [03/13/2022-08:28:39] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:39] [V] [TRT] Tactic: -8992262742606384444 time 4.21792 [03/13/2022-08:28:39] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:28:39] [V] [TRT] Tactic: -8682550625095202832 time 4.22131 [03/13/2022-08:28:39] [V] [TRT] Conv_17 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:28:39] [V] [TRT] Tactic: -8379842433586149932 time 15.3836 [03/13/2022-08:28:39] [V] [TRT] Conv_17 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:28:40] [V] [TRT] Tactic: -6352769237623756264 time 15.4071 [03/13/2022-08:28:40] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:40] [V] [TRT] Tactic: -6273232454637933930 time 8.52106 [03/13/2022-08:28:40] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:40] [V] [TRT] Tactic: -5818527483287834165 time 8.5187 [03/13/2022-08:28:40] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:28:40] [V] [TRT] Tactic: -4954692664176521434 time 16.9352 [03/13/2022-08:28:40] [V] [TRT] Conv_17 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:28:40] [V] [TRT] Tactic: -4953888146171240997 time 8.24081 [03/13/2022-08:28:40] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Tactic: -4534876761957424274 time 15.7828 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Tactic: -3237051169894153788 time 7.93911 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Tactic: -3136088851200285532 time 16.4602 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Tactic: -2586046817576862066 time 16.9369 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Tactic: -229563042944049199 time 16.4585 [03/13/2022-08:28:41] [V] [TRT] Fastest Tactic: 2148106709480872763 Time: 4.21757 [03/13/2022-08:28:41] [V] [TRT] --------------- Timing Runner: Conv_17 (CudaConvolution) [03/13/2022-08:28:41] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:41] [V] [TRT] --------------- Timing Runner: Conv_17 (CudaDepthwiseConvolution) [03/13/2022-08:28:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2148106709480872763 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] [03/13/2022-08:28:41] [V] [TRT] Conv_17 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:28:41] [V] [TRT] Conv_17 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:28:41] [V] [TRT] Conv_17 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] Conv_17 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:28:42] [V] [TRT] Tactic: 1002 time 0.393072 [03/13/2022-08:28:42] [V] [TRT] Tactic: 0 time 2.11188 [03/13/2022-08:28:42] [V] [TRT] Fastest Tactic: 1002 Time: 0.393072 [03/13/2022-08:28:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:28:42] [V] [TRT] Tactic: 1002 time 0.17164 [03/13/2022-08:28:42] [V] [TRT] Tactic: 0 time 0.187184 [03/13/2022-08:28:42] [V] [TRT] Fastest Tactic: 1002 Time: 0.17164 [03/13/2022-08:28:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:28:42] [V] [TRT] Tactic: 1002 time 0.435864 [03/13/2022-08:28:42] [V] [TRT] Tactic: 0 time 0.150132 [03/13/2022-08:28:42] [V] [TRT] Fastest Tactic: 0 Time: 0.150132 [03/13/2022-08:28:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:28:42] [V] [TRT] Tactic: 1002 time 0.390584 [03/13/2022-08:28:42] [V] [TRT] Tactic: 0 time 0.192604 [03/13/2022-08:28:42] [V] [TRT] Fastest Tactic: 0 Time: 0.192604 [03/13/2022-08:28:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:28:42] [V] [TRT] Tactic: 1002 time 1.22556 [03/13/2022-08:28:42] [V] [TRT] Tactic: 0 time 1.2082 [03/13/2022-08:28:42] [V] [TRT] Fastest Tactic: 0 Time: 1.2082 [03/13/2022-08:28:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:28:42] [V] [TRT] Tactic: 1002 time 1.15469 [03/13/2022-08:28:42] [V] [TRT] Tactic: 0 time 1.14965 [03/13/2022-08:28:42] [V] [TRT] Fastest Tactic: 0 Time: 1.14965 [03/13/2022-08:28:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:28:42] [V] [TRT] Tactic: 1002 time 0.529944 [03/13/2022-08:28:42] [V] [TRT] Tactic: 0 time 1.26912 [03/13/2022-08:28:42] [V] [TRT] Fastest Tactic: 1002 Time: 0.529944 [03/13/2022-08:28:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:28:42] [V] [TRT] Tactic: 1002 time 0.427228 [03/13/2022-08:28:42] [V] [TRT] Tactic: 0 time 0.208816 [03/13/2022-08:28:42] [V] [TRT] Fastest Tactic: 0 Time: 0.208816 [03/13/2022-08:28:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:28:42] [V] [TRT] Tactic: 1002 time 0.176852 [03/13/2022-08:28:42] [V] [TRT] Tactic: 0 time 0.174236 [03/13/2022-08:28:42] [V] [TRT] Fastest Tactic: 0 Time: 0.174236 [03/13/2022-08:28:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:28:42] [V] [TRT] Tactic: 1002 time 0.397184 [03/13/2022-08:28:42] [V] [TRT] Tactic: 0 time 2.02964 [03/13/2022-08:28:42] [V] [TRT] Fastest Tactic: 1002 Time: 0.397184 [03/13/2022-08:28:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:28:42] [V] [TRT] Tactic: 1002 time 0.44618 [03/13/2022-08:28:42] [V] [TRT] Tactic: 0 time 0.144416 [03/13/2022-08:28:42] [V] [TRT] Fastest Tactic: 0 Time: 0.144416 [03/13/2022-08:28:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:28:42] [V] [TRT] Tactic: 1002 time 0.393924 [03/13/2022-08:28:42] [V] [TRT] Tactic: 0 time 0.160864 [03/13/2022-08:28:42] [V] [TRT] Fastest Tactic: 0 Time: 0.160864 [03/13/2022-08:28:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:28:42] [V] [TRT] Tactic: 1002 time 0.407576 [03/13/2022-08:28:42] [V] [TRT] Tactic: 0 time 0.121436 [03/13/2022-08:28:42] [V] [TRT] Fastest Tactic: 0 Time: 0.121436 [03/13/2022-08:28:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:28:42] [V] [TRT] Tactic: 1002 time 0.389608 [03/13/2022-08:28:42] [V] [TRT] Tactic: 0 time 2.10636 [03/13/2022-08:28:42] [V] [TRT] Fastest Tactic: 1002 Time: 0.389608 [03/13/2022-08:28:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:28:42] [V] [TRT] Tactic: 1002 time 0.403528 [03/13/2022-08:28:42] [V] [TRT] Tactic: 0 time 0.112932 [03/13/2022-08:28:42] [V] [TRT] Fastest Tactic: 0 Time: 0.112932 [03/13/2022-08:28:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:28:42] [V] [TRT] Tactic: 1002 time 0.388028 [03/13/2022-08:28:42] [V] [TRT] Tactic: 0 time 0.161896 [03/13/2022-08:28:42] [V] [TRT] Fastest Tactic: 0 Time: 0.161896 [03/13/2022-08:28:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:28:42] [V] [TRT] Tactic: 1002 time 0.44818 [03/13/2022-08:28:42] [V] [TRT] Tactic: 0 time 0.177288 [03/13/2022-08:28:42] [V] [TRT] Fastest Tactic: 0 Time: 0.177288 [03/13/2022-08:28:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:28:42] [V] [TRT] Tactic: 1002 time 0.367656 [03/13/2022-08:28:42] [V] [TRT] Tactic: 0 time 3.03621 [03/13/2022-08:28:42] [V] [TRT] Fastest Tactic: 1002 Time: 0.367656 [03/13/2022-08:28:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:28:42] [V] [TRT] Tactic: 1002 time 0.44642 [03/13/2022-08:28:42] [V] [TRT] Tactic: 0 time 0.13806 [03/13/2022-08:28:42] [V] [TRT] Fastest Tactic: 0 Time: 0.13806 [03/13/2022-08:28:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:28:42] [V] [TRT] Tactic: 1002 time 0.429428 [03/13/2022-08:28:42] [V] [TRT] Tactic: 0 time 0.136784 [03/13/2022-08:28:42] [V] [TRT] Fastest Tactic: 0 Time: 0.136784 [03/13/2022-08:28:42] [V] [TRT] *************** Autotuning format combination: Float(1,320,76800,3072000) -> Float(1,320,76800,3072000) *************** [03/13/2022-08:28:44] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_19, Mul_20) (PointWise) [03/13/2022-08:28:44] [V] [TRT] Tactic: 128 time 0.322748 [03/13/2022-08:28:44] [V] [TRT] Tactic: 256 time 0.328824 [03/13/2022-08:28:44] [V] [TRT] Tactic: 512 time 0.37158 [03/13/2022-08:28:44] [V] [TRT] Tactic: -32 time 0.505672 [03/13/2022-08:28:44] [V] [TRT] Tactic: -64 time 0.323936 [03/13/2022-08:28:44] [V] [TRT] Tactic: -128 time 0.323684 [03/13/2022-08:28:44] [V] [TRT] Fastest Tactic: 128 Time: 0.322748 [03/13/2022-08:28:44] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_19, Mul_20) (PointWiseV2) [03/13/2022-08:28:44] [V] [TRT] Tactic: 0 time 0.217392 [03/13/2022-08:28:44] [V] [TRT] Tactic: 1 time 0.176252 [03/13/2022-08:28:44] [V] [TRT] Tactic: 2 time 0.146904 [03/13/2022-08:28:44] [V] [TRT] Tactic: 3 time 0.16164 [03/13/2022-08:28:44] [V] [TRT] Tactic: 4 time 0.146496 [03/13/2022-08:28:44] [V] [TRT] Tactic: 5 time 0.145976 [03/13/2022-08:28:44] [V] [TRT] Tactic: 6 time 0.166348 [03/13/2022-08:28:44] [V] [TRT] Tactic: 7 time 0.146604 [03/13/2022-08:28:44] [V] [TRT] Tactic: 8 time 0.146164 [03/13/2022-08:28:44] [V] [TRT] Tactic: 9 time 0.146496 [03/13/2022-08:28:44] [V] [TRT] Tactic: 28 time 0.216104 [03/13/2022-08:28:44] [V] [TRT] Fastest Tactic: 5 Time: 0.145976 [03/13/2022-08:28:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [03/13/2022-08:28:44] [V] [TRT] [03/13/2022-08:28:44] [V] [TRT] *************** Autotuning format combination: Float(1,320,76800:32,153600) -> Float(1,320,76800:32,153600) *************** [03/13/2022-08:28:45] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_19, Mul_20) (PointWise) [03/13/2022-08:28:45] [V] [TRT] Tactic: 128 time 0.679756 [03/13/2022-08:28:45] [V] [TRT] Tactic: 256 time 0.686972 [03/13/2022-08:28:45] [V] [TRT] Tactic: 512 time 0.767884 [03/13/2022-08:28:45] [V] [TRT] Tactic: -32 time 0.80258 [03/13/2022-08:28:45] [V] [TRT] Tactic: -64 time 0.517844 [03/13/2022-08:28:45] [V] [TRT] Tactic: -128 time 0.529596 [03/13/2022-08:28:45] [V] [TRT] Fastest Tactic: -64 Time: 0.517844 [03/13/2022-08:28:45] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_19, Mul_20) (PointWiseV2) [03/13/2022-08:28:45] [V] [TRT] Tactic: 24 time 0.270896 [03/13/2022-08:28:45] [V] [TRT] Tactic: 25 time 0.277816 [03/13/2022-08:28:45] [V] [TRT] Tactic: 26 time 0.281852 [03/13/2022-08:28:45] [V] [TRT] Tactic: 27 time 0.286756 [03/13/2022-08:28:45] [V] [TRT] Tactic: 31 time 0.27188 [03/13/2022-08:28:45] [V] [TRT] Fastest Tactic: 24 Time: 0.270896 [03/13/2022-08:28:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [03/13/2022-08:28:45] [V] [TRT] [03/13/2022-08:28:45] [V] [TRT] *************** Autotuning format combination: Half(1,320,76800,3072000) -> Half(1,320,76800,3072000) *************** [03/13/2022-08:28:47] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_19, Mul_20) (PointWise) [03/13/2022-08:28:47] [V] [TRT] Tactic: 128 time 0.312664 [03/13/2022-08:28:47] [V] [TRT] Tactic: 256 time 0.256672 [03/13/2022-08:28:47] [V] [TRT] Tactic: 512 time 0.247484 [03/13/2022-08:28:47] [V] [TRT] Tactic: -32 time 0.411448 [03/13/2022-08:28:47] [V] [TRT] Tactic: -64 time 0.278864 [03/13/2022-08:28:47] [V] [TRT] Tactic: -128 time 0.28732 [03/13/2022-08:28:47] [V] [TRT] Fastest Tactic: 512 Time: 0.247484 [03/13/2022-08:28:47] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_19, Mul_20) (PointWiseV2) [03/13/2022-08:28:47] [V] [TRT] Tactic: 0 time 0.188408 [03/13/2022-08:28:47] [V] [TRT] Tactic: 1 time 0.150588 [03/13/2022-08:28:47] [V] [TRT] Tactic: 2 time 0.121008 [03/13/2022-08:28:47] [V] [TRT] Tactic: 3 time 0.134488 [03/13/2022-08:28:47] [V] [TRT] Tactic: 4 time 0.098176 [03/13/2022-08:28:47] [V] [TRT] Tactic: 5 time 0.07994 [03/13/2022-08:28:47] [V] [TRT] Tactic: 6 time 0.132632 [03/13/2022-08:28:47] [V] [TRT] Tactic: 7 time 0.091836 [03/13/2022-08:28:47] [V] [TRT] Tactic: 8 time 0.076372 [03/13/2022-08:28:47] [V] [TRT] Tactic: 9 time 0.075908 [03/13/2022-08:28:47] [V] [TRT] Tactic: 28 time 0.1872 [03/13/2022-08:28:47] [V] [TRT] Fastest Tactic: 9 Time: 0.075908 [03/13/2022-08:28:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:28:47] [V] [TRT] [03/13/2022-08:28:47] [V] [TRT] *************** Autotuning format combination: Half(1,320,76800:2,1536000) -> Half(1,320,76800:2,1536000) *************** [03/13/2022-08:28:50] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_19, Mul_20) (PointWise) [03/13/2022-08:28:50] [V] [TRT] Tactic: 128 time 0.34622 [03/13/2022-08:28:50] [V] [TRT] Tactic: 256 time 0.287068 [03/13/2022-08:28:50] [V] [TRT] Tactic: 512 time 0.273912 [03/13/2022-08:28:50] [V] [TRT] Tactic: -32 time 0.453068 [03/13/2022-08:28:50] [V] [TRT] Tactic: -64 time 0.306892 [03/13/2022-08:28:50] [V] [TRT] Tactic: -128 time 0.31216 [03/13/2022-08:28:50] [V] [TRT] Fastest Tactic: 512 Time: 0.273912 [03/13/2022-08:28:50] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_19, Mul_20) (PointWiseV2) [03/13/2022-08:28:50] [V] [TRT] Tactic: 0 time 0.134648 [03/13/2022-08:28:50] [V] [TRT] Tactic: 1 time 0.113044 [03/13/2022-08:28:50] [V] [TRT] Tactic: 2 time 0.113748 [03/13/2022-08:28:50] [V] [TRT] Tactic: 3 time 0.105336 [03/13/2022-08:28:50] [V] [TRT] Tactic: 4 time 0.102624 [03/13/2022-08:28:50] [V] [TRT] Tactic: 5 time 0.111124 [03/13/2022-08:28:50] [V] [TRT] Tactic: 6 time 0.104128 [03/13/2022-08:28:50] [V] [TRT] Tactic: 7 time 0.101328 [03/13/2022-08:28:50] [V] [TRT] Tactic: 8 time 0.10812 [03/13/2022-08:28:50] [V] [TRT] Tactic: 9 time 0.139312 [03/13/2022-08:28:50] [V] [TRT] Tactic: 10 time 0.21082 [03/13/2022-08:28:50] [V] [TRT] Tactic: 11 time 0.1641 [03/13/2022-08:28:50] [V] [TRT] Tactic: 12 time 0.136664 [03/13/2022-08:28:50] [V] [TRT] Tactic: 13 time 0.145596 [03/13/2022-08:28:50] [V] [TRT] Tactic: 14 time 0.108504 [03/13/2022-08:28:50] [V] [TRT] Tactic: 15 time 0.094128 [03/13/2022-08:28:50] [V] [TRT] Tactic: 16 time 0.143216 [03/13/2022-08:28:50] [V] [TRT] Tactic: 17 time 0.100092 [03/13/2022-08:28:50] [V] [TRT] Tactic: 18 time 0.078484 [03/13/2022-08:28:50] [V] [TRT] Tactic: 19 time 0.080336 [03/13/2022-08:28:50] [V] [TRT] Tactic: 28 time 0.13388 [03/13/2022-08:28:50] [V] [TRT] Tactic: 29 time 0.209308 [03/13/2022-08:28:50] [V] [TRT] Fastest Tactic: 18 Time: 0.078484 [03/13/2022-08:28:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:28:50] [V] [TRT] [03/13/2022-08:28:50] [V] [TRT] *************** Autotuning format combination: Half(5,1600,1:8,384000) -> Half(5,1600,1:8,384000) *************** [03/13/2022-08:28:56] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_19, Mul_20) (PointWise) [03/13/2022-08:28:56] [V] [TRT] Tactic: 128 time 0.34862 [03/13/2022-08:28:56] [V] [TRT] Tactic: 256 time 0.287336 [03/13/2022-08:28:56] [V] [TRT] Tactic: 512 time 0.274304 [03/13/2022-08:28:56] [V] [TRT] Tactic: -32 time 0.451936 [03/13/2022-08:28:56] [V] [TRT] Tactic: -64 time 0.308452 [03/13/2022-08:28:56] [V] [TRT] Tactic: -128 time 0.31188 [03/13/2022-08:28:56] [V] [TRT] Fastest Tactic: 512 Time: 0.274304 [03/13/2022-08:28:56] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_19, Mul_20) (PointWiseV2) [03/13/2022-08:28:56] [V] [TRT] Tactic: 0 time 0.088688 [03/13/2022-08:28:56] [V] [TRT] Tactic: 1 time 0.09012 [03/13/2022-08:28:56] [V] [TRT] Tactic: 2 time 0.111248 [03/13/2022-08:28:56] [V] [TRT] Tactic: 3 time 0.092572 [03/13/2022-08:28:56] [V] [TRT] Tactic: 4 time 0.112672 [03/13/2022-08:28:56] [V] [TRT] Tactic: 5 time 0.144792 [03/13/2022-08:28:56] [V] [TRT] Tactic: 6 time 0.094848 [03/13/2022-08:28:56] [V] [TRT] Tactic: 7 time 0.116952 [03/13/2022-08:28:56] [V] [TRT] Tactic: 8 time 0.14596 [03/13/2022-08:28:56] [V] [TRT] Tactic: 9 time 0.200044 [03/13/2022-08:28:56] [V] [TRT] Tactic: 10 time 0.095008 [03/13/2022-08:28:56] [V] [TRT] Tactic: 11 time 0.081988 [03/13/2022-08:28:56] [V] [TRT] Tactic: 12 time 0.08938 [03/13/2022-08:28:56] [V] [TRT] Tactic: 13 time 0.081396 [03/13/2022-08:28:56] [V] [TRT] Tactic: 14 time 0.090776 [03/13/2022-08:28:56] [V] [TRT] Tactic: 15 time 0.117824 [03/13/2022-08:28:56] [V] [TRT] Tactic: 16 time 0.081972 [03/13/2022-08:28:56] [V] [TRT] Tactic: 17 time 0.093268 [03/13/2022-08:28:56] [V] [TRT] Tactic: 18 time 0.121508 [03/13/2022-08:28:56] [V] [TRT] Tactic: 19 time 0.16218 [03/13/2022-08:28:56] [V] [TRT] Tactic: 20 time 0.138068 [03/13/2022-08:28:56] [V] [TRT] Tactic: 21 time 0.114088 [03/13/2022-08:28:56] [V] [TRT] Tactic: 22 time 0.10522 [03/13/2022-08:28:56] [V] [TRT] Tactic: 23 time 0.103988 [03/13/2022-08:28:56] [V] [TRT] Tactic: 24 time 0.211656 [03/13/2022-08:28:56] [V] [TRT] Tactic: 25 time 0.165188 [03/13/2022-08:28:56] [V] [TRT] Tactic: 26 time 0.145652 [03/13/2022-08:28:56] [V] [TRT] Tactic: 27 time 0.143856 [03/13/2022-08:28:56] [V] [TRT] Tactic: 28 time 0.0887 [03/13/2022-08:28:56] [V] [TRT] Tactic: 29 time 0.09442 [03/13/2022-08:28:56] [V] [TRT] Tactic: 30 time 0.137864 [03/13/2022-08:28:56] [V] [TRT] Tactic: 31 time 0.212276 [03/13/2022-08:28:56] [V] [TRT] Fastest Tactic: 13 Time: 0.081396 [03/13/2022-08:28:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 13 [03/13/2022-08:28:56] [V] [TRT] [03/13/2022-08:28:56] [V] [TRT] *************** Autotuning format combination: Float(1,320,76800,3072000) -> Float(1,160,19200,1536000) *************** [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:28:56] [V] [TRT] --------------- Timing Runner: Conv_21 (FusedConvActConvolution) [03/13/2022-08:28:56] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:56] [V] [TRT] --------------- Timing Runner: Conv_21 (CaskConvolution) [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Tactic: 1825138533642645384 time 0.782156 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Tactic: 2842488832350522458 time 0.798912 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Tactic: 3915320020053085238 time 0.778872 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Tactic: 6448355332020552203 time 0.842532 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Tactic: 6808617066150061604 time 0.814164 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Tactic: -8060443123034038864 time 0.821692 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Tactic: -4420849921117327522 time 0.796892 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Tactic: -3946921629105938337 time 0.712164 [03/13/2022-08:28:56] [V] [TRT] Fastest Tactic: -3946921629105938337 Time: 0.712164 [03/13/2022-08:28:56] [V] [TRT] --------------- Timing Runner: Conv_21 (CudaConvolution) [03/13/2022-08:28:56] [V] [TRT] Tactic: 0 time 1.3979 [03/13/2022-08:28:56] [V] [TRT] Tactic: 2 skipped. Scratch requested: 27648000, available: 16777216 [03/13/2022-08:28:56] [V] [TRT] Tactic: 5 time 10.4088 [03/13/2022-08:28:56] [V] [TRT] Tactic: 57 time 0.713064 [03/13/2022-08:28:56] [I] [TRT] Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output. [03/13/2022-08:28:56] [V] [TRT] Fastest Tactic: 57 Time: 0.713064 [03/13/2022-08:28:56] [V] [TRT] --------------- Timing Runner: Conv_21 (CudaDepthwiseConvolution) [03/13/2022-08:28:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3946921629105938337 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:28:56] [V] [TRT] [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:28:56] [V] [TRT] Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:28:56] [V] [TRT] *************** Autotuning format combination: Half(1,320,76800,3072000) -> Half(1,160,19200,1536000) *************** [03/13/2022-08:28:56] [V] [TRT] --------------- Timing Runner: Conv_21 (FusedConvActConvolution) [03/13/2022-08:28:56] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:56] [V] [TRT] --------------- Timing Runner: Conv_21 (CaskConvolution) [03/13/2022-08:28:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:56] [V] [TRT] --------------- Timing Runner: Conv_21 (CudaConvolution) [03/13/2022-08:28:56] [V] [TRT] Tactic: 0 time 1.0397 [03/13/2022-08:28:56] [V] [TRT] Tactic: 1 time 0.69242 [03/13/2022-08:28:57] [V] [TRT] Tactic: 2 time 1.21683 [03/13/2022-08:28:57] [V] [TRT] Tactic: 5 time 10.3046 [03/13/2022-08:28:57] [V] [TRT] Fastest Tactic: 1 Time: 0.69242 [03/13/2022-08:28:57] [V] [TRT] --------------- Timing Runner: Conv_21 (CudaDepthwiseConvolution) [03/13/2022-08:28:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:28:57] [V] [TRT] [03/13/2022-08:28:57] [V] [TRT] *************** Autotuning format combination: Half(1,320,76800:2,1536000) -> Half(1,160,19200:2,768000) *************** [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:28:57] [V] [TRT] --------------- Timing Runner: Conv_21 (FusedConvActConvolution) [03/13/2022-08:28:57] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:57] [V] [TRT] --------------- Timing Runner: Conv_21 (CaskConvolution) [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: 1145226902788474763 time 0.330472 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: 1651411198763708804 time 0.33006 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: 2418518597804310654 time 0.331832 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: 4318470497547290900 time 0.328796 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: 4653005425971292725 time 0.331432 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: 4930470141256631146 time 0.288944 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: 8292881859266835088 time 0.289892 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: 8401509141903434922 time 0.32758 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: -8654297089785671176 time 0.346764 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: -7448936905981214224 time 0.294564 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: -6004726995029373073 time 0.283676 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: -5719726816705110014 time 0.34676 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: -3754890472406891741 time 0.35468 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: -3689982367035295496 time 0.347244 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: -2894005464278291378 time 0.290932 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: -2027588946874785071 time 0.289096 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: -1968398013367819764 time 0.347556 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: -245090590808296743 time 0.353204 [03/13/2022-08:28:57] [V] [TRT] Fastest Tactic: -6004726995029373073 Time: 0.283676 [03/13/2022-08:28:57] [V] [TRT] --------------- Timing Runner: Conv_21 (CudaConvolution) [03/13/2022-08:28:57] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:57] [V] [TRT] --------------- Timing Runner: Conv_21 (CudaDepthwiseConvolution) [03/13/2022-08:28:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6004726995029373073 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:28:57] [V] [TRT] [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:28:57] [V] [TRT] *************** Autotuning format combination: Half(5,1600,1:8,384000) -> Float(1,160,19200,1536000) *************** [03/13/2022-08:28:57] [V] [TRT] --------------- Timing Runner: Conv_21 (FusedConvActConvolution) [03/13/2022-08:28:57] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:57] [V] [TRT] --------------- Timing Runner: Conv_21 (CaskConvolution) [03/13/2022-08:28:57] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:57] [V] [TRT] --------------- Timing Runner: Conv_21 (CudaConvolution) [03/13/2022-08:28:57] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:57] [V] [TRT] --------------- Timing Runner: Conv_21 (CudaDepthwiseConvolution) [03/13/2022-08:28:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:57] [V] [TRT] *************** Autotuning format combination: Half(5,1600,1:8,384000) -> Half(10,1600,1:8,192000) *************** [03/13/2022-08:28:57] [V] [TRT] Conv_21 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:28:57] [V] [TRT] Conv_21 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:28:57] [V] [TRT] Conv_21 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] --------------- Timing Runner: Conv_21 (FusedConvActConvolution) [03/13/2022-08:28:57] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:28:57] [V] [TRT] --------------- Timing Runner: Conv_21 (CaskConvolution) [03/13/2022-08:28:57] [V] [TRT] Conv_21 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:28:57] [V] [TRT] Tactic: 130343752241278875 time 3.102 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: 2148106709480872763 time 4.18799 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: 2410442691266548717 time 4.60175 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:28:57] [V] [TRT] Tactic: 2921824978225832523 time 3.09898 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:28:57] [V] [TRT] Tactic: 3030711443478140260 time 5.7691 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: 3754069740140581927 time 7.83695 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:28:57] [V] [TRT] Tactic: 3823144360994712832 time 4.23971 [03/13/2022-08:28:57] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:28:58] [V] [TRT] Tactic: 5635311898703673455 time 4.19524 [03/13/2022-08:28:58] [V] [TRT] Conv_21 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:58] [V] [TRT] Tactic: 5925270497649423688 time 8.52858 [03/13/2022-08:28:58] [V] [TRT] Conv_21 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:58] [V] [TRT] Tactic: 6680916730816870145 time 7.85221 [03/13/2022-08:28:58] [V] [TRT] Conv_21 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:58] [V] [TRT] Tactic: 7158029511300006471 time 7.84392 [03/13/2022-08:28:58] [V] [TRT] Conv_21 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:58] [V] [TRT] Tactic: 7859952145590271433 time 7.84998 [03/13/2022-08:28:58] [V] [TRT] Conv_21 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:58] [V] [TRT] Tactic: 8283847742354150423 time 7.83882 [03/13/2022-08:28:58] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:58] [V] [TRT] Tactic: -8992262742606384444 time 4.19294 [03/13/2022-08:28:58] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:28:58] [V] [TRT] Tactic: -8682550625095202832 time 4.19054 [03/13/2022-08:28:58] [V] [TRT] Conv_21 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:28:59] [V] [TRT] Tactic: -8379842433586149932 time 5.76855 [03/13/2022-08:28:59] [V] [TRT] Conv_21 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:28:59] [V] [TRT] Tactic: -6352769237623756264 time 5.77357 [03/13/2022-08:28:59] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:59] [V] [TRT] Tactic: -6273232454637933930 time 4.2402 [03/13/2022-08:28:59] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:59] [V] [TRT] Tactic: -5818527483287834165 time 4.24582 [03/13/2022-08:28:59] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:28:59] [V] [TRT] Tactic: -4954692664176521434 time 4.6013 [03/13/2022-08:28:59] [V] [TRT] Conv_21 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:28:59] [V] [TRT] Tactic: -4953888146171240997 time 3.10282 [03/13/2022-08:28:59] [V] [TRT] Conv_21 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:59] [V] [TRT] Tactic: -4534876761957424274 time 8.52929 [03/13/2022-08:28:59] [V] [TRT] Conv_21 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:59] [V] [TRT] Tactic: -3237051169894153788 time 7.84995 [03/13/2022-08:28:59] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:28:59] [V] [TRT] Tactic: -3136088851200285532 time 4.19026 [03/13/2022-08:28:59] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:59] [V] [TRT] Tactic: -2586046817576862066 time 4.60164 [03/13/2022-08:28:59] [V] [TRT] Conv_21 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:28:59] [V] [TRT] Tactic: -229563042944049199 time 4.19117 [03/13/2022-08:28:59] [V] [TRT] Fastest Tactic: 2921824978225832523 Time: 3.09898 [03/13/2022-08:28:59] [V] [TRT] --------------- Timing Runner: Conv_21 (CudaConvolution) [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 3.14903 [03/13/2022-08:29:00] [V] [TRT] Tactic: 1 time 2.61599 [03/13/2022-08:29:00] [V] [TRT] Tactic: 2 skipped. Scratch requested: 16896512, available: 16777216 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 1 Time: 2.61599 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: Conv_21 (CudaDepthwiseConvolution) [03/13/2022-08:29:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:29:00] [V] [TRT] [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:00] [V] [TRT] Tactic: 1002 time 0.150568 [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 1.05798 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.150568 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:00] [V] [TRT] Tactic: 1002 time 0.086928 [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 0.09636 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.086928 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:00] [V] [TRT] Tactic: 1002 time 0.188084 [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 0.076784 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 0 Time: 0.076784 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:00] [V] [TRT] Tactic: 1002 time 0.14944 [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 0.068224 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 0 Time: 0.068224 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:00] [V] [TRT] Tactic: 1002 time 0.483564 [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 0.607052 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.483564 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:00] [V] [TRT] Tactic: 1002 time 0.428868 [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 0.576448 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.428868 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:00] [V] [TRT] Tactic: 1002 time 0.233812 [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 0.63624 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.233812 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:00] [V] [TRT] Tactic: 1002 time 0.176812 [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 0.106788 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 0 Time: 0.106788 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:00] [V] [TRT] Tactic: 1002 time 0.090152 [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 0.089404 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 0 Time: 0.089404 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:00] [V] [TRT] Tactic: 1002 time 0.1526 [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 1.0174 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.1526 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:00] [V] [TRT] Tactic: 1002 time 0.188356 [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 0.073788 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 0 Time: 0.073788 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:00] [V] [TRT] Tactic: 1002 time 0.14994 [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 0.058956 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 0 Time: 0.058956 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:00] [V] [TRT] Tactic: 1002 time 0.197744 [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 0.066464 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 0 Time: 0.066464 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:00] [V] [TRT] Tactic: 1002 time 0.148276 [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 0.996636 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.148276 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:00] [V] [TRT] Tactic: 1002 time 0.195804 [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 0.062736 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 0 Time: 0.062736 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:00] [V] [TRT] Tactic: 1002 time 0.145876 [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 0.055772 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 0 Time: 0.055772 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:00] [V] [TRT] Tactic: 1002 time 0.167224 [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 0.070868 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 0 Time: 0.070868 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:00] [V] [TRT] Tactic: 1002 time 0.1403 [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 1.59382 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.1403 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:00] [V] [TRT] Tactic: 1002 time 0.166836 [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 0.050948 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 0 Time: 0.050948 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:00] [V] [TRT] Tactic: 1002 time 0.187236 [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 0.05124 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 0 Time: 0.05124 [03/13/2022-08:29:00] [V] [TRT] *************** Autotuning format combination: Float(1,160,19200,1536000) -> Float(1,160,19200,1536000) *************** [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_22, Mul_23) (PointWise) [03/13/2022-08:29:00] [V] [TRT] Tactic: 128 time 0.131504 [03/13/2022-08:29:00] [V] [TRT] Tactic: 256 time 0.134624 [03/13/2022-08:29:00] [V] [TRT] Tactic: 512 time 0.151308 [03/13/2022-08:29:00] [V] [TRT] Tactic: -32 time 0.2109 [03/13/2022-08:29:00] [V] [TRT] Tactic: -64 time 0.133896 [03/13/2022-08:29:00] [V] [TRT] Tactic: -128 time 0.132204 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 128 Time: 0.131504 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_22, Mul_23) (PointWiseV2) [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 0.092632 [03/13/2022-08:29:00] [V] [TRT] Tactic: 1 time 0.078044 [03/13/2022-08:29:00] [V] [TRT] Tactic: 2 time 0.077084 [03/13/2022-08:29:00] [V] [TRT] Tactic: 3 time 0.078304 [03/13/2022-08:29:00] [V] [TRT] Tactic: 4 time 0.076656 [03/13/2022-08:29:00] [V] [TRT] Tactic: 5 time 0.076912 [03/13/2022-08:29:00] [V] [TRT] Tactic: 6 time 0.081572 [03/13/2022-08:29:00] [V] [TRT] Tactic: 7 time 0.077104 [03/13/2022-08:29:00] [V] [TRT] Tactic: 8 time 0.07668 [03/13/2022-08:29:00] [V] [TRT] Tactic: 9 time 0.076712 [03/13/2022-08:29:00] [V] [TRT] Tactic: 28 time 0.092028 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 4 Time: 0.076656 [03/13/2022-08:29:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [03/13/2022-08:29:00] [V] [TRT] [03/13/2022-08:29:00] [V] [TRT] *************** Autotuning format combination: Float(1,160,19200:32,57600) -> Float(1,160,19200:32,57600) *************** [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_22, Mul_23) (PointWise) [03/13/2022-08:29:00] [V] [TRT] Tactic: 128 time 0.203304 [03/13/2022-08:29:00] [V] [TRT] Tactic: 256 time 0.20502 [03/13/2022-08:29:00] [V] [TRT] Tactic: 512 time 0.231428 [03/13/2022-08:29:00] [V] [TRT] Tactic: -32 time 0.261028 [03/13/2022-08:29:00] [V] [TRT] Tactic: -64 time 0.160924 [03/13/2022-08:29:00] [V] [TRT] Tactic: -128 time 0.161952 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: -64 Time: 0.160924 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_22, Mul_23) (PointWiseV2) [03/13/2022-08:29:00] [V] [TRT] Tactic: 24 time 0.106976 [03/13/2022-08:29:00] [V] [TRT] Tactic: 25 time 0.109324 [03/13/2022-08:29:00] [V] [TRT] Tactic: 26 time 0.110356 [03/13/2022-08:29:00] [V] [TRT] Tactic: 27 time 0.110584 [03/13/2022-08:29:00] [V] [TRT] Tactic: 31 time 0.106668 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 31 Time: 0.106668 [03/13/2022-08:29:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [03/13/2022-08:29:00] [V] [TRT] [03/13/2022-08:29:00] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200,1536000) -> Half(1,160,19200,1536000) *************** [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_22, Mul_23) (PointWise) [03/13/2022-08:29:00] [V] [TRT] Tactic: 128 time 0.136468 [03/13/2022-08:29:00] [V] [TRT] Tactic: 256 time 0.113204 [03/13/2022-08:29:00] [V] [TRT] Tactic: 512 time 0.110292 [03/13/2022-08:29:00] [V] [TRT] Tactic: -32 time 0.18374 [03/13/2022-08:29:00] [V] [TRT] Tactic: -64 time 0.125712 [03/13/2022-08:29:00] [V] [TRT] Tactic: -128 time 0.12574 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 512 Time: 0.110292 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_22, Mul_23) (PointWiseV2) [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 0.086136 [03/13/2022-08:29:00] [V] [TRT] Tactic: 1 time 0.06994 [03/13/2022-08:29:00] [V] [TRT] Tactic: 2 time 0.056476 [03/13/2022-08:29:00] [V] [TRT] Tactic: 3 time 0.063768 [03/13/2022-08:29:00] [V] [TRT] Tactic: 4 time 0.046648 [03/13/2022-08:29:00] [V] [TRT] Tactic: 5 time 0.041012 [03/13/2022-08:29:00] [V] [TRT] Tactic: 6 time 0.063348 [03/13/2022-08:29:00] [V] [TRT] Tactic: 7 time 0.045056 [03/13/2022-08:29:00] [V] [TRT] Tactic: 8 time 0.04118 [03/13/2022-08:29:00] [V] [TRT] Tactic: 9 time 0.040972 [03/13/2022-08:29:00] [V] [TRT] Tactic: 28 time 0.085836 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 9 Time: 0.040972 [03/13/2022-08:29:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:29:00] [V] [TRT] [03/13/2022-08:29:00] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200:2,768000) -> Half(1,160,19200:2,768000) *************** [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_22, Mul_23) (PointWise) [03/13/2022-08:29:00] [V] [TRT] Tactic: 128 time 0.135808 [03/13/2022-08:29:00] [V] [TRT] Tactic: 256 time 0.113784 [03/13/2022-08:29:00] [V] [TRT] Tactic: 512 time 0.110396 [03/13/2022-08:29:00] [V] [TRT] Tactic: -32 time 0.183672 [03/13/2022-08:29:00] [V] [TRT] Tactic: -64 time 0.12592 [03/13/2022-08:29:00] [V] [TRT] Tactic: -128 time 0.125408 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 512 Time: 0.110396 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_22, Mul_23) (PointWiseV2) [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 0.057344 [03/13/2022-08:29:00] [V] [TRT] Tactic: 1 time 0.048724 [03/13/2022-08:29:00] [V] [TRT] Tactic: 2 time 0.04988 [03/13/2022-08:29:00] [V] [TRT] Tactic: 3 time 0.047308 [03/13/2022-08:29:00] [V] [TRT] Tactic: 4 time 0.047032 [03/13/2022-08:29:00] [V] [TRT] Tactic: 5 time 0.051676 [03/13/2022-08:29:00] [V] [TRT] Tactic: 6 time 0.049228 [03/13/2022-08:29:00] [V] [TRT] Tactic: 7 time 0.048324 [03/13/2022-08:29:00] [V] [TRT] Tactic: 8 time 0.05318 [03/13/2022-08:29:00] [V] [TRT] Tactic: 9 time 0.070828 [03/13/2022-08:29:00] [V] [TRT] Tactic: 10 time 0.089452 [03/13/2022-08:29:00] [V] [TRT] Tactic: 11 time 0.071576 [03/13/2022-08:29:00] [V] [TRT] Tactic: 12 time 0.058368 [03/13/2022-08:29:00] [V] [TRT] Tactic: 13 time 0.06502 [03/13/2022-08:29:00] [V] [TRT] Tactic: 14 time 0.047336 [03/13/2022-08:29:00] [V] [TRT] Tactic: 15 time 0.041812 [03/13/2022-08:29:00] [V] [TRT] Tactic: 16 time 0.064028 [03/13/2022-08:29:00] [V] [TRT] Tactic: 17 time 0.04568 [03/13/2022-08:29:00] [V] [TRT] Tactic: 18 time 0.041172 [03/13/2022-08:29:00] [V] [TRT] Tactic: 19 time 0.041 [03/13/2022-08:29:00] [V] [TRT] Tactic: 28 time 0.057344 [03/13/2022-08:29:00] [V] [TRT] Tactic: 29 time 0.088824 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 19 Time: 0.041 [03/13/2022-08:29:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 19 [03/13/2022-08:29:00] [V] [TRT] [03/13/2022-08:29:00] [V] [TRT] *************** Autotuning format combination: Half(10,1600,1:8,192000) -> Half(10,1600,1:8,192000) *************** [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_22, Mul_23) (PointWise) [03/13/2022-08:29:00] [V] [TRT] Tactic: 128 time 0.1369 [03/13/2022-08:29:00] [V] [TRT] Tactic: 256 time 0.113388 [03/13/2022-08:29:00] [V] [TRT] Tactic: 512 time 0.110532 [03/13/2022-08:29:00] [V] [TRT] Tactic: -32 time 0.183604 [03/13/2022-08:29:00] [V] [TRT] Tactic: -64 time 0.125684 [03/13/2022-08:29:00] [V] [TRT] Tactic: -128 time 0.125836 [03/13/2022-08:29:00] [V] [TRT] Fastest Tactic: 512 Time: 0.110532 [03/13/2022-08:29:00] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_22, Mul_23) (PointWiseV2) [03/13/2022-08:29:00] [V] [TRT] Tactic: 0 time 0.047136 [03/13/2022-08:29:00] [V] [TRT] Tactic: 1 time 0.04872 [03/13/2022-08:29:00] [V] [TRT] Tactic: 2 time 0.058636 [03/13/2022-08:29:00] [V] [TRT] Tactic: 3 time 0.049212 [03/13/2022-08:29:00] [V] [TRT] Tactic: 4 time 0.059796 [03/13/2022-08:29:00] [V] [TRT] Tactic: 5 time 0.077168 [03/13/2022-08:29:00] [V] [TRT] Tactic: 6 time 0.0492 [03/13/2022-08:29:00] [V] [TRT] Tactic: 7 time 0.061948 [03/13/2022-08:29:00] [V] [TRT] Tactic: 8 time 0.075312 [03/13/2022-08:29:00] [V] [TRT] Tactic: 9 time 0.101096 [03/13/2022-08:29:00] [V] [TRT] Tactic: 10 time 0.04242 [03/13/2022-08:29:00] [V] [TRT] Tactic: 11 time 0.043076 [03/13/2022-08:29:00] [V] [TRT] Tactic: 12 time 0.047252 [03/13/2022-08:29:00] [V] [TRT] Tactic: 13 time 0.043372 [03/13/2022-08:29:00] [V] [TRT] Tactic: 14 time 0.048616 [03/13/2022-08:29:00] [V] [TRT] Tactic: 15 time 0.06134 [03/13/2022-08:29:00] [V] [TRT] Tactic: 16 time 0.045208 [03/13/2022-08:29:00] [V] [TRT] Tactic: 17 time 0.05014 [03/13/2022-08:29:00] [V] [TRT] Tactic: 18 time 0.063588 [03/13/2022-08:29:01] [V] [TRT] Tactic: 19 time 0.084292 [03/13/2022-08:29:01] [V] [TRT] Tactic: 20 time 0.059056 [03/13/2022-08:29:01] [V] [TRT] Tactic: 21 time 0.049108 [03/13/2022-08:29:01] [V] [TRT] Tactic: 22 time 0.047616 [03/13/2022-08:29:01] [V] [TRT] Tactic: 23 time 0.049308 [03/13/2022-08:29:01] [V] [TRT] Tactic: 24 time 0.089684 [03/13/2022-08:29:01] [V] [TRT] Tactic: 25 time 0.071516 [03/13/2022-08:29:01] [V] [TRT] Tactic: 26 time 0.064472 [03/13/2022-08:29:01] [V] [TRT] Tactic: 27 time 0.064332 [03/13/2022-08:29:01] [V] [TRT] Tactic: 28 time 0.047036 [03/13/2022-08:29:01] [V] [TRT] Tactic: 29 time 0.042628 [03/13/2022-08:29:01] [V] [TRT] Tactic: 30 time 0.058748 [03/13/2022-08:29:01] [V] [TRT] Tactic: 31 time 0.08878 [03/13/2022-08:29:01] [V] [TRT] Fastest Tactic: 10 Time: 0.04242 [03/13/2022-08:29:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [03/13/2022-08:29:01] [V] [TRT] [03/13/2022-08:29:01] [V] [TRT] *************** Autotuning format combination: Float(1,160,19200,1536000) -> Float(1,160,19200,1536000) *************** [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (FusedConvActConvolution) [03/13/2022-08:29:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (CaskConvolution) [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 1754569683116234317 time 0.15588 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 1825138533642645384 time 0.157092 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 2733356012094739613 time 0.17016 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 3915320020053085238 time 0.157032 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 6808617066150061604 time 0.161112 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 9091006216302412844 time 0.156092 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -8060443123034038864 time 0.163492 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -4420849921117327522 time 0.185548 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -3946921629105938337 time 0.168 [03/13/2022-08:29:01] [V] [TRT] Fastest Tactic: 1754569683116234317 Time: 0.15588 [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (CudaConvolution) [03/13/2022-08:29:01] [V] [TRT] Tactic: 0 time 0.312756 [03/13/2022-08:29:01] [V] [TRT] Tactic: 2 time 0.41978 [03/13/2022-08:29:01] [V] [TRT] Tactic: 5 time 0.585668 [03/13/2022-08:29:01] [V] [TRT] Tactic: 57 time 0.234724 [03/13/2022-08:29:01] [V] [TRT] Fastest Tactic: 57 Time: 0.234724 [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (CudaDepthwiseConvolution) [03/13/2022-08:29:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1754569683116234317 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200,1536000) -> Half(1,160,19200,1536000) *************** [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (FusedConvActConvolution) [03/13/2022-08:29:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (CaskConvolution) [03/13/2022-08:29:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (CudaConvolution) [03/13/2022-08:29:01] [V] [TRT] Tactic: 0 time 0.306236 [03/13/2022-08:29:01] [V] [TRT] Tactic: 1 time 0.230404 [03/13/2022-08:29:01] [V] [TRT] Tactic: 2 time 0.386896 [03/13/2022-08:29:01] [V] [TRT] Tactic: 4 skipped. Scratch requested: 3423953920, available: 16777216 [03/13/2022-08:29:01] [V] [TRT] Tactic: 5 time 0.573472 [03/13/2022-08:29:01] [V] [TRT] Fastest Tactic: 1 Time: 0.230404 [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (CudaDepthwiseConvolution) [03/13/2022-08:29:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:29:01] [V] [TRT] [03/13/2022-08:29:01] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200:2,768000) -> Half(1,160,19200,1536000) *************** [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (FusedConvActConvolution) [03/13/2022-08:29:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (CaskConvolution) [03/13/2022-08:29:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (CudaConvolution) [03/13/2022-08:29:01] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (CudaDepthwiseConvolution) [03/13/2022-08:29:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:01] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200:2,768000) -> Half(1,160,19200:2,768000) *************** [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (FusedConvActConvolution) [03/13/2022-08:29:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (CaskConvolution) [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 1651411198763708804 time 0.092944 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 2418518597804310654 time 0.093452 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 4318470497547290900 time 0.093176 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 4930470141256631146 time 0.0965 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 8292881859266835088 time 0.096076 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 8401509141903434922 time 0.092508 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -8654297089785671176 time 0.115048 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -7516584506774355935 time 0.090924 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -7140760933967189247 time 0.092372 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -6004726995029373073 time 0.09604 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -5719726816705110014 time 0.115728 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -4097850214384059472 time 0.092476 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -3717489476759089008 time 0.092032 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -3689982367035295496 time 0.11526 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -2640575123064142123 time 0.087428 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -2534402059426524406 time 0.087648 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -2027588946874785071 time 0.0961 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -1968398013367819764 time 0.115748 [03/13/2022-08:29:01] [V] [TRT] Fastest Tactic: -2640575123064142123 Time: 0.087428 [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (CudaConvolution) [03/13/2022-08:29:01] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (CudaDepthwiseConvolution) [03/13/2022-08:29:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2640575123064142123 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:01] [V] [TRT] *************** Autotuning format combination: Half(10,1600,1:8,192000) -> Float(1,160,19200,1536000) *************** [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (FusedConvActConvolution) [03/13/2022-08:29:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (CaskConvolution) [03/13/2022-08:29:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (CudaConvolution) [03/13/2022-08:29:01] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (CudaDepthwiseConvolution) [03/13/2022-08:29:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:01] [V] [TRT] *************** Autotuning format combination: Half(10,1600,1:8,192000) -> Half(10,1600,1:8,192000) *************** [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (FusedConvActConvolution) [03/13/2022-08:29:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:01] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (CaskConvolution) [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:01] [V] [TRT] Tactic: 9576651994278528 time 0.696816 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 1179757074518529353 time 0.993948 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 2105695814191699972 time 1.3507 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 2148106709480872763 time 0.708548 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 2410442691266548717 time 1.06458 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 3041642431972138763 time 0.940136 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 3754069740140581927 time 1.34656 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 4555462412611657028 time 0.707872 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 5666160310350604399 time 1.34556 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:01] [V] [TRT] Tactic: 5876997871499382316 time 1.28988 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 5925270497649423688 time 1.45825 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 6680916730816870145 time 1.79485 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 7158029511300006471 time 1.35272 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 7859952145590271433 time 1.79403 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: 8283847742354150423 time 1.34752 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -8992262742606384444 time 0.708532 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -8391760416076885205 time 1.45912 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -6273232454637933930 time 0.995024 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:01] [V] [TRT] Tactic: -5925110308892264213 time 1.28961 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -5818527483287834165 time 0.994776 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:01] [V] [TRT] Tactic: -4908848143422991657 time 0.697732 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -4534876761957424274 time 1.45837 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -3237051169894153788 time 1.35222 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -3136088851200285532 time 0.940952 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:01] [V] [TRT] Tactic: -2586046817576862066 time 1.06336 [03/13/2022-08:29:01] [V] [TRT] Conv_37 || Conv_24 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:02] [V] [TRT] Tactic: -2422160065350346448 time 1.79274 [03/13/2022-08:29:02] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:02] [V] [TRT] Tactic: -1216445540764179377 time 1.06174 [03/13/2022-08:29:02] [V] [TRT] Conv_37 || Conv_24 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:02] [V] [TRT] Tactic: -229563042944049199 time 0.940868 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 9576651994278528 Time: 0.696816 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (CudaConvolution) [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.362704 [03/13/2022-08:29:02] [V] [TRT] Tactic: 1 time 0.338396 [03/13/2022-08:29:02] [V] [TRT] Tactic: 2 time 0.87216 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 1 Time: 0.338396 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: Conv_37 || Conv_24 (CudaDepthwiseConvolution) [03/13/2022-08:29:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:29:02] [V] [TRT] [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.150692 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 1.05629 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.150692 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.08708 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.096504 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.08708 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.188504 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.076836 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.076836 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.148964 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.067944 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.067944 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.090412 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.088932 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.088932 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.152512 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 1.01215 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.152512 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.188388 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.074116 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.074116 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.150352 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.05914 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.05914 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.19816 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.065892 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.065892 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.148116 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.989952 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.148116 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.1954 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.062484 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.062484 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.145912 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.05548 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.05548 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.16718 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.070836 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.070836 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.140552 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 1.59456 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.140552 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.16662 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.051108 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.051108 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.187548 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.051484 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.051484 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.102 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.524256 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.102 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.050108 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.047612 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.047612 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.113372 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.050072 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.050072 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.099532 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.067476 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.067476 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.232632 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.306092 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.232632 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.10982 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.759272 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.10982 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.213544 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.293936 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.213544 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.134168 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.320724 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.134168 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.109136 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.056284 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.056284 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.051536 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.04718 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.04718 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.101508 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.508788 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.101508 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.114264 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.039812 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.039812 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.101204 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.043588 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.043588 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.10002 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.035908 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.035908 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.100604 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.49652 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.100604 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.100328 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.044028 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.044028 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.098328 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.043652 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.043652 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.116956 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.051744 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.051744 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.096844 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.789852 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.096844 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.11556 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.041 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.041 [03/13/2022-08:29:02] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:02] [V] [TRT] Tactic: 1002 time 0.114432 [03/13/2022-08:29:02] [V] [TRT] Tactic: 0 time 0.041644 [03/13/2022-08:29:02] [V] [TRT] Fastest Tactic: 0 Time: 0.041644 [03/13/2022-08:29:02] [V] [TRT] *************** Autotuning format combination: Float(1,160,19200,1536000) -> Float(1,160,19200,768000) *************** [03/13/2022-08:29:04] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_26, Mul_27) (PointWise) [03/13/2022-08:29:04] [V] [TRT] Tactic: 128 time 0.079544 [03/13/2022-08:29:04] [V] [TRT] Tactic: 256 time 0.080796 [03/13/2022-08:29:04] [V] [TRT] Tactic: 512 time 0.090008 [03/13/2022-08:29:04] [V] [TRT] Tactic: -32 time 0.118524 [03/13/2022-08:29:04] [V] [TRT] Tactic: -64 time 0.073884 [03/13/2022-08:29:04] [V] [TRT] Tactic: -128 time 0.071536 [03/13/2022-08:29:04] [V] [TRT] Fastest Tactic: -128 Time: 0.071536 [03/13/2022-08:29:04] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_26, Mul_27) (PointWiseV2) [03/13/2022-08:29:04] [V] [TRT] Tactic: 0 time 0.051824 [03/13/2022-08:29:04] [V] [TRT] Tactic: 1 time 0.043272 [03/13/2022-08:29:04] [V] [TRT] Tactic: 2 time 0.04114 [03/13/2022-08:29:04] [V] [TRT] Tactic: 3 time 0.042828 [03/13/2022-08:29:04] [V] [TRT] Tactic: 4 time 0.041424 [03/13/2022-08:29:04] [V] [TRT] Tactic: 5 time 0.041088 [03/13/2022-08:29:04] [V] [TRT] Tactic: 6 time 0.044504 [03/13/2022-08:29:04] [V] [TRT] Tactic: 7 time 0.041736 [03/13/2022-08:29:04] [V] [TRT] Tactic: 8 time 0.040904 [03/13/2022-08:29:04] [V] [TRT] Tactic: 9 time 0.040768 [03/13/2022-08:29:04] [V] [TRT] Tactic: 28 time 0.052044 [03/13/2022-08:29:04] [V] [TRT] Fastest Tactic: 9 Time: 0.040768 [03/13/2022-08:29:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:29:04] [V] [TRT] [03/13/2022-08:29:04] [V] [TRT] *************** Autotuning format combination: Float(1,160,19200:32,57600) -> Float(1,160,19200:32,38400) *************** [03/13/2022-08:29:04] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_26, Mul_27) (PointWise) [03/13/2022-08:29:04] [V] [TRT] Tactic: 128 time 0.1376 [03/13/2022-08:29:04] [V] [TRT] Tactic: 256 time 0.138832 [03/13/2022-08:29:04] [V] [TRT] Tactic: 512 time 0.156036 [03/13/2022-08:29:04] [V] [TRT] Tactic: -32 time 0.177804 [03/13/2022-08:29:04] [V] [TRT] Tactic: -64 time 0.111252 [03/13/2022-08:29:04] [V] [TRT] Tactic: -128 time 0.110948 [03/13/2022-08:29:04] [V] [TRT] Fastest Tactic: -128 Time: 0.110948 [03/13/2022-08:29:04] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_26, Mul_27) (PointWiseV2) [03/13/2022-08:29:04] [V] [TRT] Tactic: 24 time 0.072888 [03/13/2022-08:29:04] [V] [TRT] Tactic: 25 time 0.07828 [03/13/2022-08:29:04] [V] [TRT] Tactic: 26 time 0.075732 [03/13/2022-08:29:04] [V] [TRT] Tactic: 27 time 0.076536 [03/13/2022-08:29:04] [V] [TRT] Tactic: 31 time 0.073096 [03/13/2022-08:29:04] [V] [TRT] Fastest Tactic: 24 Time: 0.072888 [03/13/2022-08:29:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [03/13/2022-08:29:04] [V] [TRT] [03/13/2022-08:29:04] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200,1536000) -> Half(1,160,19200,768000) *************** [03/13/2022-08:29:06] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_26, Mul_27) (PointWise) [03/13/2022-08:29:06] [V] [TRT] Tactic: 128 time 0.10224 [03/13/2022-08:29:06] [V] [TRT] Tactic: 256 time 0.081656 [03/13/2022-08:29:06] [V] [TRT] Tactic: 512 time 0.0795 [03/13/2022-08:29:06] [V] [TRT] Tactic: -32 time 0.131576 [03/13/2022-08:29:06] [V] [TRT] Tactic: -64 time 0.089152 [03/13/2022-08:29:06] [V] [TRT] Tactic: -128 time 0.087748 [03/13/2022-08:29:06] [V] [TRT] Fastest Tactic: 512 Time: 0.0795 [03/13/2022-08:29:06] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_26, Mul_27) (PointWiseV2) [03/13/2022-08:29:06] [V] [TRT] Tactic: 0 time 0.060232 [03/13/2022-08:29:06] [V] [TRT] Tactic: 1 time 0.047536 [03/13/2022-08:29:06] [V] [TRT] Tactic: 2 time 0.040136 [03/13/2022-08:29:06] [V] [TRT] Tactic: 3 time 0.04232 [03/13/2022-08:29:06] [V] [TRT] Tactic: 4 time 0.032816 [03/13/2022-08:29:06] [V] [TRT] Tactic: 5 time 0.02758 [03/13/2022-08:29:06] [V] [TRT] Tactic: 6 time 0.041692 [03/13/2022-08:29:06] [V] [TRT] Tactic: 7 time 0.030484 [03/13/2022-08:29:06] [V] [TRT] Tactic: 8 time 0.025056 [03/13/2022-08:29:06] [V] [TRT] Tactic: 9 time 0.023412 [03/13/2022-08:29:06] [V] [TRT] Tactic: 28 time 0.060012 [03/13/2022-08:29:06] [V] [TRT] Fastest Tactic: 9 Time: 0.023412 [03/13/2022-08:29:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:29:06] [V] [TRT] [03/13/2022-08:29:06] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200:2,768000) -> Half(1,160,19200:2,384000) *************** [03/13/2022-08:29:09] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_26, Mul_27) (PointWise) [03/13/2022-08:29:09] [V] [TRT] Tactic: 128 time 0.101548 [03/13/2022-08:29:09] [V] [TRT] Tactic: 256 time 0.081368 [03/13/2022-08:29:09] [V] [TRT] Tactic: 512 time 0.079484 [03/13/2022-08:29:09] [V] [TRT] Tactic: -32 time 0.131744 [03/13/2022-08:29:09] [V] [TRT] Tactic: -64 time 0.088736 [03/13/2022-08:29:09] [V] [TRT] Tactic: -128 time 0.087692 [03/13/2022-08:29:09] [V] [TRT] Fastest Tactic: 512 Time: 0.079484 [03/13/2022-08:29:09] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_26, Mul_27) (PointWiseV2) [03/13/2022-08:29:09] [V] [TRT] Tactic: 0 time 0.041268 [03/13/2022-08:29:09] [V] [TRT] Tactic: 1 time 0.034368 [03/13/2022-08:29:09] [V] [TRT] Tactic: 2 time 0.035408 [03/13/2022-08:29:09] [V] [TRT] Tactic: 3 time 0.031836 [03/13/2022-08:29:09] [V] [TRT] Tactic: 4 time 0.03212 [03/13/2022-08:29:09] [V] [TRT] Tactic: 5 time 0.034108 [03/13/2022-08:29:09] [V] [TRT] Tactic: 6 time 0.032952 [03/13/2022-08:29:09] [V] [TRT] Tactic: 7 time 0.032672 [03/13/2022-08:29:09] [V] [TRT] Tactic: 8 time 0.034496 [03/13/2022-08:29:09] [V] [TRT] Tactic: 9 time 0.041384 [03/13/2022-08:29:09] [V] [TRT] Tactic: 10 time 0.063196 [03/13/2022-08:29:09] [V] [TRT] Tactic: 11 time 0.048812 [03/13/2022-08:29:09] [V] [TRT] Tactic: 12 time 0.041136 [03/13/2022-08:29:09] [V] [TRT] Tactic: 13 time 0.04268 [03/13/2022-08:29:09] [V] [TRT] Tactic: 14 time 0.033352 [03/13/2022-08:29:09] [V] [TRT] Tactic: 15 time 0.02948 [03/13/2022-08:29:09] [V] [TRT] Tactic: 16 time 0.042116 [03/13/2022-08:29:09] [V] [TRT] Tactic: 17 time 0.030684 [03/13/2022-08:29:09] [V] [TRT] Tactic: 18 time 0.025344 [03/13/2022-08:29:09] [V] [TRT] Tactic: 19 time 0.025284 [03/13/2022-08:29:09] [V] [TRT] Tactic: 28 time 0.041228 [03/13/2022-08:29:09] [V] [TRT] Tactic: 29 time 0.063116 [03/13/2022-08:29:09] [V] [TRT] Fastest Tactic: 19 Time: 0.025284 [03/13/2022-08:29:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 19 [03/13/2022-08:29:09] [V] [TRT] [03/13/2022-08:29:09] [V] [TRT] *************** Autotuning format combination: Half(10,1600,1:8,192000) -> Half(5,800,1:8,96000) *************** [03/13/2022-08:29:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_26, Mul_27) (PointWise) [03/13/2022-08:29:14] [V] [TRT] Tactic: 128 time 0.102524 [03/13/2022-08:29:14] [V] [TRT] Tactic: 256 time 0.082008 [03/13/2022-08:29:14] [V] [TRT] Tactic: 512 time 0.079616 [03/13/2022-08:29:14] [V] [TRT] Tactic: -32 time 0.224356 [03/13/2022-08:29:14] [V] [TRT] Tactic: -64 time 0.227272 [03/13/2022-08:29:14] [V] [TRT] Tactic: -128 time 0.227468 [03/13/2022-08:29:14] [V] [TRT] Fastest Tactic: 512 Time: 0.079616 [03/13/2022-08:29:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_26, Mul_27) (PointWiseV2) [03/13/2022-08:29:14] [V] [TRT] Tactic: 0 time 0.1164 [03/13/2022-08:29:14] [V] [TRT] Tactic: 1 time 0.132064 [03/13/2022-08:29:14] [V] [TRT] Tactic: 2 time 0.132616 [03/13/2022-08:29:14] [V] [TRT] Tactic: 3 time 0.175832 [03/13/2022-08:29:14] [V] [TRT] Tactic: 4 time 0.162348 [03/13/2022-08:29:15] [V] [TRT] Tactic: 5 time 0.144848 [03/13/2022-08:29:15] [V] [TRT] Tactic: 6 time 0.274408 [03/13/2022-08:29:15] [V] [TRT] Tactic: 7 time 0.212732 [03/13/2022-08:29:15] [V] [TRT] Tactic: 8 time 0.187152 [03/13/2022-08:29:15] [V] [TRT] Tactic: 9 time 0.212044 [03/13/2022-08:29:15] [V] [TRT] Tactic: 10 time 0.080552 [03/13/2022-08:29:15] [V] [TRT] Tactic: 11 time 0.08868 [03/13/2022-08:29:15] [V] [TRT] Tactic: 12 time 0.086532 [03/13/2022-08:29:15] [V] [TRT] Tactic: 13 time 0.110504 [03/13/2022-08:29:15] [V] [TRT] Tactic: 14 time 0.105392 [03/13/2022-08:29:15] [V] [TRT] Tactic: 15 time 0.092544 [03/13/2022-08:29:15] [V] [TRT] Tactic: 16 time 0.161176 [03/13/2022-08:29:15] [V] [TRT] Tactic: 17 time 0.135152 [03/13/2022-08:29:15] [V] [TRT] Tactic: 18 time 0.11916 [03/13/2022-08:29:15] [V] [TRT] Tactic: 19 time 0.116692 [03/13/2022-08:29:15] [V] [TRT] Tactic: 20 time 0.065596 [03/13/2022-08:29:15] [V] [TRT] Tactic: 21 time 0.07028 [03/13/2022-08:29:15] [V] [TRT] Tactic: 22 time 0.082692 [03/13/2022-08:29:15] [V] [TRT] Tactic: 23 time 0.110556 [03/13/2022-08:29:15] [V] [TRT] Tactic: 24 time 0.095624 [03/13/2022-08:29:15] [V] [TRT] Tactic: 25 time 0.063956 [03/13/2022-08:29:15] [V] [TRT] Tactic: 26 time 0.072304 [03/13/2022-08:29:15] [V] [TRT] Tactic: 27 time 0.09208 [03/13/2022-08:29:15] [V] [TRT] Tactic: 28 time 0.032492 [03/13/2022-08:29:15] [V] [TRT] Tactic: 29 time 0.030984 [03/13/2022-08:29:15] [V] [TRT] Tactic: 30 time 0.042952 [03/13/2022-08:29:15] [V] [TRT] Tactic: 31 time 0.063644 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 29 Time: 0.030984 [03/13/2022-08:29:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 29 [03/13/2022-08:29:15] [V] [TRT] [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.126292 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.514752 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.126292 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.054336 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.065328 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.054336 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.14268 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.048344 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.048344 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.125192 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.051752 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.051752 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.2388 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.304204 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.2388 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.225384 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.29294 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.225384 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.174796 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.319724 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.174796 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.140136 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.066232 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.066232 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.054492 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.057124 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.054492 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.121128 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.500512 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.121128 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.136104 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.043336 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.043336 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.120172 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.04396 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.04396 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.120876 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.039784 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.039784 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.118976 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.502332 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.118976 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.120404 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.037392 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.037392 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.11812 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.044228 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.044228 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.136528 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.047604 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.047604 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.112936 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.759772 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.112936 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.136208 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.037836 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.037836 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.131176 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.037924 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.037924 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.050752 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.061848 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.050752 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.135788 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.045476 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.045476 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.101144 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.051372 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.051372 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.238244 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.30592 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.238244 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.225152 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.293004 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.225152 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.135428 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.321352 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.135428 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.109232 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.055996 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.055996 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.04808 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.047612 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.047612 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.1152 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.039788 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.039788 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.100476 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.043604 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.043604 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.101028 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.03528 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.03528 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.100268 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.03324 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.03324 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.099536 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.043668 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.043668 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.11564 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.048336 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.048336 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.115048 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.038088 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.038088 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:15] [V] [TRT] Tactic: 1002 time 0.110176 [03/13/2022-08:29:15] [V] [TRT] Tactic: 0 time 0.038172 [03/13/2022-08:29:15] [V] [TRT] Fastest Tactic: 0 Time: 0.038172 [03/13/2022-08:29:15] [V] [TRT] *************** Autotuning format combination: Float(1,160,19200,768000) -> Float(1,160,19200,768000) *************** [03/13/2022-08:29:15] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:29:15] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:29:15] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:29:15] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:15] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:29:15] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:29:15] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:29:15] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:29:15] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:29:15] [V] [TRT] --------------- Timing Runner: Conv_28 (FusedConvActConvolution) [03/13/2022-08:29:15] [V] [TRT] Tactic: 589823 time 0.211272 [03/13/2022-08:29:15] [V] [TRT] Tactic: 655359 time 0.169544 [03/13/2022-08:29:15] [V] [TRT] Tactic: 786431 time 0.20304 [03/13/2022-08:29:15] [V] [TRT] Tactic: 851967 time 0.235272 [03/13/2022-08:29:15] [V] [TRT] Tactic: 1310719 time 0.180452 [03/13/2022-08:29:15] [V] [TRT] Tactic: 1376255 time 0.183656 [03/13/2022-08:29:15] [V] [TRT] Tactic: 1507327 time 0.178096 [03/13/2022-08:29:15] [V] [TRT] Tactic: 1638399 time 0.217204 [03/13/2022-08:29:15] [V] [TRT] Tactic: 1835007 time 0.214672 [03/13/2022-08:29:15] [V] [TRT] Tactic: 1900543 time 0.18944 [03/13/2022-08:29:15] [V] [TRT] Tactic: 2162687 time 0.18508 [03/13/2022-08:29:15] [V] [TRT] Tactic: 2293759 time 0.187512 [03/13/2022-08:29:15] [V] [TRT] Tactic: 2359295 time 0.164456 [03/13/2022-08:29:15] [V] [TRT] Tactic: 2686975 time 0.185396 [03/13/2022-08:29:15] [V] [TRT] Tactic: 3080191 time 0.180816 [03/13/2022-08:29:15] [V] [TRT] Tactic: 3342335 time 0.181404 [03/13/2022-08:29:15] [V] [TRT] Tactic: 3407871 time 0.167864 [03/13/2022-08:29:15] [V] [TRT] Tactic: 3538943 time 0.169728 [03/13/2022-08:29:15] [V] [TRT] Tactic: 3670015 time 0.198468 [03/13/2022-08:29:15] [V] [TRT] Tactic: 3932159 time 0.182968 [03/13/2022-08:29:15] [V] [TRT] Tactic: 4063231 time 0.2306 [03/13/2022-08:29:15] [V] [TRT] Tactic: 4194303 time 0.1893 [03/13/2022-08:29:16] [V] [TRT] Tactic: 4325375 time 0.192556 [03/13/2022-08:29:16] [V] [TRT] Tactic: 4521983 time 0.1845 [03/13/2022-08:29:16] [V] [TRT] Tactic: 4980735 time 0.183348 [03/13/2022-08:29:16] [V] [TRT] Tactic: 5242879 time 0.175808 [03/13/2022-08:29:16] [V] [TRT] Tactic: 5439487 time 0.318188 [03/13/2022-08:29:16] [V] [TRT] Tactic: 5570559 time 0.181712 [03/13/2022-08:29:16] [V] [TRT] Tactic: 5636095 time 0.23082 [03/13/2022-08:29:16] [V] [TRT] Tactic: 5701631 time 0.203852 [03/13/2022-08:29:16] [V] [TRT] Tactic: 5767167 time 0.70336 [03/13/2022-08:29:16] [V] [TRT] Tactic: 5832703 time 0.167252 [03/13/2022-08:29:16] [V] [TRT] Tactic: 6029311 time 0.19894 [03/13/2022-08:29:16] [V] [TRT] Tactic: 6225919 time 0.178344 [03/13/2022-08:29:16] [V] [TRT] Tactic: 6422527 time 0.186796 [03/13/2022-08:29:16] [V] [TRT] Tactic: 6815743 time 0.218608 [03/13/2022-08:29:16] [V] [TRT] Tactic: 6946815 time 0.295532 [03/13/2022-08:29:16] [V] [TRT] Tactic: 7077887 time 0.168484 [03/13/2022-08:29:16] [V] [TRT] Tactic: 7143423 time 0.275424 [03/13/2022-08:29:16] [V] [TRT] Tactic: 7208959 time 0.183252 [03/13/2022-08:29:16] [V] [TRT] Tactic: 7405567 time 0.193856 [03/13/2022-08:29:16] [V] [TRT] Tactic: 7536639 time 0.239896 [03/13/2022-08:29:16] [V] [TRT] Tactic: 7602175 time 0.201988 [03/13/2022-08:29:16] [V] [TRT] Tactic: 7733247 time 0.171304 [03/13/2022-08:29:16] [V] [TRT] Tactic: 7798783 time 0.203588 [03/13/2022-08:29:16] [V] [TRT] Tactic: 8191999 time 0.242956 [03/13/2022-08:29:16] [V] [TRT] Tactic: 8323071 time 0.221868 [03/13/2022-08:29:16] [V] [TRT] Tactic: 8650751 time 0.231408 [03/13/2022-08:29:16] [V] [TRT] Tactic: 8716287 time 0.225484 [03/13/2022-08:29:16] [V] [TRT] Tactic: 9895935 time 0.189564 [03/13/2022-08:29:16] [V] [TRT] Tactic: 10223615 time 0.18518 [03/13/2022-08:29:16] [V] [TRT] Tactic: 10551295 time 0.213772 [03/13/2022-08:29:16] [V] [TRT] Tactic: 10747903 time 0.165016 [03/13/2022-08:29:16] [V] [TRT] Tactic: 10944511 time 0.1832 [03/13/2022-08:29:16] [V] [TRT] Fastest Tactic: 2359295 Time: 0.164456 [03/13/2022-08:29:16] [V] [TRT] --------------- Timing Runner: Conv_28 (CaskConvolution) [03/13/2022-08:29:16] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Tactic: 1754569683116234317 time 0.094752 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Tactic: 1825138533642645384 time 0.09624 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Tactic: 2733356012094739613 time 0.074108 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Tactic: 3915320020053085238 time 0.09566 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Tactic: 6808617066150061604 time 0.054488 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Tactic: 9091006216302412844 time 0.054136 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Tactic: -8060443123034038864 time 0.05534 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Tactic: -4420849921117327522 time 0.079596 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Tactic: -3946921629105938337 time 0.07416 [03/13/2022-08:29:16] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.054136 [03/13/2022-08:29:16] [V] [TRT] --------------- Timing Runner: Conv_28 (CudaConvolution) [03/13/2022-08:29:16] [V] [TRT] Tactic: 0 time 0.124592 [03/13/2022-08:29:16] [V] [TRT] Tactic: 2 time 1.31759 [03/13/2022-08:29:16] [V] [TRT] Tactic: 5 time 0.273864 [03/13/2022-08:29:16] [V] [TRT] Tactic: 57 time 0.12496 [03/13/2022-08:29:16] [V] [TRT] Fastest Tactic: 0 Time: 0.124592 [03/13/2022-08:29:16] [V] [TRT] --------------- Timing Runner: Conv_28 (CudaDepthwiseConvolution) [03/13/2022-08:29:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:29:16] [V] [TRT] [03/13/2022-08:29:16] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:29:16] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200,768000) -> Half(1,160,19200,768000) *************** [03/13/2022-08:29:16] [V] [TRT] --------------- Timing Runner: Conv_28 (FusedConvActConvolution) [03/13/2022-08:29:16] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:16] [V] [TRT] --------------- Timing Runner: Conv_28 (CaskConvolution) [03/13/2022-08:29:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:16] [V] [TRT] --------------- Timing Runner: Conv_28 (CudaConvolution) [03/13/2022-08:29:16] [V] [TRT] Tactic: 0 time 0.128204 [03/13/2022-08:29:16] [V] [TRT] Tactic: 1 time 0.093004 [03/13/2022-08:29:16] [V] [TRT] Tactic: 2 time 0.164832 [03/13/2022-08:29:16] [V] [TRT] Tactic: 4 skipped. Scratch requested: 866556416, available: 16777216 [03/13/2022-08:29:16] [V] [TRT] Tactic: 5 time 0.260032 [03/13/2022-08:29:16] [V] [TRT] Fastest Tactic: 1 Time: 0.093004 [03/13/2022-08:29:16] [V] [TRT] --------------- Timing Runner: Conv_28 (CudaDepthwiseConvolution) [03/13/2022-08:29:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:29:16] [V] [TRT] [03/13/2022-08:29:16] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200:2,384000) -> Half(1,160,19200,768000) *************** [03/13/2022-08:29:16] [V] [TRT] --------------- Timing Runner: Conv_28 (FusedConvActConvolution) [03/13/2022-08:29:16] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:16] [V] [TRT] --------------- Timing Runner: Conv_28 (CaskConvolution) [03/13/2022-08:29:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:16] [V] [TRT] --------------- Timing Runner: Conv_28 (CudaConvolution) [03/13/2022-08:29:16] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:16] [V] [TRT] --------------- Timing Runner: Conv_28 (CudaDepthwiseConvolution) [03/13/2022-08:29:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:16] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200:2,384000) -> Half(1,160,19200:2,384000) *************** [03/13/2022-08:29:16] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:16] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:16] [V] [TRT] --------------- Timing Runner: Conv_28 (FusedConvActConvolution) [03/13/2022-08:29:16] [V] [TRT] Tactic: 589823 time 0.11302 [03/13/2022-08:29:16] [V] [TRT] Tactic: 655359 time 0.094304 [03/13/2022-08:29:16] [V] [TRT] Tactic: 1310719 time 0.095332 [03/13/2022-08:29:16] [V] [TRT] Tactic: 1376255 time 0.093536 [03/13/2022-08:29:16] [V] [TRT] Tactic: 1507327 time 0.10738 [03/13/2022-08:29:16] [V] [TRT] Tactic: 1900543 time 0.105284 [03/13/2022-08:29:16] [V] [TRT] Tactic: 2162687 time 0.09646 [03/13/2022-08:29:16] [V] [TRT] Tactic: 2293759 time 0.097888 [03/13/2022-08:29:16] [V] [TRT] Tactic: 2359295 time 0.085832 [03/13/2022-08:29:16] [V] [TRT] Tactic: 2686975 time 0.096144 [03/13/2022-08:29:16] [V] [TRT] Tactic: 3080191 time 0.107772 [03/13/2022-08:29:16] [V] [TRT] Tactic: 3342335 time 0.110496 [03/13/2022-08:29:16] [V] [TRT] Tactic: 3407871 time 0.089228 [03/13/2022-08:29:16] [V] [TRT] Tactic: 3670015 time 0.101748 [03/13/2022-08:29:16] [V] [TRT] Tactic: 3932159 time 0.099892 [03/13/2022-08:29:16] [V] [TRT] Tactic: 4521983 time 0.096564 [03/13/2022-08:29:16] [V] [TRT] Tactic: 4980735 time 0.1068 [03/13/2022-08:29:16] [V] [TRT] Tactic: 5242879 time 0.093012 [03/13/2022-08:29:16] [V] [TRT] Tactic: 5570559 time 0.108164 [03/13/2022-08:29:16] [V] [TRT] Tactic: 5701631 time 0.105764 [03/13/2022-08:29:16] [V] [TRT] Tactic: 5767167 time 0.359008 [03/13/2022-08:29:16] [V] [TRT] Tactic: 5832703 time 0.087912 [03/13/2022-08:29:16] [V] [TRT] Tactic: 6029311 time 0.103648 [03/13/2022-08:29:16] [V] [TRT] Tactic: 6422527 time 0.110476 [03/13/2022-08:29:17] [V] [TRT] Tactic: 6815743 time 0.11708 [03/13/2022-08:29:17] [V] [TRT] Tactic: 7143423 time 0.146136 [03/13/2022-08:29:17] [V] [TRT] Tactic: 7208959 time 0.096632 [03/13/2022-08:29:17] [V] [TRT] Tactic: 7536639 time 0.125616 [03/13/2022-08:29:17] [V] [TRT] Tactic: 10223615 time 0.095648 [03/13/2022-08:29:17] [V] [TRT] Tactic: 10551295 time 0.112816 [03/13/2022-08:29:17] [V] [TRT] Tactic: 10944511 time 0.105596 [03/13/2022-08:29:17] [V] [TRT] Fastest Tactic: 2359295 Time: 0.085832 [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: Conv_28 (CaskConvolution) [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: 1651411198763708804 time 0.039568 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: 2418518597804310654 time 0.039352 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: 4318470497547290900 time 0.039044 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: 4930470141256631146 time 0.05026 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: 8292881859266835088 time 0.050404 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: 8401509141903434922 time 0.039224 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -8654297089785671176 time 0.089132 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -7516584506774355935 time 0.047532 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -7140760933967189247 time 0.039332 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -6004726995029373073 time 0.051032 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -5719726816705110014 time 0.089224 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -4097850214384059472 time 0.048128 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -3717489476759089008 time 0.03958 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -3689982367035295496 time 0.088756 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -2640575123064142123 time 0.063548 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -2534402059426524406 time 0.064472 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -2027588946874785071 time 0.049696 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -1968398013367819764 time 0.089104 [03/13/2022-08:29:17] [V] [TRT] Fastest Tactic: 4318470497547290900 Time: 0.039044 [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: Conv_28 (CudaConvolution) [03/13/2022-08:29:17] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: Conv_28 (CudaDepthwiseConvolution) [03/13/2022-08:29:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4318470497547290900 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:17] [V] [TRT] [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:17] [V] [TRT] *************** Autotuning format combination: Half(5,800,1:8,96000) -> Float(1,160,19200,768000) *************** [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: Conv_28 (FusedConvActConvolution) [03/13/2022-08:29:17] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: Conv_28 (CaskConvolution) [03/13/2022-08:29:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: Conv_28 (CudaConvolution) [03/13/2022-08:29:17] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: Conv_28 (CudaDepthwiseConvolution) [03/13/2022-08:29:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:17] [V] [TRT] *************** Autotuning format combination: Half(5,800,1:8,96000) -> Half(5,800,1:8,96000) *************** [03/13/2022-08:29:17] [V] [TRT] Conv_28 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: Conv_28 (FusedConvActConvolution) [03/13/2022-08:29:17] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: Conv_28 (CaskConvolution) [03/13/2022-08:29:17] [V] [TRT] Conv_28 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:17] [V] [TRT] Tactic: 9576651994278528 time 0.238368 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: 1179757074518529353 time 0.290156 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: 2105695814191699972 time 0.50632 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: 2148106709480872763 time 0.265444 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: 2410442691266548717 time 0.550612 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: 3041642431972138763 time 0.477284 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: 3754069740140581927 time 0.916088 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: 4555462412611657028 time 0.265248 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: 5666160310350604399 time 0.914828 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:17] [V] [TRT] Tactic: 5876997871499382316 time 0.436156 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: 5925270497649423688 time 0.986448 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: 6680916730816870145 time 0.509884 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: 7158029511300006471 time 0.508104 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: 7859952145590271433 time 0.510456 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: 8283847742354150423 time 0.916856 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -8992262742606384444 time 0.265608 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -8391760416076885205 time 0.985092 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -6273232454637933930 time 0.293224 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:17] [V] [TRT] Tactic: -5925110308892264213 time 0.436352 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -5818527483287834165 time 0.293864 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:17] [V] [TRT] Tactic: -4908848143422991657 time 0.23858 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -4534876761957424274 time 0.986204 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -3237051169894153788 time 0.507568 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -3136088851200285532 time 0.477576 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -2586046817576862066 time 0.550432 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -2422160065350346448 time 0.50948 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -1216445540764179377 time 0.54732 [03/13/2022-08:29:17] [V] [TRT] Conv_28 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:17] [V] [TRT] Tactic: -229563042944049199 time 0.477916 [03/13/2022-08:29:17] [V] [TRT] Fastest Tactic: 9576651994278528 Time: 0.238368 [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: Conv_28 (CudaConvolution) [03/13/2022-08:29:17] [V] [TRT] Tactic: 0 time 0.16414 [03/13/2022-08:29:17] [V] [TRT] Tactic: 1 time 0.163044 [03/13/2022-08:29:17] [V] [TRT] Tactic: 2 time 0.327248 [03/13/2022-08:29:17] [V] [TRT] Fastest Tactic: 1 Time: 0.163044 [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: Conv_28 (CudaDepthwiseConvolution) [03/13/2022-08:29:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:29:17] [V] [TRT] [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:17] [V] [TRT] Tactic: 1002 time 0.101052 [03/13/2022-08:29:17] [V] [TRT] Tactic: 0 time 0.524096 [03/13/2022-08:29:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.101052 [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:17] [V] [TRT] Tactic: 1002 time 0.102968 [03/13/2022-08:29:17] [V] [TRT] Tactic: 0 time 0.507956 [03/13/2022-08:29:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.102968 [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:17] [V] [TRT] Tactic: 1002 time 0.100508 [03/13/2022-08:29:17] [V] [TRT] Tactic: 0 time 0.501328 [03/13/2022-08:29:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.100508 [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:17] [V] [TRT] Tactic: 1002 time 0.094964 [03/13/2022-08:29:17] [V] [TRT] Tactic: 0 time 0.759896 [03/13/2022-08:29:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.094964 [03/13/2022-08:29:17] [V] [TRT] *************** Autotuning format combination: Float(1,160,19200,768000) -> Float(1,160,19200,768000) *************** [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_30, Mul_31) (PointWise) [03/13/2022-08:29:17] [V] [TRT] Tactic: 128 time 0.068692 [03/13/2022-08:29:17] [V] [TRT] Tactic: 256 time 0.071052 [03/13/2022-08:29:17] [V] [TRT] Tactic: 512 time 0.078552 [03/13/2022-08:29:17] [V] [TRT] Tactic: -32 time 0.118776 [03/13/2022-08:29:17] [V] [TRT] Tactic: -64 time 0.0737 [03/13/2022-08:29:17] [V] [TRT] Tactic: -128 time 0.070524 [03/13/2022-08:29:17] [V] [TRT] Fastest Tactic: 128 Time: 0.068692 [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_30, Mul_31) (PointWiseV2) [03/13/2022-08:29:17] [V] [TRT] Tactic: 0 time 0.04918 [03/13/2022-08:29:17] [V] [TRT] Tactic: 1 time 0.042052 [03/13/2022-08:29:17] [V] [TRT] Tactic: 2 time 0.040872 [03/13/2022-08:29:17] [V] [TRT] Tactic: 3 time 0.042152 [03/13/2022-08:29:17] [V] [TRT] Tactic: 4 time 0.041028 [03/13/2022-08:29:17] [V] [TRT] Tactic: 5 time 0.040872 [03/13/2022-08:29:17] [V] [TRT] Tactic: 6 time 0.043972 [03/13/2022-08:29:17] [V] [TRT] Tactic: 7 time 0.041108 [03/13/2022-08:29:17] [V] [TRT] Tactic: 8 time 0.040924 [03/13/2022-08:29:17] [V] [TRT] Tactic: 9 time 0.040992 [03/13/2022-08:29:17] [V] [TRT] Tactic: 28 time 0.048944 [03/13/2022-08:29:17] [V] [TRT] Fastest Tactic: 2 Time: 0.040872 [03/13/2022-08:29:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [03/13/2022-08:29:17] [V] [TRT] [03/13/2022-08:29:17] [V] [TRT] *************** Autotuning format combination: Float(1,160,19200:32,38400) -> Float(1,160,19200:32,38400) *************** [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_30, Mul_31) (PointWise) [03/13/2022-08:29:17] [V] [TRT] Tactic: 128 time 0.138664 [03/13/2022-08:29:17] [V] [TRT] Tactic: 256 time 0.139728 [03/13/2022-08:29:17] [V] [TRT] Tactic: 512 time 0.15692 [03/13/2022-08:29:17] [V] [TRT] Tactic: -32 time 0.17858 [03/13/2022-08:29:17] [V] [TRT] Tactic: -64 time 0.112416 [03/13/2022-08:29:17] [V] [TRT] Tactic: -128 time 0.111832 [03/13/2022-08:29:17] [V] [TRT] Fastest Tactic: -128 Time: 0.111832 [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_30, Mul_31) (PointWiseV2) [03/13/2022-08:29:17] [V] [TRT] Tactic: 24 time 0.073276 [03/13/2022-08:29:17] [V] [TRT] Tactic: 25 time 0.074628 [03/13/2022-08:29:17] [V] [TRT] Tactic: 26 time 0.0755 [03/13/2022-08:29:17] [V] [TRT] Tactic: 27 time 0.075732 [03/13/2022-08:29:17] [V] [TRT] Tactic: 31 time 0.071812 [03/13/2022-08:29:17] [V] [TRT] Fastest Tactic: 31 Time: 0.071812 [03/13/2022-08:29:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [03/13/2022-08:29:17] [V] [TRT] [03/13/2022-08:29:17] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200,768000) -> Half(1,160,19200,768000) *************** [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_30, Mul_31) (PointWise) [03/13/2022-08:29:17] [V] [TRT] Tactic: 128 time 0.07148 [03/13/2022-08:29:17] [V] [TRT] Tactic: 256 time 0.060312 [03/13/2022-08:29:17] [V] [TRT] Tactic: 512 time 0.05896 [03/13/2022-08:29:17] [V] [TRT] Tactic: -32 time 0.104304 [03/13/2022-08:29:17] [V] [TRT] Tactic: -64 time 0.069592 [03/13/2022-08:29:17] [V] [TRT] Tactic: -128 time 0.0674 [03/13/2022-08:29:17] [V] [TRT] Fastest Tactic: 512 Time: 0.05896 [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_30, Mul_31) (PointWiseV2) [03/13/2022-08:29:17] [V] [TRT] Tactic: 0 time 0.0466 [03/13/2022-08:29:17] [V] [TRT] Tactic: 1 time 0.037608 [03/13/2022-08:29:17] [V] [TRT] Tactic: 2 time 0.031092 [03/13/2022-08:29:17] [V] [TRT] Tactic: 3 time 0.034828 [03/13/2022-08:29:17] [V] [TRT] Tactic: 4 time 0.025856 [03/13/2022-08:29:17] [V] [TRT] Tactic: 5 time 0.022788 [03/13/2022-08:29:17] [V] [TRT] Tactic: 6 time 0.034744 [03/13/2022-08:29:17] [V] [TRT] Tactic: 7 time 0.025048 [03/13/2022-08:29:17] [V] [TRT] Tactic: 8 time 0.023016 [03/13/2022-08:29:17] [V] [TRT] Tactic: 9 time 0.022816 [03/13/2022-08:29:17] [V] [TRT] Tactic: 28 time 0.046152 [03/13/2022-08:29:17] [V] [TRT] Fastest Tactic: 5 Time: 0.022788 [03/13/2022-08:29:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [03/13/2022-08:29:17] [V] [TRT] [03/13/2022-08:29:17] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200:2,384000) -> Half(1,160,19200:2,384000) *************** [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_30, Mul_31) (PointWise) [03/13/2022-08:29:17] [V] [TRT] Tactic: 128 time 0.071184 [03/13/2022-08:29:17] [V] [TRT] Tactic: 256 time 0.060304 [03/13/2022-08:29:17] [V] [TRT] Tactic: 512 time 0.059028 [03/13/2022-08:29:17] [V] [TRT] Tactic: -32 time 0.104256 [03/13/2022-08:29:17] [V] [TRT] Tactic: -64 time 0.069352 [03/13/2022-08:29:17] [V] [TRT] Tactic: -128 time 0.067284 [03/13/2022-08:29:17] [V] [TRT] Fastest Tactic: 512 Time: 0.059028 [03/13/2022-08:29:17] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_30, Mul_31) (PointWiseV2) [03/13/2022-08:29:17] [V] [TRT] Tactic: 0 time 0.031644 [03/13/2022-08:29:18] [V] [TRT] Tactic: 1 time 0.02726 [03/13/2022-08:29:18] [V] [TRT] Tactic: 2 time 0.028084 [03/13/2022-08:29:18] [V] [TRT] Tactic: 3 time 0.026368 [03/13/2022-08:29:18] [V] [TRT] Tactic: 4 time 0.026344 [03/13/2022-08:29:18] [V] [TRT] Tactic: 5 time 0.029028 [03/13/2022-08:29:18] [V] [TRT] Tactic: 6 time 0.028232 [03/13/2022-08:29:18] [V] [TRT] Tactic: 7 time 0.028252 [03/13/2022-08:29:18] [V] [TRT] Tactic: 8 time 0.030736 [03/13/2022-08:29:18] [V] [TRT] Tactic: 9 time 0.038752 [03/13/2022-08:29:18] [V] [TRT] Tactic: 10 time 0.047888 [03/13/2022-08:29:18] [V] [TRT] Tactic: 11 time 0.038744 [03/13/2022-08:29:18] [V] [TRT] Tactic: 12 time 0.032256 [03/13/2022-08:29:18] [V] [TRT] Tactic: 13 time 0.035372 [03/13/2022-08:29:18] [V] [TRT] Tactic: 14 time 0.02648 [03/13/2022-08:29:18] [V] [TRT] Tactic: 15 time 0.023216 [03/13/2022-08:29:18] [V] [TRT] Tactic: 16 time 0.035196 [03/13/2022-08:29:18] [V] [TRT] Tactic: 17 time 0.02542 [03/13/2022-08:29:18] [V] [TRT] Tactic: 18 time 0.023108 [03/13/2022-08:29:18] [V] [TRT] Tactic: 19 time 0.02288 [03/13/2022-08:29:18] [V] [TRT] Tactic: 28 time 0.031512 [03/13/2022-08:29:18] [V] [TRT] Tactic: 29 time 0.047836 [03/13/2022-08:29:18] [V] [TRT] Fastest Tactic: 19 Time: 0.02288 [03/13/2022-08:29:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 19 [03/13/2022-08:29:18] [V] [TRT] [03/13/2022-08:29:18] [V] [TRT] *************** Autotuning format combination: Half(5,800,1:8,96000) -> Half(5,800,1:8,96000) *************** [03/13/2022-08:29:18] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_30, Mul_31) (PointWise) [03/13/2022-08:29:18] [V] [TRT] Tactic: 128 time 0.071452 [03/13/2022-08:29:18] [V] [TRT] Tactic: 256 time 0.060064 [03/13/2022-08:29:18] [V] [TRT] Tactic: 512 time 0.05874 [03/13/2022-08:29:18] [V] [TRT] Tactic: -32 time 0.104232 [03/13/2022-08:29:18] [V] [TRT] Tactic: -64 time 0.0694 [03/13/2022-08:29:18] [V] [TRT] Tactic: -128 time 0.067268 [03/13/2022-08:29:18] [V] [TRT] Fastest Tactic: 512 Time: 0.05874 [03/13/2022-08:29:18] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_30, Mul_31) (PointWiseV2) [03/13/2022-08:29:18] [V] [TRT] Tactic: 0 time 0.025888 [03/13/2022-08:29:18] [V] [TRT] Tactic: 1 time 0.026476 [03/13/2022-08:29:18] [V] [TRT] Tactic: 2 time 0.032208 [03/13/2022-08:29:18] [V] [TRT] Tactic: 3 time 0.026548 [03/13/2022-08:29:18] [V] [TRT] Tactic: 4 time 0.033356 [03/13/2022-08:29:18] [V] [TRT] Tactic: 5 time 0.041892 [03/13/2022-08:29:18] [V] [TRT] Tactic: 6 time 0.026248 [03/13/2022-08:29:18] [V] [TRT] Tactic: 7 time 0.03466 [03/13/2022-08:29:18] [V] [TRT] Tactic: 8 time 0.041632 [03/13/2022-08:29:18] [V] [TRT] Tactic: 9 time 0.061436 [03/13/2022-08:29:18] [V] [TRT] Tactic: 10 time 0.023668 [03/13/2022-08:29:18] [V] [TRT] Tactic: 11 time 0.023308 [03/13/2022-08:29:18] [V] [TRT] Tactic: 12 time 0.02606 [03/13/2022-08:29:18] [V] [TRT] Tactic: 13 time 0.024796 [03/13/2022-08:29:18] [V] [TRT] Tactic: 14 time 0.027176 [03/13/2022-08:29:18] [V] [TRT] Tactic: 15 time 0.033352 [03/13/2022-08:29:18] [V] [TRT] Tactic: 16 time 0.024652 [03/13/2022-08:29:18] [V] [TRT] Tactic: 17 time 0.026372 [03/13/2022-08:29:18] [V] [TRT] Tactic: 18 time 0.03604 [03/13/2022-08:29:18] [V] [TRT] Tactic: 19 time 0.04624 [03/13/2022-08:29:18] [V] [TRT] Tactic: 20 time 0.031872 [03/13/2022-08:29:18] [V] [TRT] Tactic: 21 time 0.027364 [03/13/2022-08:29:18] [V] [TRT] Tactic: 22 time 0.02628 [03/13/2022-08:29:18] [V] [TRT] Tactic: 23 time 0.027996 [03/13/2022-08:29:18] [V] [TRT] Tactic: 24 time 0.047924 [03/13/2022-08:29:18] [V] [TRT] Tactic: 25 time 0.037952 [03/13/2022-08:29:18] [V] [TRT] Tactic: 26 time 0.035324 [03/13/2022-08:29:18] [V] [TRT] Tactic: 27 time 0.03452 [03/13/2022-08:29:18] [V] [TRT] Tactic: 28 time 0.02582 [03/13/2022-08:29:18] [V] [TRT] Tactic: 29 time 0.02358 [03/13/2022-08:29:18] [V] [TRT] Tactic: 30 time 0.032128 [03/13/2022-08:29:18] [V] [TRT] Tactic: 31 time 0.047292 [03/13/2022-08:29:18] [V] [TRT] Fastest Tactic: 11 Time: 0.023308 [03/13/2022-08:29:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 11 [03/13/2022-08:29:18] [V] [TRT] [03/13/2022-08:29:18] [V] [TRT] *************** Autotuning format combination: Float(1,160,19200,768000) -> Float(1,160,19200,768000) *************** [03/13/2022-08:29:18] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:29:18] [V] [TRT] Conv_32 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:29:18] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:29:18] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:18] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:29:18] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:29:18] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:29:18] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:29:18] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:29:18] [V] [TRT] --------------- Timing Runner: Conv_32 (FusedConvActConvolution) [03/13/2022-08:29:18] [V] [TRT] Tactic: 524287 time 0.405844 [03/13/2022-08:29:18] [V] [TRT] Tactic: 720895 time 0.334952 [03/13/2022-08:29:18] [V] [TRT] Tactic: 983039 time 0.339024 [03/13/2022-08:29:18] [V] [TRT] Tactic: 1048575 time 0.34448 [03/13/2022-08:29:18] [V] [TRT] Tactic: 1703935 time 0.34848 [03/13/2022-08:29:18] [V] [TRT] Tactic: 1769471 time 0.470996 [03/13/2022-08:29:18] [V] [TRT] Tactic: 1966079 time 0.415856 [03/13/2022-08:29:18] [V] [TRT] Tactic: 2031615 time 0.412412 [03/13/2022-08:29:18] [V] [TRT] Tactic: 2228223 time 0.337752 [03/13/2022-08:29:18] [V] [TRT] Tactic: 2621439 time 0.415564 [03/13/2022-08:29:18] [V] [TRT] Tactic: 2752511 time 0.33666 [03/13/2022-08:29:18] [V] [TRT] Tactic: 2818047 time 0.65834 [03/13/2022-08:29:18] [V] [TRT] Tactic: 2883583 time 0.683344 [03/13/2022-08:29:18] [V] [TRT] Tactic: 3014655 time 0.343676 [03/13/2022-08:29:18] [V] [TRT] Tactic: 3145727 time 0.331668 [03/13/2022-08:29:18] [V] [TRT] Tactic: 3473407 time 0.635976 [03/13/2022-08:29:18] [V] [TRT] Tactic: 3604479 time 0.352256 [03/13/2022-08:29:18] [V] [TRT] Tactic: 3735551 time 0.622328 [03/13/2022-08:29:18] [V] [TRT] Tactic: 4390911 time 0.441708 [03/13/2022-08:29:19] [V] [TRT] Tactic: 5046271 time 0.344112 [03/13/2022-08:29:19] [V] [TRT] Tactic: 5963775 time 0.421348 [03/13/2022-08:29:19] [V] [TRT] Tactic: 6160383 time 0.384916 [03/13/2022-08:29:19] [V] [TRT] Tactic: 6488063 time 0.358384 [03/13/2022-08:29:19] [V] [TRT] Tactic: 6881279 time 0.424104 [03/13/2022-08:29:19] [V] [TRT] Tactic: 7274495 time 0.401268 [03/13/2022-08:29:19] [V] [TRT] Tactic: 7864319 time 0.40552 [03/13/2022-08:29:19] [V] [TRT] Tactic: 7995391 time 0.33282 [03/13/2022-08:29:19] [V] [TRT] Tactic: 8585215 time 0.403072 [03/13/2022-08:29:19] [V] [TRT] Tactic: 8847359 time 0.541048 [03/13/2022-08:29:19] [V] [TRT] Tactic: 8978431 time 0.429436 [03/13/2022-08:29:19] [V] [TRT] Tactic: 9043967 time 0.361148 [03/13/2022-08:29:19] [V] [TRT] Tactic: 9175039 time 0.352256 [03/13/2022-08:29:19] [V] [TRT] Tactic: 9502719 time 0.418388 [03/13/2022-08:29:19] [V] [TRT] Tactic: 9830399 time 0.622292 [03/13/2022-08:29:19] [V] [TRT] Tactic: 10027007 time 0.336464 [03/13/2022-08:29:19] [V] [TRT] Tactic: 10092543 time 0.442224 [03/13/2022-08:29:19] [V] [TRT] Tactic: 10289151 time 0.416804 [03/13/2022-08:29:19] [V] [TRT] Tactic: 10485759 time 0.340756 [03/13/2022-08:29:19] [V] [TRT] Tactic: 10682367 time 0.382008 [03/13/2022-08:29:19] [V] [TRT] Tactic: 10813439 time 0.326 [03/13/2022-08:29:19] [V] [TRT] Fastest Tactic: 10813439 Time: 0.326 [03/13/2022-08:29:19] [V] [TRT] --------------- Timing Runner: Conv_32 (CaskConvolution) [03/13/2022-08:29:19] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Tactic: 1825138533642645384 time 0.604164 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:29:19] [V] [TRT] Tactic: 2775507031594384867 time 0.280464 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Tactic: 2842488832350522458 time 0.314112 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Tactic: 3915320020053085238 time 0.602088 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Tactic: 6448355332020552203 time 0.653108 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Tactic: 6808617066150061604 time 0.319704 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Tactic: -8060443123034038864 time 0.323356 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Tactic: -4420849921117327522 time 0.382184 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Tactic: -3946921629105938337 time 0.345416 [03/13/2022-08:29:19] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.280464 [03/13/2022-08:29:19] [V] [TRT] --------------- Timing Runner: Conv_32 (CudaConvolution) [03/13/2022-08:29:19] [V] [TRT] Tactic: 0 time 0.676988 [03/13/2022-08:29:19] [V] [TRT] Tactic: 2 skipped. Scratch requested: 27648000, available: 16777216 [03/13/2022-08:29:19] [V] [TRT] Tactic: 5 time 1.71123 [03/13/2022-08:29:19] [V] [TRT] Tactic: 6 time 0.325728 [03/13/2022-08:29:19] [V] [TRT] Tactic: 57 time 0.357884 [03/13/2022-08:29:19] [V] [TRT] Fastest Tactic: 6 Time: 0.325728 [03/13/2022-08:29:19] [V] [TRT] --------------- Timing Runner: Conv_32 (CudaDepthwiseConvolution) [03/13/2022-08:29:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:29:19] [V] [TRT] [03/13/2022-08:29:19] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:29:19] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200,768000) -> Half(1,160,19200,768000) *************** [03/13/2022-08:29:19] [V] [TRT] --------------- Timing Runner: Conv_32 (FusedConvActConvolution) [03/13/2022-08:29:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:19] [V] [TRT] --------------- Timing Runner: Conv_32 (CaskConvolution) [03/13/2022-08:29:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:19] [V] [TRT] --------------- Timing Runner: Conv_32 (CudaConvolution) [03/13/2022-08:29:19] [V] [TRT] Tactic: 0 time 0.677212 [03/13/2022-08:29:19] [V] [TRT] Tactic: 1 time 0.676388 [03/13/2022-08:29:19] [V] [TRT] Tactic: 2 time 0.802908 [03/13/2022-08:29:19] [V] [TRT] Tactic: 4 skipped. Scratch requested: 866607616, available: 16777216 [03/13/2022-08:29:19] [V] [TRT] Tactic: 5 time 1.69028 [03/13/2022-08:29:19] [V] [TRT] Tactic: 6 time 0.445368 [03/13/2022-08:29:19] [V] [TRT] Fastest Tactic: 6 Time: 0.445368 [03/13/2022-08:29:19] [V] [TRT] --------------- Timing Runner: Conv_32 (CudaDepthwiseConvolution) [03/13/2022-08:29:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [03/13/2022-08:29:19] [V] [TRT] [03/13/2022-08:29:19] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200:2,384000) -> Half(1,160,19200:2,384000) *************** [03/13/2022-08:29:19] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:19] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:29:19] [V] [TRT] --------------- Timing Runner: Conv_32 (FusedConvActConvolution) [03/13/2022-08:29:19] [V] [TRT] Tactic: 524287 time 0.201556 [03/13/2022-08:29:19] [V] [TRT] Tactic: 720895 time 0.183212 [03/13/2022-08:29:19] [V] [TRT] Tactic: 983039 time 0.178796 [03/13/2022-08:29:19] [V] [TRT] Tactic: 1048575 time 0.179928 [03/13/2022-08:29:19] [V] [TRT] Tactic: 1703935 time 0.186032 [03/13/2022-08:29:19] [V] [TRT] Tactic: 1966079 time 0.209828 [03/13/2022-08:29:19] [V] [TRT] Tactic: 2031615 time 0.202696 [03/13/2022-08:29:19] [V] [TRT] Tactic: 2228223 time 0.181828 [03/13/2022-08:29:19] [V] [TRT] Tactic: 2752511 time 0.179664 [03/13/2022-08:29:19] [V] [TRT] Tactic: 2818047 time 0.346728 [03/13/2022-08:29:20] [V] [TRT] Tactic: 2883583 time 0.335268 [03/13/2022-08:29:20] [V] [TRT] Tactic: 3014655 time 0.18338 [03/13/2022-08:29:20] [V] [TRT] Tactic: 3145727 time 0.17542 [03/13/2022-08:29:20] [V] [TRT] Tactic: 3473407 time 0.321704 [03/13/2022-08:29:20] [V] [TRT] Tactic: 3604479 time 0.188028 [03/13/2022-08:29:20] [V] [TRT] Tactic: 3735551 time 0.32082 [03/13/2022-08:29:20] [V] [TRT] Tactic: 4390911 time 0.216492 [03/13/2022-08:29:20] [V] [TRT] Tactic: 5046271 time 0.197564 [03/13/2022-08:29:20] [V] [TRT] Tactic: 5963775 time 0.206892 [03/13/2022-08:29:20] [V] [TRT] Tactic: 6160383 time 0.19134 [03/13/2022-08:29:20] [V] [TRT] Tactic: 6488063 time 0.187524 [03/13/2022-08:29:20] [V] [TRT] Tactic: 6881279 time 0.209884 [03/13/2022-08:29:20] [V] [TRT] Tactic: 7995391 time 0.180744 [03/13/2022-08:29:20] [V] [TRT] Tactic: 8585215 time 0.190872 [03/13/2022-08:29:20] [V] [TRT] Tactic: 8978431 time 0.213016 [03/13/2022-08:29:20] [V] [TRT] Tactic: 9043967 time 0.192996 [03/13/2022-08:29:20] [V] [TRT] Tactic: 9175039 time 0.1881 [03/13/2022-08:29:20] [V] [TRT] Tactic: 9502719 time 0.206784 [03/13/2022-08:29:20] [V] [TRT] Tactic: 9830399 time 0.321564 [03/13/2022-08:29:20] [V] [TRT] Tactic: 10027007 time 0.180524 [03/13/2022-08:29:20] [V] [TRT] Tactic: 10092543 time 0.21696 [03/13/2022-08:29:20] [V] [TRT] Tactic: 10289151 time 0.209944 [03/13/2022-08:29:20] [V] [TRT] Tactic: 10485759 time 0.183132 [03/13/2022-08:29:20] [V] [TRT] Tactic: 10813439 time 0.175244 [03/13/2022-08:29:20] [V] [TRT] Fastest Tactic: 10813439 Time: 0.175244 [03/13/2022-08:29:20] [V] [TRT] --------------- Timing Runner: Conv_32 (CaskConvolution) [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: 1145226902788474763 time 0.170992 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: 1651411198763708804 time 0.170444 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: 2418518597804310654 time 0.171108 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: 4318470497547290900 time 0.169188 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: 4653005425971292725 time 0.17108 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: 4930470141256631146 time 0.185476 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: 8292881859266835088 time 0.193236 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: 8401509141903434922 time 0.168752 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: -8654297089785671176 time 0.346712 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: -7448936905981214224 time 0.198812 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: -6004726995029373073 time 0.185016 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: -5719726816705110014 time 0.347508 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: -3754890472406891741 time 0.355684 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: -3689982367035295496 time 0.347924 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: -3140347171730126532 time 0.177512 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: -2894005464278291378 time 0.183548 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: -2027588946874785071 time 0.181188 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: -1968398013367819764 time 0.348764 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: -245090590808296743 time 0.355328 [03/13/2022-08:29:20] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 0.168752 [03/13/2022-08:29:20] [V] [TRT] --------------- Timing Runner: Conv_32 (CudaConvolution) [03/13/2022-08:29:20] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:20] [V] [TRT] --------------- Timing Runner: Conv_32 (CudaDepthwiseConvolution) [03/13/2022-08:29:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8401509141903434922 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:20] [V] [TRT] [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:20] [V] [TRT] *************** Autotuning format combination: Half(5,800,1:8,96000) -> Float(1,160,19200,768000) *************** [03/13/2022-08:29:20] [V] [TRT] --------------- Timing Runner: Conv_32 (FusedConvActConvolution) [03/13/2022-08:29:20] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:20] [V] [TRT] --------------- Timing Runner: Conv_32 (CaskConvolution) [03/13/2022-08:29:20] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:20] [V] [TRT] --------------- Timing Runner: Conv_32 (CudaConvolution) [03/13/2022-08:29:20] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:20] [V] [TRT] --------------- Timing Runner: Conv_32 (CudaDepthwiseConvolution) [03/13/2022-08:29:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:20] [V] [TRT] *************** Autotuning format combination: Half(5,800,1:8,96000) -> Half(5,800,1:8,96000) *************** [03/13/2022-08:29:20] [V] [TRT] Conv_32 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:20] [V] [TRT] Conv_32 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:20] [V] [TRT] Conv_32 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] --------------- Timing Runner: Conv_32 (FusedConvActConvolution) [03/13/2022-08:29:20] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:20] [V] [TRT] --------------- Timing Runner: Conv_32 (CaskConvolution) [03/13/2022-08:29:20] [V] [TRT] Conv_32 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:20] [V] [TRT] Tactic: 130343752241278875 time 2.10316 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: 2148106709480872763 time 2.41771 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: 2410442691266548717 time 4.82295 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:20] [V] [TRT] Tactic: 2921824978225832523 time 2.07018 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:20] [V] [TRT] Tactic: 3030711443478140260 time 3.9409 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:20] [V] [TRT] Tactic: 3754069740140581927 time 7.91808 [03/13/2022-08:29:20] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:21] [V] [TRT] Tactic: 3823144360994712832 time 2.43596 [03/13/2022-08:29:21] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:21] [V] [TRT] Tactic: 5635311898703673455 time 4.22372 [03/13/2022-08:29:21] [V] [TRT] Conv_32 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:21] [V] [TRT] Tactic: 5925270497649423688 time 8.59955 [03/13/2022-08:29:21] [V] [TRT] Conv_32 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:21] [V] [TRT] Tactic: 6680916730816870145 time 4.51088 [03/13/2022-08:29:21] [V] [TRT] Conv_32 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:21] [V] [TRT] Tactic: 7158029511300006471 time 4.38352 [03/13/2022-08:29:21] [V] [TRT] Conv_32 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:21] [V] [TRT] Tactic: 7859952145590271433 time 4.36765 [03/13/2022-08:29:21] [V] [TRT] Conv_32 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:21] [V] [TRT] Tactic: 8283847742354150423 time 7.91776 [03/13/2022-08:29:21] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:21] [V] [TRT] Tactic: -8992262742606384444 time 2.30998 [03/13/2022-08:29:21] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:21] [V] [TRT] Tactic: -8682550625095202832 time 2.40302 [03/13/2022-08:29:21] [V] [TRT] Conv_32 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:21] [V] [TRT] Tactic: -8379842433586149932 time 4.01147 [03/13/2022-08:29:21] [V] [TRT] Conv_32 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:21] [V] [TRT] Tactic: -6352769237623756264 time 4.08448 [03/13/2022-08:29:21] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:21] [V] [TRT] Tactic: -6273232454637933930 time 2.39644 [03/13/2022-08:29:21] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:21] [V] [TRT] Tactic: -5818527483287834165 time 2.35202 [03/13/2022-08:29:21] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:22] [V] [TRT] Tactic: -4954692664176521434 time 4.86577 [03/13/2022-08:29:22] [V] [TRT] Conv_32 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:22] [V] [TRT] Tactic: -4953888146171240997 time 2.06893 [03/13/2022-08:29:22] [V] [TRT] Conv_32 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:22] [V] [TRT] Tactic: -4534876761957424274 time 9.1994 [03/13/2022-08:29:22] [V] [TRT] Conv_32 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:22] [V] [TRT] Tactic: -3237051169894153788 time 4.63395 [03/13/2022-08:29:22] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:22] [V] [TRT] Tactic: -3136088851200285532 time 4.56991 [03/13/2022-08:29:22] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:22] [V] [TRT] Tactic: -2586046817576862066 time 4.97325 [03/13/2022-08:29:22] [V] [TRT] Conv_32 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:22] [V] [TRT] Tactic: -229563042944049199 time 4.52802 [03/13/2022-08:29:22] [V] [TRT] Fastest Tactic: -4953888146171240997 Time: 2.06893 [03/13/2022-08:29:22] [V] [TRT] --------------- Timing Runner: Conv_32 (CudaConvolution) [03/13/2022-08:29:22] [V] [TRT] Tactic: 0 time 0.930308 [03/13/2022-08:29:22] [V] [TRT] Tactic: 1 time 0.932852 [03/13/2022-08:29:22] [V] [TRT] Tactic: 2 time 1.14166 [03/13/2022-08:29:22] [V] [TRT] Tactic: 6 time 0.432008 [03/13/2022-08:29:22] [V] [TRT] Fastest Tactic: 6 Time: 0.432008 [03/13/2022-08:29:22] [V] [TRT] --------------- Timing Runner: Conv_32 (CudaDepthwiseConvolution) [03/13/2022-08:29:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [03/13/2022-08:29:22] [V] [TRT] [03/13/2022-08:29:22] [V] [TRT] *************** Autotuning format combination: Float(1,160,19200,768000), Float(1,160,19200,768000) -> Float(1,160,19200,1536000) *************** [03/13/2022-08:29:24] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_34, Mul_35), Add_36) (PointWise) [03/13/2022-08:29:24] [V] [TRT] Tactic: 128 time 0.092936 [03/13/2022-08:29:24] [V] [TRT] Tactic: 256 time 0.094968 [03/13/2022-08:29:24] [V] [TRT] Tactic: 512 time 0.106468 [03/13/2022-08:29:24] [V] [TRT] Tactic: -32 time 0.146776 [03/13/2022-08:29:24] [V] [TRT] Tactic: -64 time 0.093108 [03/13/2022-08:29:24] [V] [TRT] Tactic: -128 time 0.089384 [03/13/2022-08:29:24] [V] [TRT] Fastest Tactic: -128 Time: 0.089384 [03/13/2022-08:29:24] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_34, Mul_35), Add_36) (PointWiseV2) [03/13/2022-08:29:24] [V] [TRT] Tactic: 0 time 0.05772 [03/13/2022-08:29:24] [V] [TRT] Tactic: 1 time 0.057352 [03/13/2022-08:29:24] [V] [TRT] Tactic: 2 time 0.057252 [03/13/2022-08:29:24] [V] [TRT] Tactic: 3 time 0.057948 [03/13/2022-08:29:24] [V] [TRT] Tactic: 4 time 0.057304 [03/13/2022-08:29:24] [V] [TRT] Tactic: 5 time 0.056992 [03/13/2022-08:29:24] [V] [TRT] Tactic: 6 time 0.058384 [03/13/2022-08:29:24] [V] [TRT] Tactic: 7 time 0.057972 [03/13/2022-08:29:24] [V] [TRT] Tactic: 8 time 0.056248 [03/13/2022-08:29:24] [V] [TRT] Tactic: 9 time 0.057416 [03/13/2022-08:29:24] [V] [TRT] Tactic: 28 time 0.066608 [03/13/2022-08:29:24] [V] [TRT] Fastest Tactic: 8 Time: 0.056248 [03/13/2022-08:29:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:29:24] [V] [TRT] [03/13/2022-08:29:24] [V] [TRT] *************** Autotuning format combination: Float(1,160,19200:32,38400), Float(1,160,19200:32,38400) -> Float(1,160,19200:32,57600) *************** [03/13/2022-08:29:25] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_34, Mul_35), Add_36) (PointWise) [03/13/2022-08:29:25] [V] [TRT] Tactic: 128 time 0.201224 [03/13/2022-08:29:25] [V] [TRT] Tactic: 256 time 0.208664 [03/13/2022-08:29:25] [V] [TRT] Tactic: 512 time 0.2292 [03/13/2022-08:29:25] [V] [TRT] Tactic: -32 time 0.271372 [03/13/2022-08:29:25] [V] [TRT] Tactic: -64 time 0.177664 [03/13/2022-08:29:25] [V] [TRT] Tactic: -128 time 0.175668 [03/13/2022-08:29:25] [V] [TRT] Fastest Tactic: -128 Time: 0.175668 [03/13/2022-08:29:25] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_34, Mul_35), Add_36) (PointWiseV2) [03/13/2022-08:29:25] [V] [TRT] Tactic: 24 time 0.128384 [03/13/2022-08:29:25] [V] [TRT] Tactic: 25 time 0.126344 [03/13/2022-08:29:25] [V] [TRT] Tactic: 26 time 0.125636 [03/13/2022-08:29:25] [V] [TRT] Tactic: 27 time 0.126776 [03/13/2022-08:29:25] [V] [TRT] Tactic: 31 time 0.128276 [03/13/2022-08:29:25] [V] [TRT] Fastest Tactic: 26 Time: 0.125636 [03/13/2022-08:29:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [03/13/2022-08:29:25] [V] [TRT] [03/13/2022-08:29:25] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200,768000), Half(1,160,19200,768000) -> Half(1,160,19200,1536000) *************** [03/13/2022-08:29:27] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_34, Mul_35), Add_36) (PointWise) [03/13/2022-08:29:27] [V] [TRT] Tactic: 128 time 0.120764 [03/13/2022-08:29:27] [V] [TRT] Tactic: 256 time 0.10438 [03/13/2022-08:29:27] [V] [TRT] Tactic: 512 time 0.103292 [03/13/2022-08:29:27] [V] [TRT] Tactic: -32 time 0.187704 [03/13/2022-08:29:27] [V] [TRT] Tactic: -64 time 0.120468 [03/13/2022-08:29:27] [V] [TRT] Tactic: -128 time 0.116684 [03/13/2022-08:29:27] [V] [TRT] Fastest Tactic: 512 Time: 0.103292 [03/13/2022-08:29:27] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_34, Mul_35), Add_36) (PointWiseV2) [03/13/2022-08:29:27] [V] [TRT] Tactic: 0 time 0.063392 [03/13/2022-08:29:27] [V] [TRT] Tactic: 1 time 0.05118 [03/13/2022-08:29:27] [V] [TRT] Tactic: 2 time 0.04186 [03/13/2022-08:29:27] [V] [TRT] Tactic: 3 time 0.045208 [03/13/2022-08:29:27] [V] [TRT] Tactic: 4 time 0.03726 [03/13/2022-08:29:27] [V] [TRT] Tactic: 5 time 0.032076 [03/13/2022-08:29:27] [V] [TRT] Tactic: 6 time 0.04558 [03/13/2022-08:29:27] [V] [TRT] Tactic: 7 time 0.035108 [03/13/2022-08:29:27] [V] [TRT] Tactic: 8 time 0.031748 [03/13/2022-08:29:27] [V] [TRT] Tactic: 9 time 0.031772 [03/13/2022-08:29:27] [V] [TRT] Tactic: 28 time 0.063792 [03/13/2022-08:29:27] [V] [TRT] Fastest Tactic: 8 Time: 0.031748 [03/13/2022-08:29:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:29:27] [V] [TRT] [03/13/2022-08:29:27] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200:2,384000), Half(1,160,19200:2,384000) -> Half(1,160,19200:2,768000) *************** [03/13/2022-08:29:30] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_34, Mul_35), Add_36) (PointWise) [03/13/2022-08:29:30] [V] [TRT] Tactic: 128 time 0.119976 [03/13/2022-08:29:30] [V] [TRT] Tactic: 256 time 0.104328 [03/13/2022-08:29:30] [V] [TRT] Tactic: 512 time 0.10314 [03/13/2022-08:29:30] [V] [TRT] Tactic: -32 time 0.187568 [03/13/2022-08:29:30] [V] [TRT] Tactic: -64 time 0.120868 [03/13/2022-08:29:30] [V] [TRT] Tactic: -128 time 0.116464 [03/13/2022-08:29:30] [V] [TRT] Fastest Tactic: 512 Time: 0.10314 [03/13/2022-08:29:30] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_34, Mul_35), Add_36) (PointWiseV2) [03/13/2022-08:29:30] [V] [TRT] Tactic: 0 time 0.045528 [03/13/2022-08:29:30] [V] [TRT] Tactic: 1 time 0.039524 [03/13/2022-08:29:30] [V] [TRT] Tactic: 2 time 0.04022 [03/13/2022-08:29:30] [V] [TRT] Tactic: 3 time 0.037772 [03/13/2022-08:29:30] [V] [TRT] Tactic: 4 time 0.04024 [03/13/2022-08:29:30] [V] [TRT] Tactic: 5 time 0.04824 [03/13/2022-08:29:30] [V] [TRT] Tactic: 6 time 0.039156 [03/13/2022-08:29:30] [V] [TRT] Tactic: 7 time 0.0418 [03/13/2022-08:29:30] [V] [TRT] Tactic: 8 time 0.055048 [03/13/2022-08:29:30] [V] [TRT] Tactic: 9 time 0.079248 [03/13/2022-08:29:30] [V] [TRT] Tactic: 10 time 0.06662 [03/13/2022-08:29:31] [V] [TRT] Tactic: 11 time 0.0548 [03/13/2022-08:29:31] [V] [TRT] Tactic: 12 time 0.044668 [03/13/2022-08:29:31] [V] [TRT] Tactic: 13 time 0.047828 [03/13/2022-08:29:31] [V] [TRT] Tactic: 14 time 0.04018 [03/13/2022-08:29:31] [V] [TRT] Tactic: 15 time 0.03492 [03/13/2022-08:29:31] [V] [TRT] Tactic: 16 time 0.048532 [03/13/2022-08:29:31] [V] [TRT] Tactic: 17 time 0.0387 [03/13/2022-08:29:31] [V] [TRT] Tactic: 18 time 0.033616 [03/13/2022-08:29:31] [V] [TRT] Tactic: 19 time 0.032924 [03/13/2022-08:29:31] [V] [TRT] Tactic: 28 time 0.044972 [03/13/2022-08:29:31] [V] [TRT] Tactic: 29 time 0.066096 [03/13/2022-08:29:31] [V] [TRT] Fastest Tactic: 19 Time: 0.032924 [03/13/2022-08:29:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 19 [03/13/2022-08:29:31] [V] [TRT] [03/13/2022-08:29:31] [V] [TRT] *************** Autotuning format combination: Half(5,800,1:8,96000), Half(5,800,1:8,96000) -> Half(10,1600,1:8,192000) *************** [03/13/2022-08:29:36] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_34, Mul_35), Add_36) (PointWise) [03/13/2022-08:29:36] [V] [TRT] Tactic: 128 time 0.120596 [03/13/2022-08:29:36] [V] [TRT] Tactic: 256 time 0.10478 [03/13/2022-08:29:36] [V] [TRT] Tactic: 512 time 0.104488 [03/13/2022-08:29:36] [V] [TRT] Tactic: -32 time 0.298816 [03/13/2022-08:29:36] [V] [TRT] Tactic: -64 time 0.303136 [03/13/2022-08:29:36] [V] [TRT] Tactic: -128 time 0.303092 [03/13/2022-08:29:36] [V] [TRT] Fastest Tactic: 512 Time: 0.104488 [03/13/2022-08:29:36] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_34, Mul_35), Add_36) (PointWiseV2) [03/13/2022-08:29:36] [V] [TRT] Tactic: 0 time 0.145184 [03/13/2022-08:29:36] [V] [TRT] Tactic: 1 time 0.164832 [03/13/2022-08:29:36] [V] [TRT] Tactic: 2 time 0.152672 [03/13/2022-08:29:36] [V] [TRT] Tactic: 3 time 0.204748 [03/13/2022-08:29:36] [V] [TRT] Tactic: 4 time 0.186 [03/13/2022-08:29:36] [V] [TRT] Tactic: 5 time 0.16784 [03/13/2022-08:29:36] [V] [TRT] Tactic: 6 time 0.293024 [03/13/2022-08:29:36] [V] [TRT] Tactic: 7 time 0.236028 [03/13/2022-08:29:36] [V] [TRT] Tactic: 8 time 0.206756 [03/13/2022-08:29:36] [V] [TRT] Tactic: 9 time 0.2229 [03/13/2022-08:29:36] [V] [TRT] Tactic: 10 time 0.105544 [03/13/2022-08:29:36] [V] [TRT] Tactic: 11 time 0.10602 [03/13/2022-08:29:36] [V] [TRT] Tactic: 12 time 0.109736 [03/13/2022-08:29:36] [V] [TRT] Tactic: 13 time 0.126184 [03/13/2022-08:29:36] [V] [TRT] Tactic: 14 time 0.119816 [03/13/2022-08:29:36] [V] [TRT] Tactic: 15 time 0.112264 [03/13/2022-08:29:36] [V] [TRT] Tactic: 16 time 0.172752 [03/13/2022-08:29:36] [V] [TRT] Tactic: 17 time 0.150504 [03/13/2022-08:29:36] [V] [TRT] Tactic: 18 time 0.131016 [03/13/2022-08:29:36] [V] [TRT] Tactic: 19 time 0.133444 [03/13/2022-08:29:36] [V] [TRT] Tactic: 20 time 0.07318 [03/13/2022-08:29:36] [V] [TRT] Tactic: 21 time 0.081736 [03/13/2022-08:29:36] [V] [TRT] Tactic: 22 time 0.094608 [03/13/2022-08:29:36] [V] [TRT] Tactic: 23 time 0.122924 [03/13/2022-08:29:36] [V] [TRT] Tactic: 24 time 0.102296 [03/13/2022-08:29:36] [V] [TRT] Tactic: 25 time 0.072472 [03/13/2022-08:29:36] [V] [TRT] Tactic: 26 time 0.087804 [03/13/2022-08:29:36] [V] [TRT] Tactic: 27 time 0.120688 [03/13/2022-08:29:36] [V] [TRT] Tactic: 28 time 0.058264 [03/13/2022-08:29:36] [V] [TRT] Tactic: 29 time 0.047288 [03/13/2022-08:29:36] [V] [TRT] Tactic: 30 time 0.04766 [03/13/2022-08:29:36] [V] [TRT] Tactic: 31 time 0.067944 [03/13/2022-08:29:36] [V] [TRT] Fastest Tactic: 29 Time: 0.047288 [03/13/2022-08:29:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 29 [03/13/2022-08:29:36] [V] [TRT] [03/13/2022-08:29:36] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:36] [V] [TRT] Tactic: 1002 time 0.125488 [03/13/2022-08:29:36] [V] [TRT] Tactic: 0 time 0.514248 [03/13/2022-08:29:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.125488 [03/13/2022-08:29:36] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:36] [V] [TRT] Tactic: 1002 time 0.057788 [03/13/2022-08:29:36] [V] [TRT] Tactic: 0 time 0.057672 [03/13/2022-08:29:36] [V] [TRT] Fastest Tactic: 0 Time: 0.057672 [03/13/2022-08:29:36] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:36] [V] [TRT] Tactic: 1002 time 0.142568 [03/13/2022-08:29:36] [V] [TRT] Tactic: 0 time 0.048812 [03/13/2022-08:29:36] [V] [TRT] Fastest Tactic: 0 Time: 0.048812 [03/13/2022-08:29:36] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:36] [V] [TRT] Tactic: 1002 time 0.126864 [03/13/2022-08:29:36] [V] [TRT] Tactic: 0 time 0.061636 [03/13/2022-08:29:36] [V] [TRT] Fastest Tactic: 0 Time: 0.061636 [03/13/2022-08:29:36] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:36] [V] [TRT] Tactic: 1002 time 0.242696 [03/13/2022-08:29:36] [V] [TRT] Tactic: 0 time 0.303768 [03/13/2022-08:29:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.242696 [03/13/2022-08:29:36] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:36] [V] [TRT] Tactic: 1002 time 0.216964 [03/13/2022-08:29:36] [V] [TRT] Tactic: 0 time 0.292444 [03/13/2022-08:29:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.216964 [03/13/2022-08:29:36] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:36] [V] [TRT] Tactic: 1002 time 0.17412 [03/13/2022-08:29:37] [V] [TRT] Tactic: 0 time 0.319388 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.17412 [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:37] [V] [TRT] Tactic: 1002 time 0.139268 [03/13/2022-08:29:37] [V] [TRT] Tactic: 0 time 0.070976 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 0 Time: 0.070976 [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:37] [V] [TRT] Tactic: 1002 time 0.06114 [03/13/2022-08:29:37] [V] [TRT] Tactic: 0 time 0.0585 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 0 Time: 0.0585 [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:37] [V] [TRT] Tactic: 1002 time 0.12588 [03/13/2022-08:29:37] [V] [TRT] Tactic: 0 time 0.497508 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.12588 [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:37] [V] [TRT] Tactic: 1002 time 0.145452 [03/13/2022-08:29:37] [V] [TRT] Tactic: 0 time 0.046556 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 0 Time: 0.046556 [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:37] [V] [TRT] Tactic: 1002 time 0.126988 [03/13/2022-08:29:37] [V] [TRT] Tactic: 0 time 0.047776 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 0 Time: 0.047776 [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:37] [V] [TRT] Tactic: 1002 time 0.127576 [03/13/2022-08:29:37] [V] [TRT] Tactic: 0 time 0.05946 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 0 Time: 0.05946 [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:37] [V] [TRT] Tactic: 1002 time 0.124956 [03/13/2022-08:29:37] [V] [TRT] Tactic: 0 time 0.490408 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.124956 [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:37] [V] [TRT] Tactic: 1002 time 0.127056 [03/13/2022-08:29:37] [V] [TRT] Tactic: 0 time 0.053764 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 0 Time: 0.053764 [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:37] [V] [TRT] Tactic: 1002 time 0.127056 [03/13/2022-08:29:37] [V] [TRT] Tactic: 0 time 0.046192 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 0 Time: 0.046192 [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:37] [V] [TRT] Tactic: 1002 time 0.128472 [03/13/2022-08:29:37] [V] [TRT] Tactic: 0 time 0.3037 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.128472 [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:37] [V] [TRT] Tactic: 1002 time 0.10494 [03/13/2022-08:29:37] [V] [TRT] Tactic: 0 time 0.754504 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.10494 [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:37] [V] [TRT] Tactic: 1002 time 0.128276 [03/13/2022-08:29:37] [V] [TRT] Tactic: 0 time 0.289604 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.128276 [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:37] [V] [TRT] Tactic: 1002 time 0.122188 [03/13/2022-08:29:37] [V] [TRT] Tactic: 0 time 0.037976 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 0 Time: 0.037976 [03/13/2022-08:29:37] [V] [TRT] *************** Autotuning format combination: Float(1,160,19200,1536000) -> Float(1,160,19200,1536000) *************** [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_39, Mul_40) (PointWise) [03/13/2022-08:29:37] [V] [TRT] Tactic: 128 time 0.08806 [03/13/2022-08:29:37] [V] [TRT] Tactic: 256 time 0.090024 [03/13/2022-08:29:37] [V] [TRT] Tactic: 512 time 0.099832 [03/13/2022-08:29:37] [V] [TRT] Tactic: -32 time 0.130632 [03/13/2022-08:29:37] [V] [TRT] Tactic: -64 time 0.081796 [03/13/2022-08:29:37] [V] [TRT] Tactic: -128 time 0.079076 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: -128 Time: 0.079076 [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_39, Mul_40) (PointWiseV2) [03/13/2022-08:29:37] [V] [TRT] Tactic: 0 time 0.056164 [03/13/2022-08:29:37] [V] [TRT] Tactic: 1 time 0.046776 [03/13/2022-08:29:37] [V] [TRT] Tactic: 2 time 0.040856 [03/13/2022-08:29:37] [V] [TRT] Tactic: 3 time 0.043852 [03/13/2022-08:29:37] [V] [TRT] Tactic: 4 time 0.04092 [03/13/2022-08:29:37] [V] [TRT] Tactic: 5 time 0.040652 [03/13/2022-08:29:37] [V] [TRT] Tactic: 6 time 0.045132 [03/13/2022-08:29:37] [V] [TRT] Tactic: 7 time 0.040928 [03/13/2022-08:29:37] [V] [TRT] Tactic: 8 time 0.0412 [03/13/2022-08:29:37] [V] [TRT] Tactic: 9 time 0.04058 [03/13/2022-08:29:37] [V] [TRT] Tactic: 28 time 0.056472 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 9 Time: 0.04058 [03/13/2022-08:29:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:29:37] [V] [TRT] [03/13/2022-08:29:37] [V] [TRT] *************** Autotuning format combination: Float(1,160,19200:32,57600) -> Float(1,160,19200:32,57600) *************** [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_39, Mul_40) (PointWise) [03/13/2022-08:29:37] [V] [TRT] Tactic: 128 time 0.148664 [03/13/2022-08:29:37] [V] [TRT] Tactic: 256 time 0.14754 [03/13/2022-08:29:37] [V] [TRT] Tactic: 512 time 0.16586 [03/13/2022-08:29:37] [V] [TRT] Tactic: -32 time 0.186924 [03/13/2022-08:29:37] [V] [TRT] Tactic: -64 time 0.118448 [03/13/2022-08:29:37] [V] [TRT] Tactic: -128 time 0.117288 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: -128 Time: 0.117288 [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_39, Mul_40) (PointWiseV2) [03/13/2022-08:29:37] [V] [TRT] Tactic: 24 time 0.07288 [03/13/2022-08:29:37] [V] [TRT] Tactic: 25 time 0.074148 [03/13/2022-08:29:37] [V] [TRT] Tactic: 26 time 0.07564 [03/13/2022-08:29:37] [V] [TRT] Tactic: 27 time 0.07592 [03/13/2022-08:29:37] [V] [TRT] Tactic: 31 time 0.072564 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 31 Time: 0.072564 [03/13/2022-08:29:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [03/13/2022-08:29:37] [V] [TRT] [03/13/2022-08:29:37] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200,1536000) -> Half(1,160,19200,1536000) *************** [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_39, Mul_40) (PointWise) [03/13/2022-08:29:37] [V] [TRT] Tactic: 128 time 0.084304 [03/13/2022-08:29:37] [V] [TRT] Tactic: 256 time 0.067488 [03/13/2022-08:29:37] [V] [TRT] Tactic: 512 time 0.066416 [03/13/2022-08:29:37] [V] [TRT] Tactic: -32 time 0.111152 [03/13/2022-08:29:37] [V] [TRT] Tactic: -64 time 0.074812 [03/13/2022-08:29:37] [V] [TRT] Tactic: -128 time 0.073236 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 512 Time: 0.066416 [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_39, Mul_40) (PointWiseV2) [03/13/2022-08:29:37] [V] [TRT] Tactic: 0 time 0.051492 [03/13/2022-08:29:37] [V] [TRT] Tactic: 1 time 0.04132 [03/13/2022-08:29:37] [V] [TRT] Tactic: 2 time 0.033712 [03/13/2022-08:29:37] [V] [TRT] Tactic: 3 time 0.036656 [03/13/2022-08:29:37] [V] [TRT] Tactic: 4 time 0.028652 [03/13/2022-08:29:37] [V] [TRT] Tactic: 5 time 0.02358 [03/13/2022-08:29:37] [V] [TRT] Tactic: 6 time 0.036908 [03/13/2022-08:29:37] [V] [TRT] Tactic: 7 time 0.026932 [03/13/2022-08:29:37] [V] [TRT] Tactic: 8 time 0.02314 [03/13/2022-08:29:37] [V] [TRT] Tactic: 9 time 0.022464 [03/13/2022-08:29:37] [V] [TRT] Tactic: 28 time 0.051472 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 9 Time: 0.022464 [03/13/2022-08:29:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:29:37] [V] [TRT] [03/13/2022-08:29:37] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200:2,768000) -> Half(1,160,19200:2,768000) *************** [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_39, Mul_40) (PointWise) [03/13/2022-08:29:37] [V] [TRT] Tactic: 128 time 0.083428 [03/13/2022-08:29:37] [V] [TRT] Tactic: 256 time 0.067532 [03/13/2022-08:29:37] [V] [TRT] Tactic: 512 time 0.065968 [03/13/2022-08:29:37] [V] [TRT] Tactic: -32 time 0.110788 [03/13/2022-08:29:37] [V] [TRT] Tactic: -64 time 0.07362 [03/13/2022-08:29:37] [V] [TRT] Tactic: -128 time 0.073176 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 512 Time: 0.065968 [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_39, Mul_40) (PointWiseV2) [03/13/2022-08:29:37] [V] [TRT] Tactic: 0 time 0.034808 [03/13/2022-08:29:37] [V] [TRT] Tactic: 1 time 0.029544 [03/13/2022-08:29:37] [V] [TRT] Tactic: 2 time 0.029728 [03/13/2022-08:29:37] [V] [TRT] Tactic: 3 time 0.028232 [03/13/2022-08:29:37] [V] [TRT] Tactic: 4 time 0.028024 [03/13/2022-08:29:37] [V] [TRT] Tactic: 5 time 0.030084 [03/13/2022-08:29:37] [V] [TRT] Tactic: 6 time 0.029088 [03/13/2022-08:29:37] [V] [TRT] Tactic: 7 time 0.029296 [03/13/2022-08:29:37] [V] [TRT] Tactic: 8 time 0.031316 [03/13/2022-08:29:37] [V] [TRT] Tactic: 9 time 0.038508 [03/13/2022-08:29:37] [V] [TRT] Tactic: 10 time 0.053896 [03/13/2022-08:29:37] [V] [TRT] Tactic: 11 time 0.042428 [03/13/2022-08:29:37] [V] [TRT] Tactic: 12 time 0.034852 [03/13/2022-08:29:37] [V] [TRT] Tactic: 13 time 0.036868 [03/13/2022-08:29:37] [V] [TRT] Tactic: 14 time 0.029048 [03/13/2022-08:29:37] [V] [TRT] Tactic: 15 time 0.02484 [03/13/2022-08:29:37] [V] [TRT] Tactic: 16 time 0.037012 [03/13/2022-08:29:37] [V] [TRT] Tactic: 17 time 0.026692 [03/13/2022-08:29:37] [V] [TRT] Tactic: 18 time 0.02296 [03/13/2022-08:29:37] [V] [TRT] Tactic: 19 time 0.02282 [03/13/2022-08:29:37] [V] [TRT] Tactic: 28 time 0.034124 [03/13/2022-08:29:37] [V] [TRT] Tactic: 29 time 0.053308 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 19 Time: 0.02282 [03/13/2022-08:29:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 19 [03/13/2022-08:29:37] [V] [TRT] [03/13/2022-08:29:37] [V] [TRT] *************** Autotuning format combination: Half(10,1600,1:8,192000) -> Half(10,1600,1:8,192000) *************** [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_39, Mul_40) (PointWise) [03/13/2022-08:29:37] [V] [TRT] Tactic: 128 time 0.08364 [03/13/2022-08:29:37] [V] [TRT] Tactic: 256 time 0.068116 [03/13/2022-08:29:37] [V] [TRT] Tactic: 512 time 0.067272 [03/13/2022-08:29:37] [V] [TRT] Tactic: -32 time 0.187236 [03/13/2022-08:29:37] [V] [TRT] Tactic: -64 time 0.190224 [03/13/2022-08:29:37] [V] [TRT] Tactic: -128 time 0.190136 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 512 Time: 0.067272 [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_39, Mul_40) (PointWiseV2) [03/13/2022-08:29:37] [V] [TRT] Tactic: 0 time 0.098084 [03/13/2022-08:29:37] [V] [TRT] Tactic: 1 time 0.110572 [03/13/2022-08:29:37] [V] [TRT] Tactic: 2 time 0.109412 [03/13/2022-08:29:37] [V] [TRT] Tactic: 3 time 0.145924 [03/13/2022-08:29:37] [V] [TRT] Tactic: 4 time 0.134912 [03/13/2022-08:29:37] [V] [TRT] Tactic: 5 time 0.119168 [03/13/2022-08:29:37] [V] [TRT] Tactic: 6 time 0.226124 [03/13/2022-08:29:37] [V] [TRT] Tactic: 7 time 0.17578 [03/13/2022-08:29:37] [V] [TRT] Tactic: 8 time 0.155444 [03/13/2022-08:29:37] [V] [TRT] Tactic: 9 time 0.17768 [03/13/2022-08:29:37] [V] [TRT] Tactic: 10 time 0.069644 [03/13/2022-08:29:37] [V] [TRT] Tactic: 11 time 0.075996 [03/13/2022-08:29:37] [V] [TRT] Tactic: 12 time 0.073596 [03/13/2022-08:29:37] [V] [TRT] Tactic: 13 time 0.093136 [03/13/2022-08:29:37] [V] [TRT] Tactic: 14 time 0.088596 [03/13/2022-08:29:37] [V] [TRT] Tactic: 15 time 0.077604 [03/13/2022-08:29:37] [V] [TRT] Tactic: 16 time 0.133644 [03/13/2022-08:29:37] [V] [TRT] Tactic: 17 time 0.11264 [03/13/2022-08:29:37] [V] [TRT] Tactic: 18 time 0.099848 [03/13/2022-08:29:37] [V] [TRT] Tactic: 19 time 0.09552 [03/13/2022-08:29:37] [V] [TRT] Tactic: 20 time 0.057436 [03/13/2022-08:29:37] [V] [TRT] Tactic: 21 time 0.060828 [03/13/2022-08:29:37] [V] [TRT] Tactic: 22 time 0.070748 [03/13/2022-08:29:37] [V] [TRT] Tactic: 23 time 0.093 [03/13/2022-08:29:37] [V] [TRT] Tactic: 24 time 0.083596 [03/13/2022-08:29:37] [V] [TRT] Tactic: 25 time 0.066424 [03/13/2022-08:29:37] [V] [TRT] Tactic: 26 time 0.072836 [03/13/2022-08:29:37] [V] [TRT] Tactic: 27 time 0.086864 [03/13/2022-08:29:37] [V] [TRT] Tactic: 28 time 0.044436 [03/13/2022-08:29:37] [V] [TRT] Tactic: 29 time 0.038912 [03/13/2022-08:29:37] [V] [TRT] Tactic: 30 time 0.038188 [03/13/2022-08:29:37] [V] [TRT] Tactic: 31 time 0.056252 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 30 Time: 0.038188 [03/13/2022-08:29:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 30 [03/13/2022-08:29:37] [V] [TRT] [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:37] [V] [TRT] Tactic: 1002 time 0.11678 [03/13/2022-08:29:37] [V] [TRT] Tactic: 0 time 0.756948 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.11678 [03/13/2022-08:29:37] [V] [TRT] *************** Autotuning format combination: Float(1,160,19200,1536000) -> Float(1,160,19200,1536000) *************** [03/13/2022-08:29:37] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200,1536000) -> Half(1,160,19200,1536000) *************** [03/13/2022-08:29:37] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200:2,768000) -> Half(1,160,19200,1536000) *************** [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: Conv_42 (FusedConvActConvolution) [03/13/2022-08:29:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: Conv_42 (CaskConvolution) [03/13/2022-08:29:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: Conv_42 (CudaConvolution) [03/13/2022-08:29:37] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: Conv_42 (CudaDepthwiseConvolution) [03/13/2022-08:29:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:37] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200:2,768000) -> Half(1,160,19200:2,768000) *************** [03/13/2022-08:29:37] [V] [TRT] *************** Autotuning format combination: Half(10,1600,1:8,192000) -> Float(1,160,19200,1536000) *************** [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: Conv_42 (FusedConvActConvolution) [03/13/2022-08:29:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: Conv_42 (CaskConvolution) [03/13/2022-08:29:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: Conv_42 (CudaConvolution) [03/13/2022-08:29:37] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: Conv_42 (CudaDepthwiseConvolution) [03/13/2022-08:29:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:37] [V] [TRT] *************** Autotuning format combination: Half(10,1600,1:8,192000) -> Half(10,1600,1:8,192000) *************** [03/13/2022-08:29:37] [V] [TRT] *************** Autotuning format combination: Float(1,160,19200,1536000) -> Float(1,160,19200,1536000) *************** [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_44, Mul_45) (PointWise) [03/13/2022-08:29:37] [V] [TRT] Tactic: 128 time 0.138784 [03/13/2022-08:29:37] [V] [TRT] Tactic: 256 time 0.142228 [03/13/2022-08:29:37] [V] [TRT] Tactic: 512 time 0.160376 [03/13/2022-08:29:37] [V] [TRT] Tactic: -32 time 0.222328 [03/13/2022-08:29:37] [V] [TRT] Tactic: -64 time 0.141592 [03/13/2022-08:29:37] [V] [TRT] Tactic: -128 time 0.141004 [03/13/2022-08:29:37] [V] [TRT] Fastest Tactic: 128 Time: 0.138784 [03/13/2022-08:29:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_44, Mul_45) (PointWiseV2) [03/13/2022-08:29:38] [V] [TRT] Tactic: 0 time 0.096964 [03/13/2022-08:29:38] [V] [TRT] Tactic: 1 time 0.08006 [03/13/2022-08:29:38] [V] [TRT] Tactic: 2 time 0.077444 [03/13/2022-08:29:38] [V] [TRT] Tactic: 3 time 0.078716 [03/13/2022-08:29:38] [V] [TRT] Tactic: 4 time 0.076364 [03/13/2022-08:29:38] [V] [TRT] Tactic: 5 time 0.076692 [03/13/2022-08:29:38] [V] [TRT] Tactic: 6 time 0.08226 [03/13/2022-08:29:38] [V] [TRT] Tactic: 7 time 0.076536 [03/13/2022-08:29:38] [V] [TRT] Tactic: 8 time 0.076368 [03/13/2022-08:29:38] [V] [TRT] Tactic: 9 time 0.076444 [03/13/2022-08:29:38] [V] [TRT] Tactic: 28 time 0.096136 [03/13/2022-08:29:38] [V] [TRT] Fastest Tactic: 4 Time: 0.076364 [03/13/2022-08:29:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [03/13/2022-08:29:38] [V] [TRT] [03/13/2022-08:29:38] [V] [TRT] *************** Autotuning format combination: Float(1,160,19200:32,57600) -> Float(1,160,19200:32,57600) *************** [03/13/2022-08:29:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_44, Mul_45) (PointWise) [03/13/2022-08:29:38] [V] [TRT] Tactic: 128 time 0.215928 [03/13/2022-08:29:38] [V] [TRT] Tactic: 256 time 0.217904 [03/13/2022-08:29:38] [V] [TRT] Tactic: 512 time 0.245396 [03/13/2022-08:29:38] [V] [TRT] Tactic: -32 time 0.274956 [03/13/2022-08:29:38] [V] [TRT] Tactic: -64 time 0.17082 [03/13/2022-08:29:38] [V] [TRT] Tactic: -128 time 0.172012 [03/13/2022-08:29:38] [V] [TRT] Fastest Tactic: -64 Time: 0.17082 [03/13/2022-08:29:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_44, Mul_45) (PointWiseV2) [03/13/2022-08:29:38] [V] [TRT] Tactic: 24 time 0.10648 [03/13/2022-08:29:38] [V] [TRT] Tactic: 25 time 0.10854 [03/13/2022-08:29:38] [V] [TRT] Tactic: 26 time 0.10978 [03/13/2022-08:29:38] [V] [TRT] Tactic: 27 time 0.110008 [03/13/2022-08:29:38] [V] [TRT] Tactic: 31 time 0.106176 [03/13/2022-08:29:38] [V] [TRT] Fastest Tactic: 31 Time: 0.106176 [03/13/2022-08:29:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [03/13/2022-08:29:38] [V] [TRT] [03/13/2022-08:29:38] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200,1536000) -> Half(1,160,19200,1536000) *************** [03/13/2022-08:29:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_44, Mul_45) (PointWise) [03/13/2022-08:29:38] [V] [TRT] Tactic: 128 time 0.1372 [03/13/2022-08:29:38] [V] [TRT] Tactic: 256 time 0.114012 [03/13/2022-08:29:38] [V] [TRT] Tactic: 512 time 0.111136 [03/13/2022-08:29:38] [V] [TRT] Tactic: -32 time 0.185108 [03/13/2022-08:29:38] [V] [TRT] Tactic: -64 time 0.126284 [03/13/2022-08:29:38] [V] [TRT] Tactic: -128 time 0.126696 [03/13/2022-08:29:38] [V] [TRT] Fastest Tactic: 512 Time: 0.111136 [03/13/2022-08:29:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_44, Mul_45) (PointWiseV2) [03/13/2022-08:29:38] [V] [TRT] Tactic: 0 time 0.086912 [03/13/2022-08:29:38] [V] [TRT] Tactic: 1 time 0.07046 [03/13/2022-08:29:38] [V] [TRT] Tactic: 2 time 0.056728 [03/13/2022-08:29:38] [V] [TRT] Tactic: 3 time 0.06402 [03/13/2022-08:29:38] [V] [TRT] Tactic: 4 time 0.046976 [03/13/2022-08:29:38] [V] [TRT] Tactic: 5 time 0.041184 [03/13/2022-08:29:38] [V] [TRT] Tactic: 6 time 0.063504 [03/13/2022-08:29:38] [V] [TRT] Tactic: 7 time 0.045268 [03/13/2022-08:29:38] [V] [TRT] Tactic: 8 time 0.041412 [03/13/2022-08:29:38] [V] [TRT] Tactic: 9 time 0.041076 [03/13/2022-08:29:38] [V] [TRT] Tactic: 28 time 0.086032 [03/13/2022-08:29:38] [V] [TRT] Fastest Tactic: 9 Time: 0.041076 [03/13/2022-08:29:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:29:38] [V] [TRT] [03/13/2022-08:29:38] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200:2,768000) -> Half(1,160,19200:2,768000) *************** [03/13/2022-08:29:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_44, Mul_45) (PointWise) [03/13/2022-08:29:38] [V] [TRT] Tactic: 128 time 0.137304 [03/13/2022-08:29:38] [V] [TRT] Tactic: 256 time 0.114124 [03/13/2022-08:29:38] [V] [TRT] Tactic: 512 time 0.110656 [03/13/2022-08:29:38] [V] [TRT] Tactic: -32 time 0.185032 [03/13/2022-08:29:38] [V] [TRT] Tactic: -64 time 0.126824 [03/13/2022-08:29:38] [V] [TRT] Tactic: -128 time 0.126564 [03/13/2022-08:29:38] [V] [TRT] Fastest Tactic: 512 Time: 0.110656 [03/13/2022-08:29:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_44, Mul_45) (PointWiseV2) [03/13/2022-08:29:38] [V] [TRT] Tactic: 0 time 0.057824 [03/13/2022-08:29:38] [V] [TRT] Tactic: 1 time 0.049168 [03/13/2022-08:29:38] [V] [TRT] Tactic: 2 time 0.04992 [03/13/2022-08:29:38] [V] [TRT] Tactic: 3 time 0.047432 [03/13/2022-08:29:38] [V] [TRT] Tactic: 4 time 0.047052 [03/13/2022-08:29:38] [V] [TRT] Tactic: 5 time 0.051764 [03/13/2022-08:29:38] [V] [TRT] Tactic: 6 time 0.049204 [03/13/2022-08:29:38] [V] [TRT] Tactic: 7 time 0.048788 [03/13/2022-08:29:38] [V] [TRT] Tactic: 8 time 0.053676 [03/13/2022-08:29:38] [V] [TRT] Tactic: 9 time 0.070568 [03/13/2022-08:29:38] [V] [TRT] Tactic: 10 time 0.090056 [03/13/2022-08:29:38] [V] [TRT] Tactic: 11 time 0.071808 [03/13/2022-08:29:38] [V] [TRT] Tactic: 12 time 0.058656 [03/13/2022-08:29:38] [V] [TRT] Tactic: 13 time 0.0648 [03/13/2022-08:29:38] [V] [TRT] Tactic: 14 time 0.047632 [03/13/2022-08:29:38] [V] [TRT] Tactic: 15 time 0.04176 [03/13/2022-08:29:38] [V] [TRT] Tactic: 16 time 0.064232 [03/13/2022-08:29:38] [V] [TRT] Tactic: 17 time 0.045824 [03/13/2022-08:29:38] [V] [TRT] Tactic: 18 time 0.041428 [03/13/2022-08:29:38] [V] [TRT] Tactic: 19 time 0.041288 [03/13/2022-08:29:38] [V] [TRT] Tactic: 28 time 0.057604 [03/13/2022-08:29:38] [V] [TRT] Tactic: 29 time 0.089556 [03/13/2022-08:29:38] [V] [TRT] Fastest Tactic: 19 Time: 0.041288 [03/13/2022-08:29:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 19 [03/13/2022-08:29:38] [V] [TRT] [03/13/2022-08:29:38] [V] [TRT] *************** Autotuning format combination: Half(10,1600,1:8,192000) -> Half(10,1600,1:8,192000) *************** [03/13/2022-08:29:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_44, Mul_45) (PointWise) [03/13/2022-08:29:38] [V] [TRT] Tactic: 128 time 0.137756 [03/13/2022-08:29:38] [V] [TRT] Tactic: 256 time 0.114792 [03/13/2022-08:29:38] [V] [TRT] Tactic: 512 time 0.111304 [03/13/2022-08:29:38] [V] [TRT] Tactic: -32 time 0.185088 [03/13/2022-08:29:38] [V] [TRT] Tactic: -64 time 0.126484 [03/13/2022-08:29:38] [V] [TRT] Tactic: -128 time 0.126408 [03/13/2022-08:29:38] [V] [TRT] Fastest Tactic: 512 Time: 0.111304 [03/13/2022-08:29:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_44, Mul_45) (PointWiseV2) [03/13/2022-08:29:38] [V] [TRT] Tactic: 0 time 0.047328 [03/13/2022-08:29:38] [V] [TRT] Tactic: 1 time 0.04804 [03/13/2022-08:29:38] [V] [TRT] Tactic: 2 time 0.058376 [03/13/2022-08:29:38] [V] [TRT] Tactic: 3 time 0.04934 [03/13/2022-08:29:38] [V] [TRT] Tactic: 4 time 0.060084 [03/13/2022-08:29:38] [V] [TRT] Tactic: 5 time 0.078144 [03/13/2022-08:29:38] [V] [TRT] Tactic: 6 time 0.049116 [03/13/2022-08:29:38] [V] [TRT] Tactic: 7 time 0.06158 [03/13/2022-08:29:38] [V] [TRT] Tactic: 8 time 0.075356 [03/13/2022-08:29:38] [V] [TRT] Tactic: 9 time 0.101068 [03/13/2022-08:29:38] [V] [TRT] Tactic: 10 time 0.04256 [03/13/2022-08:29:38] [V] [TRT] Tactic: 11 time 0.043072 [03/13/2022-08:29:38] [V] [TRT] Tactic: 12 time 0.047448 [03/13/2022-08:29:38] [V] [TRT] Tactic: 13 time 0.04324 [03/13/2022-08:29:38] [V] [TRT] Tactic: 14 time 0.048704 [03/13/2022-08:29:38] [V] [TRT] Tactic: 15 time 0.061156 [03/13/2022-08:29:38] [V] [TRT] Tactic: 16 time 0.044944 [03/13/2022-08:29:38] [V] [TRT] Tactic: 17 time 0.050176 [03/13/2022-08:29:38] [V] [TRT] Tactic: 18 time 0.063516 [03/13/2022-08:29:38] [V] [TRT] Tactic: 19 time 0.08392 [03/13/2022-08:29:38] [V] [TRT] Tactic: 20 time 0.059468 [03/13/2022-08:29:38] [V] [TRT] Tactic: 21 time 0.049568 [03/13/2022-08:29:38] [V] [TRT] Tactic: 22 time 0.047396 [03/13/2022-08:29:38] [V] [TRT] Tactic: 23 time 0.049144 [03/13/2022-08:29:38] [V] [TRT] Tactic: 24 time 0.090016 [03/13/2022-08:29:38] [V] [TRT] Tactic: 25 time 0.071672 [03/13/2022-08:29:38] [V] [TRT] Tactic: 26 time 0.064984 [03/13/2022-08:29:38] [V] [TRT] Tactic: 27 time 0.064464 [03/13/2022-08:29:38] [V] [TRT] Tactic: 28 time 0.047084 [03/13/2022-08:29:38] [V] [TRT] Tactic: 29 time 0.042924 [03/13/2022-08:29:38] [V] [TRT] Tactic: 30 time 0.059436 [03/13/2022-08:29:38] [V] [TRT] Tactic: 31 time 0.08886 [03/13/2022-08:29:38] [V] [TRT] Fastest Tactic: 10 Time: 0.04256 [03/13/2022-08:29:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [03/13/2022-08:29:38] [V] [TRT] [03/13/2022-08:29:38] [V] [TRT] *************** Autotuning format combination: Float(1,160,19200,1536000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:29:38] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:29:38] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:29:38] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:38] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:29:38] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:29:38] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:29:38] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:29:38] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:29:38] [V] [TRT] --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [03/13/2022-08:29:38] [V] [TRT] Tactic: 458751 time 0.68646 [03/13/2022-08:29:38] [V] [TRT] Fastest Tactic: 458751 Time: 0.68646 [03/13/2022-08:29:38] [V] [TRT] --------------- Timing Runner: Conv_46 (CaskConvolution) [03/13/2022-08:29:38] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:29:38] [V] [TRT] Tactic: 1825138533642645384 time 0.650412 [03/13/2022-08:29:38] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:29:38] [V] [TRT] Tactic: 2842488832350522458 time 0.504872 [03/13/2022-08:29:38] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:38] [V] [TRT] Tactic: 3915320020053085238 time 0.647348 [03/13/2022-08:29:38] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:29:38] [V] [TRT] Tactic: 6448355332020552203 time 0.679588 [03/13/2022-08:29:38] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: 6808617066150061604 time 0.518936 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: -8060443123034038864 time 0.524764 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: -4420849921117327522 time 0.547156 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: -3946921629105938337 time 0.528196 [03/13/2022-08:29:39] [V] [TRT] Fastest Tactic: 2842488832350522458 Time: 0.504872 [03/13/2022-08:29:39] [V] [TRT] --------------- Timing Runner: Conv_46 (CudaConvolution) [03/13/2022-08:29:39] [V] [TRT] Tactic: 0 time 0.98236 [03/13/2022-08:29:39] [V] [TRT] Tactic: 2 time 1.14064 [03/13/2022-08:29:39] [V] [TRT] Tactic: 5 skipped. Scratch requested: 57794560, available: 16777216 [03/13/2022-08:29:39] [V] [TRT] Tactic: 57 time 0.54016 [03/13/2022-08:29:39] [V] [TRT] Fastest Tactic: 57 Time: 0.54016 [03/13/2022-08:29:39] [V] [TRT] --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [03/13/2022-08:29:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2842488832350522458 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] [03/13/2022-08:29:39] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200,1536000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:29:39] [V] [TRT] --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [03/13/2022-08:29:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:39] [V] [TRT] --------------- Timing Runner: Conv_46 (CaskConvolution) [03/13/2022-08:29:39] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:39] [V] [TRT] --------------- Timing Runner: Conv_46 (CudaConvolution) [03/13/2022-08:29:39] [V] [TRT] Tactic: 0 time 0.958984 [03/13/2022-08:29:39] [V] [TRT] Tactic: 1 time 0.5164 [03/13/2022-08:29:39] [V] [TRT] Tactic: 2 time 1.03375 [03/13/2022-08:29:39] [V] [TRT] Tactic: 5 skipped. Scratch requested: 57794560, available: 16777216 [03/13/2022-08:29:39] [V] [TRT] Fastest Tactic: 1 Time: 0.5164 [03/13/2022-08:29:39] [V] [TRT] --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [03/13/2022-08:29:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:29:39] [V] [TRT] [03/13/2022-08:29:39] [V] [TRT] *************** Autotuning format combination: Half(1,160,19200:2,768000) -> Half(1,80,4800:2,384000) *************** [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [03/13/2022-08:29:39] [V] [TRT] Tactic: 458751 time 0.346624 [03/13/2022-08:29:39] [V] [TRT] Fastest Tactic: 458751 Time: 0.346624 [03/13/2022-08:29:39] [V] [TRT] --------------- Timing Runner: Conv_46 (CaskConvolution) [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: 1145226902788474763 time 0.263784 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: 1651411198763708804 time 0.26264 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: 2418518597804310654 time 0.264184 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: 4318470497547290900 time 0.26108 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: 4653005425971292725 time 0.264136 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: 4930470141256631146 time 0.251852 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: 8292881859266835088 time 0.228552 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: 8401509141903434922 time 0.260132 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: -8654297089785671176 time 0.346796 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: -7448936905981214224 time 0.254696 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: -6004726995029373073 time 0.223804 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: -5719726816705110014 time 0.3469 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: -3754890472406891741 time 0.355884 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: -3689982367035295496 time 0.347848 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: -2894005464278291378 time 0.231352 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: -2027588946874785071 time 0.246028 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: -1968398013367819764 time 0.348048 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: -245090590808296743 time 0.355576 [03/13/2022-08:29:39] [V] [TRT] Fastest Tactic: -6004726995029373073 Time: 0.223804 [03/13/2022-08:29:39] [V] [TRT] --------------- Timing Runner: Conv_46 (CudaConvolution) [03/13/2022-08:29:39] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:39] [V] [TRT] --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [03/13/2022-08:29:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6004726995029373073 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:39] [V] [TRT] *************** Autotuning format combination: Half(10,1600,1:8,192000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:29:39] [V] [TRT] --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [03/13/2022-08:29:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:39] [V] [TRT] --------------- Timing Runner: Conv_46 (CaskConvolution) [03/13/2022-08:29:39] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:39] [V] [TRT] --------------- Timing Runner: Conv_46 (CudaConvolution) [03/13/2022-08:29:39] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:39] [V] [TRT] --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [03/13/2022-08:29:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:39] [V] [TRT] *************** Autotuning format combination: Half(10,1600,1:8,192000) -> Half(20,1600,1:8,96000) *************** [03/13/2022-08:29:39] [V] [TRT] Conv_46 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:39] [V] [TRT] Conv_46 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:39] [V] [TRT] Conv_46 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [03/13/2022-08:29:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:39] [V] [TRT] --------------- Timing Runner: Conv_46 (CaskConvolution) [03/13/2022-08:29:39] [V] [TRT] Conv_46 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:39] [V] [TRT] Tactic: 130343752241278875 time 2.63003 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: 2148106709480872763 time 2.8796 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: 2410442691266548717 time 4.61948 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:39] [V] [TRT] Tactic: 2921824978225832523 time 2.60077 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:39] [V] [TRT] Tactic: 3030711443478140260 time 5.01292 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: 3754069740140581927 time 6.4555 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: 3823144360994712832 time 3.86146 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:39] [V] [TRT] Tactic: 5635311898703673455 time 4.60623 [03/13/2022-08:29:39] [V] [TRT] Conv_46 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:40] [V] [TRT] Tactic: 5925270497649423688 time 6.4481 [03/13/2022-08:29:40] [V] [TRT] Conv_46 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:40] [V] [TRT] Tactic: 6680916730816870145 time 7.171 [03/13/2022-08:29:40] [V] [TRT] Conv_46 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:40] [V] [TRT] Tactic: 7158029511300006471 time 5.3849 [03/13/2022-08:29:40] [V] [TRT] Conv_46 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:40] [V] [TRT] Tactic: 7859952145590271433 time 7.17178 [03/13/2022-08:29:40] [V] [TRT] Conv_46 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:40] [V] [TRT] Tactic: 8283847742354150423 time 6.45486 [03/13/2022-08:29:40] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:40] [V] [TRT] Tactic: -8992262742606384444 time 2.89006 [03/13/2022-08:29:40] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:40] [V] [TRT] Tactic: -8682550625095202832 time 2.89087 [03/13/2022-08:29:40] [V] [TRT] Conv_46 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:40] [V] [TRT] Tactic: -8379842433586149932 time 5.00738 [03/13/2022-08:29:40] [V] [TRT] Conv_46 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:40] [V] [TRT] Tactic: -6352769237623756264 time 5.01277 [03/13/2022-08:29:40] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:40] [V] [TRT] Tactic: -6273232454637933930 time 3.85971 [03/13/2022-08:29:40] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:41] [V] [TRT] Tactic: -5818527483287834165 time 3.86057 [03/13/2022-08:29:41] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:41] [V] [TRT] Tactic: -4954692664176521434 time 4.62114 [03/13/2022-08:29:41] [V] [TRT] Conv_46 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:41] [V] [TRT] Tactic: -4953888146171240997 time 2.60166 [03/13/2022-08:29:41] [V] [TRT] Conv_46 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:41] [V] [TRT] Tactic: -4534876761957424274 time 6.4491 [03/13/2022-08:29:41] [V] [TRT] Conv_46 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:41] [V] [TRT] Tactic: -3237051169894153788 time 5.38456 [03/13/2022-08:29:41] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:41] [V] [TRT] Tactic: -3136088851200285532 time 4.60771 [03/13/2022-08:29:41] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:41] [V] [TRT] Tactic: -2586046817576862066 time 4.62028 [03/13/2022-08:29:41] [V] [TRT] Conv_46 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:41] [V] [TRT] Tactic: -229563042944049199 time 4.60621 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 2921824978225832523 Time: 2.60077 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: Conv_46 (CudaConvolution) [03/13/2022-08:29:41] [V] [TRT] Tactic: 0 time 1.41335 [03/13/2022-08:29:41] [V] [TRT] Tactic: 1 time 0.658012 [03/13/2022-08:29:41] [V] [TRT] Tactic: 2 time 2.15718 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 1 Time: 0.658012 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [03/13/2022-08:29:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:29:41] [V] [TRT] [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:41] [V] [TRT] Tactic: 1002 time 0.069864 [03/13/2022-08:29:41] [V] [TRT] Tactic: 0 time 0.151264 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 1002 Time: 0.069864 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:41] [V] [TRT] Tactic: 1002 time 0.04628 [03/13/2022-08:29:41] [V] [TRT] Tactic: 0 time 0.05194 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 1002 Time: 0.04628 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:41] [V] [TRT] Tactic: 1002 time 0.097592 [03/13/2022-08:29:41] [V] [TRT] Tactic: 0 time 0.041404 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 0 Time: 0.041404 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:41] [V] [TRT] Tactic: 1002 time 0.06862 [03/13/2022-08:29:41] [V] [TRT] Tactic: 0 time 0.041576 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 0 Time: 0.041576 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:41] [V] [TRT] Tactic: 1002 time 0.105164 [03/13/2022-08:29:41] [V] [TRT] Tactic: 0 time 0.090776 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 0 Time: 0.090776 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:41] [V] [TRT] Tactic: 1002 time 0.103972 [03/13/2022-08:29:41] [V] [TRT] Tactic: 0 time 0.088388 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 0 Time: 0.088388 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:41] [V] [TRT] Tactic: 1002 time 0.122544 [03/13/2022-08:29:41] [V] [TRT] Tactic: 0 time 0.09014 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 0 Time: 0.09014 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:41] [V] [TRT] Tactic: 1002 time 0.088388 [03/13/2022-08:29:41] [V] [TRT] Tactic: 0 time 0.057412 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 0 Time: 0.057412 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:41] [V] [TRT] Tactic: 1002 time 0.048064 [03/13/2022-08:29:41] [V] [TRT] Tactic: 0 time 0.047636 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 0 Time: 0.047636 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:41] [V] [TRT] Tactic: 1002 time 0.069716 [03/13/2022-08:29:41] [V] [TRT] Tactic: 0 time 0.153212 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 1002 Time: 0.069716 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:41] [V] [TRT] Tactic: 1002 time 0.097716 [03/13/2022-08:29:41] [V] [TRT] Tactic: 0 time 0.039732 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 0 Time: 0.039732 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:41] [V] [TRT] Tactic: 1002 time 0.068652 [03/13/2022-08:29:41] [V] [TRT] Tactic: 0 time 0.039076 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 0 Time: 0.039076 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:41] [V] [TRT] Tactic: 1002 time 0.10126 [03/13/2022-08:29:41] [V] [TRT] Tactic: 0 time 0.037448 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 0 Time: 0.037448 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:41] [V] [TRT] Tactic: 1002 time 0.0671 [03/13/2022-08:29:41] [V] [TRT] Tactic: 0 time 0.14572 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 1002 Time: 0.0671 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:41] [V] [TRT] Tactic: 1002 time 0.100932 [03/13/2022-08:29:41] [V] [TRT] Tactic: 0 time 0.035792 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 0 Time: 0.035792 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:41] [V] [TRT] Tactic: 1002 time 0.066216 [03/13/2022-08:29:41] [V] [TRT] Tactic: 0 time 0.032292 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 0 Time: 0.032292 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:41] [V] [TRT] Tactic: 1002 time 0.068272 [03/13/2022-08:29:41] [V] [TRT] Tactic: 0 time 0.034192 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 0 Time: 0.034192 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:41] [V] [TRT] Tactic: 1002 time 0.073744 [03/13/2022-08:29:41] [V] [TRT] Tactic: 0 time 0.321936 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 1002 Time: 0.073744 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:41] [V] [TRT] Tactic: 1002 time 0.06792 [03/13/2022-08:29:41] [V] [TRT] Tactic: 0 time 0.025752 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 0 Time: 0.025752 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:41] [V] [TRT] Tactic: 1002 time 0.10794 [03/13/2022-08:29:41] [V] [TRT] Tactic: 0 time 0.025596 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 0 Time: 0.025596 [03/13/2022-08:29:41] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,768000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_47, Mul_48) (PointWise) [03/13/2022-08:29:41] [V] [TRT] Tactic: 128 time 0.068376 [03/13/2022-08:29:41] [V] [TRT] Tactic: 256 time 0.070692 [03/13/2022-08:29:41] [V] [TRT] Tactic: 512 time 0.078932 [03/13/2022-08:29:41] [V] [TRT] Tactic: -32 time 0.118748 [03/13/2022-08:29:41] [V] [TRT] Tactic: -64 time 0.073248 [03/13/2022-08:29:41] [V] [TRT] Tactic: -128 time 0.07068 [03/13/2022-08:29:41] [V] [TRT] Fastest Tactic: 128 Time: 0.068376 [03/13/2022-08:29:41] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_47, Mul_48) (PointWiseV2) [03/13/2022-08:29:42] [V] [TRT] Tactic: 0 time 0.049352 [03/13/2022-08:29:42] [V] [TRT] Tactic: 1 time 0.04188 [03/13/2022-08:29:42] [V] [TRT] Tactic: 2 time 0.040884 [03/13/2022-08:29:42] [V] [TRT] Tactic: 3 time 0.042368 [03/13/2022-08:29:42] [V] [TRT] Tactic: 4 time 0.041204 [03/13/2022-08:29:42] [V] [TRT] Tactic: 5 time 0.040848 [03/13/2022-08:29:42] [V] [TRT] Tactic: 6 time 0.044184 [03/13/2022-08:29:42] [V] [TRT] Tactic: 7 time 0.041672 [03/13/2022-08:29:42] [V] [TRT] Tactic: 8 time 0.040996 [03/13/2022-08:29:42] [V] [TRT] Tactic: 9 time 0.04072 [03/13/2022-08:29:42] [V] [TRT] Tactic: 28 time 0.048604 [03/13/2022-08:29:42] [V] [TRT] Fastest Tactic: 9 Time: 0.04072 [03/13/2022-08:29:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:29:42] [V] [TRT] [03/13/2022-08:29:42] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,24000) -> Float(1,80,4800:32,24000) *************** [03/13/2022-08:29:42] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_47, Mul_48) (PointWise) [03/13/2022-08:29:42] [V] [TRT] Tactic: 128 time 0.069036 [03/13/2022-08:29:42] [V] [TRT] Tactic: 256 time 0.070332 [03/13/2022-08:29:42] [V] [TRT] Tactic: 512 time 0.078632 [03/13/2022-08:29:42] [V] [TRT] Tactic: -32 time 0.120284 [03/13/2022-08:29:42] [V] [TRT] Tactic: -64 time 0.073204 [03/13/2022-08:29:42] [V] [TRT] Tactic: -128 time 0.0706 [03/13/2022-08:29:42] [V] [TRT] Fastest Tactic: 128 Time: 0.069036 [03/13/2022-08:29:42] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_47, Mul_48) (PointWiseV2) [03/13/2022-08:29:42] [V] [TRT] Tactic: 24 time 0.046912 [03/13/2022-08:29:42] [V] [TRT] Tactic: 25 time 0.047516 [03/13/2022-08:29:42] [V] [TRT] Tactic: 26 time 0.0486 [03/13/2022-08:29:42] [V] [TRT] Tactic: 27 time 0.048176 [03/13/2022-08:29:42] [V] [TRT] Tactic: 31 time 0.04686 [03/13/2022-08:29:42] [V] [TRT] Fastest Tactic: 31 Time: 0.04686 [03/13/2022-08:29:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [03/13/2022-08:29:42] [V] [TRT] [03/13/2022-08:29:42] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,768000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:29:42] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_47, Mul_48) (PointWise) [03/13/2022-08:29:42] [V] [TRT] Tactic: 128 time 0.071356 [03/13/2022-08:29:42] [V] [TRT] Tactic: 256 time 0.060388 [03/13/2022-08:29:42] [V] [TRT] Tactic: 512 time 0.059608 [03/13/2022-08:29:42] [V] [TRT] Tactic: -32 time 0.104224 [03/13/2022-08:29:42] [V] [TRT] Tactic: -64 time 0.068712 [03/13/2022-08:29:42] [V] [TRT] Tactic: -128 time 0.0673 [03/13/2022-08:29:42] [V] [TRT] Fastest Tactic: 512 Time: 0.059608 [03/13/2022-08:29:42] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_47, Mul_48) (PointWiseV2) [03/13/2022-08:29:42] [V] [TRT] Tactic: 0 time 0.046612 [03/13/2022-08:29:42] [V] [TRT] Tactic: 1 time 0.038124 [03/13/2022-08:29:42] [V] [TRT] Tactic: 2 time 0.031392 [03/13/2022-08:29:42] [V] [TRT] Tactic: 3 time 0.035332 [03/13/2022-08:29:42] [V] [TRT] Tactic: 4 time 0.026492 [03/13/2022-08:29:43] [V] [TRT] Tactic: 5 time 0.023212 [03/13/2022-08:29:43] [V] [TRT] Tactic: 6 time 0.035156 [03/13/2022-08:29:43] [V] [TRT] Tactic: 7 time 0.02542 [03/13/2022-08:29:43] [V] [TRT] Tactic: 8 time 0.022952 [03/13/2022-08:29:43] [V] [TRT] Tactic: 9 time 0.0228 [03/13/2022-08:29:43] [V] [TRT] Tactic: 28 time 0.045992 [03/13/2022-08:29:43] [V] [TRT] Fastest Tactic: 9 Time: 0.0228 [03/13/2022-08:29:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:29:43] [V] [TRT] [03/13/2022-08:29:43] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800:2,384000) *************** [03/13/2022-08:29:43] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_47, Mul_48) (PointWise) [03/13/2022-08:29:43] [V] [TRT] Tactic: 128 time 0.071552 [03/13/2022-08:29:43] [V] [TRT] Tactic: 256 time 0.060368 [03/13/2022-08:29:43] [V] [TRT] Tactic: 512 time 0.058868 [03/13/2022-08:29:43] [V] [TRT] Tactic: -32 time 0.104416 [03/13/2022-08:29:43] [V] [TRT] Tactic: -64 time 0.06968 [03/13/2022-08:29:43] [V] [TRT] Tactic: -128 time 0.067296 [03/13/2022-08:29:43] [V] [TRT] Fastest Tactic: 512 Time: 0.058868 [03/13/2022-08:29:43] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_47, Mul_48) (PointWiseV2) [03/13/2022-08:29:43] [V] [TRT] Tactic: 0 time 0.031564 [03/13/2022-08:29:43] [V] [TRT] Tactic: 1 time 0.027316 [03/13/2022-08:29:43] [V] [TRT] Tactic: 2 time 0.02782 [03/13/2022-08:29:43] [V] [TRT] Tactic: 3 time 0.026308 [03/13/2022-08:29:43] [V] [TRT] Tactic: 4 time 0.026464 [03/13/2022-08:29:43] [V] [TRT] Tactic: 5 time 0.029124 [03/13/2022-08:29:43] [V] [TRT] Tactic: 6 time 0.028152 [03/13/2022-08:29:43] [V] [TRT] Tactic: 7 time 0.02824 [03/13/2022-08:29:43] [V] [TRT] Tactic: 8 time 0.030368 [03/13/2022-08:29:43] [V] [TRT] Tactic: 9 time 0.038216 [03/13/2022-08:29:43] [V] [TRT] Tactic: 10 time 0.048196 [03/13/2022-08:29:43] [V] [TRT] Tactic: 11 time 0.038672 [03/13/2022-08:29:43] [V] [TRT] Tactic: 12 time 0.032352 [03/13/2022-08:29:43] [V] [TRT] Tactic: 13 time 0.03536 [03/13/2022-08:29:43] [V] [TRT] Tactic: 14 time 0.026548 [03/13/2022-08:29:43] [V] [TRT] Tactic: 15 time 0.023564 [03/13/2022-08:29:43] [V] [TRT] Tactic: 16 time 0.034928 [03/13/2022-08:29:43] [V] [TRT] Tactic: 17 time 0.025356 [03/13/2022-08:29:43] [V] [TRT] Tactic: 18 time 0.023128 [03/13/2022-08:29:43] [V] [TRT] Tactic: 19 time 0.022904 [03/13/2022-08:29:43] [V] [TRT] Tactic: 28 time 0.031464 [03/13/2022-08:29:43] [V] [TRT] Tactic: 29 time 0.04792 [03/13/2022-08:29:43] [V] [TRT] Fastest Tactic: 19 Time: 0.022904 [03/13/2022-08:29:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 19 [03/13/2022-08:29:43] [V] [TRT] [03/13/2022-08:29:43] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Half(20,1600,1:8,96000) *************** [03/13/2022-08:29:43] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_47, Mul_48) (PointWise) [03/13/2022-08:29:43] [V] [TRT] Tactic: 128 time 0.071532 [03/13/2022-08:29:43] [V] [TRT] Tactic: 256 time 0.060116 [03/13/2022-08:29:43] [V] [TRT] Tactic: 512 time 0.059048 [03/13/2022-08:29:43] [V] [TRT] Tactic: -32 time 0.104416 [03/13/2022-08:29:43] [V] [TRT] Tactic: -64 time 0.069452 [03/13/2022-08:29:43] [V] [TRT] Tactic: -128 time 0.06728 [03/13/2022-08:29:43] [V] [TRT] Fastest Tactic: 512 Time: 0.059048 [03/13/2022-08:29:43] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_47, Mul_48) (PointWiseV2) [03/13/2022-08:29:43] [V] [TRT] Tactic: 0 time 0.025352 [03/13/2022-08:29:43] [V] [TRT] Tactic: 1 time 0.026516 [03/13/2022-08:29:43] [V] [TRT] Tactic: 2 time 0.032172 [03/13/2022-08:29:43] [V] [TRT] Tactic: 3 time 0.02672 [03/13/2022-08:29:43] [V] [TRT] Tactic: 4 time 0.033504 [03/13/2022-08:29:43] [V] [TRT] Tactic: 5 time 0.043104 [03/13/2022-08:29:43] [V] [TRT] Tactic: 6 time 0.026496 [03/13/2022-08:29:43] [V] [TRT] Tactic: 7 time 0.0348 [03/13/2022-08:29:43] [V] [TRT] Tactic: 8 time 0.041456 [03/13/2022-08:29:43] [V] [TRT] Tactic: 9 time 0.057272 [03/13/2022-08:29:43] [V] [TRT] Tactic: 10 time 0.02392 [03/13/2022-08:29:43] [V] [TRT] Tactic: 11 time 0.023888 [03/13/2022-08:29:43] [V] [TRT] Tactic: 12 time 0.025916 [03/13/2022-08:29:43] [V] [TRT] Tactic: 13 time 0.024432 [03/13/2022-08:29:43] [V] [TRT] Tactic: 14 time 0.027144 [03/13/2022-08:29:43] [V] [TRT] Tactic: 15 time 0.033656 [03/13/2022-08:29:43] [V] [TRT] Tactic: 16 time 0.024504 [03/13/2022-08:29:43] [V] [TRT] Tactic: 17 time 0.027252 [03/13/2022-08:29:43] [V] [TRT] Tactic: 18 time 0.036056 [03/13/2022-08:29:43] [V] [TRT] Tactic: 19 time 0.04686 [03/13/2022-08:29:43] [V] [TRT] Tactic: 20 time 0.0325 [03/13/2022-08:29:43] [V] [TRT] Tactic: 21 time 0.02756 [03/13/2022-08:29:43] [V] [TRT] Tactic: 22 time 0.026488 [03/13/2022-08:29:43] [V] [TRT] Tactic: 23 time 0.028312 [03/13/2022-08:29:43] [V] [TRT] Tactic: 24 time 0.048468 [03/13/2022-08:29:43] [V] [TRT] Tactic: 25 time 0.03856 [03/13/2022-08:29:43] [V] [TRT] Tactic: 26 time 0.035512 [03/13/2022-08:29:43] [V] [TRT] Tactic: 27 time 0.035456 [03/13/2022-08:29:43] [V] [TRT] Tactic: 28 time 0.025132 [03/13/2022-08:29:43] [V] [TRT] Tactic: 29 time 0.023504 [03/13/2022-08:29:43] [V] [TRT] Tactic: 30 time 0.032424 [03/13/2022-08:29:43] [V] [TRT] Tactic: 31 time 0.048052 [03/13/2022-08:29:43] [V] [TRT] Fastest Tactic: 29 Time: 0.023504 [03/13/2022-08:29:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 29 [03/13/2022-08:29:43] [V] [TRT] [03/13/2022-08:29:43] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,768000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:29:43] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:29:43] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:29:43] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:29:43] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:43] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:29:43] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:29:43] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:29:43] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:29:43] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:29:43] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (FusedConvActConvolution) [03/13/2022-08:29:43] [V] [TRT] Tactic: 589823 time 0.431732 [03/13/2022-08:29:43] [V] [TRT] Tactic: 655359 time 0.320364 [03/13/2022-08:29:43] [V] [TRT] Tactic: 786431 time 0.427208 [03/13/2022-08:29:43] [V] [TRT] Tactic: 851967 time 0.385752 [03/13/2022-08:29:43] [V] [TRT] Tactic: 1179647 time 0.365376 [03/13/2022-08:29:43] [V] [TRT] Tactic: 1310719 time 0.408748 [03/13/2022-08:29:43] [V] [TRT] Tactic: 1376255 time 0.344128 [03/13/2022-08:29:43] [V] [TRT] Tactic: 1441791 time 0.400692 [03/13/2022-08:29:43] [V] [TRT] Tactic: 1507327 time 0.263592 [03/13/2022-08:29:43] [V] [TRT] Tactic: 1638399 time 0.316124 [03/13/2022-08:29:43] [V] [TRT] Tactic: 1835007 time 0.355448 [03/13/2022-08:29:43] [V] [TRT] Tactic: 1900543 time 0.285896 [03/13/2022-08:29:43] [V] [TRT] Tactic: 2097151 time 0.33812 [03/13/2022-08:29:43] [V] [TRT] Tactic: 2162687 time 0.282168 [03/13/2022-08:29:43] [V] [TRT] Tactic: 2293759 time 0.29344 [03/13/2022-08:29:43] [V] [TRT] Tactic: 2359295 time 0.238336 [03/13/2022-08:29:43] [V] [TRT] Tactic: 2686975 time 0.291068 [03/13/2022-08:29:43] [V] [TRT] Tactic: 3080191 time 0.269304 [03/13/2022-08:29:43] [V] [TRT] Tactic: 3342335 time 0.266516 [03/13/2022-08:29:43] [V] [TRT] Tactic: 3407871 time 0.255452 [03/13/2022-08:29:44] [V] [TRT] Tactic: 3538943 time 0.256916 [03/13/2022-08:29:44] [V] [TRT] Tactic: 3670015 time 0.272844 [03/13/2022-08:29:44] [V] [TRT] Tactic: 3932159 time 0.275852 [03/13/2022-08:29:44] [V] [TRT] Tactic: 3997695 time 0.33286 [03/13/2022-08:29:44] [V] [TRT] Tactic: 4063231 time 0.305568 [03/13/2022-08:29:44] [V] [TRT] Tactic: 4194303 time 0.3123 [03/13/2022-08:29:44] [V] [TRT] Tactic: 4259839 time 0.309832 [03/13/2022-08:29:44] [V] [TRT] Tactic: 4325375 time 0.294644 [03/13/2022-08:29:44] [V] [TRT] Tactic: 4521983 time 0.323236 [03/13/2022-08:29:44] [V] [TRT] Tactic: 4587519 time 0.300796 [03/13/2022-08:29:44] [V] [TRT] Tactic: 4653055 time 0.257036 [03/13/2022-08:29:44] [V] [TRT] Tactic: 4915199 time 0.313464 [03/13/2022-08:29:44] [V] [TRT] Tactic: 4980735 time 0.295096 [03/13/2022-08:29:44] [V] [TRT] Tactic: 5177343 time 0.318936 [03/13/2022-08:29:44] [V] [TRT] Tactic: 5242879 time 0.285984 [03/13/2022-08:29:44] [V] [TRT] Tactic: 5373951 time 0.41652 [03/13/2022-08:29:44] [V] [TRT] Tactic: 5439487 time 0.5376 [03/13/2022-08:29:44] [V] [TRT] Tactic: 5570559 time 0.273824 [03/13/2022-08:29:44] [V] [TRT] Tactic: 5636095 time 0.305804 [03/13/2022-08:29:44] [V] [TRT] Tactic: 5701631 time 0.324108 [03/13/2022-08:29:44] [V] [TRT] Tactic: 5767167 time 1.43031 [03/13/2022-08:29:44] [V] [TRT] Tactic: 5832703 time 0.253176 [03/13/2022-08:29:44] [V] [TRT] Tactic: 5898239 time 0.27314 [03/13/2022-08:29:44] [V] [TRT] Tactic: 6029311 time 0.322164 [03/13/2022-08:29:44] [V] [TRT] Tactic: 6225919 time 0.289404 [03/13/2022-08:29:44] [V] [TRT] Tactic: 6291455 time 0.287716 [03/13/2022-08:29:44] [V] [TRT] Tactic: 6422527 time 0.288868 [03/13/2022-08:29:44] [V] [TRT] Tactic: 6750207 time 0.381012 [03/13/2022-08:29:44] [V] [TRT] Tactic: 6815743 time 0.379684 [03/13/2022-08:29:44] [V] [TRT] Tactic: 6946815 time 0.50616 [03/13/2022-08:29:44] [V] [TRT] Tactic: 7012351 time 0.33824 [03/13/2022-08:29:44] [V] [TRT] Tactic: 7077887 time 0.254856 [03/13/2022-08:29:44] [V] [TRT] Tactic: 7143423 time 0.530808 [03/13/2022-08:29:44] [V] [TRT] Tactic: 7208959 time 0.28826 [03/13/2022-08:29:44] [V] [TRT] Tactic: 7340031 time 0.280052 [03/13/2022-08:29:44] [V] [TRT] Tactic: 7405567 time 0.289684 [03/13/2022-08:29:44] [V] [TRT] Tactic: 7536639 time 0.436628 [03/13/2022-08:29:44] [V] [TRT] Tactic: 7602175 time 0.327276 [03/13/2022-08:29:44] [V] [TRT] Tactic: 7733247 time 0.252424 [03/13/2022-08:29:44] [V] [TRT] Tactic: 7798783 time 0.331008 [03/13/2022-08:29:44] [V] [TRT] Tactic: 8191999 time 0.40612 [03/13/2022-08:29:44] [V] [TRT] Tactic: 8257535 time 0.33208 [03/13/2022-08:29:45] [V] [TRT] Tactic: 8323071 time 0.375196 [03/13/2022-08:29:45] [V] [TRT] Tactic: 8650751 time 0.382188 [03/13/2022-08:29:45] [V] [TRT] Tactic: 8716287 time 0.385232 [03/13/2022-08:29:45] [V] [TRT] Tactic: 9109503 time 0.356648 [03/13/2022-08:29:45] [V] [TRT] Tactic: 9568255 time 0.312184 [03/13/2022-08:29:45] [V] [TRT] Tactic: 9895935 time 0.313824 [03/13/2022-08:29:45] [V] [TRT] Tactic: 10223615 time 0.28876 [03/13/2022-08:29:45] [V] [TRT] Tactic: 10354687 time 0.307028 [03/13/2022-08:29:45] [V] [TRT] Tactic: 10551295 time 0.3777 [03/13/2022-08:29:45] [V] [TRT] Tactic: 10747903 time 0.245484 [03/13/2022-08:29:45] [V] [TRT] Tactic: 10944511 time 0.295736 [03/13/2022-08:29:45] [V] [TRT] Fastest Tactic: 2359295 Time: 0.238336 [03/13/2022-08:29:45] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (CaskConvolution) [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Tactic: 1754569683116234317 time 0.162292 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Tactic: 1825138533642645384 time 0.163048 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Tactic: 2733356012094739613 time 0.125908 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Tactic: 3915320020053085238 time 0.163004 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Tactic: 6808617066150061604 time 0.129104 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Tactic: 9091006216302412844 time 0.122988 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Tactic: -8060443123034038864 time 0.13078 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Tactic: -4420849921117327522 time 0.141976 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Tactic: -3946921629105938337 time 0.131624 [03/13/2022-08:29:45] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.122988 [03/13/2022-08:29:45] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (CudaConvolution) [03/13/2022-08:29:45] [V] [TRT] Tactic: 0 time 0.24654 [03/13/2022-08:29:45] [V] [TRT] Tactic: 2 time 0.357384 [03/13/2022-08:29:45] [V] [TRT] Tactic: 5 time 0.497088 [03/13/2022-08:29:45] [V] [TRT] Tactic: 57 time 0.24956 [03/13/2022-08:29:45] [V] [TRT] Fastest Tactic: 0 Time: 0.24654 [03/13/2022-08:29:45] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (CudaDepthwiseConvolution) [03/13/2022-08:29:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:29:45] [V] [TRT] [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:29:45] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,768000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:29:45] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (FusedConvActConvolution) [03/13/2022-08:29:45] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:45] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (CaskConvolution) [03/13/2022-08:29:45] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:45] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (CudaConvolution) [03/13/2022-08:29:45] [V] [TRT] Tactic: 0 time 0.236056 [03/13/2022-08:29:45] [V] [TRT] Tactic: 1 time 0.236072 [03/13/2022-08:29:45] [V] [TRT] Tactic: 2 time 0.302132 [03/13/2022-08:29:45] [V] [TRT] Tactic: 4 skipped. Scratch requested: 3429273600, available: 16777216 [03/13/2022-08:29:45] [V] [TRT] Tactic: 5 time 0.481876 [03/13/2022-08:29:45] [V] [TRT] Fastest Tactic: 0 Time: 0.236056 [03/13/2022-08:29:45] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (CudaDepthwiseConvolution) [03/13/2022-08:29:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0 [03/13/2022-08:29:45] [V] [TRT] [03/13/2022-08:29:45] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:29:45] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (FusedConvActConvolution) [03/13/2022-08:29:45] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:45] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (CaskConvolution) [03/13/2022-08:29:45] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:45] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (CudaConvolution) [03/13/2022-08:29:45] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:45] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (CudaDepthwiseConvolution) [03/13/2022-08:29:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:45] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800:2,384000) *************** [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:45] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:45] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (FusedConvActConvolution) [03/13/2022-08:29:45] [V] [TRT] Tactic: 589823 time 0.204448 [03/13/2022-08:29:45] [V] [TRT] Tactic: 655359 time 0.130632 [03/13/2022-08:29:45] [V] [TRT] Tactic: 786431 time 0.17638 [03/13/2022-08:29:45] [V] [TRT] Tactic: 851967 time 0.175908 [03/13/2022-08:29:45] [V] [TRT] Tactic: 1179647 time 0.159288 [03/13/2022-08:29:45] [V] [TRT] Tactic: 1310719 time 0.153464 [03/13/2022-08:29:45] [V] [TRT] Tactic: 1376255 time 0.137044 [03/13/2022-08:29:45] [V] [TRT] Tactic: 1441791 time 0.190816 [03/13/2022-08:29:45] [V] [TRT] Tactic: 1507327 time 0.139472 [03/13/2022-08:29:45] [V] [TRT] Tactic: 1638399 time 0.178372 [03/13/2022-08:29:45] [V] [TRT] Tactic: 1835007 time 0.184796 [03/13/2022-08:29:45] [V] [TRT] Tactic: 1900543 time 0.14112 [03/13/2022-08:29:45] [V] [TRT] Tactic: 2162687 time 0.140348 [03/13/2022-08:29:45] [V] [TRT] Tactic: 2293759 time 0.14504 [03/13/2022-08:29:45] [V] [TRT] Tactic: 2359295 time 0.12104 [03/13/2022-08:29:45] [V] [TRT] Tactic: 2686975 time 0.144864 [03/13/2022-08:29:45] [V] [TRT] Tactic: 3080191 time 0.141424 [03/13/2022-08:29:45] [V] [TRT] Tactic: 3342335 time 0.139388 [03/13/2022-08:29:45] [V] [TRT] Tactic: 3407871 time 0.13072 [03/13/2022-08:29:45] [V] [TRT] Tactic: 3538943 time 0.135372 [03/13/2022-08:29:45] [V] [TRT] Tactic: 3670015 time 0.137092 [03/13/2022-08:29:45] [V] [TRT] Tactic: 3932159 time 0.13628 [03/13/2022-08:29:45] [V] [TRT] Tactic: 3997695 time 0.18246 [03/13/2022-08:29:45] [V] [TRT] Tactic: 4063231 time 0.1777 [03/13/2022-08:29:45] [V] [TRT] Tactic: 4194303 time 0.168528 [03/13/2022-08:29:45] [V] [TRT] Tactic: 4325375 time 0.159832 [03/13/2022-08:29:45] [V] [TRT] Tactic: 4521983 time 0.155192 [03/13/2022-08:29:45] [V] [TRT] Tactic: 4587519 time 0.16678 [03/13/2022-08:29:45] [V] [TRT] Tactic: 4653055 time 0.151644 [03/13/2022-08:29:45] [V] [TRT] Tactic: 4915199 time 0.172824 [03/13/2022-08:29:45] [V] [TRT] Tactic: 4980735 time 0.154884 [03/13/2022-08:29:45] [V] [TRT] Tactic: 5177343 time 0.176052 [03/13/2022-08:29:45] [V] [TRT] Tactic: 5242879 time 0.14342 [03/13/2022-08:29:45] [V] [TRT] Tactic: 5373951 time 0.220376 [03/13/2022-08:29:45] [V] [TRT] Tactic: 5439487 time 0.275628 [03/13/2022-08:29:45] [V] [TRT] Tactic: 5570559 time 0.144304 [03/13/2022-08:29:45] [V] [TRT] Tactic: 5636095 time 0.177632 [03/13/2022-08:29:45] [V] [TRT] Tactic: 5701631 time 0.160952 [03/13/2022-08:29:45] [V] [TRT] Tactic: 5767167 time 0.627096 [03/13/2022-08:29:45] [V] [TRT] Tactic: 5832703 time 0.128484 [03/13/2022-08:29:46] [V] [TRT] Tactic: 5898239 time 0.154696 [03/13/2022-08:29:46] [V] [TRT] Tactic: 6029311 time 0.162076 [03/13/2022-08:29:46] [V] [TRT] Tactic: 6225919 time 0.148664 [03/13/2022-08:29:46] [V] [TRT] Tactic: 6291455 time 0.159428 [03/13/2022-08:29:46] [V] [TRT] Tactic: 6422527 time 0.14834 [03/13/2022-08:29:46] [V] [TRT] Tactic: 6750207 time 0.2022 [03/13/2022-08:29:46] [V] [TRT] Tactic: 6815743 time 0.193548 [03/13/2022-08:29:46] [V] [TRT] Tactic: 6946815 time 0.261996 [03/13/2022-08:29:46] [V] [TRT] Tactic: 7077887 time 0.132652 [03/13/2022-08:29:46] [V] [TRT] Tactic: 7143423 time 0.271228 [03/13/2022-08:29:46] [V] [TRT] Tactic: 7208959 time 0.146784 [03/13/2022-08:29:46] [V] [TRT] Tactic: 7340031 time 0.158628 [03/13/2022-08:29:46] [V] [TRT] Tactic: 7405567 time 0.16364 [03/13/2022-08:29:46] [V] [TRT] Tactic: 7536639 time 0.224248 [03/13/2022-08:29:46] [V] [TRT] Tactic: 7602175 time 0.17306 [03/13/2022-08:29:46] [V] [TRT] Tactic: 7733247 time 0.134564 [03/13/2022-08:29:46] [V] [TRT] Tactic: 7798783 time 0.176508 [03/13/2022-08:29:46] [V] [TRT] Tactic: 8191999 time 0.215396 [03/13/2022-08:29:46] [V] [TRT] Tactic: 8257535 time 0.180152 [03/13/2022-08:29:46] [V] [TRT] Tactic: 8323071 time 0.196668 [03/13/2022-08:29:46] [V] [TRT] Tactic: 8650751 time 0.200404 [03/13/2022-08:29:46] [V] [TRT] Tactic: 8716287 time 0.198716 [03/13/2022-08:29:46] [V] [TRT] Tactic: 9568255 time 0.173076 [03/13/2022-08:29:46] [V] [TRT] Tactic: 9895935 time 0.168808 [03/13/2022-08:29:46] [V] [TRT] Tactic: 10223615 time 0.144936 [03/13/2022-08:29:46] [V] [TRT] Tactic: 10354687 time 0.172728 [03/13/2022-08:29:46] [V] [TRT] Tactic: 10551295 time 0.191928 [03/13/2022-08:29:46] [V] [TRT] Tactic: 10747903 time 0.130504 [03/13/2022-08:29:46] [V] [TRT] Tactic: 10944511 time 0.155544 [03/13/2022-08:29:46] [V] [TRT] Fastest Tactic: 2359295 Time: 0.12104 [03/13/2022-08:29:46] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (CaskConvolution) [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: 1651411198763708804 time 0.070648 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: 2418518597804310654 time 0.070828 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: 4318470497547290900 time 0.07006 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: 4930470141256631146 time 0.068956 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: 8292881859266835088 time 0.068792 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: 8401509141903434922 time 0.070176 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: -8654297089785671176 time 0.100448 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: -7516584506774355935 time 0.066444 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: -7140760933967189247 time 0.06924 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: -6004726995029373073 time 0.067616 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: -5719726816705110014 time 0.100892 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: -4097850214384059472 time 0.066764 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: -3717489476759089008 time 0.068464 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: -3689982367035295496 time 0.100692 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: -2640575123064142123 time 0.08696 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: -2534402059426524406 time 0.086568 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: -2027588946874785071 time 0.067648 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: -1968398013367819764 time 0.100736 [03/13/2022-08:29:46] [V] [TRT] Fastest Tactic: -7516584506774355935 Time: 0.066444 [03/13/2022-08:29:46] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (CudaConvolution) [03/13/2022-08:29:46] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:46] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (CudaDepthwiseConvolution) [03/13/2022-08:29:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7516584506774355935 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:46] [V] [TRT] [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:46] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:29:46] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (FusedConvActConvolution) [03/13/2022-08:29:46] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:46] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (CaskConvolution) [03/13/2022-08:29:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:46] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (CudaConvolution) [03/13/2022-08:29:46] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:46] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (CudaDepthwiseConvolution) [03/13/2022-08:29:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:46] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Half(20,1600,1:8,96000) *************** [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (FusedConvActConvolution) [03/13/2022-08:29:46] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:46] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (CaskConvolution) [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:46] [V] [TRT] Tactic: 9576651994278528 time 0.43912 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: 1179757074518529353 time 0.668152 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: 2105695814191699972 time 1.01522 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: 2148106709480872763 time 0.540732 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: 2410442691266548717 time 0.789564 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: 3041642431972138763 time 0.774872 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: 3754069740140581927 time 1.21468 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: 4555462412611657028 time 0.540612 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: 5666160310350604399 time 1.21416 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:46] [V] [TRT] Tactic: 5876997871499382316 time 0.822744 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: 5925270497649423688 time 1.20916 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: 6680916730816870145 time 1.21716 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: 7158029511300006471 time 1.01581 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: 7859952145590271433 time 1.21706 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: 8283847742354150423 time 1.21459 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: -8992262742606384444 time 0.54072 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: -8391760416076885205 time 1.20816 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: -6273232454637933930 time 0.667888 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:46] [V] [TRT] Tactic: -5925110308892264213 time 0.836916 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: -5818527483287834165 time 0.667212 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:46] [V] [TRT] Tactic: -4908848143422991657 time 0.439556 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: -4534876761957424274 time 1.20832 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: -3237051169894153788 time 1.01589 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: -3136088851200285532 time 0.77466 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: -2586046817576862066 time 0.789256 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:46] [V] [TRT] Tactic: -2422160065350346448 time 1.21711 [03/13/2022-08:29:46] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:47] [V] [TRT] Tactic: -1216445540764179377 time 0.789084 [03/13/2022-08:29:47] [V] [TRT] Conv_80 || Conv_49 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:47] [V] [TRT] Tactic: -229563042944049199 time 0.77508 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 9576651994278528 Time: 0.43912 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (CudaConvolution) [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.27486 [03/13/2022-08:29:47] [V] [TRT] Tactic: 1 time 0.275628 [03/13/2022-08:29:47] [V] [TRT] Tactic: 2 time 0.349744 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.27486 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: Conv_80 || Conv_49 (CudaDepthwiseConvolution) [03/13/2022-08:29:47] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0 [03/13/2022-08:29:47] [V] [TRT] [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.069776 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.150724 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.069776 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.046516 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.051708 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.046516 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.097168 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.0412 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.0412 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.068152 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.041676 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.041676 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.048384 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.047456 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.047456 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.069528 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.152536 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.069528 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.097888 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.039544 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.039544 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.068424 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.03894 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.03894 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.100812 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.037304 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.037304 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.067268 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.14496 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.067268 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.100308 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.035968 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.035968 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.06556 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.032164 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.032164 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.0684 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.033504 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.033504 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.073424 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.322208 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.073424 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.067604 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.025848 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.025848 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.107836 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.025464 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.025464 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.042648 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.079 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.042648 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.027908 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.026768 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.026768 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.0536 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.0276 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.0276 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.04248 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.038876 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.038876 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.05324 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.048572 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.048572 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.051088 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.139696 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.051088 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.052264 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.046728 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.046728 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.066324 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.047796 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.047796 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.049624 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.030956 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.030956 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.028712 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.026548 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.026548 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.04314 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.0799 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.04314 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.053244 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.02228 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.02228 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.042968 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.01772 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.01772 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.05236 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.021168 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.021168 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.042432 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.075908 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.042432 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.051844 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.025468 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.025468 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.041784 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.017212 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.017212 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.046484 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.022936 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.022936 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.044336 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.163528 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.044336 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.045712 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.017888 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.017888 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:47] [V] [TRT] Tactic: 1002 time 0.058784 [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.017792 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 0 Time: 0.017792 [03/13/2022-08:29:47] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,768000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_51, Mul_52) (PointWise) [03/13/2022-08:29:47] [V] [TRT] Tactic: 128 time 0.0425 [03/13/2022-08:29:47] [V] [TRT] Tactic: 256 time 0.043912 [03/13/2022-08:29:47] [V] [TRT] Tactic: 512 time 0.048428 [03/13/2022-08:29:47] [V] [TRT] Tactic: -32 time 0.064028 [03/13/2022-08:29:47] [V] [TRT] Tactic: -64 time 0.04168 [03/13/2022-08:29:47] [V] [TRT] Tactic: -128 time 0.040052 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: -128 Time: 0.040052 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_51, Mul_52) (PointWiseV2) [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.028348 [03/13/2022-08:29:47] [V] [TRT] Tactic: 1 time 0.024284 [03/13/2022-08:29:47] [V] [TRT] Tactic: 2 time 0.021888 [03/13/2022-08:29:47] [V] [TRT] Tactic: 3 time 0.023864 [03/13/2022-08:29:47] [V] [TRT] Tactic: 4 time 0.022736 [03/13/2022-08:29:47] [V] [TRT] Tactic: 5 time 0.022568 [03/13/2022-08:29:47] [V] [TRT] Tactic: 6 time 0.024708 [03/13/2022-08:29:47] [V] [TRT] Tactic: 7 time 0.023132 [03/13/2022-08:29:47] [V] [TRT] Tactic: 8 time 0.021684 [03/13/2022-08:29:47] [V] [TRT] Tactic: 9 time 0.022752 [03/13/2022-08:29:47] [V] [TRT] Tactic: 28 time 0.028932 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 8 Time: 0.021684 [03/13/2022-08:29:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:29:47] [V] [TRT] [03/13/2022-08:29:47] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,24000) -> Float(1,80,4800:32,14400) *************** [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_51, Mul_52) (PointWise) [03/13/2022-08:29:47] [V] [TRT] Tactic: 128 time 0.055168 [03/13/2022-08:29:47] [V] [TRT] Tactic: 256 time 0.0551 [03/13/2022-08:29:47] [V] [TRT] Tactic: 512 time 0.061996 [03/13/2022-08:29:47] [V] [TRT] Tactic: -32 time 0.086044 [03/13/2022-08:29:47] [V] [TRT] Tactic: -64 time 0.051996 [03/13/2022-08:29:47] [V] [TRT] Tactic: -128 time 0.047652 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: -128 Time: 0.047652 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_51, Mul_52) (PointWiseV2) [03/13/2022-08:29:47] [V] [TRT] Tactic: 24 time 0.03014 [03/13/2022-08:29:47] [V] [TRT] Tactic: 25 time 0.03082 [03/13/2022-08:29:47] [V] [TRT] Tactic: 26 time 0.03142 [03/13/2022-08:29:47] [V] [TRT] Tactic: 27 time 0.032644 [03/13/2022-08:29:47] [V] [TRT] Tactic: 31 time 0.029788 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 31 Time: 0.029788 [03/13/2022-08:29:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [03/13/2022-08:29:47] [V] [TRT] [03/13/2022-08:29:47] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,768000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_51, Mul_52) (PointWise) [03/13/2022-08:29:47] [V] [TRT] Tactic: 128 time 0.041796 [03/13/2022-08:29:47] [V] [TRT] Tactic: 256 time 0.035496 [03/13/2022-08:29:47] [V] [TRT] Tactic: 512 time 0.035396 [03/13/2022-08:29:47] [V] [TRT] Tactic: -32 time 0.056344 [03/13/2022-08:29:47] [V] [TRT] Tactic: -64 time 0.039652 [03/13/2022-08:29:47] [V] [TRT] Tactic: -128 time 0.038496 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 512 Time: 0.035396 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_51, Mul_52) (PointWiseV2) [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.027328 [03/13/2022-08:29:47] [V] [TRT] Tactic: 1 time 0.022448 [03/13/2022-08:29:47] [V] [TRT] Tactic: 2 time 0.018828 [03/13/2022-08:29:47] [V] [TRT] Tactic: 3 time 0.020548 [03/13/2022-08:29:47] [V] [TRT] Tactic: 4 time 0.01634 [03/13/2022-08:29:47] [V] [TRT] Tactic: 5 time 0.01434 [03/13/2022-08:29:47] [V] [TRT] Tactic: 6 time 0.021296 [03/13/2022-08:29:47] [V] [TRT] Tactic: 7 time 0.016048 [03/13/2022-08:29:47] [V] [TRT] Tactic: 8 time 0.013924 [03/13/2022-08:29:47] [V] [TRT] Tactic: 9 time 0.013796 [03/13/2022-08:29:47] [V] [TRT] Tactic: 28 time 0.027604 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 9 Time: 0.013796 [03/13/2022-08:29:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:29:47] [V] [TRT] [03/13/2022-08:29:47] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800:2,192000) *************** [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_51, Mul_52) (PointWise) [03/13/2022-08:29:47] [V] [TRT] Tactic: 128 time 0.041576 [03/13/2022-08:29:47] [V] [TRT] Tactic: 256 time 0.035716 [03/13/2022-08:29:47] [V] [TRT] Tactic: 512 time 0.035428 [03/13/2022-08:29:47] [V] [TRT] Tactic: -32 time 0.056252 [03/13/2022-08:29:47] [V] [TRT] Tactic: -64 time 0.039848 [03/13/2022-08:29:47] [V] [TRT] Tactic: -128 time 0.038616 [03/13/2022-08:29:47] [V] [TRT] Fastest Tactic: 512 Time: 0.035428 [03/13/2022-08:29:47] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_51, Mul_52) (PointWiseV2) [03/13/2022-08:29:47] [V] [TRT] Tactic: 0 time 0.019332 [03/13/2022-08:29:47] [V] [TRT] Tactic: 1 time 0.017068 [03/13/2022-08:29:47] [V] [TRT] Tactic: 2 time 0.017128 [03/13/2022-08:29:47] [V] [TRT] Tactic: 3 time 0.01674 [03/13/2022-08:29:47] [V] [TRT] Tactic: 4 time 0.01678 [03/13/2022-08:29:47] [V] [TRT] Tactic: 5 time 0.01794 [03/13/2022-08:29:47] [V] [TRT] Tactic: 6 time 0.016064 [03/13/2022-08:29:47] [V] [TRT] Tactic: 7 time 0.016764 [03/13/2022-08:29:47] [V] [TRT] Tactic: 8 time 0.018152 [03/13/2022-08:29:47] [V] [TRT] Tactic: 9 time 0.020928 [03/13/2022-08:29:47] [V] [TRT] Tactic: 10 time 0.028708 [03/13/2022-08:29:47] [V] [TRT] Tactic: 11 time 0.02298 [03/13/2022-08:29:47] [V] [TRT] Tactic: 12 time 0.019516 [03/13/2022-08:29:47] [V] [TRT] Tactic: 13 time 0.02004 [03/13/2022-08:29:47] [V] [TRT] Tactic: 14 time 0.016476 [03/13/2022-08:29:47] [V] [TRT] Tactic: 15 time 0.014432 [03/13/2022-08:29:47] [V] [TRT] Tactic: 16 time 0.0212 [03/13/2022-08:29:47] [V] [TRT] Tactic: 17 time 0.016184 [03/13/2022-08:29:48] [V] [TRT] Tactic: 18 time 0.014172 [03/13/2022-08:29:48] [V] [TRT] Tactic: 19 time 0.014132 [03/13/2022-08:29:48] [V] [TRT] Tactic: 28 time 0.01828 [03/13/2022-08:29:48] [V] [TRT] Tactic: 29 time 0.028696 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 19 Time: 0.014132 [03/13/2022-08:29:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 19 [03/13/2022-08:29:48] [V] [TRT] [03/13/2022-08:29:48] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Half(10,800,1:8,48000) *************** [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_51, Mul_52) (PointWise) [03/13/2022-08:29:48] [V] [TRT] Tactic: 128 time 0.041692 [03/13/2022-08:29:48] [V] [TRT] Tactic: 256 time 0.0357 [03/13/2022-08:29:48] [V] [TRT] Tactic: 512 time 0.035336 [03/13/2022-08:29:48] [V] [TRT] Tactic: -32 time 0.080564 [03/13/2022-08:29:48] [V] [TRT] Tactic: -64 time 0.06538 [03/13/2022-08:29:48] [V] [TRT] Tactic: -128 time 0.06546 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 512 Time: 0.035336 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_51, Mul_52) (PointWiseV2) [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.027732 [03/13/2022-08:29:48] [V] [TRT] Tactic: 1 time 0.030728 [03/13/2022-08:29:48] [V] [TRT] Tactic: 2 time 0.030176 [03/13/2022-08:29:48] [V] [TRT] Tactic: 3 time 0.038936 [03/13/2022-08:29:48] [V] [TRT] Tactic: 4 time 0.036068 [03/13/2022-08:29:48] [V] [TRT] Tactic: 5 time 0.032044 [03/13/2022-08:29:48] [V] [TRT] Tactic: 6 time 0.057844 [03/13/2022-08:29:48] [V] [TRT] Tactic: 7 time 0.04584 [03/13/2022-08:29:48] [V] [TRT] Tactic: 8 time 0.040216 [03/13/2022-08:29:48] [V] [TRT] Tactic: 9 time 0.046284 [03/13/2022-08:29:48] [V] [TRT] Tactic: 10 time 0.020684 [03/13/2022-08:29:48] [V] [TRT] Tactic: 11 time 0.022 [03/13/2022-08:29:48] [V] [TRT] Tactic: 12 time 0.022136 [03/13/2022-08:29:48] [V] [TRT] Tactic: 13 time 0.026276 [03/13/2022-08:29:48] [V] [TRT] Tactic: 14 time 0.025724 [03/13/2022-08:29:48] [V] [TRT] Tactic: 15 time 0.02268 [03/13/2022-08:29:48] [V] [TRT] Tactic: 16 time 0.03604 [03/13/2022-08:29:48] [V] [TRT] Tactic: 17 time 0.031304 [03/13/2022-08:29:48] [V] [TRT] Tactic: 18 time 0.028456 [03/13/2022-08:29:48] [V] [TRT] Tactic: 19 time 0.02692 [03/13/2022-08:29:48] [V] [TRT] Tactic: 20 time 0.028632 [03/13/2022-08:29:48] [V] [TRT] Tactic: 21 time 0.022332 [03/13/2022-08:29:48] [V] [TRT] Tactic: 22 time 0.025536 [03/13/2022-08:29:48] [V] [TRT] Tactic: 23 time 0.030696 [03/13/2022-08:29:48] [V] [TRT] Tactic: 24 time 0.032668 [03/13/2022-08:29:48] [V] [TRT] Tactic: 25 time 0.031108 [03/13/2022-08:29:48] [V] [TRT] Tactic: 26 time 0.025168 [03/13/2022-08:29:48] [V] [TRT] Tactic: 27 time 0.02938 [03/13/2022-08:29:48] [V] [TRT] Tactic: 28 time 0.015284 [03/13/2022-08:29:48] [V] [TRT] Tactic: 29 time 0.015156 [03/13/2022-08:29:48] [V] [TRT] Tactic: 30 time 0.019464 [03/13/2022-08:29:48] [V] [TRT] Tactic: 31 time 0.0291 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 29 Time: 0.015156 [03/13/2022-08:29:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 29 [03/13/2022-08:29:48] [V] [TRT] [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.042936 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.079852 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.042936 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.0249 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.029204 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.0249 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.053564 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.023332 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.023332 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.0424 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.020428 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.020428 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.053936 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.048608 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.048608 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.052908 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.046724 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.046724 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.065928 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.047924 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.047924 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.049792 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.030952 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.030952 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.026496 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.026268 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.026268 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.042748 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.079884 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.042748 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.052944 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.021104 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.021104 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.042844 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.018084 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.018084 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.05244 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.020728 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.020728 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.042436 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.075656 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.042436 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.051708 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.019684 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.019684 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.041572 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.017044 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.017044 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.046148 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.020852 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.020852 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.04036 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.142632 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.04036 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.045856 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.01582 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.01582 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.05346 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.01622 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.01622 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.025364 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.029044 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.025364 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.052812 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.023292 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.023292 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.042188 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.02052 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.02052 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.054364 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.048652 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.048652 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.052872 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.04664 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.04664 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.066404 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.047772 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.047772 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.049656 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.031344 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.031344 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.026212 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.026316 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.026212 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.053564 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.02158 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.02158 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.042772 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.01794 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.01794 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.052524 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.02094 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.02094 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.052024 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.020408 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.020408 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.042068 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.017252 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.017252 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.045904 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.020768 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.020768 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.045572 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.015324 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.015324 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:48] [V] [TRT] Tactic: 1002 time 0.05356 [03/13/2022-08:29:48] [V] [TRT] Tactic: 0 time 0.01588 [03/13/2022-08:29:48] [V] [TRT] Fastest Tactic: 0 Time: 0.01588 [03/13/2022-08:29:48] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,384000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:29:48] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:29:48] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:29:48] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:29:48] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:48] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:29:48] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:29:48] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:29:48] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:29:48] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:29:48] [V] [TRT] --------------- Timing Runner: Conv_53 (FusedConvActConvolution) [03/13/2022-08:29:48] [V] [TRT] Tactic: 589823 time 0.16634 [03/13/2022-08:29:48] [V] [TRT] Tactic: 655359 time 0.11168 [03/13/2022-08:29:48] [V] [TRT] Tactic: 786431 time 0.128636 [03/13/2022-08:29:48] [V] [TRT] Tactic: 851967 time 0.11996 [03/13/2022-08:29:48] [V] [TRT] Tactic: 1179647 time 0.124688 [03/13/2022-08:29:48] [V] [TRT] Tactic: 1310719 time 0.125304 [03/13/2022-08:29:48] [V] [TRT] Tactic: 1376255 time 0.108208 [03/13/2022-08:29:48] [V] [TRT] Tactic: 1441791 time 0.151732 [03/13/2022-08:29:48] [V] [TRT] Tactic: 1507327 time 0.107496 [03/13/2022-08:29:48] [V] [TRT] Tactic: 1638399 time 0.125316 [03/13/2022-08:29:48] [V] [TRT] Tactic: 1835007 time 0.136816 [03/13/2022-08:29:48] [V] [TRT] Tactic: 1900543 time 0.123012 [03/13/2022-08:29:48] [V] [TRT] Tactic: 2162687 time 0.111956 [03/13/2022-08:29:48] [V] [TRT] Tactic: 2293759 time 0.118272 [03/13/2022-08:29:48] [V] [TRT] Tactic: 2359295 time 0.107392 [03/13/2022-08:29:48] [V] [TRT] Tactic: 2686975 time 0.11532 [03/13/2022-08:29:49] [V] [TRT] Tactic: 3080191 time 0.111576 [03/13/2022-08:29:49] [V] [TRT] Tactic: 3342335 time 0.11428 [03/13/2022-08:29:49] [V] [TRT] Tactic: 3407871 time 0.113668 [03/13/2022-08:29:49] [V] [TRT] Tactic: 3538943 time 0.114084 [03/13/2022-08:29:49] [V] [TRT] Tactic: 3670015 time 0.127032 [03/13/2022-08:29:49] [V] [TRT] Tactic: 3932159 time 0.117416 [03/13/2022-08:29:49] [V] [TRT] Tactic: 3997695 time 0.13284 [03/13/2022-08:29:49] [V] [TRT] Tactic: 4063231 time 0.1241 [03/13/2022-08:29:49] [V] [TRT] Tactic: 4194303 time 0.123888 [03/13/2022-08:29:49] [V] [TRT] Tactic: 4325375 time 0.119852 [03/13/2022-08:29:49] [V] [TRT] Tactic: 4521983 time 0.14014 [03/13/2022-08:29:49] [V] [TRT] Tactic: 4587519 time 0.116424 [03/13/2022-08:29:49] [V] [TRT] Tactic: 4653055 time 0.115644 [03/13/2022-08:29:49] [V] [TRT] Tactic: 4915199 time 0.120272 [03/13/2022-08:29:49] [V] [TRT] Tactic: 4980735 time 0.114944 [03/13/2022-08:29:49] [V] [TRT] Tactic: 5177343 time 0.137056 [03/13/2022-08:29:49] [V] [TRT] Tactic: 5242879 time 0.115324 [03/13/2022-08:29:49] [V] [TRT] Tactic: 5373951 time 0.166652 [03/13/2022-08:29:49] [V] [TRT] Tactic: 5439487 time 0.185656 [03/13/2022-08:29:49] [V] [TRT] Tactic: 5570559 time 0.108836 [03/13/2022-08:29:49] [V] [TRT] Tactic: 5636095 time 0.118584 [03/13/2022-08:29:49] [V] [TRT] Tactic: 5701631 time 0.118636 [03/13/2022-08:29:49] [V] [TRT] Tactic: 5767167 time 0.39114 [03/13/2022-08:29:49] [V] [TRT] Tactic: 5832703 time 0.10614 [03/13/2022-08:29:49] [V] [TRT] Tactic: 5898239 time 0.12062 [03/13/2022-08:29:49] [V] [TRT] Tactic: 6029311 time 0.121348 [03/13/2022-08:29:49] [V] [TRT] Tactic: 6225919 time 0.11706 [03/13/2022-08:29:49] [V] [TRT] Tactic: 6291455 time 0.12454 [03/13/2022-08:29:49] [V] [TRT] Tactic: 6422527 time 0.110448 [03/13/2022-08:29:49] [V] [TRT] Tactic: 6750207 time 0.140016 [03/13/2022-08:29:49] [V] [TRT] Tactic: 6815743 time 0.146852 [03/13/2022-08:29:49] [V] [TRT] Tactic: 6946815 time 0.17676 [03/13/2022-08:29:49] [V] [TRT] Tactic: 7077887 time 0.107736 [03/13/2022-08:29:49] [V] [TRT] Tactic: 7143423 time 0.19214 [03/13/2022-08:29:49] [V] [TRT] Tactic: 7208959 time 0.114924 [03/13/2022-08:29:49] [V] [TRT] Tactic: 7340031 time 0.123088 [03/13/2022-08:29:49] [V] [TRT] Tactic: 7405567 time 0.124912 [03/13/2022-08:29:49] [V] [TRT] Tactic: 7536639 time 0.156944 [03/13/2022-08:29:49] [V] [TRT] Tactic: 7602175 time 0.125276 [03/13/2022-08:29:49] [V] [TRT] Tactic: 7733247 time 0.107964 [03/13/2022-08:29:49] [V] [TRT] Tactic: 7798783 time 0.12882 [03/13/2022-08:29:49] [V] [TRT] Tactic: 8191999 time 0.147604 [03/13/2022-08:29:49] [V] [TRT] Tactic: 8257535 time 0.124696 [03/13/2022-08:29:49] [V] [TRT] Tactic: 8323071 time 0.138 [03/13/2022-08:29:49] [V] [TRT] Tactic: 8650751 time 0.14176 [03/13/2022-08:29:49] [V] [TRT] Tactic: 8716287 time 0.150524 [03/13/2022-08:29:49] [V] [TRT] Tactic: 9568255 time 0.11956 [03/13/2022-08:29:49] [V] [TRT] Tactic: 9895935 time 0.118896 [03/13/2022-08:29:49] [V] [TRT] Tactic: 10223615 time 0.11062 [03/13/2022-08:29:49] [V] [TRT] Tactic: 10354687 time 0.121608 [03/13/2022-08:29:49] [V] [TRT] Tactic: 10551295 time 0.143372 [03/13/2022-08:29:49] [V] [TRT] Tactic: 10747903 time 0.105896 [03/13/2022-08:29:49] [V] [TRT] Tactic: 10944511 time 0.114136 [03/13/2022-08:29:49] [V] [TRT] Fastest Tactic: 10747903 Time: 0.105896 [03/13/2022-08:29:49] [V] [TRT] --------------- Timing Runner: Conv_53 (CaskConvolution) [03/13/2022-08:29:49] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Tactic: 1754569683116234317 time 0.049792 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Tactic: 1825138533642645384 time 0.04988 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Tactic: 2733356012094739613 time 0.051272 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Tactic: 3915320020053085238 time 0.0493 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Tactic: 6808617066150061604 time 0.051724 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Tactic: 9091006216302412844 time 0.049972 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Tactic: -8060443123034038864 time 0.05208 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Tactic: -4420849921117327522 time 0.056888 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Tactic: -3946921629105938337 time 0.051152 [03/13/2022-08:29:49] [V] [TRT] Fastest Tactic: 3915320020053085238 Time: 0.0493 [03/13/2022-08:29:49] [V] [TRT] --------------- Timing Runner: Conv_53 (CudaConvolution) [03/13/2022-08:29:49] [V] [TRT] Tactic: 0 time 0.092568 [03/13/2022-08:29:49] [V] [TRT] Tactic: 2 time 0.12858 [03/13/2022-08:29:49] [V] [TRT] Tactic: 5 time 0.188652 [03/13/2022-08:29:49] [V] [TRT] Tactic: 57 time 0.124428 [03/13/2022-08:29:49] [V] [TRT] Fastest Tactic: 0 Time: 0.092568 [03/13/2022-08:29:49] [V] [TRT] --------------- Timing Runner: Conv_53 (CudaDepthwiseConvolution) [03/13/2022-08:29:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3915320020053085238 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:49] [V] [TRT] [03/13/2022-08:29:49] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:49] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,384000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:29:49] [V] [TRT] --------------- Timing Runner: Conv_53 (FusedConvActConvolution) [03/13/2022-08:29:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:49] [V] [TRT] --------------- Timing Runner: Conv_53 (CaskConvolution) [03/13/2022-08:29:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:49] [V] [TRT] --------------- Timing Runner: Conv_53 (CudaConvolution) [03/13/2022-08:29:49] [V] [TRT] Tactic: 0 time 0.085792 [03/13/2022-08:29:49] [V] [TRT] Tactic: 1 time 0.069308 [03/13/2022-08:29:49] [V] [TRT] Tactic: 2 time 0.121552 [03/13/2022-08:29:49] [V] [TRT] Tactic: 4 skipped. Scratch requested: 862643200, available: 16777216 [03/13/2022-08:29:49] [V] [TRT] Tactic: 5 time 0.18792 [03/13/2022-08:29:49] [V] [TRT] Fastest Tactic: 1 Time: 0.069308 [03/13/2022-08:29:49] [V] [TRT] --------------- Timing Runner: Conv_53 (CudaDepthwiseConvolution) [03/13/2022-08:29:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:29:49] [V] [TRT] [03/13/2022-08:29:49] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:29:49] [V] [TRT] --------------- Timing Runner: Conv_53 (FusedConvActConvolution) [03/13/2022-08:29:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:49] [V] [TRT] --------------- Timing Runner: Conv_53 (CaskConvolution) [03/13/2022-08:29:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:49] [V] [TRT] --------------- Timing Runner: Conv_53 (CudaConvolution) [03/13/2022-08:29:49] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:49] [V] [TRT] --------------- Timing Runner: Conv_53 (CudaDepthwiseConvolution) [03/13/2022-08:29:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:49] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800:2,192000) *************** [03/13/2022-08:29:49] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:49] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:49] [V] [TRT] --------------- Timing Runner: Conv_53 (FusedConvActConvolution) [03/13/2022-08:29:49] [V] [TRT] Tactic: 589823 time 0.086408 [03/13/2022-08:29:49] [V] [TRT] Tactic: 655359 time 0.059092 [03/13/2022-08:29:49] [V] [TRT] Tactic: 786431 time 0.072488 [03/13/2022-08:29:49] [V] [TRT] Tactic: 851967 time 0.071776 [03/13/2022-08:29:49] [V] [TRT] Tactic: 1310719 time 0.063936 [03/13/2022-08:29:49] [V] [TRT] Tactic: 1376255 time 0.057044 [03/13/2022-08:29:49] [V] [TRT] Tactic: 1507327 time 0.058604 [03/13/2022-08:29:49] [V] [TRT] Tactic: 1638399 time 0.075584 [03/13/2022-08:29:49] [V] [TRT] Tactic: 1835007 time 0.074236 [03/13/2022-08:29:49] [V] [TRT] Tactic: 1900543 time 0.061988 [03/13/2022-08:29:49] [V] [TRT] Tactic: 2162687 time 0.05912 [03/13/2022-08:29:49] [V] [TRT] Tactic: 2293759 time 0.060276 [03/13/2022-08:29:49] [V] [TRT] Tactic: 2359295 time 0.054584 [03/13/2022-08:29:49] [V] [TRT] Tactic: 2686975 time 0.058028 [03/13/2022-08:29:49] [V] [TRT] Tactic: 3080191 time 0.059312 [03/13/2022-08:29:50] [V] [TRT] Tactic: 3342335 time 0.059432 [03/13/2022-08:29:50] [V] [TRT] Tactic: 3407871 time 0.060192 [03/13/2022-08:29:50] [V] [TRT] Tactic: 3538943 time 0.061736 [03/13/2022-08:29:50] [V] [TRT] Tactic: 3670015 time 0.064408 [03/13/2022-08:29:50] [V] [TRT] Tactic: 3932159 time 0.060016 [03/13/2022-08:29:50] [V] [TRT] Tactic: 4063231 time 0.07194 [03/13/2022-08:29:50] [V] [TRT] Tactic: 4194303 time 0.069724 [03/13/2022-08:29:50] [V] [TRT] Tactic: 4325375 time 0.06608 [03/13/2022-08:29:50] [V] [TRT] Tactic: 4521983 time 0.066476 [03/13/2022-08:29:50] [V] [TRT] Tactic: 4980735 time 0.063676 [03/13/2022-08:29:50] [V] [TRT] Tactic: 5242879 time 0.062984 [03/13/2022-08:29:50] [V] [TRT] Tactic: 5439487 time 0.098964 [03/13/2022-08:29:50] [V] [TRT] Tactic: 5570559 time 0.059932 [03/13/2022-08:29:50] [V] [TRT] Tactic: 5636095 time 0.071944 [03/13/2022-08:29:50] [V] [TRT] Tactic: 5701631 time 0.063652 [03/13/2022-08:29:50] [V] [TRT] Tactic: 5767167 time 0.195016 [03/13/2022-08:29:50] [V] [TRT] Tactic: 5832703 time 0.05734 [03/13/2022-08:29:50] [V] [TRT] Tactic: 6029311 time 0.064688 [03/13/2022-08:29:50] [V] [TRT] Tactic: 6225919 time 0.066148 [03/13/2022-08:29:50] [V] [TRT] Tactic: 6422527 time 0.060768 [03/13/2022-08:29:50] [V] [TRT] Tactic: 6815743 time 0.079048 [03/13/2022-08:29:50] [V] [TRT] Tactic: 6946815 time 0.095916 [03/13/2022-08:29:50] [V] [TRT] Tactic: 7077887 time 0.06026 [03/13/2022-08:29:50] [V] [TRT] Tactic: 7143423 time 0.101532 [03/13/2022-08:29:50] [V] [TRT] Tactic: 7208959 time 0.062616 [03/13/2022-08:29:50] [V] [TRT] Tactic: 7405567 time 0.075852 [03/13/2022-08:29:50] [V] [TRT] Tactic: 7536639 time 0.08388 [03/13/2022-08:29:50] [V] [TRT] Tactic: 7602175 time 0.07004 [03/13/2022-08:29:50] [V] [TRT] Tactic: 7733247 time 0.061072 [03/13/2022-08:29:50] [V] [TRT] Tactic: 7798783 time 0.072936 [03/13/2022-08:29:50] [V] [TRT] Tactic: 8191999 time 0.0817 [03/13/2022-08:29:50] [V] [TRT] Tactic: 8323071 time 0.076668 [03/13/2022-08:29:50] [V] [TRT] Tactic: 8650751 time 0.077988 [03/13/2022-08:29:50] [V] [TRT] Tactic: 8716287 time 0.082048 [03/13/2022-08:29:50] [V] [TRT] Tactic: 9895935 time 0.069676 [03/13/2022-08:29:50] [V] [TRT] Tactic: 10223615 time 0.057988 [03/13/2022-08:29:50] [V] [TRT] Tactic: 10551295 time 0.075928 [03/13/2022-08:29:50] [V] [TRT] Tactic: 10747903 time 0.060184 [03/13/2022-08:29:50] [V] [TRT] Tactic: 10944511 time 0.063912 [03/13/2022-08:29:50] [V] [TRT] Fastest Tactic: 2359295 Time: 0.054584 [03/13/2022-08:29:50] [V] [TRT] --------------- Timing Runner: Conv_53 (CaskConvolution) [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: 1651411198763708804 time 0.031236 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: 2418518597804310654 time 0.031064 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: 4318470497547290900 time 0.031292 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: 4930470141256631146 time 0.029628 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: 8292881859266835088 time 0.030452 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: 8401509141903434922 time 0.030844 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -8654297089785671176 time 0.034892 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -7516584506774355935 time 0.028416 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -7140760933967189247 time 0.030608 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -6004726995029373073 time 0.029924 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -5719726816705110014 time 0.0346 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -4097850214384059472 time 0.028636 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -3717489476759089008 time 0.030488 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -3689982367035295496 time 0.034944 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -2640575123064142123 time 0.029228 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -2534402059426524406 time 0.029256 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -2027588946874785071 time 0.029324 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -1968398013367819764 time 0.03524 [03/13/2022-08:29:50] [V] [TRT] Fastest Tactic: -7516584506774355935 Time: 0.028416 [03/13/2022-08:29:50] [V] [TRT] --------------- Timing Runner: Conv_53 (CudaConvolution) [03/13/2022-08:29:50] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:50] [V] [TRT] --------------- Timing Runner: Conv_53 (CudaDepthwiseConvolution) [03/13/2022-08:29:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7516584506774355935 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:50] [V] [TRT] [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:29:50] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:29:50] [V] [TRT] --------------- Timing Runner: Conv_53 (FusedConvActConvolution) [03/13/2022-08:29:50] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:50] [V] [TRT] --------------- Timing Runner: Conv_53 (CaskConvolution) [03/13/2022-08:29:50] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:50] [V] [TRT] --------------- Timing Runner: Conv_53 (CudaConvolution) [03/13/2022-08:29:50] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:50] [V] [TRT] --------------- Timing Runner: Conv_53 (CudaDepthwiseConvolution) [03/13/2022-08:29:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:50] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Half(10,800,1:8,48000) *************** [03/13/2022-08:29:50] [V] [TRT] Conv_53 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] --------------- Timing Runner: Conv_53 (FusedConvActConvolution) [03/13/2022-08:29:50] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:50] [V] [TRT] --------------- Timing Runner: Conv_53 (CaskConvolution) [03/13/2022-08:29:50] [V] [TRT] Conv_53 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:50] [V] [TRT] Tactic: 9576651994278528 time 0.18916 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: 1179757074518529353 time 0.277244 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: 2105695814191699972 time 0.37466 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: 2148106709480872763 time 0.203152 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: 2410442691266548717 time 0.359196 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: 3041642431972138763 time 0.26664 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: 3754069740140581927 time 0.37426 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: 4555462412611657028 time 0.202412 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: 5666160310350604399 time 0.37346 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:50] [V] [TRT] Tactic: 5876997871499382316 time 0.346048 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: 5925270497649423688 time 0.4923 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: 6680916730816870145 time 0.497384 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: 7158029511300006471 time 0.375108 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: 7859952145590271433 time 0.497468 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: 8283847742354150423 time 0.374032 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -8992262742606384444 time 0.202856 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -8391760416076885205 time 0.491596 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -6273232454637933930 time 0.277548 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:50] [V] [TRT] Tactic: -5925110308892264213 time 0.34666 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -5818527483287834165 time 0.277704 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:50] [V] [TRT] Tactic: -4908848143422991657 time 0.190336 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -4534876761957424274 time 0.49228 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -3237051169894153788 time 0.376092 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -3136088851200285532 time 0.26734 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -2586046817576862066 time 0.36104 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -2422160065350346448 time 0.497328 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -1216445540764179377 time 0.358876 [03/13/2022-08:29:50] [V] [TRT] Conv_53 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:50] [V] [TRT] Tactic: -229563042944049199 time 0.26752 [03/13/2022-08:29:50] [V] [TRT] Fastest Tactic: 9576651994278528 Time: 0.18916 [03/13/2022-08:29:50] [V] [TRT] --------------- Timing Runner: Conv_53 (CudaConvolution) [03/13/2022-08:29:50] [V] [TRT] Tactic: 0 time 0.09946 [03/13/2022-08:29:50] [V] [TRT] Tactic: 1 time 0.100144 [03/13/2022-08:29:50] [V] [TRT] Tactic: 2 time 0.134048 [03/13/2022-08:29:50] [V] [TRT] Fastest Tactic: 0 Time: 0.09946 [03/13/2022-08:29:50] [V] [TRT] --------------- Timing Runner: Conv_53 (CudaDepthwiseConvolution) [03/13/2022-08:29:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0 [03/13/2022-08:29:50] [V] [TRT] [03/13/2022-08:29:50] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:50] [V] [TRT] Tactic: 1002 time 0.043304 [03/13/2022-08:29:50] [V] [TRT] Tactic: 0 time 0.078392 [03/13/2022-08:29:50] [V] [TRT] Fastest Tactic: 1002 Time: 0.043304 [03/13/2022-08:29:50] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:50] [V] [TRT] Tactic: 1002 time 0.043396 [03/13/2022-08:29:50] [V] [TRT] Tactic: 0 time 0.08116 [03/13/2022-08:29:50] [V] [TRT] Fastest Tactic: 1002 Time: 0.043396 [03/13/2022-08:29:50] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:50] [V] [TRT] Tactic: 1002 time 0.042452 [03/13/2022-08:29:50] [V] [TRT] Tactic: 0 time 0.076044 [03/13/2022-08:29:50] [V] [TRT] Fastest Tactic: 1002 Time: 0.042452 [03/13/2022-08:29:50] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:29:50] [V] [TRT] Tactic: 1002 time 0.039916 [03/13/2022-08:29:50] [V] [TRT] Tactic: 0 time 0.142836 [03/13/2022-08:29:50] [V] [TRT] Fastest Tactic: 1002 Time: 0.039916 [03/13/2022-08:29:50] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,384000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:29:50] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_55, Mul_56) (PointWise) [03/13/2022-08:29:50] [V] [TRT] Tactic: 128 time 0.036816 [03/13/2022-08:29:50] [V] [TRT] Tactic: 256 time 0.037516 [03/13/2022-08:29:50] [V] [TRT] Tactic: 512 time 0.041232 [03/13/2022-08:29:50] [V] [TRT] Tactic: -32 time 0.06388 [03/13/2022-08:29:50] [V] [TRT] Tactic: -64 time 0.041136 [03/13/2022-08:29:50] [V] [TRT] Tactic: -128 time 0.0392 [03/13/2022-08:29:50] [V] [TRT] Fastest Tactic: 128 Time: 0.036816 [03/13/2022-08:29:50] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_55, Mul_56) (PointWiseV2) [03/13/2022-08:29:50] [V] [TRT] Tactic: 0 time 0.027124 [03/13/2022-08:29:50] [V] [TRT] Tactic: 1 time 0.022552 [03/13/2022-08:29:50] [V] [TRT] Tactic: 2 time 0.022428 [03/13/2022-08:29:50] [V] [TRT] Tactic: 3 time 0.022472 [03/13/2022-08:29:50] [V] [TRT] Tactic: 4 time 0.022784 [03/13/2022-08:29:50] [V] [TRT] Tactic: 5 time 0.02156 [03/13/2022-08:29:50] [V] [TRT] Tactic: 6 time 0.025184 [03/13/2022-08:29:51] [V] [TRT] Tactic: 7 time 0.0225 [03/13/2022-08:29:51] [V] [TRT] Tactic: 8 time 0.022264 [03/13/2022-08:29:51] [V] [TRT] Tactic: 9 time 0.02204 [03/13/2022-08:29:51] [V] [TRT] Tactic: 28 time 0.02674 [03/13/2022-08:29:51] [V] [TRT] Fastest Tactic: 5 Time: 0.02156 [03/13/2022-08:29:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [03/13/2022-08:29:51] [V] [TRT] [03/13/2022-08:29:51] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,14400) -> Float(1,80,4800:32,14400) *************** [03/13/2022-08:29:51] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_55, Mul_56) (PointWise) [03/13/2022-08:29:51] [V] [TRT] Tactic: 128 time 0.055312 [03/13/2022-08:29:51] [V] [TRT] Tactic: 256 time 0.056048 [03/13/2022-08:29:51] [V] [TRT] Tactic: 512 time 0.062236 [03/13/2022-08:29:51] [V] [TRT] Tactic: -32 time 0.085884 [03/13/2022-08:29:51] [V] [TRT] Tactic: -64 time 0.051744 [03/13/2022-08:29:51] [V] [TRT] Tactic: -128 time 0.047708 [03/13/2022-08:29:51] [V] [TRT] Fastest Tactic: -128 Time: 0.047708 [03/13/2022-08:29:51] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_55, Mul_56) (PointWiseV2) [03/13/2022-08:29:51] [V] [TRT] Tactic: 24 time 0.029732 [03/13/2022-08:29:51] [V] [TRT] Tactic: 25 time 0.030648 [03/13/2022-08:29:51] [V] [TRT] Tactic: 26 time 0.031056 [03/13/2022-08:29:51] [V] [TRT] Tactic: 27 time 0.032676 [03/13/2022-08:29:51] [V] [TRT] Tactic: 31 time 0.029816 [03/13/2022-08:29:51] [V] [TRT] Fastest Tactic: 24 Time: 0.029732 [03/13/2022-08:29:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [03/13/2022-08:29:51] [V] [TRT] [03/13/2022-08:29:51] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,384000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:29:51] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_55, Mul_56) (PointWise) [03/13/2022-08:29:51] [V] [TRT] Tactic: 128 time 0.038724 [03/13/2022-08:29:51] [V] [TRT] Tactic: 256 time 0.033436 [03/13/2022-08:29:51] [V] [TRT] Tactic: 512 time 0.033508 [03/13/2022-08:29:51] [V] [TRT] Tactic: -32 time 0.056012 [03/13/2022-08:29:51] [V] [TRT] Tactic: -64 time 0.038924 [03/13/2022-08:29:51] [V] [TRT] Tactic: -128 time 0.037256 [03/13/2022-08:29:51] [V] [TRT] Fastest Tactic: 256 Time: 0.033436 [03/13/2022-08:29:51] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_55, Mul_56) (PointWiseV2) [03/13/2022-08:29:51] [V] [TRT] Tactic: 0 time 0.02568 [03/13/2022-08:29:51] [V] [TRT] Tactic: 1 time 0.020824 [03/13/2022-08:29:51] [V] [TRT] Tactic: 2 time 0.018556 [03/13/2022-08:29:51] [V] [TRT] Tactic: 3 time 0.019076 [03/13/2022-08:29:51] [V] [TRT] Tactic: 4 time 0.015432 [03/13/2022-08:29:51] [V] [TRT] Tactic: 5 time 0.013948 [03/13/2022-08:29:51] [V] [TRT] Tactic: 6 time 0.020436 [03/13/2022-08:29:51] [V] [TRT] Tactic: 7 time 0.015156 [03/13/2022-08:29:51] [V] [TRT] Tactic: 8 time 0.01326 [03/13/2022-08:29:51] [V] [TRT] Tactic: 9 time 0.013744 [03/13/2022-08:29:51] [V] [TRT] Tactic: 28 time 0.024744 [03/13/2022-08:29:51] [V] [TRT] Fastest Tactic: 8 Time: 0.01326 [03/13/2022-08:29:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:29:51] [V] [TRT] [03/13/2022-08:29:51] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800:2,192000) *************** [03/13/2022-08:29:51] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_55, Mul_56) (PointWise) [03/13/2022-08:29:51] [V] [TRT] Tactic: 128 time 0.038656 [03/13/2022-08:29:51] [V] [TRT] Tactic: 256 time 0.033928 [03/13/2022-08:29:51] [V] [TRT] Tactic: 512 time 0.033476 [03/13/2022-08:29:51] [V] [TRT] Tactic: -32 time 0.05652 [03/13/2022-08:29:51] [V] [TRT] Tactic: -64 time 0.038924 [03/13/2022-08:29:51] [V] [TRT] Tactic: -128 time 0.037584 [03/13/2022-08:29:51] [V] [TRT] Fastest Tactic: 512 Time: 0.033476 [03/13/2022-08:29:51] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_55, Mul_56) (PointWiseV2) [03/13/2022-08:29:51] [V] [TRT] Tactic: 0 time 0.017872 [03/13/2022-08:29:51] [V] [TRT] Tactic: 1 time 0.015944 [03/13/2022-08:29:51] [V] [TRT] Tactic: 2 time 0.016772 [03/13/2022-08:29:51] [V] [TRT] Tactic: 3 time 0.015448 [03/13/2022-08:29:51] [V] [TRT] Tactic: 4 time 0.016576 [03/13/2022-08:29:51] [V] [TRT] Tactic: 5 time 0.017488 [03/13/2022-08:29:51] [V] [TRT] Tactic: 6 time 0.016576 [03/13/2022-08:29:51] [V] [TRT] Tactic: 7 time 0.01664 [03/13/2022-08:29:51] [V] [TRT] Tactic: 8 time 0.01814 [03/13/2022-08:29:51] [V] [TRT] Tactic: 9 time 0.021612 [03/13/2022-08:29:51] [V] [TRT] Tactic: 10 time 0.026564 [03/13/2022-08:29:51] [V] [TRT] Tactic: 11 time 0.021632 [03/13/2022-08:29:51] [V] [TRT] Tactic: 12 time 0.018784 [03/13/2022-08:29:51] [V] [TRT] Tactic: 13 time 0.02008 [03/13/2022-08:29:51] [V] [TRT] Tactic: 14 time 0.015868 [03/13/2022-08:29:51] [V] [TRT] Tactic: 15 time 0.014424 [03/13/2022-08:29:51] [V] [TRT] Tactic: 16 time 0.021004 [03/13/2022-08:29:51] [V] [TRT] Tactic: 17 time 0.01574 [03/13/2022-08:29:51] [V] [TRT] Tactic: 18 time 0.014112 [03/13/2022-08:29:51] [V] [TRT] Tactic: 19 time 0.013824 [03/13/2022-08:29:51] [V] [TRT] Tactic: 28 time 0.017952 [03/13/2022-08:29:51] [V] [TRT] Tactic: 29 time 0.026536 [03/13/2022-08:29:51] [V] [TRT] Fastest Tactic: 19 Time: 0.013824 [03/13/2022-08:29:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 19 [03/13/2022-08:29:51] [V] [TRT] [03/13/2022-08:29:51] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Half(10,800,1:8,48000) *************** [03/13/2022-08:29:51] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_55, Mul_56) (PointWise) [03/13/2022-08:29:51] [V] [TRT] Tactic: 128 time 0.038484 [03/13/2022-08:29:51] [V] [TRT] Tactic: 256 time 0.033796 [03/13/2022-08:29:51] [V] [TRT] Tactic: 512 time 0.033576 [03/13/2022-08:29:51] [V] [TRT] Tactic: -32 time 0.05686 [03/13/2022-08:29:51] [V] [TRT] Tactic: -64 time 0.038852 [03/13/2022-08:29:51] [V] [TRT] Tactic: -128 time 0.037624 [03/13/2022-08:29:51] [V] [TRT] Fastest Tactic: 512 Time: 0.033576 [03/13/2022-08:29:51] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_55, Mul_56) (PointWiseV2) [03/13/2022-08:29:51] [V] [TRT] Tactic: 0 time 0.015088 [03/13/2022-08:29:51] [V] [TRT] Tactic: 1 time 0.0143 [03/13/2022-08:29:51] [V] [TRT] Tactic: 2 time 0.01906 [03/13/2022-08:29:51] [V] [TRT] Tactic: 3 time 0.014872 [03/13/2022-08:29:51] [V] [TRT] Tactic: 4 time 0.019816 [03/13/2022-08:29:51] [V] [TRT] Tactic: 5 time 0.024708 [03/13/2022-08:29:51] [V] [TRT] Tactic: 6 time 0.015256 [03/13/2022-08:29:51] [V] [TRT] Tactic: 7 time 0.018056 [03/13/2022-08:29:51] [V] [TRT] Tactic: 8 time 0.024468 [03/13/2022-08:29:51] [V] [TRT] Tactic: 9 time 0.032944 [03/13/2022-08:29:51] [V] [TRT] Tactic: 10 time 0.014576 [03/13/2022-08:29:51] [V] [TRT] Tactic: 11 time 0.014384 [03/13/2022-08:29:51] [V] [TRT] Tactic: 12 time 0.015596 [03/13/2022-08:29:51] [V] [TRT] Tactic: 13 time 0.014572 [03/13/2022-08:29:51] [V] [TRT] Tactic: 14 time 0.015492 [03/13/2022-08:29:51] [V] [TRT] Tactic: 15 time 0.019404 [03/13/2022-08:29:51] [V] [TRT] Tactic: 16 time 0.01356 [03/13/2022-08:29:51] [V] [TRT] Tactic: 17 time 0.015968 [03/13/2022-08:29:51] [V] [TRT] Tactic: 18 time 0.020948 [03/13/2022-08:29:51] [V] [TRT] Tactic: 19 time 0.026372 [03/13/2022-08:29:51] [V] [TRT] Tactic: 20 time 0.018844 [03/13/2022-08:29:51] [V] [TRT] Tactic: 21 time 0.016332 [03/13/2022-08:29:51] [V] [TRT] Tactic: 22 time 0.016236 [03/13/2022-08:29:51] [V] [TRT] Tactic: 23 time 0.016456 [03/13/2022-08:29:51] [V] [TRT] Tactic: 24 time 0.026544 [03/13/2022-08:29:51] [V] [TRT] Tactic: 25 time 0.0215 [03/13/2022-08:29:51] [V] [TRT] Tactic: 26 time 0.020284 [03/13/2022-08:29:51] [V] [TRT] Tactic: 27 time 0.021048 [03/13/2022-08:29:51] [V] [TRT] Tactic: 28 time 0.015056 [03/13/2022-08:29:51] [V] [TRT] Tactic: 29 time 0.014572 [03/13/2022-08:29:51] [V] [TRT] Tactic: 30 time 0.018736 [03/13/2022-08:29:51] [V] [TRT] Tactic: 31 time 0.026408 [03/13/2022-08:29:51] [V] [TRT] Fastest Tactic: 16 Time: 0.01356 [03/13/2022-08:29:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 16 [03/13/2022-08:29:51] [V] [TRT] [03/13/2022-08:29:51] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,384000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:29:51] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:29:51] [V] [TRT] Conv_57 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:29:51] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:29:51] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:51] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:29:51] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:29:51] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:29:51] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:29:51] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:29:51] [V] [TRT] --------------- Timing Runner: Conv_57 (FusedConvActConvolution) [03/13/2022-08:29:51] [V] [TRT] Tactic: 524287 time 0.314024 [03/13/2022-08:29:51] [V] [TRT] Tactic: 720895 time 0.333196 [03/13/2022-08:29:51] [V] [TRT] Tactic: 983039 time 0.33866 [03/13/2022-08:29:51] [V] [TRT] Tactic: 1048575 time 0.285308 [03/13/2022-08:29:51] [V] [TRT] Tactic: 1703935 time 0.270832 [03/13/2022-08:29:51] [V] [TRT] Tactic: 1769471 time 0.399624 [03/13/2022-08:29:51] [V] [TRT] Tactic: 1966079 time 0.359264 [03/13/2022-08:29:51] [V] [TRT] Tactic: 2031615 time 0.357696 [03/13/2022-08:29:51] [V] [TRT] Tactic: 2228223 time 0.262948 [03/13/2022-08:29:51] [V] [TRT] Tactic: 2424831 time 0.27108 [03/13/2022-08:29:51] [V] [TRT] Tactic: 2621439 time 0.298768 [03/13/2022-08:29:52] [V] [TRT] Tactic: 2752511 time 0.351424 [03/13/2022-08:29:52] [V] [TRT] Tactic: 2818047 time 0.370692 [03/13/2022-08:29:52] [V] [TRT] Tactic: 2883583 time 0.40986 [03/13/2022-08:29:52] [V] [TRT] Tactic: 3014655 time 0.280808 [03/13/2022-08:29:52] [V] [TRT] Tactic: 3145727 time 0.336632 [03/13/2022-08:29:52] [V] [TRT] Tactic: 3473407 time 0.341728 [03/13/2022-08:29:52] [V] [TRT] Tactic: 3604479 time 0.264584 [03/13/2022-08:29:52] [V] [TRT] Tactic: 3735551 time 0.337956 [03/13/2022-08:29:52] [V] [TRT] Tactic: 4390911 time 0.393312 [03/13/2022-08:29:52] [V] [TRT] Tactic: 5046271 time 0.274312 [03/13/2022-08:29:52] [V] [TRT] Tactic: 5963775 time 0.372172 [03/13/2022-08:29:52] [V] [TRT] Tactic: 6160383 time 0.309892 [03/13/2022-08:29:52] [V] [TRT] Tactic: 6488063 time 0.2878 [03/13/2022-08:29:52] [V] [TRT] Tactic: 6881279 time 0.374728 [03/13/2022-08:29:52] [V] [TRT] Tactic: 7274495 time 0.365888 [03/13/2022-08:29:52] [V] [TRT] Tactic: 7864319 time 0.294856 [03/13/2022-08:29:52] [V] [TRT] Tactic: 7995391 time 0.345408 [03/13/2022-08:29:52] [V] [TRT] Tactic: 8585215 time 0.318452 [03/13/2022-08:29:52] [V] [TRT] Tactic: 8847359 time 0.353852 [03/13/2022-08:29:52] [V] [TRT] Tactic: 8978431 time 0.369164 [03/13/2022-08:29:52] [V] [TRT] Tactic: 9043967 time 0.279108 [03/13/2022-08:29:52] [V] [TRT] Tactic: 9175039 time 0.265508 [03/13/2022-08:29:52] [V] [TRT] Tactic: 9502719 time 0.390324 [03/13/2022-08:29:52] [V] [TRT] Tactic: 9830399 time 0.357836 [03/13/2022-08:29:52] [V] [TRT] Tactic: 9961471 time 0.32272 [03/13/2022-08:29:52] [V] [TRT] Tactic: 10027007 time 0.27116 [03/13/2022-08:29:52] [V] [TRT] Tactic: 10092543 time 0.394056 [03/13/2022-08:29:52] [V] [TRT] Tactic: 10289151 time 0.359092 [03/13/2022-08:29:52] [V] [TRT] Tactic: 10485759 time 0.260328 [03/13/2022-08:29:52] [V] [TRT] Tactic: 10682367 time 0.268368 [03/13/2022-08:29:52] [V] [TRT] Tactic: 10813439 time 0.321372 [03/13/2022-08:29:52] [V] [TRT] Fastest Tactic: 10485759 Time: 0.260328 [03/13/2022-08:29:52] [V] [TRT] --------------- Timing Runner: Conv_57 (CaskConvolution) [03/13/2022-08:29:52] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Tactic: 1825138533642645384 time 0.329716 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:29:52] [V] [TRT] Tactic: 2775507031594384867 time 0.190336 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Tactic: 2842488832350522458 time 0.338616 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Tactic: 3915320020053085238 time 0.326988 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Tactic: 6448355332020552203 time 0.342 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Tactic: 6808617066150061604 time 0.345824 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Tactic: -8060443123034038864 time 0.352548 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Tactic: -4420849921117327522 time 0.3375 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Tactic: -3946921629105938337 time 0.320004 [03/13/2022-08:29:52] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.190336 [03/13/2022-08:29:52] [V] [TRT] --------------- Timing Runner: Conv_57 (CudaConvolution) [03/13/2022-08:29:52] [V] [TRT] Tactic: 0 time 0.801712 [03/13/2022-08:29:52] [V] [TRT] Tactic: 2 time 0.913248 [03/13/2022-08:29:52] [V] [TRT] Tactic: 5 skipped. Scratch requested: 29245440, available: 16777216 [03/13/2022-08:29:52] [V] [TRT] Tactic: 6 time 0.216952 [03/13/2022-08:29:52] [V] [TRT] Tactic: 57 time 0.791376 [03/13/2022-08:29:52] [V] [TRT] Fastest Tactic: 6 Time: 0.216952 [03/13/2022-08:29:52] [V] [TRT] --------------- Timing Runner: Conv_57 (CudaDepthwiseConvolution) [03/13/2022-08:29:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:29:52] [V] [TRT] [03/13/2022-08:29:52] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:29:52] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,384000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:29:52] [V] [TRT] --------------- Timing Runner: Conv_57 (FusedConvActConvolution) [03/13/2022-08:29:52] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:52] [V] [TRT] --------------- Timing Runner: Conv_57 (CaskConvolution) [03/13/2022-08:29:52] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:52] [V] [TRT] --------------- Timing Runner: Conv_57 (CudaConvolution) [03/13/2022-08:29:52] [V] [TRT] Tactic: 0 time 0.795624 [03/13/2022-08:29:52] [V] [TRT] Tactic: 1 time 0.788144 [03/13/2022-08:29:52] [V] [TRT] Tactic: 2 time 0.859732 [03/13/2022-08:29:52] [V] [TRT] Tactic: 4 skipped. Scratch requested: 862848000, available: 16777216 [03/13/2022-08:29:52] [V] [TRT] Tactic: 5 skipped. Scratch requested: 29245440, available: 16777216 [03/13/2022-08:29:52] [V] [TRT] Tactic: 6 time 0.314144 [03/13/2022-08:29:52] [V] [TRT] Fastest Tactic: 6 Time: 0.314144 [03/13/2022-08:29:52] [V] [TRT] --------------- Timing Runner: Conv_57 (CudaDepthwiseConvolution) [03/13/2022-08:29:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [03/13/2022-08:29:52] [V] [TRT] [03/13/2022-08:29:52] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800:2,192000) *************** [03/13/2022-08:29:52] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:52] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:29:52] [V] [TRT] --------------- Timing Runner: Conv_57 (FusedConvActConvolution) [03/13/2022-08:29:52] [V] [TRT] Tactic: 524287 time 0.16034 [03/13/2022-08:29:52] [V] [TRT] Tactic: 720895 time 0.172144 [03/13/2022-08:29:53] [V] [TRT] Tactic: 983039 time 0.175116 [03/13/2022-08:29:53] [V] [TRT] Tactic: 1048575 time 0.1472 [03/13/2022-08:29:53] [V] [TRT] Tactic: 1703935 time 0.14042 [03/13/2022-08:29:53] [V] [TRT] Tactic: 1769471 time 0.236796 [03/13/2022-08:29:53] [V] [TRT] Tactic: 1966079 time 0.185952 [03/13/2022-08:29:53] [V] [TRT] Tactic: 2031615 time 0.180724 [03/13/2022-08:29:53] [V] [TRT] Tactic: 2228223 time 0.141812 [03/13/2022-08:29:53] [V] [TRT] Tactic: 2621439 time 0.161344 [03/13/2022-08:29:53] [V] [TRT] Tactic: 2752511 time 0.181964 [03/13/2022-08:29:53] [V] [TRT] Tactic: 2818047 time 0.18892 [03/13/2022-08:29:53] [V] [TRT] Tactic: 2883583 time 0.207312 [03/13/2022-08:29:53] [V] [TRT] Tactic: 3014655 time 0.144012 [03/13/2022-08:29:53] [V] [TRT] Tactic: 3145727 time 0.174108 [03/13/2022-08:29:53] [V] [TRT] Tactic: 3473407 time 0.17192 [03/13/2022-08:29:53] [V] [TRT] Tactic: 3604479 time 0.137144 [03/13/2022-08:29:53] [V] [TRT] Tactic: 3735551 time 0.169956 [03/13/2022-08:29:53] [V] [TRT] Tactic: 4390911 time 0.198884 [03/13/2022-08:29:53] [V] [TRT] Tactic: 5046271 time 0.145344 [03/13/2022-08:29:53] [V] [TRT] Tactic: 5963775 time 0.18912 [03/13/2022-08:29:53] [V] [TRT] Tactic: 6160383 time 0.15698 [03/13/2022-08:29:53] [V] [TRT] Tactic: 6488063 time 0.147424 [03/13/2022-08:29:53] [V] [TRT] Tactic: 6881279 time 0.188716 [03/13/2022-08:29:53] [V] [TRT] Tactic: 7274495 time 0.19174 [03/13/2022-08:29:53] [V] [TRT] Tactic: 7864319 time 0.168468 [03/13/2022-08:29:53] [V] [TRT] Tactic: 7995391 time 0.179836 [03/13/2022-08:29:53] [V] [TRT] Tactic: 8585215 time 0.16126 [03/13/2022-08:29:53] [V] [TRT] Tactic: 8847359 time 0.204264 [03/13/2022-08:29:53] [V] [TRT] Tactic: 8978431 time 0.18962 [03/13/2022-08:29:53] [V] [TRT] Tactic: 9043967 time 0.143784 [03/13/2022-08:29:53] [V] [TRT] Tactic: 9175039 time 0.137132 [03/13/2022-08:29:53] [V] [TRT] Tactic: 9502719 time 0.198884 [03/13/2022-08:29:53] [V] [TRT] Tactic: 9830399 time 0.181944 [03/13/2022-08:29:53] [V] [TRT] Tactic: 10027007 time 0.139376 [03/13/2022-08:29:53] [V] [TRT] Tactic: 10092543 time 0.198912 [03/13/2022-08:29:53] [V] [TRT] Tactic: 10289151 time 0.186072 [03/13/2022-08:29:53] [V] [TRT] Tactic: 10485759 time 0.134916 [03/13/2022-08:29:53] [V] [TRT] Tactic: 10682367 time 0.15312 [03/13/2022-08:29:53] [V] [TRT] Tactic: 10813439 time 0.167928 [03/13/2022-08:29:53] [V] [TRT] Fastest Tactic: 10485759 Time: 0.134916 [03/13/2022-08:29:53] [V] [TRT] --------------- Timing Runner: Conv_57 (CaskConvolution) [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: 1145226902788474763 time 0.178152 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: 1651411198763708804 time 0.177416 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: 2418518597804310654 time 0.178528 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: 4318470497547290900 time 0.175612 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: 4653005425971292725 time 0.179028 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: 4930470141256631146 time 0.158128 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: 8292881859266835088 time 0.156048 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: 8401509141903434922 time 0.175676 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: -8654297089785671176 time 0.17502 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: -7448936905981214224 time 0.160116 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: -6004726995029373073 time 0.153452 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: -5719726816705110014 time 0.175284 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: -3754890472406891741 time 0.180096 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: -3689982367035295496 time 0.176776 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: -3140347171730126532 time 0.105124 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: -2894005464278291378 time 0.159432 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: -2027588946874785071 time 0.153036 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: -1968398013367819764 time 0.177192 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: -245090590808296743 time 0.180112 [03/13/2022-08:29:53] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.105124 [03/13/2022-08:29:53] [V] [TRT] --------------- Timing Runner: Conv_57 (CudaConvolution) [03/13/2022-08:29:53] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:53] [V] [TRT] --------------- Timing Runner: Conv_57 (CudaDepthwiseConvolution) [03/13/2022-08:29:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:29:53] [V] [TRT] [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:29:53] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:29:53] [V] [TRT] --------------- Timing Runner: Conv_57 (FusedConvActConvolution) [03/13/2022-08:29:53] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:53] [V] [TRT] --------------- Timing Runner: Conv_57 (CaskConvolution) [03/13/2022-08:29:53] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:53] [V] [TRT] --------------- Timing Runner: Conv_57 (CudaConvolution) [03/13/2022-08:29:53] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:53] [V] [TRT] --------------- Timing Runner: Conv_57 (CudaDepthwiseConvolution) [03/13/2022-08:29:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:53] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Half(10,800,1:8,48000) *************** [03/13/2022-08:29:53] [V] [TRT] Conv_57 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:53] [V] [TRT] Conv_57 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:53] [V] [TRT] Conv_57 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] --------------- Timing Runner: Conv_57 (FusedConvActConvolution) [03/13/2022-08:29:53] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:53] [V] [TRT] --------------- Timing Runner: Conv_57 (CaskConvolution) [03/13/2022-08:29:53] [V] [TRT] Conv_57 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:53] [V] [TRT] Tactic: 130343752241278875 time 1.63338 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: 2148106709480872763 time 1.73082 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: 2410442691266548717 time 3.1376 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:53] [V] [TRT] Tactic: 2921824978225832523 time 1.63429 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:53] [V] [TRT] Tactic: 3030711443478140260 time 3.17828 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:53] [V] [TRT] Tactic: 3754069740140581927 time 3.288 [03/13/2022-08:29:53] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:54] [V] [TRT] Tactic: 3823144360994712832 time 2.39915 [03/13/2022-08:29:54] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:54] [V] [TRT] Tactic: 5635311898703673455 time 2.30664 [03/13/2022-08:29:54] [V] [TRT] Conv_57 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:54] [V] [TRT] Tactic: 5925270497649423688 time 4.36394 [03/13/2022-08:29:54] [V] [TRT] Conv_57 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:54] [V] [TRT] Tactic: 6680916730816870145 time 4.36739 [03/13/2022-08:29:54] [V] [TRT] Conv_57 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:54] [V] [TRT] Tactic: 7158029511300006471 time 3.24838 [03/13/2022-08:29:54] [V] [TRT] Conv_57 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:54] [V] [TRT] Tactic: 7859952145590271433 time 4.34827 [03/13/2022-08:29:54] [V] [TRT] Conv_57 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:54] [V] [TRT] Tactic: 8283847742354150423 time 3.26761 [03/13/2022-08:29:54] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:54] [V] [TRT] Tactic: -8992262742606384444 time 1.73068 [03/13/2022-08:29:54] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:54] [V] [TRT] Tactic: -8682550625095202832 time 1.73076 [03/13/2022-08:29:54] [V] [TRT] Conv_57 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:54] [V] [TRT] Tactic: -8379842433586149932 time 3.06108 [03/13/2022-08:29:54] [V] [TRT] Conv_57 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:29:54] [V] [TRT] Tactic: -6352769237623756264 time 3.15796 [03/13/2022-08:29:54] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:54] [V] [TRT] Tactic: -6273232454637933930 time 2.34084 [03/13/2022-08:29:54] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:54] [V] [TRT] Tactic: -5818527483287834165 time 2.33479 [03/13/2022-08:29:54] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:29:54] [V] [TRT] Tactic: -4954692664176521434 time 3.11748 [03/13/2022-08:29:54] [V] [TRT] Conv_57 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:29:54] [V] [TRT] Tactic: -4953888146171240997 time 1.63448 [03/13/2022-08:29:54] [V] [TRT] Conv_57 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:54] [V] [TRT] Tactic: -4534876761957424274 time 4.33396 [03/13/2022-08:29:54] [V] [TRT] Conv_57 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:54] [V] [TRT] Tactic: -3237051169894153788 time 3.24801 [03/13/2022-08:29:54] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:29:54] [V] [TRT] Tactic: -3136088851200285532 time 2.40698 [03/13/2022-08:29:54] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:54] [V] [TRT] Tactic: -2586046817576862066 time 3.1139 [03/13/2022-08:29:54] [V] [TRT] Conv_57 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:29:55] [V] [TRT] Tactic: -229563042944049199 time 2.34742 [03/13/2022-08:29:55] [V] [TRT] Fastest Tactic: 130343752241278875 Time: 1.63338 [03/13/2022-08:29:55] [V] [TRT] --------------- Timing Runner: Conv_57 (CudaConvolution) [03/13/2022-08:29:55] [V] [TRT] Tactic: 0 time 0.897528 [03/13/2022-08:29:55] [V] [TRT] Tactic: 1 time 0.792512 [03/13/2022-08:29:55] [V] [TRT] Tactic: 2 time 1.03258 [03/13/2022-08:29:55] [V] [TRT] Tactic: 6 time 0.277168 [03/13/2022-08:29:55] [V] [TRT] Fastest Tactic: 6 Time: 0.277168 [03/13/2022-08:29:55] [V] [TRT] --------------- Timing Runner: Conv_57 (CudaDepthwiseConvolution) [03/13/2022-08:29:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:29:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [03/13/2022-08:29:55] [V] [TRT] [03/13/2022-08:29:55] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,384000), Float(1,80,4800,384000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:29:57] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_59, Mul_60), Add_61) (PointWise) [03/13/2022-08:29:57] [V] [TRT] Tactic: 128 time 0.054664 [03/13/2022-08:29:57] [V] [TRT] Tactic: 256 time 0.05622 [03/13/2022-08:29:57] [V] [TRT] Tactic: 512 time 0.062692 [03/13/2022-08:29:57] [V] [TRT] Tactic: -32 time 0.09522 [03/13/2022-08:29:57] [V] [TRT] Tactic: -64 time 0.064164 [03/13/2022-08:29:57] [V] [TRT] Tactic: -128 time 0.06078 [03/13/2022-08:29:57] [V] [TRT] Fastest Tactic: 128 Time: 0.054664 [03/13/2022-08:29:57] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_59, Mul_60), Add_61) (PointWiseV2) [03/13/2022-08:29:57] [V] [TRT] Tactic: 0 time 0.034588 [03/13/2022-08:29:57] [V] [TRT] Tactic: 1 time 0.030848 [03/13/2022-08:29:57] [V] [TRT] Tactic: 2 time 0.032288 [03/13/2022-08:29:57] [V] [TRT] Tactic: 3 time 0.03196 [03/13/2022-08:29:57] [V] [TRT] Tactic: 4 time 0.03146 [03/13/2022-08:29:57] [V] [TRT] Tactic: 5 time 0.031884 [03/13/2022-08:29:57] [V] [TRT] Tactic: 6 time 0.03344 [03/13/2022-08:29:57] [V] [TRT] Tactic: 7 time 0.03142 [03/13/2022-08:29:57] [V] [TRT] Tactic: 8 time 0.03208 [03/13/2022-08:29:57] [V] [TRT] Tactic: 9 time 0.032288 [03/13/2022-08:29:57] [V] [TRT] Tactic: 28 time 0.034108 [03/13/2022-08:29:57] [V] [TRT] Fastest Tactic: 1 Time: 0.030848 [03/13/2022-08:29:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [03/13/2022-08:29:57] [V] [TRT] [03/13/2022-08:29:57] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,14400), Float(1,80,4800:32,14400) -> Float(1,80,4800:32,14400) *************** [03/13/2022-08:29:57] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_59, Mul_60), Add_61) (PointWise) [03/13/2022-08:29:57] [V] [TRT] Tactic: 128 time 0.079552 [03/13/2022-08:29:57] [V] [TRT] Tactic: 256 time 0.081984 [03/13/2022-08:29:57] [V] [TRT] Tactic: 512 time 0.09006 [03/13/2022-08:29:57] [V] [TRT] Tactic: -32 time 0.12942 [03/13/2022-08:29:57] [V] [TRT] Tactic: -64 time 0.079672 [03/13/2022-08:29:57] [V] [TRT] Tactic: -128 time 0.0732 [03/13/2022-08:29:57] [V] [TRT] Fastest Tactic: -128 Time: 0.0732 [03/13/2022-08:29:57] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_59, Mul_60), Add_61) (PointWiseV2) [03/13/2022-08:29:57] [V] [TRT] Tactic: 24 time 0.051616 [03/13/2022-08:29:57] [V] [TRT] Tactic: 25 time 0.051592 [03/13/2022-08:29:57] [V] [TRT] Tactic: 26 time 0.05166 [03/13/2022-08:29:57] [V] [TRT] Tactic: 27 time 0.053048 [03/13/2022-08:29:57] [V] [TRT] Tactic: 31 time 0.051756 [03/13/2022-08:29:57] [V] [TRT] Fastest Tactic: 25 Time: 0.051592 [03/13/2022-08:29:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [03/13/2022-08:29:57] [V] [TRT] [03/13/2022-08:29:57] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,384000), Half(1,80,4800,384000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:29:58] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_59, Mul_60), Add_61) (PointWise) [03/13/2022-08:29:58] [V] [TRT] Tactic: 128 time 0.05944 [03/13/2022-08:29:58] [V] [TRT] Tactic: 256 time 0.05418 [03/13/2022-08:29:58] [V] [TRT] Tactic: 512 time 0.05558 [03/13/2022-08:29:58] [V] [TRT] Tactic: -32 time 0.098756 [03/13/2022-08:29:58] [V] [TRT] Tactic: -64 time 0.06498 [03/13/2022-08:29:58] [V] [TRT] Tactic: -128 time 0.06248 [03/13/2022-08:29:58] [V] [TRT] Fastest Tactic: 256 Time: 0.05418 [03/13/2022-08:29:58] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_59, Mul_60), Add_61) (PointWiseV2) [03/13/2022-08:29:58] [V] [TRT] Tactic: 0 time 0.031932 [03/13/2022-08:29:58] [V] [TRT] Tactic: 1 time 0.027088 [03/13/2022-08:29:58] [V] [TRT] Tactic: 2 time 0.022956 [03/13/2022-08:29:58] [V] [TRT] Tactic: 3 time 0.024732 [03/13/2022-08:29:58] [V] [TRT] Tactic: 4 time 0.020812 [03/13/2022-08:29:58] [V] [TRT] Tactic: 5 time 0.019188 [03/13/2022-08:29:58] [V] [TRT] Tactic: 6 time 0.025932 [03/13/2022-08:29:58] [V] [TRT] Tactic: 7 time 0.020616 [03/13/2022-08:29:59] [V] [TRT] Tactic: 8 time 0.01914 [03/13/2022-08:29:59] [V] [TRT] Tactic: 9 time 0.019072 [03/13/2022-08:29:59] [V] [TRT] Tactic: 28 time 0.032124 [03/13/2022-08:29:59] [V] [TRT] Fastest Tactic: 9 Time: 0.019072 [03/13/2022-08:29:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:29:59] [V] [TRT] [03/13/2022-08:29:59] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000), Half(1,80,4800:2,192000) -> Half(1,80,4800:2,192000) *************** [03/13/2022-08:30:02] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_59, Mul_60), Add_61) (PointWise) [03/13/2022-08:30:02] [V] [TRT] Tactic: 128 time 0.059676 [03/13/2022-08:30:02] [V] [TRT] Tactic: 256 time 0.054348 [03/13/2022-08:30:02] [V] [TRT] Tactic: 512 time 0.055592 [03/13/2022-08:30:02] [V] [TRT] Tactic: -32 time 0.098664 [03/13/2022-08:30:02] [V] [TRT] Tactic: -64 time 0.065632 [03/13/2022-08:30:02] [V] [TRT] Tactic: -128 time 0.062312 [03/13/2022-08:30:02] [V] [TRT] Fastest Tactic: 256 Time: 0.054348 [03/13/2022-08:30:02] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_59, Mul_60), Add_61) (PointWiseV2) [03/13/2022-08:30:02] [V] [TRT] Tactic: 0 time 0.02458 [03/13/2022-08:30:02] [V] [TRT] Tactic: 1 time 0.022344 [03/13/2022-08:30:02] [V] [TRT] Tactic: 2 time 0.02324 [03/13/2022-08:30:02] [V] [TRT] Tactic: 3 time 0.022372 [03/13/2022-08:30:02] [V] [TRT] Tactic: 4 time 0.023132 [03/13/2022-08:30:02] [V] [TRT] Tactic: 5 time 0.0278 [03/13/2022-08:30:02] [V] [TRT] Tactic: 6 time 0.021904 [03/13/2022-08:30:02] [V] [TRT] Tactic: 7 time 0.023792 [03/13/2022-08:30:02] [V] [TRT] Tactic: 8 time 0.031504 [03/13/2022-08:30:02] [V] [TRT] Tactic: 9 time 0.042224 [03/13/2022-08:30:02] [V] [TRT] Tactic: 10 time 0.03354 [03/13/2022-08:30:02] [V] [TRT] Tactic: 11 time 0.028848 [03/13/2022-08:30:02] [V] [TRT] Tactic: 12 time 0.024256 [03/13/2022-08:30:02] [V] [TRT] Tactic: 13 time 0.026272 [03/13/2022-08:30:02] [V] [TRT] Tactic: 14 time 0.022364 [03/13/2022-08:30:02] [V] [TRT] Tactic: 15 time 0.020332 [03/13/2022-08:30:02] [V] [TRT] Tactic: 16 time 0.027136 [03/13/2022-08:30:02] [V] [TRT] Tactic: 17 time 0.02256 [03/13/2022-08:30:02] [V] [TRT] Tactic: 18 time 0.019708 [03/13/2022-08:30:02] [V] [TRT] Tactic: 19 time 0.01994 [03/13/2022-08:30:02] [V] [TRT] Tactic: 28 time 0.02444 [03/13/2022-08:30:02] [V] [TRT] Tactic: 29 time 0.03314 [03/13/2022-08:30:02] [V] [TRT] Fastest Tactic: 18 Time: 0.019708 [03/13/2022-08:30:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:30:02] [V] [TRT] [03/13/2022-08:30:02] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000), Half(10,800,1:8,48000) -> Half(10,800,1:8,48000) *************** [03/13/2022-08:30:08] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_59, Mul_60), Add_61) (PointWise) [03/13/2022-08:30:08] [V] [TRT] Tactic: 128 time 0.059452 [03/13/2022-08:30:08] [V] [TRT] Tactic: 256 time 0.054048 [03/13/2022-08:30:08] [V] [TRT] Tactic: 512 time 0.055784 [03/13/2022-08:30:08] [V] [TRT] Tactic: -32 time 0.098524 [03/13/2022-08:30:08] [V] [TRT] Tactic: -64 time 0.065636 [03/13/2022-08:30:08] [V] [TRT] Tactic: -128 time 0.062168 [03/13/2022-08:30:08] [V] [TRT] Fastest Tactic: 256 Time: 0.054048 [03/13/2022-08:30:08] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_59, Mul_60), Add_61) (PointWiseV2) [03/13/2022-08:30:08] [V] [TRT] Tactic: 0 time 0.025548 [03/13/2022-08:30:08] [V] [TRT] Tactic: 1 time 0.025724 [03/13/2022-08:30:08] [V] [TRT] Tactic: 2 time 0.034552 [03/13/2022-08:30:08] [V] [TRT] Tactic: 3 time 0.026404 [03/13/2022-08:30:08] [V] [TRT] Tactic: 4 time 0.033312 [03/13/2022-08:30:08] [V] [TRT] Tactic: 5 time 0.043636 [03/13/2022-08:30:08] [V] [TRT] Tactic: 6 time 0.023176 [03/13/2022-08:30:08] [V] [TRT] Tactic: 7 time 0.031348 [03/13/2022-08:30:08] [V] [TRT] Tactic: 8 time 0.041424 [03/13/2022-08:30:08] [V] [TRT] Tactic: 9 time 0.055508 [03/13/2022-08:30:08] [V] [TRT] Tactic: 10 time 0.023444 [03/13/2022-08:30:08] [V] [TRT] Tactic: 11 time 0.020912 [03/13/2022-08:30:08] [V] [TRT] Tactic: 12 time 0.027024 [03/13/2022-08:30:08] [V] [TRT] Tactic: 13 time 0.0214 [03/13/2022-08:30:08] [V] [TRT] Tactic: 14 time 0.028084 [03/13/2022-08:30:08] [V] [TRT] Tactic: 15 time 0.038608 [03/13/2022-08:30:08] [V] [TRT] Tactic: 16 time 0.020732 [03/13/2022-08:30:08] [V] [TRT] Tactic: 17 time 0.028344 [03/13/2022-08:30:08] [V] [TRT] Tactic: 18 time 0.0361 [03/13/2022-08:30:08] [V] [TRT] Tactic: 19 time 0.046176 [03/13/2022-08:30:08] [V] [TRT] Tactic: 20 time 0.024932 [03/13/2022-08:30:08] [V] [TRT] Tactic: 21 time 0.023716 [03/13/2022-08:30:08] [V] [TRT] Tactic: 22 time 0.022668 [03/13/2022-08:30:08] [V] [TRT] Tactic: 23 time 0.023164 [03/13/2022-08:30:08] [V] [TRT] Tactic: 24 time 0.033584 [03/13/2022-08:30:08] [V] [TRT] Tactic: 25 time 0.029092 [03/13/2022-08:30:08] [V] [TRT] Tactic: 26 time 0.026492 [03/13/2022-08:30:08] [V] [TRT] Tactic: 27 time 0.027364 [03/13/2022-08:30:08] [V] [TRT] Tactic: 28 time 0.025084 [03/13/2022-08:30:08] [V] [TRT] Tactic: 29 time 0.022952 [03/13/2022-08:30:08] [V] [TRT] Tactic: 30 time 0.024972 [03/13/2022-08:30:08] [V] [TRT] Tactic: 31 time 0.03346 [03/13/2022-08:30:08] [V] [TRT] Fastest Tactic: 16 Time: 0.020732 [03/13/2022-08:30:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 16 [03/13/2022-08:30:08] [V] [TRT] [03/13/2022-08:30:08] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,384000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:30:08] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,384000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:30:08] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:30:08] [V] [TRT] --------------- Timing Runner: Conv_62 (FusedConvActConvolution) [03/13/2022-08:30:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:08] [V] [TRT] --------------- Timing Runner: Conv_62 (CaskConvolution) [03/13/2022-08:30:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:08] [V] [TRT] --------------- Timing Runner: Conv_62 (CudaConvolution) [03/13/2022-08:30:08] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:08] [V] [TRT] --------------- Timing Runner: Conv_62 (CudaDepthwiseConvolution) [03/13/2022-08:30:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:08] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800:2,192000) *************** [03/13/2022-08:30:08] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:30:08] [V] [TRT] --------------- Timing Runner: Conv_62 (FusedConvActConvolution) [03/13/2022-08:30:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:08] [V] [TRT] --------------- Timing Runner: Conv_62 (CaskConvolution) [03/13/2022-08:30:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:08] [V] [TRT] --------------- Timing Runner: Conv_62 (CudaConvolution) [03/13/2022-08:30:08] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:08] [V] [TRT] --------------- Timing Runner: Conv_62 (CudaDepthwiseConvolution) [03/13/2022-08:30:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:08] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Half(10,800,1:8,48000) *************** [03/13/2022-08:30:08] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,384000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:30:08] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_64, Mul_65) (PointWise) [03/13/2022-08:30:08] [V] [TRT] Tactic: 128 time 0.045256 [03/13/2022-08:30:08] [V] [TRT] Tactic: 256 time 0.046728 [03/13/2022-08:30:08] [V] [TRT] Tactic: 512 time 0.051644 [03/13/2022-08:30:08] [V] [TRT] Tactic: -32 time 0.077944 [03/13/2022-08:30:08] [V] [TRT] Tactic: -64 time 0.051288 [03/13/2022-08:30:08] [V] [TRT] Tactic: -128 time 0.048676 [03/13/2022-08:30:08] [V] [TRT] Fastest Tactic: 128 Time: 0.045256 [03/13/2022-08:30:08] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_64, Mul_65) (PointWiseV2) [03/13/2022-08:30:08] [V] [TRT] Tactic: 0 time 0.0324 [03/13/2022-08:30:08] [V] [TRT] Tactic: 1 time 0.027252 [03/13/2022-08:30:08] [V] [TRT] Tactic: 2 time 0.023588 [03/13/2022-08:30:08] [V] [TRT] Tactic: 3 time 0.025752 [03/13/2022-08:30:08] [V] [TRT] Tactic: 4 time 0.023244 [03/13/2022-08:30:08] [V] [TRT] Tactic: 5 time 0.022652 [03/13/2022-08:30:08] [V] [TRT] Tactic: 6 time 0.02728 [03/13/2022-08:30:08] [V] [TRT] Tactic: 7 time 0.023772 [03/13/2022-08:30:08] [V] [TRT] Tactic: 8 time 0.023108 [03/13/2022-08:30:08] [V] [TRT] Tactic: 9 time 0.023232 [03/13/2022-08:30:08] [V] [TRT] Tactic: 28 time 0.032172 [03/13/2022-08:30:08] [V] [TRT] Fastest Tactic: 5 Time: 0.022652 [03/13/2022-08:30:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [03/13/2022-08:30:08] [V] [TRT] [03/13/2022-08:30:08] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,14400) -> Float(1,80,4800:32,14400) *************** [03/13/2022-08:30:08] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_64, Mul_65) (PointWise) [03/13/2022-08:30:08] [V] [TRT] Tactic: 128 time 0.069336 [03/13/2022-08:30:08] [V] [TRT] Tactic: 256 time 0.070052 [03/13/2022-08:30:08] [V] [TRT] Tactic: 512 time 0.077736 [03/13/2022-08:30:08] [V] [TRT] Tactic: -32 time 0.105832 [03/13/2022-08:30:08] [V] [TRT] Tactic: -64 time 0.06434 [03/13/2022-08:30:08] [V] [TRT] Tactic: -128 time 0.059364 [03/13/2022-08:30:08] [V] [TRT] Fastest Tactic: -128 Time: 0.059364 [03/13/2022-08:30:08] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_64, Mul_65) (PointWiseV2) [03/13/2022-08:30:08] [V] [TRT] Tactic: 24 time 0.030344 [03/13/2022-08:30:08] [V] [TRT] Tactic: 25 time 0.031156 [03/13/2022-08:30:08] [V] [TRT] Tactic: 26 time 0.032192 [03/13/2022-08:30:08] [V] [TRT] Tactic: 27 time 0.033644 [03/13/2022-08:30:08] [V] [TRT] Tactic: 31 time 0.030356 [03/13/2022-08:30:08] [V] [TRT] Fastest Tactic: 24 Time: 0.030344 [03/13/2022-08:30:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [03/13/2022-08:30:08] [V] [TRT] [03/13/2022-08:30:08] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,384000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:30:08] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_64, Mul_65) (PointWise) [03/13/2022-08:30:08] [V] [TRT] Tactic: 128 time 0.048836 [03/13/2022-08:30:08] [V] [TRT] Tactic: 256 time 0.042416 [03/13/2022-08:30:08] [V] [TRT] Tactic: 512 time 0.042516 [03/13/2022-08:30:08] [V] [TRT] Tactic: -32 time 0.070228 [03/13/2022-08:30:09] [V] [TRT] Tactic: -64 time 0.049092 [03/13/2022-08:30:09] [V] [TRT] Tactic: -128 time 0.046916 [03/13/2022-08:30:09] [V] [TRT] Fastest Tactic: 256 Time: 0.042416 [03/13/2022-08:30:09] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_64, Mul_65) (PointWiseV2) [03/13/2022-08:30:09] [V] [TRT] Tactic: 0 time 0.030572 [03/13/2022-08:30:09] [V] [TRT] Tactic: 1 time 0.025316 [03/13/2022-08:30:09] [V] [TRT] Tactic: 2 time 0.021604 [03/13/2022-08:30:09] [V] [TRT] Tactic: 3 time 0.023372 [03/13/2022-08:30:09] [V] [TRT] Tactic: 4 time 0.018232 [03/13/2022-08:30:09] [V] [TRT] Tactic: 5 time 0.016352 [03/13/2022-08:30:09] [V] [TRT] Tactic: 6 time 0.024188 [03/13/2022-08:30:09] [V] [TRT] Tactic: 7 time 0.01794 [03/13/2022-08:30:09] [V] [TRT] Tactic: 8 time 0.015056 [03/13/2022-08:30:09] [V] [TRT] Tactic: 9 time 0.014492 [03/13/2022-08:30:09] [V] [TRT] Tactic: 28 time 0.030548 [03/13/2022-08:30:09] [V] [TRT] Fastest Tactic: 9 Time: 0.014492 [03/13/2022-08:30:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:30:09] [V] [TRT] [03/13/2022-08:30:09] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800:2,192000) *************** [03/13/2022-08:30:09] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_64, Mul_65) (PointWise) [03/13/2022-08:30:09] [V] [TRT] Tactic: 128 time 0.048972 [03/13/2022-08:30:09] [V] [TRT] Tactic: 256 time 0.042224 [03/13/2022-08:30:09] [V] [TRT] Tactic: 512 time 0.042632 [03/13/2022-08:30:09] [V] [TRT] Tactic: -32 time 0.069808 [03/13/2022-08:30:09] [V] [TRT] Tactic: -64 time 0.049044 [03/13/2022-08:30:09] [V] [TRT] Tactic: -128 time 0.046952 [03/13/2022-08:30:09] [V] [TRT] Fastest Tactic: 256 Time: 0.042224 [03/13/2022-08:30:09] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_64, Mul_65) (PointWiseV2) [03/13/2022-08:30:09] [V] [TRT] Tactic: 0 time 0.0222 [03/13/2022-08:30:09] [V] [TRT] Tactic: 1 time 0.0192 [03/13/2022-08:30:09] [V] [TRT] Tactic: 2 time 0.019772 [03/13/2022-08:30:09] [V] [TRT] Tactic: 3 time 0.018824 [03/13/2022-08:30:09] [V] [TRT] Tactic: 4 time 0.019632 [03/13/2022-08:30:09] [V] [TRT] Tactic: 5 time 0.020384 [03/13/2022-08:30:09] [V] [TRT] Tactic: 6 time 0.019236 [03/13/2022-08:30:09] [V] [TRT] Tactic: 7 time 0.019396 [03/13/2022-08:30:09] [V] [TRT] Tactic: 8 time 0.020252 [03/13/2022-08:30:09] [V] [TRT] Tactic: 9 time 0.02396 [03/13/2022-08:30:09] [V] [TRT] Tactic: 10 time 0.031284 [03/13/2022-08:30:09] [V] [TRT] Tactic: 11 time 0.025668 [03/13/2022-08:30:09] [V] [TRT] Tactic: 12 time 0.02296 [03/13/2022-08:30:09] [V] [TRT] Tactic: 13 time 0.023452 [03/13/2022-08:30:09] [V] [TRT] Tactic: 14 time 0.018728 [03/13/2022-08:30:09] [V] [TRT] Tactic: 15 time 0.017128 [03/13/2022-08:30:09] [V] [TRT] Tactic: 16 time 0.024412 [03/13/2022-08:30:09] [V] [TRT] Tactic: 17 time 0.018372 [03/13/2022-08:30:09] [V] [TRT] Tactic: 18 time 0.01544 [03/13/2022-08:30:09] [V] [TRT] Tactic: 19 time 0.01586 [03/13/2022-08:30:09] [V] [TRT] Tactic: 28 time 0.022152 [03/13/2022-08:30:09] [V] [TRT] Tactic: 29 time 0.031416 [03/13/2022-08:30:09] [V] [TRT] Fastest Tactic: 18 Time: 0.01544 [03/13/2022-08:30:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:30:09] [V] [TRT] [03/13/2022-08:30:09] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Half(10,800,1:8,48000) *************** [03/13/2022-08:30:09] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_64, Mul_65) (PointWise) [03/13/2022-08:30:09] [V] [TRT] Tactic: 128 time 0.04894 [03/13/2022-08:30:09] [V] [TRT] Tactic: 256 time 0.042488 [03/13/2022-08:30:09] [V] [TRT] Tactic: 512 time 0.04252 [03/13/2022-08:30:09] [V] [TRT] Tactic: -32 time 0.070008 [03/13/2022-08:30:09] [V] [TRT] Tactic: -64 time 0.04916 [03/13/2022-08:30:09] [V] [TRT] Tactic: -128 time 0.046912 [03/13/2022-08:30:09] [V] [TRT] Fastest Tactic: 256 Time: 0.042488 [03/13/2022-08:30:09] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_64, Mul_65) (PointWiseV2) [03/13/2022-08:30:09] [V] [TRT] Tactic: 0 time 0.01564 [03/13/2022-08:30:09] [V] [TRT] Tactic: 1 time 0.015432 [03/13/2022-08:30:09] [V] [TRT] Tactic: 2 time 0.019064 [03/13/2022-08:30:09] [V] [TRT] Tactic: 3 time 0.016236 [03/13/2022-08:30:09] [V] [TRT] Tactic: 4 time 0.020828 [03/13/2022-08:30:09] [V] [TRT] Tactic: 5 time 0.028056 [03/13/2022-08:30:09] [V] [TRT] Tactic: 6 time 0.01836 [03/13/2022-08:30:09] [V] [TRT] Tactic: 7 time 0.020368 [03/13/2022-08:30:09] [V] [TRT] Tactic: 8 time 0.028112 [03/13/2022-08:30:09] [V] [TRT] Tactic: 9 time 0.036688 [03/13/2022-08:30:09] [V] [TRT] Tactic: 10 time 0.017652 [03/13/2022-08:30:09] [V] [TRT] Tactic: 11 time 0.016048 [03/13/2022-08:30:09] [V] [TRT] Tactic: 12 time 0.017444 [03/13/2022-08:30:09] [V] [TRT] Tactic: 13 time 0.01566 [03/13/2022-08:30:09] [V] [TRT] Tactic: 14 time 0.01672 [03/13/2022-08:30:09] [V] [TRT] Tactic: 15 time 0.021468 [03/13/2022-08:30:09] [V] [TRT] Tactic: 16 time 0.015352 [03/13/2022-08:30:09] [V] [TRT] Tactic: 17 time 0.0176 [03/13/2022-08:30:09] [V] [TRT] Tactic: 18 time 0.02246 [03/13/2022-08:30:09] [V] [TRT] Tactic: 19 time 0.028828 [03/13/2022-08:30:09] [V] [TRT] Tactic: 20 time 0.02262 [03/13/2022-08:30:09] [V] [TRT] Tactic: 21 time 0.018908 [03/13/2022-08:30:09] [V] [TRT] Tactic: 22 time 0.01912 [03/13/2022-08:30:09] [V] [TRT] Tactic: 23 time 0.019188 [03/13/2022-08:30:09] [V] [TRT] Tactic: 24 time 0.031488 [03/13/2022-08:30:09] [V] [TRT] Tactic: 25 time 0.026188 [03/13/2022-08:30:09] [V] [TRT] Tactic: 26 time 0.023516 [03/13/2022-08:30:09] [V] [TRT] Tactic: 27 time 0.024236 [03/13/2022-08:30:09] [V] [TRT] Tactic: 28 time 0.016004 [03/13/2022-08:30:09] [V] [TRT] Tactic: 29 time 0.017292 [03/13/2022-08:30:09] [V] [TRT] Tactic: 30 time 0.022704 [03/13/2022-08:30:09] [V] [TRT] Tactic: 31 time 0.031416 [03/13/2022-08:30:09] [V] [TRT] Fastest Tactic: 16 Time: 0.015352 [03/13/2022-08:30:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 16 [03/13/2022-08:30:09] [V] [TRT] [03/13/2022-08:30:09] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,384000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:30:09] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,384000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:30:09] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800:2,192000) *************** [03/13/2022-08:30:09] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:30:09] [V] [TRT] --------------- Timing Runner: Conv_66 (FusedConvActConvolution) [03/13/2022-08:30:09] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:09] [V] [TRT] --------------- Timing Runner: Conv_66 (CaskConvolution) [03/13/2022-08:30:09] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:09] [V] [TRT] --------------- Timing Runner: Conv_66 (CudaConvolution) [03/13/2022-08:30:09] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:09] [V] [TRT] --------------- Timing Runner: Conv_66 (CudaDepthwiseConvolution) [03/13/2022-08:30:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:09] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Half(10,800,1:8,48000) *************** [03/13/2022-08:30:09] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,384000), Float(1,80,4800,384000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:30:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_68, Mul_69), Add_70) (PointWise) [03/13/2022-08:30:09] [V] [TRT] Tactic: 128 time 0.054872 [03/13/2022-08:30:09] [V] [TRT] Tactic: 256 time 0.056256 [03/13/2022-08:30:09] [V] [TRT] Tactic: 512 time 0.063008 [03/13/2022-08:30:09] [V] [TRT] Tactic: -32 time 0.09492 [03/13/2022-08:30:09] [V] [TRT] Tactic: -64 time 0.064468 [03/13/2022-08:30:09] [V] [TRT] Tactic: -128 time 0.0609 [03/13/2022-08:30:09] [V] [TRT] Fastest Tactic: 128 Time: 0.054872 [03/13/2022-08:30:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_68, Mul_69), Add_70) (PointWiseV2) [03/13/2022-08:30:09] [V] [TRT] Tactic: 0 time 0.034656 [03/13/2022-08:30:09] [V] [TRT] Tactic: 1 time 0.03236 [03/13/2022-08:30:09] [V] [TRT] Tactic: 2 time 0.03198 [03/13/2022-08:30:09] [V] [TRT] Tactic: 3 time 0.031792 [03/13/2022-08:30:09] [V] [TRT] Tactic: 4 time 0.031308 [03/13/2022-08:30:09] [V] [TRT] Tactic: 5 time 0.031908 [03/13/2022-08:30:09] [V] [TRT] Tactic: 6 time 0.032752 [03/13/2022-08:30:09] [V] [TRT] Tactic: 7 time 0.031896 [03/13/2022-08:30:09] [V] [TRT] Tactic: 8 time 0.032144 [03/13/2022-08:30:09] [V] [TRT] Tactic: 9 time 0.032048 [03/13/2022-08:30:09] [V] [TRT] Tactic: 28 time 0.034432 [03/13/2022-08:30:09] [V] [TRT] Fastest Tactic: 4 Time: 0.031308 [03/13/2022-08:30:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [03/13/2022-08:30:09] [V] [TRT] [03/13/2022-08:30:09] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,14400), Float(1,80,4800:32,14400) -> Float(1,80,4800:32,14400) *************** [03/13/2022-08:30:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_68, Mul_69), Add_70) (PointWise) [03/13/2022-08:30:09] [V] [TRT] Tactic: 128 time 0.079652 [03/13/2022-08:30:09] [V] [TRT] Tactic: 256 time 0.082436 [03/13/2022-08:30:09] [V] [TRT] Tactic: 512 time 0.089896 [03/13/2022-08:30:09] [V] [TRT] Tactic: -32 time 0.12946 [03/13/2022-08:30:09] [V] [TRT] Tactic: -64 time 0.079788 [03/13/2022-08:30:09] [V] [TRT] Tactic: -128 time 0.0737 [03/13/2022-08:30:09] [V] [TRT] Fastest Tactic: -128 Time: 0.0737 [03/13/2022-08:30:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_68, Mul_69), Add_70) (PointWiseV2) [03/13/2022-08:30:09] [V] [TRT] Tactic: 24 time 0.05158 [03/13/2022-08:30:09] [V] [TRT] Tactic: 25 time 0.051268 [03/13/2022-08:30:09] [V] [TRT] Tactic: 26 time 0.051992 [03/13/2022-08:30:09] [V] [TRT] Tactic: 27 time 0.05354 [03/13/2022-08:30:09] [V] [TRT] Tactic: 31 time 0.051484 [03/13/2022-08:30:09] [V] [TRT] Fastest Tactic: 25 Time: 0.051268 [03/13/2022-08:30:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [03/13/2022-08:30:09] [V] [TRT] [03/13/2022-08:30:09] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,384000), Half(1,80,4800,384000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:30:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_68, Mul_69), Add_70) (PointWise) [03/13/2022-08:30:09] [V] [TRT] Tactic: 128 time 0.05946 [03/13/2022-08:30:09] [V] [TRT] Tactic: 256 time 0.054392 [03/13/2022-08:30:09] [V] [TRT] Tactic: 512 time 0.05576 [03/13/2022-08:30:09] [V] [TRT] Tactic: -32 time 0.09868 [03/13/2022-08:30:09] [V] [TRT] Tactic: -64 time 0.065232 [03/13/2022-08:30:09] [V] [TRT] Tactic: -128 time 0.06256 [03/13/2022-08:30:09] [V] [TRT] Fastest Tactic: 256 Time: 0.054392 [03/13/2022-08:30:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_68, Mul_69), Add_70) (PointWiseV2) [03/13/2022-08:30:09] [V] [TRT] Tactic: 0 time 0.032532 [03/13/2022-08:30:09] [V] [TRT] Tactic: 1 time 0.027236 [03/13/2022-08:30:09] [V] [TRT] Tactic: 2 time 0.022912 [03/13/2022-08:30:09] [V] [TRT] Tactic: 3 time 0.024684 [03/13/2022-08:30:09] [V] [TRT] Tactic: 4 time 0.020716 [03/13/2022-08:30:09] [V] [TRT] Tactic: 5 time 0.019136 [03/13/2022-08:30:09] [V] [TRT] Tactic: 6 time 0.02634 [03/13/2022-08:30:09] [V] [TRT] Tactic: 7 time 0.020724 [03/13/2022-08:30:09] [V] [TRT] Tactic: 8 time 0.018984 [03/13/2022-08:30:09] [V] [TRT] Tactic: 9 time 0.019092 [03/13/2022-08:30:09] [V] [TRT] Tactic: 28 time 0.03228 [03/13/2022-08:30:09] [V] [TRT] Fastest Tactic: 8 Time: 0.018984 [03/13/2022-08:30:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:30:09] [V] [TRT] [03/13/2022-08:30:09] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000), Half(1,80,4800:2,192000) -> Half(1,80,4800:2,192000) *************** [03/13/2022-08:30:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_68, Mul_69), Add_70) (PointWise) [03/13/2022-08:30:09] [V] [TRT] Tactic: 128 time 0.059596 [03/13/2022-08:30:09] [V] [TRT] Tactic: 256 time 0.054476 [03/13/2022-08:30:09] [V] [TRT] Tactic: 512 time 0.0558 [03/13/2022-08:30:09] [V] [TRT] Tactic: -32 time 0.098712 [03/13/2022-08:30:09] [V] [TRT] Tactic: -64 time 0.065552 [03/13/2022-08:30:09] [V] [TRT] Tactic: -128 time 0.062216 [03/13/2022-08:30:09] [V] [TRT] Fastest Tactic: 256 Time: 0.054476 [03/13/2022-08:30:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_68, Mul_69), Add_70) (PointWiseV2) [03/13/2022-08:30:09] [V] [TRT] Tactic: 0 time 0.024396 [03/13/2022-08:30:09] [V] [TRT] Tactic: 1 time 0.022396 [03/13/2022-08:30:09] [V] [TRT] Tactic: 2 time 0.023192 [03/13/2022-08:30:09] [V] [TRT] Tactic: 3 time 0.02242 [03/13/2022-08:30:09] [V] [TRT] Tactic: 4 time 0.0231 [03/13/2022-08:30:09] [V] [TRT] Tactic: 5 time 0.0277 [03/13/2022-08:30:09] [V] [TRT] Tactic: 6 time 0.02272 [03/13/2022-08:30:09] [V] [TRT] Tactic: 7 time 0.023772 [03/13/2022-08:30:09] [V] [TRT] Tactic: 8 time 0.031952 [03/13/2022-08:30:09] [V] [TRT] Tactic: 9 time 0.042464 [03/13/2022-08:30:09] [V] [TRT] Tactic: 10 time 0.033728 [03/13/2022-08:30:09] [V] [TRT] Tactic: 11 time 0.028832 [03/13/2022-08:30:09] [V] [TRT] Tactic: 12 time 0.023932 [03/13/2022-08:30:09] [V] [TRT] Tactic: 13 time 0.026608 [03/13/2022-08:30:10] [V] [TRT] Tactic: 14 time 0.022088 [03/13/2022-08:30:10] [V] [TRT] Tactic: 15 time 0.020376 [03/13/2022-08:30:10] [V] [TRT] Tactic: 16 time 0.027384 [03/13/2022-08:30:10] [V] [TRT] Tactic: 17 time 0.022452 [03/13/2022-08:30:10] [V] [TRT] Tactic: 18 time 0.019868 [03/13/2022-08:30:10] [V] [TRT] Tactic: 19 time 0.019388 [03/13/2022-08:30:10] [V] [TRT] Tactic: 28 time 0.024592 [03/13/2022-08:30:10] [V] [TRT] Tactic: 29 time 0.033356 [03/13/2022-08:30:10] [V] [TRT] Fastest Tactic: 19 Time: 0.019388 [03/13/2022-08:30:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 19 [03/13/2022-08:30:10] [V] [TRT] [03/13/2022-08:30:10] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000), Half(10,800,1:8,48000) -> Half(10,800,1:8,48000) *************** [03/13/2022-08:30:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_68, Mul_69), Add_70) (PointWise) [03/13/2022-08:30:10] [V] [TRT] Tactic: 128 time 0.059516 [03/13/2022-08:30:10] [V] [TRT] Tactic: 256 time 0.054292 [03/13/2022-08:30:10] [V] [TRT] Tactic: 512 time 0.055372 [03/13/2022-08:30:10] [V] [TRT] Tactic: -32 time 0.09872 [03/13/2022-08:30:10] [V] [TRT] Tactic: -64 time 0.066432 [03/13/2022-08:30:10] [V] [TRT] Tactic: -128 time 0.061976 [03/13/2022-08:30:10] [V] [TRT] Fastest Tactic: 256 Time: 0.054292 [03/13/2022-08:30:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_68, Mul_69), Add_70) (PointWiseV2) [03/13/2022-08:30:10] [V] [TRT] Tactic: 0 time 0.024852 [03/13/2022-08:30:10] [V] [TRT] Tactic: 1 time 0.0258 [03/13/2022-08:30:10] [V] [TRT] Tactic: 2 time 0.034488 [03/13/2022-08:30:10] [V] [TRT] Tactic: 3 time 0.026628 [03/13/2022-08:30:10] [V] [TRT] Tactic: 4 time 0.033104 [03/13/2022-08:30:10] [V] [TRT] Tactic: 5 time 0.04362 [03/13/2022-08:30:10] [V] [TRT] Tactic: 6 time 0.023212 [03/13/2022-08:30:10] [V] [TRT] Tactic: 7 time 0.031344 [03/13/2022-08:30:10] [V] [TRT] Tactic: 8 time 0.041828 [03/13/2022-08:30:10] [V] [TRT] Tactic: 9 time 0.054896 [03/13/2022-08:30:10] [V] [TRT] Tactic: 10 time 0.02332 [03/13/2022-08:30:10] [V] [TRT] Tactic: 11 time 0.02122 [03/13/2022-08:30:10] [V] [TRT] Tactic: 12 time 0.027004 [03/13/2022-08:30:10] [V] [TRT] Tactic: 13 time 0.021256 [03/13/2022-08:30:10] [V] [TRT] Tactic: 14 time 0.02818 [03/13/2022-08:30:10] [V] [TRT] Tactic: 15 time 0.037976 [03/13/2022-08:30:10] [V] [TRT] Tactic: 16 time 0.020572 [03/13/2022-08:30:10] [V] [TRT] Tactic: 17 time 0.028544 [03/13/2022-08:30:10] [V] [TRT] Tactic: 18 time 0.035716 [03/13/2022-08:30:10] [V] [TRT] Tactic: 19 time 0.04554 [03/13/2022-08:30:10] [V] [TRT] Tactic: 20 time 0.02516 [03/13/2022-08:30:10] [V] [TRT] Tactic: 21 time 0.023204 [03/13/2022-08:30:10] [V] [TRT] Tactic: 22 time 0.022828 [03/13/2022-08:30:10] [V] [TRT] Tactic: 23 time 0.022932 [03/13/2022-08:30:10] [V] [TRT] Tactic: 24 time 0.03336 [03/13/2022-08:30:10] [V] [TRT] Tactic: 25 time 0.028992 [03/13/2022-08:30:10] [V] [TRT] Tactic: 26 time 0.026548 [03/13/2022-08:30:10] [V] [TRT] Tactic: 27 time 0.027668 [03/13/2022-08:30:10] [V] [TRT] Tactic: 28 time 0.025384 [03/13/2022-08:30:10] [V] [TRT] Tactic: 29 time 0.022812 [03/13/2022-08:30:10] [V] [TRT] Tactic: 30 time 0.024864 [03/13/2022-08:30:10] [V] [TRT] Tactic: 31 time 0.032964 [03/13/2022-08:30:10] [V] [TRT] Fastest Tactic: 16 Time: 0.020572 [03/13/2022-08:30:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 16 [03/13/2022-08:30:10] [V] [TRT] [03/13/2022-08:30:10] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,384000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:30:10] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,384000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:30:10] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:30:10] [V] [TRT] --------------- Timing Runner: Conv_71 (FusedConvActConvolution) [03/13/2022-08:30:10] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:10] [V] [TRT] --------------- Timing Runner: Conv_71 (CaskConvolution) [03/13/2022-08:30:10] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:10] [V] [TRT] --------------- Timing Runner: Conv_71 (CudaConvolution) [03/13/2022-08:30:10] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:10] [V] [TRT] --------------- Timing Runner: Conv_71 (CudaDepthwiseConvolution) [03/13/2022-08:30:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:10] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800:2,192000) *************** [03/13/2022-08:30:10] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:30:10] [V] [TRT] --------------- Timing Runner: Conv_71 (FusedConvActConvolution) [03/13/2022-08:30:10] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:10] [V] [TRT] --------------- Timing Runner: Conv_71 (CaskConvolution) [03/13/2022-08:30:10] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:10] [V] [TRT] --------------- Timing Runner: Conv_71 (CudaConvolution) [03/13/2022-08:30:10] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:10] [V] [TRT] --------------- Timing Runner: Conv_71 (CudaDepthwiseConvolution) [03/13/2022-08:30:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:10] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Half(10,800,1:8,48000) *************** [03/13/2022-08:30:10] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,384000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:30:10] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_73, Mul_74) (PointWise) [03/13/2022-08:30:10] [V] [TRT] Tactic: 128 time 0.045596 [03/13/2022-08:30:10] [V] [TRT] Tactic: 256 time 0.04666 [03/13/2022-08:30:10] [V] [TRT] Tactic: 512 time 0.051764 [03/13/2022-08:30:10] [V] [TRT] Tactic: -32 time 0.077548 [03/13/2022-08:30:10] [V] [TRT] Tactic: -64 time 0.051224 [03/13/2022-08:30:10] [V] [TRT] Tactic: -128 time 0.048764 [03/13/2022-08:30:10] [V] [TRT] Fastest Tactic: 128 Time: 0.045596 [03/13/2022-08:30:10] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_73, Mul_74) (PointWiseV2) [03/13/2022-08:30:10] [V] [TRT] Tactic: 0 time 0.03258 [03/13/2022-08:30:10] [V] [TRT] Tactic: 1 time 0.027 [03/13/2022-08:30:10] [V] [TRT] Tactic: 2 time 0.023244 [03/13/2022-08:30:10] [V] [TRT] Tactic: 3 time 0.02598 [03/13/2022-08:30:10] [V] [TRT] Tactic: 4 time 0.023084 [03/13/2022-08:30:10] [V] [TRT] Tactic: 5 time 0.022076 [03/13/2022-08:30:10] [V] [TRT] Tactic: 6 time 0.027116 [03/13/2022-08:30:10] [V] [TRT] Tactic: 7 time 0.023208 [03/13/2022-08:30:10] [V] [TRT] Tactic: 8 time 0.022972 [03/13/2022-08:30:10] [V] [TRT] Tactic: 9 time 0.023028 [03/13/2022-08:30:10] [V] [TRT] Tactic: 28 time 0.032096 [03/13/2022-08:30:10] [V] [TRT] Fastest Tactic: 5 Time: 0.022076 [03/13/2022-08:30:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [03/13/2022-08:30:10] [V] [TRT] [03/13/2022-08:30:10] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,14400) -> Float(1,80,4800:32,14400) *************** [03/13/2022-08:30:10] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_73, Mul_74) (PointWise) [03/13/2022-08:30:10] [V] [TRT] Tactic: 128 time 0.0698 [03/13/2022-08:30:10] [V] [TRT] Tactic: 256 time 0.070356 [03/13/2022-08:30:10] [V] [TRT] Tactic: 512 time 0.077988 [03/13/2022-08:30:10] [V] [TRT] Tactic: -32 time 0.106188 [03/13/2022-08:30:10] [V] [TRT] Tactic: -64 time 0.064616 [03/13/2022-08:30:10] [V] [TRT] Tactic: -128 time 0.059352 [03/13/2022-08:30:10] [V] [TRT] Fastest Tactic: -128 Time: 0.059352 [03/13/2022-08:30:10] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_73, Mul_74) (PointWiseV2) [03/13/2022-08:30:10] [V] [TRT] Tactic: 24 time 0.03032 [03/13/2022-08:30:10] [V] [TRT] Tactic: 25 time 0.031244 [03/13/2022-08:30:10] [V] [TRT] Tactic: 26 time 0.032512 [03/13/2022-08:30:10] [V] [TRT] Tactic: 27 time 0.033352 [03/13/2022-08:30:10] [V] [TRT] Tactic: 31 time 0.030652 [03/13/2022-08:30:10] [V] [TRT] Fastest Tactic: 24 Time: 0.03032 [03/13/2022-08:30:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [03/13/2022-08:30:10] [V] [TRT] [03/13/2022-08:30:10] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,384000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:30:10] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_73, Mul_74) (PointWise) [03/13/2022-08:30:10] [V] [TRT] Tactic: 128 time 0.049012 [03/13/2022-08:30:10] [V] [TRT] Tactic: 256 time 0.042308 [03/13/2022-08:30:10] [V] [TRT] Tactic: 512 time 0.0425 [03/13/2022-08:30:10] [V] [TRT] Tactic: -32 time 0.070136 [03/13/2022-08:30:10] [V] [TRT] Tactic: -64 time 0.049056 [03/13/2022-08:30:10] [V] [TRT] Tactic: -128 time 0.04694 [03/13/2022-08:30:10] [V] [TRT] Fastest Tactic: 256 Time: 0.042308 [03/13/2022-08:30:10] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_73, Mul_74) (PointWiseV2) [03/13/2022-08:30:10] [V] [TRT] Tactic: 0 time 0.030564 [03/13/2022-08:30:10] [V] [TRT] Tactic: 1 time 0.025136 [03/13/2022-08:30:10] [V] [TRT] Tactic: 2 time 0.021868 [03/13/2022-08:30:10] [V] [TRT] Tactic: 3 time 0.023136 [03/13/2022-08:30:10] [V] [TRT] Tactic: 4 time 0.018152 [03/13/2022-08:30:10] [V] [TRT] Tactic: 5 time 0.01632 [03/13/2022-08:30:10] [V] [TRT] Tactic: 6 time 0.02442 [03/13/2022-08:30:10] [V] [TRT] Tactic: 7 time 0.017996 [03/13/2022-08:30:10] [V] [TRT] Tactic: 8 time 0.015288 [03/13/2022-08:30:10] [V] [TRT] Tactic: 9 time 0.014548 [03/13/2022-08:30:10] [V] [TRT] Tactic: 28 time 0.030368 [03/13/2022-08:30:10] [V] [TRT] Fastest Tactic: 9 Time: 0.014548 [03/13/2022-08:30:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:30:10] [V] [TRT] [03/13/2022-08:30:10] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800:2,192000) *************** [03/13/2022-08:30:10] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_73, Mul_74) (PointWise) [03/13/2022-08:30:10] [V] [TRT] Tactic: 128 time 0.048804 [03/13/2022-08:30:10] [V] [TRT] Tactic: 256 time 0.0427 [03/13/2022-08:30:10] [V] [TRT] Tactic: 512 time 0.042524 [03/13/2022-08:30:10] [V] [TRT] Tactic: -32 time 0.070588 [03/13/2022-08:30:10] [V] [TRT] Tactic: -64 time 0.04894 [03/13/2022-08:30:10] [V] [TRT] Tactic: -128 time 0.04694 [03/13/2022-08:30:10] [V] [TRT] Fastest Tactic: 512 Time: 0.042524 [03/13/2022-08:30:10] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_73, Mul_74) (PointWiseV2) [03/13/2022-08:30:10] [V] [TRT] Tactic: 0 time 0.021908 [03/13/2022-08:30:10] [V] [TRT] Tactic: 1 time 0.019072 [03/13/2022-08:30:10] [V] [TRT] Tactic: 2 time 0.019868 [03/13/2022-08:30:10] [V] [TRT] Tactic: 3 time 0.019376 [03/13/2022-08:30:10] [V] [TRT] Tactic: 4 time 0.019724 [03/13/2022-08:30:10] [V] [TRT] Tactic: 5 time 0.02096 [03/13/2022-08:30:10] [V] [TRT] Tactic: 6 time 0.018872 [03/13/2022-08:30:10] [V] [TRT] Tactic: 7 time 0.019232 [03/13/2022-08:30:10] [V] [TRT] Tactic: 8 time 0.020768 [03/13/2022-08:30:10] [V] [TRT] Tactic: 9 time 0.023936 [03/13/2022-08:30:10] [V] [TRT] Tactic: 10 time 0.031336 [03/13/2022-08:30:10] [V] [TRT] Tactic: 11 time 0.02574 [03/13/2022-08:30:10] [V] [TRT] Tactic: 12 time 0.022764 [03/13/2022-08:30:10] [V] [TRT] Tactic: 13 time 0.023368 [03/13/2022-08:30:10] [V] [TRT] Tactic: 14 time 0.01864 [03/13/2022-08:30:10] [V] [TRT] Tactic: 15 time 0.017168 [03/13/2022-08:30:10] [V] [TRT] Tactic: 16 time 0.02446 [03/13/2022-08:30:10] [V] [TRT] Tactic: 17 time 0.018416 [03/13/2022-08:30:10] [V] [TRT] Tactic: 18 time 0.015028 [03/13/2022-08:30:10] [V] [TRT] Tactic: 19 time 0.016256 [03/13/2022-08:30:10] [V] [TRT] Tactic: 28 time 0.021796 [03/13/2022-08:30:10] [V] [TRT] Tactic: 29 time 0.031248 [03/13/2022-08:30:10] [V] [TRT] Fastest Tactic: 18 Time: 0.015028 [03/13/2022-08:30:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:30:10] [V] [TRT] [03/13/2022-08:30:10] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Half(10,800,1:8,48000) *************** [03/13/2022-08:30:10] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_73, Mul_74) (PointWise) [03/13/2022-08:30:10] [V] [TRT] Tactic: 128 time 0.048476 [03/13/2022-08:30:10] [V] [TRT] Tactic: 256 time 0.042292 [03/13/2022-08:30:10] [V] [TRT] Tactic: 512 time 0.04262 [03/13/2022-08:30:10] [V] [TRT] Tactic: -32 time 0.070172 [03/13/2022-08:30:10] [V] [TRT] Tactic: -64 time 0.049084 [03/13/2022-08:30:10] [V] [TRT] Tactic: -128 time 0.046972 [03/13/2022-08:30:10] [V] [TRT] Fastest Tactic: 256 Time: 0.042292 [03/13/2022-08:30:10] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_73, Mul_74) (PointWiseV2) [03/13/2022-08:30:10] [V] [TRT] Tactic: 0 time 0.015944 [03/13/2022-08:30:10] [V] [TRT] Tactic: 1 time 0.015792 [03/13/2022-08:30:10] [V] [TRT] Tactic: 2 time 0.01944 [03/13/2022-08:30:10] [V] [TRT] Tactic: 3 time 0.015788 [03/13/2022-08:30:10] [V] [TRT] Tactic: 4 time 0.02074 [03/13/2022-08:30:10] [V] [TRT] Tactic: 5 time 0.028016 [03/13/2022-08:30:10] [V] [TRT] Tactic: 6 time 0.018104 [03/13/2022-08:30:10] [V] [TRT] Tactic: 7 time 0.020192 [03/13/2022-08:30:10] [V] [TRT] Tactic: 8 time 0.028556 [03/13/2022-08:30:10] [V] [TRT] Tactic: 9 time 0.03684 [03/13/2022-08:30:10] [V] [TRT] Tactic: 10 time 0.0175 [03/13/2022-08:30:10] [V] [TRT] Tactic: 11 time 0.015692 [03/13/2022-08:30:10] [V] [TRT] Tactic: 12 time 0.017856 [03/13/2022-08:30:10] [V] [TRT] Tactic: 13 time 0.01584 [03/13/2022-08:30:10] [V] [TRT] Tactic: 14 time 0.016976 [03/13/2022-08:30:11] [V] [TRT] Tactic: 15 time 0.020988 [03/13/2022-08:30:11] [V] [TRT] Tactic: 16 time 0.015688 [03/13/2022-08:30:11] [V] [TRT] Tactic: 17 time 0.017052 [03/13/2022-08:30:11] [V] [TRT] Tactic: 18 time 0.0226 [03/13/2022-08:30:11] [V] [TRT] Tactic: 19 time 0.028896 [03/13/2022-08:30:11] [V] [TRT] Tactic: 20 time 0.022692 [03/13/2022-08:30:11] [V] [TRT] Tactic: 21 time 0.019368 [03/13/2022-08:30:11] [V] [TRT] Tactic: 22 time 0.0191 [03/13/2022-08:30:11] [V] [TRT] Tactic: 23 time 0.019308 [03/13/2022-08:30:11] [V] [TRT] Tactic: 24 time 0.031488 [03/13/2022-08:30:11] [V] [TRT] Tactic: 25 time 0.025452 [03/13/2022-08:30:11] [V] [TRT] Tactic: 26 time 0.0237 [03/13/2022-08:30:11] [V] [TRT] Tactic: 27 time 0.024376 [03/13/2022-08:30:11] [V] [TRT] Tactic: 28 time 0.01592 [03/13/2022-08:30:11] [V] [TRT] Tactic: 29 time 0.01722 [03/13/2022-08:30:11] [V] [TRT] Tactic: 30 time 0.022608 [03/13/2022-08:30:11] [V] [TRT] Tactic: 31 time 0.031536 [03/13/2022-08:30:11] [V] [TRT] Fastest Tactic: 16 Time: 0.015688 [03/13/2022-08:30:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 16 [03/13/2022-08:30:11] [V] [TRT] [03/13/2022-08:30:11] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,384000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:30:11] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,384000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:30:11] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800:2,192000) *************** [03/13/2022-08:30:11] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:30:11] [V] [TRT] --------------- Timing Runner: Conv_75 (FusedConvActConvolution) [03/13/2022-08:30:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:11] [V] [TRT] --------------- Timing Runner: Conv_75 (CaskConvolution) [03/13/2022-08:30:11] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:11] [V] [TRT] --------------- Timing Runner: Conv_75 (CudaConvolution) [03/13/2022-08:30:11] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:11] [V] [TRT] --------------- Timing Runner: Conv_75 (CudaDepthwiseConvolution) [03/13/2022-08:30:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:11] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Half(10,800,1:8,48000) *************** [03/13/2022-08:30:11] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,384000), Float(1,80,4800,384000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:30:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_77, Mul_78), Add_79) (PointWise) [03/13/2022-08:30:11] [V] [TRT] Tactic: 128 time 0.06242 [03/13/2022-08:30:11] [V] [TRT] Tactic: 256 time 0.063656 [03/13/2022-08:30:11] [V] [TRT] Tactic: 512 time 0.070552 [03/13/2022-08:30:11] [V] [TRT] Tactic: -32 time 0.095344 [03/13/2022-08:30:11] [V] [TRT] Tactic: -64 time 0.06422 [03/13/2022-08:30:11] [V] [TRT] Tactic: -128 time 0.061828 [03/13/2022-08:30:11] [V] [TRT] Fastest Tactic: -128 Time: 0.061828 [03/13/2022-08:30:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_77, Mul_78), Add_79) (PointWiseV2) [03/13/2022-08:30:11] [V] [TRT] Tactic: 0 time 0.036592 [03/13/2022-08:30:11] [V] [TRT] Tactic: 1 time 0.032668 [03/13/2022-08:30:11] [V] [TRT] Tactic: 2 time 0.031908 [03/13/2022-08:30:11] [V] [TRT] Tactic: 3 time 0.032512 [03/13/2022-08:30:11] [V] [TRT] Tactic: 4 time 0.03134 [03/13/2022-08:30:11] [V] [TRT] Tactic: 5 time 0.031744 [03/13/2022-08:30:11] [V] [TRT] Tactic: 6 time 0.0336 [03/13/2022-08:30:11] [V] [TRT] Tactic: 7 time 0.031944 [03/13/2022-08:30:11] [V] [TRT] Tactic: 8 time 0.032332 [03/13/2022-08:30:11] [V] [TRT] Tactic: 9 time 0.032144 [03/13/2022-08:30:11] [V] [TRT] Tactic: 28 time 0.03666 [03/13/2022-08:30:11] [V] [TRT] Fastest Tactic: 4 Time: 0.03134 [03/13/2022-08:30:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [03/13/2022-08:30:11] [V] [TRT] [03/13/2022-08:30:11] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,14400), Float(1,80,4800:32,14400) -> Float(1,80,4800:32,24000) *************** [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_77, Mul_78), Add_79) (PointWise) [03/13/2022-08:30:12] [V] [TRT] Tactic: 128 time 0.079684 [03/13/2022-08:30:12] [V] [TRT] Tactic: 256 time 0.082516 [03/13/2022-08:30:12] [V] [TRT] Tactic: 512 time 0.089976 [03/13/2022-08:30:12] [V] [TRT] Tactic: -32 time 0.12974 [03/13/2022-08:30:12] [V] [TRT] Tactic: -64 time 0.07966 [03/13/2022-08:30:12] [V] [TRT] Tactic: -128 time 0.07352 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: -128 Time: 0.07352 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_77, Mul_78), Add_79) (PointWiseV2) [03/13/2022-08:30:12] [V] [TRT] Tactic: 24 time 0.051588 [03/13/2022-08:30:12] [V] [TRT] Tactic: 25 time 0.051388 [03/13/2022-08:30:12] [V] [TRT] Tactic: 26 time 0.051976 [03/13/2022-08:30:12] [V] [TRT] Tactic: 27 time 0.053756 [03/13/2022-08:30:12] [V] [TRT] Tactic: 31 time 0.051528 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 25 Time: 0.051388 [03/13/2022-08:30:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [03/13/2022-08:30:12] [V] [TRT] [03/13/2022-08:30:12] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,384000), Half(1,80,4800,384000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_77, Mul_78), Add_79) (PointWise) [03/13/2022-08:30:12] [V] [TRT] Tactic: 128 time 0.063332 [03/13/2022-08:30:12] [V] [TRT] Tactic: 256 time 0.056976 [03/13/2022-08:30:12] [V] [TRT] Tactic: 512 time 0.058112 [03/13/2022-08:30:12] [V] [TRT] Tactic: -32 time 0.099112 [03/13/2022-08:30:12] [V] [TRT] Tactic: -64 time 0.066212 [03/13/2022-08:30:12] [V] [TRT] Tactic: -128 time 0.063504 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 256 Time: 0.056976 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_77, Mul_78), Add_79) (PointWiseV2) [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.034884 [03/13/2022-08:30:12] [V] [TRT] Tactic: 1 time 0.028788 [03/13/2022-08:30:12] [V] [TRT] Tactic: 2 time 0.0244 [03/13/2022-08:30:12] [V] [TRT] Tactic: 3 time 0.025796 [03/13/2022-08:30:12] [V] [TRT] Tactic: 4 time 0.021748 [03/13/2022-08:30:12] [V] [TRT] Tactic: 5 time 0.019372 [03/13/2022-08:30:12] [V] [TRT] Tactic: 6 time 0.02692 [03/13/2022-08:30:12] [V] [TRT] Tactic: 7 time 0.021368 [03/13/2022-08:30:12] [V] [TRT] Tactic: 8 time 0.019088 [03/13/2022-08:30:12] [V] [TRT] Tactic: 9 time 0.01914 [03/13/2022-08:30:12] [V] [TRT] Tactic: 28 time 0.034812 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 8 Time: 0.019088 [03/13/2022-08:30:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:30:12] [V] [TRT] [03/13/2022-08:30:12] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000), Half(1,80,4800:2,192000) -> Half(1,80,4800:2,384000) *************** [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_77, Mul_78), Add_79) (PointWise) [03/13/2022-08:30:12] [V] [TRT] Tactic: 128 time 0.064072 [03/13/2022-08:30:12] [V] [TRT] Tactic: 256 time 0.05712 [03/13/2022-08:30:12] [V] [TRT] Tactic: 512 time 0.058028 [03/13/2022-08:30:12] [V] [TRT] Tactic: -32 time 0.099388 [03/13/2022-08:30:12] [V] [TRT] Tactic: -64 time 0.066376 [03/13/2022-08:30:12] [V] [TRT] Tactic: -128 time 0.063696 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 256 Time: 0.05712 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_77, Mul_78), Add_79) (PointWiseV2) [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.025932 [03/13/2022-08:30:12] [V] [TRT] Tactic: 1 time 0.023072 [03/13/2022-08:30:12] [V] [TRT] Tactic: 2 time 0.02376 [03/13/2022-08:30:12] [V] [TRT] Tactic: 3 time 0.02256 [03/13/2022-08:30:12] [V] [TRT] Tactic: 4 time 0.023452 [03/13/2022-08:30:12] [V] [TRT] Tactic: 5 time 0.027724 [03/13/2022-08:30:12] [V] [TRT] Tactic: 6 time 0.022564 [03/13/2022-08:30:12] [V] [TRT] Tactic: 7 time 0.02396 [03/13/2022-08:30:12] [V] [TRT] Tactic: 8 time 0.032128 [03/13/2022-08:30:12] [V] [TRT] Tactic: 9 time 0.042496 [03/13/2022-08:30:12] [V] [TRT] Tactic: 10 time 0.03632 [03/13/2022-08:30:12] [V] [TRT] Tactic: 11 time 0.030636 [03/13/2022-08:30:12] [V] [TRT] Tactic: 12 time 0.025376 [03/13/2022-08:30:12] [V] [TRT] Tactic: 13 time 0.02738 [03/13/2022-08:30:12] [V] [TRT] Tactic: 14 time 0.023128 [03/13/2022-08:30:12] [V] [TRT] Tactic: 15 time 0.020796 [03/13/2022-08:30:12] [V] [TRT] Tactic: 16 time 0.028316 [03/13/2022-08:30:12] [V] [TRT] Tactic: 17 time 0.022572 [03/13/2022-08:30:12] [V] [TRT] Tactic: 18 time 0.020276 [03/13/2022-08:30:12] [V] [TRT] Tactic: 19 time 0.019856 [03/13/2022-08:30:12] [V] [TRT] Tactic: 28 time 0.025584 [03/13/2022-08:30:12] [V] [TRT] Tactic: 29 time 0.0364 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 19 Time: 0.019856 [03/13/2022-08:30:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 19 [03/13/2022-08:30:12] [V] [TRT] [03/13/2022-08:30:12] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000), Half(10,800,1:8,48000) -> Half(20,1600,1:8,96000) *************** [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_77, Mul_78), Add_79) (PointWise) [03/13/2022-08:30:12] [V] [TRT] Tactic: 128 time 0.063468 [03/13/2022-08:30:12] [V] [TRT] Tactic: 256 time 0.056664 [03/13/2022-08:30:12] [V] [TRT] Tactic: 512 time 0.05768 [03/13/2022-08:30:12] [V] [TRT] Tactic: -32 time 0.137792 [03/13/2022-08:30:12] [V] [TRT] Tactic: -64 time 0.10482 [03/13/2022-08:30:12] [V] [TRT] Tactic: -128 time 0.1049 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 256 Time: 0.056664 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_77, Mul_78), Add_79) (PointWiseV2) [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.043344 [03/13/2022-08:30:12] [V] [TRT] Tactic: 1 time 0.048172 [03/13/2022-08:30:12] [V] [TRT] Tactic: 2 time 0.04504 [03/13/2022-08:30:12] [V] [TRT] Tactic: 3 time 0.057812 [03/13/2022-08:30:12] [V] [TRT] Tactic: 4 time 0.052364 [03/13/2022-08:30:12] [V] [TRT] Tactic: 5 time 0.048708 [03/13/2022-08:30:12] [V] [TRT] Tactic: 6 time 0.079892 [03/13/2022-08:30:12] [V] [TRT] Tactic: 7 time 0.065356 [03/13/2022-08:30:12] [V] [TRT] Tactic: 8 time 0.05756 [03/13/2022-08:30:12] [V] [TRT] Tactic: 9 time 0.062524 [03/13/2022-08:30:12] [V] [TRT] Tactic: 10 time 0.0335 [03/13/2022-08:30:12] [V] [TRT] Tactic: 11 time 0.032728 [03/13/2022-08:30:12] [V] [TRT] Tactic: 12 time 0.034656 [03/13/2022-08:30:12] [V] [TRT] Tactic: 13 time 0.037392 [03/13/2022-08:30:12] [V] [TRT] Tactic: 14 time 0.036488 [03/13/2022-08:30:12] [V] [TRT] Tactic: 15 time 0.035404 [03/13/2022-08:30:12] [V] [TRT] Tactic: 16 time 0.049548 [03/13/2022-08:30:12] [V] [TRT] Tactic: 17 time 0.043624 [03/13/2022-08:30:12] [V] [TRT] Tactic: 18 time 0.039016 [03/13/2022-08:30:12] [V] [TRT] Tactic: 19 time 0.040768 [03/13/2022-08:30:12] [V] [TRT] Tactic: 20 time 0.038616 [03/13/2022-08:30:12] [V] [TRT] Tactic: 21 time 0.033284 [03/13/2022-08:30:12] [V] [TRT] Tactic: 22 time 0.0368 [03/13/2022-08:30:12] [V] [TRT] Tactic: 23 time 0.04368 [03/13/2022-08:30:12] [V] [TRT] Tactic: 24 time 0.043088 [03/13/2022-08:30:12] [V] [TRT] Tactic: 25 time 0.042732 [03/13/2022-08:30:12] [V] [TRT] Tactic: 26 time 0.034608 [03/13/2022-08:30:12] [V] [TRT] Tactic: 27 time 0.042924 [03/13/2022-08:30:12] [V] [TRT] Tactic: 28 time 0.028716 [03/13/2022-08:30:12] [V] [TRT] Tactic: 29 time 0.023856 [03/13/2022-08:30:12] [V] [TRT] Tactic: 30 time 0.026852 [03/13/2022-08:30:12] [V] [TRT] Tactic: 31 time 0.036948 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 29 Time: 0.023856 [03/13/2022-08:30:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 29 [03/13/2022-08:30:12] [V] [TRT] [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:12] [V] [TRT] Tactic: 1002 time 0.052776 [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.100232 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.052776 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:12] [V] [TRT] Tactic: 1002 time 0.032592 [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.032516 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 0 Time: 0.032516 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:12] [V] [TRT] Tactic: 1002 time 0.067056 [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.027584 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 0 Time: 0.027584 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:12] [V] [TRT] Tactic: 1002 time 0.053204 [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.02574 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 0 Time: 0.02574 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:12] [V] [TRT] Tactic: 1002 time 0.067192 [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.057884 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 0 Time: 0.057884 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:12] [V] [TRT] Tactic: 1002 time 0.066092 [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.056052 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 0 Time: 0.056052 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:12] [V] [TRT] Tactic: 1002 time 0.085272 [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.057592 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 0 Time: 0.057592 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:12] [V] [TRT] Tactic: 1002 time 0.063204 [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.038848 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 0 Time: 0.038848 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:12] [V] [TRT] Tactic: 1002 time 0.033552 [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.03282 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 0 Time: 0.03282 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:12] [V] [TRT] Tactic: 1002 time 0.053228 [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.099916 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.053228 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:12] [V] [TRT] Tactic: 1002 time 0.066352 [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.025944 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 0 Time: 0.025944 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:12] [V] [TRT] Tactic: 1002 time 0.05342 [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.022024 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 0 Time: 0.022024 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:12] [V] [TRT] Tactic: 1002 time 0.066388 [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.033804 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 0 Time: 0.033804 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:12] [V] [TRT] Tactic: 1002 time 0.052592 [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.094736 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.052592 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:12] [V] [TRT] Tactic: 1002 time 0.065608 [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.030424 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 0 Time: 0.030424 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:12] [V] [TRT] Tactic: 1002 time 0.052872 [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.020752 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 0 Time: 0.020752 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:12] [V] [TRT] Tactic: 1002 time 0.057912 [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.047124 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 0 Time: 0.047124 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:12] [V] [TRT] Tactic: 1002 time 0.050244 [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.151556 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.050244 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:12] [V] [TRT] Tactic: 1002 time 0.057508 [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.045624 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 0 Time: 0.045624 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:12] [V] [TRT] Tactic: 1002 time 0.06764 [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.016848 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: 0 Time: 0.016848 [03/13/2022-08:30:12] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,768000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_82, Mul_83) (PointWise) [03/13/2022-08:30:12] [V] [TRT] Tactic: 128 time 0.052848 [03/13/2022-08:30:12] [V] [TRT] Tactic: 256 time 0.053628 [03/13/2022-08:30:12] [V] [TRT] Tactic: 512 time 0.05928 [03/13/2022-08:30:12] [V] [TRT] Tactic: -32 time 0.078716 [03/13/2022-08:30:12] [V] [TRT] Tactic: -64 time 0.051832 [03/13/2022-08:30:12] [V] [TRT] Tactic: -128 time 0.049644 [03/13/2022-08:30:12] [V] [TRT] Fastest Tactic: -128 Time: 0.049644 [03/13/2022-08:30:12] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_82, Mul_83) (PointWiseV2) [03/13/2022-08:30:12] [V] [TRT] Tactic: 0 time 0.034316 [03/13/2022-08:30:12] [V] [TRT] Tactic: 1 time 0.028748 [03/13/2022-08:30:12] [V] [TRT] Tactic: 2 time 0.0239 [03/13/2022-08:30:12] [V] [TRT] Tactic: 3 time 0.02678 [03/13/2022-08:30:12] [V] [TRT] Tactic: 4 time 0.02294 [03/13/2022-08:30:13] [V] [TRT] Tactic: 5 time 0.023008 [03/13/2022-08:30:13] [V] [TRT] Tactic: 6 time 0.027888 [03/13/2022-08:30:13] [V] [TRT] Tactic: 7 time 0.024228 [03/13/2022-08:30:13] [V] [TRT] Tactic: 8 time 0.023536 [03/13/2022-08:30:13] [V] [TRT] Tactic: 9 time 0.02356 [03/13/2022-08:30:13] [V] [TRT] Tactic: 28 time 0.034276 [03/13/2022-08:30:13] [V] [TRT] Fastest Tactic: 4 Time: 0.02294 [03/13/2022-08:30:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [03/13/2022-08:30:13] [V] [TRT] [03/13/2022-08:30:13] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,24000) -> Float(1,80,4800:32,24000) *************** [03/13/2022-08:30:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_82, Mul_83) (PointWise) [03/13/2022-08:30:13] [V] [TRT] Tactic: 128 time 0.069148 [03/13/2022-08:30:13] [V] [TRT] Tactic: 256 time 0.070024 [03/13/2022-08:30:13] [V] [TRT] Tactic: 512 time 0.07778 [03/13/2022-08:30:13] [V] [TRT] Tactic: -32 time 0.105492 [03/13/2022-08:30:13] [V] [TRT] Tactic: -64 time 0.064324 [03/13/2022-08:30:13] [V] [TRT] Tactic: -128 time 0.059208 [03/13/2022-08:30:13] [V] [TRT] Fastest Tactic: -128 Time: 0.059208 [03/13/2022-08:30:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_82, Mul_83) (PointWiseV2) [03/13/2022-08:30:13] [V] [TRT] Tactic: 24 time 0.030128 [03/13/2022-08:30:13] [V] [TRT] Tactic: 25 time 0.031196 [03/13/2022-08:30:13] [V] [TRT] Tactic: 26 time 0.032136 [03/13/2022-08:30:13] [V] [TRT] Tactic: 27 time 0.032272 [03/13/2022-08:30:13] [V] [TRT] Tactic: 31 time 0.030504 [03/13/2022-08:30:13] [V] [TRT] Fastest Tactic: 24 Time: 0.030128 [03/13/2022-08:30:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [03/13/2022-08:30:13] [V] [TRT] [03/13/2022-08:30:13] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,768000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:30:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_82, Mul_83) (PointWise) [03/13/2022-08:30:13] [V] [TRT] Tactic: 128 time 0.052564 [03/13/2022-08:30:13] [V] [TRT] Tactic: 256 time 0.044788 [03/13/2022-08:30:13] [V] [TRT] Tactic: 512 time 0.045188 [03/13/2022-08:30:13] [V] [TRT] Tactic: -32 time 0.069992 [03/13/2022-08:30:13] [V] [TRT] Tactic: -64 time 0.049768 [03/13/2022-08:30:13] [V] [TRT] Tactic: -128 time 0.048788 [03/13/2022-08:30:13] [V] [TRT] Fastest Tactic: 256 Time: 0.044788 [03/13/2022-08:30:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_82, Mul_83) (PointWiseV2) [03/13/2022-08:30:13] [V] [TRT] Tactic: 0 time 0.032588 [03/13/2022-08:30:13] [V] [TRT] Tactic: 1 time 0.026248 [03/13/2022-08:30:13] [V] [TRT] Tactic: 2 time 0.022728 [03/13/2022-08:30:13] [V] [TRT] Tactic: 3 time 0.0244 [03/13/2022-08:30:13] [V] [TRT] Tactic: 4 time 0.0195 [03/13/2022-08:30:13] [V] [TRT] Tactic: 5 time 0.016952 [03/13/2022-08:30:13] [V] [TRT] Tactic: 6 time 0.024776 [03/13/2022-08:30:13] [V] [TRT] Tactic: 7 time 0.018872 [03/13/2022-08:30:13] [V] [TRT] Tactic: 8 time 0.01502 [03/13/2022-08:30:14] [V] [TRT] Tactic: 9 time 0.014852 [03/13/2022-08:30:14] [V] [TRT] Tactic: 28 time 0.03262 [03/13/2022-08:30:14] [V] [TRT] Fastest Tactic: 9 Time: 0.014852 [03/13/2022-08:30:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:30:14] [V] [TRT] [03/13/2022-08:30:14] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800:2,384000) *************** [03/13/2022-08:30:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_82, Mul_83) (PointWise) [03/13/2022-08:30:14] [V] [TRT] Tactic: 128 time 0.052536 [03/13/2022-08:30:14] [V] [TRT] Tactic: 256 time 0.04412 [03/13/2022-08:30:14] [V] [TRT] Tactic: 512 time 0.044196 [03/13/2022-08:30:14] [V] [TRT] Tactic: -32 time 0.070236 [03/13/2022-08:30:14] [V] [TRT] Tactic: -64 time 0.049592 [03/13/2022-08:30:14] [V] [TRT] Tactic: -128 time 0.048564 [03/13/2022-08:30:14] [V] [TRT] Fastest Tactic: 256 Time: 0.04412 [03/13/2022-08:30:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_82, Mul_83) (PointWiseV2) [03/13/2022-08:30:14] [V] [TRT] Tactic: 0 time 0.02306 [03/13/2022-08:30:14] [V] [TRT] Tactic: 1 time 0.020148 [03/13/2022-08:30:14] [V] [TRT] Tactic: 2 time 0.020428 [03/13/2022-08:30:14] [V] [TRT] Tactic: 3 time 0.019448 [03/13/2022-08:30:14] [V] [TRT] Tactic: 4 time 0.019776 [03/13/2022-08:30:14] [V] [TRT] Tactic: 5 time 0.020388 [03/13/2022-08:30:14] [V] [TRT] Tactic: 6 time 0.01932 [03/13/2022-08:30:14] [V] [TRT] Tactic: 7 time 0.019312 [03/13/2022-08:30:14] [V] [TRT] Tactic: 8 time 0.020892 [03/13/2022-08:30:14] [V] [TRT] Tactic: 9 time 0.024188 [03/13/2022-08:30:14] [V] [TRT] Tactic: 10 time 0.034408 [03/13/2022-08:30:14] [V] [TRT] Tactic: 11 time 0.02728 [03/13/2022-08:30:14] [V] [TRT] Tactic: 12 time 0.023224 [03/13/2022-08:30:14] [V] [TRT] Tactic: 13 time 0.024492 [03/13/2022-08:30:14] [V] [TRT] Tactic: 14 time 0.01982 [03/13/2022-08:30:14] [V] [TRT] Tactic: 15 time 0.017296 [03/13/2022-08:30:14] [V] [TRT] Tactic: 16 time 0.024812 [03/13/2022-08:30:14] [V] [TRT] Tactic: 17 time 0.018916 [03/13/2022-08:30:14] [V] [TRT] Tactic: 18 time 0.015596 [03/13/2022-08:30:14] [V] [TRT] Tactic: 19 time 0.015452 [03/13/2022-08:30:14] [V] [TRT] Tactic: 28 time 0.023216 [03/13/2022-08:30:14] [V] [TRT] Tactic: 29 time 0.0335 [03/13/2022-08:30:14] [V] [TRT] Fastest Tactic: 19 Time: 0.015452 [03/13/2022-08:30:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 19 [03/13/2022-08:30:14] [V] [TRT] [03/13/2022-08:30:14] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Half(20,1600,1:8,96000) *************** [03/13/2022-08:30:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_82, Mul_83) (PointWise) [03/13/2022-08:30:14] [V] [TRT] Tactic: 128 time 0.052372 [03/13/2022-08:30:14] [V] [TRT] Tactic: 256 time 0.044108 [03/13/2022-08:30:14] [V] [TRT] Tactic: 512 time 0.043988 [03/13/2022-08:30:14] [V] [TRT] Tactic: -32 time 0.105068 [03/13/2022-08:30:14] [V] [TRT] Tactic: -64 time 0.08394 [03/13/2022-08:30:14] [V] [TRT] Tactic: -128 time 0.083868 [03/13/2022-08:30:14] [V] [TRT] Fastest Tactic: 512 Time: 0.043988 [03/13/2022-08:30:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_82, Mul_83) (PointWiseV2) [03/13/2022-08:30:14] [V] [TRT] Tactic: 0 time 0.0347 [03/13/2022-08:30:14] [V] [TRT] Tactic: 1 time 0.038696 [03/13/2022-08:30:14] [V] [TRT] Tactic: 2 time 0.037272 [03/13/2022-08:30:14] [V] [TRT] Tactic: 3 time 0.049676 [03/13/2022-08:30:14] [V] [TRT] Tactic: 4 time 0.045808 [03/13/2022-08:30:14] [V] [TRT] Tactic: 5 time 0.040208 [03/13/2022-08:30:14] [V] [TRT] Tactic: 6 time 0.074668 [03/13/2022-08:30:14] [V] [TRT] Tactic: 7 time 0.058056 [03/13/2022-08:30:14] [V] [TRT] Tactic: 8 time 0.051364 [03/13/2022-08:30:14] [V] [TRT] Tactic: 9 time 0.057992 [03/13/2022-08:30:14] [V] [TRT] Tactic: 10 time 0.026248 [03/13/2022-08:30:14] [V] [TRT] Tactic: 11 time 0.028472 [03/13/2022-08:30:14] [V] [TRT] Tactic: 12 time 0.027292 [03/13/2022-08:30:14] [V] [TRT] Tactic: 13 time 0.033528 [03/13/2022-08:30:14] [V] [TRT] Tactic: 14 time 0.032376 [03/13/2022-08:30:14] [V] [TRT] Tactic: 15 time 0.028716 [03/13/2022-08:30:14] [V] [TRT] Tactic: 16 time 0.045732 [03/13/2022-08:30:14] [V] [TRT] Tactic: 17 time 0.039884 [03/13/2022-08:30:14] [V] [TRT] Tactic: 18 time 0.03524 [03/13/2022-08:30:14] [V] [TRT] Tactic: 19 time 0.033824 [03/13/2022-08:30:14] [V] [TRT] Tactic: 20 time 0.0353 [03/13/2022-08:30:14] [V] [TRT] Tactic: 21 time 0.029208 [03/13/2022-08:30:14] [V] [TRT] Tactic: 22 time 0.032288 [03/13/2022-08:30:14] [V] [TRT] Tactic: 23 time 0.038556 [03/13/2022-08:30:14] [V] [TRT] Tactic: 24 time 0.040788 [03/13/2022-08:30:14] [V] [TRT] Tactic: 25 time 0.038184 [03/13/2022-08:30:14] [V] [TRT] Tactic: 26 time 0.03156 [03/13/2022-08:30:14] [V] [TRT] Tactic: 27 time 0.036276 [03/13/2022-08:30:14] [V] [TRT] Tactic: 28 time 0.01996 [03/13/2022-08:30:14] [V] [TRT] Tactic: 29 time 0.018304 [03/13/2022-08:30:14] [V] [TRT] Tactic: 30 time 0.024752 [03/13/2022-08:30:14] [V] [TRT] Tactic: 31 time 0.035128 [03/13/2022-08:30:14] [V] [TRT] Fastest Tactic: 29 Time: 0.018304 [03/13/2022-08:30:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 29 [03/13/2022-08:30:14] [V] [TRT] [03/13/2022-08:30:14] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:14] [V] [TRT] Tactic: 1002 time 0.063812 [03/13/2022-08:30:14] [V] [TRT] Tactic: 0 time 0.14606 [03/13/2022-08:30:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.063812 [03/13/2022-08:30:14] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,768000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:30:14] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,768000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:30:14] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:30:14] [V] [TRT] --------------- Timing Runner: Conv_85 (FusedConvActConvolution) [03/13/2022-08:30:14] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:14] [V] [TRT] --------------- Timing Runner: Conv_85 (CaskConvolution) [03/13/2022-08:30:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:14] [V] [TRT] --------------- Timing Runner: Conv_85 (CudaConvolution) [03/13/2022-08:30:14] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:14] [V] [TRT] --------------- Timing Runner: Conv_85 (CudaDepthwiseConvolution) [03/13/2022-08:30:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:14] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800:2,384000) *************** [03/13/2022-08:30:14] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:30:14] [V] [TRT] --------------- Timing Runner: Conv_85 (FusedConvActConvolution) [03/13/2022-08:30:14] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:14] [V] [TRT] --------------- Timing Runner: Conv_85 (CaskConvolution) [03/13/2022-08:30:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:14] [V] [TRT] --------------- Timing Runner: Conv_85 (CudaConvolution) [03/13/2022-08:30:14] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:14] [V] [TRT] --------------- Timing Runner: Conv_85 (CudaDepthwiseConvolution) [03/13/2022-08:30:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:14] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Half(20,1600,1:8,96000) *************** [03/13/2022-08:30:14] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,768000) -> Float(1,80,4800,1536000) *************** [03/13/2022-08:30:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_87, Mul_88) (PointWise) [03/13/2022-08:30:14] [V] [TRT] Tactic: 128 time 0.09974 [03/13/2022-08:30:14] [V] [TRT] Tactic: 256 time 0.102412 [03/13/2022-08:30:14] [V] [TRT] Tactic: 512 time 0.113324 [03/13/2022-08:30:14] [V] [TRT] Tactic: -32 time 0.14804 [03/13/2022-08:30:14] [V] [TRT] Tactic: -64 time 0.091592 [03/13/2022-08:30:14] [V] [TRT] Tactic: -128 time 0.089956 [03/13/2022-08:30:14] [V] [TRT] Fastest Tactic: -128 Time: 0.089956 [03/13/2022-08:30:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_87, Mul_88) (PointWiseV2) [03/13/2022-08:30:14] [V] [TRT] Tactic: 0 time 0.062548 [03/13/2022-08:30:14] [V] [TRT] Tactic: 1 time 0.051132 [03/13/2022-08:30:14] [V] [TRT] Tactic: 2 time 0.04226 [03/13/2022-08:30:14] [V] [TRT] Tactic: 3 time 0.046968 [03/13/2022-08:30:14] [V] [TRT] Tactic: 4 time 0.040936 [03/13/2022-08:30:14] [V] [TRT] Tactic: 5 time 0.040708 [03/13/2022-08:30:14] [V] [TRT] Tactic: 6 time 0.047252 [03/13/2022-08:30:14] [V] [TRT] Tactic: 7 time 0.04112 [03/13/2022-08:30:14] [V] [TRT] Tactic: 8 time 0.040828 [03/13/2022-08:30:14] [V] [TRT] Tactic: 9 time 0.040816 [03/13/2022-08:30:14] [V] [TRT] Tactic: 28 time 0.06368 [03/13/2022-08:30:14] [V] [TRT] Fastest Tactic: 5 Time: 0.040708 [03/13/2022-08:30:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [03/13/2022-08:30:14] [V] [TRT] [03/13/2022-08:30:14] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,24000) -> Float(1,80,4800:32,48000) *************** [03/13/2022-08:30:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_87, Mul_88) (PointWise) [03/13/2022-08:30:15] [V] [TRT] Tactic: 128 time 0.099856 [03/13/2022-08:30:15] [V] [TRT] Tactic: 256 time 0.102292 [03/13/2022-08:30:15] [V] [TRT] Tactic: 512 time 0.113008 [03/13/2022-08:30:15] [V] [TRT] Tactic: -32 time 0.145316 [03/13/2022-08:30:15] [V] [TRT] Tactic: -64 time 0.092976 [03/13/2022-08:30:15] [V] [TRT] Tactic: -128 time 0.090048 [03/13/2022-08:30:15] [V] [TRT] Fastest Tactic: -128 Time: 0.090048 [03/13/2022-08:30:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_87, Mul_88) (PointWiseV2) [03/13/2022-08:30:15] [V] [TRT] Tactic: 24 time 0.04676 [03/13/2022-08:30:15] [V] [TRT] Tactic: 25 time 0.047848 [03/13/2022-08:30:15] [V] [TRT] Tactic: 26 time 0.048812 [03/13/2022-08:30:15] [V] [TRT] Tactic: 27 time 0.048312 [03/13/2022-08:30:15] [V] [TRT] Tactic: 31 time 0.046948 [03/13/2022-08:30:15] [V] [TRT] Fastest Tactic: 24 Time: 0.04676 [03/13/2022-08:30:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [03/13/2022-08:30:15] [V] [TRT] [03/13/2022-08:30:15] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,768000) -> Half(1,80,4800,1536000) *************** [03/13/2022-08:30:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_87, Mul_88) (PointWise) [03/13/2022-08:30:15] [V] [TRT] Tactic: 128 time 0.100116 [03/13/2022-08:30:15] [V] [TRT] Tactic: 256 time 0.08082 [03/13/2022-08:30:15] [V] [TRT] Tactic: 512 time 0.078832 [03/13/2022-08:30:15] [V] [TRT] Tactic: -32 time 0.131964 [03/13/2022-08:30:15] [V] [TRT] Tactic: -64 time 0.08886 [03/13/2022-08:30:15] [V] [TRT] Tactic: -128 time 0.087964 [03/13/2022-08:30:15] [V] [TRT] Fastest Tactic: 512 Time: 0.078832 [03/13/2022-08:30:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_87, Mul_88) (PointWiseV2) [03/13/2022-08:30:15] [V] [TRT] Tactic: 0 time 0.059748 [03/13/2022-08:30:15] [V] [TRT] Tactic: 1 time 0.047924 [03/13/2022-08:30:15] [V] [TRT] Tactic: 2 time 0.03948 [03/13/2022-08:30:15] [V] [TRT] Tactic: 3 time 0.041964 [03/13/2022-08:30:15] [V] [TRT] Tactic: 4 time 0.032904 [03/13/2022-08:30:15] [V] [TRT] Tactic: 5 time 0.027816 [03/13/2022-08:30:15] [V] [TRT] Tactic: 6 time 0.040408 [03/13/2022-08:30:15] [V] [TRT] Tactic: 7 time 0.030744 [03/13/2022-08:30:15] [V] [TRT] Tactic: 8 time 0.024396 [03/13/2022-08:30:15] [V] [TRT] Tactic: 9 time 0.023328 [03/13/2022-08:30:15] [V] [TRT] Tactic: 28 time 0.059708 [03/13/2022-08:30:15] [V] [TRT] Fastest Tactic: 9 Time: 0.023328 [03/13/2022-08:30:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:30:15] [V] [TRT] [03/13/2022-08:30:15] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800:2,768000) *************** [03/13/2022-08:30:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_87, Mul_88) (PointWise) [03/13/2022-08:30:15] [V] [TRT] Tactic: 128 time 0.101652 [03/13/2022-08:30:15] [V] [TRT] Tactic: 256 time 0.081224 [03/13/2022-08:30:15] [V] [TRT] Tactic: 512 time 0.079456 [03/13/2022-08:30:15] [V] [TRT] Tactic: -32 time 0.131828 [03/13/2022-08:30:15] [V] [TRT] Tactic: -64 time 0.088764 [03/13/2022-08:30:15] [V] [TRT] Tactic: -128 time 0.087752 [03/13/2022-08:30:15] [V] [TRT] Fastest Tactic: 512 Time: 0.079456 [03/13/2022-08:30:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_87, Mul_88) (PointWiseV2) [03/13/2022-08:30:15] [V] [TRT] Tactic: 0 time 0.040812 [03/13/2022-08:30:15] [V] [TRT] Tactic: 1 time 0.034376 [03/13/2022-08:30:15] [V] [TRT] Tactic: 2 time 0.03514 [03/13/2022-08:30:15] [V] [TRT] Tactic: 3 time 0.031908 [03/13/2022-08:30:15] [V] [TRT] Tactic: 4 time 0.03154 [03/13/2022-08:30:15] [V] [TRT] Tactic: 5 time 0.03312 [03/13/2022-08:30:15] [V] [TRT] Tactic: 6 time 0.033012 [03/13/2022-08:30:15] [V] [TRT] Tactic: 7 time 0.032572 [03/13/2022-08:30:15] [V] [TRT] Tactic: 8 time 0.03482 [03/13/2022-08:30:15] [V] [TRT] Tactic: 9 time 0.04114 [03/13/2022-08:30:15] [V] [TRT] Tactic: 10 time 0.062356 [03/13/2022-08:30:15] [V] [TRT] Tactic: 11 time 0.048732 [03/13/2022-08:30:15] [V] [TRT] Tactic: 12 time 0.040492 [03/13/2022-08:30:15] [V] [TRT] Tactic: 13 time 0.04282 [03/13/2022-08:30:15] [V] [TRT] Tactic: 14 time 0.03334 [03/13/2022-08:30:15] [V] [TRT] Tactic: 15 time 0.029312 [03/13/2022-08:30:15] [V] [TRT] Tactic: 16 time 0.041664 [03/13/2022-08:30:15] [V] [TRT] Tactic: 17 time 0.03074 [03/13/2022-08:30:15] [V] [TRT] Tactic: 18 time 0.025008 [03/13/2022-08:30:15] [V] [TRT] Tactic: 19 time 0.02542 [03/13/2022-08:30:15] [V] [TRT] Tactic: 28 time 0.04076 [03/13/2022-08:30:15] [V] [TRT] Tactic: 29 time 0.062128 [03/13/2022-08:30:15] [V] [TRT] Fastest Tactic: 18 Time: 0.025008 [03/13/2022-08:30:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:30:15] [V] [TRT] [03/13/2022-08:30:15] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Half(40,3200,1:8,192000) *************** [03/13/2022-08:30:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_87, Mul_88) (PointWise) [03/13/2022-08:30:15] [V] [TRT] Tactic: 128 time 0.099652 [03/13/2022-08:30:15] [V] [TRT] Tactic: 256 time 0.081492 [03/13/2022-08:30:15] [V] [TRT] Tactic: 512 time 0.07854 [03/13/2022-08:30:15] [V] [TRT] Tactic: -32 time 0.148868 [03/13/2022-08:30:15] [V] [TRT] Tactic: -64 time 0.123428 [03/13/2022-08:30:15] [V] [TRT] Tactic: -128 time 0.12352 [03/13/2022-08:30:15] [V] [TRT] Fastest Tactic: 512 Time: 0.07854 [03/13/2022-08:30:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_87, Mul_88) (PointWiseV2) [03/13/2022-08:30:15] [V] [TRT] Tactic: 0 time 0.037672 [03/13/2022-08:30:15] [V] [TRT] Tactic: 1 time 0.040832 [03/13/2022-08:30:15] [V] [TRT] Tactic: 2 time 0.041208 [03/13/2022-08:30:15] [V] [TRT] Tactic: 3 time 0.05084 [03/13/2022-08:30:15] [V] [TRT] Tactic: 4 time 0.047888 [03/13/2022-08:30:15] [V] [TRT] Tactic: 5 time 0.044016 [03/13/2022-08:30:15] [V] [TRT] Tactic: 6 time 0.074284 [03/13/2022-08:30:15] [V] [TRT] Tactic: 7 time 0.059984 [03/13/2022-08:30:15] [V] [TRT] Tactic: 8 time 0.053952 [03/13/2022-08:30:15] [V] [TRT] Tactic: 9 time 0.065064 [03/13/2022-08:30:15] [V] [TRT] Tactic: 10 time 0.045028 [03/13/2022-08:30:15] [V] [TRT] Tactic: 11 time 0.037132 [03/13/2022-08:30:15] [V] [TRT] Tactic: 12 time 0.039192 [03/13/2022-08:30:15] [V] [TRT] Tactic: 13 time 0.041916 [03/13/2022-08:30:15] [V] [TRT] Tactic: 14 time 0.041352 [03/13/2022-08:30:15] [V] [TRT] Tactic: 15 time 0.040748 [03/13/2022-08:30:15] [V] [TRT] Tactic: 16 time 0.053172 [03/13/2022-08:30:15] [V] [TRT] Tactic: 17 time 0.047516 [03/13/2022-08:30:15] [V] [TRT] Tactic: 18 time 0.046528 [03/13/2022-08:30:15] [V] [TRT] Tactic: 19 time 0.044748 [03/13/2022-08:30:15] [V] [TRT] Tactic: 20 time 0.050376 [03/13/2022-08:30:15] [V] [TRT] Tactic: 21 time 0.048272 [03/13/2022-08:30:15] [V] [TRT] Tactic: 22 time 0.03934 [03/13/2022-08:30:15] [V] [TRT] Tactic: 23 time 0.046056 [03/13/2022-08:30:15] [V] [TRT] Tactic: 24 time 0.063908 [03/13/2022-08:30:15] [V] [TRT] Tactic: 25 time 0.05774 [03/13/2022-08:30:15] [V] [TRT] Tactic: 26 time 0.055644 [03/13/2022-08:30:15] [V] [TRT] Tactic: 27 time 0.048048 [03/13/2022-08:30:15] [V] [TRT] Tactic: 28 time 0.029728 [03/13/2022-08:30:15] [V] [TRT] Tactic: 29 time 0.030012 [03/13/2022-08:30:16] [V] [TRT] Tactic: 30 time 0.042752 [03/13/2022-08:30:16] [V] [TRT] Tactic: 31 time 0.063416 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 28 Time: 0.029728 [03/13/2022-08:30:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [03/13/2022-08:30:16] [V] [TRT] [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.084096 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.19008 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.084096 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.058096 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.05764 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.05764 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.123616 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.049012 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.049012 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.084128 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.05216 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.05216 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.131192 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.109512 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.109512 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.12986 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.105896 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.105896 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.155744 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.108608 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.108608 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.112324 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.07084 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.07084 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.0608 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.058728 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.058728 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.084684 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.193292 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.084684 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.124496 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.046284 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.046284 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.08464 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.048152 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.048152 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.12888 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.060284 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.060284 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.08268 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.18328 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.08268 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.1278 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.054992 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.054992 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.082244 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.041024 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.041024 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.083788 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.099448 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.083788 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.094016 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.338284 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.094016 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.083048 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.0946 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.083048 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.1391 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.028684 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.028684 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.057816 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.057908 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.057816 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.123004 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.061104 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.061104 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.083364 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.101 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.083364 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.131204 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.109008 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.109008 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.130084 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.106188 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.106188 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.155908 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.10932 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.10932 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.11086 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.070612 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.070612 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.061076 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.061136 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.061076 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.122044 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.04734 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.04734 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.083608 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.045488 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.045488 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.127676 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.045084 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.045084 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.12786 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.055548 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.055548 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.081648 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.03736 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.03736 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.084712 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.036408 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.036408 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.083704 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.029672 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.029672 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:16] [V] [TRT] Tactic: 1002 time 0.157396 [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.028824 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 0 Time: 0.028824 [03/13/2022-08:30:16] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,1536000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:30:16] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: Conv_89 (FusedConvActConvolution) [03/13/2022-08:30:16] [V] [TRT] Tactic: 458751 time 0.857276 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 458751 Time: 0.857276 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: Conv_89 (CaskConvolution) [03/13/2022-08:30:16] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: 1825138533642645384 time 0.832684 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: 2842488832350522458 time 0.598112 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: 3915320020053085238 time 0.826776 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: 6448355332020552203 time 0.85274 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: 6808617066150061604 time 0.60672 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: -8060443123034038864 time 0.617232 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: -4420849921117327522 time 0.82838 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: -3946921629105938337 time 0.73326 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 2842488832350522458 Time: 0.598112 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: Conv_89 (CudaConvolution) [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.99816 [03/13/2022-08:30:16] [V] [TRT] Tactic: 2 time 0.896644 [03/13/2022-08:30:16] [V] [TRT] Tactic: 5 skipped. Scratch requested: 227000320, available: 16777216 [03/13/2022-08:30:16] [V] [TRT] Tactic: 57 time 0.490192 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 57 Time: 0.490192 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: Conv_89 (CudaDepthwiseConvolution) [03/13/2022-08:30:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 57 [03/13/2022-08:30:16] [V] [TRT] [03/13/2022-08:30:16] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,1536000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: Conv_89 (FusedConvActConvolution) [03/13/2022-08:30:16] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: Conv_89 (CaskConvolution) [03/13/2022-08:30:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: Conv_89 (CudaConvolution) [03/13/2022-08:30:16] [V] [TRT] Tactic: 0 time 0.84066 [03/13/2022-08:30:16] [V] [TRT] Tactic: 1 time 0.48242 [03/13/2022-08:30:16] [V] [TRT] Tactic: 2 time 0.862764 [03/13/2022-08:30:16] [V] [TRT] Tactic: 5 skipped. Scratch requested: 227000320, available: 16777216 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 1 Time: 0.48242 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: Conv_89 (CudaDepthwiseConvolution) [03/13/2022-08:30:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:30:16] [V] [TRT] [03/13/2022-08:30:16] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,768000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: Conv_89 (FusedConvActConvolution) [03/13/2022-08:30:16] [V] [TRT] Tactic: 458751 time 0.334756 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 458751 Time: 0.334756 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: Conv_89 (CaskConvolution) [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: 1145226902788474763 time 0.235652 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: 1651411198763708804 time 0.234908 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: 2418518597804310654 time 0.236124 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: 4318470497547290900 time 0.233128 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: 4653005425971292725 time 0.236324 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: 4930470141256631146 time 0.275004 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: 8292881859266835088 time 0.278132 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: 8401509141903434922 time 0.232108 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: -8654297089785671176 time 0.33466 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: -7448936905981214224 time 0.29012 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: -6004726995029373073 time 0.2744 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: -5719726816705110014 time 0.334668 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: -3754890472406891741 time 0.34386 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: -3689982367035295496 time 0.336384 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: -2894005464278291378 time 0.281596 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: -2027588946874785071 time 0.265936 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: -1968398013367819764 time 0.336108 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: -245090590808296743 time 0.34348 [03/13/2022-08:30:16] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 0.232108 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: Conv_89 (CudaConvolution) [03/13/2022-08:30:16] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: Conv_89 (CudaDepthwiseConvolution) [03/13/2022-08:30:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8401509141903434922 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:16] [V] [TRT] *************** Autotuning format combination: Half(40,3200,1:8,192000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: Conv_89 (FusedConvActConvolution) [03/13/2022-08:30:16] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: Conv_89 (CaskConvolution) [03/13/2022-08:30:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: Conv_89 (CudaConvolution) [03/13/2022-08:30:16] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: Conv_89 (CudaDepthwiseConvolution) [03/13/2022-08:30:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:16] [V] [TRT] *************** Autotuning format combination: Half(40,3200,1:8,192000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:30:16] [V] [TRT] Conv_89 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:16] [V] [TRT] Conv_89 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:16] [V] [TRT] Conv_89 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: Conv_89 (FusedConvActConvolution) [03/13/2022-08:30:16] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:16] [V] [TRT] --------------- Timing Runner: Conv_89 (CaskConvolution) [03/13/2022-08:30:16] [V] [TRT] Conv_89 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:16] [V] [TRT] Tactic: 130343752241278875 time 2.02042 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:16] [V] [TRT] Tactic: 2148106709480872763 time 1.92378 [03/13/2022-08:30:16] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:17] [V] [TRT] Tactic: 2410442691266548717 time 4.60918 [03/13/2022-08:30:17] [V] [TRT] Conv_89 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:17] [V] [TRT] Tactic: 2921824978225832523 time 2.02671 [03/13/2022-08:30:17] [V] [TRT] Conv_89 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:17] [V] [TRT] Tactic: 3030711443478140260 time 3.89837 [03/13/2022-08:30:17] [V] [TRT] Conv_89 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:17] [V] [TRT] Tactic: 3754069740140581927 time 5.37114 [03/13/2022-08:30:17] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:17] [V] [TRT] Tactic: 3823144360994712832 time 2.31745 [03/13/2022-08:30:17] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:17] [V] [TRT] Tactic: 5635311898703673455 time 3.45734 [03/13/2022-08:30:17] [V] [TRT] Conv_89 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:17] [V] [TRT] Tactic: 5925270497649423688 time 7.15028 [03/13/2022-08:30:17] [V] [TRT] Conv_89 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:17] [V] [TRT] Tactic: 6680916730816870145 time 4.30584 [03/13/2022-08:30:17] [V] [TRT] Conv_89 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:17] [V] [TRT] Tactic: 7158029511300006471 time 3.58968 [03/13/2022-08:30:17] [V] [TRT] Conv_89 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:17] [V] [TRT] Tactic: 7859952145590271433 time 4.30071 [03/13/2022-08:30:17] [V] [TRT] Conv_89 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:17] [V] [TRT] Tactic: 8283847742354150423 time 5.3697 [03/13/2022-08:30:17] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:17] [V] [TRT] Tactic: -8992262742606384444 time 1.92827 [03/13/2022-08:30:17] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:17] [V] [TRT] Tactic: -8682550625095202832 time 1.93142 [03/13/2022-08:30:17] [V] [TRT] Conv_89 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:18] [V] [TRT] Tactic: -8379842433586149932 time 3.76622 [03/13/2022-08:30:18] [V] [TRT] Conv_89 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:18] [V] [TRT] Tactic: -6352769237623756264 time 4.0002 [03/13/2022-08:30:18] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:18] [V] [TRT] Tactic: -6273232454637933930 time 2.3192 [03/13/2022-08:30:18] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:18] [V] [TRT] Tactic: -5818527483287834165 time 2.3186 [03/13/2022-08:30:18] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:18] [V] [TRT] Tactic: -4954692664176521434 time 4.61098 [03/13/2022-08:30:18] [V] [TRT] Conv_89 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:18] [V] [TRT] Tactic: -4953888146171240997 time 2.01982 [03/13/2022-08:30:18] [V] [TRT] Conv_89 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:18] [V] [TRT] Tactic: -4534876761957424274 time 7.62741 [03/13/2022-08:30:18] [V] [TRT] Conv_89 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:18] [V] [TRT] Tactic: -3237051169894153788 time 3.74628 [03/13/2022-08:30:18] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:18] [V] [TRT] Tactic: -3136088851200285532 time 3.51492 [03/13/2022-08:30:18] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:18] [V] [TRT] Tactic: -2586046817576862066 time 4.7727 [03/13/2022-08:30:18] [V] [TRT] Conv_89 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:18] [V] [TRT] Tactic: -229563042944049199 time 3.45468 [03/13/2022-08:30:18] [V] [TRT] Fastest Tactic: 2148106709480872763 Time: 1.92378 [03/13/2022-08:30:18] [V] [TRT] --------------- Timing Runner: Conv_89 (CudaConvolution) [03/13/2022-08:30:18] [V] [TRT] Tactic: 0 time 1.08789 [03/13/2022-08:30:18] [V] [TRT] Tactic: 1 time 2.06778 [03/13/2022-08:30:18] [V] [TRT] Tactic: 2 time 1.44298 [03/13/2022-08:30:18] [V] [TRT] Fastest Tactic: 0 Time: 1.08789 [03/13/2022-08:30:18] [V] [TRT] --------------- Timing Runner: Conv_89 (CudaDepthwiseConvolution) [03/13/2022-08:30:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0 [03/13/2022-08:30:18] [V] [TRT] [03/13/2022-08:30:18] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:18] [V] [TRT] Tactic: 1002 time 0.0383 [03/13/2022-08:30:18] [V] [TRT] Tactic: 0 time 0.074228 [03/13/2022-08:30:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0383 [03/13/2022-08:30:18] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:18] [V] [TRT] Tactic: 1002 time 0.026108 [03/13/2022-08:30:18] [V] [TRT] Tactic: 0 time 0.029344 [03/13/2022-08:30:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.026108 [03/13/2022-08:30:18] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:18] [V] [TRT] Tactic: 1002 time 0.0518 [03/13/2022-08:30:18] [V] [TRT] Tactic: 0 time 0.023296 [03/13/2022-08:30:18] [V] [TRT] Fastest Tactic: 0 Time: 0.023296 [03/13/2022-08:30:18] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:18] [V] [TRT] Tactic: 1002 time 0.037616 [03/13/2022-08:30:18] [V] [TRT] Tactic: 0 time 0.021592 [03/13/2022-08:30:18] [V] [TRT] Fastest Tactic: 0 Time: 0.021592 [03/13/2022-08:30:18] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:18] [V] [TRT] Tactic: 1002 time 0.0555 [03/13/2022-08:30:18] [V] [TRT] Tactic: 0 time 0.047088 [03/13/2022-08:30:18] [V] [TRT] Fastest Tactic: 0 Time: 0.047088 [03/13/2022-08:30:18] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:18] [V] [TRT] Tactic: 1002 time 0.0558 [03/13/2022-08:30:18] [V] [TRT] Tactic: 0 time 0.0453 [03/13/2022-08:30:18] [V] [TRT] Fastest Tactic: 0 Time: 0.0453 [03/13/2022-08:30:18] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:18] [V] [TRT] Tactic: 1002 time 0.06284 [03/13/2022-08:30:18] [V] [TRT] Tactic: 0 time 0.046652 [03/13/2022-08:30:18] [V] [TRT] Fastest Tactic: 0 Time: 0.046652 [03/13/2022-08:30:18] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:18] [V] [TRT] Tactic: 1002 time 0.047624 [03/13/2022-08:30:18] [V] [TRT] Tactic: 0 time 0.031476 [03/13/2022-08:30:18] [V] [TRT] Fastest Tactic: 0 Time: 0.031476 [03/13/2022-08:30:18] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:18] [V] [TRT] Tactic: 1002 time 0.026988 [03/13/2022-08:30:18] [V] [TRT] Tactic: 0 time 0.026452 [03/13/2022-08:30:18] [V] [TRT] Fastest Tactic: 0 Time: 0.026452 [03/13/2022-08:30:18] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:18] [V] [TRT] Tactic: 1002 time 0.037472 [03/13/2022-08:30:18] [V] [TRT] Tactic: 0 time 0.075076 [03/13/2022-08:30:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.037472 [03/13/2022-08:30:18] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:18] [V] [TRT] Tactic: 1002 time 0.051352 [03/13/2022-08:30:18] [V] [TRT] Tactic: 0 time 0.022372 [03/13/2022-08:30:18] [V] [TRT] Fastest Tactic: 0 Time: 0.022372 [03/13/2022-08:30:18] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:18] [V] [TRT] Tactic: 1002 time 0.03736 [03/13/2022-08:30:19] [V] [TRT] Tactic: 0 time 0.019808 [03/13/2022-08:30:19] [V] [TRT] Fastest Tactic: 0 Time: 0.019808 [03/13/2022-08:30:19] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:19] [V] [TRT] Tactic: 1002 time 0.056172 [03/13/2022-08:30:19] [V] [TRT] Tactic: 0 time 0.022824 [03/13/2022-08:30:19] [V] [TRT] Fastest Tactic: 0 Time: 0.022824 [03/13/2022-08:30:19] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:19] [V] [TRT] Tactic: 1002 time 0.037012 [03/13/2022-08:30:19] [V] [TRT] Tactic: 0 time 0.073072 [03/13/2022-08:30:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.037012 [03/13/2022-08:30:19] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:19] [V] [TRT] Tactic: 1002 time 0.055072 [03/13/2022-08:30:19] [V] [TRT] Tactic: 0 time 0.021292 [03/13/2022-08:30:19] [V] [TRT] Fastest Tactic: 0 Time: 0.021292 [03/13/2022-08:30:19] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:19] [V] [TRT] Tactic: 1002 time 0.0363 [03/13/2022-08:30:19] [V] [TRT] Tactic: 0 time 0.016724 [03/13/2022-08:30:19] [V] [TRT] Fastest Tactic: 0 Time: 0.016724 [03/13/2022-08:30:19] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:19] [V] [TRT] Tactic: 1002 time 0.037416 [03/13/2022-08:30:19] [V] [TRT] Tactic: 0 time 0.018356 [03/13/2022-08:30:19] [V] [TRT] Fastest Tactic: 0 Time: 0.018356 [03/13/2022-08:30:19] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:19] [V] [TRT] Tactic: 1002 time 0.049624 [03/13/2022-08:30:19] [V] [TRT] Tactic: 0 time 0.096196 [03/13/2022-08:30:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.049624 [03/13/2022-08:30:19] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:19] [V] [TRT] Tactic: 1002 time 0.036996 [03/13/2022-08:30:19] [V] [TRT] Tactic: 0 time 0.014148 [03/13/2022-08:30:19] [V] [TRT] Fastest Tactic: 0 Time: 0.014148 [03/13/2022-08:30:19] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:19] [V] [TRT] Tactic: 1002 time 0.063016 [03/13/2022-08:30:19] [V] [TRT] Tactic: 0 time 0.01412 [03/13/2022-08:30:19] [V] [TRT] Fastest Tactic: 0 Time: 0.01412 [03/13/2022-08:30:19] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:30:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_90, Mul_91) (PointWise) [03/13/2022-08:30:19] [V] [TRT] Tactic: 128 time 0.037404 [03/13/2022-08:30:19] [V] [TRT] Tactic: 256 time 0.037684 [03/13/2022-08:30:19] [V] [TRT] Tactic: 512 time 0.04196 [03/13/2022-08:30:19] [V] [TRT] Tactic: -32 time 0.06368 [03/13/2022-08:30:19] [V] [TRT] Tactic: -64 time 0.041372 [03/13/2022-08:30:19] [V] [TRT] Tactic: -128 time 0.039472 [03/13/2022-08:30:19] [V] [TRT] Fastest Tactic: 128 Time: 0.037404 [03/13/2022-08:30:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_90, Mul_91) (PointWiseV2) [03/13/2022-08:30:19] [V] [TRT] Tactic: 0 time 0.02738 [03/13/2022-08:30:19] [V] [TRT] Tactic: 1 time 0.023268 [03/13/2022-08:30:19] [V] [TRT] Tactic: 2 time 0.0224 [03/13/2022-08:30:19] [V] [TRT] Tactic: 3 time 0.023636 [03/13/2022-08:30:19] [V] [TRT] Tactic: 4 time 0.022628 [03/13/2022-08:30:19] [V] [TRT] Tactic: 5 time 0.022448 [03/13/2022-08:30:19] [V] [TRT] Tactic: 6 time 0.025148 [03/13/2022-08:30:19] [V] [TRT] Tactic: 7 time 0.023068 [03/13/2022-08:30:19] [V] [TRT] Tactic: 8 time 0.022744 [03/13/2022-08:30:19] [V] [TRT] Tactic: 9 time 0.022408 [03/13/2022-08:30:19] [V] [TRT] Tactic: 28 time 0.027068 [03/13/2022-08:30:19] [V] [TRT] Fastest Tactic: 2 Time: 0.0224 [03/13/2022-08:30:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [03/13/2022-08:30:19] [V] [TRT] [03/13/2022-08:30:19] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,12000) -> Float(1,40,1200:32,12000) *************** [03/13/2022-08:30:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_90, Mul_91) (PointWise) [03/13/2022-08:30:19] [V] [TRT] Tactic: 128 time 0.037136 [03/13/2022-08:30:19] [V] [TRT] Tactic: 256 time 0.037928 [03/13/2022-08:30:19] [V] [TRT] Tactic: 512 time 0.041828 [03/13/2022-08:30:19] [V] [TRT] Tactic: -32 time 0.064024 [03/13/2022-08:30:19] [V] [TRT] Tactic: -64 time 0.041308 [03/13/2022-08:30:19] [V] [TRT] Tactic: -128 time 0.039532 [03/13/2022-08:30:19] [V] [TRT] Fastest Tactic: 128 Time: 0.037136 [03/13/2022-08:30:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_90, Mul_91) (PointWiseV2) [03/13/2022-08:30:19] [V] [TRT] Tactic: 24 time 0.02586 [03/13/2022-08:30:19] [V] [TRT] Tactic: 25 time 0.026396 [03/13/2022-08:30:19] [V] [TRT] Tactic: 26 time 0.02604 [03/13/2022-08:30:19] [V] [TRT] Tactic: 27 time 0.025676 [03/13/2022-08:30:19] [V] [TRT] Tactic: 31 time 0.025416 [03/13/2022-08:30:19] [V] [TRT] Fastest Tactic: 31 Time: 0.025416 [03/13/2022-08:30:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [03/13/2022-08:30:19] [V] [TRT] [03/13/2022-08:30:19] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:30:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_90, Mul_91) (PointWise) [03/13/2022-08:30:19] [V] [TRT] Tactic: 128 time 0.039112 [03/13/2022-08:30:19] [V] [TRT] Tactic: 256 time 0.03412 [03/13/2022-08:30:19] [V] [TRT] Tactic: 512 time 0.03414 [03/13/2022-08:30:19] [V] [TRT] Tactic: -32 time 0.056376 [03/13/2022-08:30:19] [V] [TRT] Tactic: -64 time 0.038996 [03/13/2022-08:30:19] [V] [TRT] Tactic: -128 time 0.03742 [03/13/2022-08:30:19] [V] [TRT] Fastest Tactic: 256 Time: 0.03412 [03/13/2022-08:30:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_90, Mul_91) (PointWiseV2) [03/13/2022-08:30:19] [V] [TRT] Tactic: 0 time 0.02566 [03/13/2022-08:30:19] [V] [TRT] Tactic: 1 time 0.021492 [03/13/2022-08:30:19] [V] [TRT] Tactic: 2 time 0.018612 [03/13/2022-08:30:19] [V] [TRT] Tactic: 3 time 0.019872 [03/13/2022-08:30:19] [V] [TRT] Tactic: 4 time 0.01532 [03/13/2022-08:30:19] [V] [TRT] Tactic: 5 time 0.01364 [03/13/2022-08:30:19] [V] [TRT] Tactic: 6 time 0.020668 [03/13/2022-08:30:19] [V] [TRT] Tactic: 7 time 0.015532 [03/13/2022-08:30:19] [V] [TRT] Tactic: 8 time 0.014008 [03/13/2022-08:30:19] [V] [TRT] Tactic: 9 time 0.013744 [03/13/2022-08:30:19] [V] [TRT] Tactic: 28 time 0.025364 [03/13/2022-08:30:19] [V] [TRT] Fastest Tactic: 5 Time: 0.01364 [03/13/2022-08:30:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [03/13/2022-08:30:19] [V] [TRT] [03/13/2022-08:30:19] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:30:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_90, Mul_91) (PointWise) [03/13/2022-08:30:19] [V] [TRT] Tactic: 128 time 0.038964 [03/13/2022-08:30:19] [V] [TRT] Tactic: 256 time 0.033596 [03/13/2022-08:30:19] [V] [TRT] Tactic: 512 time 0.034208 [03/13/2022-08:30:19] [V] [TRT] Tactic: -32 time 0.056336 [03/13/2022-08:30:19] [V] [TRT] Tactic: -64 time 0.039184 [03/13/2022-08:30:19] [V] [TRT] Tactic: -128 time 0.037572 [03/13/2022-08:30:19] [V] [TRT] Fastest Tactic: 256 Time: 0.033596 [03/13/2022-08:30:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_90, Mul_91) (PointWiseV2) [03/13/2022-08:30:19] [V] [TRT] Tactic: 0 time 0.018588 [03/13/2022-08:30:19] [V] [TRT] Tactic: 1 time 0.016444 [03/13/2022-08:30:19] [V] [TRT] Tactic: 2 time 0.016768 [03/13/2022-08:30:19] [V] [TRT] Tactic: 3 time 0.01616 [03/13/2022-08:30:19] [V] [TRT] Tactic: 4 time 0.016592 [03/13/2022-08:30:19] [V] [TRT] Tactic: 5 time 0.018184 [03/13/2022-08:30:19] [V] [TRT] Tactic: 6 time 0.016596 [03/13/2022-08:30:19] [V] [TRT] Tactic: 7 time 0.016784 [03/13/2022-08:30:19] [V] [TRT] Tactic: 8 time 0.018364 [03/13/2022-08:30:19] [V] [TRT] Tactic: 9 time 0.021872 [03/13/2022-08:30:19] [V] [TRT] Tactic: 10 time 0.02658 [03/13/2022-08:30:19] [V] [TRT] Tactic: 11 time 0.02164 [03/13/2022-08:30:19] [V] [TRT] Tactic: 12 time 0.018912 [03/13/2022-08:30:19] [V] [TRT] Tactic: 13 time 0.020284 [03/13/2022-08:30:19] [V] [TRT] Tactic: 14 time 0.015508 [03/13/2022-08:30:19] [V] [TRT] Tactic: 15 time 0.01484 [03/13/2022-08:30:19] [V] [TRT] Tactic: 16 time 0.020776 [03/13/2022-08:30:19] [V] [TRT] Tactic: 17 time 0.015412 [03/13/2022-08:30:19] [V] [TRT] Tactic: 18 time 0.013832 [03/13/2022-08:30:19] [V] [TRT] Tactic: 19 time 0.013832 [03/13/2022-08:30:19] [V] [TRT] Tactic: 28 time 0.018372 [03/13/2022-08:30:19] [V] [TRT] Tactic: 29 time 0.026468 [03/13/2022-08:30:19] [V] [TRT] Fastest Tactic: 18 Time: 0.013832 [03/13/2022-08:30:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:30:19] [V] [TRT] [03/13/2022-08:30:19] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:30:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_90, Mul_91) (PointWise) [03/13/2022-08:30:19] [V] [TRT] Tactic: 128 time 0.03912 [03/13/2022-08:30:19] [V] [TRT] Tactic: 256 time 0.033724 [03/13/2022-08:30:19] [V] [TRT] Tactic: 512 time 0.034156 [03/13/2022-08:30:19] [V] [TRT] Tactic: -32 time 0.0564 [03/13/2022-08:30:19] [V] [TRT] Tactic: -64 time 0.039256 [03/13/2022-08:30:19] [V] [TRT] Tactic: -128 time 0.037272 [03/13/2022-08:30:19] [V] [TRT] Fastest Tactic: 256 Time: 0.033724 [03/13/2022-08:30:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_90, Mul_91) (PointWiseV2) [03/13/2022-08:30:19] [V] [TRT] Tactic: 0 time 0.015208 [03/13/2022-08:30:19] [V] [TRT] Tactic: 1 time 0.015412 [03/13/2022-08:30:19] [V] [TRT] Tactic: 2 time 0.019056 [03/13/2022-08:30:19] [V] [TRT] Tactic: 3 time 0.01534 [03/13/2022-08:30:19] [V] [TRT] Tactic: 4 time 0.019912 [03/13/2022-08:30:19] [V] [TRT] Tactic: 5 time 0.025576 [03/13/2022-08:30:19] [V] [TRT] Tactic: 6 time 0.015216 [03/13/2022-08:30:19] [V] [TRT] Tactic: 7 time 0.017928 [03/13/2022-08:30:19] [V] [TRT] Tactic: 8 time 0.024568 [03/13/2022-08:30:19] [V] [TRT] Tactic: 9 time 0.032856 [03/13/2022-08:30:19] [V] [TRT] Tactic: 10 time 0.01488 [03/13/2022-08:30:19] [V] [TRT] Tactic: 11 time 0.014644 [03/13/2022-08:30:19] [V] [TRT] Tactic: 12 time 0.015688 [03/13/2022-08:30:19] [V] [TRT] Tactic: 13 time 0.01436 [03/13/2022-08:30:19] [V] [TRT] Tactic: 14 time 0.015832 [03/13/2022-08:30:19] [V] [TRT] Tactic: 15 time 0.01924 [03/13/2022-08:30:19] [V] [TRT] Tactic: 16 time 0.01434 [03/13/2022-08:30:19] [V] [TRT] Tactic: 17 time 0.0162 [03/13/2022-08:30:19] [V] [TRT] Tactic: 18 time 0.020508 [03/13/2022-08:30:19] [V] [TRT] Tactic: 19 time 0.024872 [03/13/2022-08:30:19] [V] [TRT] Tactic: 20 time 0.018956 [03/13/2022-08:30:19] [V] [TRT] Tactic: 21 time 0.016264 [03/13/2022-08:30:19] [V] [TRT] Tactic: 22 time 0.016388 [03/13/2022-08:30:19] [V] [TRT] Tactic: 23 time 0.01656 [03/13/2022-08:30:19] [V] [TRT] Tactic: 24 time 0.025912 [03/13/2022-08:30:19] [V] [TRT] Tactic: 25 time 0.02132 [03/13/2022-08:30:19] [V] [TRT] Tactic: 26 time 0.019404 [03/13/2022-08:30:19] [V] [TRT] Tactic: 27 time 0.020972 [03/13/2022-08:30:19] [V] [TRT] Tactic: 28 time 0.014976 [03/13/2022-08:30:19] [V] [TRT] Tactic: 29 time 0.014232 [03/13/2022-08:30:19] [V] [TRT] Tactic: 30 time 0.018892 [03/13/2022-08:30:19] [V] [TRT] Tactic: 31 time 0.025872 [03/13/2022-08:30:19] [V] [TRT] Fastest Tactic: 29 Time: 0.014232 [03/13/2022-08:30:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 29 [03/13/2022-08:30:19] [V] [TRT] [03/13/2022-08:30:19] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:30:19] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:30:19] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:30:19] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:30:19] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:30:19] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:30:19] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:30:19] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:30:19] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:30:19] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:30:19] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (FusedConvActConvolution) [03/13/2022-08:30:19] [V] [TRT] Tactic: 589823 time 0.428652 [03/13/2022-08:30:19] [V] [TRT] Tactic: 655359 time 0.218772 [03/13/2022-08:30:19] [V] [TRT] Tactic: 786431 time 0.267952 [03/13/2022-08:30:20] [V] [TRT] Tactic: 851967 time 0.220632 [03/13/2022-08:30:20] [V] [TRT] Tactic: 1179647 time 0.196156 [03/13/2022-08:30:20] [V] [TRT] Tactic: 1310719 time 0.271072 [03/13/2022-08:30:20] [V] [TRT] Tactic: 1376255 time 0.236344 [03/13/2022-08:30:20] [V] [TRT] Tactic: 1441791 time 0.248108 [03/13/2022-08:30:20] [V] [TRT] Tactic: 1507327 time 0.193772 [03/13/2022-08:30:20] [V] [TRT] Tactic: 1638399 time 0.257628 [03/13/2022-08:30:20] [V] [TRT] Tactic: 1835007 time 0.29508 [03/13/2022-08:30:20] [V] [TRT] Tactic: 1900543 time 0.226828 [03/13/2022-08:30:20] [V] [TRT] Tactic: 2097151 time 0.278144 [03/13/2022-08:30:20] [V] [TRT] Tactic: 2162687 time 0.24302 [03/13/2022-08:30:20] [V] [TRT] Tactic: 2293759 time 0.227724 [03/13/2022-08:30:20] [V] [TRT] Tactic: 2359295 time 0.184796 [03/13/2022-08:30:20] [V] [TRT] Tactic: 2686975 time 0.2328 [03/13/2022-08:30:20] [V] [TRT] Tactic: 3080191 time 0.200816 [03/13/2022-08:30:20] [V] [TRT] Tactic: 3342335 time 0.1955 [03/13/2022-08:30:20] [V] [TRT] Tactic: 3407871 time 0.198304 [03/13/2022-08:30:20] [V] [TRT] Tactic: 3538943 time 0.19776 [03/13/2022-08:30:20] [V] [TRT] Tactic: 3670015 time 0.24228 [03/13/2022-08:30:20] [V] [TRT] Tactic: 3932159 time 0.219404 [03/13/2022-08:30:20] [V] [TRT] Tactic: 3997695 time 0.26266 [03/13/2022-08:30:20] [V] [TRT] Tactic: 4063231 time 0.207288 [03/13/2022-08:30:20] [V] [TRT] Tactic: 4194303 time 0.26558 [03/13/2022-08:30:20] [V] [TRT] Tactic: 4259839 time 0.257584 [03/13/2022-08:30:20] [V] [TRT] Tactic: 4325375 time 0.244856 [03/13/2022-08:30:20] [V] [TRT] Tactic: 4521983 time 0.28244 [03/13/2022-08:30:20] [V] [TRT] Tactic: 4587519 time 0.26822 [03/13/2022-08:30:20] [V] [TRT] Tactic: 4653055 time 0.189628 [03/13/2022-08:30:20] [V] [TRT] Tactic: 4915199 time 0.26202 [03/13/2022-08:30:20] [V] [TRT] Tactic: 4980735 time 0.252308 [03/13/2022-08:30:20] [V] [TRT] Tactic: 5177343 time 0.2379 [03/13/2022-08:30:20] [V] [TRT] Tactic: 5242879 time 0.219876 [03/13/2022-08:30:20] [V] [TRT] Tactic: 5373951 time 0.3302 [03/13/2022-08:30:20] [V] [TRT] Tactic: 5439487 time 0.474468 [03/13/2022-08:30:20] [V] [TRT] Tactic: 5570559 time 0.210624 [03/13/2022-08:30:20] [V] [TRT] Tactic: 5636095 time 0.2072 [03/13/2022-08:30:20] [V] [TRT] Tactic: 5701631 time 0.236904 [03/13/2022-08:30:20] [V] [TRT] Tactic: 5767167 time 0.94626 [03/13/2022-08:30:20] [V] [TRT] Tactic: 5832703 time 0.19076 [03/13/2022-08:30:20] [V] [TRT] Tactic: 5898239 time 0.200188 [03/13/2022-08:30:20] [V] [TRT] Tactic: 6029311 time 0.273544 [03/13/2022-08:30:20] [V] [TRT] Tactic: 6225919 time 0.231428 [03/13/2022-08:30:20] [V] [TRT] Tactic: 6291455 time 0.196408 [03/13/2022-08:30:20] [V] [TRT] Tactic: 6422527 time 0.230764 [03/13/2022-08:30:20] [V] [TRT] Tactic: 6750207 time 0.31794 [03/13/2022-08:30:20] [V] [TRT] Tactic: 6815743 time 0.293368 [03/13/2022-08:30:20] [V] [TRT] Tactic: 6946815 time 0.411124 [03/13/2022-08:30:20] [V] [TRT] Tactic: 7012351 time 0.278096 [03/13/2022-08:30:20] [V] [TRT] Tactic: 7077887 time 0.183296 [03/13/2022-08:30:20] [V] [TRT] Tactic: 7143423 time 0.441248 [03/13/2022-08:30:20] [V] [TRT] Tactic: 7208959 time 0.214536 [03/13/2022-08:30:20] [V] [TRT] Tactic: 7340031 time 0.21822 [03/13/2022-08:30:21] [V] [TRT] Tactic: 7405567 time 0.202188 [03/13/2022-08:30:21] [V] [TRT] Tactic: 7536639 time 0.367616 [03/13/2022-08:30:21] [V] [TRT] Tactic: 7602175 time 0.263656 [03/13/2022-08:30:21] [V] [TRT] Tactic: 7733247 time 0.198052 [03/13/2022-08:30:21] [V] [TRT] Tactic: 7798783 time 0.26666 [03/13/2022-08:30:21] [V] [TRT] Tactic: 8191999 time 0.329728 [03/13/2022-08:30:21] [V] [TRT] Tactic: 8257535 time 0.28828 [03/13/2022-08:30:21] [V] [TRT] Tactic: 8323071 time 0.307048 [03/13/2022-08:30:21] [V] [TRT] Tactic: 8650751 time 0.311836 [03/13/2022-08:30:21] [V] [TRT] Tactic: 8716287 time 0.30784 [03/13/2022-08:30:21] [V] [TRT] Tactic: 9109503 time 0.304968 [03/13/2022-08:30:21] [V] [TRT] Tactic: 9568255 time 0.261896 [03/13/2022-08:30:21] [V] [TRT] Tactic: 9895935 time 0.265892 [03/13/2022-08:30:21] [V] [TRT] Tactic: 10223615 time 0.232824 [03/13/2022-08:30:21] [V] [TRT] Tactic: 10354687 time 0.25568 [03/13/2022-08:30:21] [V] [TRT] Tactic: 10551295 time 0.31248 [03/13/2022-08:30:21] [V] [TRT] Tactic: 10747903 time 0.183328 [03/13/2022-08:30:21] [V] [TRT] Tactic: 10944511 time 0.251252 [03/13/2022-08:30:21] [V] [TRT] Fastest Tactic: 7077887 Time: 0.183296 [03/13/2022-08:30:21] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (CaskConvolution) [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Tactic: 1754569683116234317 time 0.155244 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Tactic: 1825138533642645384 time 0.155756 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Tactic: 2733356012094739613 time 0.122804 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Tactic: 3915320020053085238 time 0.155748 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Tactic: 6808617066150061604 time 0.117424 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Tactic: 9091006216302412844 time 0.110844 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Tactic: -8060443123034038864 time 0.118656 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Tactic: -4420849921117327522 time 0.142192 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Tactic: -3946921629105938337 time 0.135104 [03/13/2022-08:30:21] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.110844 [03/13/2022-08:30:21] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (CudaConvolution) [03/13/2022-08:30:21] [V] [TRT] Tactic: 0 time 0.225256 [03/13/2022-08:30:21] [V] [TRT] Tactic: 2 time 0.34926 [03/13/2022-08:30:21] [V] [TRT] Tactic: 5 skipped. Scratch requested: 19148800, available: 16777216 [03/13/2022-08:30:21] [V] [TRT] Tactic: 57 time 0.209524 [03/13/2022-08:30:21] [V] [TRT] Fastest Tactic: 57 Time: 0.209524 [03/13/2022-08:30:21] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (CudaDepthwiseConvolution) [03/13/2022-08:30:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:30:21] [V] [TRT] [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:30:21] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:30:21] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (FusedConvActConvolution) [03/13/2022-08:30:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:21] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (CaskConvolution) [03/13/2022-08:30:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:21] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (CudaConvolution) [03/13/2022-08:30:21] [V] [TRT] Tactic: 0 time 0.222052 [03/13/2022-08:30:21] [V] [TRT] Tactic: 1 time 0.252676 [03/13/2022-08:30:21] [V] [TRT] Tactic: 2 time 0.340452 [03/13/2022-08:30:21] [V] [TRT] Tactic: 4 skipped. Scratch requested: 3471523840, available: 16777216 [03/13/2022-08:30:21] [V] [TRT] Tactic: 5 skipped. Scratch requested: 19148800, available: 16777216 [03/13/2022-08:30:21] [V] [TRT] Fastest Tactic: 0 Time: 0.222052 [03/13/2022-08:30:21] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (CudaDepthwiseConvolution) [03/13/2022-08:30:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0 [03/13/2022-08:30:21] [V] [TRT] [03/13/2022-08:30:21] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:30:21] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (FusedConvActConvolution) [03/13/2022-08:30:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:21] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (CaskConvolution) [03/13/2022-08:30:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:21] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (CudaConvolution) [03/13/2022-08:30:21] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:21] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (CudaDepthwiseConvolution) [03/13/2022-08:30:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:21] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:21] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:21] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (FusedConvActConvolution) [03/13/2022-08:30:21] [V] [TRT] Tactic: 589823 time 0.213784 [03/13/2022-08:30:21] [V] [TRT] Tactic: 655359 time 0.111496 [03/13/2022-08:30:21] [V] [TRT] Tactic: 786431 time 0.140524 [03/13/2022-08:30:21] [V] [TRT] Tactic: 851967 time 0.1168 [03/13/2022-08:30:21] [V] [TRT] Tactic: 1179647 time 0.104444 [03/13/2022-08:30:21] [V] [TRT] Tactic: 1310719 time 0.13652 [03/13/2022-08:30:21] [V] [TRT] Tactic: 1376255 time 0.118968 [03/13/2022-08:30:21] [V] [TRT] Tactic: 1441791 time 0.123272 [03/13/2022-08:30:21] [V] [TRT] Tactic: 1507327 time 0.097912 [03/13/2022-08:30:21] [V] [TRT] Tactic: 1638399 time 0.139372 [03/13/2022-08:30:21] [V] [TRT] Tactic: 1835007 time 0.151996 [03/13/2022-08:30:21] [V] [TRT] Tactic: 1900543 time 0.113464 [03/13/2022-08:30:21] [V] [TRT] Tactic: 2097151 time 0.157128 [03/13/2022-08:30:21] [V] [TRT] Tactic: 2162687 time 0.1185 [03/13/2022-08:30:21] [V] [TRT] Tactic: 2293759 time 0.112872 [03/13/2022-08:30:21] [V] [TRT] Tactic: 2359295 time 0.089724 [03/13/2022-08:30:21] [V] [TRT] Tactic: 2686975 time 0.115184 [03/13/2022-08:30:21] [V] [TRT] Tactic: 3080191 time 0.100724 [03/13/2022-08:30:21] [V] [TRT] Tactic: 3342335 time 0.098248 [03/13/2022-08:30:21] [V] [TRT] Tactic: 3407871 time 0.100452 [03/13/2022-08:30:21] [V] [TRT] Tactic: 3538943 time 0.0996 [03/13/2022-08:30:21] [V] [TRT] Tactic: 3670015 time 0.116824 [03/13/2022-08:30:21] [V] [TRT] Tactic: 3932159 time 0.10534 [03/13/2022-08:30:21] [V] [TRT] Tactic: 3997695 time 0.140008 [03/13/2022-08:30:21] [V] [TRT] Tactic: 4063231 time 0.11252 [03/13/2022-08:30:21] [V] [TRT] Tactic: 4194303 time 0.1429 [03/13/2022-08:30:21] [V] [TRT] Tactic: 4259839 time 0.139376 [03/13/2022-08:30:21] [V] [TRT] Tactic: 4325375 time 0.12958 [03/13/2022-08:30:21] [V] [TRT] Tactic: 4521983 time 0.136768 [03/13/2022-08:30:21] [V] [TRT] Tactic: 4587519 time 0.14624 [03/13/2022-08:30:21] [V] [TRT] Tactic: 4653055 time 0.105032 [03/13/2022-08:30:21] [V] [TRT] Tactic: 4915199 time 0.141944 [03/13/2022-08:30:21] [V] [TRT] Tactic: 4980735 time 0.130512 [03/13/2022-08:30:21] [V] [TRT] Tactic: 5177343 time 0.11864 [03/13/2022-08:30:21] [V] [TRT] Tactic: 5242879 time 0.10498 [03/13/2022-08:30:21] [V] [TRT] Tactic: 5373951 time 0.143872 [03/13/2022-08:30:21] [V] [TRT] Tactic: 5439487 time 0.222556 [03/13/2022-08:30:21] [V] [TRT] Tactic: 5570559 time 0.106148 [03/13/2022-08:30:21] [V] [TRT] Tactic: 5636095 time 0.112528 [03/13/2022-08:30:21] [V] [TRT] Tactic: 5701631 time 0.11548 [03/13/2022-08:30:22] [V] [TRT] Tactic: 5767167 time 0.394352 [03/13/2022-08:30:22] [V] [TRT] Tactic: 5832703 time 0.092684 [03/13/2022-08:30:22] [V] [TRT] Tactic: 5898239 time 0.103152 [03/13/2022-08:30:22] [V] [TRT] Tactic: 6029311 time 0.129216 [03/13/2022-08:30:22] [V] [TRT] Tactic: 6225919 time 0.113076 [03/13/2022-08:30:22] [V] [TRT] Tactic: 6291455 time 0.104456 [03/13/2022-08:30:22] [V] [TRT] Tactic: 6422527 time 0.116056 [03/13/2022-08:30:22] [V] [TRT] Tactic: 6750207 time 0.161892 [03/13/2022-08:30:22] [V] [TRT] Tactic: 6815743 time 0.141204 [03/13/2022-08:30:22] [V] [TRT] Tactic: 6946815 time 0.197352 [03/13/2022-08:30:22] [V] [TRT] Tactic: 7012351 time 0.15672 [03/13/2022-08:30:22] [V] [TRT] Tactic: 7077887 time 0.090208 [03/13/2022-08:30:22] [V] [TRT] Tactic: 7143423 time 0.221532 [03/13/2022-08:30:22] [V] [TRT] Tactic: 7208959 time 0.103568 [03/13/2022-08:30:22] [V] [TRT] Tactic: 7340031 time 0.11056 [03/13/2022-08:30:22] [V] [TRT] Tactic: 7405567 time 0.10736 [03/13/2022-08:30:22] [V] [TRT] Tactic: 7536639 time 0.17504 [03/13/2022-08:30:22] [V] [TRT] Tactic: 7602175 time 0.1379 [03/13/2022-08:30:22] [V] [TRT] Tactic: 7733247 time 0.098168 [03/13/2022-08:30:22] [V] [TRT] Tactic: 7798783 time 0.140584 [03/13/2022-08:30:22] [V] [TRT] Tactic: 8191999 time 0.16888 [03/13/2022-08:30:22] [V] [TRT] Tactic: 8257535 time 0.150064 [03/13/2022-08:30:22] [V] [TRT] Tactic: 8323071 time 0.155316 [03/13/2022-08:30:22] [V] [TRT] Tactic: 8650751 time 0.161284 [03/13/2022-08:30:22] [V] [TRT] Tactic: 8716287 time 0.145172 [03/13/2022-08:30:22] [V] [TRT] Tactic: 9109503 time 0.166752 [03/13/2022-08:30:22] [V] [TRT] Tactic: 9568255 time 0.141664 [03/13/2022-08:30:22] [V] [TRT] Tactic: 9895935 time 0.142596 [03/13/2022-08:30:22] [V] [TRT] Tactic: 10223615 time 0.115836 [03/13/2022-08:30:22] [V] [TRT] Tactic: 10354687 time 0.137844 [03/13/2022-08:30:22] [V] [TRT] Tactic: 10551295 time 0.156304 [03/13/2022-08:30:22] [V] [TRT] Tactic: 10747903 time 0.091308 [03/13/2022-08:30:22] [V] [TRT] Tactic: 10944511 time 0.130456 [03/13/2022-08:30:22] [V] [TRT] Fastest Tactic: 2359295 Time: 0.089724 [03/13/2022-08:30:22] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (CaskConvolution) [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: 1651411198763708804 time 0.060744 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: 2418518597804310654 time 0.06114 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: 4318470497547290900 time 0.059868 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: 4930470141256631146 time 0.075472 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: 8292881859266835088 time 0.075756 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: 8401509141903434922 time 0.059996 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: -8654297089785671176 time 0.087784 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: -7516584506774355935 time 0.067544 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: -7140760933967189247 time 0.060924 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: -6004726995029373073 time 0.072976 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: -5719726816705110014 time 0.08774 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: -4097850214384059472 time 0.068472 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: -3717489476759089008 time 0.060436 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: -3689982367035295496 time 0.087916 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: -2640575123064142123 time 0.082968 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: -2534402059426524406 time 0.082908 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: -2027588946874785071 time 0.073384 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: -1968398013367819764 time 0.087948 [03/13/2022-08:30:22] [V] [TRT] Fastest Tactic: 4318470497547290900 Time: 0.059868 [03/13/2022-08:30:22] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (CudaConvolution) [03/13/2022-08:30:22] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:22] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (CudaDepthwiseConvolution) [03/13/2022-08:30:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4318470497547290900 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:22] [V] [TRT] [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:22] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:30:22] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (FusedConvActConvolution) [03/13/2022-08:30:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:22] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (CaskConvolution) [03/13/2022-08:30:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:22] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (CudaConvolution) [03/13/2022-08:30:22] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:22] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (CudaDepthwiseConvolution) [03/13/2022-08:30:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:22] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (FusedConvActConvolution) [03/13/2022-08:30:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:22] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (CaskConvolution) [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:22] [V] [TRT] Tactic: 9576651994278528 time 0.381276 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: 1179757074518529353 time 0.440708 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: 2105695814191699972 time 0.806872 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: 2148106709480872763 time 0.435356 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: 2410442691266548717 time 0.865692 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: 3041642431972138763 time 0.647728 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: 3754069740140581927 time 1.20545 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: 4555462412611657028 time 0.434976 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: 5666160310350604399 time 1.2046 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:22] [V] [TRT] Tactic: 5876997871499382316 time 0.703636 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: 5925270497649423688 time 1.5993 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: 6680916730816870145 time 0.808884 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: 7158029511300006471 time 0.807096 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: 7859952145590271433 time 0.808748 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: 8283847742354150423 time 1.20508 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: -8992262742606384444 time 0.435328 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: -8391760416076885205 time 1.6008 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: -6273232454637933930 time 0.441356 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:22] [V] [TRT] Tactic: -5925110308892264213 time 0.702828 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: -5818527483287834165 time 0.441672 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:22] [V] [TRT] Tactic: -4908848143422991657 time 0.381748 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: -4534876761957424274 time 1.59883 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:22] [V] [TRT] Tactic: -3237051169894153788 time 0.807412 [03/13/2022-08:30:22] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:23] [V] [TRT] Tactic: -3136088851200285532 time 0.647932 [03/13/2022-08:30:23] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:23] [V] [TRT] Tactic: -2586046817576862066 time 0.865432 [03/13/2022-08:30:23] [V] [TRT] Conv_123 || Conv_92 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:23] [V] [TRT] Tactic: -2422160065350346448 time 0.808396 [03/13/2022-08:30:23] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:23] [V] [TRT] Tactic: -1216445540764179377 time 0.865184 [03/13/2022-08:30:23] [V] [TRT] Conv_123 || Conv_92 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:23] [V] [TRT] Tactic: -229563042944049199 time 0.64808 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 9576651994278528 Time: 0.381276 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (CudaConvolution) [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.315684 [03/13/2022-08:30:23] [V] [TRT] Tactic: 1 time 0.275328 [03/13/2022-08:30:23] [V] [TRT] Tactic: 2 time 0.366452 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 1 Time: 0.275328 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: Conv_123 || Conv_92 (CudaDepthwiseConvolution) [03/13/2022-08:30:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:30:23] [V] [TRT] [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.038124 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.074368 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.038124 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.025104 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.029116 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.025104 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.051896 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.022824 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.022824 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.037804 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.021428 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.021428 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.026904 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.026524 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.026524 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.037636 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.074588 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.037636 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.051184 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.022096 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.022096 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.036652 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.01972 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.01972 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.055532 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.022544 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.022544 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.036776 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.0733 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.036776 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.054904 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.020372 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.020372 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.036276 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.015548 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.015548 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.037108 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.01824 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.01824 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.049432 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.096368 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.049432 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.0369 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.013772 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.013772 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.063704 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.01426 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.01426 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.021272 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.04062 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.021272 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.016344 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.015576 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.015576 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.029992 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.016112 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.016112 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.02058 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.022648 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.02058 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.030232 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.026284 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.026284 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.029572 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.024276 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.024276 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.035724 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.024964 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.024964 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.026644 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.018152 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.018152 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.017332 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.015728 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.015728 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.020664 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.041304 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.020664 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.029112 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.009544 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.009544 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.018676 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.011732 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.011732 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.03034 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.014224 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.014224 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.020708 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.03992 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.020708 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.028772 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.013056 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.013056 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.018448 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.008848 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.008848 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.020476 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.010604 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.010604 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.029512 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.051808 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.029512 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.018988 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.008616 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.008616 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:23] [V] [TRT] Tactic: 1002 time 0.035228 [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.00824 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00824 [03/13/2022-08:30:23] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_94, Mul_95) (PointWise) [03/13/2022-08:30:23] [V] [TRT] Tactic: 128 time 0.024284 [03/13/2022-08:30:23] [V] [TRT] Tactic: 256 time 0.024228 [03/13/2022-08:30:23] [V] [TRT] Tactic: 512 time 0.0267 [03/13/2022-08:30:23] [V] [TRT] Tactic: -32 time 0.035956 [03/13/2022-08:30:23] [V] [TRT] Tactic: -64 time 0.02584 [03/13/2022-08:30:23] [V] [TRT] Tactic: -128 time 0.023468 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: -128 Time: 0.023468 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_94, Mul_95) (PointWiseV2) [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.016692 [03/13/2022-08:30:23] [V] [TRT] Tactic: 1 time 0.014588 [03/13/2022-08:30:23] [V] [TRT] Tactic: 2 time 0.013652 [03/13/2022-08:30:23] [V] [TRT] Tactic: 3 time 0.014864 [03/13/2022-08:30:23] [V] [TRT] Tactic: 4 time 0.013424 [03/13/2022-08:30:23] [V] [TRT] Tactic: 5 time 0.012416 [03/13/2022-08:30:23] [V] [TRT] Tactic: 6 time 0.014972 [03/13/2022-08:30:23] [V] [TRT] Tactic: 7 time 0.013772 [03/13/2022-08:30:23] [V] [TRT] Tactic: 8 time 0.01264 [03/13/2022-08:30:23] [V] [TRT] Tactic: 9 time 0.012844 [03/13/2022-08:30:23] [V] [TRT] Tactic: 28 time 0.016456 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 5 Time: 0.012416 [03/13/2022-08:30:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [03/13/2022-08:30:23] [V] [TRT] [03/13/2022-08:30:23] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,12000) -> Float(1,40,1200:32,6000) *************** [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_94, Mul_95) (PointWise) [03/13/2022-08:30:23] [V] [TRT] Tactic: 128 time 0.024388 [03/13/2022-08:30:23] [V] [TRT] Tactic: 256 time 0.024684 [03/13/2022-08:30:23] [V] [TRT] Tactic: 512 time 0.026448 [03/13/2022-08:30:23] [V] [TRT] Tactic: -32 time 0.034772 [03/13/2022-08:30:23] [V] [TRT] Tactic: -64 time 0.025908 [03/13/2022-08:30:23] [V] [TRT] Tactic: -128 time 0.023348 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: -128 Time: 0.023348 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_94, Mul_95) (PointWiseV2) [03/13/2022-08:30:23] [V] [TRT] Tactic: 24 time 0.01482 [03/13/2022-08:30:23] [V] [TRT] Tactic: 25 time 0.01402 [03/13/2022-08:30:23] [V] [TRT] Tactic: 26 time 0.015204 [03/13/2022-08:30:23] [V] [TRT] Tactic: 27 time 0.012916 [03/13/2022-08:30:23] [V] [TRT] Tactic: 31 time 0.014916 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 27 Time: 0.012916 [03/13/2022-08:30:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [03/13/2022-08:30:23] [V] [TRT] [03/13/2022-08:30:23] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_94, Mul_95) (PointWise) [03/13/2022-08:30:23] [V] [TRT] Tactic: 128 time 0.022004 [03/13/2022-08:30:23] [V] [TRT] Tactic: 256 time 0.01988 [03/13/2022-08:30:23] [V] [TRT] Tactic: 512 time 0.01938 [03/13/2022-08:30:23] [V] [TRT] Tactic: -32 time 0.028612 [03/13/2022-08:30:23] [V] [TRT] Tactic: -64 time 0.024148 [03/13/2022-08:30:23] [V] [TRT] Tactic: -128 time 0.022096 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 512 Time: 0.01938 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_94, Mul_95) (PointWiseV2) [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.013364 [03/13/2022-08:30:23] [V] [TRT] Tactic: 1 time 0.01102 [03/13/2022-08:30:23] [V] [TRT] Tactic: 2 time 0.01008 [03/13/2022-08:30:23] [V] [TRT] Tactic: 3 time 0.00958 [03/13/2022-08:30:23] [V] [TRT] Tactic: 4 time 0.008812 [03/13/2022-08:30:23] [V] [TRT] Tactic: 5 time 0.008156 [03/13/2022-08:30:23] [V] [TRT] Tactic: 6 time 0.008628 [03/13/2022-08:30:23] [V] [TRT] Tactic: 7 time 0.008044 [03/13/2022-08:30:23] [V] [TRT] Tactic: 8 time 0.007996 [03/13/2022-08:30:23] [V] [TRT] Tactic: 9 time 0.007964 [03/13/2022-08:30:23] [V] [TRT] Tactic: 28 time 0.013412 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 9 Time: 0.007964 [03/13/2022-08:30:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:30:23] [V] [TRT] [03/13/2022-08:30:23] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_94, Mul_95) (PointWise) [03/13/2022-08:30:23] [V] [TRT] Tactic: 128 time 0.02222 [03/13/2022-08:30:23] [V] [TRT] Tactic: 256 time 0.019732 [03/13/2022-08:30:23] [V] [TRT] Tactic: 512 time 0.019772 [03/13/2022-08:30:23] [V] [TRT] Tactic: -32 time 0.028424 [03/13/2022-08:30:23] [V] [TRT] Tactic: -64 time 0.023968 [03/13/2022-08:30:23] [V] [TRT] Tactic: -128 time 0.021756 [03/13/2022-08:30:23] [V] [TRT] Fastest Tactic: 256 Time: 0.019732 [03/13/2022-08:30:23] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_94, Mul_95) (PointWiseV2) [03/13/2022-08:30:23] [V] [TRT] Tactic: 0 time 0.010252 [03/13/2022-08:30:23] [V] [TRT] Tactic: 1 time 0.009108 [03/13/2022-08:30:23] [V] [TRT] Tactic: 2 time 0.010188 [03/13/2022-08:30:24] [V] [TRT] Tactic: 3 time 0.008688 [03/13/2022-08:30:24] [V] [TRT] Tactic: 4 time 0.009144 [03/13/2022-08:30:24] [V] [TRT] Tactic: 5 time 0.010564 [03/13/2022-08:30:24] [V] [TRT] Tactic: 6 time 0.008192 [03/13/2022-08:30:24] [V] [TRT] Tactic: 7 time 0.008724 [03/13/2022-08:30:24] [V] [TRT] Tactic: 8 time 0.010108 [03/13/2022-08:30:24] [V] [TRT] Tactic: 9 time 0.012348 [03/13/2022-08:30:24] [V] [TRT] Tactic: 10 time 0.014112 [03/13/2022-08:30:24] [V] [TRT] Tactic: 11 time 0.010876 [03/13/2022-08:30:24] [V] [TRT] Tactic: 12 time 0.010224 [03/13/2022-08:30:24] [V] [TRT] Tactic: 13 time 0.009992 [03/13/2022-08:30:24] [V] [TRT] Tactic: 14 time 0.008784 [03/13/2022-08:30:24] [V] [TRT] Tactic: 15 time 0.008652 [03/13/2022-08:30:24] [V] [TRT] Tactic: 16 time 0.009264 [03/13/2022-08:30:24] [V] [TRT] Tactic: 17 time 0.008216 [03/13/2022-08:30:24] [V] [TRT] Tactic: 18 time 0.00806 [03/13/2022-08:30:24] [V] [TRT] Tactic: 19 time 0.008152 [03/13/2022-08:30:24] [V] [TRT] Tactic: 28 time 0.010248 [03/13/2022-08:30:24] [V] [TRT] Tactic: 29 time 0.014 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 18 Time: 0.00806 [03/13/2022-08:30:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:30:24] [V] [TRT] [03/13/2022-08:30:24] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_94, Mul_95) (PointWise) [03/13/2022-08:30:24] [V] [TRT] Tactic: 128 time 0.022348 [03/13/2022-08:30:24] [V] [TRT] Tactic: 256 time 0.020208 [03/13/2022-08:30:24] [V] [TRT] Tactic: 512 time 0.019436 [03/13/2022-08:30:24] [V] [TRT] Tactic: -32 time 0.032884 [03/13/2022-08:30:24] [V] [TRT] Tactic: -64 time 0.027844 [03/13/2022-08:30:24] [V] [TRT] Tactic: -128 time 0.027928 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 512 Time: 0.019436 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_94, Mul_95) (PointWiseV2) [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.010856 [03/13/2022-08:30:24] [V] [TRT] Tactic: 1 time 0.011928 [03/13/2022-08:30:24] [V] [TRT] Tactic: 2 time 0.011736 [03/13/2022-08:30:24] [V] [TRT] Tactic: 3 time 0.014184 [03/13/2022-08:30:24] [V] [TRT] Tactic: 4 time 0.013144 [03/13/2022-08:30:24] [V] [TRT] Tactic: 5 time 0.012128 [03/13/2022-08:30:24] [V] [TRT] Tactic: 6 time 0.019232 [03/13/2022-08:30:24] [V] [TRT] Tactic: 7 time 0.016372 [03/13/2022-08:30:24] [V] [TRT] Tactic: 8 time 0.014192 [03/13/2022-08:30:24] [V] [TRT] Tactic: 9 time 0.016188 [03/13/2022-08:30:24] [V] [TRT] Tactic: 10 time 0.012828 [03/13/2022-08:30:24] [V] [TRT] Tactic: 11 time 0.011628 [03/13/2022-08:30:24] [V] [TRT] Tactic: 12 time 0.01196 [03/13/2022-08:30:24] [V] [TRT] Tactic: 13 time 0.01264 [03/13/2022-08:30:24] [V] [TRT] Tactic: 14 time 0.01262 [03/13/2022-08:30:24] [V] [TRT] Tactic: 15 time 0.012044 [03/13/2022-08:30:24] [V] [TRT] Tactic: 16 time 0.014888 [03/13/2022-08:30:24] [V] [TRT] Tactic: 17 time 0.014004 [03/13/2022-08:30:24] [V] [TRT] Tactic: 18 time 0.013504 [03/13/2022-08:30:24] [V] [TRT] Tactic: 19 time 0.013708 [03/13/2022-08:30:24] [V] [TRT] Tactic: 20 time 0.013208 [03/13/2022-08:30:24] [V] [TRT] Tactic: 21 time 0.013772 [03/13/2022-08:30:24] [V] [TRT] Tactic: 22 time 0.011328 [03/13/2022-08:30:24] [V] [TRT] Tactic: 23 time 0.013428 [03/13/2022-08:30:24] [V] [TRT] Tactic: 24 time 0.01554 [03/13/2022-08:30:24] [V] [TRT] Tactic: 25 time 0.014136 [03/13/2022-08:30:24] [V] [TRT] Tactic: 26 time 0.01506 [03/13/2022-08:30:24] [V] [TRT] Tactic: 27 time 0.011092 [03/13/2022-08:30:24] [V] [TRT] Tactic: 28 time 0.010532 [03/13/2022-08:30:24] [V] [TRT] Tactic: 29 time 0.01006 [03/13/2022-08:30:24] [V] [TRT] Tactic: 30 time 0.011356 [03/13/2022-08:30:24] [V] [TRT] Tactic: 31 time 0.015148 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 29 Time: 0.01006 [03/13/2022-08:30:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 29 [03/13/2022-08:30:24] [V] [TRT] [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.021124 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.040964 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.021124 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.015296 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.01746 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.015296 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.030272 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.014264 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.014264 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.020744 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.014304 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.014304 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.030228 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.026416 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.026416 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.029428 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.024924 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.024924 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.035992 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.025044 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.025044 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.026812 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.018188 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.018188 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.015556 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.015712 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.015556 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.020916 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.04056 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.020916 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.029328 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.011436 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.011436 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.018472 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.011476 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.011476 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.030464 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.012512 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.012512 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.020888 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.039488 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.020888 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.02854 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.010944 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.010944 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.01838 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.0086 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0086 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.019624 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.010836 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.010836 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.02406 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.04984 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.02406 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.018704 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.008312 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.008312 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.03212 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.008212 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.008212 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.015708 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.017724 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.015708 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.030264 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.013848 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.013848 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.02066 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.0139 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0139 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.0302 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.025624 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.025624 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.030068 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.0248 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0248 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.036384 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.02486 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.02486 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.027112 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.017952 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.017952 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.016328 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.015296 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.015296 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.029216 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.009888 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.009888 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.019124 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.011616 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.011616 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.030148 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.013448 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.013448 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.029356 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.009252 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.009252 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.018456 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.008332 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.008332 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.019516 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.010876 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.010876 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:24] [V] [TRT] Tactic: 1002 time 0.019028 [03/13/2022-08:30:24] [V] [TRT] Tactic: 0 time 0.009932 [03/13/2022-08:30:24] [V] [TRT] Fastest Tactic: 0 Time: 0.009932 [03/13/2022-08:30:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:25] [V] [TRT] Tactic: 1002 time 0.031904 [03/13/2022-08:30:25] [V] [TRT] Tactic: 0 time 0.008956 [03/13/2022-08:30:25] [V] [TRT] Fastest Tactic: 0 Time: 0.008956 [03/13/2022-08:30:25] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:30:25] [V] [TRT] --------------- Timing Runner: Conv_96 (FusedConvActConvolution) [03/13/2022-08:30:25] [V] [TRT] Tactic: 589823 time 0.158212 [03/13/2022-08:30:25] [V] [TRT] Tactic: 655359 time 0.085872 [03/13/2022-08:30:25] [V] [TRT] Tactic: 786431 time 0.092304 [03/13/2022-08:30:25] [V] [TRT] Tactic: 851967 time 0.086732 [03/13/2022-08:30:25] [V] [TRT] Tactic: 1179647 time 0.07714 [03/13/2022-08:30:25] [V] [TRT] Tactic: 1310719 time 0.097348 [03/13/2022-08:30:25] [V] [TRT] Tactic: 1376255 time 0.085528 [03/13/2022-08:30:25] [V] [TRT] Tactic: 1441791 time 0.093332 [03/13/2022-08:30:25] [V] [TRT] Tactic: 1507327 time 0.080884 [03/13/2022-08:30:25] [V] [TRT] Tactic: 1638399 time 0.08606 [03/13/2022-08:30:25] [V] [TRT] Tactic: 1835007 time 0.09728 [03/13/2022-08:30:25] [V] [TRT] Tactic: 1900543 time 0.098068 [03/13/2022-08:30:25] [V] [TRT] Tactic: 2097151 time 0.088708 [03/13/2022-08:30:25] [V] [TRT] Tactic: 2162687 time 0.086016 [03/13/2022-08:30:25] [V] [TRT] Tactic: 2293759 time 0.107616 [03/13/2022-08:30:25] [V] [TRT] Tactic: 2359295 time 0.07818 [03/13/2022-08:30:25] [V] [TRT] Tactic: 2686975 time 0.087244 [03/13/2022-08:30:25] [V] [TRT] Tactic: 3080191 time 0.0788 [03/13/2022-08:30:25] [V] [TRT] Tactic: 3342335 time 0.080552 [03/13/2022-08:30:25] [V] [TRT] Tactic: 3407871 time 0.079204 [03/13/2022-08:30:25] [V] [TRT] Tactic: 3538943 time 0.076196 [03/13/2022-08:30:25] [V] [TRT] Tactic: 3670015 time 0.113936 [03/13/2022-08:30:25] [V] [TRT] Tactic: 3932159 time 0.083804 [03/13/2022-08:30:25] [V] [TRT] Tactic: 3997695 time 0.085352 [03/13/2022-08:30:25] [V] [TRT] Tactic: 4063231 time 0.085056 [03/13/2022-08:30:25] [V] [TRT] Tactic: 4194303 time 0.084868 [03/13/2022-08:30:25] [V] [TRT] Tactic: 4259839 time 0.083156 [03/13/2022-08:30:25] [V] [TRT] Tactic: 4325375 time 0.078508 [03/13/2022-08:30:25] [V] [TRT] Tactic: 4521983 time 0.092232 [03/13/2022-08:30:25] [V] [TRT] Tactic: 4587519 time 0.082804 [03/13/2022-08:30:25] [V] [TRT] Tactic: 4653055 time 0.075668 [03/13/2022-08:30:25] [V] [TRT] Tactic: 4915199 time 0.08122 [03/13/2022-08:30:25] [V] [TRT] Tactic: 4980735 time 0.0861 [03/13/2022-08:30:25] [V] [TRT] Tactic: 5177343 time 0.086236 [03/13/2022-08:30:25] [V] [TRT] Tactic: 5242879 time 0.07942 [03/13/2022-08:30:25] [V] [TRT] Tactic: 5373951 time 0.101572 [03/13/2022-08:30:25] [V] [TRT] Tactic: 5439487 time 0.125424 [03/13/2022-08:30:25] [V] [TRT] Tactic: 5570559 time 0.084932 [03/13/2022-08:30:25] [V] [TRT] Tactic: 5636095 time 0.084868 [03/13/2022-08:30:25] [V] [TRT] Tactic: 5701631 time 0.10678 [03/13/2022-08:30:25] [V] [TRT] Tactic: 5767167 time 0.204836 [03/13/2022-08:30:25] [V] [TRT] Tactic: 5832703 time 0.076564 [03/13/2022-08:30:25] [V] [TRT] Tactic: 5898239 time 0.076664 [03/13/2022-08:30:25] [V] [TRT] Tactic: 6029311 time 0.108068 [03/13/2022-08:30:25] [V] [TRT] Tactic: 6225919 time 0.07958 [03/13/2022-08:30:25] [V] [TRT] Tactic: 6291455 time 0.077496 [03/13/2022-08:30:25] [V] [TRT] Tactic: 6422527 time 0.080604 [03/13/2022-08:30:25] [V] [TRT] Tactic: 6750207 time 0.091484 [03/13/2022-08:30:25] [V] [TRT] Tactic: 6815743 time 0.100212 [03/13/2022-08:30:25] [V] [TRT] Tactic: 6946815 time 0.117312 [03/13/2022-08:30:25] [V] [TRT] Tactic: 7012351 time 0.08918 [03/13/2022-08:30:25] [V] [TRT] Tactic: 7077887 time 0.071012 [03/13/2022-08:30:25] [V] [TRT] Tactic: 7143423 time 0.135896 [03/13/2022-08:30:25] [V] [TRT] Tactic: 7208959 time 0.08254 [03/13/2022-08:30:25] [V] [TRT] Tactic: 7340031 time 0.080916 [03/13/2022-08:30:25] [V] [TRT] Tactic: 7405567 time 0.078456 [03/13/2022-08:30:25] [V] [TRT] Tactic: 7536639 time 0.127648 [03/13/2022-08:30:25] [V] [TRT] Tactic: 7602175 time 0.08654 [03/13/2022-08:30:25] [V] [TRT] Tactic: 7733247 time 0.075292 [03/13/2022-08:30:25] [V] [TRT] Tactic: 7798783 time 0.0923 [03/13/2022-08:30:25] [V] [TRT] Tactic: 8191999 time 0.098404 [03/13/2022-08:30:25] [V] [TRT] Tactic: 8257535 time 0.087256 [03/13/2022-08:30:25] [V] [TRT] Tactic: 8323071 time 0.092596 [03/13/2022-08:30:25] [V] [TRT] Tactic: 8650751 time 0.099204 [03/13/2022-08:30:25] [V] [TRT] Tactic: 8716287 time 0.101288 [03/13/2022-08:30:25] [V] [TRT] Tactic: 9109503 time 0.095876 [03/13/2022-08:30:25] [V] [TRT] Tactic: 9568255 time 0.080908 [03/13/2022-08:30:25] [V] [TRT] Tactic: 9895935 time 0.084552 [03/13/2022-08:30:25] [V] [TRT] Tactic: 10223615 time 0.08704 [03/13/2022-08:30:25] [V] [TRT] Tactic: 10354687 time 0.082444 [03/13/2022-08:30:25] [V] [TRT] Tactic: 10551295 time 0.10166 [03/13/2022-08:30:25] [V] [TRT] Tactic: 10747903 time 0.071336 [03/13/2022-08:30:25] [V] [TRT] Tactic: 10944511 time 0.085508 [03/13/2022-08:30:25] [V] [TRT] Fastest Tactic: 7077887 Time: 0.071012 [03/13/2022-08:30:25] [V] [TRT] --------------- Timing Runner: Conv_96 (CaskConvolution) [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Tactic: 1754569683116234317 time 0.05902 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Tactic: 1825138533642645384 time 0.059504 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Tactic: 2733356012094739613 time 0.039832 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Tactic: 3915320020053085238 time 0.059372 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Tactic: 6808617066150061604 time 0.050024 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Tactic: 9091006216302412844 time 0.047172 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Tactic: -8060443123034038864 time 0.050728 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Tactic: -4420849921117327522 time 0.042432 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Tactic: -3946921629105938337 time 0.041676 [03/13/2022-08:30:25] [V] [TRT] Fastest Tactic: 2733356012094739613 Time: 0.039832 [03/13/2022-08:30:25] [V] [TRT] --------------- Timing Runner: Conv_96 (CudaConvolution) [03/13/2022-08:30:25] [V] [TRT] Tactic: 0 time 0.071676 [03/13/2022-08:30:25] [V] [TRT] Tactic: 2 time 0.150948 [03/13/2022-08:30:25] [V] [TRT] Tactic: 5 time 0.195412 [03/13/2022-08:30:25] [V] [TRT] Tactic: 57 time 0.052736 [03/13/2022-08:30:25] [V] [TRT] Fastest Tactic: 57 Time: 0.052736 [03/13/2022-08:30:25] [V] [TRT] --------------- Timing Runner: Conv_96 (CudaDepthwiseConvolution) [03/13/2022-08:30:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2733356012094739613 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:30:25] [V] [TRT] [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:30:25] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:30:25] [V] [TRT] --------------- Timing Runner: Conv_96 (FusedConvActConvolution) [03/13/2022-08:30:25] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:25] [V] [TRT] --------------- Timing Runner: Conv_96 (CaskConvolution) [03/13/2022-08:30:25] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:25] [V] [TRT] --------------- Timing Runner: Conv_96 (CudaConvolution) [03/13/2022-08:30:25] [V] [TRT] Tactic: 0 time 0.06578 [03/13/2022-08:30:25] [V] [TRT] Tactic: 1 time 0.067476 [03/13/2022-08:30:25] [V] [TRT] Tactic: 2 time 0.131536 [03/13/2022-08:30:25] [V] [TRT] Tactic: 4 skipped. Scratch requested: 870584320, available: 16777216 [03/13/2022-08:30:25] [V] [TRT] Tactic: 5 time 0.191192 [03/13/2022-08:30:25] [V] [TRT] Fastest Tactic: 0 Time: 0.06578 [03/13/2022-08:30:25] [V] [TRT] --------------- Timing Runner: Conv_96 (CudaDepthwiseConvolution) [03/13/2022-08:30:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0 [03/13/2022-08:30:25] [V] [TRT] [03/13/2022-08:30:25] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:30:25] [V] [TRT] --------------- Timing Runner: Conv_96 (FusedConvActConvolution) [03/13/2022-08:30:25] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:25] [V] [TRT] --------------- Timing Runner: Conv_96 (CaskConvolution) [03/13/2022-08:30:25] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:25] [V] [TRT] --------------- Timing Runner: Conv_96 (CudaConvolution) [03/13/2022-08:30:25] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:25] [V] [TRT] --------------- Timing Runner: Conv_96 (CudaDepthwiseConvolution) [03/13/2022-08:30:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:25] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:30:25] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:25] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:25] [V] [TRT] --------------- Timing Runner: Conv_96 (FusedConvActConvolution) [03/13/2022-08:30:25] [V] [TRT] Tactic: 589823 time 0.064568 [03/13/2022-08:30:26] [V] [TRT] Tactic: 655359 time 0.043412 [03/13/2022-08:30:26] [V] [TRT] Tactic: 786431 time 0.051132 [03/13/2022-08:30:26] [V] [TRT] Tactic: 851967 time 0.049944 [03/13/2022-08:30:26] [V] [TRT] Tactic: 1179647 time 0.041824 [03/13/2022-08:30:26] [V] [TRT] Tactic: 1310719 time 0.04996 [03/13/2022-08:30:26] [V] [TRT] Tactic: 1376255 time 0.041132 [03/13/2022-08:30:26] [V] [TRT] Tactic: 1441791 time 0.047608 [03/13/2022-08:30:26] [V] [TRT] Tactic: 1507327 time 0.040884 [03/13/2022-08:30:26] [V] [TRT] Tactic: 1638399 time 0.048264 [03/13/2022-08:30:26] [V] [TRT] Tactic: 1835007 time 0.051012 [03/13/2022-08:30:26] [V] [TRT] Tactic: 1900543 time 0.046872 [03/13/2022-08:30:26] [V] [TRT] Tactic: 2162687 time 0.041444 [03/13/2022-08:30:26] [V] [TRT] Tactic: 2293759 time 0.047708 [03/13/2022-08:30:26] [V] [TRT] Tactic: 2359295 time 0.037848 [03/13/2022-08:30:26] [V] [TRT] Tactic: 2686975 time 0.043316 [03/13/2022-08:30:26] [V] [TRT] Tactic: 3080191 time 0.040648 [03/13/2022-08:30:26] [V] [TRT] Tactic: 3342335 time 0.0409 [03/13/2022-08:30:26] [V] [TRT] Tactic: 3407871 time 0.039288 [03/13/2022-08:30:26] [V] [TRT] Tactic: 3538943 time 0.039492 [03/13/2022-08:30:26] [V] [TRT] Tactic: 3670015 time 0.047436 [03/13/2022-08:30:26] [V] [TRT] Tactic: 3932159 time 0.042604 [03/13/2022-08:30:26] [V] [TRT] Tactic: 3997695 time 0.049276 [03/13/2022-08:30:26] [V] [TRT] Tactic: 4063231 time 0.048564 [03/13/2022-08:30:26] [V] [TRT] Tactic: 4194303 time 0.050748 [03/13/2022-08:30:26] [V] [TRT] Tactic: 4325375 time 0.043668 [03/13/2022-08:30:26] [V] [TRT] Tactic: 4521983 time 0.047956 [03/13/2022-08:30:26] [V] [TRT] Tactic: 4587519 time 0.048836 [03/13/2022-08:30:26] [V] [TRT] Tactic: 4653055 time 0.043016 [03/13/2022-08:30:26] [V] [TRT] Tactic: 4915199 time 0.0488 [03/13/2022-08:30:26] [V] [TRT] Tactic: 4980735 time 0.045064 [03/13/2022-08:30:26] [V] [TRT] Tactic: 5177343 time 0.046804 [03/13/2022-08:30:26] [V] [TRT] Tactic: 5242879 time 0.040168 [03/13/2022-08:30:26] [V] [TRT] Tactic: 5373951 time 0.054612 [03/13/2022-08:30:26] [V] [TRT] Tactic: 5439487 time 0.065612 [03/13/2022-08:30:26] [V] [TRT] Tactic: 5570559 time 0.04254 [03/13/2022-08:30:26] [V] [TRT] Tactic: 5636095 time 0.047832 [03/13/2022-08:30:26] [V] [TRT] Tactic: 5701631 time 0.05002 [03/13/2022-08:30:26] [V] [TRT] Tactic: 5767167 time 0.103632 [03/13/2022-08:30:26] [V] [TRT] Tactic: 5832703 time 0.037748 [03/13/2022-08:30:26] [V] [TRT] Tactic: 5898239 time 0.042516 [03/13/2022-08:30:26] [V] [TRT] Tactic: 6029311 time 0.047608 [03/13/2022-08:30:26] [V] [TRT] Tactic: 6225919 time 0.041528 [03/13/2022-08:30:26] [V] [TRT] Tactic: 6291455 time 0.042068 [03/13/2022-08:30:26] [V] [TRT] Tactic: 6422527 time 0.04334 [03/13/2022-08:30:26] [V] [TRT] Tactic: 6750207 time 0.050844 [03/13/2022-08:30:26] [V] [TRT] Tactic: 6815743 time 0.050664 [03/13/2022-08:30:26] [V] [TRT] Tactic: 6946815 time 0.06126 [03/13/2022-08:30:26] [V] [TRT] Tactic: 7077887 time 0.03686 [03/13/2022-08:30:26] [V] [TRT] Tactic: 7143423 time 0.069468 [03/13/2022-08:30:26] [V] [TRT] Tactic: 7208959 time 0.042068 [03/13/2022-08:30:26] [V] [TRT] Tactic: 7340031 time 0.044856 [03/13/2022-08:30:26] [V] [TRT] Tactic: 7405567 time 0.04322 [03/13/2022-08:30:26] [V] [TRT] Tactic: 7536639 time 0.055784 [03/13/2022-08:30:26] [V] [TRT] Tactic: 7602175 time 0.047164 [03/13/2022-08:30:26] [V] [TRT] Tactic: 7733247 time 0.03904 [03/13/2022-08:30:26] [V] [TRT] Tactic: 7798783 time 0.050984 [03/13/2022-08:30:26] [V] [TRT] Tactic: 8191999 time 0.053504 [03/13/2022-08:30:26] [V] [TRT] Tactic: 8257535 time 0.04922 [03/13/2022-08:30:26] [V] [TRT] Tactic: 8323071 time 0.049936 [03/13/2022-08:30:26] [V] [TRT] Tactic: 8650751 time 0.053072 [03/13/2022-08:30:26] [V] [TRT] Tactic: 8716287 time 0.052372 [03/13/2022-08:30:26] [V] [TRT] Tactic: 9568255 time 0.048504 [03/13/2022-08:30:26] [V] [TRT] Tactic: 9895935 time 0.05096 [03/13/2022-08:30:26] [V] [TRT] Tactic: 10223615 time 0.043156 [03/13/2022-08:30:26] [V] [TRT] Tactic: 10354687 time 0.047604 [03/13/2022-08:30:26] [V] [TRT] Tactic: 10551295 time 0.050564 [03/13/2022-08:30:26] [V] [TRT] Tactic: 10747903 time 0.037232 [03/13/2022-08:30:26] [V] [TRT] Tactic: 10944511 time 0.043684 [03/13/2022-08:30:26] [V] [TRT] Fastest Tactic: 7077887 Time: 0.03686 [03/13/2022-08:30:26] [V] [TRT] --------------- Timing Runner: Conv_96 (CaskConvolution) [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: 1651411198763708804 time 0.028276 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: 2418518597804310654 time 0.028232 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: 4318470497547290900 time 0.027528 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: 4930470141256631146 time 0.02916 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: 8292881859266835088 time 0.028884 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: 8401509141903434922 time 0.027552 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: -8654297089785671176 time 0.035744 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: -7516584506774355935 time 0.021156 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: -7140760933967189247 time 0.02752 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: -6004726995029373073 time 0.028424 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: -5719726816705110014 time 0.035808 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: -4097850214384059472 time 0.021104 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: -3717489476759089008 time 0.027468 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: -3689982367035295496 time 0.035628 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: -2640575123064142123 time 0.033316 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: -2534402059426524406 time 0.033412 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: -2027588946874785071 time 0.02136 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: -1968398013367819764 time 0.03568 [03/13/2022-08:30:26] [V] [TRT] Fastest Tactic: -4097850214384059472 Time: 0.021104 [03/13/2022-08:30:26] [V] [TRT] --------------- Timing Runner: Conv_96 (CudaConvolution) [03/13/2022-08:30:26] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:26] [V] [TRT] --------------- Timing Runner: Conv_96 (CudaDepthwiseConvolution) [03/13/2022-08:30:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4097850214384059472 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:26] [V] [TRT] [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:26] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:30:26] [V] [TRT] --------------- Timing Runner: Conv_96 (FusedConvActConvolution) [03/13/2022-08:30:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:26] [V] [TRT] --------------- Timing Runner: Conv_96 (CaskConvolution) [03/13/2022-08:30:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:26] [V] [TRT] --------------- Timing Runner: Conv_96 (CudaConvolution) [03/13/2022-08:30:26] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:26] [V] [TRT] --------------- Timing Runner: Conv_96 (CudaDepthwiseConvolution) [03/13/2022-08:30:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:26] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:30:26] [V] [TRT] Conv_96 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] --------------- Timing Runner: Conv_96 (FusedConvActConvolution) [03/13/2022-08:30:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:26] [V] [TRT] --------------- Timing Runner: Conv_96 (CaskConvolution) [03/13/2022-08:30:26] [V] [TRT] Conv_96 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:26] [V] [TRT] Tactic: 9576651994278528 time 0.120012 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: 1179757074518529353 time 0.268256 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: 2105695814191699972 time 0.40752 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: 2148106709480872763 time 0.221184 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: 2410442691266548717 time 0.265528 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: 3041642431972138763 time 0.263936 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: 3754069740140581927 time 0.40746 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: 4555462412611657028 time 0.221124 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: 5666160310350604399 time 0.407384 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:26] [V] [TRT] Tactic: 5876997871499382316 time 0.246332 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: 5925270497649423688 time 0.405912 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: 6680916730816870145 time 0.488132 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: 7158029511300006471 time 0.407708 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: 7859952145590271433 time 0.488668 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: 8283847742354150423 time 0.407368 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: -8992262742606384444 time 0.221216 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: -8391760416076885205 time 0.405564 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: -6273232454637933930 time 0.268544 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:26] [V] [TRT] Tactic: -5925110308892264213 time 0.245888 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: -5818527483287834165 time 0.26842 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:26] [V] [TRT] Tactic: -4908848143422991657 time 0.120176 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: -4534876761957424274 time 0.406132 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: -3237051169894153788 time 0.40764 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: -3136088851200285532 time 0.264164 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:26] [V] [TRT] Tactic: -2586046817576862066 time 0.265336 [03/13/2022-08:30:26] [V] [TRT] Conv_96 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:27] [V] [TRT] Tactic: -2422160065350346448 time 0.488172 [03/13/2022-08:30:27] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:27] [V] [TRT] Tactic: -1216445540764179377 time 0.265308 [03/13/2022-08:30:27] [V] [TRT] Conv_96 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:27] [V] [TRT] Tactic: -229563042944049199 time 0.264192 [03/13/2022-08:30:27] [V] [TRT] Fastest Tactic: 9576651994278528 Time: 0.120012 [03/13/2022-08:30:27] [V] [TRT] --------------- Timing Runner: Conv_96 (CudaConvolution) [03/13/2022-08:30:27] [V] [TRT] Tactic: 0 time 0.08812 [03/13/2022-08:30:27] [V] [TRT] Tactic: 1 time 0.078852 [03/13/2022-08:30:27] [V] [TRT] Tactic: 2 time 0.139996 [03/13/2022-08:30:27] [V] [TRT] Fastest Tactic: 1 Time: 0.078852 [03/13/2022-08:30:27] [V] [TRT] --------------- Timing Runner: Conv_96 (CudaDepthwiseConvolution) [03/13/2022-08:30:27] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:30:27] [V] [TRT] [03/13/2022-08:30:27] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:27] [V] [TRT] Tactic: 1002 time 0.021264 [03/13/2022-08:30:27] [V] [TRT] Tactic: 0 time 0.040944 [03/13/2022-08:30:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.021264 [03/13/2022-08:30:27] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:27] [V] [TRT] Tactic: 1002 time 0.020992 [03/13/2022-08:30:27] [V] [TRT] Tactic: 0 time 0.0405 [03/13/2022-08:30:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.020992 [03/13/2022-08:30:27] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:27] [V] [TRT] Tactic: 1002 time 0.020684 [03/13/2022-08:30:27] [V] [TRT] Tactic: 0 time 0.039516 [03/13/2022-08:30:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.020684 [03/13/2022-08:30:27] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:27] [V] [TRT] Tactic: 1002 time 0.024264 [03/13/2022-08:30:27] [V] [TRT] Tactic: 0 time 0.049664 [03/13/2022-08:30:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.024264 [03/13/2022-08:30:27] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:30:27] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_98, Mul_99) (PointWise) [03/13/2022-08:30:27] [V] [TRT] Tactic: 128 time 0.02128 [03/13/2022-08:30:27] [V] [TRT] Tactic: 256 time 0.021812 [03/13/2022-08:30:27] [V] [TRT] Tactic: 512 time 0.023876 [03/13/2022-08:30:27] [V] [TRT] Tactic: -32 time 0.035668 [03/13/2022-08:30:27] [V] [TRT] Tactic: -64 time 0.025252 [03/13/2022-08:30:27] [V] [TRT] Tactic: -128 time 0.023032 [03/13/2022-08:30:27] [V] [TRT] Fastest Tactic: 128 Time: 0.02128 [03/13/2022-08:30:27] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_98, Mul_99) (PointWiseV2) [03/13/2022-08:30:27] [V] [TRT] Tactic: 0 time 0.01608 [03/13/2022-08:30:27] [V] [TRT] Tactic: 1 time 0.014256 [03/13/2022-08:30:27] [V] [TRT] Tactic: 2 time 0.014072 [03/13/2022-08:30:27] [V] [TRT] Tactic: 3 time 0.014524 [03/13/2022-08:30:27] [V] [TRT] Tactic: 4 time 0.013676 [03/13/2022-08:30:27] [V] [TRT] Tactic: 5 time 0.013308 [03/13/2022-08:30:27] [V] [TRT] Tactic: 6 time 0.014888 [03/13/2022-08:30:27] [V] [TRT] Tactic: 7 time 0.013776 [03/13/2022-08:30:27] [V] [TRT] Tactic: 8 time 0.013192 [03/13/2022-08:30:27] [V] [TRT] Tactic: 9 time 0.012524 [03/13/2022-08:30:27] [V] [TRT] Tactic: 28 time 0.01596 [03/13/2022-08:30:27] [V] [TRT] Fastest Tactic: 9 Time: 0.012524 [03/13/2022-08:30:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:30:27] [V] [TRT] [03/13/2022-08:30:27] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,6000) -> Float(1,40,1200:32,6000) *************** [03/13/2022-08:30:27] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_98, Mul_99) (PointWise) [03/13/2022-08:30:27] [V] [TRT] Tactic: 128 time 0.021468 [03/13/2022-08:30:27] [V] [TRT] Tactic: 256 time 0.021488 [03/13/2022-08:30:27] [V] [TRT] Tactic: 512 time 0.02408 [03/13/2022-08:30:27] [V] [TRT] Tactic: -32 time 0.035496 [03/13/2022-08:30:27] [V] [TRT] Tactic: -64 time 0.025216 [03/13/2022-08:30:27] [V] [TRT] Tactic: -128 time 0.023392 [03/13/2022-08:30:27] [V] [TRT] Fastest Tactic: 128 Time: 0.021468 [03/13/2022-08:30:27] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_98, Mul_99) (PointWiseV2) [03/13/2022-08:30:27] [V] [TRT] Tactic: 24 time 0.014788 [03/13/2022-08:30:27] [V] [TRT] Tactic: 25 time 0.014884 [03/13/2022-08:30:27] [V] [TRT] Tactic: 26 time 0.014384 [03/13/2022-08:30:27] [V] [TRT] Tactic: 27 time 0.014252 [03/13/2022-08:30:27] [V] [TRT] Tactic: 31 time 0.014648 [03/13/2022-08:30:27] [V] [TRT] Fastest Tactic: 27 Time: 0.014252 [03/13/2022-08:30:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [03/13/2022-08:30:27] [V] [TRT] [03/13/2022-08:30:27] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:30:27] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_98, Mul_99) (PointWise) [03/13/2022-08:30:27] [V] [TRT] Tactic: 128 time 0.020616 [03/13/2022-08:30:27] [V] [TRT] Tactic: 256 time 0.018724 [03/13/2022-08:30:27] [V] [TRT] Tactic: 512 time 0.018568 [03/13/2022-08:30:27] [V] [TRT] Tactic: -32 time 0.02836 [03/13/2022-08:30:27] [V] [TRT] Tactic: -64 time 0.023576 [03/13/2022-08:30:27] [V] [TRT] Tactic: -128 time 0.0213 [03/13/2022-08:30:27] [V] [TRT] Fastest Tactic: 512 Time: 0.018568 [03/13/2022-08:30:27] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_98, Mul_99) (PointWiseV2) [03/13/2022-08:30:27] [V] [TRT] Tactic: 0 time 0.012088 [03/13/2022-08:30:27] [V] [TRT] Tactic: 1 time 0.009916 [03/13/2022-08:30:27] [V] [TRT] Tactic: 2 time 0.008996 [03/13/2022-08:30:27] [V] [TRT] Tactic: 3 time 0.008704 [03/13/2022-08:30:27] [V] [TRT] Tactic: 4 time 0.00828 [03/13/2022-08:30:27] [V] [TRT] Tactic: 5 time 0.008016 [03/13/2022-08:30:27] [V] [TRT] Tactic: 6 time 0.0085 [03/13/2022-08:30:27] [V] [TRT] Tactic: 7 time 0.007692 [03/13/2022-08:30:27] [V] [TRT] Tactic: 8 time 0.007112 [03/13/2022-08:30:27] [V] [TRT] Tactic: 9 time 0.007584 [03/13/2022-08:30:27] [V] [TRT] Tactic: 28 time 0.011872 [03/13/2022-08:30:27] [V] [TRT] Fastest Tactic: 8 Time: 0.007112 [03/13/2022-08:30:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:30:27] [V] [TRT] [03/13/2022-08:30:27] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:30:27] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_98, Mul_99) (PointWise) [03/13/2022-08:30:27] [V] [TRT] Tactic: 128 time 0.02086 [03/13/2022-08:30:27] [V] [TRT] Tactic: 256 time 0.018868 [03/13/2022-08:30:27] [V] [TRT] Tactic: 512 time 0.018536 [03/13/2022-08:30:27] [V] [TRT] Tactic: -32 time 0.028564 [03/13/2022-08:30:27] [V] [TRT] Tactic: -64 time 0.023252 [03/13/2022-08:30:27] [V] [TRT] Tactic: -128 time 0.021388 [03/13/2022-08:30:27] [V] [TRT] Fastest Tactic: 512 Time: 0.018536 [03/13/2022-08:30:27] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_98, Mul_99) (PointWiseV2) [03/13/2022-08:30:27] [V] [TRT] Tactic: 0 time 0.0094 [03/13/2022-08:30:27] [V] [TRT] Tactic: 1 time 0.008432 [03/13/2022-08:30:27] [V] [TRT] Tactic: 2 time 0.009232 [03/13/2022-08:30:27] [V] [TRT] Tactic: 3 time 0.008132 [03/13/2022-08:30:27] [V] [TRT] Tactic: 4 time 0.0086 [03/13/2022-08:30:27] [V] [TRT] Tactic: 5 time 0.010168 [03/13/2022-08:30:27] [V] [TRT] Tactic: 6 time 0.008068 [03/13/2022-08:30:27] [V] [TRT] Tactic: 7 time 0.008596 [03/13/2022-08:30:27] [V] [TRT] Tactic: 8 time 0.010048 [03/13/2022-08:30:27] [V] [TRT] Tactic: 9 time 0.012516 [03/13/2022-08:30:27] [V] [TRT] Tactic: 10 time 0.012608 [03/13/2022-08:30:27] [V] [TRT] Tactic: 11 time 0.010172 [03/13/2022-08:30:27] [V] [TRT] Tactic: 12 time 0.00942 [03/13/2022-08:30:27] [V] [TRT] Tactic: 13 time 0.00904 [03/13/2022-08:30:27] [V] [TRT] Tactic: 14 time 0.008716 [03/13/2022-08:30:27] [V] [TRT] Tactic: 15 time 0.00824 [03/13/2022-08:30:27] [V] [TRT] Tactic: 16 time 0.00842 [03/13/2022-08:30:27] [V] [TRT] Tactic: 17 time 0.008008 [03/13/2022-08:30:27] [V] [TRT] Tactic: 18 time 0.007732 [03/13/2022-08:30:27] [V] [TRT] Tactic: 19 time 0.00808 [03/13/2022-08:30:27] [V] [TRT] Tactic: 28 time 0.009084 [03/13/2022-08:30:27] [V] [TRT] Tactic: 29 time 0.012524 [03/13/2022-08:30:27] [V] [TRT] Fastest Tactic: 18 Time: 0.007732 [03/13/2022-08:30:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:30:27] [V] [TRT] [03/13/2022-08:30:27] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:30:27] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_98, Mul_99) (PointWise) [03/13/2022-08:30:27] [V] [TRT] Tactic: 128 time 0.021116 [03/13/2022-08:30:27] [V] [TRT] Tactic: 256 time 0.018556 [03/13/2022-08:30:27] [V] [TRT] Tactic: 512 time 0.018492 [03/13/2022-08:30:27] [V] [TRT] Tactic: -32 time 0.028092 [03/13/2022-08:30:27] [V] [TRT] Tactic: -64 time 0.023532 [03/13/2022-08:30:27] [V] [TRT] Tactic: -128 time 0.02136 [03/13/2022-08:30:27] [V] [TRT] Fastest Tactic: 512 Time: 0.018492 [03/13/2022-08:30:27] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_98, Mul_99) (PointWiseV2) [03/13/2022-08:30:27] [V] [TRT] Tactic: 0 time 0.008684 [03/13/2022-08:30:27] [V] [TRT] Tactic: 1 time 0.009532 [03/13/2022-08:30:27] [V] [TRT] Tactic: 2 time 0.010648 [03/13/2022-08:30:27] [V] [TRT] Tactic: 3 time 0.008684 [03/13/2022-08:30:27] [V] [TRT] Tactic: 4 time 0.010096 [03/13/2022-08:30:27] [V] [TRT] Tactic: 5 time 0.01292 [03/13/2022-08:30:27] [V] [TRT] Tactic: 6 time 0.01108 [03/13/2022-08:30:27] [V] [TRT] Tactic: 7 time 0.0125 [03/13/2022-08:30:27] [V] [TRT] Tactic: 8 time 0.013308 [03/13/2022-08:30:27] [V] [TRT] Tactic: 9 time 0.018432 [03/13/2022-08:30:27] [V] [TRT] Tactic: 10 time 0.009 [03/13/2022-08:30:27] [V] [TRT] Tactic: 11 time 0.00818 [03/13/2022-08:30:27] [V] [TRT] Tactic: 12 time 0.009272 [03/13/2022-08:30:27] [V] [TRT] Tactic: 13 time 0.007948 [03/13/2022-08:30:27] [V] [TRT] Tactic: 14 time 0.008532 [03/13/2022-08:30:27] [V] [TRT] Tactic: 15 time 0.011336 [03/13/2022-08:30:27] [V] [TRT] Tactic: 16 time 0.008672 [03/13/2022-08:30:27] [V] [TRT] Tactic: 17 time 0.008688 [03/13/2022-08:30:27] [V] [TRT] Tactic: 18 time 0.011136 [03/13/2022-08:30:27] [V] [TRT] Tactic: 19 time 0.014824 [03/13/2022-08:30:27] [V] [TRT] Tactic: 20 time 0.00972 [03/13/2022-08:30:27] [V] [TRT] Tactic: 21 time 0.008708 [03/13/2022-08:30:27] [V] [TRT] Tactic: 22 time 0.008196 [03/13/2022-08:30:27] [V] [TRT] Tactic: 23 time 0.008008 [03/13/2022-08:30:27] [V] [TRT] Tactic: 24 time 0.012552 [03/13/2022-08:30:27] [V] [TRT] Tactic: 25 time 0.010192 [03/13/2022-08:30:27] [V] [TRT] Tactic: 26 time 0.008992 [03/13/2022-08:30:27] [V] [TRT] Tactic: 27 time 0.008332 [03/13/2022-08:30:27] [V] [TRT] Tactic: 28 time 0.0089 [03/13/2022-08:30:27] [V] [TRT] Tactic: 29 time 0.009044 [03/13/2022-08:30:27] [V] [TRT] Tactic: 30 time 0.009908 [03/13/2022-08:30:27] [V] [TRT] Tactic: 31 time 0.0126 [03/13/2022-08:30:27] [V] [TRT] Fastest Tactic: 13 Time: 0.007948 [03/13/2022-08:30:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 13 [03/13/2022-08:30:27] [V] [TRT] [03/13/2022-08:30:27] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:30:27] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:30:27] [V] [TRT] Conv_100 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:30:27] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:30:27] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:30:27] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:30:27] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:30:27] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:30:27] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:30:27] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:30:27] [V] [TRT] --------------- Timing Runner: Conv_100 (FusedConvActConvolution) [03/13/2022-08:30:27] [V] [TRT] Tactic: 524287 time 0.304496 [03/13/2022-08:30:27] [V] [TRT] Tactic: 720895 time 0.295104 [03/13/2022-08:30:27] [V] [TRT] Tactic: 983039 time 0.29082 [03/13/2022-08:30:27] [V] [TRT] Tactic: 1048575 time 0.267668 [03/13/2022-08:30:27] [V] [TRT] Tactic: 1703935 time 0.236292 [03/13/2022-08:30:27] [V] [TRT] Tactic: 1769471 time 0.29168 [03/13/2022-08:30:28] [V] [TRT] Tactic: 1966079 time 0.391176 [03/13/2022-08:30:28] [V] [TRT] Tactic: 2031615 time 0.324848 [03/13/2022-08:30:28] [V] [TRT] Tactic: 2228223 time 0.24364 [03/13/2022-08:30:28] [V] [TRT] Tactic: 2424831 time 0.21868 [03/13/2022-08:30:28] [V] [TRT] Tactic: 2621439 time 0.249628 [03/13/2022-08:30:28] [V] [TRT] Tactic: 2752511 time 0.283096 [03/13/2022-08:30:28] [V] [TRT] Tactic: 2818047 time 0.390944 [03/13/2022-08:30:28] [V] [TRT] Tactic: 2883583 time 0.464056 [03/13/2022-08:30:28] [V] [TRT] Tactic: 3014655 time 0.245584 [03/13/2022-08:30:28] [V] [TRT] Tactic: 3145727 time 0.26592 [03/13/2022-08:30:28] [V] [TRT] Tactic: 3473407 time 0.372956 [03/13/2022-08:30:28] [V] [TRT] Tactic: 3604479 time 0.242756 [03/13/2022-08:30:28] [V] [TRT] Tactic: 3735551 time 0.40324 [03/13/2022-08:30:28] [V] [TRT] Tactic: 4390911 time 0.423112 [03/13/2022-08:30:28] [V] [TRT] Tactic: 5046271 time 0.251916 [03/13/2022-08:30:28] [V] [TRT] Tactic: 5963775 time 0.355832 [03/13/2022-08:30:28] [V] [TRT] Tactic: 6160383 time 0.297684 [03/13/2022-08:30:28] [V] [TRT] Tactic: 6488063 time 0.291824 [03/13/2022-08:30:28] [V] [TRT] Tactic: 6881279 time 0.35634 [03/13/2022-08:30:28] [V] [TRT] Tactic: 7274495 time 0.27428 [03/13/2022-08:30:28] [V] [TRT] Tactic: 7864319 time 0.271608 [03/13/2022-08:30:28] [V] [TRT] Tactic: 7995391 time 0.307936 [03/13/2022-08:30:28] [V] [TRT] Tactic: 8585215 time 0.308144 [03/13/2022-08:30:28] [V] [TRT] Tactic: 8847359 time 0.307856 [03/13/2022-08:30:28] [V] [TRT] Tactic: 8978431 time 0.355988 [03/13/2022-08:30:28] [V] [TRT] Tactic: 9043967 time 0.259132 [03/13/2022-08:30:28] [V] [TRT] Tactic: 9175039 time 0.242992 [03/13/2022-08:30:28] [V] [TRT] Tactic: 9502719 time 0.312192 [03/13/2022-08:30:28] [V] [TRT] Tactic: 9830399 time 0.364484 [03/13/2022-08:30:28] [V] [TRT] Tactic: 9961471 time 0.267936 [03/13/2022-08:30:28] [V] [TRT] Tactic: 10027007 time 0.247196 [03/13/2022-08:30:28] [V] [TRT] Tactic: 10092543 time 0.422988 [03/13/2022-08:30:28] [V] [TRT] Tactic: 10289151 time 0.390712 [03/13/2022-08:30:28] [V] [TRT] Tactic: 10485759 time 0.222272 [03/13/2022-08:30:28] [V] [TRT] Tactic: 10682367 time 0.223276 [03/13/2022-08:30:28] [V] [TRT] Tactic: 10813439 time 0.268608 [03/13/2022-08:30:28] [V] [TRT] Fastest Tactic: 2424831 Time: 0.21868 [03/13/2022-08:30:28] [V] [TRT] --------------- Timing Runner: Conv_100 (CaskConvolution) [03/13/2022-08:30:28] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Tactic: 1825138533642645384 time 0.434052 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:30:28] [V] [TRT] Tactic: 2775507031594384867 time 0.187988 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Tactic: 2842488832350522458 time 0.339708 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Tactic: 3915320020053085238 time 0.429052 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Tactic: 6448355332020552203 time 0.444996 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Tactic: 6808617066150061604 time 0.348416 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Tactic: -8060443123034038864 time 0.359288 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Tactic: -4420849921117327522 time 0.304616 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Tactic: -3946921629105938337 time 0.284808 [03/13/2022-08:30:28] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.187988 [03/13/2022-08:30:28] [V] [TRT] --------------- Timing Runner: Conv_100 (CudaConvolution) [03/13/2022-08:30:28] [V] [TRT] Tactic: 0 time 0.490496 [03/13/2022-08:30:28] [V] [TRT] Tactic: 2 time 0.545732 [03/13/2022-08:30:28] [V] [TRT] Tactic: 5 skipped. Scratch requested: 114196480, available: 16777216 [03/13/2022-08:30:28] [V] [TRT] Tactic: 6 time 0.21614 [03/13/2022-08:30:28] [V] [TRT] Tactic: 57 time 0.317964 [03/13/2022-08:30:28] [V] [TRT] Fastest Tactic: 6 Time: 0.21614 [03/13/2022-08:30:28] [V] [TRT] --------------- Timing Runner: Conv_100 (CudaDepthwiseConvolution) [03/13/2022-08:30:28] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:30:28] [V] [TRT] [03/13/2022-08:30:28] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:30:28] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:30:28] [V] [TRT] --------------- Timing Runner: Conv_100 (FusedConvActConvolution) [03/13/2022-08:30:28] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:28] [V] [TRT] --------------- Timing Runner: Conv_100 (CaskConvolution) [03/13/2022-08:30:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:28] [V] [TRT] --------------- Timing Runner: Conv_100 (CudaConvolution) [03/13/2022-08:30:28] [V] [TRT] Tactic: 0 time 0.48102 [03/13/2022-08:30:28] [V] [TRT] Tactic: 1 time 0.3553 [03/13/2022-08:30:28] [V] [TRT] Tactic: 2 time 0.521164 [03/13/2022-08:30:28] [V] [TRT] Tactic: 4 skipped. Scratch requested: 871403520, available: 16777216 [03/13/2022-08:30:28] [V] [TRT] Tactic: 5 skipped. Scratch requested: 114196480, available: 16777216 [03/13/2022-08:30:28] [V] [TRT] Tactic: 6 time 0.30696 [03/13/2022-08:30:28] [V] [TRT] Fastest Tactic: 6 Time: 0.30696 [03/13/2022-08:30:28] [V] [TRT] --------------- Timing Runner: Conv_100 (CudaDepthwiseConvolution) [03/13/2022-08:30:28] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [03/13/2022-08:30:28] [V] [TRT] [03/13/2022-08:30:28] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:30:28] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:28] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:30:28] [V] [TRT] --------------- Timing Runner: Conv_100 (FusedConvActConvolution) [03/13/2022-08:30:28] [V] [TRT] Tactic: 524287 time 0.152468 [03/13/2022-08:30:29] [V] [TRT] Tactic: 720895 time 0.145688 [03/13/2022-08:30:29] [V] [TRT] Tactic: 983039 time 0.145884 [03/13/2022-08:30:29] [V] [TRT] Tactic: 1048575 time 0.137108 [03/13/2022-08:30:29] [V] [TRT] Tactic: 1703935 time 0.118852 [03/13/2022-08:30:29] [V] [TRT] Tactic: 1769471 time 0.161036 [03/13/2022-08:30:29] [V] [TRT] Tactic: 1966079 time 0.195048 [03/13/2022-08:30:29] [V] [TRT] Tactic: 2031615 time 0.162912 [03/13/2022-08:30:29] [V] [TRT] Tactic: 2228223 time 0.12084 [03/13/2022-08:30:29] [V] [TRT] Tactic: 2424831 time 0.113944 [03/13/2022-08:30:29] [V] [TRT] Tactic: 2621439 time 0.126604 [03/13/2022-08:30:29] [V] [TRT] Tactic: 2752511 time 0.148028 [03/13/2022-08:30:29] [V] [TRT] Tactic: 2818047 time 0.19682 [03/13/2022-08:30:29] [V] [TRT] Tactic: 2883583 time 0.232004 [03/13/2022-08:30:29] [V] [TRT] Tactic: 3014655 time 0.123552 [03/13/2022-08:30:29] [V] [TRT] Tactic: 3145727 time 0.134484 [03/13/2022-08:30:29] [V] [TRT] Tactic: 3473407 time 0.187736 [03/13/2022-08:30:29] [V] [TRT] Tactic: 3604479 time 0.122756 [03/13/2022-08:30:29] [V] [TRT] Tactic: 3735551 time 0.192988 [03/13/2022-08:30:29] [V] [TRT] Tactic: 4390911 time 0.210984 [03/13/2022-08:30:29] [V] [TRT] Tactic: 5046271 time 0.130596 [03/13/2022-08:30:29] [V] [TRT] Tactic: 5963775 time 0.174464 [03/13/2022-08:30:29] [V] [TRT] Tactic: 6160383 time 0.150916 [03/13/2022-08:30:29] [V] [TRT] Tactic: 6488063 time 0.145284 [03/13/2022-08:30:29] [V] [TRT] Tactic: 6881279 time 0.177596 [03/13/2022-08:30:29] [V] [TRT] Tactic: 7274495 time 0.13654 [03/13/2022-08:30:29] [V] [TRT] Tactic: 7864319 time 0.14426 [03/13/2022-08:30:29] [V] [TRT] Tactic: 7995391 time 0.154216 [03/13/2022-08:30:29] [V] [TRT] Tactic: 8585215 time 0.15394 [03/13/2022-08:30:29] [V] [TRT] Tactic: 8847359 time 0.15942 [03/13/2022-08:30:29] [V] [TRT] Tactic: 8978431 time 0.177176 [03/13/2022-08:30:29] [V] [TRT] Tactic: 9043967 time 0.130824 [03/13/2022-08:30:29] [V] [TRT] Tactic: 9175039 time 0.12332 [03/13/2022-08:30:29] [V] [TRT] Tactic: 9502719 time 0.154056 [03/13/2022-08:30:29] [V] [TRT] Tactic: 9830399 time 0.184036 [03/13/2022-08:30:29] [V] [TRT] Tactic: 9961471 time 0.146516 [03/13/2022-08:30:29] [V] [TRT] Tactic: 10027007 time 0.124908 [03/13/2022-08:30:29] [V] [TRT] Tactic: 10092543 time 0.210768 [03/13/2022-08:30:29] [V] [TRT] Tactic: 10289151 time 0.195032 [03/13/2022-08:30:29] [V] [TRT] Tactic: 10485759 time 0.1131 [03/13/2022-08:30:29] [V] [TRT] Tactic: 10682367 time 0.117368 [03/13/2022-08:30:29] [V] [TRT] Tactic: 10813439 time 0.136064 [03/13/2022-08:30:29] [V] [TRT] Fastest Tactic: 10485759 Time: 0.1131 [03/13/2022-08:30:29] [V] [TRT] --------------- Timing Runner: Conv_100 (CaskConvolution) [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: 1145226902788474763 time 0.180188 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: 1651411198763708804 time 0.179964 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: 2418518597804310654 time 0.180156 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: 4318470497547290900 time 0.175172 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: 4653005425971292725 time 0.181492 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: 4930470141256631146 time 0.13098 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: 8292881859266835088 time 0.130092 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: 8401509141903434922 time 0.17462 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: -8654297089785671176 time 0.224816 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: -7448936905981214224 time 0.136632 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: -6004726995029373073 time 0.125104 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: -5719726816705110014 time 0.22458 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: -3754890472406891741 time 0.232284 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: -3689982367035295496 time 0.22752 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: -3140347171730126532 time 0.100592 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: -2894005464278291378 time 0.189272 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: -2027588946874785071 time 0.124264 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: -1968398013367819764 time 0.228164 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: -245090590808296743 time 0.232704 [03/13/2022-08:30:29] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.100592 [03/13/2022-08:30:29] [V] [TRT] --------------- Timing Runner: Conv_100 (CudaConvolution) [03/13/2022-08:30:29] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:29] [V] [TRT] --------------- Timing Runner: Conv_100 (CudaDepthwiseConvolution) [03/13/2022-08:30:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:30:29] [V] [TRT] [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:30:29] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:30:29] [V] [TRT] --------------- Timing Runner: Conv_100 (FusedConvActConvolution) [03/13/2022-08:30:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:29] [V] [TRT] --------------- Timing Runner: Conv_100 (CaskConvolution) [03/13/2022-08:30:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:29] [V] [TRT] --------------- Timing Runner: Conv_100 (CudaConvolution) [03/13/2022-08:30:29] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:29] [V] [TRT] --------------- Timing Runner: Conv_100 (CudaDepthwiseConvolution) [03/13/2022-08:30:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:29] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:30:29] [V] [TRT] Conv_100 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:29] [V] [TRT] Conv_100 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:29] [V] [TRT] Conv_100 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] --------------- Timing Runner: Conv_100 (FusedConvActConvolution) [03/13/2022-08:30:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:29] [V] [TRT] --------------- Timing Runner: Conv_100 (CaskConvolution) [03/13/2022-08:30:29] [V] [TRT] Conv_100 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:29] [V] [TRT] Tactic: 130343752241278875 time 1.15749 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: 2148106709480872763 time 1.92153 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: 2410442691266548717 time 2.48004 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:29] [V] [TRT] Tactic: 2921824978225832523 time 1.01541 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:29] [V] [TRT] Tactic: 3030711443478140260 time 2.2293 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:29] [V] [TRT] Tactic: 3754069740140581927 time 3.7301 [03/13/2022-08:30:29] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:30] [V] [TRT] Tactic: 3823144360994712832 time 2.3833 [03/13/2022-08:30:30] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:30] [V] [TRT] Tactic: 5635311898703673455 time 2.3038 [03/13/2022-08:30:30] [V] [TRT] Conv_100 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:30] [V] [TRT] Tactic: 5925270497649423688 time 3.57818 [03/13/2022-08:30:30] [V] [TRT] Conv_100 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:30] [V] [TRT] Tactic: 6680916730816870145 time 4.29574 [03/13/2022-08:30:30] [V] [TRT] Conv_100 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:30] [V] [TRT] Tactic: 7158029511300006471 time 3.58444 [03/13/2022-08:30:30] [V] [TRT] Conv_100 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:30] [V] [TRT] Tactic: 7859952145590271433 time 4.2978 [03/13/2022-08:30:30] [V] [TRT] Conv_100 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:30] [V] [TRT] Tactic: 8283847742354150423 time 3.73241 [03/13/2022-08:30:30] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:30] [V] [TRT] Tactic: -8992262742606384444 time 1.92143 [03/13/2022-08:30:30] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:30] [V] [TRT] Tactic: -8682550625095202832 time 1.92152 [03/13/2022-08:30:30] [V] [TRT] Conv_100 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:30] [V] [TRT] Tactic: -8379842433586149932 time 2.30992 [03/13/2022-08:30:30] [V] [TRT] Conv_100 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:30] [V] [TRT] Tactic: -6352769237623756264 time 2.21066 [03/13/2022-08:30:30] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:30] [V] [TRT] Tactic: -6273232454637933930 time 2.42351 [03/13/2022-08:30:30] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:30] [V] [TRT] Tactic: -5818527483287834165 time 2.40141 [03/13/2022-08:30:30] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:30] [V] [TRT] Tactic: -4954692664176521434 time 2.36487 [03/13/2022-08:30:30] [V] [TRT] Conv_100 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:30] [V] [TRT] Tactic: -4953888146171240997 time 1.01372 [03/13/2022-08:30:30] [V] [TRT] Conv_100 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:30] [V] [TRT] Tactic: -4534876761957424274 time 3.57991 [03/13/2022-08:30:30] [V] [TRT] Conv_100 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:30] [V] [TRT] Tactic: -3237051169894153788 time 3.72727 [03/13/2022-08:30:30] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:30] [V] [TRT] Tactic: -3136088851200285532 time 2.36213 [03/13/2022-08:30:30] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:30] [V] [TRT] Tactic: -2586046817576862066 time 2.47992 [03/13/2022-08:30:30] [V] [TRT] Conv_100 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:31] [V] [TRT] Tactic: -229563042944049199 time 2.45699 [03/13/2022-08:30:31] [V] [TRT] Fastest Tactic: -4953888146171240997 Time: 1.01372 [03/13/2022-08:30:31] [V] [TRT] --------------- Timing Runner: Conv_100 (CudaConvolution) [03/13/2022-08:30:31] [V] [TRT] Tactic: 0 time 0.998232 [03/13/2022-08:30:31] [V] [TRT] Tactic: 1 time 0.36996 [03/13/2022-08:30:31] [V] [TRT] Tactic: 2 time 0.635516 [03/13/2022-08:30:31] [V] [TRT] Tactic: 6 time 0.263932 [03/13/2022-08:30:31] [V] [TRT] Fastest Tactic: 6 Time: 0.263932 [03/13/2022-08:30:31] [V] [TRT] --------------- Timing Runner: Conv_100 (CudaDepthwiseConvolution) [03/13/2022-08:30:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [03/13/2022-08:30:31] [V] [TRT] [03/13/2022-08:30:31] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000), Float(1,40,1200,192000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:30:31] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_102, Mul_103), Add_104) (PointWise) [03/13/2022-08:30:31] [V] [TRT] Tactic: 128 time 0.024484 [03/13/2022-08:30:31] [V] [TRT] Tactic: 256 time 0.025748 [03/13/2022-08:30:31] [V] [TRT] Tactic: 512 time 0.027988 [03/13/2022-08:30:31] [V] [TRT] Tactic: -32 time 0.042976 [03/13/2022-08:30:31] [V] [TRT] Tactic: -64 time 0.031572 [03/13/2022-08:30:31] [V] [TRT] Tactic: -128 time 0.028712 [03/13/2022-08:30:31] [V] [TRT] Fastest Tactic: 128 Time: 0.024484 [03/13/2022-08:30:31] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_102, Mul_103), Add_104) (PointWiseV2) [03/13/2022-08:30:31] [V] [TRT] Tactic: 0 time 0.018312 [03/13/2022-08:30:31] [V] [TRT] Tactic: 1 time 0.018164 [03/13/2022-08:30:31] [V] [TRT] Tactic: 2 time 0.018372 [03/13/2022-08:30:31] [V] [TRT] Tactic: 3 time 0.018452 [03/13/2022-08:30:31] [V] [TRT] Tactic: 4 time 0.01832 [03/13/2022-08:30:31] [V] [TRT] Tactic: 5 time 0.018016 [03/13/2022-08:30:31] [V] [TRT] Tactic: 6 time 0.018376 [03/13/2022-08:30:31] [V] [TRT] Tactic: 7 time 0.018616 [03/13/2022-08:30:31] [V] [TRT] Tactic: 8 time 0.018396 [03/13/2022-08:30:31] [V] [TRT] Tactic: 9 time 0.01806 [03/13/2022-08:30:31] [V] [TRT] Tactic: 28 time 0.018196 [03/13/2022-08:30:31] [V] [TRT] Fastest Tactic: 5 Time: 0.018016 [03/13/2022-08:30:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [03/13/2022-08:30:31] [V] [TRT] [03/13/2022-08:30:31] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,6000), Float(1,40,1200:32,6000) -> Float(1,40,1200:32,6000) *************** [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_102, Mul_103), Add_104) (PointWise) [03/13/2022-08:30:32] [V] [TRT] Tactic: 128 time 0.024992 [03/13/2022-08:30:32] [V] [TRT] Tactic: 256 time 0.025444 [03/13/2022-08:30:32] [V] [TRT] Tactic: 512 time 0.028572 [03/13/2022-08:30:32] [V] [TRT] Tactic: -32 time 0.042944 [03/13/2022-08:30:32] [V] [TRT] Tactic: -64 time 0.031796 [03/13/2022-08:30:32] [V] [TRT] Tactic: -128 time 0.028616 [03/13/2022-08:30:32] [V] [TRT] Fastest Tactic: 128 Time: 0.024992 [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_102, Mul_103), Add_104) (PointWiseV2) [03/13/2022-08:30:32] [V] [TRT] Tactic: 24 time 0.02448 [03/13/2022-08:30:32] [V] [TRT] Tactic: 25 time 0.024244 [03/13/2022-08:30:32] [V] [TRT] Tactic: 26 time 0.023796 [03/13/2022-08:30:32] [V] [TRT] Tactic: 27 time 0.019912 [03/13/2022-08:30:32] [V] [TRT] Tactic: 31 time 0.024324 [03/13/2022-08:30:32] [V] [TRT] Fastest Tactic: 27 Time: 0.019912 [03/13/2022-08:30:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [03/13/2022-08:30:32] [V] [TRT] [03/13/2022-08:30:32] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000), Half(1,40,1200,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_102, Mul_103), Add_104) (PointWise) [03/13/2022-08:30:32] [V] [TRT] Tactic: 128 time 0.026676 [03/13/2022-08:30:32] [V] [TRT] Tactic: 256 time 0.025216 [03/13/2022-08:30:32] [V] [TRT] Tactic: 512 time 0.02524 [03/13/2022-08:30:32] [V] [TRT] Tactic: -32 time 0.043476 [03/13/2022-08:30:32] [V] [TRT] Tactic: -64 time 0.032224 [03/13/2022-08:30:32] [V] [TRT] Tactic: -128 time 0.029124 [03/13/2022-08:30:32] [V] [TRT] Fastest Tactic: 256 Time: 0.025216 [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_102, Mul_103), Add_104) (PointWiseV2) [03/13/2022-08:30:32] [V] [TRT] Tactic: 0 time 0.01578 [03/13/2022-08:30:32] [V] [TRT] Tactic: 1 time 0.014056 [03/13/2022-08:30:32] [V] [TRT] Tactic: 2 time 0.01204 [03/13/2022-08:30:32] [V] [TRT] Tactic: 3 time 0.013368 [03/13/2022-08:30:32] [V] [TRT] Tactic: 4 time 0.01104 [03/13/2022-08:30:32] [V] [TRT] Tactic: 5 time 0.010848 [03/13/2022-08:30:32] [V] [TRT] Tactic: 6 time 0.013384 [03/13/2022-08:30:32] [V] [TRT] Tactic: 7 time 0.011108 [03/13/2022-08:30:32] [V] [TRT] Tactic: 8 time 0.010692 [03/13/2022-08:30:32] [V] [TRT] Tactic: 9 time 0.01076 [03/13/2022-08:30:32] [V] [TRT] Tactic: 28 time 0.015824 [03/13/2022-08:30:32] [V] [TRT] Fastest Tactic: 8 Time: 0.010692 [03/13/2022-08:30:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:30:32] [V] [TRT] [03/13/2022-08:30:32] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000), Half(1,40,1200:2,96000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_102, Mul_103), Add_104) (PointWise) [03/13/2022-08:30:32] [V] [TRT] Tactic: 128 time 0.026608 [03/13/2022-08:30:32] [V] [TRT] Tactic: 256 time 0.025492 [03/13/2022-08:30:32] [V] [TRT] Tactic: 512 time 0.025764 [03/13/2022-08:30:32] [V] [TRT] Tactic: -32 time 0.043308 [03/13/2022-08:30:32] [V] [TRT] Tactic: -64 time 0.032356 [03/13/2022-08:30:32] [V] [TRT] Tactic: -128 time 0.029056 [03/13/2022-08:30:32] [V] [TRT] Fastest Tactic: 256 Time: 0.025492 [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_102, Mul_103), Add_104) (PointWiseV2) [03/13/2022-08:30:32] [V] [TRT] Tactic: 0 time 0.012768 [03/13/2022-08:30:32] [V] [TRT] Tactic: 1 time 0.012148 [03/13/2022-08:30:32] [V] [TRT] Tactic: 2 time 0.013184 [03/13/2022-08:30:32] [V] [TRT] Tactic: 3 time 0.012068 [03/13/2022-08:30:32] [V] [TRT] Tactic: 4 time 0.013088 [03/13/2022-08:30:32] [V] [TRT] Tactic: 5 time 0.014992 [03/13/2022-08:30:32] [V] [TRT] Tactic: 6 time 0.012964 [03/13/2022-08:30:32] [V] [TRT] Tactic: 7 time 0.013256 [03/13/2022-08:30:32] [V] [TRT] Tactic: 8 time 0.016712 [03/13/2022-08:30:32] [V] [TRT] Tactic: 9 time 0.021328 [03/13/2022-08:30:32] [V] [TRT] Tactic: 10 time 0.016012 [03/13/2022-08:30:32] [V] [TRT] Tactic: 11 time 0.014464 [03/13/2022-08:30:32] [V] [TRT] Tactic: 12 time 0.0126 [03/13/2022-08:30:32] [V] [TRT] Tactic: 13 time 0.014044 [03/13/2022-08:30:32] [V] [TRT] Tactic: 14 time 0.011908 [03/13/2022-08:30:32] [V] [TRT] Tactic: 15 time 0.01122 [03/13/2022-08:30:32] [V] [TRT] Tactic: 16 time 0.013856 [03/13/2022-08:30:32] [V] [TRT] Tactic: 17 time 0.011984 [03/13/2022-08:30:32] [V] [TRT] Tactic: 18 time 0.01098 [03/13/2022-08:30:32] [V] [TRT] Tactic: 19 time 0.01136 [03/13/2022-08:30:32] [V] [TRT] Tactic: 28 time 0.01272 [03/13/2022-08:30:32] [V] [TRT] Tactic: 29 time 0.015468 [03/13/2022-08:30:32] [V] [TRT] Fastest Tactic: 18 Time: 0.01098 [03/13/2022-08:30:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:30:32] [V] [TRT] [03/13/2022-08:30:32] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000), Half(20,800,1:8,24000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_102, Mul_103), Add_104) (PointWise) [03/13/2022-08:30:32] [V] [TRT] Tactic: 128 time 0.026612 [03/13/2022-08:30:32] [V] [TRT] Tactic: 256 time 0.025284 [03/13/2022-08:30:32] [V] [TRT] Tactic: 512 time 0.025416 [03/13/2022-08:30:32] [V] [TRT] Tactic: -32 time 0.043804 [03/13/2022-08:30:32] [V] [TRT] Tactic: -64 time 0.031808 [03/13/2022-08:30:32] [V] [TRT] Tactic: -128 time 0.029156 [03/13/2022-08:30:32] [V] [TRT] Fastest Tactic: 256 Time: 0.025284 [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_102, Mul_103), Add_104) (PointWiseV2) [03/13/2022-08:30:32] [V] [TRT] Tactic: 0 time 0.014452 [03/13/2022-08:30:32] [V] [TRT] Tactic: 1 time 0.014928 [03/13/2022-08:30:32] [V] [TRT] Tactic: 2 time 0.01922 [03/13/2022-08:30:32] [V] [TRT] Tactic: 3 time 0.012796 [03/13/2022-08:30:32] [V] [TRT] Tactic: 4 time 0.016944 [03/13/2022-08:30:32] [V] [TRT] Tactic: 5 time 0.02376 [03/13/2022-08:30:32] [V] [TRT] Tactic: 6 time 0.016448 [03/13/2022-08:30:32] [V] [TRT] Tactic: 7 time 0.018712 [03/13/2022-08:30:32] [V] [TRT] Tactic: 8 time 0.022628 [03/13/2022-08:30:32] [V] [TRT] Tactic: 9 time 0.032164 [03/13/2022-08:30:32] [V] [TRT] Tactic: 10 time 0.013116 [03/13/2022-08:30:32] [V] [TRT] Tactic: 11 time 0.012388 [03/13/2022-08:30:32] [V] [TRT] Tactic: 12 time 0.014956 [03/13/2022-08:30:32] [V] [TRT] Tactic: 13 time 0.011324 [03/13/2022-08:30:32] [V] [TRT] Tactic: 14 time 0.015712 [03/13/2022-08:30:32] [V] [TRT] Tactic: 15 time 0.020116 [03/13/2022-08:30:32] [V] [TRT] Tactic: 16 time 0.012792 [03/13/2022-08:30:32] [V] [TRT] Tactic: 17 time 0.014696 [03/13/2022-08:30:32] [V] [TRT] Tactic: 18 time 0.018644 [03/13/2022-08:30:32] [V] [TRT] Tactic: 19 time 0.023808 [03/13/2022-08:30:32] [V] [TRT] Tactic: 20 time 0.012716 [03/13/2022-08:30:32] [V] [TRT] Tactic: 21 time 0.012408 [03/13/2022-08:30:32] [V] [TRT] Tactic: 22 time 0.012292 [03/13/2022-08:30:32] [V] [TRT] Tactic: 23 time 0.012548 [03/13/2022-08:30:32] [V] [TRT] Tactic: 24 time 0.016272 [03/13/2022-08:30:32] [V] [TRT] Tactic: 25 time 0.014464 [03/13/2022-08:30:32] [V] [TRT] Tactic: 26 time 0.014136 [03/13/2022-08:30:32] [V] [TRT] Tactic: 27 time 0.013992 [03/13/2022-08:30:32] [V] [TRT] Tactic: 28 time 0.014548 [03/13/2022-08:30:32] [V] [TRT] Tactic: 29 time 0.012952 [03/13/2022-08:30:32] [V] [TRT] Tactic: 30 time 0.012992 [03/13/2022-08:30:32] [V] [TRT] Tactic: 31 time 0.015916 [03/13/2022-08:30:32] [V] [TRT] Fastest Tactic: 13 Time: 0.011324 [03/13/2022-08:30:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 13 [03/13/2022-08:30:32] [V] [TRT] [03/13/2022-08:30:32] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:30:32] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:30:32] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: Conv_105 (FusedConvActConvolution) [03/13/2022-08:30:32] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: Conv_105 (CaskConvolution) [03/13/2022-08:30:32] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: Conv_105 (CudaConvolution) [03/13/2022-08:30:32] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: Conv_105 (CudaDepthwiseConvolution) [03/13/2022-08:30:32] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:32] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:30:32] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: Conv_105 (FusedConvActConvolution) [03/13/2022-08:30:32] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: Conv_105 (CaskConvolution) [03/13/2022-08:30:32] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: Conv_105 (CudaConvolution) [03/13/2022-08:30:32] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: Conv_105 (CudaDepthwiseConvolution) [03/13/2022-08:30:32] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:32] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:30:32] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_107, Mul_108) (PointWise) [03/13/2022-08:30:32] [V] [TRT] Tactic: 128 time 0.022212 [03/13/2022-08:30:32] [V] [TRT] Tactic: 256 time 0.021596 [03/13/2022-08:30:32] [V] [TRT] Tactic: 512 time 0.024188 [03/13/2022-08:30:32] [V] [TRT] Tactic: -32 time 0.03548 [03/13/2022-08:30:32] [V] [TRT] Tactic: -64 time 0.025644 [03/13/2022-08:30:32] [V] [TRT] Tactic: -128 time 0.023456 [03/13/2022-08:30:32] [V] [TRT] Fastest Tactic: 256 Time: 0.021596 [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_107, Mul_108) (PointWiseV2) [03/13/2022-08:30:32] [V] [TRT] Tactic: 0 time 0.01586 [03/13/2022-08:30:32] [V] [TRT] Tactic: 1 time 0.014208 [03/13/2022-08:30:32] [V] [TRT] Tactic: 2 time 0.012928 [03/13/2022-08:30:32] [V] [TRT] Tactic: 3 time 0.014472 [03/13/2022-08:30:32] [V] [TRT] Tactic: 4 time 0.013536 [03/13/2022-08:30:32] [V] [TRT] Tactic: 5 time 0.01246 [03/13/2022-08:30:32] [V] [TRT] Tactic: 6 time 0.015024 [03/13/2022-08:30:32] [V] [TRT] Tactic: 7 time 0.01264 [03/13/2022-08:30:32] [V] [TRT] Tactic: 8 time 0.012976 [03/13/2022-08:30:32] [V] [TRT] Tactic: 9 time 0.012692 [03/13/2022-08:30:32] [V] [TRT] Tactic: 28 time 0.015784 [03/13/2022-08:30:32] [V] [TRT] Fastest Tactic: 5 Time: 0.01246 [03/13/2022-08:30:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [03/13/2022-08:30:32] [V] [TRT] [03/13/2022-08:30:32] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,6000) -> Float(1,40,1200:32,6000) *************** [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_107, Mul_108) (PointWise) [03/13/2022-08:30:32] [V] [TRT] Tactic: 128 time 0.021364 [03/13/2022-08:30:32] [V] [TRT] Tactic: 256 time 0.021732 [03/13/2022-08:30:32] [V] [TRT] Tactic: 512 time 0.023776 [03/13/2022-08:30:32] [V] [TRT] Tactic: -32 time 0.035004 [03/13/2022-08:30:32] [V] [TRT] Tactic: -64 time 0.026076 [03/13/2022-08:30:32] [V] [TRT] Tactic: -128 time 0.023284 [03/13/2022-08:30:32] [V] [TRT] Fastest Tactic: 128 Time: 0.021364 [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_107, Mul_108) (PointWiseV2) [03/13/2022-08:30:32] [V] [TRT] Tactic: 24 time 0.014432 [03/13/2022-08:30:32] [V] [TRT] Tactic: 25 time 0.013916 [03/13/2022-08:30:32] [V] [TRT] Tactic: 26 time 0.014436 [03/13/2022-08:30:32] [V] [TRT] Tactic: 27 time 0.014444 [03/13/2022-08:30:32] [V] [TRT] Tactic: 31 time 0.0134 [03/13/2022-08:30:32] [V] [TRT] Fastest Tactic: 31 Time: 0.0134 [03/13/2022-08:30:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [03/13/2022-08:30:32] [V] [TRT] [03/13/2022-08:30:32] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_107, Mul_108) (PointWise) [03/13/2022-08:30:32] [V] [TRT] Tactic: 128 time 0.0209 [03/13/2022-08:30:32] [V] [TRT] Tactic: 256 time 0.018696 [03/13/2022-08:30:32] [V] [TRT] Tactic: 512 time 0.018488 [03/13/2022-08:30:32] [V] [TRT] Tactic: -32 time 0.028532 [03/13/2022-08:30:32] [V] [TRT] Tactic: -64 time 0.023892 [03/13/2022-08:30:32] [V] [TRT] Tactic: -128 time 0.021344 [03/13/2022-08:30:32] [V] [TRT] Fastest Tactic: 512 Time: 0.018488 [03/13/2022-08:30:32] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_107, Mul_108) (PointWiseV2) [03/13/2022-08:30:33] [V] [TRT] Tactic: 0 time 0.012056 [03/13/2022-08:30:33] [V] [TRT] Tactic: 1 time 0.009992 [03/13/2022-08:30:33] [V] [TRT] Tactic: 2 time 0.009152 [03/13/2022-08:30:33] [V] [TRT] Tactic: 3 time 0.008864 [03/13/2022-08:30:33] [V] [TRT] Tactic: 4 time 0.00812 [03/13/2022-08:30:33] [V] [TRT] Tactic: 5 time 0.00806 [03/13/2022-08:30:33] [V] [TRT] Tactic: 6 time 0.008292 [03/13/2022-08:30:33] [V] [TRT] Tactic: 7 time 0.007672 [03/13/2022-08:30:33] [V] [TRT] Tactic: 8 time 0.006976 [03/13/2022-08:30:33] [V] [TRT] Tactic: 9 time 0.007212 [03/13/2022-08:30:33] [V] [TRT] Tactic: 28 time 0.01204 [03/13/2022-08:30:33] [V] [TRT] Fastest Tactic: 8 Time: 0.006976 [03/13/2022-08:30:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:30:33] [V] [TRT] [03/13/2022-08:30:33] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:30:33] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_107, Mul_108) (PointWise) [03/13/2022-08:30:33] [V] [TRT] Tactic: 128 time 0.0213 [03/13/2022-08:30:33] [V] [TRT] Tactic: 256 time 0.01904 [03/13/2022-08:30:33] [V] [TRT] Tactic: 512 time 0.018364 [03/13/2022-08:30:33] [V] [TRT] Tactic: -32 time 0.028744 [03/13/2022-08:30:33] [V] [TRT] Tactic: -64 time 0.023836 [03/13/2022-08:30:33] [V] [TRT] Tactic: -128 time 0.021204 [03/13/2022-08:30:33] [V] [TRT] Fastest Tactic: 512 Time: 0.018364 [03/13/2022-08:30:33] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_107, Mul_108) (PointWiseV2) [03/13/2022-08:30:33] [V] [TRT] Tactic: 0 time 0.009272 [03/13/2022-08:30:33] [V] [TRT] Tactic: 1 time 0.00874 [03/13/2022-08:30:33] [V] [TRT] Tactic: 2 time 0.009356 [03/13/2022-08:30:33] [V] [TRT] Tactic: 3 time 0.00792 [03/13/2022-08:30:33] [V] [TRT] Tactic: 4 time 0.009168 [03/13/2022-08:30:33] [V] [TRT] Tactic: 5 time 0.010396 [03/13/2022-08:30:33] [V] [TRT] Tactic: 6 time 0.008108 [03/13/2022-08:30:33] [V] [TRT] Tactic: 7 time 0.008448 [03/13/2022-08:30:33] [V] [TRT] Tactic: 8 time 0.010184 [03/13/2022-08:30:33] [V] [TRT] Tactic: 9 time 0.011916 [03/13/2022-08:30:33] [V] [TRT] Tactic: 10 time 0.0125 [03/13/2022-08:30:33] [V] [TRT] Tactic: 11 time 0.010176 [03/13/2022-08:30:33] [V] [TRT] Tactic: 12 time 0.009392 [03/13/2022-08:30:33] [V] [TRT] Tactic: 13 time 0.008924 [03/13/2022-08:30:33] [V] [TRT] Tactic: 14 time 0.008536 [03/13/2022-08:30:33] [V] [TRT] Tactic: 15 time 0.008016 [03/13/2022-08:30:33] [V] [TRT] Tactic: 16 time 0.008524 [03/13/2022-08:30:33] [V] [TRT] Tactic: 17 time 0.007848 [03/13/2022-08:30:33] [V] [TRT] Tactic: 18 time 0.007768 [03/13/2022-08:30:33] [V] [TRT] Tactic: 19 time 0.008008 [03/13/2022-08:30:33] [V] [TRT] Tactic: 28 time 0.00908 [03/13/2022-08:30:33] [V] [TRT] Tactic: 29 time 0.012336 [03/13/2022-08:30:33] [V] [TRT] Fastest Tactic: 18 Time: 0.007768 [03/13/2022-08:30:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:30:33] [V] [TRT] [03/13/2022-08:30:33] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:30:33] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_107, Mul_108) (PointWise) [03/13/2022-08:30:33] [V] [TRT] Tactic: 128 time 0.0211 [03/13/2022-08:30:33] [V] [TRT] Tactic: 256 time 0.01868 [03/13/2022-08:30:33] [V] [TRT] Tactic: 512 time 0.018932 [03/13/2022-08:30:33] [V] [TRT] Tactic: -32 time 0.02848 [03/13/2022-08:30:33] [V] [TRT] Tactic: -64 time 0.02388 [03/13/2022-08:30:33] [V] [TRT] Tactic: -128 time 0.02098 [03/13/2022-08:30:33] [V] [TRT] Fastest Tactic: 256 Time: 0.01868 [03/13/2022-08:30:33] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_107, Mul_108) (PointWiseV2) [03/13/2022-08:30:33] [V] [TRT] Tactic: 0 time 0.008396 [03/13/2022-08:30:33] [V] [TRT] Tactic: 1 time 0.008272 [03/13/2022-08:30:33] [V] [TRT] Tactic: 2 time 0.01066 [03/13/2022-08:30:33] [V] [TRT] Tactic: 3 time 0.00866 [03/13/2022-08:30:33] [V] [TRT] Tactic: 4 time 0.010104 [03/13/2022-08:30:33] [V] [TRT] Tactic: 5 time 0.012876 [03/13/2022-08:30:33] [V] [TRT] Tactic: 6 time 0.012304 [03/13/2022-08:30:33] [V] [TRT] Tactic: 7 time 0.013832 [03/13/2022-08:30:33] [V] [TRT] Tactic: 8 time 0.013412 [03/13/2022-08:30:33] [V] [TRT] Tactic: 9 time 0.018924 [03/13/2022-08:30:33] [V] [TRT] Tactic: 10 time 0.008992 [03/13/2022-08:30:33] [V] [TRT] Tactic: 11 time 0.00838 [03/13/2022-08:30:33] [V] [TRT] Tactic: 12 time 0.00996 [03/13/2022-08:30:33] [V] [TRT] Tactic: 13 time 0.009072 [03/13/2022-08:30:33] [V] [TRT] Tactic: 14 time 0.009332 [03/13/2022-08:30:33] [V] [TRT] Tactic: 15 time 0.011576 [03/13/2022-08:30:33] [V] [TRT] Tactic: 16 time 0.0096 [03/13/2022-08:30:33] [V] [TRT] Tactic: 17 time 0.011332 [03/13/2022-08:30:33] [V] [TRT] Tactic: 18 time 0.011728 [03/13/2022-08:30:33] [V] [TRT] Tactic: 19 time 0.01368 [03/13/2022-08:30:33] [V] [TRT] Tactic: 20 time 0.011744 [03/13/2022-08:30:33] [V] [TRT] Tactic: 21 time 0.0099 [03/13/2022-08:30:33] [V] [TRT] Tactic: 22 time 0.008272 [03/13/2022-08:30:33] [V] [TRT] Tactic: 23 time 0.008036 [03/13/2022-08:30:33] [V] [TRT] Tactic: 24 time 0.012452 [03/13/2022-08:30:33] [V] [TRT] Tactic: 25 time 0.010552 [03/13/2022-08:30:33] [V] [TRT] Tactic: 26 time 0.009128 [03/13/2022-08:30:33] [V] [TRT] Tactic: 27 time 0.008544 [03/13/2022-08:30:33] [V] [TRT] Tactic: 28 time 0.008544 [03/13/2022-08:30:33] [V] [TRT] Tactic: 29 time 0.008764 [03/13/2022-08:30:33] [V] [TRT] Tactic: 30 time 0.009948 [03/13/2022-08:30:33] [V] [TRT] Tactic: 31 time 0.012304 [03/13/2022-08:30:33] [V] [TRT] Fastest Tactic: 23 Time: 0.008036 [03/13/2022-08:30:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 23 [03/13/2022-08:30:33] [V] [TRT] [03/13/2022-08:30:33] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:30:33] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:30:33] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:30:33] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:30:33] [V] [TRT] --------------- Timing Runner: Conv_109 (FusedConvActConvolution) [03/13/2022-08:30:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:33] [V] [TRT] --------------- Timing Runner: Conv_109 (CaskConvolution) [03/13/2022-08:30:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:33] [V] [TRT] --------------- Timing Runner: Conv_109 (CudaConvolution) [03/13/2022-08:30:33] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:33] [V] [TRT] --------------- Timing Runner: Conv_109 (CudaDepthwiseConvolution) [03/13/2022-08:30:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:33] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:30:33] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000), Float(1,40,1200,192000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:30:33] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_111, Mul_112), Add_113) (PointWise) [03/13/2022-08:30:33] [V] [TRT] Tactic: 128 time 0.025536 [03/13/2022-08:30:33] [V] [TRT] Tactic: 256 time 0.0253 [03/13/2022-08:30:33] [V] [TRT] Tactic: 512 time 0.028388 [03/13/2022-08:30:33] [V] [TRT] Tactic: -32 time 0.042832 [03/13/2022-08:30:33] [V] [TRT] Tactic: -64 time 0.031704 [03/13/2022-08:30:33] [V] [TRT] Tactic: -128 time 0.028696 [03/13/2022-08:30:33] [V] [TRT] Fastest Tactic: 256 Time: 0.0253 [03/13/2022-08:30:33] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_111, Mul_112), Add_113) (PointWiseV2) [03/13/2022-08:30:33] [V] [TRT] Tactic: 0 time 0.018212 [03/13/2022-08:30:33] [V] [TRT] Tactic: 1 time 0.016548 [03/13/2022-08:30:33] [V] [TRT] Tactic: 2 time 0.018208 [03/13/2022-08:30:33] [V] [TRT] Tactic: 3 time 0.018372 [03/13/2022-08:30:33] [V] [TRT] Tactic: 4 time 0.016976 [03/13/2022-08:30:33] [V] [TRT] Tactic: 5 time 0.018276 [03/13/2022-08:30:33] [V] [TRT] Tactic: 6 time 0.016832 [03/13/2022-08:30:33] [V] [TRT] Tactic: 7 time 0.018448 [03/13/2022-08:30:33] [V] [TRT] Tactic: 8 time 0.01832 [03/13/2022-08:30:33] [V] [TRT] Tactic: 9 time 0.018464 [03/13/2022-08:30:33] [V] [TRT] Tactic: 28 time 0.018236 [03/13/2022-08:30:33] [V] [TRT] Fastest Tactic: 1 Time: 0.016548 [03/13/2022-08:30:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [03/13/2022-08:30:33] [V] [TRT] [03/13/2022-08:30:33] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,6000), Float(1,40,1200:32,6000) -> Float(1,40,1200:32,6000) *************** [03/13/2022-08:30:33] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_111, Mul_112), Add_113) (PointWise) [03/13/2022-08:30:33] [V] [TRT] Tactic: 128 time 0.025044 [03/13/2022-08:30:33] [V] [TRT] Tactic: 256 time 0.02564 [03/13/2022-08:30:33] [V] [TRT] Tactic: 512 time 0.02838 [03/13/2022-08:30:33] [V] [TRT] Tactic: -32 time 0.042936 [03/13/2022-08:30:33] [V] [TRT] Tactic: -64 time 0.031672 [03/13/2022-08:30:33] [V] [TRT] Tactic: -128 time 0.028416 [03/13/2022-08:30:33] [V] [TRT] Fastest Tactic: 128 Time: 0.025044 [03/13/2022-08:30:33] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_111, Mul_112), Add_113) (PointWiseV2) [03/13/2022-08:30:33] [V] [TRT] Tactic: 24 time 0.023284 [03/13/2022-08:30:33] [V] [TRT] Tactic: 25 time 0.024112 [03/13/2022-08:30:33] [V] [TRT] Tactic: 26 time 0.023296 [03/13/2022-08:30:33] [V] [TRT] Tactic: 27 time 0.019544 [03/13/2022-08:30:33] [V] [TRT] Tactic: 31 time 0.023752 [03/13/2022-08:30:33] [V] [TRT] Fastest Tactic: 27 Time: 0.019544 [03/13/2022-08:30:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [03/13/2022-08:30:33] [V] [TRT] [03/13/2022-08:30:33] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000), Half(1,40,1200,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:30:33] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_111, Mul_112), Add_113) (PointWise) [03/13/2022-08:30:33] [V] [TRT] Tactic: 128 time 0.026616 [03/13/2022-08:30:33] [V] [TRT] Tactic: 256 time 0.025092 [03/13/2022-08:30:33] [V] [TRT] Tactic: 512 time 0.025212 [03/13/2022-08:30:33] [V] [TRT] Tactic: -32 time 0.043924 [03/13/2022-08:30:33] [V] [TRT] Tactic: -64 time 0.031972 [03/13/2022-08:30:33] [V] [TRT] Tactic: -128 time 0.02926 [03/13/2022-08:30:33] [V] [TRT] Fastest Tactic: 256 Time: 0.025092 [03/13/2022-08:30:33] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_111, Mul_112), Add_113) (PointWiseV2) [03/13/2022-08:30:33] [V] [TRT] Tactic: 0 time 0.01522 [03/13/2022-08:30:33] [V] [TRT] Tactic: 1 time 0.014 [03/13/2022-08:30:33] [V] [TRT] Tactic: 2 time 0.012036 [03/13/2022-08:30:33] [V] [TRT] Tactic: 3 time 0.013488 [03/13/2022-08:30:33] [V] [TRT] Tactic: 4 time 0.011196 [03/13/2022-08:30:33] [V] [TRT] Tactic: 5 time 0.011152 [03/13/2022-08:30:33] [V] [TRT] Tactic: 6 time 0.013176 [03/13/2022-08:30:33] [V] [TRT] Tactic: 7 time 0.010884 [03/13/2022-08:30:33] [V] [TRT] Tactic: 8 time 0.010804 [03/13/2022-08:30:33] [V] [TRT] Tactic: 9 time 0.010668 [03/13/2022-08:30:33] [V] [TRT] Tactic: 28 time 0.015308 [03/13/2022-08:30:33] [V] [TRT] Fastest Tactic: 9 Time: 0.010668 [03/13/2022-08:30:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:30:33] [V] [TRT] [03/13/2022-08:30:33] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000), Half(1,40,1200:2,96000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:30:33] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_111, Mul_112), Add_113) (PointWise) [03/13/2022-08:30:33] [V] [TRT] Tactic: 128 time 0.026612 [03/13/2022-08:30:33] [V] [TRT] Tactic: 256 time 0.025148 [03/13/2022-08:30:33] [V] [TRT] Tactic: 512 time 0.025016 [03/13/2022-08:30:33] [V] [TRT] Tactic: -32 time 0.043464 [03/13/2022-08:30:33] [V] [TRT] Tactic: -64 time 0.031868 [03/13/2022-08:30:33] [V] [TRT] Tactic: -128 time 0.029252 [03/13/2022-08:30:33] [V] [TRT] Fastest Tactic: 512 Time: 0.025016 [03/13/2022-08:30:33] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_111, Mul_112), Add_113) (PointWiseV2) [03/13/2022-08:30:33] [V] [TRT] Tactic: 0 time 0.01228 [03/13/2022-08:30:33] [V] [TRT] Tactic: 1 time 0.012192 [03/13/2022-08:30:33] [V] [TRT] Tactic: 2 time 0.012428 [03/13/2022-08:30:33] [V] [TRT] Tactic: 3 time 0.012116 [03/13/2022-08:30:33] [V] [TRT] Tactic: 4 time 0.0128 [03/13/2022-08:30:34] [V] [TRT] Tactic: 5 time 0.014696 [03/13/2022-08:30:34] [V] [TRT] Tactic: 6 time 0.012316 [03/13/2022-08:30:34] [V] [TRT] Tactic: 7 time 0.012364 [03/13/2022-08:30:34] [V] [TRT] Tactic: 8 time 0.016892 [03/13/2022-08:30:34] [V] [TRT] Tactic: 9 time 0.020272 [03/13/2022-08:30:34] [V] [TRT] Tactic: 10 time 0.016648 [03/13/2022-08:30:34] [V] [TRT] Tactic: 11 time 0.01414 [03/13/2022-08:30:34] [V] [TRT] Tactic: 12 time 0.013372 [03/13/2022-08:30:34] [V] [TRT] Tactic: 13 time 0.013952 [03/13/2022-08:30:34] [V] [TRT] Tactic: 14 time 0.012696 [03/13/2022-08:30:34] [V] [TRT] Tactic: 15 time 0.01168 [03/13/2022-08:30:34] [V] [TRT] Tactic: 16 time 0.014104 [03/13/2022-08:30:34] [V] [TRT] Tactic: 17 time 0.01322 [03/13/2022-08:30:34] [V] [TRT] Tactic: 18 time 0.011256 [03/13/2022-08:30:34] [V] [TRT] Tactic: 19 time 0.011096 [03/13/2022-08:30:34] [V] [TRT] Tactic: 28 time 0.012544 [03/13/2022-08:30:34] [V] [TRT] Tactic: 29 time 0.015824 [03/13/2022-08:30:34] [V] [TRT] Fastest Tactic: 19 Time: 0.011096 [03/13/2022-08:30:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 19 [03/13/2022-08:30:34] [V] [TRT] [03/13/2022-08:30:34] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000), Half(20,800,1:8,24000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:30:34] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_111, Mul_112), Add_113) (PointWise) [03/13/2022-08:30:34] [V] [TRT] Tactic: 128 time 0.026912 [03/13/2022-08:30:34] [V] [TRT] Tactic: 256 time 0.02508 [03/13/2022-08:30:34] [V] [TRT] Tactic: 512 time 0.025208 [03/13/2022-08:30:34] [V] [TRT] Tactic: -32 time 0.04354 [03/13/2022-08:30:34] [V] [TRT] Tactic: -64 time 0.031588 [03/13/2022-08:30:34] [V] [TRT] Tactic: -128 time 0.029208 [03/13/2022-08:30:34] [V] [TRT] Fastest Tactic: 256 Time: 0.02508 [03/13/2022-08:30:34] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_111, Mul_112), Add_113) (PointWiseV2) [03/13/2022-08:30:34] [V] [TRT] Tactic: 0 time 0.013848 [03/13/2022-08:30:34] [V] [TRT] Tactic: 1 time 0.013548 [03/13/2022-08:30:34] [V] [TRT] Tactic: 2 time 0.018328 [03/13/2022-08:30:34] [V] [TRT] Tactic: 3 time 0.012764 [03/13/2022-08:30:34] [V] [TRT] Tactic: 4 time 0.016788 [03/13/2022-08:30:34] [V] [TRT] Tactic: 5 time 0.023512 [03/13/2022-08:30:34] [V] [TRT] Tactic: 6 time 0.016804 [03/13/2022-08:30:34] [V] [TRT] Tactic: 7 time 0.017168 [03/13/2022-08:30:34] [V] [TRT] Tactic: 8 time 0.023072 [03/13/2022-08:30:34] [V] [TRT] Tactic: 9 time 0.03268 [03/13/2022-08:30:34] [V] [TRT] Tactic: 10 time 0.012808 [03/13/2022-08:30:34] [V] [TRT] Tactic: 11 time 0.01148 [03/13/2022-08:30:34] [V] [TRT] Tactic: 12 time 0.014992 [03/13/2022-08:30:34] [V] [TRT] Tactic: 13 time 0.011552 [03/13/2022-08:30:34] [V] [TRT] Tactic: 14 time 0.01532 [03/13/2022-08:30:34] [V] [TRT] Tactic: 15 time 0.01852 [03/13/2022-08:30:34] [V] [TRT] Tactic: 16 time 0.012936 [03/13/2022-08:30:34] [V] [TRT] Tactic: 17 time 0.014772 [03/13/2022-08:30:34] [V] [TRT] Tactic: 18 time 0.018336 [03/13/2022-08:30:34] [V] [TRT] Tactic: 19 time 0.023668 [03/13/2022-08:30:34] [V] [TRT] Tactic: 20 time 0.01288 [03/13/2022-08:30:34] [V] [TRT] Tactic: 21 time 0.012076 [03/13/2022-08:30:34] [V] [TRT] Tactic: 22 time 0.012536 [03/13/2022-08:30:34] [V] [TRT] Tactic: 23 time 0.01202 [03/13/2022-08:30:34] [V] [TRT] Tactic: 24 time 0.01634 [03/13/2022-08:30:34] [V] [TRT] Tactic: 25 time 0.01462 [03/13/2022-08:30:34] [V] [TRT] Tactic: 26 time 0.014204 [03/13/2022-08:30:34] [V] [TRT] Tactic: 27 time 0.013908 [03/13/2022-08:30:34] [V] [TRT] Tactic: 28 time 0.014256 [03/13/2022-08:30:34] [V] [TRT] Tactic: 29 time 0.012888 [03/13/2022-08:30:34] [V] [TRT] Tactic: 30 time 0.012496 [03/13/2022-08:30:34] [V] [TRT] Tactic: 31 time 0.016452 [03/13/2022-08:30:34] [V] [TRT] Fastest Tactic: 11 Time: 0.01148 [03/13/2022-08:30:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 11 [03/13/2022-08:30:34] [V] [TRT] [03/13/2022-08:30:34] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:30:34] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:30:34] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:30:34] [V] [TRT] --------------- Timing Runner: Conv_114 (FusedConvActConvolution) [03/13/2022-08:30:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:34] [V] [TRT] --------------- Timing Runner: Conv_114 (CaskConvolution) [03/13/2022-08:30:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:34] [V] [TRT] --------------- Timing Runner: Conv_114 (CudaConvolution) [03/13/2022-08:30:34] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:34] [V] [TRT] --------------- Timing Runner: Conv_114 (CudaDepthwiseConvolution) [03/13/2022-08:30:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:34] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:30:34] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:30:34] [V] [TRT] --------------- Timing Runner: Conv_114 (FusedConvActConvolution) [03/13/2022-08:30:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:34] [V] [TRT] --------------- Timing Runner: Conv_114 (CaskConvolution) [03/13/2022-08:30:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:34] [V] [TRT] --------------- Timing Runner: Conv_114 (CudaConvolution) [03/13/2022-08:30:34] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:34] [V] [TRT] --------------- Timing Runner: Conv_114 (CudaDepthwiseConvolution) [03/13/2022-08:30:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:34] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:30:34] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:30:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_116, Mul_117) (PointWise) [03/13/2022-08:30:34] [V] [TRT] Tactic: 128 time 0.021276 [03/13/2022-08:30:34] [V] [TRT] Tactic: 256 time 0.021508 [03/13/2022-08:30:34] [V] [TRT] Tactic: 512 time 0.02352 [03/13/2022-08:30:34] [V] [TRT] Tactic: -32 time 0.035768 [03/13/2022-08:30:34] [V] [TRT] Tactic: -64 time 0.025688 [03/13/2022-08:30:34] [V] [TRT] Tactic: -128 time 0.023228 [03/13/2022-08:30:34] [V] [TRT] Fastest Tactic: 128 Time: 0.021276 [03/13/2022-08:30:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_116, Mul_117) (PointWiseV2) [03/13/2022-08:30:34] [V] [TRT] Tactic: 0 time 0.016156 [03/13/2022-08:30:34] [V] [TRT] Tactic: 1 time 0.014008 [03/13/2022-08:30:34] [V] [TRT] Tactic: 2 time 0.013552 [03/13/2022-08:30:34] [V] [TRT] Tactic: 3 time 0.014052 [03/13/2022-08:30:34] [V] [TRT] Tactic: 4 time 0.012588 [03/13/2022-08:30:34] [V] [TRT] Tactic: 5 time 0.013004 [03/13/2022-08:30:34] [V] [TRT] Tactic: 6 time 0.014784 [03/13/2022-08:30:34] [V] [TRT] Tactic: 7 time 0.0126 [03/13/2022-08:30:34] [V] [TRT] Tactic: 8 time 0.011124 [03/13/2022-08:30:34] [V] [TRT] Tactic: 9 time 0.011848 [03/13/2022-08:30:34] [V] [TRT] Tactic: 28 time 0.015984 [03/13/2022-08:30:34] [V] [TRT] Fastest Tactic: 8 Time: 0.011124 [03/13/2022-08:30:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:30:34] [V] [TRT] [03/13/2022-08:30:34] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,6000) -> Float(1,40,1200:32,6000) *************** [03/13/2022-08:30:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_116, Mul_117) (PointWise) [03/13/2022-08:30:34] [V] [TRT] Tactic: 128 time 0.021504 [03/13/2022-08:30:34] [V] [TRT] Tactic: 256 time 0.02122 [03/13/2022-08:30:34] [V] [TRT] Tactic: 512 time 0.023924 [03/13/2022-08:30:34] [V] [TRT] Tactic: -32 time 0.035824 [03/13/2022-08:30:34] [V] [TRT] Tactic: -64 time 0.025704 [03/13/2022-08:30:34] [V] [TRT] Tactic: -128 time 0.023352 [03/13/2022-08:30:34] [V] [TRT] Fastest Tactic: 256 Time: 0.02122 [03/13/2022-08:30:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_116, Mul_117) (PointWiseV2) [03/13/2022-08:30:34] [V] [TRT] Tactic: 24 time 0.014336 [03/13/2022-08:30:34] [V] [TRT] Tactic: 25 time 0.014832 [03/13/2022-08:30:34] [V] [TRT] Tactic: 26 time 0.013744 [03/13/2022-08:30:34] [V] [TRT] Tactic: 27 time 0.014304 [03/13/2022-08:30:34] [V] [TRT] Tactic: 31 time 0.014184 [03/13/2022-08:30:34] [V] [TRT] Fastest Tactic: 26 Time: 0.013744 [03/13/2022-08:30:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [03/13/2022-08:30:34] [V] [TRT] [03/13/2022-08:30:34] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:30:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_116, Mul_117) (PointWise) [03/13/2022-08:30:34] [V] [TRT] Tactic: 128 time 0.020972 [03/13/2022-08:30:34] [V] [TRT] Tactic: 256 time 0.018832 [03/13/2022-08:30:34] [V] [TRT] Tactic: 512 time 0.019272 [03/13/2022-08:30:34] [V] [TRT] Tactic: -32 time 0.030028 [03/13/2022-08:30:34] [V] [TRT] Tactic: -64 time 0.024868 [03/13/2022-08:30:34] [V] [TRT] Tactic: -128 time 0.02232 [03/13/2022-08:30:34] [V] [TRT] Fastest Tactic: 256 Time: 0.018832 [03/13/2022-08:30:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_116, Mul_117) (PointWiseV2) [03/13/2022-08:30:34] [V] [TRT] Tactic: 0 time 0.012376 [03/13/2022-08:30:34] [V] [TRT] Tactic: 1 time 0.010224 [03/13/2022-08:30:34] [V] [TRT] Tactic: 2 time 0.008868 [03/13/2022-08:30:34] [V] [TRT] Tactic: 3 time 0.009416 [03/13/2022-08:30:34] [V] [TRT] Tactic: 4 time 0.008524 [03/13/2022-08:30:34] [V] [TRT] Tactic: 5 time 0.008176 [03/13/2022-08:30:34] [V] [TRT] Tactic: 6 time 0.008904 [03/13/2022-08:30:34] [V] [TRT] Tactic: 7 time 0.008128 [03/13/2022-08:30:34] [V] [TRT] Tactic: 8 time 0.008 [03/13/2022-08:30:34] [V] [TRT] Tactic: 9 time 0.007896 [03/13/2022-08:30:34] [V] [TRT] Tactic: 28 time 0.01254 [03/13/2022-08:30:34] [V] [TRT] Fastest Tactic: 9 Time: 0.007896 [03/13/2022-08:30:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:30:34] [V] [TRT] [03/13/2022-08:30:34] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:30:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_116, Mul_117) (PointWise) [03/13/2022-08:30:34] [V] [TRT] Tactic: 128 time 0.022476 [03/13/2022-08:30:34] [V] [TRT] Tactic: 256 time 0.019784 [03/13/2022-08:30:34] [V] [TRT] Tactic: 512 time 0.0198 [03/13/2022-08:30:34] [V] [TRT] Tactic: -32 time 0.029612 [03/13/2022-08:30:34] [V] [TRT] Tactic: -64 time 0.024948 [03/13/2022-08:30:34] [V] [TRT] Tactic: -128 time 0.022368 [03/13/2022-08:30:34] [V] [TRT] Fastest Tactic: 256 Time: 0.019784 [03/13/2022-08:30:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_116, Mul_117) (PointWiseV2) [03/13/2022-08:30:34] [V] [TRT] Tactic: 0 time 0.009972 [03/13/2022-08:30:34] [V] [TRT] Tactic: 1 time 0.008804 [03/13/2022-08:30:34] [V] [TRT] Tactic: 2 time 0.01008 [03/13/2022-08:30:34] [V] [TRT] Tactic: 3 time 0.00834 [03/13/2022-08:30:34] [V] [TRT] Tactic: 4 time 0.009556 [03/13/2022-08:30:34] [V] [TRT] Tactic: 5 time 0.010836 [03/13/2022-08:30:34] [V] [TRT] Tactic: 6 time 0.008204 [03/13/2022-08:30:34] [V] [TRT] Tactic: 7 time 0.00922 [03/13/2022-08:30:34] [V] [TRT] Tactic: 8 time 0.010444 [03/13/2022-08:30:34] [V] [TRT] Tactic: 9 time 0.0134 [03/13/2022-08:30:34] [V] [TRT] Tactic: 10 time 0.012968 [03/13/2022-08:30:34] [V] [TRT] Tactic: 11 time 0.011 [03/13/2022-08:30:34] [V] [TRT] Tactic: 12 time 0.010332 [03/13/2022-08:30:34] [V] [TRT] Tactic: 13 time 0.010088 [03/13/2022-08:30:34] [V] [TRT] Tactic: 14 time 0.00928 [03/13/2022-08:30:34] [V] [TRT] Tactic: 15 time 0.008924 [03/13/2022-08:30:34] [V] [TRT] Tactic: 16 time 0.009096 [03/13/2022-08:30:34] [V] [TRT] Tactic: 17 time 0.008904 [03/13/2022-08:30:34] [V] [TRT] Tactic: 18 time 0.008224 [03/13/2022-08:30:34] [V] [TRT] Tactic: 19 time 0.009344 [03/13/2022-08:30:34] [V] [TRT] Tactic: 28 time 0.010316 [03/13/2022-08:30:34] [V] [TRT] Tactic: 29 time 0.012912 [03/13/2022-08:30:34] [V] [TRT] Fastest Tactic: 6 Time: 0.008204 [03/13/2022-08:30:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [03/13/2022-08:30:34] [V] [TRT] [03/13/2022-08:30:34] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:30:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_116, Mul_117) (PointWise) [03/13/2022-08:30:34] [V] [TRT] Tactic: 128 time 0.023552 [03/13/2022-08:30:34] [V] [TRT] Tactic: 256 time 0.0206 [03/13/2022-08:30:35] [V] [TRT] Tactic: 512 time 0.020452 [03/13/2022-08:30:35] [V] [TRT] Tactic: -32 time 0.031908 [03/13/2022-08:30:35] [V] [TRT] Tactic: -64 time 0.026496 [03/13/2022-08:30:35] [V] [TRT] Tactic: -128 time 0.022976 [03/13/2022-08:30:35] [V] [TRT] Fastest Tactic: 512 Time: 0.020452 [03/13/2022-08:30:35] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_116, Mul_117) (PointWiseV2) [03/13/2022-08:30:35] [V] [TRT] Tactic: 0 time 0.009124 [03/13/2022-08:30:35] [V] [TRT] Tactic: 1 time 0.008688 [03/13/2022-08:30:35] [V] [TRT] Tactic: 2 time 0.011104 [03/13/2022-08:30:35] [V] [TRT] Tactic: 3 time 0.0092 [03/13/2022-08:30:35] [V] [TRT] Tactic: 4 time 0.011144 [03/13/2022-08:30:35] [V] [TRT] Tactic: 5 time 0.013928 [03/13/2022-08:30:35] [V] [TRT] Tactic: 6 time 0.012936 [03/13/2022-08:30:35] [V] [TRT] Tactic: 7 time 0.013932 [03/13/2022-08:30:35] [V] [TRT] Tactic: 8 time 0.01528 [03/13/2022-08:30:35] [V] [TRT] Tactic: 9 time 0.021028 [03/13/2022-08:30:35] [V] [TRT] Tactic: 10 time 0.010036 [03/13/2022-08:30:35] [V] [TRT] Tactic: 11 time 0.008908 [03/13/2022-08:30:35] [V] [TRT] Tactic: 12 time 0.010084 [03/13/2022-08:30:35] [V] [TRT] Tactic: 13 time 0.00882 [03/13/2022-08:30:35] [V] [TRT] Tactic: 14 time 0.008972 [03/13/2022-08:30:35] [V] [TRT] Tactic: 15 time 0.012236 [03/13/2022-08:30:35] [V] [TRT] Tactic: 16 time 0.0102 [03/13/2022-08:30:35] [V] [TRT] Tactic: 17 time 0.010124 [03/13/2022-08:30:35] [V] [TRT] Tactic: 18 time 0.01274 [03/13/2022-08:30:35] [V] [TRT] Tactic: 19 time 0.015176 [03/13/2022-08:30:35] [V] [TRT] Tactic: 20 time 0.011632 [03/13/2022-08:30:35] [V] [TRT] Tactic: 21 time 0.01226 [03/13/2022-08:30:35] [V] [TRT] Tactic: 22 time 0.011008 [03/13/2022-08:30:35] [V] [TRT] Tactic: 23 time 0.011456 [03/13/2022-08:30:35] [V] [TRT] Tactic: 24 time 0.014176 [03/13/2022-08:30:35] [V] [TRT] Tactic: 25 time 0.011244 [03/13/2022-08:30:35] [V] [TRT] Tactic: 26 time 0.015156 [03/13/2022-08:30:35] [V] [TRT] Tactic: 27 time 0.011372 [03/13/2022-08:30:35] [V] [TRT] Tactic: 28 time 0.011348 [03/13/2022-08:30:35] [V] [TRT] Tactic: 29 time 0.011024 [03/13/2022-08:30:35] [V] [TRT] Tactic: 30 time 0.01226 [03/13/2022-08:30:35] [V] [TRT] Tactic: 31 time 0.014172 [03/13/2022-08:30:35] [V] [TRT] Fastest Tactic: 1 Time: 0.008688 [03/13/2022-08:30:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [03/13/2022-08:30:35] [V] [TRT] [03/13/2022-08:30:35] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:30:35] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:30:35] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:30:35] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:30:35] [V] [TRT] --------------- Timing Runner: Conv_118 (FusedConvActConvolution) [03/13/2022-08:30:35] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:35] [V] [TRT] --------------- Timing Runner: Conv_118 (CaskConvolution) [03/13/2022-08:30:35] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:35] [V] [TRT] --------------- Timing Runner: Conv_118 (CudaConvolution) [03/13/2022-08:30:35] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:35] [V] [TRT] --------------- Timing Runner: Conv_118 (CudaDepthwiseConvolution) [03/13/2022-08:30:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:35] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:30:35] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000), Float(1,40,1200,192000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:30:35] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_120, Mul_121), Add_122) (PointWise) [03/13/2022-08:30:35] [V] [TRT] Tactic: 128 time 0.0313 [03/13/2022-08:30:35] [V] [TRT] Tactic: 256 time 0.03176 [03/13/2022-08:30:35] [V] [TRT] Tactic: 512 time 0.035008 [03/13/2022-08:30:35] [V] [TRT] Tactic: -32 time 0.04786 [03/13/2022-08:30:35] [V] [TRT] Tactic: -64 time 0.03612 [03/13/2022-08:30:35] [V] [TRT] Tactic: -128 time 0.032512 [03/13/2022-08:30:35] [V] [TRT] Fastest Tactic: 128 Time: 0.0313 [03/13/2022-08:30:35] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_120, Mul_121), Add_122) (PointWiseV2) [03/13/2022-08:30:35] [V] [TRT] Tactic: 0 time 0.019476 [03/13/2022-08:30:35] [V] [TRT] Tactic: 1 time 0.01858 [03/13/2022-08:30:35] [V] [TRT] Tactic: 2 time 0.018624 [03/13/2022-08:30:35] [V] [TRT] Tactic: 3 time 0.01882 [03/13/2022-08:30:35] [V] [TRT] Tactic: 4 time 0.018312 [03/13/2022-08:30:35] [V] [TRT] Tactic: 5 time 0.018392 [03/13/2022-08:30:35] [V] [TRT] Tactic: 6 time 0.019176 [03/13/2022-08:30:35] [V] [TRT] Tactic: 7 time 0.018612 [03/13/2022-08:30:35] [V] [TRT] Tactic: 8 time 0.018684 [03/13/2022-08:30:35] [V] [TRT] Tactic: 9 time 0.018568 [03/13/2022-08:30:35] [V] [TRT] Tactic: 28 time 0.019388 [03/13/2022-08:30:35] [V] [TRT] Fastest Tactic: 4 Time: 0.018312 [03/13/2022-08:30:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [03/13/2022-08:30:35] [V] [TRT] [03/13/2022-08:30:35] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,6000), Float(1,40,1200:32,6000) -> Float(1,40,1200:32,12000) *************** [03/13/2022-08:30:36] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_120, Mul_121), Add_122) (PointWise) [03/13/2022-08:30:36] [V] [TRT] Tactic: 128 time 0.0311 [03/13/2022-08:30:36] [V] [TRT] Tactic: 256 time 0.031864 [03/13/2022-08:30:36] [V] [TRT] Tactic: 512 time 0.034936 [03/13/2022-08:30:36] [V] [TRT] Tactic: -32 time 0.048212 [03/13/2022-08:30:36] [V] [TRT] Tactic: -64 time 0.03612 [03/13/2022-08:30:36] [V] [TRT] Tactic: -128 time 0.032784 [03/13/2022-08:30:36] [V] [TRT] Fastest Tactic: 128 Time: 0.0311 [03/13/2022-08:30:36] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_120, Mul_121), Add_122) (PointWiseV2) [03/13/2022-08:30:36] [V] [TRT] Tactic: 24 time 0.023368 [03/13/2022-08:30:36] [V] [TRT] Tactic: 25 time 0.024796 [03/13/2022-08:30:36] [V] [TRT] Tactic: 26 time 0.023576 [03/13/2022-08:30:36] [V] [TRT] Tactic: 27 time 0.021112 [03/13/2022-08:30:36] [V] [TRT] Tactic: 31 time 0.023848 [03/13/2022-08:30:36] [V] [TRT] Fastest Tactic: 27 Time: 0.021112 [03/13/2022-08:30:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [03/13/2022-08:30:36] [V] [TRT] [03/13/2022-08:30:36] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000), Half(1,40,1200,192000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:30:36] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_120, Mul_121), Add_122) (PointWise) [03/13/2022-08:30:36] [V] [TRT] Tactic: 128 time 0.031832 [03/13/2022-08:30:36] [V] [TRT] Tactic: 256 time 0.028944 [03/13/2022-08:30:36] [V] [TRT] Tactic: 512 time 0.02914 [03/13/2022-08:30:36] [V] [TRT] Tactic: -32 time 0.048608 [03/13/2022-08:30:36] [V] [TRT] Tactic: -64 time 0.036156 [03/13/2022-08:30:36] [V] [TRT] Tactic: -128 time 0.033068 [03/13/2022-08:30:36] [V] [TRT] Fastest Tactic: 256 Time: 0.028944 [03/13/2022-08:30:36] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_120, Mul_121), Add_122) (PointWiseV2) [03/13/2022-08:30:36] [V] [TRT] Tactic: 0 time 0.018592 [03/13/2022-08:30:36] [V] [TRT] Tactic: 1 time 0.015968 [03/13/2022-08:30:36] [V] [TRT] Tactic: 2 time 0.013756 [03/13/2022-08:30:36] [V] [TRT] Tactic: 3 time 0.0148 [03/13/2022-08:30:36] [V] [TRT] Tactic: 4 time 0.012972 [03/13/2022-08:30:36] [V] [TRT] Tactic: 5 time 0.011304 [03/13/2022-08:30:36] [V] [TRT] Tactic: 6 time 0.014652 [03/13/2022-08:30:36] [V] [TRT] Tactic: 7 time 0.01218 [03/13/2022-08:30:36] [V] [TRT] Tactic: 8 time 0.011368 [03/13/2022-08:30:36] [V] [TRT] Tactic: 9 time 0.010896 [03/13/2022-08:30:36] [V] [TRT] Tactic: 28 time 0.018664 [03/13/2022-08:30:36] [V] [TRT] Fastest Tactic: 9 Time: 0.010896 [03/13/2022-08:30:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:30:36] [V] [TRT] [03/13/2022-08:30:36] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000), Half(1,40,1200:2,96000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:30:36] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_120, Mul_121), Add_122) (PointWise) [03/13/2022-08:30:36] [V] [TRT] Tactic: 128 time 0.030236 [03/13/2022-08:30:36] [V] [TRT] Tactic: 256 time 0.028636 [03/13/2022-08:30:36] [V] [TRT] Tactic: 512 time 0.028708 [03/13/2022-08:30:36] [V] [TRT] Tactic: -32 time 0.047608 [03/13/2022-08:30:36] [V] [TRT] Tactic: -64 time 0.035508 [03/13/2022-08:30:36] [V] [TRT] Tactic: -128 time 0.032544 [03/13/2022-08:30:36] [V] [TRT] Fastest Tactic: 256 Time: 0.028636 [03/13/2022-08:30:36] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_120, Mul_121), Add_122) (PointWiseV2) [03/13/2022-08:30:36] [V] [TRT] Tactic: 0 time 0.014164 [03/13/2022-08:30:36] [V] [TRT] Tactic: 1 time 0.013044 [03/13/2022-08:30:36] [V] [TRT] Tactic: 2 time 0.013412 [03/13/2022-08:30:36] [V] [TRT] Tactic: 3 time 0.012876 [03/13/2022-08:30:36] [V] [TRT] Tactic: 4 time 0.013468 [03/13/2022-08:30:36] [V] [TRT] Tactic: 5 time 0.015676 [03/13/2022-08:30:36] [V] [TRT] Tactic: 6 time 0.012592 [03/13/2022-08:30:36] [V] [TRT] Tactic: 7 time 0.013308 [03/13/2022-08:30:36] [V] [TRT] Tactic: 8 time 0.017 [03/13/2022-08:30:36] [V] [TRT] Tactic: 9 time 0.021992 [03/13/2022-08:30:36] [V] [TRT] Tactic: 10 time 0.0186 [03/13/2022-08:30:36] [V] [TRT] Tactic: 11 time 0.016224 [03/13/2022-08:30:36] [V] [TRT] Tactic: 12 time 0.014136 [03/13/2022-08:30:36] [V] [TRT] Tactic: 13 time 0.015368 [03/13/2022-08:30:36] [V] [TRT] Tactic: 14 time 0.013124 [03/13/2022-08:30:36] [V] [TRT] Tactic: 15 time 0.012168 [03/13/2022-08:30:36] [V] [TRT] Tactic: 16 time 0.014928 [03/13/2022-08:30:36] [V] [TRT] Tactic: 17 time 0.01294 [03/13/2022-08:30:36] [V] [TRT] Tactic: 18 time 0.011772 [03/13/2022-08:30:36] [V] [TRT] Tactic: 19 time 0.011608 [03/13/2022-08:30:36] [V] [TRT] Tactic: 28 time 0.014016 [03/13/2022-08:30:36] [V] [TRT] Tactic: 29 time 0.018736 [03/13/2022-08:30:36] [V] [TRT] Fastest Tactic: 19 Time: 0.011608 [03/13/2022-08:30:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 19 [03/13/2022-08:30:36] [V] [TRT] [03/13/2022-08:30:36] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000), Half(20,800,1:8,24000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:30:36] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_120, Mul_121), Add_122) (PointWise) [03/13/2022-08:30:36] [V] [TRT] Tactic: 128 time 0.030532 [03/13/2022-08:30:36] [V] [TRT] Tactic: 256 time 0.028688 [03/13/2022-08:30:36] [V] [TRT] Tactic: 512 time 0.028644 [03/13/2022-08:30:36] [V] [TRT] Tactic: -32 time 0.05222 [03/13/2022-08:30:36] [V] [TRT] Tactic: -64 time 0.041348 [03/13/2022-08:30:36] [V] [TRT] Tactic: -128 time 0.038884 [03/13/2022-08:30:36] [V] [TRT] Fastest Tactic: 512 Time: 0.028644 [03/13/2022-08:30:36] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_120, Mul_121), Add_122) (PointWiseV2) [03/13/2022-08:30:36] [V] [TRT] Tactic: 0 time 0.017492 [03/13/2022-08:30:36] [V] [TRT] Tactic: 1 time 0.018044 [03/13/2022-08:30:36] [V] [TRT] Tactic: 2 time 0.017352 [03/13/2022-08:30:36] [V] [TRT] Tactic: 3 time 0.019368 [03/13/2022-08:30:36] [V] [TRT] Tactic: 4 time 0.017908 [03/13/2022-08:30:36] [V] [TRT] Tactic: 5 time 0.018864 [03/13/2022-08:30:36] [V] [TRT] Tactic: 6 time 0.023612 [03/13/2022-08:30:36] [V] [TRT] Tactic: 7 time 0.020288 [03/13/2022-08:30:36] [V] [TRT] Tactic: 8 time 0.019748 [03/13/2022-08:30:36] [V] [TRT] Tactic: 9 time 0.019672 [03/13/2022-08:30:36] [V] [TRT] Tactic: 10 time 0.01734 [03/13/2022-08:30:36] [V] [TRT] Tactic: 11 time 0.01502 [03/13/2022-08:30:36] [V] [TRT] Tactic: 12 time 0.018596 [03/13/2022-08:30:36] [V] [TRT] Tactic: 13 time 0.01596 [03/13/2022-08:30:36] [V] [TRT] Tactic: 14 time 0.019144 [03/13/2022-08:30:36] [V] [TRT] Tactic: 15 time 0.018744 [03/13/2022-08:30:36] [V] [TRT] Tactic: 16 time 0.01842 [03/13/2022-08:30:36] [V] [TRT] Tactic: 17 time 0.020268 [03/13/2022-08:30:36] [V] [TRT] Tactic: 18 time 0.01808 [03/13/2022-08:30:36] [V] [TRT] Tactic: 19 time 0.020348 [03/13/2022-08:30:36] [V] [TRT] Tactic: 20 time 0.016076 [03/13/2022-08:30:36] [V] [TRT] Tactic: 21 time 0.016956 [03/13/2022-08:30:36] [V] [TRT] Tactic: 22 time 0.014992 [03/13/2022-08:30:36] [V] [TRT] Tactic: 23 time 0.016528 [03/13/2022-08:30:36] [V] [TRT] Tactic: 24 time 0.018888 [03/13/2022-08:30:36] [V] [TRT] Tactic: 25 time 0.018568 [03/13/2022-08:30:36] [V] [TRT] Tactic: 26 time 0.019968 [03/13/2022-08:30:36] [V] [TRT] Tactic: 27 time 0.016352 [03/13/2022-08:30:36] [V] [TRT] Tactic: 28 time 0.015348 [03/13/2022-08:30:36] [V] [TRT] Tactic: 29 time 0.01384 [03/13/2022-08:30:36] [V] [TRT] Tactic: 30 time 0.0142 [03/13/2022-08:30:36] [V] [TRT] Tactic: 31 time 0.018832 [03/13/2022-08:30:36] [V] [TRT] Fastest Tactic: 29 Time: 0.01384 [03/13/2022-08:30:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 29 [03/13/2022-08:30:36] [V] [TRT] [03/13/2022-08:30:36] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:36] [V] [TRT] Tactic: 1002 time 0.023012 [03/13/2022-08:30:36] [V] [TRT] Tactic: 0 time 0.044216 [03/13/2022-08:30:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.023012 [03/13/2022-08:30:36] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:36] [V] [TRT] Tactic: 1002 time 0.0179 [03/13/2022-08:30:36] [V] [TRT] Tactic: 0 time 0.016628 [03/13/2022-08:30:36] [V] [TRT] Fastest Tactic: 0 Time: 0.016628 [03/13/2022-08:30:36] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:36] [V] [TRT] Tactic: 1002 time 0.032976 [03/13/2022-08:30:36] [V] [TRT] Tactic: 0 time 0.014884 [03/13/2022-08:30:36] [V] [TRT] Fastest Tactic: 0 Time: 0.014884 [03/13/2022-08:30:36] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:36] [V] [TRT] Tactic: 1002 time 0.022764 [03/13/2022-08:30:36] [V] [TRT] Tactic: 0 time 0.01572 [03/13/2022-08:30:36] [V] [TRT] Fastest Tactic: 0 Time: 0.01572 [03/13/2022-08:30:36] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:36] [V] [TRT] Tactic: 1002 time 0.032568 [03/13/2022-08:30:37] [V] [TRT] Tactic: 0 time 0.028508 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 0 Time: 0.028508 [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:37] [V] [TRT] Tactic: 1002 time 0.032576 [03/13/2022-08:30:37] [V] [TRT] Tactic: 0 time 0.02618 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 0 Time: 0.02618 [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:37] [V] [TRT] Tactic: 1002 time 0.039476 [03/13/2022-08:30:37] [V] [TRT] Tactic: 0 time 0.029016 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 0 Time: 0.029016 [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:37] [V] [TRT] Tactic: 1002 time 0.030048 [03/13/2022-08:30:37] [V] [TRT] Tactic: 0 time 0.020332 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 0 Time: 0.020332 [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:37] [V] [TRT] Tactic: 1002 time 0.018036 [03/13/2022-08:30:37] [V] [TRT] Tactic: 0 time 0.017256 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 0 Time: 0.017256 [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:37] [V] [TRT] Tactic: 1002 time 0.0229 [03/13/2022-08:30:37] [V] [TRT] Tactic: 0 time 0.04458 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.0229 [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:37] [V] [TRT] Tactic: 1002 time 0.034072 [03/13/2022-08:30:37] [V] [TRT] Tactic: 0 time 0.015176 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 0 Time: 0.015176 [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:37] [V] [TRT] Tactic: 1002 time 0.021732 [03/13/2022-08:30:37] [V] [TRT] Tactic: 0 time 0.014492 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 0 Time: 0.014492 [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:37] [V] [TRT] Tactic: 1002 time 0.032616 [03/13/2022-08:30:37] [V] [TRT] Tactic: 0 time 0.01854 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 0 Time: 0.01854 [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:37] [V] [TRT] Tactic: 1002 time 0.022204 [03/13/2022-08:30:37] [V] [TRT] Tactic: 0 time 0.043504 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.022204 [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:37] [V] [TRT] Tactic: 1002 time 0.031352 [03/13/2022-08:30:37] [V] [TRT] Tactic: 0 time 0.014408 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 0 Time: 0.014408 [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:37] [V] [TRT] Tactic: 1002 time 0.020308 [03/13/2022-08:30:37] [V] [TRT] Tactic: 0 time 0.008956 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 0 Time: 0.008956 [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:37] [V] [TRT] Tactic: 1002 time 0.021232 [03/13/2022-08:30:37] [V] [TRT] Tactic: 0 time 0.02256 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.021232 [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:37] [V] [TRT] Tactic: 1002 time 0.026736 [03/13/2022-08:30:37] [V] [TRT] Tactic: 0 time 0.054752 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.026736 [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:37] [V] [TRT] Tactic: 1002 time 0.02016 [03/13/2022-08:30:37] [V] [TRT] Tactic: 0 time 0.02138 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.02016 [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:37] [V] [TRT] Tactic: 1002 time 0.0353 [03/13/2022-08:30:37] [V] [TRT] Tactic: 0 time 0.008612 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 0 Time: 0.008612 [03/13/2022-08:30:37] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_125, Mul_126) (PointWise) [03/13/2022-08:30:37] [V] [TRT] Tactic: 128 time 0.026112 [03/13/2022-08:30:37] [V] [TRT] Tactic: 256 time 0.02662 [03/13/2022-08:30:37] [V] [TRT] Tactic: 512 time 0.02872 [03/13/2022-08:30:37] [V] [TRT] Tactic: -32 time 0.038732 [03/13/2022-08:30:37] [V] [TRT] Tactic: -64 time 0.02796 [03/13/2022-08:30:37] [V] [TRT] Tactic: -128 time 0.0259 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: -128 Time: 0.0259 [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_125, Mul_126) (PointWiseV2) [03/13/2022-08:30:37] [V] [TRT] Tactic: 0 time 0.018108 [03/13/2022-08:30:37] [V] [TRT] Tactic: 1 time 0.015304 [03/13/2022-08:30:37] [V] [TRT] Tactic: 2 time 0.013936 [03/13/2022-08:30:37] [V] [TRT] Tactic: 3 time 0.015392 [03/13/2022-08:30:37] [V] [TRT] Tactic: 4 time 0.013992 [03/13/2022-08:30:37] [V] [TRT] Tactic: 5 time 0.013144 [03/13/2022-08:30:37] [V] [TRT] Tactic: 6 time 0.015552 [03/13/2022-08:30:37] [V] [TRT] Tactic: 7 time 0.014048 [03/13/2022-08:30:37] [V] [TRT] Tactic: 8 time 0.013536 [03/13/2022-08:30:37] [V] [TRT] Tactic: 9 time 0.013004 [03/13/2022-08:30:37] [V] [TRT] Tactic: 28 time 0.01782 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 9 Time: 0.013004 [03/13/2022-08:30:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:30:37] [V] [TRT] [03/13/2022-08:30:37] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,12000) -> Float(1,40,1200:32,12000) *************** [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_125, Mul_126) (PointWise) [03/13/2022-08:30:37] [V] [TRT] Tactic: 128 time 0.026268 [03/13/2022-08:30:37] [V] [TRT] Tactic: 256 time 0.026348 [03/13/2022-08:30:37] [V] [TRT] Tactic: 512 time 0.028764 [03/13/2022-08:30:37] [V] [TRT] Tactic: -32 time 0.038844 [03/13/2022-08:30:37] [V] [TRT] Tactic: -64 time 0.028064 [03/13/2022-08:30:37] [V] [TRT] Tactic: -128 time 0.025784 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: -128 Time: 0.025784 [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_125, Mul_126) (PointWiseV2) [03/13/2022-08:30:37] [V] [TRT] Tactic: 24 time 0.015164 [03/13/2022-08:30:37] [V] [TRT] Tactic: 25 time 0.015204 [03/13/2022-08:30:37] [V] [TRT] Tactic: 26 time 0.015052 [03/13/2022-08:30:37] [V] [TRT] Tactic: 27 time 0.014772 [03/13/2022-08:30:37] [V] [TRT] Tactic: 31 time 0.014628 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 31 Time: 0.014628 [03/13/2022-08:30:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [03/13/2022-08:30:37] [V] [TRT] [03/13/2022-08:30:37] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_125, Mul_126) (PointWise) [03/13/2022-08:30:37] [V] [TRT] Tactic: 128 time 0.024068 [03/13/2022-08:30:37] [V] [TRT] Tactic: 256 time 0.02126 [03/13/2022-08:30:37] [V] [TRT] Tactic: 512 time 0.021336 [03/13/2022-08:30:37] [V] [TRT] Tactic: -32 time 0.03144 [03/13/2022-08:30:37] [V] [TRT] Tactic: -64 time 0.02624 [03/13/2022-08:30:37] [V] [TRT] Tactic: -128 time 0.023964 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 256 Time: 0.02126 [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_125, Mul_126) (PointWiseV2) [03/13/2022-08:30:37] [V] [TRT] Tactic: 0 time 0.01672 [03/13/2022-08:30:37] [V] [TRT] Tactic: 1 time 0.012004 [03/13/2022-08:30:37] [V] [TRT] Tactic: 2 time 0.01358 [03/13/2022-08:30:37] [V] [TRT] Tactic: 3 time 0.013436 [03/13/2022-08:30:37] [V] [TRT] Tactic: 4 time 0.011724 [03/13/2022-08:30:37] [V] [TRT] Tactic: 5 time 0.009764 [03/13/2022-08:30:37] [V] [TRT] Tactic: 6 time 0.0144 [03/13/2022-08:30:37] [V] [TRT] Tactic: 7 time 0.0115 [03/13/2022-08:30:37] [V] [TRT] Tactic: 8 time 0.00954 [03/13/2022-08:30:37] [V] [TRT] Tactic: 9 time 0.009136 [03/13/2022-08:30:37] [V] [TRT] Tactic: 28 time 0.01566 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 9 Time: 0.009136 [03/13/2022-08:30:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:30:37] [V] [TRT] [03/13/2022-08:30:37] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_125, Mul_126) (PointWise) [03/13/2022-08:30:37] [V] [TRT] Tactic: 128 time 0.024736 [03/13/2022-08:30:37] [V] [TRT] Tactic: 256 time 0.021588 [03/13/2022-08:30:37] [V] [TRT] Tactic: 512 time 0.020964 [03/13/2022-08:30:37] [V] [TRT] Tactic: -32 time 0.030964 [03/13/2022-08:30:37] [V] [TRT] Tactic: -64 time 0.026444 [03/13/2022-08:30:37] [V] [TRT] Tactic: -128 time 0.024776 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 512 Time: 0.020964 [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_125, Mul_126) (PointWiseV2) [03/13/2022-08:30:37] [V] [TRT] Tactic: 0 time 0.0114 [03/13/2022-08:30:37] [V] [TRT] Tactic: 1 time 0.010168 [03/13/2022-08:30:37] [V] [TRT] Tactic: 2 time 0.010628 [03/13/2022-08:30:37] [V] [TRT] Tactic: 3 time 0.009048 [03/13/2022-08:30:37] [V] [TRT] Tactic: 4 time 0.010188 [03/13/2022-08:30:37] [V] [TRT] Tactic: 5 time 0.010504 [03/13/2022-08:30:37] [V] [TRT] Tactic: 6 time 0.00816 [03/13/2022-08:30:37] [V] [TRT] Tactic: 7 time 0.009076 [03/13/2022-08:30:37] [V] [TRT] Tactic: 8 time 0.01014 [03/13/2022-08:30:37] [V] [TRT] Tactic: 9 time 0.01304 [03/13/2022-08:30:37] [V] [TRT] Tactic: 10 time 0.01422 [03/13/2022-08:30:37] [V] [TRT] Tactic: 11 time 0.010964 [03/13/2022-08:30:37] [V] [TRT] Tactic: 12 time 0.010232 [03/13/2022-08:30:37] [V] [TRT] Tactic: 13 time 0.009692 [03/13/2022-08:30:37] [V] [TRT] Tactic: 14 time 0.008684 [03/13/2022-08:30:37] [V] [TRT] Tactic: 15 time 0.008768 [03/13/2022-08:30:37] [V] [TRT] Tactic: 16 time 0.00882 [03/13/2022-08:30:37] [V] [TRT] Tactic: 17 time 0.00824 [03/13/2022-08:30:37] [V] [TRT] Tactic: 18 time 0.008076 [03/13/2022-08:30:37] [V] [TRT] Tactic: 19 time 0.008152 [03/13/2022-08:30:37] [V] [TRT] Tactic: 28 time 0.01026 [03/13/2022-08:30:37] [V] [TRT] Tactic: 29 time 0.013456 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 18 Time: 0.008076 [03/13/2022-08:30:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:30:37] [V] [TRT] [03/13/2022-08:30:37] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_125, Mul_126) (PointWise) [03/13/2022-08:30:37] [V] [TRT] Tactic: 128 time 0.022364 [03/13/2022-08:30:37] [V] [TRT] Tactic: 256 time 0.020308 [03/13/2022-08:30:37] [V] [TRT] Tactic: 512 time 0.020008 [03/13/2022-08:30:37] [V] [TRT] Tactic: -32 time 0.033596 [03/13/2022-08:30:37] [V] [TRT] Tactic: -64 time 0.028412 [03/13/2022-08:30:37] [V] [TRT] Tactic: -128 time 0.02794 [03/13/2022-08:30:37] [V] [TRT] Fastest Tactic: 512 Time: 0.020008 [03/13/2022-08:30:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_125, Mul_126) (PointWiseV2) [03/13/2022-08:30:37] [V] [TRT] Tactic: 0 time 0.011372 [03/13/2022-08:30:37] [V] [TRT] Tactic: 1 time 0.01198 [03/13/2022-08:30:37] [V] [TRT] Tactic: 2 time 0.011936 [03/13/2022-08:30:37] [V] [TRT] Tactic: 3 time 0.014248 [03/13/2022-08:30:37] [V] [TRT] Tactic: 4 time 0.01356 [03/13/2022-08:30:37] [V] [TRT] Tactic: 5 time 0.0123 [03/13/2022-08:30:37] [V] [TRT] Tactic: 6 time 0.019472 [03/13/2022-08:30:37] [V] [TRT] Tactic: 7 time 0.01618 [03/13/2022-08:30:37] [V] [TRT] Tactic: 8 time 0.014444 [03/13/2022-08:30:37] [V] [TRT] Tactic: 9 time 0.01594 [03/13/2022-08:30:37] [V] [TRT] Tactic: 10 time 0.01278 [03/13/2022-08:30:37] [V] [TRT] Tactic: 11 time 0.011044 [03/13/2022-08:30:37] [V] [TRT] Tactic: 12 time 0.011508 [03/13/2022-08:30:37] [V] [TRT] Tactic: 13 time 0.012264 [03/13/2022-08:30:37] [V] [TRT] Tactic: 14 time 0.01228 [03/13/2022-08:30:37] [V] [TRT] Tactic: 15 time 0.01226 [03/13/2022-08:30:37] [V] [TRT] Tactic: 16 time 0.01476 [03/13/2022-08:30:37] [V] [TRT] Tactic: 17 time 0.013952 [03/13/2022-08:30:37] [V] [TRT] Tactic: 18 time 0.01318 [03/13/2022-08:30:37] [V] [TRT] Tactic: 19 time 0.012616 [03/13/2022-08:30:37] [V] [TRT] Tactic: 20 time 0.013956 [03/13/2022-08:30:37] [V] [TRT] Tactic: 21 time 0.013112 [03/13/2022-08:30:37] [V] [TRT] Tactic: 22 time 0.011784 [03/13/2022-08:30:37] [V] [TRT] Tactic: 23 time 0.012832 [03/13/2022-08:30:38] [V] [TRT] Tactic: 24 time 0.015672 [03/13/2022-08:30:38] [V] [TRT] Tactic: 25 time 0.014356 [03/13/2022-08:30:38] [V] [TRT] Tactic: 26 time 0.014264 [03/13/2022-08:30:38] [V] [TRT] Tactic: 27 time 0.012624 [03/13/2022-08:30:38] [V] [TRT] Tactic: 28 time 0.009572 [03/13/2022-08:30:38] [V] [TRT] Tactic: 29 time 0.0103 [03/13/2022-08:30:38] [V] [TRT] Tactic: 30 time 0.012204 [03/13/2022-08:30:38] [V] [TRT] Tactic: 31 time 0.015372 [03/13/2022-08:30:38] [V] [TRT] Fastest Tactic: 28 Time: 0.009572 [03/13/2022-08:30:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [03/13/2022-08:30:38] [V] [TRT] [03/13/2022-08:30:38] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:30:38] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:30:38] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: Conv_128 (FusedConvActConvolution) [03/13/2022-08:30:38] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: Conv_128 (CaskConvolution) [03/13/2022-08:30:38] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: Conv_128 (CudaConvolution) [03/13/2022-08:30:38] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: Conv_128 (CudaDepthwiseConvolution) [03/13/2022-08:30:38] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:38] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:30:38] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: Conv_128 (FusedConvActConvolution) [03/13/2022-08:30:38] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: Conv_128 (CaskConvolution) [03/13/2022-08:30:38] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: Conv_128 (CudaConvolution) [03/13/2022-08:30:38] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: Conv_128 (CudaDepthwiseConvolution) [03/13/2022-08:30:38] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:38] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:30:38] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,768000) *************** [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_130, Mul_131) (PointWise) [03/13/2022-08:30:38] [V] [TRT] Tactic: 128 time 0.042828 [03/13/2022-08:30:38] [V] [TRT] Tactic: 256 time 0.043416 [03/13/2022-08:30:38] [V] [TRT] Tactic: 512 time 0.047532 [03/13/2022-08:30:38] [V] [TRT] Tactic: -32 time 0.064684 [03/13/2022-08:30:38] [V] [TRT] Tactic: -64 time 0.041708 [03/13/2022-08:30:38] [V] [TRT] Tactic: -128 time 0.040024 [03/13/2022-08:30:38] [V] [TRT] Fastest Tactic: -128 Time: 0.040024 [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_130, Mul_131) (PointWiseV2) [03/13/2022-08:30:38] [V] [TRT] Tactic: 0 time 0.028648 [03/13/2022-08:30:38] [V] [TRT] Tactic: 1 time 0.024464 [03/13/2022-08:30:38] [V] [TRT] Tactic: 2 time 0.022652 [03/13/2022-08:30:38] [V] [TRT] Tactic: 3 time 0.023796 [03/13/2022-08:30:38] [V] [TRT] Tactic: 4 time 0.023004 [03/13/2022-08:30:38] [V] [TRT] Tactic: 5 time 0.022596 [03/13/2022-08:30:38] [V] [TRT] Tactic: 6 time 0.025448 [03/13/2022-08:30:38] [V] [TRT] Tactic: 7 time 0.023228 [03/13/2022-08:30:38] [V] [TRT] Tactic: 8 time 0.023092 [03/13/2022-08:30:38] [V] [TRT] Tactic: 9 time 0.022744 [03/13/2022-08:30:38] [V] [TRT] Tactic: 28 time 0.028788 [03/13/2022-08:30:38] [V] [TRT] Fastest Tactic: 5 Time: 0.022596 [03/13/2022-08:30:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [03/13/2022-08:30:38] [V] [TRT] [03/13/2022-08:30:38] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,12000) -> Float(1,40,1200:32,24000) *************** [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_130, Mul_131) (PointWise) [03/13/2022-08:30:38] [V] [TRT] Tactic: 128 time 0.043076 [03/13/2022-08:30:38] [V] [TRT] Tactic: 256 time 0.043656 [03/13/2022-08:30:38] [V] [TRT] Tactic: 512 time 0.04806 [03/13/2022-08:30:38] [V] [TRT] Tactic: -32 time 0.064952 [03/13/2022-08:30:38] [V] [TRT] Tactic: -64 time 0.041744 [03/13/2022-08:30:38] [V] [TRT] Tactic: -128 time 0.040084 [03/13/2022-08:30:38] [V] [TRT] Fastest Tactic: -128 Time: 0.040084 [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_130, Mul_131) (PointWiseV2) [03/13/2022-08:30:38] [V] [TRT] Tactic: 24 time 0.025652 [03/13/2022-08:30:38] [V] [TRT] Tactic: 25 time 0.026252 [03/13/2022-08:30:38] [V] [TRT] Tactic: 26 time 0.02594 [03/13/2022-08:30:38] [V] [TRT] Tactic: 27 time 0.025296 [03/13/2022-08:30:38] [V] [TRT] Tactic: 31 time 0.025756 [03/13/2022-08:30:38] [V] [TRT] Fastest Tactic: 27 Time: 0.025296 [03/13/2022-08:30:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [03/13/2022-08:30:38] [V] [TRT] [03/13/2022-08:30:38] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,768000) *************** [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_130, Mul_131) (PointWise) [03/13/2022-08:30:38] [V] [TRT] Tactic: 128 time 0.041784 [03/13/2022-08:30:38] [V] [TRT] Tactic: 256 time 0.035096 [03/13/2022-08:30:38] [V] [TRT] Tactic: 512 time 0.035324 [03/13/2022-08:30:38] [V] [TRT] Tactic: -32 time 0.05684 [03/13/2022-08:30:38] [V] [TRT] Tactic: -64 time 0.039632 [03/13/2022-08:30:38] [V] [TRT] Tactic: -128 time 0.038756 [03/13/2022-08:30:38] [V] [TRT] Fastest Tactic: 256 Time: 0.035096 [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_130, Mul_131) (PointWiseV2) [03/13/2022-08:30:38] [V] [TRT] Tactic: 0 time 0.02724 [03/13/2022-08:30:38] [V] [TRT] Tactic: 1 time 0.022588 [03/13/2022-08:30:38] [V] [TRT] Tactic: 2 time 0.018968 [03/13/2022-08:30:38] [V] [TRT] Tactic: 3 time 0.020696 [03/13/2022-08:30:38] [V] [TRT] Tactic: 4 time 0.016316 [03/13/2022-08:30:38] [V] [TRT] Tactic: 5 time 0.014148 [03/13/2022-08:30:38] [V] [TRT] Tactic: 6 time 0.020992 [03/13/2022-08:30:38] [V] [TRT] Tactic: 7 time 0.0161 [03/13/2022-08:30:38] [V] [TRT] Tactic: 8 time 0.014004 [03/13/2022-08:30:38] [V] [TRT] Tactic: 9 time 0.01356 [03/13/2022-08:30:38] [V] [TRT] Tactic: 28 time 0.027352 [03/13/2022-08:30:38] [V] [TRT] Fastest Tactic: 9 Time: 0.01356 [03/13/2022-08:30:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:30:38] [V] [TRT] [03/13/2022-08:30:38] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,384000) *************** [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_130, Mul_131) (PointWise) [03/13/2022-08:30:38] [V] [TRT] Tactic: 128 time 0.041428 [03/13/2022-08:30:38] [V] [TRT] Tactic: 256 time 0.0363 [03/13/2022-08:30:38] [V] [TRT] Tactic: 512 time 0.034708 [03/13/2022-08:30:38] [V] [TRT] Tactic: -32 time 0.057256 [03/13/2022-08:30:38] [V] [TRT] Tactic: -64 time 0.03988 [03/13/2022-08:30:38] [V] [TRT] Tactic: -128 time 0.038832 [03/13/2022-08:30:38] [V] [TRT] Fastest Tactic: 512 Time: 0.034708 [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_130, Mul_131) (PointWiseV2) [03/13/2022-08:30:38] [V] [TRT] Tactic: 0 time 0.019272 [03/13/2022-08:30:38] [V] [TRT] Tactic: 1 time 0.016804 [03/13/2022-08:30:38] [V] [TRT] Tactic: 2 time 0.0167 [03/13/2022-08:30:38] [V] [TRT] Tactic: 3 time 0.016552 [03/13/2022-08:30:38] [V] [TRT] Tactic: 4 time 0.016632 [03/13/2022-08:30:38] [V] [TRT] Tactic: 5 time 0.017964 [03/13/2022-08:30:38] [V] [TRT] Tactic: 6 time 0.01676 [03/13/2022-08:30:38] [V] [TRT] Tactic: 7 time 0.016656 [03/13/2022-08:30:38] [V] [TRT] Tactic: 8 time 0.017972 [03/13/2022-08:30:38] [V] [TRT] Tactic: 9 time 0.021332 [03/13/2022-08:30:38] [V] [TRT] Tactic: 10 time 0.028308 [03/13/2022-08:30:38] [V] [TRT] Tactic: 11 time 0.022652 [03/13/2022-08:30:38] [V] [TRT] Tactic: 12 time 0.018844 [03/13/2022-08:30:38] [V] [TRT] Tactic: 13 time 0.020816 [03/13/2022-08:30:38] [V] [TRT] Tactic: 14 time 0.01648 [03/13/2022-08:30:38] [V] [TRT] Tactic: 15 time 0.014644 [03/13/2022-08:30:38] [V] [TRT] Tactic: 16 time 0.0214 [03/13/2022-08:30:38] [V] [TRT] Tactic: 17 time 0.016256 [03/13/2022-08:30:38] [V] [TRT] Tactic: 18 time 0.013872 [03/13/2022-08:30:38] [V] [TRT] Tactic: 19 time 0.013844 [03/13/2022-08:30:38] [V] [TRT] Tactic: 28 time 0.018988 [03/13/2022-08:30:38] [V] [TRT] Tactic: 29 time 0.028436 [03/13/2022-08:30:38] [V] [TRT] Fastest Tactic: 19 Time: 0.013844 [03/13/2022-08:30:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 19 [03/13/2022-08:30:38] [V] [TRT] [03/13/2022-08:30:38] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(80,3200,1:8,96000) *************** [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_130, Mul_131) (PointWise) [03/13/2022-08:30:38] [V] [TRT] Tactic: 128 time 0.041364 [03/13/2022-08:30:38] [V] [TRT] Tactic: 256 time 0.035288 [03/13/2022-08:30:38] [V] [TRT] Tactic: 512 time 0.034948 [03/13/2022-08:30:38] [V] [TRT] Tactic: -32 time 0.053824 [03/13/2022-08:30:38] [V] [TRT] Tactic: -64 time 0.04118 [03/13/2022-08:30:38] [V] [TRT] Tactic: -128 time 0.044988 [03/13/2022-08:30:38] [V] [TRT] Fastest Tactic: 512 Time: 0.034948 [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_130, Mul_131) (PointWiseV2) [03/13/2022-08:30:38] [V] [TRT] Tactic: 0 time 0.016896 [03/13/2022-08:30:38] [V] [TRT] Tactic: 1 time 0.016428 [03/13/2022-08:30:38] [V] [TRT] Tactic: 2 time 0.020256 [03/13/2022-08:30:38] [V] [TRT] Tactic: 3 time 0.017648 [03/13/2022-08:30:38] [V] [TRT] Tactic: 4 time 0.020992 [03/13/2022-08:30:38] [V] [TRT] Tactic: 5 time 0.020844 [03/13/2022-08:30:38] [V] [TRT] Tactic: 6 time 0.022048 [03/13/2022-08:30:38] [V] [TRT] Tactic: 7 time 0.021704 [03/13/2022-08:30:38] [V] [TRT] Tactic: 8 time 0.021516 [03/13/2022-08:30:38] [V] [TRT] Tactic: 9 time 0.022848 [03/13/2022-08:30:38] [V] [TRT] Tactic: 10 time 0.01688 [03/13/2022-08:30:38] [V] [TRT] Tactic: 11 time 0.0168 [03/13/2022-08:30:38] [V] [TRT] Tactic: 12 time 0.018176 [03/13/2022-08:30:38] [V] [TRT] Tactic: 13 time 0.015792 [03/13/2022-08:30:38] [V] [TRT] Tactic: 14 time 0.016968 [03/13/2022-08:30:38] [V] [TRT] Tactic: 15 time 0.019124 [03/13/2022-08:30:38] [V] [TRT] Tactic: 16 time 0.01712 [03/13/2022-08:30:38] [V] [TRT] Tactic: 17 time 0.017368 [03/13/2022-08:30:38] [V] [TRT] Tactic: 18 time 0.01878 [03/13/2022-08:30:38] [V] [TRT] Tactic: 19 time 0.018908 [03/13/2022-08:30:38] [V] [TRT] Tactic: 20 time 0.019872 [03/13/2022-08:30:38] [V] [TRT] Tactic: 21 time 0.018836 [03/13/2022-08:30:38] [V] [TRT] Tactic: 22 time 0.020816 [03/13/2022-08:30:38] [V] [TRT] Tactic: 23 time 0.017136 [03/13/2022-08:30:38] [V] [TRT] Tactic: 24 time 0.02876 [03/13/2022-08:30:38] [V] [TRT] Tactic: 25 time 0.02348 [03/13/2022-08:30:38] [V] [TRT] Tactic: 26 time 0.0241 [03/13/2022-08:30:38] [V] [TRT] Tactic: 27 time 0.0282 [03/13/2022-08:30:38] [V] [TRT] Tactic: 28 time 0.015468 [03/13/2022-08:30:38] [V] [TRT] Tactic: 29 time 0.014876 [03/13/2022-08:30:38] [V] [TRT] Tactic: 30 time 0.019668 [03/13/2022-08:30:38] [V] [TRT] Tactic: 31 time 0.028668 [03/13/2022-08:30:38] [V] [TRT] Fastest Tactic: 29 Time: 0.014876 [03/13/2022-08:30:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 29 [03/13/2022-08:30:38] [V] [TRT] [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:38] [V] [TRT] Tactic: 1002 time 0.038676 [03/13/2022-08:30:38] [V] [TRT] Tactic: 0 time 0.074388 [03/13/2022-08:30:38] [V] [TRT] Fastest Tactic: 1002 Time: 0.038676 [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:38] [V] [TRT] Tactic: 1002 time 0.02806 [03/13/2022-08:30:38] [V] [TRT] Tactic: 0 time 0.027056 [03/13/2022-08:30:38] [V] [TRT] Fastest Tactic: 0 Time: 0.027056 [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:38] [V] [TRT] Tactic: 1002 time 0.052516 [03/13/2022-08:30:38] [V] [TRT] Tactic: 0 time 0.02376 [03/13/2022-08:30:38] [V] [TRT] Fastest Tactic: 0 Time: 0.02376 [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:38] [V] [TRT] Tactic: 1002 time 0.038036 [03/13/2022-08:30:38] [V] [TRT] Tactic: 0 time 0.021364 [03/13/2022-08:30:38] [V] [TRT] Fastest Tactic: 0 Time: 0.021364 [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:38] [V] [TRT] Tactic: 1002 time 0.056308 [03/13/2022-08:30:38] [V] [TRT] Tactic: 0 time 0.0466 [03/13/2022-08:30:38] [V] [TRT] Fastest Tactic: 0 Time: 0.0466 [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:38] [V] [TRT] Tactic: 1002 time 0.055708 [03/13/2022-08:30:38] [V] [TRT] Tactic: 0 time 0.044952 [03/13/2022-08:30:38] [V] [TRT] Fastest Tactic: 0 Time: 0.044952 [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:38] [V] [TRT] Tactic: 1002 time 0.063344 [03/13/2022-08:30:38] [V] [TRT] Tactic: 0 time 0.046748 [03/13/2022-08:30:38] [V] [TRT] Fastest Tactic: 0 Time: 0.046748 [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:38] [V] [TRT] Tactic: 1002 time 0.047584 [03/13/2022-08:30:38] [V] [TRT] Tactic: 0 time 0.031308 [03/13/2022-08:30:38] [V] [TRT] Fastest Tactic: 0 Time: 0.031308 [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:38] [V] [TRT] Tactic: 1002 time 0.028892 [03/13/2022-08:30:38] [V] [TRT] Tactic: 0 time 0.02736 [03/13/2022-08:30:38] [V] [TRT] Fastest Tactic: 0 Time: 0.02736 [03/13/2022-08:30:38] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.037512 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.075008 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 1002 Time: 0.037512 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.052052 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.022184 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 0 Time: 0.022184 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.037536 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.019584 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 0 Time: 0.019584 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.055784 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.028524 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 0 Time: 0.028524 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.037092 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.073292 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 1002 Time: 0.037092 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.0555 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.026144 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 0 Time: 0.026144 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.036596 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.01672 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 0 Time: 0.01672 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.037332 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.045876 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 1002 Time: 0.037332 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.049732 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.096172 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 1002 Time: 0.049732 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.037012 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.044784 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 1002 Time: 0.037012 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.063452 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.014076 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 0 Time: 0.014076 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.027712 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.026688 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 0 Time: 0.026688 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.05118 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.027664 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 0 Time: 0.027664 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.037096 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.046536 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 1002 Time: 0.037096 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.055292 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.047244 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 0 Time: 0.047244 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.055568 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.04516 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 0 Time: 0.04516 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.063008 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.04666 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 0 Time: 0.04666 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.047348 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.031464 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 0 Time: 0.031464 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.028928 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.026464 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 0 Time: 0.026464 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.051208 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.02198 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 0 Time: 0.02198 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.036988 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.018848 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 0 Time: 0.018848 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.055528 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.023 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 0 Time: 0.023 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.056204 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.02652 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 0 Time: 0.02652 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.03602 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.016452 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 0 Time: 0.016452 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.038016 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.018852 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 0 Time: 0.018852 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.037436 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.014896 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 0 Time: 0.014896 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:39] [V] [TRT] Tactic: 1002 time 0.06348 [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 0.014368 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 0 Time: 0.014368 [03/13/2022-08:30:39] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,768000) -> Float(1,20,300,192000) *************** [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: Conv_132 (FusedConvActConvolution) [03/13/2022-08:30:39] [V] [TRT] Tactic: 458751 time 0.847628 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 458751 Time: 0.847628 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: Conv_132 (CaskConvolution) [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: 1825138533642645384 time 0.862776 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: 2842488832350522458 time 0.676888 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: 3915320020053085238 time 0.85684 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: 6448355332020552203 time 0.870224 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: 6808617066150061604 time 0.700796 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: -8060443123034038864 time 0.717592 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: -4420849921117327522 time 0.920096 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: -3946921629105938337 time 0.827944 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 2842488832350522458 Time: 0.676888 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: Conv_132 (CudaConvolution) [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 1.09053 [03/13/2022-08:30:39] [V] [TRT] Tactic: 2 time 1.0904 [03/13/2022-08:30:39] [V] [TRT] Tactic: 5 skipped. Scratch requested: 899645440, available: 16777216 [03/13/2022-08:30:39] [V] [TRT] Tactic: 57 skipped. Scratch requested: 17051648, available: 16777216 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 2 Time: 1.0904 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: Conv_132 (CudaDepthwiseConvolution) [03/13/2022-08:30:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2842488832350522458 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,768000) -> Half(1,20,300,192000) *************** [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: Conv_132 (FusedConvActConvolution) [03/13/2022-08:30:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: Conv_132 (CaskConvolution) [03/13/2022-08:30:39] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: Conv_132 (CudaConvolution) [03/13/2022-08:30:39] [V] [TRT] Tactic: 0 time 1.11186 [03/13/2022-08:30:39] [V] [TRT] Tactic: 1 time 0.870568 [03/13/2022-08:30:39] [V] [TRT] Tactic: 2 time 1.10785 [03/13/2022-08:30:39] [V] [TRT] Tactic: 5 skipped. Scratch requested: 899645440, available: 16777216 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 1 Time: 0.870568 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: Conv_132 (CudaDepthwiseConvolution) [03/13/2022-08:30:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:30:39] [V] [TRT] [03/13/2022-08:30:39] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,384000) -> Half(1,20,300:2,96000) *************** [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: Conv_132 (FusedConvActConvolution) [03/13/2022-08:30:39] [V] [TRT] Tactic: 458751 time 0.42626 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 458751 Time: 0.42626 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: Conv_132 (CaskConvolution) [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: 1145226902788474763 time 0.352916 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: 1651411198763708804 time 0.35156 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: 2418518597804310654 time 0.353116 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: 4318470497547290900 time 0.345396 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: 4653005425971292725 time 0.354836 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: 4930470141256631146 time 0.380392 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: 8292881859266835088 time 0.377052 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: 8401509141903434922 time 0.344068 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: -8654297089785671176 time 0.437272 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: -7448936905981214224 time 0.391488 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: -6004726995029373073 time 0.369516 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: -5719726816705110014 time 0.437364 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: -3754890472406891741 time 0.448836 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: -3689982367035295496 time 0.43892 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: -2894005464278291378 time 0.389276 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: -2027588946874785071 time 0.37472 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: -1968398013367819764 time 0.439328 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Tactic: -245090590808296743 time 0.448496 [03/13/2022-08:30:39] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 0.344068 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: Conv_132 (CudaConvolution) [03/13/2022-08:30:39] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: Conv_132 (CudaDepthwiseConvolution) [03/13/2022-08:30:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8401509141903434922 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:39] [V] [TRT] *************** Autotuning format combination: Half(80,3200,1:8,96000) -> Float(1,20,300,192000) *************** [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: Conv_132 (FusedConvActConvolution) [03/13/2022-08:30:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: Conv_132 (CaskConvolution) [03/13/2022-08:30:39] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: Conv_132 (CudaConvolution) [03/13/2022-08:30:39] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: Conv_132 (CudaDepthwiseConvolution) [03/13/2022-08:30:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:39] [V] [TRT] *************** Autotuning format combination: Half(80,3200,1:8,96000) -> Half(80,1600,1:8,24000) *************** [03/13/2022-08:30:39] [V] [TRT] Conv_132 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:39] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:39] [V] [TRT] Conv_132 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:39] [V] [TRT] Conv_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:39] [V] [TRT] Conv_132 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:39] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:39] [V] [TRT] Conv_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:39] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: Conv_132 (FusedConvActConvolution) [03/13/2022-08:30:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:39] [V] [TRT] --------------- Timing Runner: Conv_132 (CaskConvolution) [03/13/2022-08:30:39] [V] [TRT] Conv_132 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:40] [V] [TRT] Tactic: 130343752241278875 time 1.93441 [03/13/2022-08:30:40] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:40] [V] [TRT] Tactic: 2148106709480872763 time 3.84231 [03/13/2022-08:30:40] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:40] [V] [TRT] Tactic: 2410442691266548717 time 3.8421 [03/13/2022-08:30:40] [V] [TRT] Conv_132 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:40] [V] [TRT] Tactic: 2921824978225832523 time 1.93402 [03/13/2022-08:30:40] [V] [TRT] Conv_132 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:40] [V] [TRT] Tactic: 3030711443478140260 time 3.58474 [03/13/2022-08:30:40] [V] [TRT] Conv_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:40] [V] [TRT] Tactic: 3754069740140581927 time 7.15584 [03/13/2022-08:30:40] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:40] [V] [TRT] Tactic: 3823144360994712832 time 3.84469 [03/13/2022-08:30:40] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:40] [V] [TRT] Tactic: 5635311898703673455 time 3.8416 [03/13/2022-08:30:40] [V] [TRT] Conv_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:40] [V] [TRT] Tactic: 5925270497649423688 time 7.14845 [03/13/2022-08:30:40] [V] [TRT] Conv_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:40] [V] [TRT] Tactic: 6680916730816870145 time 7.15574 [03/13/2022-08:30:40] [V] [TRT] Conv_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:41] [V] [TRT] Tactic: 7158029511300006471 time 7.15761 [03/13/2022-08:30:41] [V] [TRT] Conv_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:41] [V] [TRT] Tactic: 7859952145590271433 time 7.38204 [03/13/2022-08:30:41] [V] [TRT] Conv_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:41] [V] [TRT] Tactic: 8283847742354150423 time 7.15828 [03/13/2022-08:30:41] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:41] [V] [TRT] Tactic: -8992262742606384444 time 3.84053 [03/13/2022-08:30:41] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:41] [V] [TRT] Tactic: -8682550625095202832 time 3.8424 [03/13/2022-08:30:41] [V] [TRT] Conv_132 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:41] [V] [TRT] Tactic: -8379842433586149932 time 3.57867 [03/13/2022-08:30:41] [V] [TRT] Conv_132 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:41] [V] [TRT] Tactic: -6352769237623756264 time 3.57822 [03/13/2022-08:30:41] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:41] [V] [TRT] Tactic: -6273232454637933930 time 3.84796 [03/13/2022-08:30:41] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:41] [V] [TRT] Tactic: -5818527483287834165 time 3.84326 [03/13/2022-08:30:41] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:30:41] [V] [TRT] Tactic: -4954692664176521434 time 3.8412 [03/13/2022-08:30:41] [V] [TRT] Conv_132 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:41] [V] [TRT] Tactic: -4953888146171240997 time 1.92785 [03/13/2022-08:30:41] [V] [TRT] Conv_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:42] [V] [TRT] Tactic: -4534876761957424274 time 7.1503 [03/13/2022-08:30:42] [V] [TRT] Conv_132 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:42] [V] [TRT] Tactic: -3237051169894153788 time 7.15631 [03/13/2022-08:30:42] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:42] [V] [TRT] Tactic: -3136088851200285532 time 3.83964 [03/13/2022-08:30:42] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:42] [V] [TRT] Tactic: -2586046817576862066 time 3.84035 [03/13/2022-08:30:42] [V] [TRT] Conv_132 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:42] [V] [TRT] Tactic: -229563042944049199 time 3.83552 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: -4953888146171240997 Time: 1.92785 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: Conv_132 (CudaConvolution) [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 1.33256 [03/13/2022-08:30:42] [V] [TRT] Tactic: 1 time 2.02398 [03/13/2022-08:30:42] [V] [TRT] Tactic: 2 time 1.17982 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 2 Time: 1.17982 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: Conv_132 (CudaDepthwiseConvolution) [03/13/2022-08:30:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2 [03/13/2022-08:30:42] [V] [TRT] [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:42] [V] [TRT] Tactic: 1002 time 0.022436 [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.039984 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 1002 Time: 0.022436 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:42] [V] [TRT] Tactic: 1002 time 0.015488 [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.017288 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 1002 Time: 0.015488 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:42] [V] [TRT] Tactic: 1002 time 0.028564 [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.013952 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 0 Time: 0.013952 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:42] [V] [TRT] Tactic: 1002 time 0.021752 [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.01356 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 0 Time: 0.01356 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:42] [V] [TRT] Tactic: 1002 time 0.04252 [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.02368 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 0 Time: 0.02368 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:42] [V] [TRT] Tactic: 1002 time 0.041844 [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.022716 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 0 Time: 0.022716 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:42] [V] [TRT] Tactic: 1002 time 0.03426 [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.023332 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 0 Time: 0.023332 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:42] [V] [TRT] Tactic: 1002 time 0.02814 [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.018192 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 0 Time: 0.018192 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:42] [V] [TRT] Tactic: 1002 time 0.016092 [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.015648 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 0 Time: 0.015648 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:42] [V] [TRT] Tactic: 1002 time 0.021088 [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.04028 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 1002 Time: 0.021088 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:42] [V] [TRT] Tactic: 1002 time 0.02684 [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.00992 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 0 Time: 0.00992 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:42] [V] [TRT] Tactic: 1002 time 0.019716 [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.010188 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 0 Time: 0.010188 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:42] [V] [TRT] Tactic: 1002 time 0.043616 [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.013636 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 0 Time: 0.013636 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:42] [V] [TRT] Tactic: 1002 time 0.021468 [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.039368 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 1002 Time: 0.021468 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:42] [V] [TRT] Tactic: 1002 time 0.041084 [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.009016 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 0 Time: 0.009016 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:42] [V] [TRT] Tactic: 1002 time 0.0196 [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.007852 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 0 Time: 0.007852 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:42] [V] [TRT] Tactic: 1002 time 0.021324 [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.011412 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 0 Time: 0.011412 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:42] [V] [TRT] Tactic: 1002 time 0.029216 [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.05004 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 1002 Time: 0.029216 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:42] [V] [TRT] Tactic: 1002 time 0.019396 [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.008664 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 0 Time: 0.008664 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:42] [V] [TRT] Tactic: 1002 time 0.033724 [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.00812 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 0 Time: 0.00812 [03/13/2022-08:30:42] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,192000) -> Float(1,20,300,192000) *************** [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_133, Mul_134) (PointWise) [03/13/2022-08:30:42] [V] [TRT] Tactic: 128 time 0.021436 [03/13/2022-08:30:42] [V] [TRT] Tactic: 256 time 0.021964 [03/13/2022-08:30:42] [V] [TRT] Tactic: 512 time 0.023756 [03/13/2022-08:30:42] [V] [TRT] Tactic: -32 time 0.035728 [03/13/2022-08:30:42] [V] [TRT] Tactic: -64 time 0.0253 [03/13/2022-08:30:42] [V] [TRT] Tactic: -128 time 0.023644 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 128 Time: 0.021436 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_133, Mul_134) (PointWiseV2) [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.016196 [03/13/2022-08:30:42] [V] [TRT] Tactic: 1 time 0.014204 [03/13/2022-08:30:42] [V] [TRT] Tactic: 2 time 0.013824 [03/13/2022-08:30:42] [V] [TRT] Tactic: 3 time 0.014724 [03/13/2022-08:30:42] [V] [TRT] Tactic: 4 time 0.013792 [03/13/2022-08:30:42] [V] [TRT] Tactic: 5 time 0.01366 [03/13/2022-08:30:42] [V] [TRT] Tactic: 6 time 0.014724 [03/13/2022-08:30:42] [V] [TRT] Tactic: 7 time 0.01368 [03/13/2022-08:30:42] [V] [TRT] Tactic: 8 time 0.01358 [03/13/2022-08:30:42] [V] [TRT] Tactic: 9 time 0.012444 [03/13/2022-08:30:42] [V] [TRT] Tactic: 28 time 0.01612 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 9 Time: 0.012444 [03/13/2022-08:30:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:30:42] [V] [TRT] [03/13/2022-08:30:42] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,6000) -> Float(1,20,300:32,6000) *************** [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_133, Mul_134) (PointWise) [03/13/2022-08:30:42] [V] [TRT] Tactic: 128 time 0.021156 [03/13/2022-08:30:42] [V] [TRT] Tactic: 256 time 0.021612 [03/13/2022-08:30:42] [V] [TRT] Tactic: 512 time 0.024136 [03/13/2022-08:30:42] [V] [TRT] Tactic: -32 time 0.035516 [03/13/2022-08:30:42] [V] [TRT] Tactic: -64 time 0.025236 [03/13/2022-08:30:42] [V] [TRT] Tactic: -128 time 0.023276 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 128 Time: 0.021156 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_133, Mul_134) (PointWiseV2) [03/13/2022-08:30:42] [V] [TRT] Tactic: 24 time 0.014608 [03/13/2022-08:30:42] [V] [TRT] Tactic: 25 time 0.014792 [03/13/2022-08:30:42] [V] [TRT] Tactic: 26 time 0.014336 [03/13/2022-08:30:42] [V] [TRT] Tactic: 27 time 0.014296 [03/13/2022-08:30:42] [V] [TRT] Tactic: 31 time 0.014992 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 27 Time: 0.014296 [03/13/2022-08:30:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [03/13/2022-08:30:42] [V] [TRT] [03/13/2022-08:30:42] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,192000) -> Half(1,20,300,192000) *************** [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_133, Mul_134) (PointWise) [03/13/2022-08:30:42] [V] [TRT] Tactic: 128 time 0.021492 [03/13/2022-08:30:42] [V] [TRT] Tactic: 256 time 0.018764 [03/13/2022-08:30:42] [V] [TRT] Tactic: 512 time 0.018652 [03/13/2022-08:30:42] [V] [TRT] Tactic: -32 time 0.028448 [03/13/2022-08:30:42] [V] [TRT] Tactic: -64 time 0.0235 [03/13/2022-08:30:42] [V] [TRT] Tactic: -128 time 0.021068 [03/13/2022-08:30:42] [V] [TRT] Fastest Tactic: 512 Time: 0.018652 [03/13/2022-08:30:42] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_133, Mul_134) (PointWiseV2) [03/13/2022-08:30:42] [V] [TRT] Tactic: 0 time 0.011872 [03/13/2022-08:30:43] [V] [TRT] Tactic: 1 time 0.009956 [03/13/2022-08:30:43] [V] [TRT] Tactic: 2 time 0.009084 [03/13/2022-08:30:43] [V] [TRT] Tactic: 3 time 0.009072 [03/13/2022-08:30:43] [V] [TRT] Tactic: 4 time 0.008036 [03/13/2022-08:30:43] [V] [TRT] Tactic: 5 time 0.007984 [03/13/2022-08:30:43] [V] [TRT] Tactic: 6 time 0.008256 [03/13/2022-08:30:43] [V] [TRT] Tactic: 7 time 0.007668 [03/13/2022-08:30:43] [V] [TRT] Tactic: 8 time 0.007484 [03/13/2022-08:30:43] [V] [TRT] Tactic: 9 time 0.007412 [03/13/2022-08:30:43] [V] [TRT] Tactic: 28 time 0.011912 [03/13/2022-08:30:43] [V] [TRT] Fastest Tactic: 9 Time: 0.007412 [03/13/2022-08:30:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:30:43] [V] [TRT] [03/13/2022-08:30:43] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300:2,96000) *************** [03/13/2022-08:30:43] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_133, Mul_134) (PointWise) [03/13/2022-08:30:43] [V] [TRT] Tactic: 128 time 0.020964 [03/13/2022-08:30:43] [V] [TRT] Tactic: 256 time 0.018676 [03/13/2022-08:30:43] [V] [TRT] Tactic: 512 time 0.01864 [03/13/2022-08:30:43] [V] [TRT] Tactic: -32 time 0.028316 [03/13/2022-08:30:43] [V] [TRT] Tactic: -64 time 0.023368 [03/13/2022-08:30:43] [V] [TRT] Tactic: -128 time 0.020944 [03/13/2022-08:30:43] [V] [TRT] Fastest Tactic: 512 Time: 0.01864 [03/13/2022-08:30:43] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_133, Mul_134) (PointWiseV2) [03/13/2022-08:30:43] [V] [TRT] Tactic: 0 time 0.009284 [03/13/2022-08:30:43] [V] [TRT] Tactic: 1 time 0.008448 [03/13/2022-08:30:43] [V] [TRT] Tactic: 2 time 0.009516 [03/13/2022-08:30:43] [V] [TRT] Tactic: 3 time 0.008084 [03/13/2022-08:30:43] [V] [TRT] Tactic: 4 time 0.008856 [03/13/2022-08:30:43] [V] [TRT] Tactic: 5 time 0.010312 [03/13/2022-08:30:43] [V] [TRT] Tactic: 6 time 0.00804 [03/13/2022-08:30:43] [V] [TRT] Tactic: 7 time 0.008804 [03/13/2022-08:30:43] [V] [TRT] Tactic: 8 time 0.010104 [03/13/2022-08:30:43] [V] [TRT] Tactic: 9 time 0.0122 [03/13/2022-08:30:43] [V] [TRT] Tactic: 10 time 0.012324 [03/13/2022-08:30:43] [V] [TRT] Tactic: 11 time 0.010128 [03/13/2022-08:30:43] [V] [TRT] Tactic: 12 time 0.00942 [03/13/2022-08:30:43] [V] [TRT] Tactic: 13 time 0.009256 [03/13/2022-08:30:43] [V] [TRT] Tactic: 14 time 0.0083 [03/13/2022-08:30:43] [V] [TRT] Tactic: 15 time 0.008208 [03/13/2022-08:30:43] [V] [TRT] Tactic: 16 time 0.008608 [03/13/2022-08:30:43] [V] [TRT] Tactic: 17 time 0.007888 [03/13/2022-08:30:43] [V] [TRT] Tactic: 18 time 0.007404 [03/13/2022-08:30:43] [V] [TRT] Tactic: 19 time 0.008056 [03/13/2022-08:30:43] [V] [TRT] Tactic: 28 time 0.009176 [03/13/2022-08:30:43] [V] [TRT] Tactic: 29 time 0.012228 [03/13/2022-08:30:43] [V] [TRT] Fastest Tactic: 18 Time: 0.007404 [03/13/2022-08:30:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:30:43] [V] [TRT] [03/13/2022-08:30:43] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Half(80,1600,1:8,24000) *************** [03/13/2022-08:30:43] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_133, Mul_134) (PointWise) [03/13/2022-08:30:43] [V] [TRT] Tactic: 128 time 0.020708 [03/13/2022-08:30:43] [V] [TRT] Tactic: 256 time 0.018804 [03/13/2022-08:30:43] [V] [TRT] Tactic: 512 time 0.018412 [03/13/2022-08:30:43] [V] [TRT] Tactic: -32 time 0.02856 [03/13/2022-08:30:43] [V] [TRT] Tactic: -64 time 0.02346 [03/13/2022-08:30:43] [V] [TRT] Tactic: -128 time 0.0211 [03/13/2022-08:30:43] [V] [TRT] Fastest Tactic: 512 Time: 0.018412 [03/13/2022-08:30:43] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_133, Mul_134) (PointWiseV2) [03/13/2022-08:30:43] [V] [TRT] Tactic: 0 time 0.00874 [03/13/2022-08:30:43] [V] [TRT] Tactic: 1 time 0.0082 [03/13/2022-08:30:43] [V] [TRT] Tactic: 2 time 0.010176 [03/13/2022-08:30:43] [V] [TRT] Tactic: 3 time 0.008468 [03/13/2022-08:30:43] [V] [TRT] Tactic: 4 time 0.010084 [03/13/2022-08:30:43] [V] [TRT] Tactic: 5 time 0.013284 [03/13/2022-08:30:43] [V] [TRT] Tactic: 6 time 0.011208 [03/13/2022-08:30:43] [V] [TRT] Tactic: 7 time 0.012556 [03/13/2022-08:30:43] [V] [TRT] Tactic: 8 time 0.0136 [03/13/2022-08:30:43] [V] [TRT] Tactic: 9 time 0.01882 [03/13/2022-08:30:43] [V] [TRT] Tactic: 10 time 0.008776 [03/13/2022-08:30:43] [V] [TRT] Tactic: 11 time 0.008136 [03/13/2022-08:30:43] [V] [TRT] Tactic: 12 time 0.008844 [03/13/2022-08:30:43] [V] [TRT] Tactic: 13 time 0.007948 [03/13/2022-08:30:43] [V] [TRT] Tactic: 14 time 0.008528 [03/13/2022-08:30:43] [V] [TRT] Tactic: 15 time 0.011364 [03/13/2022-08:30:43] [V] [TRT] Tactic: 16 time 0.009372 [03/13/2022-08:30:43] [V] [TRT] Tactic: 17 time 0.008836 [03/13/2022-08:30:43] [V] [TRT] Tactic: 18 time 0.011036 [03/13/2022-08:30:43] [V] [TRT] Tactic: 19 time 0.014724 [03/13/2022-08:30:43] [V] [TRT] Tactic: 20 time 0.009932 [03/13/2022-08:30:43] [V] [TRT] Tactic: 21 time 0.008796 [03/13/2022-08:30:43] [V] [TRT] Tactic: 22 time 0.008124 [03/13/2022-08:30:43] [V] [TRT] Tactic: 23 time 0.008032 [03/13/2022-08:30:43] [V] [TRT] Tactic: 24 time 0.012364 [03/13/2022-08:30:43] [V] [TRT] Tactic: 25 time 0.010184 [03/13/2022-08:30:43] [V] [TRT] Tactic: 26 time 0.008864 [03/13/2022-08:30:43] [V] [TRT] Tactic: 27 time 0.00856 [03/13/2022-08:30:43] [V] [TRT] Tactic: 28 time 0.008496 [03/13/2022-08:30:43] [V] [TRT] Tactic: 29 time 0.008912 [03/13/2022-08:30:43] [V] [TRT] Tactic: 30 time 0.00994 [03/13/2022-08:30:43] [V] [TRT] Tactic: 31 time 0.012708 [03/13/2022-08:30:43] [V] [TRT] Fastest Tactic: 13 Time: 0.007948 [03/13/2022-08:30:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 13 [03/13/2022-08:30:43] [V] [TRT] [03/13/2022-08:30:43] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,192000) -> Float(1,20,300,96000) *************** [03/13/2022-08:30:43] [V] [TRT] Conv_135 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:30:43] [V] [TRT] Conv_135 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:30:43] [V] [TRT] Conv_135 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:30:43] [V] [TRT] Conv_135 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:30:43] [V] [TRT] Conv_135 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:30:43] [V] [TRT] Conv_135 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:30:43] [V] [TRT] Conv_135 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:30:43] [V] [TRT] Conv_135 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:30:43] [V] [TRT] Conv_135 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:30:43] [V] [TRT] --------------- Timing Runner: Conv_135 (FusedConvActConvolution) [03/13/2022-08:30:43] [V] [TRT] Tactic: 589823 time 0.259052 [03/13/2022-08:30:43] [V] [TRT] Tactic: 655359 time 0.166752 [03/13/2022-08:30:43] [V] [TRT] Tactic: 786431 time 0.158688 [03/13/2022-08:30:43] [V] [TRT] Tactic: 851967 time 0.108812 [03/13/2022-08:30:43] [V] [TRT] Tactic: 1179647 time 0.111992 [03/13/2022-08:30:43] [V] [TRT] Tactic: 1310719 time 0.163872 [03/13/2022-08:30:43] [V] [TRT] Tactic: 1376255 time 0.17742 [03/13/2022-08:30:43] [V] [TRT] Tactic: 1441791 time 0.123056 [03/13/2022-08:30:43] [V] [TRT] Tactic: 1507327 time 0.111696 [03/13/2022-08:30:43] [V] [TRT] Tactic: 1638399 time 0.124116 [03/13/2022-08:30:43] [V] [TRT] Tactic: 1835007 time 0.1538 [03/13/2022-08:30:43] [V] [TRT] Tactic: 1900543 time 0.178984 [03/13/2022-08:30:43] [V] [TRT] Tactic: 2097151 time 0.131884 [03/13/2022-08:30:43] [V] [TRT] Tactic: 2162687 time 0.181728 [03/13/2022-08:30:43] [V] [TRT] Tactic: 2293759 time 0.1715 [03/13/2022-08:30:43] [V] [TRT] Tactic: 2359295 time 0.107136 [03/13/2022-08:30:43] [V] [TRT] Tactic: 2686975 time 0.168664 [03/13/2022-08:30:43] [V] [TRT] Tactic: 3080191 time 0.106332 [03/13/2022-08:30:43] [V] [TRT] Tactic: 3342335 time 0.11542 [03/13/2022-08:30:43] [V] [TRT] Tactic: 3407871 time 0.117652 [03/13/2022-08:30:43] [V] [TRT] Tactic: 3538943 time 0.111404 [03/13/2022-08:30:43] [V] [TRT] Tactic: 3670015 time 0.306216 [03/13/2022-08:30:43] [V] [TRT] Tactic: 3932159 time 0.146208 [03/13/2022-08:30:43] [V] [TRT] Tactic: 3997695 time 0.133324 [03/13/2022-08:30:43] [V] [TRT] Tactic: 4063231 time 0.109168 [03/13/2022-08:30:43] [V] [TRT] Tactic: 4194303 time 0.133844 [03/13/2022-08:30:43] [V] [TRT] Tactic: 4259839 time 0.140656 [03/13/2022-08:30:43] [V] [TRT] Tactic: 4325375 time 0.121084 [03/13/2022-08:30:43] [V] [TRT] Tactic: 4521983 time 0.170124 [03/13/2022-08:30:43] [V] [TRT] Tactic: 4587519 time 0.147004 [03/13/2022-08:30:43] [V] [TRT] Tactic: 4653055 time 0.100856 [03/13/2022-08:30:43] [V] [TRT] Tactic: 4915199 time 0.12724 [03/13/2022-08:30:43] [V] [TRT] Tactic: 4980735 time 0.124356 [03/13/2022-08:30:44] [V] [TRT] Tactic: 5177343 time 0.10838 [03/13/2022-08:30:44] [V] [TRT] Tactic: 5242879 time 0.105784 [03/13/2022-08:30:44] [V] [TRT] Tactic: 5373951 time 0.1262 [03/13/2022-08:30:44] [V] [TRT] Tactic: 5439487 time 0.21474 [03/13/2022-08:30:44] [V] [TRT] Tactic: 5570559 time 0.108808 [03/13/2022-08:30:44] [V] [TRT] Tactic: 5636095 time 0.109708 [03/13/2022-08:30:44] [V] [TRT] Tactic: 5701631 time 0.164464 [03/13/2022-08:30:44] [V] [TRT] Tactic: 5767167 time 0.275432 [03/13/2022-08:30:44] [V] [TRT] Tactic: 5832703 time 0.115832 [03/13/2022-08:30:44] [V] [TRT] Tactic: 5898239 time 0.10076 [03/13/2022-08:30:44] [V] [TRT] Tactic: 6029311 time 0.159844 [03/13/2022-08:30:44] [V] [TRT] Tactic: 6225919 time 0.118236 [03/13/2022-08:30:44] [V] [TRT] Tactic: 6291455 time 0.112564 [03/13/2022-08:30:44] [V] [TRT] Tactic: 6422527 time 0.109652 [03/13/2022-08:30:44] [V] [TRT] Tactic: 6750207 time 0.156984 [03/13/2022-08:30:44] [V] [TRT] Tactic: 6815743 time 0.12314 [03/13/2022-08:30:44] [V] [TRT] Tactic: 6946815 time 0.173504 [03/13/2022-08:30:44] [V] [TRT] Tactic: 7012351 time 0.131504 [03/13/2022-08:30:44] [V] [TRT] Tactic: 7077887 time 0.110232 [03/13/2022-08:30:44] [V] [TRT] Tactic: 7143423 time 0.23488 [03/13/2022-08:30:44] [V] [TRT] Tactic: 7208959 time 0.104852 [03/13/2022-08:30:44] [V] [TRT] Tactic: 7340031 time 0.114904 [03/13/2022-08:30:44] [V] [TRT] Tactic: 7405567 time 0.100844 [03/13/2022-08:30:44] [V] [TRT] Tactic: 7536639 time 0.244876 [03/13/2022-08:30:44] [V] [TRT] Tactic: 7602175 time 0.161856 [03/13/2022-08:30:44] [V] [TRT] Tactic: 7733247 time 0.1096 [03/13/2022-08:30:44] [V] [TRT] Tactic: 7798783 time 0.158656 [03/13/2022-08:30:44] [V] [TRT] Tactic: 8191999 time 0.197272 [03/13/2022-08:30:44] [V] [TRT] Tactic: 8257535 time 0.152056 [03/13/2022-08:30:44] [V] [TRT] Tactic: 8323071 time 0.151768 [03/13/2022-08:30:44] [V] [TRT] Tactic: 8650751 time 0.149752 [03/13/2022-08:30:44] [V] [TRT] Tactic: 8716287 time 0.139856 [03/13/2022-08:30:44] [V] [TRT] Tactic: 9109503 time 0.15634 [03/13/2022-08:30:44] [V] [TRT] Tactic: 9568255 time 0.127084 [03/13/2022-08:30:44] [V] [TRT] Tactic: 9895935 time 0.138596 [03/13/2022-08:30:44] [V] [TRT] Tactic: 10223615 time 0.16862 [03/13/2022-08:30:44] [V] [TRT] Tactic: 10354687 time 0.140356 [03/13/2022-08:30:44] [V] [TRT] Tactic: 10551295 time 0.194216 [03/13/2022-08:30:44] [V] [TRT] Tactic: 10747903 time 0.105376 [03/13/2022-08:30:44] [V] [TRT] Tactic: 10944511 time 0.125408 [03/13/2022-08:30:44] [V] [TRT] Fastest Tactic: 5898239 Time: 0.10076 [03/13/2022-08:30:44] [V] [TRT] --------------- Timing Runner: Conv_135 (CaskConvolution) [03/13/2022-08:30:44] [V] [TRT] Conv_135 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Tactic: 1754569683116234317 time 0.106316 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Tactic: 1825138533642645384 time 0.107176 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Tactic: 2733356012094739613 time 0.113348 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Tactic: 3915320020053085238 time 0.106576 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Tactic: 6808617066150061604 time 0.1129 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Tactic: 9091006216302412844 time 0.106048 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Tactic: -8060443123034038864 time 0.115736 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Tactic: -4420849921117327522 time 0.102968 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Tactic: -3946921629105938337 time 0.127388 [03/13/2022-08:30:44] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.102968 [03/13/2022-08:30:44] [V] [TRT] --------------- Timing Runner: Conv_135 (CudaConvolution) [03/13/2022-08:30:44] [V] [TRT] Tactic: 0 time 0.125548 [03/13/2022-08:30:44] [V] [TRT] Tactic: 2 time 0.229036 [03/13/2022-08:30:44] [V] [TRT] Tactic: 5 skipped. Scratch requested: 29811200, available: 16777216 [03/13/2022-08:30:44] [V] [TRT] Tactic: 57 time 0.116012 [03/13/2022-08:30:44] [V] [TRT] Fastest Tactic: 57 Time: 0.116012 [03/13/2022-08:30:44] [V] [TRT] --------------- Timing Runner: Conv_135 (CudaDepthwiseConvolution) [03/13/2022-08:30:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5898239 [03/13/2022-08:30:44] [V] [TRT] [03/13/2022-08:30:44] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,192000) -> Half(1,20,300,96000) *************** [03/13/2022-08:30:44] [V] [TRT] --------------- Timing Runner: Conv_135 (FusedConvActConvolution) [03/13/2022-08:30:44] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:44] [V] [TRT] --------------- Timing Runner: Conv_135 (CaskConvolution) [03/13/2022-08:30:44] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:44] [V] [TRT] --------------- Timing Runner: Conv_135 (CudaConvolution) [03/13/2022-08:30:44] [V] [TRT] Tactic: 0 time 0.12662 [03/13/2022-08:30:44] [V] [TRT] Tactic: 1 time 0.12678 [03/13/2022-08:30:44] [V] [TRT] Tactic: 2 time 0.225812 [03/13/2022-08:30:44] [V] [TRT] Tactic: 4 skipped. Scratch requested: 1788968960, available: 16777216 [03/13/2022-08:30:44] [V] [TRT] Tactic: 5 skipped. Scratch requested: 29811200, available: 16777216 [03/13/2022-08:30:44] [V] [TRT] Fastest Tactic: 0 Time: 0.12662 [03/13/2022-08:30:44] [V] [TRT] --------------- Timing Runner: Conv_135 (CudaDepthwiseConvolution) [03/13/2022-08:30:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0 [03/13/2022-08:30:44] [V] [TRT] [03/13/2022-08:30:44] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300,96000) *************** [03/13/2022-08:30:44] [V] [TRT] --------------- Timing Runner: Conv_135 (FusedConvActConvolution) [03/13/2022-08:30:44] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:44] [V] [TRT] --------------- Timing Runner: Conv_135 (CaskConvolution) [03/13/2022-08:30:44] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:44] [V] [TRT] --------------- Timing Runner: Conv_135 (CudaConvolution) [03/13/2022-08:30:44] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:44] [V] [TRT] --------------- Timing Runner: Conv_135 (CudaDepthwiseConvolution) [03/13/2022-08:30:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:44] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300:2,48000) *************** [03/13/2022-08:30:44] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:44] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:44] [V] [TRT] --------------- Timing Runner: Conv_135 (FusedConvActConvolution) [03/13/2022-08:30:44] [V] [TRT] Tactic: 589823 time 0.091552 [03/13/2022-08:30:44] [V] [TRT] Tactic: 655359 time 0.066284 [03/13/2022-08:30:44] [V] [TRT] Tactic: 786431 time 0.07908 [03/13/2022-08:30:44] [V] [TRT] Tactic: 851967 time 0.0562 [03/13/2022-08:30:44] [V] [TRT] Tactic: 1179647 time 0.058088 [03/13/2022-08:30:44] [V] [TRT] Tactic: 1310719 time 0.08372 [03/13/2022-08:30:44] [V] [TRT] Tactic: 1376255 time 0.071072 [03/13/2022-08:30:44] [V] [TRT] Tactic: 1441791 time 0.051748 [03/13/2022-08:30:44] [V] [TRT] Tactic: 1507327 time 0.058544 [03/13/2022-08:30:44] [V] [TRT] Tactic: 1638399 time 0.065816 [03/13/2022-08:30:44] [V] [TRT] Tactic: 1835007 time 0.077956 [03/13/2022-08:30:44] [V] [TRT] Tactic: 1900543 time 0.069664 [03/13/2022-08:30:44] [V] [TRT] Tactic: 2097151 time 0.071484 [03/13/2022-08:30:44] [V] [TRT] Tactic: 2162687 time 0.072444 [03/13/2022-08:30:44] [V] [TRT] Tactic: 2293759 time 0.072628 [03/13/2022-08:30:44] [V] [TRT] Tactic: 2359295 time 0.04488 [03/13/2022-08:30:44] [V] [TRT] Tactic: 2686975 time 0.065044 [03/13/2022-08:30:44] [V] [TRT] Tactic: 3080191 time 0.054276 [03/13/2022-08:30:44] [V] [TRT] Tactic: 3342335 time 0.060092 [03/13/2022-08:30:44] [V] [TRT] Tactic: 3407871 time 0.057884 [03/13/2022-08:30:44] [V] [TRT] Tactic: 3538943 time 0.055508 [03/13/2022-08:30:44] [V] [TRT] Tactic: 3670015 time 0.114776 [03/13/2022-08:30:44] [V] [TRT] Tactic: 3932159 time 0.059688 [03/13/2022-08:30:44] [V] [TRT] Tactic: 3997695 time 0.069436 [03/13/2022-08:30:44] [V] [TRT] Tactic: 4063231 time 0.055012 [03/13/2022-08:30:44] [V] [TRT] Tactic: 4194303 time 0.08036 [03/13/2022-08:30:44] [V] [TRT] Tactic: 4259839 time 0.075176 [03/13/2022-08:30:44] [V] [TRT] Tactic: 4325375 time 0.063436 [03/13/2022-08:30:44] [V] [TRT] Tactic: 4521983 time 0.068436 [03/13/2022-08:30:44] [V] [TRT] Tactic: 4587519 time 0.079308 [03/13/2022-08:30:44] [V] [TRT] Tactic: 4653055 time 0.0545 [03/13/2022-08:30:44] [V] [TRT] Tactic: 4915199 time 0.070228 [03/13/2022-08:30:44] [V] [TRT] Tactic: 4980735 time 0.063732 [03/13/2022-08:30:45] [V] [TRT] Tactic: 5177343 time 0.053924 [03/13/2022-08:30:45] [V] [TRT] Tactic: 5242879 time 0.052032 [03/13/2022-08:30:45] [V] [TRT] Tactic: 5373951 time 0.0627 [03/13/2022-08:30:45] [V] [TRT] Tactic: 5439487 time 0.106616 [03/13/2022-08:30:45] [V] [TRT] Tactic: 5570559 time 0.056952 [03/13/2022-08:30:45] [V] [TRT] Tactic: 5636095 time 0.055308 [03/13/2022-08:30:45] [V] [TRT] Tactic: 5701631 time 0.06128 [03/13/2022-08:30:45] [V] [TRT] Tactic: 5767167 time 0.139644 [03/13/2022-08:30:45] [V] [TRT] Tactic: 5832703 time 0.05554 [03/13/2022-08:30:45] [V] [TRT] Tactic: 5898239 time 0.047888 [03/13/2022-08:30:45] [V] [TRT] Tactic: 6029311 time 0.063796 [03/13/2022-08:30:45] [V] [TRT] Tactic: 6225919 time 0.05348 [03/13/2022-08:30:45] [V] [TRT] Tactic: 6291455 time 0.058524 [03/13/2022-08:30:45] [V] [TRT] Tactic: 6422527 time 0.055532 [03/13/2022-08:30:45] [V] [TRT] Tactic: 6750207 time 0.080412 [03/13/2022-08:30:45] [V] [TRT] Tactic: 6815743 time 0.06484 [03/13/2022-08:30:45] [V] [TRT] Tactic: 6946815 time 0.086296 [03/13/2022-08:30:45] [V] [TRT] Tactic: 7012351 time 0.071564 [03/13/2022-08:30:45] [V] [TRT] Tactic: 7077887 time 0.05254 [03/13/2022-08:30:45] [V] [TRT] Tactic: 7143423 time 0.10632 [03/13/2022-08:30:45] [V] [TRT] Tactic: 7208959 time 0.048784 [03/13/2022-08:30:45] [V] [TRT] Tactic: 7340031 time 0.057328 [03/13/2022-08:30:45] [V] [TRT] Tactic: 7405567 time 0.049276 [03/13/2022-08:30:45] [V] [TRT] Tactic: 7536639 time 0.090352 [03/13/2022-08:30:45] [V] [TRT] Tactic: 7602175 time 0.083036 [03/13/2022-08:30:45] [V] [TRT] Tactic: 7733247 time 0.053128 [03/13/2022-08:30:45] [V] [TRT] Tactic: 7798783 time 0.079344 [03/13/2022-08:30:45] [V] [TRT] Tactic: 8191999 time 0.099076 [03/13/2022-08:30:45] [V] [TRT] Tactic: 8257535 time 0.079832 [03/13/2022-08:30:45] [V] [TRT] Tactic: 8323071 time 0.078376 [03/13/2022-08:30:45] [V] [TRT] Tactic: 8650751 time 0.076376 [03/13/2022-08:30:45] [V] [TRT] Tactic: 8716287 time 0.06766 [03/13/2022-08:30:45] [V] [TRT] Tactic: 9109503 time 0.084688 [03/13/2022-08:30:45] [V] [TRT] Tactic: 9568255 time 0.070404 [03/13/2022-08:30:45] [V] [TRT] Tactic: 9895935 time 0.079348 [03/13/2022-08:30:45] [V] [TRT] Tactic: 10223615 time 0.065072 [03/13/2022-08:30:45] [V] [TRT] Tactic: 10354687 time 0.074944 [03/13/2022-08:30:45] [V] [TRT] Tactic: 10551295 time 0.087936 [03/13/2022-08:30:45] [V] [TRT] Tactic: 10747903 time 0.047764 [03/13/2022-08:30:45] [V] [TRT] Tactic: 10944511 time 0.06422 [03/13/2022-08:30:45] [V] [TRT] Fastest Tactic: 2359295 Time: 0.04488 [03/13/2022-08:30:45] [V] [TRT] --------------- Timing Runner: Conv_135 (CaskConvolution) [03/13/2022-08:30:45] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: 1651411198763708804 time 0.058796 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: 2418518597804310654 time 0.058536 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: 4318470497547290900 time 0.057772 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: 4930470141256631146 time 0.060172 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: 8292881859266835088 time 0.060344 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: 8401509141903434922 time 0.057612 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -8654297089785671176 time 0.056056 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -7516584506774355935 time 0.057792 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -7140760933967189247 time 0.057384 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -6004726995029373073 time 0.059176 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -5719726816705110014 time 0.055828 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -4097850214384059472 time 0.058088 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -3717489476759089008 time 0.057344 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -3689982367035295496 time 0.056016 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -2640575123064142123 time 0.055944 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -2534402059426524406 time 0.056092 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -2027588946874785071 time 0.058904 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -1968398013367819764 time 0.055996 [03/13/2022-08:30:45] [V] [TRT] Fastest Tactic: -5719726816705110014 Time: 0.055828 [03/13/2022-08:30:45] [V] [TRT] --------------- Timing Runner: Conv_135 (CudaConvolution) [03/13/2022-08:30:45] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:45] [V] [TRT] --------------- Timing Runner: Conv_135 (CudaDepthwiseConvolution) [03/13/2022-08:30:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2359295 [03/13/2022-08:30:45] [V] [TRT] [03/13/2022-08:30:45] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Float(1,20,300,96000) *************** [03/13/2022-08:30:45] [V] [TRT] --------------- Timing Runner: Conv_135 (FusedConvActConvolution) [03/13/2022-08:30:45] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:45] [V] [TRT] --------------- Timing Runner: Conv_135 (CaskConvolution) [03/13/2022-08:30:45] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:45] [V] [TRT] --------------- Timing Runner: Conv_135 (CudaConvolution) [03/13/2022-08:30:45] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:45] [V] [TRT] --------------- Timing Runner: Conv_135 (CudaDepthwiseConvolution) [03/13/2022-08:30:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:45] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Half(40,800,1:8,12000) *************** [03/13/2022-08:30:45] [V] [TRT] Conv_135 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] --------------- Timing Runner: Conv_135 (FusedConvActConvolution) [03/13/2022-08:30:45] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:45] [V] [TRT] --------------- Timing Runner: Conv_135 (CaskConvolution) [03/13/2022-08:30:45] [V] [TRT] Conv_135 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:45] [V] [TRT] Tactic: 9576651994278528 time 0.220324 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: 1179757074518529353 time 0.434256 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: 2105695814191699972 time 0.801404 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: 2148106709480872763 time 0.433888 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: 2410442691266548717 time 0.860056 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: 3041642431972138763 time 0.433492 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: 3754069740140581927 time 0.801252 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: 4555462412611657028 time 0.4339 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: 5666160310350604399 time 0.80134 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:45] [V] [TRT] Tactic: 5876997871499382316 time 0.404732 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: 5925270497649423688 time 1.59511 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: 6680916730816870145 time 0.802536 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: 7158029511300006471 time 0.802132 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: 7859952145590271433 time 0.802256 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: 8283847742354150423 time 0.801668 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -8992262742606384444 time 0.434016 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -8391760416076885205 time 1.59446 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -6273232454637933930 time 0.434796 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:45] [V] [TRT] Tactic: -5925110308892264213 time 0.404044 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -5818527483287834165 time 0.434352 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:45] [V] [TRT] Tactic: -4908848143422991657 time 0.2209 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -4534876761957424274 time 1.59532 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -3237051169894153788 time 0.801764 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -3136088851200285532 time 0.43358 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -2586046817576862066 time 0.860084 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -2422160065350346448 time 0.802516 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:45] [V] [TRT] Tactic: -1216445540764179377 time 0.860028 [03/13/2022-08:30:45] [V] [TRT] Conv_135 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:46] [V] [TRT] Tactic: -229563042944049199 time 0.433876 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 9576651994278528 Time: 0.220324 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: Conv_135 (CudaConvolution) [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.21604 [03/13/2022-08:30:46] [V] [TRT] Tactic: 1 time 0.149876 [03/13/2022-08:30:46] [V] [TRT] Tactic: 2 time 0.203144 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 1 Time: 0.149876 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: Conv_135 (CudaDepthwiseConvolution) [03/13/2022-08:30:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:30:46] [V] [TRT] [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:46] [V] [TRT] Tactic: 1002 time 0.013076 [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.02144 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 1002 Time: 0.013076 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:46] [V] [TRT] Tactic: 1002 time 0.007184 [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.010408 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 1002 Time: 0.007184 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:46] [V] [TRT] Tactic: 1002 time 0.016836 [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.007152 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 0 Time: 0.007152 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:46] [V] [TRT] Tactic: 1002 time 0.013336 [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.007236 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 0 Time: 0.007236 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:46] [V] [TRT] Tactic: 1002 time 0.023152 [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.014196 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 0 Time: 0.014196 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:46] [V] [TRT] Tactic: 1002 time 0.022904 [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.013536 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 0 Time: 0.013536 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:46] [V] [TRT] Tactic: 1002 time 0.020848 [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.014172 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 0 Time: 0.014172 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:46] [V] [TRT] Tactic: 1002 time 0.017056 [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.010048 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 0 Time: 0.010048 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:46] [V] [TRT] Tactic: 1002 time 0.007132 [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.010148 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 1002 Time: 0.007132 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:46] [V] [TRT] Tactic: 1002 time 0.01328 [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.021416 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 1002 Time: 0.01328 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:46] [V] [TRT] Tactic: 1002 time 0.017048 [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.00706 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 0 Time: 0.00706 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:46] [V] [TRT] Tactic: 1002 time 0.013304 [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.007176 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 0 Time: 0.007176 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:46] [V] [TRT] Tactic: 1002 time 0.023248 [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.006688 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 0 Time: 0.006688 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:46] [V] [TRT] Tactic: 1002 time 0.013072 [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.021716 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 1002 Time: 0.013072 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:46] [V] [TRT] Tactic: 1002 time 0.023188 [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.006868 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 0 Time: 0.006868 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:46] [V] [TRT] Tactic: 1002 time 0.01306 [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.006036 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 0 Time: 0.006036 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:46] [V] [TRT] Tactic: 1002 time 0.012656 [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.006776 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 0 Time: 0.006776 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:46] [V] [TRT] Tactic: 1002 time 0.016816 [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.027524 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 1002 Time: 0.016816 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:46] [V] [TRT] Tactic: 1002 time 0.012776 [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.006808 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 0 Time: 0.006808 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:46] [V] [TRT] Tactic: 1002 time 0.021212 [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.006768 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 0 Time: 0.006768 [03/13/2022-08:30:46] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,96000) -> Float(1,20,300,96000) *************** [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_137, Mul_138) (PointWise) [03/13/2022-08:30:46] [V] [TRT] Tactic: 128 time 0.011396 [03/13/2022-08:30:46] [V] [TRT] Tactic: 256 time 0.011736 [03/13/2022-08:30:46] [V] [TRT] Tactic: 512 time 0.012488 [03/13/2022-08:30:46] [V] [TRT] Tactic: -32 time 0.025452 [03/13/2022-08:30:46] [V] [TRT] Tactic: -64 time 0.01672 [03/13/2022-08:30:46] [V] [TRT] Tactic: -128 time 0.01336 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 128 Time: 0.011396 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_137, Mul_138) (PointWiseV2) [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.008096 [03/13/2022-08:30:46] [V] [TRT] Tactic: 1 time 0.006704 [03/13/2022-08:30:46] [V] [TRT] Tactic: 2 time 0.006812 [03/13/2022-08:30:46] [V] [TRT] Tactic: 3 time 0.006616 [03/13/2022-08:30:46] [V] [TRT] Tactic: 4 time 0.00654 [03/13/2022-08:30:46] [V] [TRT] Tactic: 5 time 0.006616 [03/13/2022-08:30:46] [V] [TRT] Tactic: 6 time 0.006824 [03/13/2022-08:30:46] [V] [TRT] Tactic: 7 time 0.00636 [03/13/2022-08:30:46] [V] [TRT] Tactic: 8 time 0.006228 [03/13/2022-08:30:46] [V] [TRT] Tactic: 9 time 0.006492 [03/13/2022-08:30:46] [V] [TRT] Tactic: 28 time 0.008116 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 8 Time: 0.006228 [03/13/2022-08:30:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:30:46] [V] [TRT] [03/13/2022-08:30:46] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,3000) -> Float(1,20,300:32,3000) *************** [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_137, Mul_138) (PointWise) [03/13/2022-08:30:46] [V] [TRT] Tactic: 128 time 0.011524 [03/13/2022-08:30:46] [V] [TRT] Tactic: 256 time 0.011904 [03/13/2022-08:30:46] [V] [TRT] Tactic: 512 time 0.01242 [03/13/2022-08:30:46] [V] [TRT] Tactic: -32 time 0.025516 [03/13/2022-08:30:46] [V] [TRT] Tactic: -64 time 0.016624 [03/13/2022-08:30:46] [V] [TRT] Tactic: -128 time 0.013288 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 128 Time: 0.011524 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_137, Mul_138) (PointWiseV2) [03/13/2022-08:30:46] [V] [TRT] Tactic: 24 time 0.007812 [03/13/2022-08:30:46] [V] [TRT] Tactic: 25 time 0.007148 [03/13/2022-08:30:46] [V] [TRT] Tactic: 26 time 0.007136 [03/13/2022-08:30:46] [V] [TRT] Tactic: 27 time 0.00864 [03/13/2022-08:30:46] [V] [TRT] Tactic: 31 time 0.007856 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 26 Time: 0.007136 [03/13/2022-08:30:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [03/13/2022-08:30:46] [V] [TRT] [03/13/2022-08:30:46] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,96000) -> Half(1,20,300,96000) *************** [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_137, Mul_138) (PointWise) [03/13/2022-08:30:46] [V] [TRT] Tactic: 128 time 0.012732 [03/13/2022-08:30:46] [V] [TRT] Tactic: 256 time 0.011788 [03/13/2022-08:30:46] [V] [TRT] Tactic: 512 time 0.012588 [03/13/2022-08:30:46] [V] [TRT] Tactic: -32 time 0.025048 [03/13/2022-08:30:46] [V] [TRT] Tactic: -64 time 0.016584 [03/13/2022-08:30:46] [V] [TRT] Tactic: -128 time 0.013124 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 256 Time: 0.011788 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_137, Mul_138) (PointWiseV2) [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.008116 [03/13/2022-08:30:46] [V] [TRT] Tactic: 1 time 0.007508 [03/13/2022-08:30:46] [V] [TRT] Tactic: 2 time 0.006828 [03/13/2022-08:30:46] [V] [TRT] Tactic: 3 time 0.006556 [03/13/2022-08:30:46] [V] [TRT] Tactic: 4 time 0.006532 [03/13/2022-08:30:46] [V] [TRT] Tactic: 5 time 0.0062 [03/13/2022-08:30:46] [V] [TRT] Tactic: 6 time 0.006544 [03/13/2022-08:30:46] [V] [TRT] Tactic: 7 time 0.005972 [03/13/2022-08:30:46] [V] [TRT] Tactic: 8 time 0.006356 [03/13/2022-08:30:46] [V] [TRT] Tactic: 9 time 0.006152 [03/13/2022-08:30:46] [V] [TRT] Tactic: 28 time 0.008172 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 7 Time: 0.005972 [03/13/2022-08:30:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [03/13/2022-08:30:46] [V] [TRT] [03/13/2022-08:30:46] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,48000) -> Half(1,20,300:2,48000) *************** [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_137, Mul_138) (PointWise) [03/13/2022-08:30:46] [V] [TRT] Tactic: 128 time 0.012816 [03/13/2022-08:30:46] [V] [TRT] Tactic: 256 time 0.011904 [03/13/2022-08:30:46] [V] [TRT] Tactic: 512 time 0.012728 [03/13/2022-08:30:46] [V] [TRT] Tactic: -32 time 0.025612 [03/13/2022-08:30:46] [V] [TRT] Tactic: -64 time 0.016588 [03/13/2022-08:30:46] [V] [TRT] Tactic: -128 time 0.013316 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 256 Time: 0.011904 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_137, Mul_138) (PointWiseV2) [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.006652 [03/13/2022-08:30:46] [V] [TRT] Tactic: 1 time 0.006748 [03/13/2022-08:30:46] [V] [TRT] Tactic: 2 time 0.006776 [03/13/2022-08:30:46] [V] [TRT] Tactic: 3 time 0.006356 [03/13/2022-08:30:46] [V] [TRT] Tactic: 4 time 0.006644 [03/13/2022-08:30:46] [V] [TRT] Tactic: 5 time 0.00668 [03/13/2022-08:30:46] [V] [TRT] Tactic: 6 time 0.007048 [03/13/2022-08:30:46] [V] [TRT] Tactic: 7 time 0.006812 [03/13/2022-08:30:46] [V] [TRT] Tactic: 8 time 0.00698 [03/13/2022-08:30:46] [V] [TRT] Tactic: 9 time 0.007308 [03/13/2022-08:30:46] [V] [TRT] Tactic: 10 time 0.008564 [03/13/2022-08:30:46] [V] [TRT] Tactic: 11 time 0.007184 [03/13/2022-08:30:46] [V] [TRT] Tactic: 12 time 0.006704 [03/13/2022-08:30:46] [V] [TRT] Tactic: 13 time 0.006808 [03/13/2022-08:30:46] [V] [TRT] Tactic: 14 time 0.006924 [03/13/2022-08:30:46] [V] [TRT] Tactic: 15 time 0.006644 [03/13/2022-08:30:46] [V] [TRT] Tactic: 16 time 0.0065 [03/13/2022-08:30:46] [V] [TRT] Tactic: 17 time 0.006292 [03/13/2022-08:30:46] [V] [TRT] Tactic: 18 time 0.00616 [03/13/2022-08:30:46] [V] [TRT] Tactic: 19 time 0.006644 [03/13/2022-08:30:46] [V] [TRT] Tactic: 28 time 0.006716 [03/13/2022-08:30:46] [V] [TRT] Tactic: 29 time 0.008224 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 18 Time: 0.00616 [03/13/2022-08:30:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:30:46] [V] [TRT] [03/13/2022-08:30:46] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Half(40,800,1:8,12000) *************** [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_137, Mul_138) (PointWise) [03/13/2022-08:30:46] [V] [TRT] Tactic: 128 time 0.012984 [03/13/2022-08:30:46] [V] [TRT] Tactic: 256 time 0.012072 [03/13/2022-08:30:46] [V] [TRT] Tactic: 512 time 0.012744 [03/13/2022-08:30:46] [V] [TRT] Tactic: -32 time 0.025504 [03/13/2022-08:30:46] [V] [TRT] Tactic: -64 time 0.01672 [03/13/2022-08:30:46] [V] [TRT] Tactic: -128 time 0.013484 [03/13/2022-08:30:46] [V] [TRT] Fastest Tactic: 256 Time: 0.012072 [03/13/2022-08:30:46] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_137, Mul_138) (PointWiseV2) [03/13/2022-08:30:46] [V] [TRT] Tactic: 0 time 0.006556 [03/13/2022-08:30:46] [V] [TRT] Tactic: 1 time 0.006836 [03/13/2022-08:30:46] [V] [TRT] Tactic: 2 time 0.006892 [03/13/2022-08:30:46] [V] [TRT] Tactic: 3 time 0.00806 [03/13/2022-08:30:46] [V] [TRT] Tactic: 4 time 0.008188 [03/13/2022-08:30:46] [V] [TRT] Tactic: 5 time 0.008704 [03/13/2022-08:30:46] [V] [TRT] Tactic: 6 time 0.011088 [03/13/2022-08:30:46] [V] [TRT] Tactic: 7 time 0.01084 [03/13/2022-08:30:46] [V] [TRT] Tactic: 8 time 0.011208 [03/13/2022-08:30:46] [V] [TRT] Tactic: 9 time 0.011504 [03/13/2022-08:30:46] [V] [TRT] Tactic: 10 time 0.00666 [03/13/2022-08:30:46] [V] [TRT] Tactic: 11 time 0.006152 [03/13/2022-08:30:46] [V] [TRT] Tactic: 12 time 0.006628 [03/13/2022-08:30:46] [V] [TRT] Tactic: 13 time 0.006608 [03/13/2022-08:30:46] [V] [TRT] Tactic: 14 time 0.006616 [03/13/2022-08:30:46] [V] [TRT] Tactic: 15 time 0.006544 [03/13/2022-08:30:46] [V] [TRT] Tactic: 16 time 0.008352 [03/13/2022-08:30:46] [V] [TRT] Tactic: 17 time 0.008192 [03/13/2022-08:30:46] [V] [TRT] Tactic: 18 time 0.008612 [03/13/2022-08:30:46] [V] [TRT] Tactic: 19 time 0.009756 [03/13/2022-08:30:46] [V] [TRT] Tactic: 20 time 0.006944 [03/13/2022-08:30:46] [V] [TRT] Tactic: 21 time 0.00668 [03/13/2022-08:30:46] [V] [TRT] Tactic: 22 time 0.00624 [03/13/2022-08:30:46] [V] [TRT] Tactic: 23 time 0.006864 [03/13/2022-08:30:46] [V] [TRT] Tactic: 24 time 0.008532 [03/13/2022-08:30:46] [V] [TRT] Tactic: 25 time 0.00688 [03/13/2022-08:30:46] [V] [TRT] Tactic: 26 time 0.006712 [03/13/2022-08:30:46] [V] [TRT] Tactic: 27 time 0.00654 [03/13/2022-08:30:46] [V] [TRT] Tactic: 28 time 0.006376 [03/13/2022-08:30:46] [V] [TRT] Tactic: 29 time 0.006632 [03/13/2022-08:30:47] [V] [TRT] Tactic: 30 time 0.0068 [03/13/2022-08:30:47] [V] [TRT] Tactic: 31 time 0.008212 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 11 Time: 0.006152 [03/13/2022-08:30:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 11 [03/13/2022-08:30:47] [V] [TRT] [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.013208 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.021064 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.013208 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.0071 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.010504 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.0071 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.017032 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.006992 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.006992 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.013336 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.006948 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.006948 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.022744 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.0141 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.0141 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.023096 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.013248 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.013248 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.021152 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.014132 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.014132 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.017164 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.010252 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.010252 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.007256 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.010072 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.007256 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.013176 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.021612 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.013176 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.016904 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.007032 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.007032 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.013148 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.007176 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.007176 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.023296 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.006824 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.006824 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.013064 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.0219 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.013064 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.023648 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.006828 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.006828 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.013164 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.00604 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.00604 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.012828 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.00694 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.00694 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.016816 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.027484 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.016816 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.012728 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.00672 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.00672 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.02124 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.006604 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.006604 [03/13/2022-08:30:47] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,96000) -> Float(1,20,300,384000) *************** [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: MaxPool_141 (Pooling) [03/13/2022-08:30:47] [V] [TRT] Tactic: -1 time 0.107696 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: -1 Time: 0.107696 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: MaxPool_141 (TiledPooling) [03/13/2022-08:30:47] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [03/13/2022-08:30:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -1 [03/13/2022-08:30:47] [V] [TRT] [03/13/2022-08:30:47] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,96000) -> Half(1,20,300,384000) *************** [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: MaxPool_141 (Pooling) [03/13/2022-08:30:47] [V] [TRT] Tactic: -1 time 0.106752 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: -1 Time: 0.106752 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: MaxPool_141 (TiledPooling) [03/13/2022-08:30:47] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [03/13/2022-08:30:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -1 [03/13/2022-08:30:47] [V] [TRT] [03/13/2022-08:30:47] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,48000) -> Half(1,20,300:2,192000) *************** [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: MaxPool_141 (Pooling) [03/13/2022-08:30:47] [V] [TRT] Tactic: -3 time 0.04396 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: -3 Time: 0.04396 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: MaxPool_141 (TiledPooling) [03/13/2022-08:30:47] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [03/13/2022-08:30:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -3 [03/13/2022-08:30:47] [V] [TRT] [03/13/2022-08:30:47] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Half(160,3200,1:8,48000) *************** [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: MaxPool_141 (Pooling) [03/13/2022-08:30:47] [V] [TRT] Tactic: -2 time 0.044928 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: -2 Time: 0.044928 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: MaxPool_141 (TiledPooling) [03/13/2022-08:30:47] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [03/13/2022-08:30:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -2 [03/13/2022-08:30:47] [V] [TRT] [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.00808 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.008812 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.00808 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.016836 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.007172 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.007172 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.012752 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.007232 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.007232 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.008048 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.008888 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.008048 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.016736 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.006788 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.006788 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.013268 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.007152 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.007152 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.023052 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.00936 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.00936 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.02368 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.008568 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.008568 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.0133 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.006044 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.006044 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.012644 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.014376 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.012644 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.012864 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.014196 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.012864 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:47] [V] [TRT] Tactic: 1002 time 0.0211 [03/13/2022-08:30:47] [V] [TRT] Tactic: 0 time 0.00636 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: 0 Time: 0.00636 [03/13/2022-08:30:47] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,96000) -> Float(1,20,300,384000) *************** [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: MaxPool_140 (Pooling) [03/13/2022-08:30:47] [V] [TRT] Tactic: -1 time 0.059716 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: -1 Time: 0.059716 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: MaxPool_140 (TiledPooling) [03/13/2022-08:30:47] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [03/13/2022-08:30:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -1 [03/13/2022-08:30:47] [V] [TRT] [03/13/2022-08:30:47] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,96000) -> Half(1,20,300,384000) *************** [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: MaxPool_140 (Pooling) [03/13/2022-08:30:47] [V] [TRT] Tactic: -1 time 0.059632 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: -1 Time: 0.059632 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: MaxPool_140 (TiledPooling) [03/13/2022-08:30:47] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [03/13/2022-08:30:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -1 [03/13/2022-08:30:47] [V] [TRT] [03/13/2022-08:30:47] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,48000) -> Half(1,20,300:2,192000) *************** [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: MaxPool_140 (Pooling) [03/13/2022-08:30:47] [V] [TRT] Tactic: -3 time 0.027596 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: -3 Time: 0.027596 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: MaxPool_140 (TiledPooling) [03/13/2022-08:30:47] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [03/13/2022-08:30:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -3 [03/13/2022-08:30:47] [V] [TRT] [03/13/2022-08:30:47] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Half(160,3200,1:8,48000) *************** [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: MaxPool_140 (Pooling) [03/13/2022-08:30:47] [V] [TRT] Tactic: -2 time 0.024864 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: -2 Time: 0.024864 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: MaxPool_140 (TiledPooling) [03/13/2022-08:30:47] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [03/13/2022-08:30:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -2 [03/13/2022-08:30:47] [V] [TRT] [03/13/2022-08:30:47] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,96000) -> Float(1,20,300,384000) *************** [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: MaxPool_139 (Pooling) [03/13/2022-08:30:47] [V] [TRT] Tactic: -1 time 0.026456 [03/13/2022-08:30:47] [V] [TRT] Fastest Tactic: -1 Time: 0.026456 [03/13/2022-08:30:47] [V] [TRT] --------------- Timing Runner: MaxPool_139 (TiledPooling) [03/13/2022-08:30:47] [V] [TRT] Tactic: 7733505 time 0.316572 [03/13/2022-08:30:47] [V] [TRT] Tactic: 7733506 time 0.160552 [03/13/2022-08:30:47] [V] [TRT] Tactic: 7733508 time 0.094872 [03/13/2022-08:30:47] [V] [TRT] Tactic: 7733511 time 0.058752 [03/13/2022-08:30:47] [V] [TRT] Tactic: 7733512 time 0.058752 [03/13/2022-08:30:47] [V] [TRT] Tactic: 7733519 time 0.052824 [03/13/2022-08:30:47] [V] [TRT] Tactic: 7733520 time 0.06588 [03/13/2022-08:30:47] [V] [TRT] Tactic: 7733524 time 0.03646 [03/13/2022-08:30:47] [V] [TRT] Tactic: 7733761 time 0.171876 [03/13/2022-08:30:47] [V] [TRT] Tactic: 7733762 time 0.100328 [03/13/2022-08:30:47] [V] [TRT] Tactic: 7733764 time 0.052988 [03/13/2022-08:30:47] [V] [TRT] Tactic: 7733767 time 0.043 [03/13/2022-08:30:47] [V] [TRT] Tactic: 7733768 time 0.043064 [03/13/2022-08:30:47] [V] [TRT] Tactic: 7733775 time 0.037872 [03/13/2022-08:30:47] [V] [TRT] Tactic: 7733776 time 0.037316 [03/13/2022-08:30:47] [V] [TRT] Tactic: 7733780 time 0.036316 [03/13/2022-08:30:47] [V] [TRT] Tactic: 7734017 time 0.159544 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734018 time 0.082572 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734020 time 0.044676 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734023 time 0.036984 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734024 time 0.036808 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734031 time 0.043488 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734032 time 0.043472 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734036 time 0.028376 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734273 time 0.12872 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734274 time 0.067424 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734276 time 0.036864 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734279 time 0.0334 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734280 time 0.033456 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734287 time 0.035792 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734288 time 0.041676 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734292 time 0.029788 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734529 time 0.098284 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734530 time 0.052208 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734532 time 0.039588 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734535 time 0.036864 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734536 time 0.036864 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734543 time 0.041536 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734544 time 0.041624 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734548 time 0.030144 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734785 time 0.098016 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734786 time 0.05204 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734788 time 0.039632 [03/13/2022-08:30:48] [V] [TRT] Tactic: 7734791 time 0.036616 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7734792 time 0.036536 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7734799 time 0.041324 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7734800 time 0.045028 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7734804 time 0.030964 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7735041 time 0.098328 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7735042 time 0.065864 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7735044 time 0.03932 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7735047 time 0.036344 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7735048 time 0.039288 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7735055 time 0.053368 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7735056 time 0.053268 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7735060 time 0.037032 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7735297 time 0.067808 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7735298 time 0.046628 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7735300 time 0.02906 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7735303 time 0.03318 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7735304 time 0.03306 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7735311 time 0.03902 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7735312 time 0.041352 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7735316 time 0.02844 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7735553 time 0.08684 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7735554 time 0.046028 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7735556 time 0.039928 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7735559 time 0.034436 [03/13/2022-08:30:49] [V] [TRT] Tactic: 7735560 time 0.038948 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7735567 time 0.045628 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7735568 time 0.047524 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7735572 time 0.032488 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7735809 time 0.086404 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7735810 time 0.046264 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7735812 time 0.039556 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7735815 time 0.038964 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7735816 time 0.044296 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7735823 time 0.04838 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7735824 time 0.049612 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7735828 time 0.03886 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7736065 time 0.086112 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7736066 time 0.046612 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7736068 time 0.039804 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7736071 time 0.041332 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7736072 time 0.041332 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7736079 time 0.055008 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7736080 time 0.054976 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7736084 time 0.042188 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7736321 time 0.085992 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7736322 time 0.047092 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7736324 time 0.043592 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7736327 time 0.043 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7736328 time 0.046676 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7736335 time 0.054948 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7736336 time 0.057476 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7736340 time 0.041724 [03/13/2022-08:30:50] [V] [TRT] Fastest Tactic: 7734036 Time: 0.028376 [03/13/2022-08:30:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -1 [03/13/2022-08:30:50] [V] [TRT] [03/13/2022-08:30:50] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,96000) -> Half(1,20,300,384000) *************** [03/13/2022-08:30:50] [V] [TRT] --------------- Timing Runner: MaxPool_139 (Pooling) [03/13/2022-08:30:50] [V] [TRT] Tactic: -1 time 0.033924 [03/13/2022-08:30:50] [V] [TRT] Fastest Tactic: -1 Time: 0.033924 [03/13/2022-08:30:50] [V] [TRT] --------------- Timing Runner: MaxPool_139 (TiledPooling) [03/13/2022-08:30:50] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [03/13/2022-08:30:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -1 [03/13/2022-08:30:50] [V] [TRT] [03/13/2022-08:30:50] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,48000) -> Half(1,20,300:2,192000) *************** [03/13/2022-08:30:50] [V] [TRT] --------------- Timing Runner: MaxPool_139 (Pooling) [03/13/2022-08:30:50] [V] [TRT] Tactic: -3 time 0.017984 [03/13/2022-08:30:50] [V] [TRT] Fastest Tactic: -3 Time: 0.017984 [03/13/2022-08:30:50] [V] [TRT] --------------- Timing Runner: MaxPool_139 (TiledPooling) [03/13/2022-08:30:50] [V] [TRT] Tactic: 7733505 time 0.240384 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7733506 time 0.122896 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7733508 time 0.076956 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7733511 time 0.05066 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7733512 time 0.052552 [03/13/2022-08:30:50] [V] [TRT] Tactic: 7733519 time 0.043752 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7733520 time 0.052592 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7733524 time 0.028724 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7733761 time 0.13096 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7733762 time 0.081452 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7733764 time 0.045948 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7733767 time 0.035108 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7733768 time 0.035312 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7733775 time 0.030492 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7733776 time 0.030424 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7733780 time 0.024068 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7734017 time 0.10044 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7734018 time 0.05324 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7734020 time 0.029268 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7734023 time 0.024456 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7734024 time 0.02434 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7734031 time 0.028416 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7734032 time 0.028276 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7734036 time 0.01886 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7734273 time 0.081732 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7734274 time 0.04364 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7734276 time 0.024872 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7734279 time 0.021064 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7734280 time 0.020724 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7734287 time 0.024164 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7734288 time 0.024208 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7734292 time 0.018992 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7734529 time 0.062812 [03/13/2022-08:30:51] [V] [TRT] Tactic: 7734530 time 0.03442 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7734532 time 0.024616 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7734535 time 0.027364 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7734536 time 0.025032 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7734543 time 0.026308 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7734544 time 0.02948 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7734548 time 0.017148 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7734785 time 0.063 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7734786 time 0.035916 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7734788 time 0.024512 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7734791 time 0.02538 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7734792 time 0.026496 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7734799 time 0.030044 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7734800 time 0.030368 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7734804 time 0.018312 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7735041 time 0.062764 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7735042 time 0.041748 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7735044 time 0.024188 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7735047 time 0.02292 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7735048 time 0.0259 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7735055 time 0.028164 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7735056 time 0.028156 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7735060 time 0.021956 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7735297 time 0.043684 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7735298 time 0.029692 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7735300 time 0.018692 [03/13/2022-08:30:52] [V] [TRT] Tactic: 7735303 time 0.019644 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7735304 time 0.01972 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7735311 time 0.022084 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7735312 time 0.022948 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7735316 time 0.016932 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7735553 time 0.053892 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7735554 time 0.030108 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7735556 time 0.024604 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7735559 time 0.019908 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7735560 time 0.022092 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7735567 time 0.025252 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7735568 time 0.027248 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7735572 time 0.018424 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7735809 time 0.053916 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7735810 time 0.029968 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7735812 time 0.024784 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7735815 time 0.022248 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7735816 time 0.025324 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7735823 time 0.027016 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7735824 time 0.02742 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7735828 time 0.023 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7736065 time 0.053776 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7736066 time 0.03014 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7736068 time 0.024704 [03/13/2022-08:30:53] [V] [TRT] Tactic: 7736071 time 0.025312 [03/13/2022-08:30:54] [V] [TRT] Tactic: 7736072 time 0.02544 [03/13/2022-08:30:54] [V] [TRT] Tactic: 7736079 time 0.030664 [03/13/2022-08:30:54] [V] [TRT] Tactic: 7736080 time 0.030324 [03/13/2022-08:30:54] [V] [TRT] Tactic: 7736084 time 0.023344 [03/13/2022-08:30:54] [V] [TRT] Tactic: 7736321 time 0.053692 [03/13/2022-08:30:54] [V] [TRT] Tactic: 7736322 time 0.03004 [03/13/2022-08:30:54] [V] [TRT] Tactic: 7736324 time 0.0249 [03/13/2022-08:30:54] [V] [TRT] Tactic: 7736327 time 0.025544 [03/13/2022-08:30:54] [V] [TRT] Tactic: 7736328 time 0.025864 [03/13/2022-08:30:54] [V] [TRT] Tactic: 7736335 time 0.030332 [03/13/2022-08:30:54] [V] [TRT] Tactic: 7736336 time 0.031036 [03/13/2022-08:30:54] [V] [TRT] Tactic: 7736340 time 0.024592 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 7735316 Time: 0.016932 [03/13/2022-08:30:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 7735316 [03/13/2022-08:30:54] [V] [TRT] [03/13/2022-08:30:54] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Half(160,3200,1:8,48000) *************** [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: MaxPool_139 (Pooling) [03/13/2022-08:30:54] [V] [TRT] Tactic: -2 time 0.014696 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: -2 Time: 0.014696 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: MaxPool_139 (TiledPooling) [03/13/2022-08:30:54] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [03/13/2022-08:30:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -2 [03/13/2022-08:30:54] [V] [TRT] [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: 565 copy (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.009332 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.007428 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.007428 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: 565 copy (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.009112 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.010324 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.009112 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: 565 copy (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.021388 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.008556 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.008556 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: 565 copy (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.01642 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.00874 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.00874 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: 565 copy (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.029168 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.017284 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.017284 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: 565 copy (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.02956 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.01708 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.01708 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: 565 copy (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.027236 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.017212 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.017212 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: 565 copy (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.021256 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.01296 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.01296 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: 565 copy (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.00924 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.01048 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.00924 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: 565 copy (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.00946 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.0061 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.0061 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: 565 copy (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.02092 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.00822 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.00822 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: 565 copy (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.016584 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.008324 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.008324 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: 565 copy (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.02952 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.011028 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.011028 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: 565 copy (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.029664 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.010716 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.010716 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: 565 copy (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.020616 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.006336 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.006336 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: 565 copy (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.01646 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.00688 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.00688 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: 565 copy (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.015184 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.0177 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.015184 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: 565 copy (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.015192 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.016996 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.015192 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: 565 copy (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.027156 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.007356 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.007356 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: 565 copy (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.024376 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.008696 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.008696 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.029756 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.035892 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.029756 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.064052 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.028016 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.028016 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.048336 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.025496 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.025496 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.031896 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.03368 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.031896 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.063264 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.02638 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.02638 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.047588 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.023416 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.023416 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.104728 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.027252 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.027252 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.103856 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.025552 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.025552 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.047052 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.019024 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.019024 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.046704 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.021028 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.021028 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.04662 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.01842 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.01842 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:30:54] [V] [TRT] Tactic: 1002 time 0.078152 [03/13/2022-08:30:54] [V] [TRT] Tactic: 0 time 0.017368 [03/13/2022-08:30:54] [V] [TRT] Fastest Tactic: 0 Time: 0.017368 [03/13/2022-08:30:54] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,384000) -> Float(1,20,300,192000) *************** [03/13/2022-08:30:54] [V] [TRT] Conv_143 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:30:54] [V] [TRT] Conv_143 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:30:54] [V] [TRT] Conv_143 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:30:54] [V] [TRT] Conv_143 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:30:54] [V] [TRT] Conv_143 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:30:54] [V] [TRT] Conv_143 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:30:54] [V] [TRT] Conv_143 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:30:54] [V] [TRT] Conv_143 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:30:54] [V] [TRT] Conv_143 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:30:54] [V] [TRT] --------------- Timing Runner: Conv_143 (FusedConvActConvolution) [03/13/2022-08:30:55] [V] [TRT] Tactic: 589823 time 1.17119 [03/13/2022-08:30:55] [V] [TRT] Tactic: 655359 time 0.596348 [03/13/2022-08:30:55] [V] [TRT] Tactic: 786431 time 0.628416 [03/13/2022-08:30:55] [V] [TRT] Tactic: 851967 time 0.389864 [03/13/2022-08:30:55] [V] [TRT] Tactic: 1179647 time 0.45652 [03/13/2022-08:30:55] [V] [TRT] Tactic: 1310719 time 0.586064 [03/13/2022-08:30:55] [V] [TRT] Tactic: 1376255 time 0.377044 [03/13/2022-08:30:55] [V] [TRT] Tactic: 1441791 time 0.42942 [03/13/2022-08:30:55] [V] [TRT] Tactic: 1507327 time 0.343876 [03/13/2022-08:30:55] [V] [TRT] Tactic: 1638399 time 0.45148 [03/13/2022-08:30:55] [V] [TRT] Tactic: 1835007 time 0.540764 [03/13/2022-08:30:55] [V] [TRT] Tactic: 1900543 time 0.407484 [03/13/2022-08:30:55] [V] [TRT] Tactic: 2097151 time 0.480508 [03/13/2022-08:30:55] [V] [TRT] Tactic: 2162687 time 0.391328 [03/13/2022-08:30:55] [V] [TRT] Tactic: 2293759 time 0.614652 [03/13/2022-08:30:55] [V] [TRT] Tactic: 2359295 time 0.293728 [03/13/2022-08:30:55] [V] [TRT] Tactic: 2686975 time 0.350432 [03/13/2022-08:30:55] [V] [TRT] Tactic: 3080191 time 0.325452 [03/13/2022-08:30:55] [V] [TRT] Tactic: 3342335 time 0.349768 [03/13/2022-08:30:55] [V] [TRT] Tactic: 3407871 time 0.416216 [03/13/2022-08:30:55] [V] [TRT] Tactic: 3538943 time 0.442112 [03/13/2022-08:30:55] [V] [TRT] Tactic: 3670015 time 0.605748 [03/13/2022-08:30:55] [V] [TRT] Tactic: 3932159 time 0.339696 [03/13/2022-08:30:55] [V] [TRT] Tactic: 3997695 time 0.471564 [03/13/2022-08:30:55] [V] [TRT] Tactic: 4063231 time 0.319088 [03/13/2022-08:30:55] [V] [TRT] Tactic: 4194303 time 0.476876 [03/13/2022-08:30:55] [V] [TRT] Tactic: 4259839 time 0.517204 [03/13/2022-08:30:55] [V] [TRT] Tactic: 4325375 time 0.43072 [03/13/2022-08:30:55] [V] [TRT] Tactic: 4521983 time 0.490192 [03/13/2022-08:30:55] [V] [TRT] Tactic: 4587519 time 0.552748 [03/13/2022-08:30:55] [V] [TRT] Tactic: 4653055 time 0.348852 [03/13/2022-08:30:55] [V] [TRT] Tactic: 4915199 time 0.468632 [03/13/2022-08:30:56] [V] [TRT] Tactic: 4980735 time 0.457036 [03/13/2022-08:30:56] [V] [TRT] Tactic: 5177343 time 0.4396 [03/13/2022-08:30:56] [V] [TRT] Tactic: 5242879 time 0.407428 [03/13/2022-08:30:56] [V] [TRT] Tactic: 5373951 time 0.568784 [03/13/2022-08:30:56] [V] [TRT] Tactic: 5439487 time 0.92848 [03/13/2022-08:30:56] [V] [TRT] Tactic: 5570559 time 0.339432 [03/13/2022-08:30:56] [V] [TRT] Tactic: 5636095 time 0.31928 [03/13/2022-08:30:56] [V] [TRT] Tactic: 5701631 time 0.37132 [03/13/2022-08:30:56] [V] [TRT] Tactic: 5767167 time 1.06093 [03/13/2022-08:30:56] [V] [TRT] Tactic: 5832703 time 0.382988 [03/13/2022-08:30:56] [V] [TRT] Tactic: 5898239 time 0.328372 [03/13/2022-08:30:56] [V] [TRT] Tactic: 6029311 time 0.57116 [03/13/2022-08:30:56] [V] [TRT] Tactic: 6225919 time 0.395888 [03/13/2022-08:30:56] [V] [TRT] Tactic: 6291455 time 0.45256 [03/13/2022-08:30:56] [V] [TRT] Tactic: 6422527 time 0.36724 [03/13/2022-08:30:56] [V] [TRT] Tactic: 6750207 time 0.6373 [03/13/2022-08:30:56] [V] [TRT] Tactic: 6815743 time 0.504164 [03/13/2022-08:30:56] [V] [TRT] Tactic: 6946815 time 0.656624 [03/13/2022-08:30:56] [V] [TRT] Tactic: 7012351 time 0.480208 [03/13/2022-08:30:56] [V] [TRT] Tactic: 7077887 time 0.406548 [03/13/2022-08:30:56] [V] [TRT] Tactic: 7143423 time 0.814748 [03/13/2022-08:30:56] [V] [TRT] Tactic: 7208959 time 0.397012 [03/13/2022-08:30:56] [V] [TRT] Tactic: 7340031 time 0.400356 [03/13/2022-08:30:56] [V] [TRT] Tactic: 7405567 time 0.325304 [03/13/2022-08:30:56] [V] [TRT] Tactic: 7536639 time 0.746104 [03/13/2022-08:30:56] [V] [TRT] Tactic: 7602175 time 0.645352 [03/13/2022-08:30:56] [V] [TRT] Tactic: 7733247 time 0.375416 [03/13/2022-08:30:56] [V] [TRT] Tactic: 7798783 time 0.496916 [03/13/2022-08:30:56] [V] [TRT] Tactic: 8191999 time 0.950852 [03/13/2022-08:30:57] [V] [TRT] Tactic: 8257535 time 0.574704 [03/13/2022-08:30:57] [V] [TRT] Tactic: 8323071 time 0.623464 [03/13/2022-08:30:57] [V] [TRT] Tactic: 8650751 time 0.581852 [03/13/2022-08:30:57] [V] [TRT] Tactic: 8716287 time 0.587444 [03/13/2022-08:30:57] [V] [TRT] Tactic: 9109503 time 0.583288 [03/13/2022-08:30:57] [V] [TRT] Tactic: 9568255 time 0.469016 [03/13/2022-08:30:57] [V] [TRT] Tactic: 9895935 time 0.47776 [03/13/2022-08:30:57] [V] [TRT] Tactic: 10223615 time 0.350796 [03/13/2022-08:30:57] [V] [TRT] Tactic: 10354687 time 0.520852 [03/13/2022-08:30:57] [V] [TRT] Tactic: 10551295 time 0.631692 [03/13/2022-08:30:57] [V] [TRT] Tactic: 10747903 time 0.321132 [03/13/2022-08:30:57] [V] [TRT] Tactic: 10944511 time 0.45888 [03/13/2022-08:30:57] [V] [TRT] Fastest Tactic: 2359295 Time: 0.293728 [03/13/2022-08:30:57] [V] [TRT] --------------- Timing Runner: Conv_143 (CaskConvolution) [03/13/2022-08:30:57] [V] [TRT] Conv_143 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Tactic: 1754569683116234317 time 0.392588 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Tactic: 1825138533642645384 time 0.397696 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Tactic: 2733356012094739613 time 0.35008 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Tactic: 3915320020053085238 time 0.395812 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Tactic: 6808617066150061604 time 0.318432 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Tactic: 9091006216302412844 time 0.302784 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Tactic: -8060443123034038864 time 0.32594 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Tactic: -4420849921117327522 time 0.402732 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Tactic: -3946921629105938337 time 0.375132 [03/13/2022-08:30:57] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.302784 [03/13/2022-08:30:57] [V] [TRT] --------------- Timing Runner: Conv_143 (CudaConvolution) [03/13/2022-08:30:57] [V] [TRT] Tactic: 0 time 0.455368 [03/13/2022-08:30:57] [V] [TRT] Tactic: 2 time 0.571116 [03/13/2022-08:30:57] [V] [TRT] Tactic: 5 skipped. Scratch requested: 115328000, available: 16777216 [03/13/2022-08:30:57] [V] [TRT] Tactic: 57 time 0.334872 [03/13/2022-08:30:57] [V] [TRT] Fastest Tactic: 57 Time: 0.334872 [03/13/2022-08:30:57] [V] [TRT] --------------- Timing Runner: Conv_143 (CudaDepthwiseConvolution) [03/13/2022-08:30:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2359295 [03/13/2022-08:30:57] [V] [TRT] [03/13/2022-08:30:57] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,384000) -> Half(1,20,300,192000) *************** [03/13/2022-08:30:57] [V] [TRT] --------------- Timing Runner: Conv_143 (FusedConvActConvolution) [03/13/2022-08:30:57] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:57] [V] [TRT] --------------- Timing Runner: Conv_143 (CaskConvolution) [03/13/2022-08:30:57] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:57] [V] [TRT] --------------- Timing Runner: Conv_143 (CudaConvolution) [03/13/2022-08:30:57] [V] [TRT] Tactic: 0 time 0.36468 [03/13/2022-08:30:57] [V] [TRT] Tactic: 1 time 0.311168 [03/13/2022-08:30:57] [V] [TRT] Tactic: 2 time 0.4362 [03/13/2022-08:30:57] [V] [TRT] Tactic: 4 skipped. Scratch requested: 7144734720, available: 16777216 [03/13/2022-08:30:57] [V] [TRT] Tactic: 5 skipped. Scratch requested: 115328000, available: 16777216 [03/13/2022-08:30:57] [V] [TRT] Fastest Tactic: 1 Time: 0.311168 [03/13/2022-08:30:57] [V] [TRT] --------------- Timing Runner: Conv_143 (CudaDepthwiseConvolution) [03/13/2022-08:30:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:30:57] [V] [TRT] [03/13/2022-08:30:57] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,192000) -> Half(1,20,300,192000) *************** [03/13/2022-08:30:57] [V] [TRT] --------------- Timing Runner: Conv_143 (FusedConvActConvolution) [03/13/2022-08:30:57] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:57] [V] [TRT] --------------- Timing Runner: Conv_143 (CaskConvolution) [03/13/2022-08:30:57] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:57] [V] [TRT] --------------- Timing Runner: Conv_143 (CudaConvolution) [03/13/2022-08:30:57] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:57] [V] [TRT] --------------- Timing Runner: Conv_143 (CudaDepthwiseConvolution) [03/13/2022-08:30:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:57] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,192000) -> Half(1,20,300:2,96000) *************** [03/13/2022-08:30:57] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:57] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:57] [V] [TRT] --------------- Timing Runner: Conv_143 (FusedConvActConvolution) [03/13/2022-08:30:57] [V] [TRT] Tactic: 589823 time 0.498948 [03/13/2022-08:30:57] [V] [TRT] Tactic: 655359 time 0.220952 [03/13/2022-08:30:57] [V] [TRT] Tactic: 786431 time 0.262312 [03/13/2022-08:30:57] [V] [TRT] Tactic: 851967 time 0.160564 [03/13/2022-08:30:57] [V] [TRT] Tactic: 1179647 time 0.207784 [03/13/2022-08:30:57] [V] [TRT] Tactic: 1310719 time 0.290792 [03/13/2022-08:30:57] [V] [TRT] Tactic: 1376255 time 0.188268 [03/13/2022-08:30:57] [V] [TRT] Tactic: 1441791 time 0.20952 [03/13/2022-08:30:57] [V] [TRT] Tactic: 1507327 time 0.175856 [03/13/2022-08:30:57] [V] [TRT] Tactic: 1638399 time 0.227916 [03/13/2022-08:30:57] [V] [TRT] Tactic: 1835007 time 0.264876 [03/13/2022-08:30:57] [V] [TRT] Tactic: 1900543 time 0.186584 [03/13/2022-08:30:57] [V] [TRT] Tactic: 2097151 time 0.258116 [03/13/2022-08:30:57] [V] [TRT] Tactic: 2162687 time 0.192352 [03/13/2022-08:30:57] [V] [TRT] Tactic: 2293759 time 0.302704 [03/13/2022-08:30:57] [V] [TRT] Tactic: 2359295 time 0.146468 [03/13/2022-08:30:57] [V] [TRT] Tactic: 2686975 time 0.174856 [03/13/2022-08:30:57] [V] [TRT] Tactic: 3080191 time 0.165132 [03/13/2022-08:30:57] [V] [TRT] Tactic: 3342335 time 0.176672 [03/13/2022-08:30:57] [V] [TRT] Tactic: 3407871 time 0.192828 [03/13/2022-08:30:57] [V] [TRT] Tactic: 3538943 time 0.20138 [03/13/2022-08:30:57] [V] [TRT] Tactic: 3670015 time 0.308684 [03/13/2022-08:30:58] [V] [TRT] Tactic: 3932159 time 0.162056 [03/13/2022-08:30:58] [V] [TRT] Tactic: 3997695 time 0.24624 [03/13/2022-08:30:58] [V] [TRT] Tactic: 4063231 time 0.1625 [03/13/2022-08:30:58] [V] [TRT] Tactic: 4194303 time 0.262996 [03/13/2022-08:30:58] [V] [TRT] Tactic: 4259839 time 0.269232 [03/13/2022-08:30:58] [V] [TRT] Tactic: 4325375 time 0.219128 [03/13/2022-08:30:58] [V] [TRT] Tactic: 4521983 time 0.241104 [03/13/2022-08:30:58] [V] [TRT] Tactic: 4587519 time 0.294724 [03/13/2022-08:30:58] [V] [TRT] Tactic: 4653055 time 0.18962 [03/13/2022-08:30:58] [V] [TRT] Tactic: 4915199 time 0.245956 [03/13/2022-08:30:58] [V] [TRT] Tactic: 4980735 time 0.233536 [03/13/2022-08:30:58] [V] [TRT] Tactic: 5177343 time 0.187776 [03/13/2022-08:30:58] [V] [TRT] Tactic: 5242879 time 0.196164 [03/13/2022-08:30:58] [V] [TRT] Tactic: 5373951 time 0.241076 [03/13/2022-08:30:58] [V] [TRT] Tactic: 5439487 time 0.402756 [03/13/2022-08:30:58] [V] [TRT] Tactic: 5570559 time 0.172372 [03/13/2022-08:30:58] [V] [TRT] Tactic: 5636095 time 0.162816 [03/13/2022-08:30:58] [V] [TRT] Tactic: 5701631 time 0.174096 [03/13/2022-08:30:58] [V] [TRT] Tactic: 5767167 time 0.528468 [03/13/2022-08:30:58] [V] [TRT] Tactic: 5832703 time 0.18584 [03/13/2022-08:30:58] [V] [TRT] Tactic: 5898239 time 0.161784 [03/13/2022-08:30:58] [V] [TRT] Tactic: 6029311 time 0.2899 [03/13/2022-08:30:58] [V] [TRT] Tactic: 6225919 time 0.187768 [03/13/2022-08:30:58] [V] [TRT] Tactic: 6291455 time 0.207808 [03/13/2022-08:30:58] [V] [TRT] Tactic: 6422527 time 0.182436 [03/13/2022-08:30:58] [V] [TRT] Tactic: 6750207 time 0.302076 [03/13/2022-08:30:58] [V] [TRT] Tactic: 6815743 time 0.247736 [03/13/2022-08:30:58] [V] [TRT] Tactic: 6946815 time 0.313972 [03/13/2022-08:30:58] [V] [TRT] Tactic: 7012351 time 0.257688 [03/13/2022-08:30:58] [V] [TRT] Tactic: 7077887 time 0.179988 [03/13/2022-08:30:58] [V] [TRT] Tactic: 7143423 time 0.405868 [03/13/2022-08:30:58] [V] [TRT] Tactic: 7208959 time 0.192692 [03/13/2022-08:30:58] [V] [TRT] Tactic: 7340031 time 0.1997 [03/13/2022-08:30:58] [V] [TRT] Tactic: 7405567 time 0.159512 [03/13/2022-08:30:58] [V] [TRT] Tactic: 7536639 time 0.37134 [03/13/2022-08:30:58] [V] [TRT] Tactic: 7602175 time 0.313228 [03/13/2022-08:30:58] [V] [TRT] Tactic: 7733247 time 0.179796 [03/13/2022-08:30:58] [V] [TRT] Tactic: 7798783 time 0.261816 [03/13/2022-08:30:58] [V] [TRT] Tactic: 8191999 time 0.404836 [03/13/2022-08:30:58] [V] [TRT] Tactic: 8257535 time 0.29416 [03/13/2022-08:30:58] [V] [TRT] Tactic: 8323071 time 0.290256 [03/13/2022-08:30:58] [V] [TRT] Tactic: 8650751 time 0.274272 [03/13/2022-08:30:58] [V] [TRT] Tactic: 8716287 time 0.248868 [03/13/2022-08:30:58] [V] [TRT] Tactic: 9109503 time 0.315564 [03/13/2022-08:30:58] [V] [TRT] Tactic: 9568255 time 0.246128 [03/13/2022-08:30:58] [V] [TRT] Tactic: 9895935 time 0.263328 [03/13/2022-08:30:58] [V] [TRT] Tactic: 10223615 time 0.17436 [03/13/2022-08:30:58] [V] [TRT] Tactic: 10354687 time 0.267256 [03/13/2022-08:30:58] [V] [TRT] Tactic: 10551295 time 0.309716 [03/13/2022-08:30:58] [V] [TRT] Tactic: 10747903 time 0.159036 [03/13/2022-08:30:58] [V] [TRT] Tactic: 10944511 time 0.22948 [03/13/2022-08:30:58] [V] [TRT] Fastest Tactic: 2359295 Time: 0.146468 [03/13/2022-08:30:58] [V] [TRT] --------------- Timing Runner: Conv_143 (CaskConvolution) [03/13/2022-08:30:58] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:58] [V] [TRT] Tactic: 1651411198763708804 time 0.159512 [03/13/2022-08:30:58] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: 2418518597804310654 time 0.160348 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: 4318470497547290900 time 0.157736 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: 4930470141256631146 time 0.17222 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: 8292881859266835088 time 0.169828 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: 8401509141903434922 time 0.157484 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: -8654297089785671176 time 0.200836 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: -7516584506774355935 time 0.160548 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: -7140760933967189247 time 0.156108 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: -6004726995029373073 time 0.163956 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: -5719726816705110014 time 0.20072 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: -4097850214384059472 time 0.159916 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: -3717489476759089008 time 0.155604 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: -3689982367035295496 time 0.201592 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: -2640575123064142123 time 0.200236 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: -2534402059426524406 time 0.201032 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: -2027588946874785071 time 0.167208 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: -1968398013367819764 time 0.201516 [03/13/2022-08:30:59] [V] [TRT] Fastest Tactic: -3717489476759089008 Time: 0.155604 [03/13/2022-08:30:59] [V] [TRT] --------------- Timing Runner: Conv_143 (CudaConvolution) [03/13/2022-08:30:59] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:59] [V] [TRT] --------------- Timing Runner: Conv_143 (CudaDepthwiseConvolution) [03/13/2022-08:30:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2359295 [03/13/2022-08:30:59] [V] [TRT] [03/13/2022-08:30:59] [V] [TRT] *************** Autotuning format combination: Half(160,3200,1:8,48000) -> Float(1,20,300,192000) *************** [03/13/2022-08:30:59] [V] [TRT] --------------- Timing Runner: Conv_143 (FusedConvActConvolution) [03/13/2022-08:30:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:59] [V] [TRT] --------------- Timing Runner: Conv_143 (CaskConvolution) [03/13/2022-08:30:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:59] [V] [TRT] --------------- Timing Runner: Conv_143 (CudaConvolution) [03/13/2022-08:30:59] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:59] [V] [TRT] --------------- Timing Runner: Conv_143 (CudaDepthwiseConvolution) [03/13/2022-08:30:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:59] [V] [TRT] *************** Autotuning format combination: Half(160,3200,1:8,48000) -> Half(80,1600,1:8,24000) *************** [03/13/2022-08:30:59] [V] [TRT] Conv_143 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] --------------- Timing Runner: Conv_143 (FusedConvActConvolution) [03/13/2022-08:30:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:30:59] [V] [TRT] --------------- Timing Runner: Conv_143 (CaskConvolution) [03/13/2022-08:30:59] [V] [TRT] Conv_143 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:30:59] [V] [TRT] Tactic: 9576651994278528 time 0.858976 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: 1179757074518529353 time 1.7142 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: 2105695814191699972 time 3.18881 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: 2148106709480872763 time 1.7187 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: 2410442691266548717 time 1.71742 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: 3041642431972138763 time 1.7151 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: 3754069740140581927 time 3.18985 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: 4555462412611657028 time 1.71636 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: 5666160310350604399 time 3.18888 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:30:59] [V] [TRT] Tactic: 5876997871499382316 time 1.60046 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: 5925270497649423688 time 3.18641 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: 6680916730816870145 time 3.1977 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: 7158029511300006471 time 3.19046 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: 7859952145590271433 time 3.19234 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:30:59] [V] [TRT] Tactic: 8283847742354150423 time 3.19046 [03/13/2022-08:30:59] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:00] [V] [TRT] Tactic: -8992262742606384444 time 1.70992 [03/13/2022-08:31:00] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:00] [V] [TRT] Tactic: -8391760416076885205 time 3.18604 [03/13/2022-08:31:00] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:00] [V] [TRT] Tactic: -6273232454637933930 time 1.72157 [03/13/2022-08:31:00] [V] [TRT] Conv_143 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:00] [V] [TRT] Tactic: -5925110308892264213 time 1.60215 [03/13/2022-08:31:00] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:00] [V] [TRT] Tactic: -5818527483287834165 time 1.71969 [03/13/2022-08:31:00] [V] [TRT] Conv_143 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:00] [V] [TRT] Tactic: -4908848143422991657 time 0.8669 [03/13/2022-08:31:00] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:00] [V] [TRT] Tactic: -4534876761957424274 time 3.1861 [03/13/2022-08:31:00] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:00] [V] [TRT] Tactic: -3237051169894153788 time 3.18914 [03/13/2022-08:31:00] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:00] [V] [TRT] Tactic: -3136088851200285532 time 1.71464 [03/13/2022-08:31:00] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:00] [V] [TRT] Tactic: -2586046817576862066 time 1.71616 [03/13/2022-08:31:00] [V] [TRT] Conv_143 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:00] [V] [TRT] Tactic: -2422160065350346448 time 3.19471 [03/13/2022-08:31:00] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:00] [V] [TRT] Tactic: -1216445540764179377 time 1.71438 [03/13/2022-08:31:00] [V] [TRT] Conv_143 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:00] [V] [TRT] Tactic: -229563042944049199 time 1.71757 [03/13/2022-08:31:00] [V] [TRT] Fastest Tactic: 9576651994278528 Time: 0.858976 [03/13/2022-08:31:00] [V] [TRT] --------------- Timing Runner: Conv_143 (CudaConvolution) [03/13/2022-08:31:00] [V] [TRT] Tactic: 0 time 0.521424 [03/13/2022-08:31:00] [V] [TRT] Tactic: 1 time 0.329404 [03/13/2022-08:31:00] [V] [TRT] Tactic: 2 time 0.412136 [03/13/2022-08:31:00] [V] [TRT] Fastest Tactic: 1 Time: 0.329404 [03/13/2022-08:31:00] [V] [TRT] --------------- Timing Runner: Conv_143 (CudaDepthwiseConvolution) [03/13/2022-08:31:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:31:00] [V] [TRT] [03/13/2022-08:31:00] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,192000) -> Float(1,20,300,192000) *************** [03/13/2022-08:31:00] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_145, Mul_146) (PointWise) [03/13/2022-08:31:00] [V] [TRT] Tactic: 128 time 0.021436 [03/13/2022-08:31:00] [V] [TRT] Tactic: 256 time 0.021876 [03/13/2022-08:31:00] [V] [TRT] Tactic: 512 time 0.023876 [03/13/2022-08:31:00] [V] [TRT] Tactic: -32 time 0.03562 [03/13/2022-08:31:00] [V] [TRT] Tactic: -64 time 0.0256 [03/13/2022-08:31:00] [V] [TRT] Tactic: -128 time 0.023228 [03/13/2022-08:31:00] [V] [TRT] Fastest Tactic: 128 Time: 0.021436 [03/13/2022-08:31:00] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_145, Mul_146) (PointWiseV2) [03/13/2022-08:31:00] [V] [TRT] Tactic: 0 time 0.0161 [03/13/2022-08:31:00] [V] [TRT] Tactic: 1 time 0.014296 [03/13/2022-08:31:00] [V] [TRT] Tactic: 2 time 0.013652 [03/13/2022-08:31:00] [V] [TRT] Tactic: 3 time 0.0146 [03/13/2022-08:31:00] [V] [TRT] Tactic: 4 time 0.013652 [03/13/2022-08:31:00] [V] [TRT] Tactic: 5 time 0.013376 [03/13/2022-08:31:00] [V] [TRT] Tactic: 6 time 0.01464 [03/13/2022-08:31:00] [V] [TRT] Tactic: 7 time 0.01356 [03/13/2022-08:31:00] [V] [TRT] Tactic: 8 time 0.013476 [03/13/2022-08:31:00] [V] [TRT] Tactic: 9 time 0.01278 [03/13/2022-08:31:00] [V] [TRT] Tactic: 28 time 0.01606 [03/13/2022-08:31:00] [V] [TRT] Fastest Tactic: 9 Time: 0.01278 [03/13/2022-08:31:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:00] [V] [TRT] [03/13/2022-08:31:00] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,6000) -> Float(1,20,300:32,6000) *************** [03/13/2022-08:31:00] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_145, Mul_146) (PointWise) [03/13/2022-08:31:00] [V] [TRT] Tactic: 128 time 0.021156 [03/13/2022-08:31:00] [V] [TRT] Tactic: 256 time 0.021532 [03/13/2022-08:31:00] [V] [TRT] Tactic: 512 time 0.023912 [03/13/2022-08:31:00] [V] [TRT] Tactic: -32 time 0.035696 [03/13/2022-08:31:00] [V] [TRT] Tactic: -64 time 0.025276 [03/13/2022-08:31:00] [V] [TRT] Tactic: -128 time 0.023516 [03/13/2022-08:31:00] [V] [TRT] Fastest Tactic: 128 Time: 0.021156 [03/13/2022-08:31:00] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_145, Mul_146) (PointWiseV2) [03/13/2022-08:31:00] [V] [TRT] Tactic: 24 time 0.014712 [03/13/2022-08:31:00] [V] [TRT] Tactic: 25 time 0.014816 [03/13/2022-08:31:00] [V] [TRT] Tactic: 26 time 0.014588 [03/13/2022-08:31:00] [V] [TRT] Tactic: 27 time 0.014224 [03/13/2022-08:31:00] [V] [TRT] Tactic: 31 time 0.014388 [03/13/2022-08:31:00] [V] [TRT] Fastest Tactic: 27 Time: 0.014224 [03/13/2022-08:31:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [03/13/2022-08:31:00] [V] [TRT] [03/13/2022-08:31:00] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,192000) -> Half(1,20,300,192000) *************** [03/13/2022-08:31:00] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_145, Mul_146) (PointWise) [03/13/2022-08:31:00] [V] [TRT] Tactic: 128 time 0.020912 [03/13/2022-08:31:00] [V] [TRT] Tactic: 256 time 0.018688 [03/13/2022-08:31:00] [V] [TRT] Tactic: 512 time 0.018484 [03/13/2022-08:31:00] [V] [TRT] Tactic: -32 time 0.028564 [03/13/2022-08:31:00] [V] [TRT] Tactic: -64 time 0.023812 [03/13/2022-08:31:00] [V] [TRT] Tactic: -128 time 0.020908 [03/13/2022-08:31:00] [V] [TRT] Fastest Tactic: 512 Time: 0.018484 [03/13/2022-08:31:00] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_145, Mul_146) (PointWiseV2) [03/13/2022-08:31:00] [V] [TRT] Tactic: 0 time 0.011864 [03/13/2022-08:31:00] [V] [TRT] Tactic: 1 time 0.009884 [03/13/2022-08:31:00] [V] [TRT] Tactic: 2 time 0.008872 [03/13/2022-08:31:00] [V] [TRT] Tactic: 3 time 0.008948 [03/13/2022-08:31:00] [V] [TRT] Tactic: 4 time 0.008076 [03/13/2022-08:31:00] [V] [TRT] Tactic: 5 time 0.007988 [03/13/2022-08:31:00] [V] [TRT] Tactic: 6 time 0.008552 [03/13/2022-08:31:00] [V] [TRT] Tactic: 7 time 0.007776 [03/13/2022-08:31:00] [V] [TRT] Tactic: 8 time 0.007404 [03/13/2022-08:31:00] [V] [TRT] Tactic: 9 time 0.007256 [03/13/2022-08:31:00] [V] [TRT] Tactic: 28 time 0.011904 [03/13/2022-08:31:00] [V] [TRT] Fastest Tactic: 9 Time: 0.007256 [03/13/2022-08:31:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:00] [V] [TRT] [03/13/2022-08:31:00] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300:2,96000) *************** [03/13/2022-08:31:00] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_145, Mul_146) (PointWise) [03/13/2022-08:31:00] [V] [TRT] Tactic: 128 time 0.020672 [03/13/2022-08:31:00] [V] [TRT] Tactic: 256 time 0.019004 [03/13/2022-08:31:00] [V] [TRT] Tactic: 512 time 0.018436 [03/13/2022-08:31:00] [V] [TRT] Tactic: -32 time 0.028524 [03/13/2022-08:31:00] [V] [TRT] Tactic: -64 time 0.023736 [03/13/2022-08:31:01] [V] [TRT] Tactic: -128 time 0.021256 [03/13/2022-08:31:01] [V] [TRT] Fastest Tactic: 512 Time: 0.018436 [03/13/2022-08:31:01] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_145, Mul_146) (PointWiseV2) [03/13/2022-08:31:01] [V] [TRT] Tactic: 0 time 0.008964 [03/13/2022-08:31:01] [V] [TRT] Tactic: 1 time 0.008492 [03/13/2022-08:31:01] [V] [TRT] Tactic: 2 time 0.009264 [03/13/2022-08:31:01] [V] [TRT] Tactic: 3 time 0.008176 [03/13/2022-08:31:01] [V] [TRT] Tactic: 4 time 0.008728 [03/13/2022-08:31:01] [V] [TRT] Tactic: 5 time 0.010356 [03/13/2022-08:31:01] [V] [TRT] Tactic: 6 time 0.00792 [03/13/2022-08:31:01] [V] [TRT] Tactic: 7 time 0.00858 [03/13/2022-08:31:01] [V] [TRT] Tactic: 8 time 0.00988 [03/13/2022-08:31:01] [V] [TRT] Tactic: 9 time 0.012244 [03/13/2022-08:31:01] [V] [TRT] Tactic: 10 time 0.012348 [03/13/2022-08:31:01] [V] [TRT] Tactic: 11 time 0.010112 [03/13/2022-08:31:01] [V] [TRT] Tactic: 12 time 0.009724 [03/13/2022-08:31:01] [V] [TRT] Tactic: 13 time 0.008844 [03/13/2022-08:31:01] [V] [TRT] Tactic: 14 time 0.008748 [03/13/2022-08:31:01] [V] [TRT] Tactic: 15 time 0.00822 [03/13/2022-08:31:01] [V] [TRT] Tactic: 16 time 0.008432 [03/13/2022-08:31:01] [V] [TRT] Tactic: 17 time 0.008064 [03/13/2022-08:31:01] [V] [TRT] Tactic: 18 time 0.007828 [03/13/2022-08:31:01] [V] [TRT] Tactic: 19 time 0.00812 [03/13/2022-08:31:01] [V] [TRT] Tactic: 28 time 0.0092 [03/13/2022-08:31:01] [V] [TRT] Tactic: 29 time 0.01272 [03/13/2022-08:31:01] [V] [TRT] Fastest Tactic: 18 Time: 0.007828 [03/13/2022-08:31:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:31:01] [V] [TRT] [03/13/2022-08:31:01] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Half(80,1600,1:8,24000) *************** [03/13/2022-08:31:01] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_145, Mul_146) (PointWise) [03/13/2022-08:31:01] [V] [TRT] Tactic: 128 time 0.021104 [03/13/2022-08:31:01] [V] [TRT] Tactic: 256 time 0.018668 [03/13/2022-08:31:01] [V] [TRT] Tactic: 512 time 0.018532 [03/13/2022-08:31:01] [V] [TRT] Tactic: -32 time 0.028528 [03/13/2022-08:31:01] [V] [TRT] Tactic: -64 time 0.0238 [03/13/2022-08:31:01] [V] [TRT] Tactic: -128 time 0.021168 [03/13/2022-08:31:01] [V] [TRT] Fastest Tactic: 512 Time: 0.018532 [03/13/2022-08:31:01] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_145, Mul_146) (PointWiseV2) [03/13/2022-08:31:01] [V] [TRT] Tactic: 0 time 0.00884 [03/13/2022-08:31:01] [V] [TRT] Tactic: 1 time 0.008108 [03/13/2022-08:31:01] [V] [TRT] Tactic: 2 time 0.010792 [03/13/2022-08:31:01] [V] [TRT] Tactic: 3 time 0.008668 [03/13/2022-08:31:01] [V] [TRT] Tactic: 4 time 0.010328 [03/13/2022-08:31:01] [V] [TRT] Tactic: 5 time 0.013112 [03/13/2022-08:31:01] [V] [TRT] Tactic: 6 time 0.011296 [03/13/2022-08:31:01] [V] [TRT] Tactic: 7 time 0.012272 [03/13/2022-08:31:01] [V] [TRT] Tactic: 8 time 0.013056 [03/13/2022-08:31:01] [V] [TRT] Tactic: 9 time 0.018684 [03/13/2022-08:31:01] [V] [TRT] Tactic: 10 time 0.009084 [03/13/2022-08:31:01] [V] [TRT] Tactic: 11 time 0.008136 [03/13/2022-08:31:01] [V] [TRT] Tactic: 12 time 0.009164 [03/13/2022-08:31:01] [V] [TRT] Tactic: 13 time 0.007984 [03/13/2022-08:31:01] [V] [TRT] Tactic: 14 time 0.009016 [03/13/2022-08:31:01] [V] [TRT] Tactic: 15 time 0.011564 [03/13/2022-08:31:01] [V] [TRT] Tactic: 16 time 0.009064 [03/13/2022-08:31:01] [V] [TRT] Tactic: 17 time 0.008932 [03/13/2022-08:31:01] [V] [TRT] Tactic: 18 time 0.0113 [03/13/2022-08:31:01] [V] [TRT] Tactic: 19 time 0.014296 [03/13/2022-08:31:01] [V] [TRT] Tactic: 20 time 0.009852 [03/13/2022-08:31:01] [V] [TRT] Tactic: 21 time 0.008788 [03/13/2022-08:31:01] [V] [TRT] Tactic: 22 time 0.009268 [03/13/2022-08:31:01] [V] [TRT] Tactic: 23 time 0.00962 [03/13/2022-08:31:01] [V] [TRT] Tactic: 24 time 0.012344 [03/13/2022-08:31:01] [V] [TRT] Tactic: 25 time 0.010216 [03/13/2022-08:31:01] [V] [TRT] Tactic: 26 time 0.012224 [03/13/2022-08:31:01] [V] [TRT] Tactic: 27 time 0.008864 [03/13/2022-08:31:01] [V] [TRT] Tactic: 28 time 0.008488 [03/13/2022-08:31:01] [V] [TRT] Tactic: 29 time 0.008972 [03/13/2022-08:31:01] [V] [TRT] Tactic: 30 time 0.011256 [03/13/2022-08:31:01] [V] [TRT] Tactic: 31 time 0.015492 [03/13/2022-08:31:01] [V] [TRT] Fastest Tactic: 13 Time: 0.007984 [03/13/2022-08:31:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 13 [03/13/2022-08:31:01] [V] [TRT] [03/13/2022-08:31:01] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,192000) -> Float(1,20,300,192000) *************** [03/13/2022-08:31:01] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:31:01] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:01] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:01] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:01] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:01] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:01] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:01] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:01] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:01] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (FusedConvActConvolution) [03/13/2022-08:31:01] [V] [TRT] Tactic: 589823 time 0.50966 [03/13/2022-08:31:01] [V] [TRT] Tactic: 655359 time 0.25182 [03/13/2022-08:31:01] [V] [TRT] Tactic: 786431 time 0.261556 [03/13/2022-08:31:01] [V] [TRT] Tactic: 851967 time 0.178212 [03/13/2022-08:31:01] [V] [TRT] Tactic: 1179647 time 0.23224 [03/13/2022-08:31:01] [V] [TRT] Tactic: 1310719 time 0.29924 [03/13/2022-08:31:01] [V] [TRT] Tactic: 1376255 time 0.20668 [03/13/2022-08:31:01] [V] [TRT] Tactic: 1441791 time 0.242016 [03/13/2022-08:31:01] [V] [TRT] Tactic: 1507327 time 0.192056 [03/13/2022-08:31:01] [V] [TRT] Tactic: 1638399 time 0.238688 [03/13/2022-08:31:01] [V] [TRT] Tactic: 1835007 time 0.275976 [03/13/2022-08:31:01] [V] [TRT] Tactic: 1900543 time 0.223756 [03/13/2022-08:31:01] [V] [TRT] Tactic: 2097151 time 0.25732 [03/13/2022-08:31:01] [V] [TRT] Tactic: 2162687 time 0.214812 [03/13/2022-08:31:01] [V] [TRT] Tactic: 2293759 time 0.3221 [03/13/2022-08:31:01] [V] [TRT] Tactic: 2359295 time 0.16246 [03/13/2022-08:31:01] [V] [TRT] Tactic: 2686975 time 0.195564 [03/13/2022-08:31:01] [V] [TRT] Tactic: 3080191 time 0.182712 [03/13/2022-08:31:01] [V] [TRT] Tactic: 3342335 time 0.194744 [03/13/2022-08:31:01] [V] [TRT] Tactic: 3407871 time 0.216136 [03/13/2022-08:31:01] [V] [TRT] Tactic: 3538943 time 0.219696 [03/13/2022-08:31:01] [V] [TRT] Tactic: 3670015 time 0.324172 [03/13/2022-08:31:01] [V] [TRT] Tactic: 3932159 time 0.183696 [03/13/2022-08:31:01] [V] [TRT] Tactic: 3997695 time 0.245944 [03/13/2022-08:31:01] [V] [TRT] Tactic: 4063231 time 0.180832 [03/13/2022-08:31:01] [V] [TRT] Tactic: 4194303 time 0.247632 [03/13/2022-08:31:01] [V] [TRT] Tactic: 4259839 time 0.27434 [03/13/2022-08:31:01] [V] [TRT] Tactic: 4325375 time 0.223968 [03/13/2022-08:31:02] [V] [TRT] Tactic: 4521983 time 0.257692 [03/13/2022-08:31:02] [V] [TRT] Tactic: 4587519 time 0.289196 [03/13/2022-08:31:02] [V] [TRT] Tactic: 4653055 time 0.189988 [03/13/2022-08:31:02] [V] [TRT] Tactic: 4915199 time 0.243744 [03/13/2022-08:31:02] [V] [TRT] Tactic: 4980735 time 0.237808 [03/13/2022-08:31:02] [V] [TRT] Tactic: 5177343 time 0.21268 [03/13/2022-08:31:02] [V] [TRT] Tactic: 5242879 time 0.211456 [03/13/2022-08:31:02] [V] [TRT] Tactic: 5373951 time 0.274344 [03/13/2022-08:31:02] [V] [TRT] Tactic: 5439487 time 0.421016 [03/13/2022-08:31:02] [V] [TRT] Tactic: 5570559 time 0.189664 [03/13/2022-08:31:02] [V] [TRT] Tactic: 5636095 time 0.181528 [03/13/2022-08:31:02] [V] [TRT] Tactic: 5701631 time 0.204228 [03/13/2022-08:31:02] [V] [TRT] Tactic: 5767167 time 0.545108 [03/13/2022-08:31:02] [V] [TRT] Tactic: 5832703 time 0.204012 [03/13/2022-08:31:02] [V] [TRT] Tactic: 5898239 time 0.185288 [03/13/2022-08:31:02] [V] [TRT] Tactic: 6029311 time 0.305636 [03/13/2022-08:31:02] [V] [TRT] Tactic: 6225919 time 0.2056 [03/13/2022-08:31:02] [V] [TRT] Tactic: 6291455 time 0.233584 [03/13/2022-08:31:02] [V] [TRT] Tactic: 6422527 time 0.19956 [03/13/2022-08:31:02] [V] [TRT] Tactic: 6750207 time 0.312992 [03/13/2022-08:31:02] [V] [TRT] Tactic: 6815743 time 0.259836 [03/13/2022-08:31:02] [V] [TRT] Tactic: 6946815 time 0.323984 [03/13/2022-08:31:02] [V] [TRT] Tactic: 7012351 time 0.257292 [03/13/2022-08:31:02] [V] [TRT] Tactic: 7077887 time 0.199172 [03/13/2022-08:31:02] [V] [TRT] Tactic: 7143423 time 0.420784 [03/13/2022-08:31:02] [V] [TRT] Tactic: 7208959 time 0.208464 [03/13/2022-08:31:02] [V] [TRT] Tactic: 7340031 time 0.223584 [03/13/2022-08:31:02] [V] [TRT] Tactic: 7405567 time 0.174944 [03/13/2022-08:31:02] [V] [TRT] Tactic: 7536639 time 0.39102 [03/13/2022-08:31:02] [V] [TRT] Tactic: 7602175 time 0.3177 [03/13/2022-08:31:02] [V] [TRT] Tactic: 7733247 time 0.200564 [03/13/2022-08:31:02] [V] [TRT] Tactic: 7798783 time 0.262164 [03/13/2022-08:31:02] [V] [TRT] Tactic: 8191999 time 0.420748 [03/13/2022-08:31:02] [V] [TRT] Tactic: 8257535 time 0.299436 [03/13/2022-08:31:02] [V] [TRT] Tactic: 8323071 time 0.29964 [03/13/2022-08:31:02] [V] [TRT] Tactic: 8650751 time 0.279064 [03/13/2022-08:31:02] [V] [TRT] Tactic: 8716287 time 0.271776 [03/13/2022-08:31:02] [V] [TRT] Tactic: 9109503 time 0.312192 [03/13/2022-08:31:02] [V] [TRT] Tactic: 9568255 time 0.243632 [03/13/2022-08:31:02] [V] [TRT] Tactic: 9895935 time 0.248612 [03/13/2022-08:31:02] [V] [TRT] Tactic: 10223615 time 0.195564 [03/13/2022-08:31:02] [V] [TRT] Tactic: 10354687 time 0.274876 [03/13/2022-08:31:02] [V] [TRT] Tactic: 10551295 time 0.323788 [03/13/2022-08:31:02] [V] [TRT] Tactic: 10747903 time 0.175548 [03/13/2022-08:31:02] [V] [TRT] Tactic: 10944511 time 0.237628 [03/13/2022-08:31:02] [V] [TRT] Fastest Tactic: 2359295 Time: 0.16246 [03/13/2022-08:31:02] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (CaskConvolution) [03/13/2022-08:31:02] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:31:02] [V] [TRT] Tactic: 1754569683116234317 time 0.20156 [03/13/2022-08:31:02] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:02] [V] [TRT] Tactic: 1825138533642645384 time 0.203968 [03/13/2022-08:31:02] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:02] [V] [TRT] Tactic: 2733356012094739613 time 0.17884 [03/13/2022-08:31:02] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:02] [V] [TRT] Tactic: 3915320020053085238 time 0.202648 [03/13/2022-08:31:02] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:02] [V] [TRT] Tactic: 6808617066150061604 time 0.164408 [03/13/2022-08:31:02] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:02] [V] [TRT] Tactic: 9091006216302412844 time 0.155724 [03/13/2022-08:31:02] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:02] [V] [TRT] Tactic: -8060443123034038864 time 0.167392 [03/13/2022-08:31:02] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:02] [V] [TRT] Tactic: -4420849921117327522 time 0.20814 [03/13/2022-08:31:02] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Tactic: -3946921629105938337 time 0.190112 [03/13/2022-08:31:03] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.155724 [03/13/2022-08:31:03] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (CudaConvolution) [03/13/2022-08:31:03] [V] [TRT] Tactic: 0 time 0.191908 [03/13/2022-08:31:03] [V] [TRT] Tactic: 2 time 0.287152 [03/13/2022-08:31:03] [V] [TRT] Tactic: 5 skipped. Scratch requested: 58316800, available: 16777216 [03/13/2022-08:31:03] [V] [TRT] Tactic: 57 time 0.20366 [03/13/2022-08:31:03] [V] [TRT] Fastest Tactic: 0 Time: 0.191908 [03/13/2022-08:31:03] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (CudaDepthwiseConvolution) [03/13/2022-08:31:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:03] [V] [TRT] [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:03] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,192000) -> Half(1,20,300,192000) *************** [03/13/2022-08:31:03] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (FusedConvActConvolution) [03/13/2022-08:31:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:03] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (CaskConvolution) [03/13/2022-08:31:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:03] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (CudaConvolution) [03/13/2022-08:31:03] [V] [TRT] Tactic: 0 time 0.187052 [03/13/2022-08:31:03] [V] [TRT] Tactic: 1 time 0.172396 [03/13/2022-08:31:03] [V] [TRT] Tactic: 2 time 0.277432 [03/13/2022-08:31:03] [V] [TRT] Tactic: 4 skipped. Scratch requested: 3572367360, available: 16777216 [03/13/2022-08:31:03] [V] [TRT] Tactic: 5 skipped. Scratch requested: 58316800, available: 16777216 [03/13/2022-08:31:03] [V] [TRT] Fastest Tactic: 1 Time: 0.172396 [03/13/2022-08:31:03] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (CudaDepthwiseConvolution) [03/13/2022-08:31:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:31:03] [V] [TRT] [03/13/2022-08:31:03] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300,192000) *************** [03/13/2022-08:31:03] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (FusedConvActConvolution) [03/13/2022-08:31:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:03] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (CaskConvolution) [03/13/2022-08:31:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:03] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (CudaConvolution) [03/13/2022-08:31:03] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:03] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (CudaDepthwiseConvolution) [03/13/2022-08:31:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:03] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300:2,96000) *************** [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:03] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:03] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (FusedConvActConvolution) [03/13/2022-08:31:03] [V] [TRT] Tactic: 589823 time 0.260472 [03/13/2022-08:31:03] [V] [TRT] Tactic: 655359 time 0.118024 [03/13/2022-08:31:03] [V] [TRT] Tactic: 786431 time 0.138776 [03/13/2022-08:31:03] [V] [TRT] Tactic: 851967 time 0.0912 [03/13/2022-08:31:03] [V] [TRT] Tactic: 1179647 time 0.110268 [03/13/2022-08:31:03] [V] [TRT] Tactic: 1310719 time 0.151488 [03/13/2022-08:31:03] [V] [TRT] Tactic: 1376255 time 0.106144 [03/13/2022-08:31:03] [V] [TRT] Tactic: 1441791 time 0.116088 [03/13/2022-08:31:03] [V] [TRT] Tactic: 1507327 time 0.100076 [03/13/2022-08:31:03] [V] [TRT] Tactic: 1638399 time 0.1213 [03/13/2022-08:31:03] [V] [TRT] Tactic: 1835007 time 0.137976 [03/13/2022-08:31:03] [V] [TRT] Tactic: 1900543 time 0.107128 [03/13/2022-08:31:03] [V] [TRT] Tactic: 2097151 time 0.139116 [03/13/2022-08:31:03] [V] [TRT] Tactic: 2162687 time 0.10878 [03/13/2022-08:31:03] [V] [TRT] Tactic: 2293759 time 0.158852 [03/13/2022-08:31:03] [V] [TRT] Tactic: 2359295 time 0.077996 [03/13/2022-08:31:03] [V] [TRT] Tactic: 2686975 time 0.099372 [03/13/2022-08:31:03] [V] [TRT] Tactic: 3080191 time 0.093224 [03/13/2022-08:31:03] [V] [TRT] Tactic: 3342335 time 0.09964 [03/13/2022-08:31:03] [V] [TRT] Tactic: 3407871 time 0.103312 [03/13/2022-08:31:03] [V] [TRT] Tactic: 3538943 time 0.104916 [03/13/2022-08:31:03] [V] [TRT] Tactic: 3670015 time 0.166792 [03/13/2022-08:31:03] [V] [TRT] Tactic: 3932159 time 0.09178 [03/13/2022-08:31:03] [V] [TRT] Tactic: 3997695 time 0.129892 [03/13/2022-08:31:03] [V] [TRT] Tactic: 4063231 time 0.091024 [03/13/2022-08:31:03] [V] [TRT] Tactic: 4194303 time 0.139624 [03/13/2022-08:31:03] [V] [TRT] Tactic: 4259839 time 0.144812 [03/13/2022-08:31:03] [V] [TRT] Tactic: 4325375 time 0.115608 [03/13/2022-08:31:03] [V] [TRT] Tactic: 4521983 time 0.12594 [03/13/2022-08:31:03] [V] [TRT] Tactic: 4587519 time 0.153636 [03/13/2022-08:31:03] [V] [TRT] Tactic: 4653055 time 0.102832 [03/13/2022-08:31:03] [V] [TRT] Tactic: 4915199 time 0.129788 [03/13/2022-08:31:03] [V] [TRT] Tactic: 4980735 time 0.11944 [03/13/2022-08:31:03] [V] [TRT] Tactic: 5177343 time 0.1007 [03/13/2022-08:31:03] [V] [TRT] Tactic: 5242879 time 0.103252 [03/13/2022-08:31:03] [V] [TRT] Tactic: 5373951 time 0.118004 [03/13/2022-08:31:03] [V] [TRT] Tactic: 5439487 time 0.19586 [03/13/2022-08:31:03] [V] [TRT] Tactic: 5570559 time 0.098068 [03/13/2022-08:31:03] [V] [TRT] Tactic: 5636095 time 0.091304 [03/13/2022-08:31:03] [V] [TRT] Tactic: 5701631 time 0.098732 [03/13/2022-08:31:03] [V] [TRT] Tactic: 5767167 time 0.27 [03/13/2022-08:31:03] [V] [TRT] Tactic: 5832703 time 0.10018 [03/13/2022-08:31:03] [V] [TRT] Tactic: 5898239 time 0.089616 [03/13/2022-08:31:03] [V] [TRT] Tactic: 6029311 time 0.154036 [03/13/2022-08:31:03] [V] [TRT] Tactic: 6225919 time 0.099364 [03/13/2022-08:31:03] [V] [TRT] Tactic: 6291455 time 0.109652 [03/13/2022-08:31:03] [V] [TRT] Tactic: 6422527 time 0.100268 [03/13/2022-08:31:03] [V] [TRT] Tactic: 6750207 time 0.153552 [03/13/2022-08:31:03] [V] [TRT] Tactic: 6815743 time 0.127528 [03/13/2022-08:31:03] [V] [TRT] Tactic: 6946815 time 0.156968 [03/13/2022-08:31:03] [V] [TRT] Tactic: 7012351 time 0.139156 [03/13/2022-08:31:03] [V] [TRT] Tactic: 7077887 time 0.096252 [03/13/2022-08:31:03] [V] [TRT] Tactic: 7143423 time 0.204084 [03/13/2022-08:31:03] [V] [TRT] Tactic: 7208959 time 0.100144 [03/13/2022-08:31:03] [V] [TRT] Tactic: 7340031 time 0.108752 [03/13/2022-08:31:03] [V] [TRT] Tactic: 7405567 time 0.089404 [03/13/2022-08:31:03] [V] [TRT] Tactic: 7536639 time 0.18758 [03/13/2022-08:31:03] [V] [TRT] Tactic: 7602175 time 0.157284 [03/13/2022-08:31:03] [V] [TRT] Tactic: 7733247 time 0.097316 [03/13/2022-08:31:03] [V] [TRT] Tactic: 7798783 time 0.138784 [03/13/2022-08:31:03] [V] [TRT] Tactic: 8191999 time 0.19608 [03/13/2022-08:31:03] [V] [TRT] Tactic: 8257535 time 0.153548 [03/13/2022-08:31:03] [V] [TRT] Tactic: 8323071 time 0.148136 [03/13/2022-08:31:03] [V] [TRT] Tactic: 8650751 time 0.141344 [03/13/2022-08:31:03] [V] [TRT] Tactic: 8716287 time 0.127728 [03/13/2022-08:31:03] [V] [TRT] Tactic: 9109503 time 0.168424 [03/13/2022-08:31:03] [V] [TRT] Tactic: 9568255 time 0.129864 [03/13/2022-08:31:04] [V] [TRT] Tactic: 9895935 time 0.138416 [03/13/2022-08:31:04] [V] [TRT] Tactic: 10223615 time 0.099152 [03/13/2022-08:31:04] [V] [TRT] Tactic: 10354687 time 0.14352 [03/13/2022-08:31:04] [V] [TRT] Tactic: 10551295 time 0.155588 [03/13/2022-08:31:04] [V] [TRT] Tactic: 10747903 time 0.08526 [03/13/2022-08:31:04] [V] [TRT] Tactic: 10944511 time 0.120528 [03/13/2022-08:31:04] [V] [TRT] Fastest Tactic: 2359295 Time: 0.077996 [03/13/2022-08:31:04] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (CaskConvolution) [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: 1651411198763708804 time 0.084872 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: 2418518597804310654 time 0.084872 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: 4318470497547290900 time 0.083836 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: 4930470141256631146 time 0.090296 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: 8292881859266835088 time 0.08806 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: 8401509141903434922 time 0.083604 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -8654297089785671176 time 0.106788 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -7516584506774355935 time 0.0847 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -7140760933967189247 time 0.082764 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -6004726995029373073 time 0.086716 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -5719726816705110014 time 0.106944 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -4097850214384059472 time 0.084816 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -3717489476759089008 time 0.082764 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -3689982367035295496 time 0.107144 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -2640575123064142123 time 0.104888 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -2534402059426524406 time 0.104792 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -2027588946874785071 time 0.087012 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -1968398013367819764 time 0.107192 [03/13/2022-08:31:04] [V] [TRT] Fastest Tactic: -7140760933967189247 Time: 0.082764 [03/13/2022-08:31:04] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (CudaConvolution) [03/13/2022-08:31:04] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:04] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (CudaDepthwiseConvolution) [03/13/2022-08:31:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2359295 [03/13/2022-08:31:04] [V] [TRT] [03/13/2022-08:31:04] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Float(1,20,300,192000) *************** [03/13/2022-08:31:04] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (FusedConvActConvolution) [03/13/2022-08:31:04] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:04] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (CaskConvolution) [03/13/2022-08:31:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:04] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (CudaConvolution) [03/13/2022-08:31:04] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:04] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (CudaDepthwiseConvolution) [03/13/2022-08:31:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:04] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Half(80,1600,1:8,24000) *************** [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (FusedConvActConvolution) [03/13/2022-08:31:04] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:04] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (CaskConvolution) [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:04] [V] [TRT] Tactic: 9576651994278528 time 0.43456 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: 1179757074518529353 time 0.864164 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: 2105695814191699972 time 1.59876 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: 2148106709480872763 time 0.8594 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: 2410442691266548717 time 0.860784 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: 3041642431972138763 time 0.859316 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: 3754069740140581927 time 1.5976 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: 4555462412611657028 time 0.858728 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: 5666160310350604399 time 1.59728 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:04] [V] [TRT] Tactic: 5876997871499382316 time 0.801848 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: 5925270497649423688 time 1.59548 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: 6680916730816870145 time 1.59948 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: 7158029511300006471 time 1.59871 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: 7859952145590271433 time 1.59927 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: 8283847742354150423 time 1.59779 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -8992262742606384444 time 0.85918 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -8391760416076885205 time 1.59576 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -6273232454637933930 time 0.863988 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:04] [V] [TRT] Tactic: -5925110308892264213 time 0.801416 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -5818527483287834165 time 0.86422 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:04] [V] [TRT] Tactic: -4908848143422991657 time 0.434956 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -4534876761957424274 time 1.59576 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -3237051169894153788 time 1.59892 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -3136088851200285532 time 0.859516 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -2586046817576862066 time 0.861084 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -2422160065350346448 time 1.59942 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -1216445540764179377 time 0.860988 [03/13/2022-08:31:04] [V] [TRT] Conv_159 || Conv_147 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:04] [V] [TRT] Tactic: -229563042944049199 time 0.85978 [03/13/2022-08:31:04] [V] [TRT] Fastest Tactic: 9576651994278528 Time: 0.43456 [03/13/2022-08:31:04] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (CudaConvolution) [03/13/2022-08:31:04] [V] [TRT] Tactic: 0 time 0.264776 [03/13/2022-08:31:04] [V] [TRT] Tactic: 1 time 0.184932 [03/13/2022-08:31:04] [V] [TRT] Tactic: 2 time 0.256176 [03/13/2022-08:31:04] [V] [TRT] Fastest Tactic: 1 Time: 0.184932 [03/13/2022-08:31:04] [V] [TRT] --------------- Timing Runner: Conv_159 || Conv_147 (CudaDepthwiseConvolution) [03/13/2022-08:31:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:31:04] [V] [TRT] [03/13/2022-08:31:04] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:04] [V] [TRT] Tactic: 1002 time 0.022516 [03/13/2022-08:31:04] [V] [TRT] Tactic: 0 time 0.039952 [03/13/2022-08:31:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.022516 [03/13/2022-08:31:04] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:04] [V] [TRT] Tactic: 1002 time 0.01594 [03/13/2022-08:31:04] [V] [TRT] Tactic: 0 time 0.017188 [03/13/2022-08:31:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.01594 [03/13/2022-08:31:04] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:04] [V] [TRT] Tactic: 1002 time 0.028332 [03/13/2022-08:31:04] [V] [TRT] Tactic: 0 time 0.013816 [03/13/2022-08:31:04] [V] [TRT] Fastest Tactic: 0 Time: 0.013816 [03/13/2022-08:31:04] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:04] [V] [TRT] Tactic: 1002 time 0.02162 [03/13/2022-08:31:04] [V] [TRT] Tactic: 0 time 0.013816 [03/13/2022-08:31:04] [V] [TRT] Fastest Tactic: 0 Time: 0.013816 [03/13/2022-08:31:04] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:04] [V] [TRT] Tactic: 1002 time 0.016208 [03/13/2022-08:31:04] [V] [TRT] Tactic: 0 time 0.015636 [03/13/2022-08:31:04] [V] [TRT] Fastest Tactic: 0 Time: 0.015636 [03/13/2022-08:31:04] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:04] [V] [TRT] Tactic: 1002 time 0.021144 [03/13/2022-08:31:04] [V] [TRT] Tactic: 0 time 0.040324 [03/13/2022-08:31:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.021144 [03/13/2022-08:31:04] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:04] [V] [TRT] Tactic: 1002 time 0.0268 [03/13/2022-08:31:04] [V] [TRT] Tactic: 0 time 0.00972 [03/13/2022-08:31:04] [V] [TRT] Fastest Tactic: 0 Time: 0.00972 [03/13/2022-08:31:04] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:04] [V] [TRT] Tactic: 1002 time 0.019644 [03/13/2022-08:31:04] [V] [TRT] Tactic: 0 time 0.010144 [03/13/2022-08:31:04] [V] [TRT] Fastest Tactic: 0 Time: 0.010144 [03/13/2022-08:31:04] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:04] [V] [TRT] Tactic: 1002 time 0.04304 [03/13/2022-08:31:04] [V] [TRT] Tactic: 0 time 0.01358 [03/13/2022-08:31:04] [V] [TRT] Fastest Tactic: 0 Time: 0.01358 [03/13/2022-08:31:04] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.021508 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.03924 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.021508 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.042096 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.00936 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 0 Time: 0.00936 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.019488 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.007944 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 0 Time: 0.007944 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.02116 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.01156 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 0 Time: 0.01156 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.029236 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.049668 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.029236 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.01942 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.008904 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 0 Time: 0.008904 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.03368 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.00808 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 0 Time: 0.00808 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.013044 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.021612 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.013044 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.008028 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.008668 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.008028 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.016892 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.008896 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 0 Time: 0.008896 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.012864 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.012528 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 0 Time: 0.012528 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.022944 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.013956 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 0 Time: 0.013956 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.022788 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.013648 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 0 Time: 0.013648 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.021128 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.014152 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 0 Time: 0.014152 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.017 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.010248 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 0 Time: 0.010248 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.008076 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.01014 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.008076 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.01312 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.021288 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.01312 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.017332 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.007084 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 0 Time: 0.007084 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.012876 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.006848 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 0 Time: 0.006848 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.023216 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.00688 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 0 Time: 0.00688 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.012804 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.0218 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.012804 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.023212 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.00868 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 0 Time: 0.00868 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.012992 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.006056 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 0 Time: 0.006056 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.012676 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.007152 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 0 Time: 0.007152 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.01664 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.027252 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.01664 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.012644 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.006812 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 0 Time: 0.006812 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:05] [V] [TRT] Tactic: 1002 time 0.02148 [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.006592 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 0 Time: 0.006592 [03/13/2022-08:31:05] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,192000) -> Float(1,20,300,96000) *************** [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_149, Mul_150) (PointWise) [03/13/2022-08:31:05] [V] [TRT] Tactic: 128 time 0.01316 [03/13/2022-08:31:05] [V] [TRT] Tactic: 256 time 0.013036 [03/13/2022-08:31:05] [V] [TRT] Tactic: 512 time 0.014308 [03/13/2022-08:31:05] [V] [TRT] Tactic: -32 time 0.025412 [03/13/2022-08:31:05] [V] [TRT] Tactic: -64 time 0.016548 [03/13/2022-08:31:05] [V] [TRT] Tactic: -128 time 0.01392 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 256 Time: 0.013036 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_149, Mul_150) (PointWiseV2) [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.00886 [03/13/2022-08:31:05] [V] [TRT] Tactic: 1 time 0.00772 [03/13/2022-08:31:05] [V] [TRT] Tactic: 2 time 0.007212 [03/13/2022-08:31:05] [V] [TRT] Tactic: 3 time 0.006772 [03/13/2022-08:31:05] [V] [TRT] Tactic: 4 time 0.006808 [03/13/2022-08:31:05] [V] [TRT] Tactic: 5 time 0.006624 [03/13/2022-08:31:05] [V] [TRT] Tactic: 6 time 0.00674 [03/13/2022-08:31:05] [V] [TRT] Tactic: 7 time 0.006636 [03/13/2022-08:31:05] [V] [TRT] Tactic: 8 time 0.006552 [03/13/2022-08:31:05] [V] [TRT] Tactic: 9 time 0.006528 [03/13/2022-08:31:05] [V] [TRT] Tactic: 28 time 0.008804 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 9 Time: 0.006528 [03/13/2022-08:31:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:05] [V] [TRT] [03/13/2022-08:31:05] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,6000) -> Float(1,20,300:32,3000) *************** [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_149, Mul_150) (PointWise) [03/13/2022-08:31:05] [V] [TRT] Tactic: 128 time 0.013076 [03/13/2022-08:31:05] [V] [TRT] Tactic: 256 time 0.01332 [03/13/2022-08:31:05] [V] [TRT] Tactic: 512 time 0.014356 [03/13/2022-08:31:05] [V] [TRT] Tactic: -32 time 0.025536 [03/13/2022-08:31:05] [V] [TRT] Tactic: -64 time 0.016712 [03/13/2022-08:31:05] [V] [TRT] Tactic: -128 time 0.01386 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 128 Time: 0.013076 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_149, Mul_150) (PointWiseV2) [03/13/2022-08:31:05] [V] [TRT] Tactic: 24 time 0.008012 [03/13/2022-08:31:05] [V] [TRT] Tactic: 25 time 0.007684 [03/13/2022-08:31:05] [V] [TRT] Tactic: 26 time 0.007292 [03/13/2022-08:31:05] [V] [TRT] Tactic: 27 time 0.008784 [03/13/2022-08:31:05] [V] [TRT] Tactic: 31 time 0.007544 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 26 Time: 0.007292 [03/13/2022-08:31:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [03/13/2022-08:31:05] [V] [TRT] [03/13/2022-08:31:05] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,192000) -> Half(1,20,300,96000) *************** [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_149, Mul_150) (PointWise) [03/13/2022-08:31:05] [V] [TRT] Tactic: 128 time 0.013052 [03/13/2022-08:31:05] [V] [TRT] Tactic: 256 time 0.012168 [03/13/2022-08:31:05] [V] [TRT] Tactic: 512 time 0.013328 [03/13/2022-08:31:05] [V] [TRT] Tactic: -32 time 0.025256 [03/13/2022-08:31:05] [V] [TRT] Tactic: -64 time 0.016696 [03/13/2022-08:31:05] [V] [TRT] Tactic: -128 time 0.013668 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 256 Time: 0.012168 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_149, Mul_150) (PointWiseV2) [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.008696 [03/13/2022-08:31:05] [V] [TRT] Tactic: 1 time 0.007752 [03/13/2022-08:31:05] [V] [TRT] Tactic: 2 time 0.006976 [03/13/2022-08:31:05] [V] [TRT] Tactic: 3 time 0.006768 [03/13/2022-08:31:05] [V] [TRT] Tactic: 4 time 0.006728 [03/13/2022-08:31:05] [V] [TRT] Tactic: 5 time 0.006424 [03/13/2022-08:31:05] [V] [TRT] Tactic: 6 time 0.006704 [03/13/2022-08:31:05] [V] [TRT] Tactic: 7 time 0.006572 [03/13/2022-08:31:05] [V] [TRT] Tactic: 8 time 0.006324 [03/13/2022-08:31:05] [V] [TRT] Tactic: 9 time 0.006336 [03/13/2022-08:31:05] [V] [TRT] Tactic: 28 time 0.008856 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 8 Time: 0.006324 [03/13/2022-08:31:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:31:05] [V] [TRT] [03/13/2022-08:31:05] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300:2,48000) *************** [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_149, Mul_150) (PointWise) [03/13/2022-08:31:05] [V] [TRT] Tactic: 128 time 0.01292 [03/13/2022-08:31:05] [V] [TRT] Tactic: 256 time 0.012232 [03/13/2022-08:31:05] [V] [TRT] Tactic: 512 time 0.013204 [03/13/2022-08:31:05] [V] [TRT] Tactic: -32 time 0.025596 [03/13/2022-08:31:05] [V] [TRT] Tactic: -64 time 0.0165 [03/13/2022-08:31:05] [V] [TRT] Tactic: -128 time 0.013532 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 256 Time: 0.012232 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_149, Mul_150) (PointWiseV2) [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.007392 [03/13/2022-08:31:05] [V] [TRT] Tactic: 1 time 0.006784 [03/13/2022-08:31:05] [V] [TRT] Tactic: 2 time 0.00678 [03/13/2022-08:31:05] [V] [TRT] Tactic: 3 time 0.006736 [03/13/2022-08:31:05] [V] [TRT] Tactic: 4 time 0.006664 [03/13/2022-08:31:05] [V] [TRT] Tactic: 5 time 0.00676 [03/13/2022-08:31:05] [V] [TRT] Tactic: 6 time 0.007268 [03/13/2022-08:31:05] [V] [TRT] Tactic: 7 time 0.007668 [03/13/2022-08:31:05] [V] [TRT] Tactic: 8 time 0.00762 [03/13/2022-08:31:05] [V] [TRT] Tactic: 9 time 0.007628 [03/13/2022-08:31:05] [V] [TRT] Tactic: 10 time 0.009204 [03/13/2022-08:31:05] [V] [TRT] Tactic: 11 time 0.007872 [03/13/2022-08:31:05] [V] [TRT] Tactic: 12 time 0.007532 [03/13/2022-08:31:05] [V] [TRT] Tactic: 13 time 0.00678 [03/13/2022-08:31:05] [V] [TRT] Tactic: 14 time 0.00672 [03/13/2022-08:31:05] [V] [TRT] Tactic: 15 time 0.006736 [03/13/2022-08:31:05] [V] [TRT] Tactic: 16 time 0.00668 [03/13/2022-08:31:05] [V] [TRT] Tactic: 17 time 0.006632 [03/13/2022-08:31:05] [V] [TRT] Tactic: 18 time 0.006812 [03/13/2022-08:31:05] [V] [TRT] Tactic: 19 time 0.006624 [03/13/2022-08:31:05] [V] [TRT] Tactic: 28 time 0.007268 [03/13/2022-08:31:05] [V] [TRT] Tactic: 29 time 0.009004 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 19 Time: 0.006624 [03/13/2022-08:31:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 19 [03/13/2022-08:31:05] [V] [TRT] [03/13/2022-08:31:05] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Half(40,800,1:8,12000) *************** [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_149, Mul_150) (PointWise) [03/13/2022-08:31:05] [V] [TRT] Tactic: 128 time 0.012932 [03/13/2022-08:31:05] [V] [TRT] Tactic: 256 time 0.01256 [03/13/2022-08:31:05] [V] [TRT] Tactic: 512 time 0.013024 [03/13/2022-08:31:05] [V] [TRT] Tactic: -32 time 0.019216 [03/13/2022-08:31:05] [V] [TRT] Tactic: -64 time 0.0147 [03/13/2022-08:31:05] [V] [TRT] Tactic: -128 time 0.014956 [03/13/2022-08:31:05] [V] [TRT] Fastest Tactic: 256 Time: 0.01256 [03/13/2022-08:31:05] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_149, Mul_150) (PointWiseV2) [03/13/2022-08:31:05] [V] [TRT] Tactic: 0 time 0.008108 [03/13/2022-08:31:05] [V] [TRT] Tactic: 1 time 0.007012 [03/13/2022-08:31:05] [V] [TRT] Tactic: 2 time 0.007676 [03/13/2022-08:31:05] [V] [TRT] Tactic: 3 time 0.007968 [03/13/2022-08:31:05] [V] [TRT] Tactic: 4 time 0.008008 [03/13/2022-08:31:05] [V] [TRT] Tactic: 5 time 0.007824 [03/13/2022-08:31:05] [V] [TRT] Tactic: 6 time 0.009268 [03/13/2022-08:31:05] [V] [TRT] Tactic: 7 time 0.008716 [03/13/2022-08:31:05] [V] [TRT] Tactic: 8 time 0.008164 [03/13/2022-08:31:05] [V] [TRT] Tactic: 9 time 0.008524 [03/13/2022-08:31:05] [V] [TRT] Tactic: 10 time 0.006712 [03/13/2022-08:31:05] [V] [TRT] Tactic: 11 time 0.007036 [03/13/2022-08:31:05] [V] [TRT] Tactic: 12 time 0.00754 [03/13/2022-08:31:05] [V] [TRT] Tactic: 13 time 0.006728 [03/13/2022-08:31:05] [V] [TRT] Tactic: 14 time 0.006748 [03/13/2022-08:31:05] [V] [TRT] Tactic: 15 time 0.006568 [03/13/2022-08:31:05] [V] [TRT] Tactic: 16 time 0.007784 [03/13/2022-08:31:05] [V] [TRT] Tactic: 17 time 0.007308 [03/13/2022-08:31:05] [V] [TRT] Tactic: 18 time 0.007164 [03/13/2022-08:31:05] [V] [TRT] Tactic: 19 time 0.007032 [03/13/2022-08:31:05] [V] [TRT] Tactic: 20 time 0.007256 [03/13/2022-08:31:06] [V] [TRT] Tactic: 21 time 0.007448 [03/13/2022-08:31:06] [V] [TRT] Tactic: 22 time 0.007896 [03/13/2022-08:31:06] [V] [TRT] Tactic: 23 time 0.006752 [03/13/2022-08:31:06] [V] [TRT] Tactic: 24 time 0.00934 [03/13/2022-08:31:06] [V] [TRT] Tactic: 25 time 0.007952 [03/13/2022-08:31:06] [V] [TRT] Tactic: 26 time 0.007824 [03/13/2022-08:31:06] [V] [TRT] Tactic: 27 time 0.008284 [03/13/2022-08:31:06] [V] [TRT] Tactic: 28 time 0.0066 [03/13/2022-08:31:06] [V] [TRT] Tactic: 29 time 0.00664 [03/13/2022-08:31:06] [V] [TRT] Tactic: 30 time 0.00744 [03/13/2022-08:31:06] [V] [TRT] Tactic: 31 time 0.00872 [03/13/2022-08:31:06] [V] [TRT] Fastest Tactic: 15 Time: 0.006568 [03/13/2022-08:31:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 15 [03/13/2022-08:31:06] [V] [TRT] [03/13/2022-08:31:06] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,96000) -> Float(1,20,300,96000) *************** [03/13/2022-08:31:06] [V] [TRT] Conv_151 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:31:06] [V] [TRT] Conv_151 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:06] [V] [TRT] Conv_151 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:06] [V] [TRT] Conv_151 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:06] [V] [TRT] Conv_151 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:06] [V] [TRT] Conv_151 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:06] [V] [TRT] Conv_151 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:06] [V] [TRT] Conv_151 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:06] [V] [TRT] Conv_151 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:06] [V] [TRT] --------------- Timing Runner: Conv_151 (FusedConvActConvolution) [03/13/2022-08:31:06] [V] [TRT] Tactic: 589823 time 0.142368 [03/13/2022-08:31:06] [V] [TRT] Tactic: 655359 time 0.09566 [03/13/2022-08:31:06] [V] [TRT] Tactic: 786431 time 0.0865 [03/13/2022-08:31:06] [V] [TRT] Tactic: 851967 time 0.0646 [03/13/2022-08:31:06] [V] [TRT] Tactic: 1179647 time 0.065984 [03/13/2022-08:31:06] [V] [TRT] Tactic: 1310719 time 0.09152 [03/13/2022-08:31:06] [V] [TRT] Tactic: 1376255 time 0.102268 [03/13/2022-08:31:06] [V] [TRT] Tactic: 1441791 time 0.07014 [03/13/2022-08:31:06] [V] [TRT] Tactic: 1507327 time 0.0676 [03/13/2022-08:31:06] [V] [TRT] Tactic: 1638399 time 0.071344 [03/13/2022-08:31:06] [V] [TRT] Tactic: 1835007 time 0.084312 [03/13/2022-08:31:06] [V] [TRT] Tactic: 1900543 time 0.103644 [03/13/2022-08:31:06] [V] [TRT] Tactic: 2097151 time 0.074736 [03/13/2022-08:31:06] [V] [TRT] Tactic: 2162687 time 0.102788 [03/13/2022-08:31:06] [V] [TRT] Tactic: 2293759 time 0.099328 [03/13/2022-08:31:06] [V] [TRT] Tactic: 2359295 time 0.066124 [03/13/2022-08:31:06] [V] [TRT] Tactic: 2686975 time 0.096564 [03/13/2022-08:31:06] [V] [TRT] Tactic: 3080191 time 0.064676 [03/13/2022-08:31:06] [V] [TRT] Tactic: 3342335 time 0.071128 [03/13/2022-08:31:06] [V] [TRT] Tactic: 3407871 time 0.070932 [03/13/2022-08:31:06] [V] [TRT] Tactic: 3538943 time 0.064364 [03/13/2022-08:31:06] [V] [TRT] Tactic: 3670015 time 0.168216 [03/13/2022-08:31:06] [V] [TRT] Tactic: 3932159 time 0.08556 [03/13/2022-08:31:06] [V] [TRT] Tactic: 3997695 time 0.07396 [03/13/2022-08:31:06] [V] [TRT] Tactic: 4063231 time 0.062688 [03/13/2022-08:31:06] [V] [TRT] Tactic: 4194303 time 0.073948 [03/13/2022-08:31:06] [V] [TRT] Tactic: 4259839 time 0.078768 [03/13/2022-08:31:06] [V] [TRT] Tactic: 4325375 time 0.068272 [03/13/2022-08:31:06] [V] [TRT] Tactic: 4521983 time 0.097032 [03/13/2022-08:31:06] [V] [TRT] Tactic: 4587519 time 0.081556 [03/13/2022-08:31:06] [V] [TRT] Tactic: 4653055 time 0.059052 [03/13/2022-08:31:06] [V] [TRT] Tactic: 4915199 time 0.071016 [03/13/2022-08:31:06] [V] [TRT] Tactic: 4980735 time 0.071868 [03/13/2022-08:31:06] [V] [TRT] Tactic: 5177343 time 0.063056 [03/13/2022-08:31:06] [V] [TRT] Tactic: 5242879 time 0.063532 [03/13/2022-08:31:06] [V] [TRT] Tactic: 5373951 time 0.071408 [03/13/2022-08:31:06] [V] [TRT] Tactic: 5439487 time 0.109908 [03/13/2022-08:31:06] [V] [TRT] Tactic: 5570559 time 0.068128 [03/13/2022-08:31:06] [V] [TRT] Tactic: 5636095 time 0.063196 [03/13/2022-08:31:06] [V] [TRT] Tactic: 5701631 time 0.094804 [03/13/2022-08:31:06] [V] [TRT] Tactic: 5767167 time 0.146032 [03/13/2022-08:31:06] [V] [TRT] Tactic: 5832703 time 0.068744 [03/13/2022-08:31:06] [V] [TRT] Tactic: 5898239 time 0.059236 [03/13/2022-08:31:06] [V] [TRT] Tactic: 6029311 time 0.092 [03/13/2022-08:31:06] [V] [TRT] Tactic: 6225919 time 0.064544 [03/13/2022-08:31:06] [V] [TRT] Tactic: 6291455 time 0.06604 [03/13/2022-08:31:06] [V] [TRT] Tactic: 6422527 time 0.064948 [03/13/2022-08:31:06] [V] [TRT] Tactic: 6750207 time 0.084056 [03/13/2022-08:31:06] [V] [TRT] Tactic: 6815743 time 0.070968 [03/13/2022-08:31:06] [V] [TRT] Tactic: 6946815 time 0.09096 [03/13/2022-08:31:06] [V] [TRT] Tactic: 7012351 time 0.0746 [03/13/2022-08:31:06] [V] [TRT] Tactic: 7077887 time 0.062228 [03/13/2022-08:31:06] [V] [TRT] Tactic: 7143423 time 0.118748 [03/13/2022-08:31:06] [V] [TRT] Tactic: 7208959 time 0.063164 [03/13/2022-08:31:06] [V] [TRT] Tactic: 7340031 time 0.066496 [03/13/2022-08:31:06] [V] [TRT] Tactic: 7405567 time 0.05896 [03/13/2022-08:31:06] [V] [TRT] Tactic: 7536639 time 0.122524 [03/13/2022-08:31:06] [V] [TRT] Tactic: 7602175 time 0.088132 [03/13/2022-08:31:06] [V] [TRT] Tactic: 7733247 time 0.062772 [03/13/2022-08:31:06] [V] [TRT] Tactic: 7798783 time 0.086564 [03/13/2022-08:31:06] [V] [TRT] Tactic: 8191999 time 0.101176 [03/13/2022-08:31:06] [V] [TRT] Tactic: 8257535 time 0.098536 [03/13/2022-08:31:06] [V] [TRT] Tactic: 8323071 time 0.097632 [03/13/2022-08:31:06] [V] [TRT] Tactic: 8650751 time 0.095644 [03/13/2022-08:31:06] [V] [TRT] Tactic: 8716287 time 0.090416 [03/13/2022-08:31:06] [V] [TRT] Tactic: 9109503 time 0.10306 [03/13/2022-08:31:06] [V] [TRT] Tactic: 9568255 time 0.0836 [03/13/2022-08:31:06] [V] [TRT] Tactic: 9895935 time 0.087388 [03/13/2022-08:31:06] [V] [TRT] Tactic: 10223615 time 0.109656 [03/13/2022-08:31:06] [V] [TRT] Tactic: 10354687 time 0.092768 [03/13/2022-08:31:06] [V] [TRT] Tactic: 10551295 time 0.116296 [03/13/2022-08:31:06] [V] [TRT] Tactic: 10747903 time 0.069132 [03/13/2022-08:31:06] [V] [TRT] Tactic: 10944511 time 0.08406 [03/13/2022-08:31:06] [V] [TRT] Fastest Tactic: 7405567 Time: 0.05896 [03/13/2022-08:31:06] [V] [TRT] --------------- Timing Runner: Conv_151 (CaskConvolution) [03/13/2022-08:31:06] [V] [TRT] Conv_151 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:31:06] [V] [TRT] Tactic: 1754569683116234317 time 0.068 [03/13/2022-08:31:06] [V] [TRT] Conv_151 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:06] [V] [TRT] Tactic: 1825138533642645384 time 0.068812 [03/13/2022-08:31:06] [V] [TRT] Conv_151 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:06] [V] [TRT] Tactic: 2733356012094739613 time 0.071904 [03/13/2022-08:31:06] [V] [TRT] Conv_151 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:06] [V] [TRT] Tactic: 3915320020053085238 time 0.068536 [03/13/2022-08:31:06] [V] [TRT] Conv_151 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:06] [V] [TRT] Tactic: 6808617066150061604 time 0.07222 [03/13/2022-08:31:06] [V] [TRT] Conv_151 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:06] [V] [TRT] Tactic: 9091006216302412844 time 0.0682 [03/13/2022-08:31:06] [V] [TRT] Conv_151 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:06] [V] [TRT] Tactic: -8060443123034038864 time 0.073992 [03/13/2022-08:31:06] [V] [TRT] Conv_151 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:06] [V] [TRT] Tactic: -4420849921117327522 time 0.064664 [03/13/2022-08:31:06] [V] [TRT] Conv_151 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:06] [V] [TRT] Tactic: -3946921629105938337 time 0.079288 [03/13/2022-08:31:06] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.064664 [03/13/2022-08:31:06] [V] [TRT] --------------- Timing Runner: Conv_151 (CudaConvolution) [03/13/2022-08:31:06] [V] [TRT] Tactic: 0 time 0.082076 [03/13/2022-08:31:06] [V] [TRT] Tactic: 2 time 0.195604 [03/13/2022-08:31:06] [V] [TRT] Tactic: 5 time 0.448908 [03/13/2022-08:31:06] [V] [TRT] Tactic: 57 time 0.08664 [03/13/2022-08:31:06] [V] [TRT] Fastest Tactic: 0 Time: 0.082076 [03/13/2022-08:31:06] [V] [TRT] --------------- Timing Runner: Conv_151 (CudaDepthwiseConvolution) [03/13/2022-08:31:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7405567 [03/13/2022-08:31:06] [V] [TRT] [03/13/2022-08:31:06] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,96000) -> Half(1,20,300,96000) *************** [03/13/2022-08:31:06] [V] [TRT] --------------- Timing Runner: Conv_151 (FusedConvActConvolution) [03/13/2022-08:31:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:06] [V] [TRT] --------------- Timing Runner: Conv_151 (CaskConvolution) [03/13/2022-08:31:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:06] [V] [TRT] --------------- Timing Runner: Conv_151 (CudaConvolution) [03/13/2022-08:31:06] [V] [TRT] Tactic: 0 time 0.884424 [03/13/2022-08:31:06] [V] [TRT] Tactic: 1 time 0.08048 [03/13/2022-08:31:06] [V] [TRT] Tactic: 2 time 0.158356 [03/13/2022-08:31:06] [V] [TRT] Tactic: 4 skipped. Scratch requested: 894484480, available: 16777216 [03/13/2022-08:31:07] [V] [TRT] Tactic: 5 time 0.430056 [03/13/2022-08:31:07] [V] [TRT] Fastest Tactic: 1 Time: 0.08048 [03/13/2022-08:31:07] [V] [TRT] --------------- Timing Runner: Conv_151 (CudaDepthwiseConvolution) [03/13/2022-08:31:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:31:07] [V] [TRT] [03/13/2022-08:31:07] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,48000) -> Half(1,20,300,96000) *************** [03/13/2022-08:31:07] [V] [TRT] --------------- Timing Runner: Conv_151 (FusedConvActConvolution) [03/13/2022-08:31:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:07] [V] [TRT] --------------- Timing Runner: Conv_151 (CaskConvolution) [03/13/2022-08:31:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:07] [V] [TRT] --------------- Timing Runner: Conv_151 (CudaConvolution) [03/13/2022-08:31:07] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:07] [V] [TRT] --------------- Timing Runner: Conv_151 (CudaDepthwiseConvolution) [03/13/2022-08:31:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:07] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,48000) -> Half(1,20,300:2,48000) *************** [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:07] [V] [TRT] --------------- Timing Runner: Conv_151 (FusedConvActConvolution) [03/13/2022-08:31:07] [V] [TRT] Tactic: 589823 time 0.06108 [03/13/2022-08:31:07] [V] [TRT] Tactic: 655359 time 0.046844 [03/13/2022-08:31:07] [V] [TRT] Tactic: 786431 time 0.056172 [03/13/2022-08:31:07] [V] [TRT] Tactic: 851967 time 0.04224 [03/13/2022-08:31:07] [V] [TRT] Tactic: 1179647 time 0.042208 [03/13/2022-08:31:07] [V] [TRT] Tactic: 1310719 time 0.05702 [03/13/2022-08:31:07] [V] [TRT] Tactic: 1376255 time 0.04928 [03/13/2022-08:31:07] [V] [TRT] Tactic: 1441791 time 0.040296 [03/13/2022-08:31:07] [V] [TRT] Tactic: 1507327 time 0.043552 [03/13/2022-08:31:07] [V] [TRT] Tactic: 1638399 time 0.047228 [03/13/2022-08:31:07] [V] [TRT] Tactic: 1835007 time 0.0534 [03/13/2022-08:31:07] [V] [TRT] Tactic: 1900543 time 0.04918 [03/13/2022-08:31:07] [V] [TRT] Tactic: 2097151 time 0.051864 [03/13/2022-08:31:07] [V] [TRT] Tactic: 2162687 time 0.049696 [03/13/2022-08:31:07] [V] [TRT] Tactic: 2293759 time 0.051608 [03/13/2022-08:31:07] [V] [TRT] Tactic: 2359295 time 0.035036 [03/13/2022-08:31:07] [V] [TRT] Tactic: 2686975 time 0.0464 [03/13/2022-08:31:07] [V] [TRT] Tactic: 3080191 time 0.040988 [03/13/2022-08:31:07] [V] [TRT] Tactic: 3342335 time 0.046124 [03/13/2022-08:31:07] [V] [TRT] Tactic: 3407871 time 0.042292 [03/13/2022-08:31:07] [V] [TRT] Tactic: 3538943 time 0.040528 [03/13/2022-08:31:07] [V] [TRT] Tactic: 3670015 time 0.077116 [03/13/2022-08:31:07] [V] [TRT] Tactic: 3932159 time 0.043536 [03/13/2022-08:31:07] [V] [TRT] Tactic: 3997695 time 0.05082 [03/13/2022-08:31:07] [V] [TRT] Tactic: 4063231 time 0.041964 [03/13/2022-08:31:07] [V] [TRT] Tactic: 4194303 time 0.056272 [03/13/2022-08:31:07] [V] [TRT] Tactic: 4259839 time 0.054296 [03/13/2022-08:31:07] [V] [TRT] Tactic: 4325375 time 0.044936 [03/13/2022-08:31:07] [V] [TRT] Tactic: 4521983 time 0.048148 [03/13/2022-08:31:07] [V] [TRT] Tactic: 4587519 time 0.056004 [03/13/2022-08:31:07] [V] [TRT] Tactic: 4653055 time 0.041624 [03/13/2022-08:31:07] [V] [TRT] Tactic: 4915199 time 0.049844 [03/13/2022-08:31:07] [V] [TRT] Tactic: 4980735 time 0.044984 [03/13/2022-08:31:07] [V] [TRT] Tactic: 5177343 time 0.040656 [03/13/2022-08:31:07] [V] [TRT] Tactic: 5242879 time 0.038736 [03/13/2022-08:31:07] [V] [TRT] Tactic: 5373951 time 0.04536 [03/13/2022-08:31:07] [V] [TRT] Tactic: 5439487 time 0.069768 [03/13/2022-08:31:07] [V] [TRT] Tactic: 5570559 time 0.045604 [03/13/2022-08:31:07] [V] [TRT] Tactic: 5636095 time 0.043556 [03/13/2022-08:31:07] [V] [TRT] Tactic: 5701631 time 0.045208 [03/13/2022-08:31:07] [V] [TRT] Tactic: 5767167 time 0.095152 [03/13/2022-08:31:07] [V] [TRT] Tactic: 5832703 time 0.0426 [03/13/2022-08:31:07] [V] [TRT] Tactic: 5898239 time 0.039436 [03/13/2022-08:31:07] [V] [TRT] Tactic: 6029311 time 0.047216 [03/13/2022-08:31:07] [V] [TRT] Tactic: 6225919 time 0.040312 [03/13/2022-08:31:07] [V] [TRT] Tactic: 6291455 time 0.044988 [03/13/2022-08:31:07] [V] [TRT] Tactic: 6422527 time 0.043404 [03/13/2022-08:31:07] [V] [TRT] Tactic: 6750207 time 0.056072 [03/13/2022-08:31:07] [V] [TRT] Tactic: 6815743 time 0.048916 [03/13/2022-08:31:07] [V] [TRT] Tactic: 6946815 time 0.059308 [03/13/2022-08:31:07] [V] [TRT] Tactic: 7012351 time 0.054832 [03/13/2022-08:31:07] [V] [TRT] Tactic: 7077887 time 0.039776 [03/13/2022-08:31:07] [V] [TRT] Tactic: 7143423 time 0.074496 [03/13/2022-08:31:07] [V] [TRT] Tactic: 7208959 time 0.038284 [03/13/2022-08:31:07] [V] [TRT] Tactic: 7340031 time 0.045392 [03/13/2022-08:31:07] [V] [TRT] Tactic: 7405567 time 0.040092 [03/13/2022-08:31:07] [V] [TRT] Tactic: 7536639 time 0.062932 [03/13/2022-08:31:07] [V] [TRT] Tactic: 7602175 time 0.059516 [03/13/2022-08:31:07] [V] [TRT] Tactic: 7733247 time 0.041896 [03/13/2022-08:31:07] [V] [TRT] Tactic: 7798783 time 0.059968 [03/13/2022-08:31:07] [V] [TRT] Tactic: 8191999 time 0.06724 [03/13/2022-08:31:07] [V] [TRT] Tactic: 8257535 time 0.0583 [03/13/2022-08:31:07] [V] [TRT] Tactic: 8323071 time 0.0558 [03/13/2022-08:31:07] [V] [TRT] Tactic: 8650751 time 0.05542 [03/13/2022-08:31:07] [V] [TRT] Tactic: 8716287 time 0.049336 [03/13/2022-08:31:07] [V] [TRT] Tactic: 9109503 time 0.065452 [03/13/2022-08:31:07] [V] [TRT] Tactic: 9568255 time 0.052552 [03/13/2022-08:31:07] [V] [TRT] Tactic: 9895935 time 0.058564 [03/13/2022-08:31:07] [V] [TRT] Tactic: 10223615 time 0.04878 [03/13/2022-08:31:07] [V] [TRT] Tactic: 10354687 time 0.056212 [03/13/2022-08:31:07] [V] [TRT] Tactic: 10551295 time 0.063008 [03/13/2022-08:31:07] [V] [TRT] Tactic: 10747903 time 0.038024 [03/13/2022-08:31:07] [V] [TRT] Tactic: 10944511 time 0.047192 [03/13/2022-08:31:07] [V] [TRT] Fastest Tactic: 2359295 Time: 0.035036 [03/13/2022-08:31:07] [V] [TRT] --------------- Timing Runner: Conv_151 (CaskConvolution) [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: 1651411198763708804 time 0.0423 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: 2418518597804310654 time 0.042328 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: 4318470497547290900 time 0.04136 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: 4930470141256631146 time 0.043924 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: 8292881859266835088 time 0.043228 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: 8401509141903434922 time 0.041828 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: -8654297089785671176 time 0.040608 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: -7516584506774355935 time 0.041732 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: -7140760933967189247 time 0.04156 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: -6004726995029373073 time 0.042876 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: -5719726816705110014 time 0.040672 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: -4097850214384059472 time 0.041428 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: -3717489476759089008 time 0.041808 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: -3689982367035295496 time 0.040688 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: -2640575123064142123 time 0.04052 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: -2534402059426524406 time 0.040556 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: -2027588946874785071 time 0.04248 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: -1968398013367819764 time 0.040732 [03/13/2022-08:31:07] [V] [TRT] Fastest Tactic: -2640575123064142123 Time: 0.04052 [03/13/2022-08:31:07] [V] [TRT] --------------- Timing Runner: Conv_151 (CudaConvolution) [03/13/2022-08:31:07] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:07] [V] [TRT] --------------- Timing Runner: Conv_151 (CudaDepthwiseConvolution) [03/13/2022-08:31:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2359295 [03/13/2022-08:31:07] [V] [TRT] [03/13/2022-08:31:07] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Float(1,20,300,96000) *************** [03/13/2022-08:31:07] [V] [TRT] --------------- Timing Runner: Conv_151 (FusedConvActConvolution) [03/13/2022-08:31:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:07] [V] [TRT] --------------- Timing Runner: Conv_151 (CaskConvolution) [03/13/2022-08:31:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:07] [V] [TRT] --------------- Timing Runner: Conv_151 (CudaConvolution) [03/13/2022-08:31:07] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:07] [V] [TRT] --------------- Timing Runner: Conv_151 (CudaDepthwiseConvolution) [03/13/2022-08:31:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:07] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Half(40,800,1:8,12000) *************** [03/13/2022-08:31:07] [V] [TRT] Conv_151 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] --------------- Timing Runner: Conv_151 (FusedConvActConvolution) [03/13/2022-08:31:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:07] [V] [TRT] --------------- Timing Runner: Conv_151 (CaskConvolution) [03/13/2022-08:31:07] [V] [TRT] Conv_151 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:07] [V] [TRT] Tactic: 9576651994278528 time 0.146124 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: 1179757074518529353 time 0.290448 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: 2105695814191699972 time 0.522032 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: 2148106709480872763 time 0.290488 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: 2410442691266548717 time 0.560772 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: 3041642431972138763 time 0.289148 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: 3754069740140581927 time 0.521724 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: 4555462412611657028 time 0.28902 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: 5666160310350604399 time 0.521648 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:07] [V] [TRT] Tactic: 5876997871499382316 time 0.265856 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: 5925270497649423688 time 1.00899 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: 6680916730816870145 time 0.468472 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: 7158029511300006471 time 0.46828 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:07] [V] [TRT] Tactic: 7859952145590271433 time 0.468208 [03/13/2022-08:31:07] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:08] [V] [TRT] Tactic: 8283847742354150423 time 0.466308 [03/13/2022-08:31:08] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:08] [V] [TRT] Tactic: -8992262742606384444 time 0.254656 [03/13/2022-08:31:08] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:08] [V] [TRT] Tactic: -8391760416076885205 time 0.92486 [03/13/2022-08:31:08] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:08] [V] [TRT] Tactic: -6273232454637933930 time 0.256056 [03/13/2022-08:31:08] [V] [TRT] Conv_151 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:08] [V] [TRT] Tactic: -5925110308892264213 time 0.237304 [03/13/2022-08:31:08] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:08] [V] [TRT] Tactic: -5818527483287834165 time 0.256004 [03/13/2022-08:31:08] [V] [TRT] Conv_151 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:08] [V] [TRT] Tactic: -4908848143422991657 time 0.131592 [03/13/2022-08:31:08] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:08] [V] [TRT] Tactic: -4534876761957424274 time 0.925108 [03/13/2022-08:31:08] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:08] [V] [TRT] Tactic: -3237051169894153788 time 0.466976 [03/13/2022-08:31:08] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:08] [V] [TRT] Tactic: -3136088851200285532 time 0.254256 [03/13/2022-08:31:08] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:08] [V] [TRT] Tactic: -2586046817576862066 time 0.501384 [03/13/2022-08:31:08] [V] [TRT] Conv_151 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:08] [V] [TRT] Tactic: -2422160065350346448 time 0.467568 [03/13/2022-08:31:08] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:08] [V] [TRT] Tactic: -1216445540764179377 time 0.500992 [03/13/2022-08:31:08] [V] [TRT] Conv_151 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:08] [V] [TRT] Tactic: -229563042944049199 time 0.25462 [03/13/2022-08:31:08] [V] [TRT] Fastest Tactic: -4908848143422991657 Time: 0.131592 [03/13/2022-08:31:08] [V] [TRT] --------------- Timing Runner: Conv_151 (CudaConvolution) [03/13/2022-08:31:08] [V] [TRT] Tactic: 0 time 2.75895 [03/13/2022-08:31:08] [V] [TRT] Tactic: 1 time 0.07566 [03/13/2022-08:31:08] [V] [TRT] Tactic: 2 time 0.144 [03/13/2022-08:31:08] [V] [TRT] Fastest Tactic: 1 Time: 0.07566 [03/13/2022-08:31:08] [V] [TRT] --------------- Timing Runner: Conv_151 (CudaDepthwiseConvolution) [03/13/2022-08:31:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:31:08] [V] [TRT] [03/13/2022-08:31:08] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,96000) -> Float(1,20,300,96000) *************** [03/13/2022-08:31:08] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_153, Mul_154) (PointWise) [03/13/2022-08:31:08] [V] [TRT] Tactic: 128 time 0.011164 [03/13/2022-08:31:08] [V] [TRT] Tactic: 256 time 0.011508 [03/13/2022-08:31:08] [V] [TRT] Tactic: 512 time 0.0125 [03/13/2022-08:31:08] [V] [TRT] Tactic: -32 time 0.025112 [03/13/2022-08:31:08] [V] [TRT] Tactic: -64 time 0.0167 [03/13/2022-08:31:08] [V] [TRT] Tactic: -128 time 0.013236 [03/13/2022-08:31:08] [V] [TRT] Fastest Tactic: 128 Time: 0.011164 [03/13/2022-08:31:08] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_153, Mul_154) (PointWiseV2) [03/13/2022-08:31:08] [V] [TRT] Tactic: 0 time 0.008108 [03/13/2022-08:31:08] [V] [TRT] Tactic: 1 time 0.006936 [03/13/2022-08:31:08] [V] [TRT] Tactic: 2 time 0.006496 [03/13/2022-08:31:08] [V] [TRT] Tactic: 3 time 0.006616 [03/13/2022-08:31:08] [V] [TRT] Tactic: 4 time 0.006556 [03/13/2022-08:31:08] [V] [TRT] Tactic: 5 time 0.006844 [03/13/2022-08:31:08] [V] [TRT] Tactic: 6 time 0.006444 [03/13/2022-08:31:08] [V] [TRT] Tactic: 7 time 0.00642 [03/13/2022-08:31:08] [V] [TRT] Tactic: 8 time 0.006308 [03/13/2022-08:31:08] [V] [TRT] Tactic: 9 time 0.006652 [03/13/2022-08:31:08] [V] [TRT] Tactic: 28 time 0.008076 [03/13/2022-08:31:08] [V] [TRT] Fastest Tactic: 8 Time: 0.006308 [03/13/2022-08:31:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:31:08] [V] [TRT] [03/13/2022-08:31:08] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,3000) -> Float(1,20,300:32,3000) *************** [03/13/2022-08:31:08] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_153, Mul_154) (PointWise) [03/13/2022-08:31:08] [V] [TRT] Tactic: 128 time 0.011348 [03/13/2022-08:31:08] [V] [TRT] Tactic: 256 time 0.011612 [03/13/2022-08:31:08] [V] [TRT] Tactic: 512 time 0.01286 [03/13/2022-08:31:08] [V] [TRT] Tactic: -32 time 0.025292 [03/13/2022-08:31:08] [V] [TRT] Tactic: -64 time 0.016736 [03/13/2022-08:31:08] [V] [TRT] Tactic: -128 time 0.013416 [03/13/2022-08:31:08] [V] [TRT] Fastest Tactic: 128 Time: 0.011348 [03/13/2022-08:31:08] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_153, Mul_154) (PointWiseV2) [03/13/2022-08:31:08] [V] [TRT] Tactic: 24 time 0.007976 [03/13/2022-08:31:08] [V] [TRT] Tactic: 25 time 0.007612 [03/13/2022-08:31:08] [V] [TRT] Tactic: 26 time 0.007124 [03/13/2022-08:31:08] [V] [TRT] Tactic: 27 time 0.008812 [03/13/2022-08:31:08] [V] [TRT] Tactic: 31 time 0.007952 [03/13/2022-08:31:08] [V] [TRT] Fastest Tactic: 26 Time: 0.007124 [03/13/2022-08:31:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [03/13/2022-08:31:08] [V] [TRT] [03/13/2022-08:31:08] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,96000) -> Half(1,20,300,96000) *************** [03/13/2022-08:31:08] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_153, Mul_154) (PointWise) [03/13/2022-08:31:08] [V] [TRT] Tactic: 128 time 0.012616 [03/13/2022-08:31:08] [V] [TRT] Tactic: 256 time 0.011984 [03/13/2022-08:31:08] [V] [TRT] Tactic: 512 time 0.012636 [03/13/2022-08:31:08] [V] [TRT] Tactic: -32 time 0.02528 [03/13/2022-08:31:08] [V] [TRT] Tactic: -64 time 0.016444 [03/13/2022-08:31:08] [V] [TRT] Tactic: -128 time 0.013148 [03/13/2022-08:31:08] [V] [TRT] Fastest Tactic: 256 Time: 0.011984 [03/13/2022-08:31:08] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_153, Mul_154) (PointWiseV2) [03/13/2022-08:31:08] [V] [TRT] Tactic: 0 time 0.008096 [03/13/2022-08:31:08] [V] [TRT] Tactic: 1 time 0.0067 [03/13/2022-08:31:08] [V] [TRT] Tactic: 2 time 0.006964 [03/13/2022-08:31:08] [V] [TRT] Tactic: 3 time 0.006568 [03/13/2022-08:31:08] [V] [TRT] Tactic: 4 time 0.006404 [03/13/2022-08:31:08] [V] [TRT] Tactic: 5 time 0.006404 [03/13/2022-08:31:08] [V] [TRT] Tactic: 6 time 0.006556 [03/13/2022-08:31:08] [V] [TRT] Tactic: 7 time 0.005992 [03/13/2022-08:31:08] [V] [TRT] Tactic: 8 time 0.00622 [03/13/2022-08:31:08] [V] [TRT] Tactic: 9 time 0.005968 [03/13/2022-08:31:08] [V] [TRT] Tactic: 28 time 0.008048 [03/13/2022-08:31:08] [V] [TRT] Fastest Tactic: 9 Time: 0.005968 [03/13/2022-08:31:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:08] [V] [TRT] [03/13/2022-08:31:08] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,48000) -> Half(1,20,300:2,48000) *************** [03/13/2022-08:31:08] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_153, Mul_154) (PointWise) [03/13/2022-08:31:08] [V] [TRT] Tactic: 128 time 0.012544 [03/13/2022-08:31:08] [V] [TRT] Tactic: 256 time 0.01212 [03/13/2022-08:31:08] [V] [TRT] Tactic: 512 time 0.012376 [03/13/2022-08:31:08] [V] [TRT] Tactic: -32 time 0.025196 [03/13/2022-08:31:08] [V] [TRT] Tactic: -64 time 0.016456 [03/13/2022-08:31:08] [V] [TRT] Tactic: -128 time 0.013436 [03/13/2022-08:31:08] [V] [TRT] Fastest Tactic: 256 Time: 0.01212 [03/13/2022-08:31:08] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_153, Mul_154) (PointWiseV2) [03/13/2022-08:31:08] [V] [TRT] Tactic: 0 time 0.006592 [03/13/2022-08:31:08] [V] [TRT] Tactic: 1 time 0.006748 [03/13/2022-08:31:08] [V] [TRT] Tactic: 2 time 0.006776 [03/13/2022-08:31:08] [V] [TRT] Tactic: 3 time 0.006616 [03/13/2022-08:31:08] [V] [TRT] Tactic: 4 time 0.006172 [03/13/2022-08:31:08] [V] [TRT] Tactic: 5 time 0.006528 [03/13/2022-08:31:08] [V] [TRT] Tactic: 6 time 0.007472 [03/13/2022-08:31:08] [V] [TRT] Tactic: 7 time 0.007188 [03/13/2022-08:31:08] [V] [TRT] Tactic: 8 time 0.006952 [03/13/2022-08:31:08] [V] [TRT] Tactic: 9 time 0.007284 [03/13/2022-08:31:08] [V] [TRT] Tactic: 10 time 0.00836 [03/13/2022-08:31:08] [V] [TRT] Tactic: 11 time 0.007012 [03/13/2022-08:31:08] [V] [TRT] Tactic: 12 time 0.006792 [03/13/2022-08:31:08] [V] [TRT] Tactic: 13 time 0.006696 [03/13/2022-08:31:08] [V] [TRT] Tactic: 14 time 0.006744 [03/13/2022-08:31:08] [V] [TRT] Tactic: 15 time 0.006508 [03/13/2022-08:31:08] [V] [TRT] Tactic: 16 time 0.006664 [03/13/2022-08:31:08] [V] [TRT] Tactic: 17 time 0.006396 [03/13/2022-08:31:08] [V] [TRT] Tactic: 18 time 0.006336 [03/13/2022-08:31:08] [V] [TRT] Tactic: 19 time 0.0063 [03/13/2022-08:31:08] [V] [TRT] Tactic: 28 time 0.006624 [03/13/2022-08:31:08] [V] [TRT] Tactic: 29 time 0.008204 [03/13/2022-08:31:08] [V] [TRT] Fastest Tactic: 4 Time: 0.006172 [03/13/2022-08:31:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [03/13/2022-08:31:08] [V] [TRT] [03/13/2022-08:31:08] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Half(40,800,1:8,12000) *************** [03/13/2022-08:31:08] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_153, Mul_154) (PointWise) [03/13/2022-08:31:08] [V] [TRT] Tactic: 128 time 0.012552 [03/13/2022-08:31:08] [V] [TRT] Tactic: 256 time 0.011744 [03/13/2022-08:31:08] [V] [TRT] Tactic: 512 time 0.012364 [03/13/2022-08:31:08] [V] [TRT] Tactic: -32 time 0.025144 [03/13/2022-08:31:08] [V] [TRT] Tactic: -64 time 0.016392 [03/13/2022-08:31:08] [V] [TRT] Tactic: -128 time 0.013176 [03/13/2022-08:31:08] [V] [TRT] Fastest Tactic: 256 Time: 0.011744 [03/13/2022-08:31:08] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_153, Mul_154) (PointWiseV2) [03/13/2022-08:31:08] [V] [TRT] Tactic: 0 time 0.006524 [03/13/2022-08:31:08] [V] [TRT] Tactic: 1 time 0.006616 [03/13/2022-08:31:08] [V] [TRT] Tactic: 2 time 0.00688 [03/13/2022-08:31:08] [V] [TRT] Tactic: 3 time 0.007984 [03/13/2022-08:31:08] [V] [TRT] Tactic: 4 time 0.00818 [03/13/2022-08:31:08] [V] [TRT] Tactic: 5 time 0.008932 [03/13/2022-08:31:08] [V] [TRT] Tactic: 6 time 0.011172 [03/13/2022-08:31:08] [V] [TRT] Tactic: 7 time 0.011312 [03/13/2022-08:31:08] [V] [TRT] Tactic: 8 time 0.011108 [03/13/2022-08:31:08] [V] [TRT] Tactic: 9 time 0.011712 [03/13/2022-08:31:08] [V] [TRT] Tactic: 10 time 0.006688 [03/13/2022-08:31:08] [V] [TRT] Tactic: 11 time 0.006252 [03/13/2022-08:31:08] [V] [TRT] Tactic: 12 time 0.006468 [03/13/2022-08:31:08] [V] [TRT] Tactic: 13 time 0.006832 [03/13/2022-08:31:08] [V] [TRT] Tactic: 14 time 0.006804 [03/13/2022-08:31:08] [V] [TRT] Tactic: 15 time 0.00664 [03/13/2022-08:31:08] [V] [TRT] Tactic: 16 time 0.008768 [03/13/2022-08:31:08] [V] [TRT] Tactic: 17 time 0.0082 [03/13/2022-08:31:08] [V] [TRT] Tactic: 18 time 0.008696 [03/13/2022-08:31:08] [V] [TRT] Tactic: 19 time 0.00922 [03/13/2022-08:31:08] [V] [TRT] Tactic: 20 time 0.00664 [03/13/2022-08:31:08] [V] [TRT] Tactic: 21 time 0.006656 [03/13/2022-08:31:08] [V] [TRT] Tactic: 22 time 0.006472 [03/13/2022-08:31:08] [V] [TRT] Tactic: 23 time 0.00722 [03/13/2022-08:31:08] [V] [TRT] Tactic: 24 time 0.008696 [03/13/2022-08:31:08] [V] [TRT] Tactic: 25 time 0.007316 [03/13/2022-08:31:08] [V] [TRT] Tactic: 26 time 0.006792 [03/13/2022-08:31:08] [V] [TRT] Tactic: 27 time 0.006524 [03/13/2022-08:31:08] [V] [TRT] Tactic: 28 time 0.006348 [03/13/2022-08:31:08] [V] [TRT] Tactic: 29 time 0.006552 [03/13/2022-08:31:08] [V] [TRT] Tactic: 30 time 0.006656 [03/13/2022-08:31:08] [V] [TRT] Tactic: 31 time 0.008196 [03/13/2022-08:31:08] [V] [TRT] Fastest Tactic: 11 Time: 0.006252 [03/13/2022-08:31:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 11 [03/13/2022-08:31:08] [V] [TRT] [03/13/2022-08:31:08] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,96000) -> Float(1,20,300,96000) *************** [03/13/2022-08:31:08] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:08] [V] [TRT] Conv_155 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:31:08] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:31:08] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:08] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:31:08] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:08] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:08] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:08] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:08] [V] [TRT] --------------- Timing Runner: Conv_155 (FusedConvActConvolution) [03/13/2022-08:31:08] [V] [TRT] Tactic: 524287 time 0.37792 [03/13/2022-08:31:09] [V] [TRT] Tactic: 720895 time 0.363552 [03/13/2022-08:31:09] [V] [TRT] Tactic: 983039 time 0.275704 [03/13/2022-08:31:09] [V] [TRT] Tactic: 1048575 time 0.332252 [03/13/2022-08:31:09] [V] [TRT] Tactic: 1703935 time 0.245656 [03/13/2022-08:31:09] [V] [TRT] Tactic: 1769471 time 0.279968 [03/13/2022-08:31:09] [V] [TRT] Tactic: 1966079 time 0.525296 [03/13/2022-08:31:09] [V] [TRT] Tactic: 2031615 time 0.435856 [03/13/2022-08:31:09] [V] [TRT] Tactic: 2228223 time 0.373976 [03/13/2022-08:31:09] [V] [TRT] Tactic: 2424831 time 0.306744 [03/13/2022-08:31:09] [V] [TRT] Tactic: 2621439 time 0.244156 [03/13/2022-08:31:09] [V] [TRT] Tactic: 2752511 time 0.299332 [03/13/2022-08:31:09] [V] [TRT] Tactic: 2818047 time 0.285356 [03/13/2022-08:31:09] [V] [TRT] Tactic: 2883583 time 0.400288 [03/13/2022-08:31:09] [V] [TRT] Tactic: 3014655 time 0.276408 [03/13/2022-08:31:09] [V] [TRT] Tactic: 3145727 time 0.275264 [03/13/2022-08:31:09] [V] [TRT] Tactic: 3473407 time 0.334112 [03/13/2022-08:31:09] [V] [TRT] Tactic: 3604479 time 0.368908 [03/13/2022-08:31:09] [V] [TRT] Tactic: 3735551 time 0.364488 [03/13/2022-08:31:09] [V] [TRT] Tactic: 4390911 time 0.579356 [03/13/2022-08:31:09] [V] [TRT] Tactic: 5046271 time 0.300868 [03/13/2022-08:31:09] [V] [TRT] Tactic: 5963775 time 0.466212 [03/13/2022-08:31:09] [V] [TRT] Tactic: 6160383 time 0.35938 [03/13/2022-08:31:09] [V] [TRT] Tactic: 6488063 time 0.393512 [03/13/2022-08:31:09] [V] [TRT] Tactic: 6881279 time 0.394124 [03/13/2022-08:31:09] [V] [TRT] Tactic: 7274495 time 0.2519 [03/13/2022-08:31:09] [V] [TRT] Tactic: 7864319 time 0.363176 [03/13/2022-08:31:09] [V] [TRT] Tactic: 7995391 time 0.381704 [03/13/2022-08:31:09] [V] [TRT] Tactic: 8585215 time 0.442584 [03/13/2022-08:31:09] [V] [TRT] Tactic: 8847359 time 0.365976 [03/13/2022-08:31:09] [V] [TRT] Tactic: 8978431 time 0.466068 [03/13/2022-08:31:09] [V] [TRT] Tactic: 9043967 time 0.331764 [03/13/2022-08:31:09] [V] [TRT] Tactic: 9175039 time 0.36896 [03/13/2022-08:31:09] [V] [TRT] Tactic: 9502719 time 0.369648 [03/13/2022-08:31:09] [V] [TRT] Tactic: 9830399 time 0.425104 [03/13/2022-08:31:09] [V] [TRT] Tactic: 9961471 time 0.379536 [03/13/2022-08:31:09] [V] [TRT] Tactic: 10027007 time 0.295968 [03/13/2022-08:31:10] [V] [TRT] Tactic: 10092543 time 0.57834 [03/13/2022-08:31:10] [V] [TRT] Tactic: 10289151 time 0.524292 [03/13/2022-08:31:10] [V] [TRT] Tactic: 10485759 time 0.24656 [03/13/2022-08:31:10] [V] [TRT] Tactic: 10682367 time 0.27046 [03/13/2022-08:31:10] [V] [TRT] Tactic: 10813439 time 0.304668 [03/13/2022-08:31:10] [V] [TRT] Fastest Tactic: 2621439 Time: 0.244156 [03/13/2022-08:31:10] [V] [TRT] --------------- Timing Runner: Conv_155 (CaskConvolution) [03/13/2022-08:31:10] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Tactic: 1825138533642645384 time 0.44116 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:31:10] [V] [TRT] Tactic: 2775507031594384867 time 0.217 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Tactic: 2842488832350522458 time 0.458468 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Tactic: 3915320020053085238 time 0.431268 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Tactic: 6448355332020552203 time 0.44518 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Tactic: 6808617066150061604 time 0.474044 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Tactic: -8060443123034038864 time 0.499432 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Tactic: -4420849921117327522 time 0.427104 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Tactic: -3946921629105938337 time 0.54386 [03/13/2022-08:31:10] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.217 [03/13/2022-08:31:10] [V] [TRT] --------------- Timing Runner: Conv_155 (CudaConvolution) [03/13/2022-08:31:10] [V] [TRT] Tactic: 0 time 0.520748 [03/13/2022-08:31:10] [V] [TRT] Tactic: 2 time 0.569044 [03/13/2022-08:31:10] [V] [TRT] Tactic: 5 skipped. Scratch requested: 448430080, available: 16777216 [03/13/2022-08:31:10] [V] [TRT] Tactic: 6 time 0.29648 [03/13/2022-08:31:10] [V] [TRT] Tactic: 57 time 0.455104 [03/13/2022-08:31:10] [V] [TRT] Fastest Tactic: 6 Time: 0.29648 [03/13/2022-08:31:10] [V] [TRT] --------------- Timing Runner: Conv_155 (CudaDepthwiseConvolution) [03/13/2022-08:31:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:31:10] [V] [TRT] [03/13/2022-08:31:10] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:31:10] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,96000) -> Half(1,20,300,96000) *************** [03/13/2022-08:31:10] [V] [TRT] --------------- Timing Runner: Conv_155 (FusedConvActConvolution) [03/13/2022-08:31:10] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:10] [V] [TRT] --------------- Timing Runner: Conv_155 (CaskConvolution) [03/13/2022-08:31:10] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:10] [V] [TRT] --------------- Timing Runner: Conv_155 (CudaConvolution) [03/13/2022-08:31:10] [V] [TRT] Tactic: 0 time 0.52972 [03/13/2022-08:31:10] [V] [TRT] Tactic: 1 time 0.528212 [03/13/2022-08:31:10] [V] [TRT] Tactic: 2 time 0.556592 [03/13/2022-08:31:10] [V] [TRT] Tactic: 4 skipped. Scratch requested: 897761280, available: 16777216 [03/13/2022-08:31:10] [V] [TRT] Tactic: 5 skipped. Scratch requested: 448430080, available: 16777216 [03/13/2022-08:31:10] [V] [TRT] Tactic: 6 time 0.397764 [03/13/2022-08:31:10] [V] [TRT] Fastest Tactic: 6 Time: 0.397764 [03/13/2022-08:31:10] [V] [TRT] --------------- Timing Runner: Conv_155 (CudaDepthwiseConvolution) [03/13/2022-08:31:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [03/13/2022-08:31:10] [V] [TRT] [03/13/2022-08:31:10] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,48000) -> Half(1,20,300:2,48000) *************** [03/13/2022-08:31:10] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:10] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:31:10] [V] [TRT] --------------- Timing Runner: Conv_155 (FusedConvActConvolution) [03/13/2022-08:31:10] [V] [TRT] Tactic: 524287 time 0.194412 [03/13/2022-08:31:10] [V] [TRT] Tactic: 720895 time 0.18112 [03/13/2022-08:31:10] [V] [TRT] Tactic: 983039 time 0.13946 [03/13/2022-08:31:10] [V] [TRT] Tactic: 1048575 time 0.16576 [03/13/2022-08:31:10] [V] [TRT] Tactic: 1703935 time 0.12504 [03/13/2022-08:31:10] [V] [TRT] Tactic: 1769471 time 0.148544 [03/13/2022-08:31:10] [V] [TRT] Tactic: 1966079 time 0.274452 [03/13/2022-08:31:10] [V] [TRT] Tactic: 2031615 time 0.219764 [03/13/2022-08:31:10] [V] [TRT] Tactic: 2228223 time 0.189656 [03/13/2022-08:31:10] [V] [TRT] Tactic: 2424831 time 0.160292 [03/13/2022-08:31:10] [V] [TRT] Tactic: 2621439 time 0.12548 [03/13/2022-08:31:10] [V] [TRT] Tactic: 2752511 time 0.148892 [03/13/2022-08:31:10] [V] [TRT] Tactic: 2818047 time 0.142864 [03/13/2022-08:31:10] [V] [TRT] Tactic: 2883583 time 0.205312 [03/13/2022-08:31:10] [V] [TRT] Tactic: 3014655 time 0.13998 [03/13/2022-08:31:10] [V] [TRT] Tactic: 3145727 time 0.138908 [03/13/2022-08:31:10] [V] [TRT] Tactic: 3473407 time 0.16818 [03/13/2022-08:31:10] [V] [TRT] Tactic: 3604479 time 0.187248 [03/13/2022-08:31:10] [V] [TRT] Tactic: 3735551 time 0.176248 [03/13/2022-08:31:10] [V] [TRT] Tactic: 4390911 time 0.291812 [03/13/2022-08:31:10] [V] [TRT] Tactic: 5046271 time 0.151584 [03/13/2022-08:31:10] [V] [TRT] Tactic: 5963775 time 0.236444 [03/13/2022-08:31:10] [V] [TRT] Tactic: 6160383 time 0.178444 [03/13/2022-08:31:10] [V] [TRT] Tactic: 6488063 time 0.198864 [03/13/2022-08:31:10] [V] [TRT] Tactic: 6881279 time 0.201312 [03/13/2022-08:31:10] [V] [TRT] Tactic: 7274495 time 0.12424 [03/13/2022-08:31:10] [V] [TRT] Tactic: 7864319 time 0.192216 [03/13/2022-08:31:10] [V] [TRT] Tactic: 7995391 time 0.19492 [03/13/2022-08:31:10] [V] [TRT] Tactic: 8585215 time 0.229192 [03/13/2022-08:31:10] [V] [TRT] Tactic: 8847359 time 0.19038 [03/13/2022-08:31:10] [V] [TRT] Tactic: 8978431 time 0.24174 [03/13/2022-08:31:10] [V] [TRT] Tactic: 9043967 time 0.167744 [03/13/2022-08:31:10] [V] [TRT] Tactic: 9175039 time 0.187072 [03/13/2022-08:31:10] [V] [TRT] Tactic: 9502719 time 0.188664 [03/13/2022-08:31:10] [V] [TRT] Tactic: 9830399 time 0.213404 [03/13/2022-08:31:10] [V] [TRT] Tactic: 9961471 time 0.199316 [03/13/2022-08:31:10] [V] [TRT] Tactic: 10027007 time 0.151004 [03/13/2022-08:31:10] [V] [TRT] Tactic: 10092543 time 0.29232 [03/13/2022-08:31:11] [V] [TRT] Tactic: 10289151 time 0.274504 [03/13/2022-08:31:11] [V] [TRT] Tactic: 10485759 time 0.124064 [03/13/2022-08:31:11] [V] [TRT] Tactic: 10682367 time 0.142068 [03/13/2022-08:31:11] [V] [TRT] Tactic: 10813439 time 0.157508 [03/13/2022-08:31:11] [V] [TRT] Fastest Tactic: 10485759 Time: 0.124064 [03/13/2022-08:31:11] [V] [TRT] --------------- Timing Runner: Conv_155 (CaskConvolution) [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: 1145226902788474763 time 0.242824 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: 1651411198763708804 time 0.23806 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: 2418518597804310654 time 0.240436 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: 4318470497547290900 time 0.231352 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: 4653005425971292725 time 0.243004 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: 4930470141256631146 time 0.251 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: 8292881859266835088 time 0.247792 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: 8401509141903434922 time 0.230796 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: -8654297089785671176 time 0.221084 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: -7448936905981214224 time 0.25792 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: -6004726995029373073 time 0.236328 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: -5719726816705110014 time 0.221128 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: -3754890472406891741 time 0.230836 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: -3689982367035295496 time 0.226016 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: -3140347171730126532 time 0.110892 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: -2894005464278291378 time 0.255512 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: -2027588946874785071 time 0.235556 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: -1968398013367819764 time 0.22602 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: -245090590808296743 time 0.231028 [03/13/2022-08:31:11] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.110892 [03/13/2022-08:31:11] [V] [TRT] --------------- Timing Runner: Conv_155 (CudaConvolution) [03/13/2022-08:31:11] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:11] [V] [TRT] --------------- Timing Runner: Conv_155 (CudaDepthwiseConvolution) [03/13/2022-08:31:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:31:11] [V] [TRT] [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:31:11] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Float(1,20,300,96000) *************** [03/13/2022-08:31:11] [V] [TRT] --------------- Timing Runner: Conv_155 (FusedConvActConvolution) [03/13/2022-08:31:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:11] [V] [TRT] --------------- Timing Runner: Conv_155 (CaskConvolution) [03/13/2022-08:31:11] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:11] [V] [TRT] --------------- Timing Runner: Conv_155 (CudaConvolution) [03/13/2022-08:31:11] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:11] [V] [TRT] --------------- Timing Runner: Conv_155 (CudaDepthwiseConvolution) [03/13/2022-08:31:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:11] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Half(40,800,1:8,12000) *************** [03/13/2022-08:31:11] [V] [TRT] Conv_155 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:11] [V] [TRT] Conv_155 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:11] [V] [TRT] Conv_155 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] --------------- Timing Runner: Conv_155 (FusedConvActConvolution) [03/13/2022-08:31:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:11] [V] [TRT] --------------- Timing Runner: Conv_155 (CaskConvolution) [03/13/2022-08:31:11] [V] [TRT] Conv_155 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:11] [V] [TRT] Tactic: 130343752241278875 time 0.96508 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: 2148106709480872763 time 1.92193 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: 2410442691266548717 time 3.83791 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:11] [V] [TRT] Tactic: 2921824978225832523 time 0.96582 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:11] [V] [TRT] Tactic: 3030711443478140260 time 1.79276 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: 3754069740140581927 time 3.58419 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: 3823144360994712832 time 1.92772 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: 5635311898703673455 time 1.92992 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: 5925270497649423688 time 7.15035 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: 6680916730816870145 time 3.58402 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: 7158029511300006471 time 3.58163 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: 7859952145590271433 time 3.58296 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:11] [V] [TRT] Tactic: 8283847742354150423 time 3.58312 [03/13/2022-08:31:11] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:12] [V] [TRT] Tactic: -8992262742606384444 time 1.93029 [03/13/2022-08:31:12] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:31:12] [V] [TRT] Tactic: -8682550625095202832 time 1.93263 [03/13/2022-08:31:12] [V] [TRT] Conv_155 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:12] [V] [TRT] Tactic: -8379842433586149932 time 1.79452 [03/13/2022-08:31:12] [V] [TRT] Conv_155 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:12] [V] [TRT] Tactic: -6352769237623756264 time 1.79487 [03/13/2022-08:31:12] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:12] [V] [TRT] Tactic: -6273232454637933930 time 1.93049 [03/13/2022-08:31:12] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:12] [V] [TRT] Tactic: -5818527483287834165 time 1.92985 [03/13/2022-08:31:12] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:31:12] [V] [TRT] Tactic: -4954692664176521434 time 3.84176 [03/13/2022-08:31:12] [V] [TRT] Conv_155 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:12] [V] [TRT] Tactic: -4953888146171240997 time 0.965828 [03/13/2022-08:31:12] [V] [TRT] Conv_155 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:12] [V] [TRT] Tactic: -4534876761957424274 time 7.15248 [03/13/2022-08:31:12] [V] [TRT] Conv_155 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:12] [V] [TRT] Tactic: -3237051169894153788 time 3.58434 [03/13/2022-08:31:12] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:12] [V] [TRT] Tactic: -3136088851200285532 time 1.92778 [03/13/2022-08:31:12] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:12] [V] [TRT] Tactic: -2586046817576862066 time 3.83833 [03/13/2022-08:31:12] [V] [TRT] Conv_155 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:12] [V] [TRT] Tactic: -229563042944049199 time 1.9266 [03/13/2022-08:31:12] [V] [TRT] Fastest Tactic: 130343752241278875 Time: 0.96508 [03/13/2022-08:31:12] [V] [TRT] --------------- Timing Runner: Conv_155 (CudaConvolution) [03/13/2022-08:31:12] [V] [TRT] Tactic: 0 time 1.23801 [03/13/2022-08:31:12] [V] [TRT] Tactic: 1 time 1.87553 [03/13/2022-08:31:12] [V] [TRT] Tactic: 2 time 0.618528 [03/13/2022-08:31:12] [V] [TRT] Tactic: 6 time 0.355308 [03/13/2022-08:31:12] [V] [TRT] Fastest Tactic: 6 Time: 0.355308 [03/13/2022-08:31:12] [V] [TRT] --------------- Timing Runner: Conv_155 (CudaDepthwiseConvolution) [03/13/2022-08:31:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [03/13/2022-08:31:12] [V] [TRT] [03/13/2022-08:31:12] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,96000) -> Float(1,20,300,192000) *************** [03/13/2022-08:31:12] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_157, Mul_158) (PointWise) [03/13/2022-08:31:12] [V] [TRT] Tactic: 128 time 0.013376 [03/13/2022-08:31:12] [V] [TRT] Tactic: 256 time 0.013224 [03/13/2022-08:31:12] [V] [TRT] Tactic: 512 time 0.014244 [03/13/2022-08:31:12] [V] [TRT] Tactic: -32 time 0.025548 [03/13/2022-08:31:12] [V] [TRT] Tactic: -64 time 0.016648 [03/13/2022-08:31:12] [V] [TRT] Tactic: -128 time 0.013912 [03/13/2022-08:31:12] [V] [TRT] Fastest Tactic: 256 Time: 0.013224 [03/13/2022-08:31:12] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_157, Mul_158) (PointWiseV2) [03/13/2022-08:31:12] [V] [TRT] Tactic: 0 time 0.00904 [03/13/2022-08:31:12] [V] [TRT] Tactic: 1 time 0.00784 [03/13/2022-08:31:12] [V] [TRT] Tactic: 2 time 0.007048 [03/13/2022-08:31:12] [V] [TRT] Tactic: 3 time 0.006944 [03/13/2022-08:31:12] [V] [TRT] Tactic: 4 time 0.006812 [03/13/2022-08:31:12] [V] [TRT] Tactic: 5 time 0.00656 [03/13/2022-08:31:12] [V] [TRT] Tactic: 6 time 0.0071 [03/13/2022-08:31:12] [V] [TRT] Tactic: 7 time 0.006372 [03/13/2022-08:31:12] [V] [TRT] Tactic: 8 time 0.006372 [03/13/2022-08:31:12] [V] [TRT] Tactic: 9 time 0.006644 [03/13/2022-08:31:12] [V] [TRT] Tactic: 28 time 0.008856 [03/13/2022-08:31:12] [V] [TRT] Fastest Tactic: 7 Time: 0.006372 [03/13/2022-08:31:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [03/13/2022-08:31:12] [V] [TRT] [03/13/2022-08:31:12] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,3000) -> Float(1,20,300:32,6000) *************** [03/13/2022-08:31:12] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_157, Mul_158) (PointWise) [03/13/2022-08:31:12] [V] [TRT] Tactic: 128 time 0.012984 [03/13/2022-08:31:12] [V] [TRT] Tactic: 256 time 0.013212 [03/13/2022-08:31:12] [V] [TRT] Tactic: 512 time 0.014248 [03/13/2022-08:31:12] [V] [TRT] Tactic: -32 time 0.024928 [03/13/2022-08:31:13] [V] [TRT] Tactic: -64 time 0.016568 [03/13/2022-08:31:13] [V] [TRT] Tactic: -128 time 0.013924 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 128 Time: 0.012984 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_157, Mul_158) (PointWiseV2) [03/13/2022-08:31:13] [V] [TRT] Tactic: 24 time 0.008088 [03/13/2022-08:31:13] [V] [TRT] Tactic: 25 time 0.007648 [03/13/2022-08:31:13] [V] [TRT] Tactic: 26 time 0.007284 [03/13/2022-08:31:13] [V] [TRT] Tactic: 27 time 0.008932 [03/13/2022-08:31:13] [V] [TRT] Tactic: 31 time 0.007836 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 26 Time: 0.007284 [03/13/2022-08:31:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [03/13/2022-08:31:13] [V] [TRT] [03/13/2022-08:31:13] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,96000) -> Half(1,20,300,192000) *************** [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_157, Mul_158) (PointWise) [03/13/2022-08:31:13] [V] [TRT] Tactic: 128 time 0.013012 [03/13/2022-08:31:13] [V] [TRT] Tactic: 256 time 0.01244 [03/13/2022-08:31:13] [V] [TRT] Tactic: 512 time 0.012748 [03/13/2022-08:31:13] [V] [TRT] Tactic: -32 time 0.025388 [03/13/2022-08:31:13] [V] [TRT] Tactic: -64 time 0.016736 [03/13/2022-08:31:13] [V] [TRT] Tactic: -128 time 0.013196 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 256 Time: 0.01244 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_157, Mul_158) (PointWiseV2) [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.009064 [03/13/2022-08:31:13] [V] [TRT] Tactic: 1 time 0.007844 [03/13/2022-08:31:13] [V] [TRT] Tactic: 2 time 0.006948 [03/13/2022-08:31:13] [V] [TRT] Tactic: 3 time 0.007016 [03/13/2022-08:31:13] [V] [TRT] Tactic: 4 time 0.006828 [03/13/2022-08:31:13] [V] [TRT] Tactic: 5 time 0.006696 [03/13/2022-08:31:13] [V] [TRT] Tactic: 6 time 0.006448 [03/13/2022-08:31:13] [V] [TRT] Tactic: 7 time 0.006348 [03/13/2022-08:31:13] [V] [TRT] Tactic: 8 time 0.006204 [03/13/2022-08:31:13] [V] [TRT] Tactic: 9 time 0.00636 [03/13/2022-08:31:13] [V] [TRT] Tactic: 28 time 0.009164 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 8 Time: 0.006204 [03/13/2022-08:31:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:31:13] [V] [TRT] [03/13/2022-08:31:13] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,48000) -> Half(1,20,300:2,96000) *************** [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_157, Mul_158) (PointWise) [03/13/2022-08:31:13] [V] [TRT] Tactic: 128 time 0.013104 [03/13/2022-08:31:13] [V] [TRT] Tactic: 256 time 0.012352 [03/13/2022-08:31:13] [V] [TRT] Tactic: 512 time 0.013112 [03/13/2022-08:31:13] [V] [TRT] Tactic: -32 time 0.025428 [03/13/2022-08:31:13] [V] [TRT] Tactic: -64 time 0.016572 [03/13/2022-08:31:13] [V] [TRT] Tactic: -128 time 0.013412 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 256 Time: 0.012352 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_157, Mul_158) (PointWiseV2) [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.00738 [03/13/2022-08:31:13] [V] [TRT] Tactic: 1 time 0.006856 [03/13/2022-08:31:13] [V] [TRT] Tactic: 2 time 0.006464 [03/13/2022-08:31:13] [V] [TRT] Tactic: 3 time 0.006376 [03/13/2022-08:31:13] [V] [TRT] Tactic: 4 time 0.00634 [03/13/2022-08:31:13] [V] [TRT] Tactic: 5 time 0.006584 [03/13/2022-08:31:13] [V] [TRT] Tactic: 6 time 0.00724 [03/13/2022-08:31:13] [V] [TRT] Tactic: 7 time 0.00684 [03/13/2022-08:31:13] [V] [TRT] Tactic: 8 time 0.007032 [03/13/2022-08:31:13] [V] [TRT] Tactic: 9 time 0.007132 [03/13/2022-08:31:13] [V] [TRT] Tactic: 10 time 0.008952 [03/13/2022-08:31:13] [V] [TRT] Tactic: 11 time 0.007928 [03/13/2022-08:31:13] [V] [TRT] Tactic: 12 time 0.007316 [03/13/2022-08:31:13] [V] [TRT] Tactic: 13 time 0.007272 [03/13/2022-08:31:13] [V] [TRT] Tactic: 14 time 0.0068 [03/13/2022-08:31:13] [V] [TRT] Tactic: 15 time 0.006592 [03/13/2022-08:31:13] [V] [TRT] Tactic: 16 time 0.006612 [03/13/2022-08:31:13] [V] [TRT] Tactic: 17 time 0.00636 [03/13/2022-08:31:13] [V] [TRT] Tactic: 18 time 0.0064 [03/13/2022-08:31:13] [V] [TRT] Tactic: 19 time 0.006516 [03/13/2022-08:31:13] [V] [TRT] Tactic: 28 time 0.007044 [03/13/2022-08:31:13] [V] [TRT] Tactic: 29 time 0.00888 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 4 Time: 0.00634 [03/13/2022-08:31:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [03/13/2022-08:31:13] [V] [TRT] [03/13/2022-08:31:13] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Half(80,1600,1:8,24000) *************** [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_157, Mul_158) (PointWise) [03/13/2022-08:31:13] [V] [TRT] Tactic: 128 time 0.012968 [03/13/2022-08:31:13] [V] [TRT] Tactic: 256 time 0.01246 [03/13/2022-08:31:13] [V] [TRT] Tactic: 512 time 0.012928 [03/13/2022-08:31:13] [V] [TRT] Tactic: -32 time 0.01864 [03/13/2022-08:31:13] [V] [TRT] Tactic: -64 time 0.014684 [03/13/2022-08:31:13] [V] [TRT] Tactic: -128 time 0.015128 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 256 Time: 0.01246 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_157, Mul_158) (PointWiseV2) [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.007364 [03/13/2022-08:31:13] [V] [TRT] Tactic: 1 time 0.007028 [03/13/2022-08:31:13] [V] [TRT] Tactic: 2 time 0.007728 [03/13/2022-08:31:13] [V] [TRT] Tactic: 3 time 0.007912 [03/13/2022-08:31:13] [V] [TRT] Tactic: 4 time 0.007988 [03/13/2022-08:31:13] [V] [TRT] Tactic: 5 time 0.00782 [03/13/2022-08:31:13] [V] [TRT] Tactic: 6 time 0.008912 [03/13/2022-08:31:13] [V] [TRT] Tactic: 7 time 0.008508 [03/13/2022-08:31:13] [V] [TRT] Tactic: 8 time 0.008224 [03/13/2022-08:31:13] [V] [TRT] Tactic: 9 time 0.008552 [03/13/2022-08:31:13] [V] [TRT] Tactic: 10 time 0.007076 [03/13/2022-08:31:13] [V] [TRT] Tactic: 11 time 0.007004 [03/13/2022-08:31:13] [V] [TRT] Tactic: 12 time 0.006872 [03/13/2022-08:31:13] [V] [TRT] Tactic: 13 time 0.006624 [03/13/2022-08:31:13] [V] [TRT] Tactic: 14 time 0.006884 [03/13/2022-08:31:13] [V] [TRT] Tactic: 15 time 0.006692 [03/13/2022-08:31:13] [V] [TRT] Tactic: 16 time 0.007856 [03/13/2022-08:31:13] [V] [TRT] Tactic: 17 time 0.00758 [03/13/2022-08:31:13] [V] [TRT] Tactic: 18 time 0.007692 [03/13/2022-08:31:13] [V] [TRT] Tactic: 19 time 0.007184 [03/13/2022-08:31:13] [V] [TRT] Tactic: 20 time 0.007356 [03/13/2022-08:31:13] [V] [TRT] Tactic: 21 time 0.007324 [03/13/2022-08:31:13] [V] [TRT] Tactic: 22 time 0.007888 [03/13/2022-08:31:13] [V] [TRT] Tactic: 23 time 0.006732 [03/13/2022-08:31:13] [V] [TRT] Tactic: 24 time 0.008868 [03/13/2022-08:31:13] [V] [TRT] Tactic: 25 time 0.007812 [03/13/2022-08:31:13] [V] [TRT] Tactic: 26 time 0.007872 [03/13/2022-08:31:13] [V] [TRT] Tactic: 27 time 0.008284 [03/13/2022-08:31:13] [V] [TRT] Tactic: 28 time 0.006512 [03/13/2022-08:31:13] [V] [TRT] Tactic: 29 time 0.006612 [03/13/2022-08:31:13] [V] [TRT] Tactic: 30 time 0.007324 [03/13/2022-08:31:13] [V] [TRT] Tactic: 31 time 0.009192 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 28 Time: 0.006512 [03/13/2022-08:31:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [03/13/2022-08:31:13] [V] [TRT] [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:13] [V] [TRT] Tactic: 1002 time 0.013008 [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.021556 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.013008 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:13] [V] [TRT] Tactic: 1002 time 0.00786 [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.008728 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.00786 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:13] [V] [TRT] Tactic: 1002 time 0.01706 [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.007464 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 0 Time: 0.007464 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:13] [V] [TRT] Tactic: 1002 time 0.012872 [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.007436 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 0 Time: 0.007436 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:13] [V] [TRT] Tactic: 1002 time 0.0232 [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.01412 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 0 Time: 0.01412 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:13] [V] [TRT] Tactic: 1002 time 0.023224 [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.013628 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 0 Time: 0.013628 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:13] [V] [TRT] Tactic: 1002 time 0.021492 [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.014256 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 0 Time: 0.014256 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:13] [V] [TRT] Tactic: 1002 time 0.016812 [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.010264 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 0 Time: 0.010264 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:13] [V] [TRT] Tactic: 1002 time 0.007976 [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.008932 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.007976 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:13] [V] [TRT] Tactic: 1002 time 0.013388 [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.021516 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.013388 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:13] [V] [TRT] Tactic: 1002 time 0.017088 [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.006928 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 0 Time: 0.006928 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:13] [V] [TRT] Tactic: 1002 time 0.013364 [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.006712 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 0 Time: 0.006712 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:13] [V] [TRT] Tactic: 1002 time 0.022864 [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.009252 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 0 Time: 0.009252 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:13] [V] [TRT] Tactic: 1002 time 0.01296 [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.021784 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.01296 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:13] [V] [TRT] Tactic: 1002 time 0.023376 [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.008544 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 0 Time: 0.008544 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:13] [V] [TRT] Tactic: 1002 time 0.013256 [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.005912 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 0 Time: 0.005912 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:13] [V] [TRT] Tactic: 1002 time 0.0126 [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.01438 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0126 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:13] [V] [TRT] Tactic: 1002 time 0.0166 [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.027656 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0166 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:13] [V] [TRT] Tactic: 1002 time 0.01288 [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.014148 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.01288 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:13] [V] [TRT] Tactic: 1002 time 0.021336 [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.006436 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 0 Time: 0.006436 [03/13/2022-08:31:13] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,192000) -> Float(1,20,300,192000) *************** [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_161, Mul_162) (PointWise) [03/13/2022-08:31:13] [V] [TRT] Tactic: 128 time 0.013272 [03/13/2022-08:31:13] [V] [TRT] Tactic: 256 time 0.013256 [03/13/2022-08:31:13] [V] [TRT] Tactic: 512 time 0.01434 [03/13/2022-08:31:13] [V] [TRT] Tactic: -32 time 0.025568 [03/13/2022-08:31:13] [V] [TRT] Tactic: -64 time 0.016732 [03/13/2022-08:31:13] [V] [TRT] Tactic: -128 time 0.013544 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 256 Time: 0.013256 [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_161, Mul_162) (PointWiseV2) [03/13/2022-08:31:13] [V] [TRT] Tactic: 0 time 0.008912 [03/13/2022-08:31:13] [V] [TRT] Tactic: 1 time 0.007496 [03/13/2022-08:31:13] [V] [TRT] Tactic: 2 time 0.006908 [03/13/2022-08:31:13] [V] [TRT] Tactic: 3 time 0.00716 [03/13/2022-08:31:13] [V] [TRT] Tactic: 4 time 0.006904 [03/13/2022-08:31:13] [V] [TRT] Tactic: 5 time 0.00654 [03/13/2022-08:31:13] [V] [TRT] Tactic: 6 time 0.006816 [03/13/2022-08:31:13] [V] [TRT] Tactic: 7 time 0.006404 [03/13/2022-08:31:13] [V] [TRT] Tactic: 8 time 0.006456 [03/13/2022-08:31:13] [V] [TRT] Tactic: 9 time 0.006344 [03/13/2022-08:31:13] [V] [TRT] Tactic: 28 time 0.008988 [03/13/2022-08:31:13] [V] [TRT] Fastest Tactic: 9 Time: 0.006344 [03/13/2022-08:31:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:13] [V] [TRT] [03/13/2022-08:31:13] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,6000) -> Float(1,20,300:32,6000) *************** [03/13/2022-08:31:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_161, Mul_162) (PointWise) [03/13/2022-08:31:13] [V] [TRT] Tactic: 128 time 0.01308 [03/13/2022-08:31:13] [V] [TRT] Tactic: 256 time 0.01318 [03/13/2022-08:31:13] [V] [TRT] Tactic: 512 time 0.014292 [03/13/2022-08:31:13] [V] [TRT] Tactic: -32 time 0.025432 [03/13/2022-08:31:13] [V] [TRT] Tactic: -64 time 0.01678 [03/13/2022-08:31:14] [V] [TRT] Tactic: -128 time 0.013936 [03/13/2022-08:31:14] [V] [TRT] Fastest Tactic: 128 Time: 0.01308 [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_161, Mul_162) (PointWiseV2) [03/13/2022-08:31:14] [V] [TRT] Tactic: 24 time 0.007596 [03/13/2022-08:31:14] [V] [TRT] Tactic: 25 time 0.007284 [03/13/2022-08:31:14] [V] [TRT] Tactic: 26 time 0.007472 [03/13/2022-08:31:14] [V] [TRT] Tactic: 27 time 0.00878 [03/13/2022-08:31:14] [V] [TRT] Tactic: 31 time 0.007288 [03/13/2022-08:31:14] [V] [TRT] Fastest Tactic: 25 Time: 0.007284 [03/13/2022-08:31:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [03/13/2022-08:31:14] [V] [TRT] [03/13/2022-08:31:14] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,192000) -> Half(1,20,300,192000) *************** [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_161, Mul_162) (PointWise) [03/13/2022-08:31:14] [V] [TRT] Tactic: 128 time 0.012856 [03/13/2022-08:31:14] [V] [TRT] Tactic: 256 time 0.012488 [03/13/2022-08:31:14] [V] [TRT] Tactic: 512 time 0.012952 [03/13/2022-08:31:14] [V] [TRT] Tactic: -32 time 0.025412 [03/13/2022-08:31:14] [V] [TRT] Tactic: -64 time 0.016968 [03/13/2022-08:31:14] [V] [TRT] Tactic: -128 time 0.013424 [03/13/2022-08:31:14] [V] [TRT] Fastest Tactic: 256 Time: 0.012488 [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_161, Mul_162) (PointWiseV2) [03/13/2022-08:31:14] [V] [TRT] Tactic: 0 time 0.008788 [03/13/2022-08:31:14] [V] [TRT] Tactic: 1 time 0.0079 [03/13/2022-08:31:14] [V] [TRT] Tactic: 2 time 0.006812 [03/13/2022-08:31:14] [V] [TRT] Tactic: 3 time 0.006924 [03/13/2022-08:31:14] [V] [TRT] Tactic: 4 time 0.006684 [03/13/2022-08:31:14] [V] [TRT] Tactic: 5 time 0.006772 [03/13/2022-08:31:14] [V] [TRT] Tactic: 6 time 0.006684 [03/13/2022-08:31:14] [V] [TRT] Tactic: 7 time 0.006448 [03/13/2022-08:31:14] [V] [TRT] Tactic: 8 time 0.006384 [03/13/2022-08:31:14] [V] [TRT] Tactic: 9 time 0.006496 [03/13/2022-08:31:14] [V] [TRT] Tactic: 28 time 0.00906 [03/13/2022-08:31:14] [V] [TRT] Fastest Tactic: 8 Time: 0.006384 [03/13/2022-08:31:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:31:14] [V] [TRT] [03/13/2022-08:31:14] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300:2,96000) *************** [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_161, Mul_162) (PointWise) [03/13/2022-08:31:14] [V] [TRT] Tactic: 128 time 0.013108 [03/13/2022-08:31:14] [V] [TRT] Tactic: 256 time 0.01226 [03/13/2022-08:31:14] [V] [TRT] Tactic: 512 time 0.0129 [03/13/2022-08:31:14] [V] [TRT] Tactic: -32 time 0.025336 [03/13/2022-08:31:14] [V] [TRT] Tactic: -64 time 0.016816 [03/13/2022-08:31:14] [V] [TRT] Tactic: -128 time 0.013492 [03/13/2022-08:31:14] [V] [TRT] Fastest Tactic: 256 Time: 0.01226 [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_161, Mul_162) (PointWiseV2) [03/13/2022-08:31:14] [V] [TRT] Tactic: 0 time 0.007212 [03/13/2022-08:31:14] [V] [TRT] Tactic: 1 time 0.006812 [03/13/2022-08:31:14] [V] [TRT] Tactic: 2 time 0.00672 [03/13/2022-08:31:14] [V] [TRT] Tactic: 3 time 0.006504 [03/13/2022-08:31:14] [V] [TRT] Tactic: 4 time 0.006364 [03/13/2022-08:31:14] [V] [TRT] Tactic: 5 time 0.006692 [03/13/2022-08:31:14] [V] [TRT] Tactic: 6 time 0.006896 [03/13/2022-08:31:14] [V] [TRT] Tactic: 7 time 0.007052 [03/13/2022-08:31:14] [V] [TRT] Tactic: 8 time 0.007188 [03/13/2022-08:31:14] [V] [TRT] Tactic: 9 time 0.007856 [03/13/2022-08:31:14] [V] [TRT] Tactic: 10 time 0.009008 [03/13/2022-08:31:14] [V] [TRT] Tactic: 11 time 0.008016 [03/13/2022-08:31:14] [V] [TRT] Tactic: 12 time 0.007136 [03/13/2022-08:31:14] [V] [TRT] Tactic: 13 time 0.00704 [03/13/2022-08:31:14] [V] [TRT] Tactic: 14 time 0.006728 [03/13/2022-08:31:14] [V] [TRT] Tactic: 15 time 0.006708 [03/13/2022-08:31:14] [V] [TRT] Tactic: 16 time 0.006592 [03/13/2022-08:31:14] [V] [TRT] Tactic: 17 time 0.006588 [03/13/2022-08:31:14] [V] [TRT] Tactic: 18 time 0.006456 [03/13/2022-08:31:14] [V] [TRT] Tactic: 19 time 0.00662 [03/13/2022-08:31:14] [V] [TRT] Tactic: 28 time 0.006992 [03/13/2022-08:31:14] [V] [TRT] Tactic: 29 time 0.008992 [03/13/2022-08:31:14] [V] [TRT] Fastest Tactic: 4 Time: 0.006364 [03/13/2022-08:31:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [03/13/2022-08:31:14] [V] [TRT] [03/13/2022-08:31:14] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Half(80,1600,1:8,24000) *************** [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_161, Mul_162) (PointWise) [03/13/2022-08:31:14] [V] [TRT] Tactic: 128 time 0.01332 [03/13/2022-08:31:14] [V] [TRT] Tactic: 256 time 0.012608 [03/13/2022-08:31:14] [V] [TRT] Tactic: 512 time 0.013068 [03/13/2022-08:31:14] [V] [TRT] Tactic: -32 time 0.018824 [03/13/2022-08:31:14] [V] [TRT] Tactic: -64 time 0.014564 [03/13/2022-08:31:14] [V] [TRT] Tactic: -128 time 0.014792 [03/13/2022-08:31:14] [V] [TRT] Fastest Tactic: 256 Time: 0.012608 [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_161, Mul_162) (PointWiseV2) [03/13/2022-08:31:14] [V] [TRT] Tactic: 0 time 0.007636 [03/13/2022-08:31:14] [V] [TRT] Tactic: 1 time 0.006832 [03/13/2022-08:31:14] [V] [TRT] Tactic: 2 time 0.007832 [03/13/2022-08:31:14] [V] [TRT] Tactic: 3 time 0.008748 [03/13/2022-08:31:14] [V] [TRT] Tactic: 4 time 0.008116 [03/13/2022-08:31:14] [V] [TRT] Tactic: 5 time 0.00798 [03/13/2022-08:31:14] [V] [TRT] Tactic: 6 time 0.009688 [03/13/2022-08:31:14] [V] [TRT] Tactic: 7 time 0.008856 [03/13/2022-08:31:14] [V] [TRT] Tactic: 8 time 0.008708 [03/13/2022-08:31:14] [V] [TRT] Tactic: 9 time 0.008496 [03/13/2022-08:31:14] [V] [TRT] Tactic: 10 time 0.007176 [03/13/2022-08:31:14] [V] [TRT] Tactic: 11 time 0.007336 [03/13/2022-08:31:14] [V] [TRT] Tactic: 12 time 0.007716 [03/13/2022-08:31:14] [V] [TRT] Tactic: 13 time 0.007512 [03/13/2022-08:31:14] [V] [TRT] Tactic: 14 time 0.008212 [03/13/2022-08:31:14] [V] [TRT] Tactic: 15 time 0.007316 [03/13/2022-08:31:14] [V] [TRT] Tactic: 16 time 0.00788 [03/13/2022-08:31:14] [V] [TRT] Tactic: 17 time 0.007528 [03/13/2022-08:31:14] [V] [TRT] Tactic: 18 time 0.007604 [03/13/2022-08:31:14] [V] [TRT] Tactic: 19 time 0.007044 [03/13/2022-08:31:14] [V] [TRT] Tactic: 20 time 0.007516 [03/13/2022-08:31:14] [V] [TRT] Tactic: 21 time 0.007176 [03/13/2022-08:31:14] [V] [TRT] Tactic: 22 time 0.007908 [03/13/2022-08:31:14] [V] [TRT] Tactic: 23 time 0.006528 [03/13/2022-08:31:14] [V] [TRT] Tactic: 24 time 0.009112 [03/13/2022-08:31:14] [V] [TRT] Tactic: 25 time 0.007916 [03/13/2022-08:31:14] [V] [TRT] Tactic: 26 time 0.008016 [03/13/2022-08:31:14] [V] [TRT] Tactic: 27 time 0.01016 [03/13/2022-08:31:14] [V] [TRT] Tactic: 28 time 0.007816 [03/13/2022-08:31:14] [V] [TRT] Tactic: 29 time 0.007972 [03/13/2022-08:31:14] [V] [TRT] Tactic: 30 time 0.009256 [03/13/2022-08:31:14] [V] [TRT] Tactic: 31 time 0.0117 [03/13/2022-08:31:14] [V] [TRT] Fastest Tactic: 23 Time: 0.006528 [03/13/2022-08:31:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 23 [03/13/2022-08:31:14] [V] [TRT] [03/13/2022-08:31:14] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,192000) -> Float(1,20,300,192000) *************** [03/13/2022-08:31:14] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,192000) -> Half(1,20,300,192000) *************** [03/13/2022-08:31:14] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300,192000) *************** [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: Conv_164 (FusedConvActConvolution) [03/13/2022-08:31:14] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: Conv_164 (CaskConvolution) [03/13/2022-08:31:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: Conv_164 (CudaConvolution) [03/13/2022-08:31:14] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: Conv_164 (CudaDepthwiseConvolution) [03/13/2022-08:31:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:14] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300:2,96000) *************** [03/13/2022-08:31:14] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Float(1,20,300,192000) *************** [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: Conv_164 (FusedConvActConvolution) [03/13/2022-08:31:14] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: Conv_164 (CaskConvolution) [03/13/2022-08:31:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: Conv_164 (CudaConvolution) [03/13/2022-08:31:14] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: Conv_164 (CudaDepthwiseConvolution) [03/13/2022-08:31:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:14] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Half(80,1600,1:8,24000) *************** [03/13/2022-08:31:14] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,192000) -> Float(1,20,300,192000) *************** [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_166, Mul_167) (PointWise) [03/13/2022-08:31:14] [V] [TRT] Tactic: 128 time 0.026108 [03/13/2022-08:31:14] [V] [TRT] Tactic: 256 time 0.026404 [03/13/2022-08:31:14] [V] [TRT] Tactic: 512 time 0.029208 [03/13/2022-08:31:14] [V] [TRT] Tactic: -32 time 0.043256 [03/13/2022-08:31:14] [V] [TRT] Tactic: -64 time 0.031824 [03/13/2022-08:31:14] [V] [TRT] Tactic: -128 time 0.02872 [03/13/2022-08:31:14] [V] [TRT] Fastest Tactic: 128 Time: 0.026108 [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_166, Mul_167) (PointWiseV2) [03/13/2022-08:31:14] [V] [TRT] Tactic: 0 time 0.019068 [03/13/2022-08:31:14] [V] [TRT] Tactic: 1 time 0.016428 [03/13/2022-08:31:14] [V] [TRT] Tactic: 2 time 0.014652 [03/13/2022-08:31:14] [V] [TRT] Tactic: 3 time 0.016296 [03/13/2022-08:31:14] [V] [TRT] Tactic: 4 time 0.014444 [03/13/2022-08:31:14] [V] [TRT] Tactic: 5 time 0.01394 [03/13/2022-08:31:14] [V] [TRT] Tactic: 6 time 0.016328 [03/13/2022-08:31:14] [V] [TRT] Tactic: 7 time 0.014212 [03/13/2022-08:31:14] [V] [TRT] Tactic: 8 time 0.013892 [03/13/2022-08:31:14] [V] [TRT] Tactic: 9 time 0.013172 [03/13/2022-08:31:14] [V] [TRT] Tactic: 28 time 0.019184 [03/13/2022-08:31:14] [V] [TRT] Fastest Tactic: 9 Time: 0.013172 [03/13/2022-08:31:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:14] [V] [TRT] [03/13/2022-08:31:14] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,6000) -> Float(1,20,300:32,6000) *************** [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_166, Mul_167) (PointWise) [03/13/2022-08:31:14] [V] [TRT] Tactic: 128 time 0.026428 [03/13/2022-08:31:14] [V] [TRT] Tactic: 256 time 0.026804 [03/13/2022-08:31:14] [V] [TRT] Tactic: 512 time 0.0294 [03/13/2022-08:31:14] [V] [TRT] Tactic: -32 time 0.043532 [03/13/2022-08:31:14] [V] [TRT] Tactic: -64 time 0.031744 [03/13/2022-08:31:14] [V] [TRT] Tactic: -128 time 0.028668 [03/13/2022-08:31:14] [V] [TRT] Fastest Tactic: 128 Time: 0.026428 [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_166, Mul_167) (PointWiseV2) [03/13/2022-08:31:14] [V] [TRT] Tactic: 24 time 0.015352 [03/13/2022-08:31:14] [V] [TRT] Tactic: 25 time 0.015548 [03/13/2022-08:31:14] [V] [TRT] Tactic: 26 time 0.015232 [03/13/2022-08:31:14] [V] [TRT] Tactic: 27 time 0.015168 [03/13/2022-08:31:14] [V] [TRT] Tactic: 31 time 0.0152 [03/13/2022-08:31:14] [V] [TRT] Fastest Tactic: 27 Time: 0.015168 [03/13/2022-08:31:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [03/13/2022-08:31:14] [V] [TRT] [03/13/2022-08:31:14] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,192000) -> Half(1,20,300,192000) *************** [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_166, Mul_167) (PointWise) [03/13/2022-08:31:14] [V] [TRT] Tactic: 128 time 0.026436 [03/13/2022-08:31:14] [V] [TRT] Tactic: 256 time 0.02338 [03/13/2022-08:31:14] [V] [TRT] Tactic: 512 time 0.022876 [03/13/2022-08:31:14] [V] [TRT] Tactic: -32 time 0.035836 [03/13/2022-08:31:14] [V] [TRT] Tactic: -64 time 0.029704 [03/13/2022-08:31:14] [V] [TRT] Tactic: -128 time 0.02676 [03/13/2022-08:31:14] [V] [TRT] Fastest Tactic: 512 Time: 0.022876 [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_166, Mul_167) (PointWiseV2) [03/13/2022-08:31:14] [V] [TRT] Tactic: 0 time 0.0144 [03/13/2022-08:31:14] [V] [TRT] Tactic: 1 time 0.012032 [03/13/2022-08:31:14] [V] [TRT] Tactic: 2 time 0.011188 [03/13/2022-08:31:14] [V] [TRT] Tactic: 3 time 0.011116 [03/13/2022-08:31:14] [V] [TRT] Tactic: 4 time 0.009848 [03/13/2022-08:31:14] [V] [TRT] Tactic: 5 time 0.009396 [03/13/2022-08:31:14] [V] [TRT] Tactic: 6 time 0.010312 [03/13/2022-08:31:14] [V] [TRT] Tactic: 7 time 0.009448 [03/13/2022-08:31:14] [V] [TRT] Tactic: 8 time 0.00938 [03/13/2022-08:31:14] [V] [TRT] Tactic: 9 time 0.008916 [03/13/2022-08:31:14] [V] [TRT] Tactic: 28 time 0.01438 [03/13/2022-08:31:14] [V] [TRT] Fastest Tactic: 9 Time: 0.008916 [03/13/2022-08:31:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:14] [V] [TRT] [03/13/2022-08:31:14] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300:2,96000) *************** [03/13/2022-08:31:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_166, Mul_167) (PointWise) [03/13/2022-08:31:14] [V] [TRT] Tactic: 128 time 0.027356 [03/13/2022-08:31:14] [V] [TRT] Tactic: 256 time 0.023064 [03/13/2022-08:31:14] [V] [TRT] Tactic: 512 time 0.024724 [03/13/2022-08:31:14] [V] [TRT] Tactic: -32 time 0.038572 [03/13/2022-08:31:14] [V] [TRT] Tactic: -64 time 0.030684 [03/13/2022-08:31:15] [V] [TRT] Tactic: -128 time 0.02726 [03/13/2022-08:31:15] [V] [TRT] Fastest Tactic: 256 Time: 0.023064 [03/13/2022-08:31:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_166, Mul_167) (PointWiseV2) [03/13/2022-08:31:15] [V] [TRT] Tactic: 0 time 0.01332 [03/13/2022-08:31:15] [V] [TRT] Tactic: 1 time 0.012872 [03/13/2022-08:31:15] [V] [TRT] Tactic: 2 time 0.011964 [03/13/2022-08:31:15] [V] [TRT] Tactic: 3 time 0.009964 [03/13/2022-08:31:15] [V] [TRT] Tactic: 4 time 0.011148 [03/13/2022-08:31:15] [V] [TRT] Tactic: 5 time 0.012408 [03/13/2022-08:31:15] [V] [TRT] Tactic: 6 time 0.009532 [03/13/2022-08:31:15] [V] [TRT] Tactic: 7 time 0.010052 [03/13/2022-08:31:15] [V] [TRT] Tactic: 8 time 0.0128 [03/13/2022-08:31:15] [V] [TRT] Tactic: 9 time 0.014428 [03/13/2022-08:31:15] [V] [TRT] Tactic: 10 time 0.015196 [03/13/2022-08:31:15] [V] [TRT] Tactic: 11 time 0.01282 [03/13/2022-08:31:15] [V] [TRT] Tactic: 12 time 0.011724 [03/13/2022-08:31:15] [V] [TRT] Tactic: 13 time 0.010912 [03/13/2022-08:31:15] [V] [TRT] Tactic: 14 time 0.010344 [03/13/2022-08:31:15] [V] [TRT] Tactic: 15 time 0.010072 [03/13/2022-08:31:15] [V] [TRT] Tactic: 16 time 0.010336 [03/13/2022-08:31:15] [V] [TRT] Tactic: 17 time 0.008772 [03/13/2022-08:31:15] [V] [TRT] Tactic: 18 time 0.00902 [03/13/2022-08:31:15] [V] [TRT] Tactic: 19 time 0.009676 [03/13/2022-08:31:15] [V] [TRT] Tactic: 28 time 0.011108 [03/13/2022-08:31:15] [V] [TRT] Tactic: 29 time 0.015028 [03/13/2022-08:31:15] [V] [TRT] Fastest Tactic: 17 Time: 0.008772 [03/13/2022-08:31:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 17 [03/13/2022-08:31:15] [V] [TRT] [03/13/2022-08:31:15] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Half(80,1600,1:8,24000) *************** [03/13/2022-08:31:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_166, Mul_167) (PointWise) [03/13/2022-08:31:15] [V] [TRT] Tactic: 128 time 0.026396 [03/13/2022-08:31:15] [V] [TRT] Tactic: 256 time 0.0236 [03/13/2022-08:31:15] [V] [TRT] Tactic: 512 time 0.022968 [03/13/2022-08:31:15] [V] [TRT] Tactic: -32 time 0.036048 [03/13/2022-08:31:15] [V] [TRT] Tactic: -64 time 0.029748 [03/13/2022-08:31:15] [V] [TRT] Tactic: -128 time 0.026772 [03/13/2022-08:31:15] [V] [TRT] Fastest Tactic: 512 Time: 0.022968 [03/13/2022-08:31:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_166, Mul_167) (PointWiseV2) [03/13/2022-08:31:15] [V] [TRT] Tactic: 0 time 0.010284 [03/13/2022-08:31:15] [V] [TRT] Tactic: 1 time 0.009904 [03/13/2022-08:31:15] [V] [TRT] Tactic: 2 time 0.011936 [03/13/2022-08:31:15] [V] [TRT] Tactic: 3 time 0.01036 [03/13/2022-08:31:15] [V] [TRT] Tactic: 4 time 0.012064 [03/13/2022-08:31:15] [V] [TRT] Tactic: 5 time 0.015316 [03/13/2022-08:31:15] [V] [TRT] Tactic: 6 time 0.014188 [03/13/2022-08:31:15] [V] [TRT] Tactic: 7 time 0.015248 [03/13/2022-08:31:15] [V] [TRT] Tactic: 8 time 0.016028 [03/13/2022-08:31:15] [V] [TRT] Tactic: 9 time 0.022748 [03/13/2022-08:31:15] [V] [TRT] Tactic: 10 time 0.01092 [03/13/2022-08:31:15] [V] [TRT] Tactic: 11 time 0.009524 [03/13/2022-08:31:15] [V] [TRT] Tactic: 12 time 0.01086 [03/13/2022-08:31:15] [V] [TRT] Tactic: 13 time 0.008864 [03/13/2022-08:31:15] [V] [TRT] Tactic: 14 time 0.010204 [03/13/2022-08:31:15] [V] [TRT] Tactic: 15 time 0.012868 [03/13/2022-08:31:15] [V] [TRT] Tactic: 16 time 0.010844 [03/13/2022-08:31:15] [V] [TRT] Tactic: 17 time 0.010828 [03/13/2022-08:31:15] [V] [TRT] Tactic: 18 time 0.013116 [03/13/2022-08:31:15] [V] [TRT] Tactic: 19 time 0.017468 [03/13/2022-08:31:15] [V] [TRT] Tactic: 20 time 0.012032 [03/13/2022-08:31:15] [V] [TRT] Tactic: 21 time 0.012724 [03/13/2022-08:31:15] [V] [TRT] Tactic: 22 time 0.012788 [03/13/2022-08:31:15] [V] [TRT] Tactic: 23 time 0.01144 [03/13/2022-08:31:15] [V] [TRT] Tactic: 24 time 0.016132 [03/13/2022-08:31:15] [V] [TRT] Tactic: 25 time 0.015456 [03/13/2022-08:31:15] [V] [TRT] Tactic: 26 time 0.014988 [03/13/2022-08:31:15] [V] [TRT] Tactic: 27 time 0.01108 [03/13/2022-08:31:15] [V] [TRT] Tactic: 28 time 0.011452 [03/13/2022-08:31:15] [V] [TRT] Tactic: 29 time 0.010956 [03/13/2022-08:31:15] [V] [TRT] Tactic: 30 time 0.01398 [03/13/2022-08:31:15] [V] [TRT] Tactic: 31 time 0.017124 [03/13/2022-08:31:15] [V] [TRT] Fastest Tactic: 13 Time: 0.008864 [03/13/2022-08:31:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 13 [03/13/2022-08:31:15] [V] [TRT] [03/13/2022-08:31:15] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,192000) -> Float(1,20,300,96000) *************** [03/13/2022-08:31:15] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,192000) -> Half(1,20,300,96000) *************** [03/13/2022-08:31:15] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300,96000) *************** [03/13/2022-08:31:15] [V] [TRT] --------------- Timing Runner: Conv_168 (FusedConvActConvolution) [03/13/2022-08:31:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:15] [V] [TRT] --------------- Timing Runner: Conv_168 (CaskConvolution) [03/13/2022-08:31:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:15] [V] [TRT] --------------- Timing Runner: Conv_168 (CudaConvolution) [03/13/2022-08:31:15] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:15] [V] [TRT] --------------- Timing Runner: Conv_168 (CudaDepthwiseConvolution) [03/13/2022-08:31:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:15] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300:2,48000) *************** [03/13/2022-08:31:15] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Float(1,20,300,96000) *************** [03/13/2022-08:31:15] [V] [TRT] --------------- Timing Runner: Conv_168 (FusedConvActConvolution) [03/13/2022-08:31:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:15] [V] [TRT] --------------- Timing Runner: Conv_168 (CaskConvolution) [03/13/2022-08:31:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:15] [V] [TRT] --------------- Timing Runner: Conv_168 (CudaConvolution) [03/13/2022-08:31:15] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:15] [V] [TRT] --------------- Timing Runner: Conv_168 (CudaDepthwiseConvolution) [03/13/2022-08:31:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:15] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Half(40,800,1:8,12000) *************** [03/13/2022-08:31:15] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,96000) -> Float(1,20,300,96000) *************** [03/13/2022-08:31:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_169, Mul_170) (PointWise) [03/13/2022-08:31:15] [V] [TRT] Tactic: 128 time 0.014428 [03/13/2022-08:31:15] [V] [TRT] Tactic: 256 time 0.015008 [03/13/2022-08:31:15] [V] [TRT] Tactic: 512 time 0.014968 [03/13/2022-08:31:15] [V] [TRT] Tactic: -32 time 0.0325 [03/13/2022-08:31:15] [V] [TRT] Tactic: -64 time 0.02098 [03/13/2022-08:31:15] [V] [TRT] Tactic: -128 time 0.016812 [03/13/2022-08:31:15] [V] [TRT] Fastest Tactic: 128 Time: 0.014428 [03/13/2022-08:31:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_169, Mul_170) (PointWiseV2) [03/13/2022-08:31:15] [V] [TRT] Tactic: 0 time 0.010004 [03/13/2022-08:31:15] [V] [TRT] Tactic: 1 time 0.00866 [03/13/2022-08:31:15] [V] [TRT] Tactic: 2 time 0.008164 [03/13/2022-08:31:15] [V] [TRT] Tactic: 3 time 0.008084 [03/13/2022-08:31:15] [V] [TRT] Tactic: 4 time 0.00746 [03/13/2022-08:31:15] [V] [TRT] Tactic: 5 time 0.007912 [03/13/2022-08:31:15] [V] [TRT] Tactic: 6 time 0.007932 [03/13/2022-08:31:15] [V] [TRT] Tactic: 7 time 0.006988 [03/13/2022-08:31:15] [V] [TRT] Tactic: 8 time 0.0066 [03/13/2022-08:31:15] [V] [TRT] Tactic: 9 time 0.006696 [03/13/2022-08:31:15] [V] [TRT] Tactic: 28 time 0.008344 [03/13/2022-08:31:15] [V] [TRT] Fastest Tactic: 8 Time: 0.0066 [03/13/2022-08:31:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:31:15] [V] [TRT] [03/13/2022-08:31:15] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,3000) -> Float(1,20,300:32,3000) *************** [03/13/2022-08:31:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_169, Mul_170) (PointWise) [03/13/2022-08:31:15] [V] [TRT] Tactic: 128 time 0.012 [03/13/2022-08:31:15] [V] [TRT] Tactic: 256 time 0.012372 [03/13/2022-08:31:15] [V] [TRT] Tactic: 512 time 0.012572 [03/13/2022-08:31:15] [V] [TRT] Tactic: -32 time 0.027144 [03/13/2022-08:31:15] [V] [TRT] Tactic: -64 time 0.018232 [03/13/2022-08:31:15] [V] [TRT] Tactic: -128 time 0.01404 [03/13/2022-08:31:15] [V] [TRT] Fastest Tactic: 128 Time: 0.012 [03/13/2022-08:31:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_169, Mul_170) (PointWiseV2) [03/13/2022-08:31:15] [V] [TRT] Tactic: 24 time 0.0084 [03/13/2022-08:31:15] [V] [TRT] Tactic: 25 time 0.009436 [03/13/2022-08:31:15] [V] [TRT] Tactic: 26 time 0.007828 [03/13/2022-08:31:15] [V] [TRT] Tactic: 27 time 0.009036 [03/13/2022-08:31:15] [V] [TRT] Tactic: 31 time 0.008288 [03/13/2022-08:31:15] [V] [TRT] Fastest Tactic: 26 Time: 0.007828 [03/13/2022-08:31:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [03/13/2022-08:31:15] [V] [TRT] [03/13/2022-08:31:15] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,96000) -> Half(1,20,300,96000) *************** [03/13/2022-08:31:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_169, Mul_170) (PointWise) [03/13/2022-08:31:15] [V] [TRT] Tactic: 128 time 0.013536 [03/13/2022-08:31:15] [V] [TRT] Tactic: 256 time 0.01246 [03/13/2022-08:31:15] [V] [TRT] Tactic: 512 time 0.013036 [03/13/2022-08:31:15] [V] [TRT] Tactic: -32 time 0.026852 [03/13/2022-08:31:15] [V] [TRT] Tactic: -64 time 0.016964 [03/13/2022-08:31:15] [V] [TRT] Tactic: -128 time 0.01432 [03/13/2022-08:31:15] [V] [TRT] Fastest Tactic: 256 Time: 0.01246 [03/13/2022-08:31:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_169, Mul_170) (PointWiseV2) [03/13/2022-08:31:15] [V] [TRT] Tactic: 0 time 0.008256 [03/13/2022-08:31:15] [V] [TRT] Tactic: 1 time 0.006836 [03/13/2022-08:31:15] [V] [TRT] Tactic: 2 time 0.006608 [03/13/2022-08:31:15] [V] [TRT] Tactic: 3 time 0.006848 [03/13/2022-08:31:15] [V] [TRT] Tactic: 4 time 0.006652 [03/13/2022-08:31:15] [V] [TRT] Tactic: 5 time 0.006604 [03/13/2022-08:31:15] [V] [TRT] Tactic: 6 time 0.006672 [03/13/2022-08:31:15] [V] [TRT] Tactic: 7 time 0.006356 [03/13/2022-08:31:15] [V] [TRT] Tactic: 8 time 0.006076 [03/13/2022-08:31:15] [V] [TRT] Tactic: 9 time 0.0066 [03/13/2022-08:31:15] [V] [TRT] Tactic: 28 time 0.008272 [03/13/2022-08:31:15] [V] [TRT] Fastest Tactic: 8 Time: 0.006076 [03/13/2022-08:31:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:31:15] [V] [TRT] [03/13/2022-08:31:15] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,48000) -> Half(1,20,300:2,48000) *************** [03/13/2022-08:31:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_169, Mul_170) (PointWise) [03/13/2022-08:31:15] [V] [TRT] Tactic: 128 time 0.013228 [03/13/2022-08:31:15] [V] [TRT] Tactic: 256 time 0.012612 [03/13/2022-08:31:15] [V] [TRT] Tactic: 512 time 0.012756 [03/13/2022-08:31:15] [V] [TRT] Tactic: -32 time 0.027136 [03/13/2022-08:31:15] [V] [TRT] Tactic: -64 time 0.01688 [03/13/2022-08:31:15] [V] [TRT] Tactic: -128 time 0.014156 [03/13/2022-08:31:15] [V] [TRT] Fastest Tactic: 256 Time: 0.012612 [03/13/2022-08:31:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_169, Mul_170) (PointWiseV2) [03/13/2022-08:31:15] [V] [TRT] Tactic: 0 time 0.006988 [03/13/2022-08:31:15] [V] [TRT] Tactic: 1 time 0.006972 [03/13/2022-08:31:15] [V] [TRT] Tactic: 2 time 0.006676 [03/13/2022-08:31:15] [V] [TRT] Tactic: 3 time 0.006924 [03/13/2022-08:31:15] [V] [TRT] Tactic: 4 time 0.006568 [03/13/2022-08:31:15] [V] [TRT] Tactic: 5 time 0.00684 [03/13/2022-08:31:15] [V] [TRT] Tactic: 6 time 0.007436 [03/13/2022-08:31:15] [V] [TRT] Tactic: 7 time 0.00756 [03/13/2022-08:31:15] [V] [TRT] Tactic: 8 time 0.007648 [03/13/2022-08:31:15] [V] [TRT] Tactic: 9 time 0.00792 [03/13/2022-08:31:15] [V] [TRT] Tactic: 10 time 0.008928 [03/13/2022-08:31:15] [V] [TRT] Tactic: 11 time 0.007704 [03/13/2022-08:31:15] [V] [TRT] Tactic: 12 time 0.007128 [03/13/2022-08:31:15] [V] [TRT] Tactic: 13 time 0.007164 [03/13/2022-08:31:15] [V] [TRT] Tactic: 14 time 0.00682 [03/13/2022-08:31:15] [V] [TRT] Tactic: 15 time 0.00692 [03/13/2022-08:31:15] [V] [TRT] Tactic: 16 time 0.006684 [03/13/2022-08:31:15] [V] [TRT] Tactic: 17 time 0.006372 [03/13/2022-08:31:15] [V] [TRT] Tactic: 18 time 0.00644 [03/13/2022-08:31:15] [V] [TRT] Tactic: 19 time 0.00692 [03/13/2022-08:31:15] [V] [TRT] Tactic: 28 time 0.007372 [03/13/2022-08:31:15] [V] [TRT] Tactic: 29 time 0.008696 [03/13/2022-08:31:15] [V] [TRT] Fastest Tactic: 17 Time: 0.006372 [03/13/2022-08:31:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 17 [03/13/2022-08:31:15] [V] [TRT] [03/13/2022-08:31:15] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Half(40,800,1:8,12000) *************** [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_169, Mul_170) (PointWise) [03/13/2022-08:31:16] [V] [TRT] Tactic: 128 time 0.0131 [03/13/2022-08:31:16] [V] [TRT] Tactic: 256 time 0.01286 [03/13/2022-08:31:16] [V] [TRT] Tactic: 512 time 0.01304 [03/13/2022-08:31:16] [V] [TRT] Tactic: -32 time 0.027036 [03/13/2022-08:31:16] [V] [TRT] Tactic: -64 time 0.01852 [03/13/2022-08:31:16] [V] [TRT] Tactic: -128 time 0.014268 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 256 Time: 0.01286 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_169, Mul_170) (PointWiseV2) [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.006364 [03/13/2022-08:31:16] [V] [TRT] Tactic: 1 time 0.008268 [03/13/2022-08:31:16] [V] [TRT] Tactic: 2 time 0.008092 [03/13/2022-08:31:16] [V] [TRT] Tactic: 3 time 0.009644 [03/13/2022-08:31:16] [V] [TRT] Tactic: 4 time 0.009444 [03/13/2022-08:31:16] [V] [TRT] Tactic: 5 time 0.009212 [03/13/2022-08:31:16] [V] [TRT] Tactic: 6 time 0.011376 [03/13/2022-08:31:16] [V] [TRT] Tactic: 7 time 0.014176 [03/13/2022-08:31:16] [V] [TRT] Tactic: 8 time 0.012128 [03/13/2022-08:31:16] [V] [TRT] Tactic: 9 time 0.015388 [03/13/2022-08:31:16] [V] [TRT] Tactic: 10 time 0.007464 [03/13/2022-08:31:16] [V] [TRT] Tactic: 11 time 0.006668 [03/13/2022-08:31:16] [V] [TRT] Tactic: 12 time 0.006872 [03/13/2022-08:31:16] [V] [TRT] Tactic: 13 time 0.007092 [03/13/2022-08:31:16] [V] [TRT] Tactic: 14 time 0.006928 [03/13/2022-08:31:16] [V] [TRT] Tactic: 15 time 0.007112 [03/13/2022-08:31:16] [V] [TRT] Tactic: 16 time 0.008808 [03/13/2022-08:31:16] [V] [TRT] Tactic: 17 time 0.008536 [03/13/2022-08:31:16] [V] [TRT] Tactic: 18 time 0.008988 [03/13/2022-08:31:16] [V] [TRT] Tactic: 19 time 0.009708 [03/13/2022-08:31:16] [V] [TRT] Tactic: 20 time 0.006824 [03/13/2022-08:31:16] [V] [TRT] Tactic: 21 time 0.00672 [03/13/2022-08:31:16] [V] [TRT] Tactic: 22 time 0.006728 [03/13/2022-08:31:16] [V] [TRT] Tactic: 23 time 0.007172 [03/13/2022-08:31:16] [V] [TRT] Tactic: 24 time 0.00864 [03/13/2022-08:31:16] [V] [TRT] Tactic: 25 time 0.007332 [03/13/2022-08:31:16] [V] [TRT] Tactic: 26 time 0.006584 [03/13/2022-08:31:16] [V] [TRT] Tactic: 27 time 0.006844 [03/13/2022-08:31:16] [V] [TRT] Tactic: 28 time 0.006544 [03/13/2022-08:31:16] [V] [TRT] Tactic: 29 time 0.00672 [03/13/2022-08:31:16] [V] [TRT] Tactic: 30 time 0.007368 [03/13/2022-08:31:16] [V] [TRT] Tactic: 31 time 0.008176 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.006364 [03/13/2022-08:31:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [03/13/2022-08:31:16] [V] [TRT] [03/13/2022-08:31:16] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,96000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: Resize_172 (Resize) [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.044336 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.044336 [03/13/2022-08:31:16] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,96000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: Resize_172 (Resize) [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.043244 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.043244 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: 607 copy (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.029392 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.021476 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.021476 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: 607 copy (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.038892 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.076184 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.038892 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: 607 copy (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.028576 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.027092 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.027092 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: 607 copy (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.052652 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.02352 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.02352 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: 607 copy (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.038884 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.022276 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.022276 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: 607 copy (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.02942 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.027344 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.027344 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: 607 copy (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.038528 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.076576 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.038528 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: 607 copy (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.027568 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.013804 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.013804 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: 607 copy (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.051764 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.022332 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.022332 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: 607 copy (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.0381 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.020076 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.020076 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.046312 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.0534 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.046312 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.099296 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.041792 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.041792 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.071948 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.037268 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.037268 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.109052 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.089312 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.089312 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.108872 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.085764 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.085764 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.121888 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.089296 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.089296 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.090948 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.058572 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.058572 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.049148 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.049072 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.049072 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.098804 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.03978 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.03978 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.071552 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.03384 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.03384 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.107144 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.040836 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.040836 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.109672 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.038272 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.038272 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.06918 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.029148 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.029148 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.07172 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.03328 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.03328 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.071356 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.024124 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.024124 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:16] [V] [TRT] Tactic: 1002 time 0.121588 [03/13/2022-08:31:16] [V] [TRT] Tactic: 0 time 0.0241 [03/13/2022-08:31:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0241 [03/13/2022-08:31:16] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,768000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:31:16] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:31:16] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:16] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:16] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:16] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:16] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:16] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:16] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:16] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:16] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (FusedConvActConvolution) [03/13/2022-08:31:16] [V] [TRT] Tactic: 589823 time 0.80374 [03/13/2022-08:31:16] [V] [TRT] Tactic: 655359 time 0.376068 [03/13/2022-08:31:16] [V] [TRT] Tactic: 786431 time 0.497876 [03/13/2022-08:31:16] [V] [TRT] Tactic: 851967 time 0.395304 [03/13/2022-08:31:16] [V] [TRT] Tactic: 1179647 time 0.356956 [03/13/2022-08:31:16] [V] [TRT] Tactic: 1310719 time 0.485644 [03/13/2022-08:31:16] [V] [TRT] Tactic: 1376255 time 0.399556 [03/13/2022-08:31:16] [V] [TRT] Tactic: 1441791 time 0.458008 [03/13/2022-08:31:16] [V] [TRT] Tactic: 1507327 time 0.328712 [03/13/2022-08:31:16] [V] [TRT] Tactic: 1638399 time 0.470088 [03/13/2022-08:31:16] [V] [TRT] Tactic: 1835007 time 0.543988 [03/13/2022-08:31:16] [V] [TRT] Tactic: 1900543 time 0.378404 [03/13/2022-08:31:17] [V] [TRT] Tactic: 2097151 time 0.505784 [03/13/2022-08:31:17] [V] [TRT] Tactic: 2162687 time 0.415244 [03/13/2022-08:31:17] [V] [TRT] Tactic: 2293759 time 0.386176 [03/13/2022-08:31:17] [V] [TRT] Tactic: 2359295 time 0.310228 [03/13/2022-08:31:17] [V] [TRT] Tactic: 2686975 time 0.38808 [03/13/2022-08:31:17] [V] [TRT] Tactic: 3080191 time 0.351988 [03/13/2022-08:31:17] [V] [TRT] Tactic: 3342335 time 0.332788 [03/13/2022-08:31:17] [V] [TRT] Tactic: 3407871 time 0.349028 [03/13/2022-08:31:17] [V] [TRT] Tactic: 3538943 time 0.350124 [03/13/2022-08:31:17] [V] [TRT] Tactic: 3670015 time 0.38414 [03/13/2022-08:31:17] [V] [TRT] Tactic: 3932159 time 0.39118 [03/13/2022-08:31:17] [V] [TRT] Tactic: 3997695 time 0.483656 [03/13/2022-08:31:17] [V] [TRT] Tactic: 4063231 time 0.365984 [03/13/2022-08:31:17] [V] [TRT] Tactic: 4194303 time 0.492136 [03/13/2022-08:31:17] [V] [TRT] Tactic: 4259839 time 0.457456 [03/13/2022-08:31:17] [V] [TRT] Tactic: 4325375 time 0.446176 [03/13/2022-08:31:17] [V] [TRT] Tactic: 4521983 time 0.512248 [03/13/2022-08:31:17] [V] [TRT] Tactic: 4587519 time 0.494156 [03/13/2022-08:31:17] [V] [TRT] Tactic: 4653055 time 0.317124 [03/13/2022-08:31:17] [V] [TRT] Tactic: 4915199 time 0.482528 [03/13/2022-08:31:17] [V] [TRT] Tactic: 4980735 time 0.457808 [03/13/2022-08:31:17] [V] [TRT] Tactic: 5177343 time 0.438268 [03/13/2022-08:31:17] [V] [TRT] Tactic: 5242879 time 0.403976 [03/13/2022-08:31:17] [V] [TRT] Tactic: 5373951 time 0.632732 [03/13/2022-08:31:17] [V] [TRT] Tactic: 5439487 time 1.19166 [03/13/2022-08:31:17] [V] [TRT] Tactic: 5570559 time 0.364848 [03/13/2022-08:31:17] [V] [TRT] Tactic: 5636095 time 0.364456 [03/13/2022-08:31:17] [V] [TRT] Tactic: 5701631 time 0.403308 [03/13/2022-08:31:17] [V] [TRT] Tactic: 5767167 time 2.62084 [03/13/2022-08:31:17] [V] [TRT] Tactic: 5832703 time 0.322448 [03/13/2022-08:31:17] [V] [TRT] Tactic: 5898239 time 0.351604 [03/13/2022-08:31:17] [V] [TRT] Tactic: 6029311 time 0.482244 [03/13/2022-08:31:17] [V] [TRT] Tactic: 6225919 time 0.408568 [03/13/2022-08:31:18] [V] [TRT] Tactic: 6291455 time 0.34866 [03/13/2022-08:31:18] [V] [TRT] Tactic: 6422527 time 0.413 [03/13/2022-08:31:18] [V] [TRT] Tactic: 6750207 time 0.604464 [03/13/2022-08:31:18] [V] [TRT] Tactic: 6815743 time 0.624584 [03/13/2022-08:31:18] [V] [TRT] Tactic: 6946815 time 0.949388 [03/13/2022-08:31:18] [V] [TRT] Tactic: 7012351 time 0.504188 [03/13/2022-08:31:18] [V] [TRT] Tactic: 7077887 time 0.311424 [03/13/2022-08:31:18] [V] [TRT] Tactic: 7143423 time 0.841276 [03/13/2022-08:31:18] [V] [TRT] Tactic: 7208959 time 0.381168 [03/13/2022-08:31:18] [V] [TRT] Tactic: 7340031 time 0.367972 [03/13/2022-08:31:18] [V] [TRT] Tactic: 7405567 time 0.344652 [03/13/2022-08:31:18] [V] [TRT] Tactic: 7536639 time 0.68246 [03/13/2022-08:31:18] [V] [TRT] Tactic: 7602175 time 0.498508 [03/13/2022-08:31:18] [V] [TRT] Tactic: 7733247 time 0.33902 [03/13/2022-08:31:18] [V] [TRT] Tactic: 7798783 time 0.484716 [03/13/2022-08:31:18] [V] [TRT] Tactic: 8191999 time 0.641148 [03/13/2022-08:31:18] [V] [TRT] Tactic: 8257535 time 0.526512 [03/13/2022-08:31:18] [V] [TRT] Tactic: 8323071 time 0.578192 [03/13/2022-08:31:18] [V] [TRT] Tactic: 8650751 time 0.597584 [03/13/2022-08:31:18] [V] [TRT] Tactic: 8716287 time 0.750072 [03/13/2022-08:31:18] [V] [TRT] Tactic: 9109503 time 0.549116 [03/13/2022-08:31:18] [V] [TRT] Tactic: 9568255 time 0.480872 [03/13/2022-08:31:18] [V] [TRT] Tactic: 9895935 time 0.490276 [03/13/2022-08:31:18] [V] [TRT] Tactic: 10223615 time 0.386152 [03/13/2022-08:31:18] [V] [TRT] Tactic: 10354687 time 0.454752 [03/13/2022-08:31:18] [V] [TRT] Tactic: 10551295 time 0.581048 [03/13/2022-08:31:18] [V] [TRT] Tactic: 10747903 time 0.319888 [03/13/2022-08:31:18] [V] [TRT] Tactic: 10944511 time 0.455916 [03/13/2022-08:31:18] [V] [TRT] Fastest Tactic: 2359295 Time: 0.310228 [03/13/2022-08:31:18] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (CaskConvolution) [03/13/2022-08:31:18] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:31:18] [V] [TRT] Tactic: 1754569683116234317 time 0.29432 [03/13/2022-08:31:18] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:18] [V] [TRT] Tactic: 1825138533642645384 time 0.29572 [03/13/2022-08:31:18] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:18] [V] [TRT] Tactic: 2733356012094739613 time 0.238728 [03/13/2022-08:31:18] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:18] [V] [TRT] Tactic: 3915320020053085238 time 0.295088 [03/13/2022-08:31:18] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:18] [V] [TRT] Tactic: 6808617066150061604 time 0.219236 [03/13/2022-08:31:18] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:18] [V] [TRT] Tactic: 9091006216302412844 time 0.20748 [03/13/2022-08:31:18] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:18] [V] [TRT] Tactic: -8060443123034038864 time 0.223304 [03/13/2022-08:31:18] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:18] [V] [TRT] Tactic: -4420849921117327522 time 0.274012 [03/13/2022-08:31:18] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:18] [V] [TRT] Tactic: -3946921629105938337 time 0.252032 [03/13/2022-08:31:18] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.20748 [03/13/2022-08:31:18] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (CudaConvolution) [03/13/2022-08:31:18] [V] [TRT] Tactic: 0 time 0.405704 [03/13/2022-08:31:18] [V] [TRT] Tactic: 2 time 0.517884 [03/13/2022-08:31:18] [V] [TRT] Tactic: 5 skipped. Scratch requested: 35686400, available: 16777216 [03/13/2022-08:31:18] [V] [TRT] Tactic: 57 time 0.31716 [03/13/2022-08:31:18] [V] [TRT] Fastest Tactic: 57 Time: 0.31716 [03/13/2022-08:31:18] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (CudaDepthwiseConvolution) [03/13/2022-08:31:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [03/13/2022-08:31:18] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:18] [V] [TRT] [03/13/2022-08:31:18] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:31:18] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:18] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:18] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:18] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:18] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:18] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:18] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:18] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:18] [V] [TRT] Conv_186 || Conv_174 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:18] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,768000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:31:18] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (FusedConvActConvolution) [03/13/2022-08:31:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:18] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (CaskConvolution) [03/13/2022-08:31:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:18] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (CudaConvolution) [03/13/2022-08:31:18] [V] [TRT] Tactic: 0 time 0.395476 [03/13/2022-08:31:18] [V] [TRT] Tactic: 1 time 0.313596 [03/13/2022-08:31:19] [V] [TRT] Tactic: 2 time 0.4984 [03/13/2022-08:31:19] [V] [TRT] Tactic: 4 skipped. Scratch requested: 6943047680, available: 16777216 [03/13/2022-08:31:19] [V] [TRT] Tactic: 5 skipped. Scratch requested: 35686400, available: 16777216 [03/13/2022-08:31:19] [V] [TRT] Fastest Tactic: 1 Time: 0.313596 [03/13/2022-08:31:19] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (CudaDepthwiseConvolution) [03/13/2022-08:31:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:31:19] [V] [TRT] [03/13/2022-08:31:19] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,384000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:31:19] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (FusedConvActConvolution) [03/13/2022-08:31:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:19] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (CaskConvolution) [03/13/2022-08:31:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:19] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (CudaConvolution) [03/13/2022-08:31:19] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:19] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (CudaDepthwiseConvolution) [03/13/2022-08:31:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:19] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,384000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:31:19] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:19] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:19] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:19] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:19] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:19] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:19] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:19] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:19] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:19] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:19] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:19] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:19] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:19] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:19] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:19] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:19] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:19] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:19] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (FusedConvActConvolution) [03/13/2022-08:31:19] [V] [TRT] Tactic: 589823 time 0.39726 [03/13/2022-08:31:19] [V] [TRT] Tactic: 655359 time 0.186956 [03/13/2022-08:31:19] [V] [TRT] Tactic: 786431 time 0.249172 [03/13/2022-08:31:19] [V] [TRT] Tactic: 851967 time 0.192504 [03/13/2022-08:31:19] [V] [TRT] Tactic: 1179647 time 0.167552 [03/13/2022-08:31:19] [V] [TRT] Tactic: 1310719 time 0.241912 [03/13/2022-08:31:19] [V] [TRT] Tactic: 1376255 time 0.203116 [03/13/2022-08:31:19] [V] [TRT] Tactic: 1441791 time 0.199056 [03/13/2022-08:31:19] [V] [TRT] Tactic: 1507327 time 0.161816 [03/13/2022-08:31:19] [V] [TRT] Tactic: 1638399 time 0.238908 [03/13/2022-08:31:19] [V] [TRT] Tactic: 1835007 time 0.273608 [03/13/2022-08:31:19] [V] [TRT] Tactic: 1900543 time 0.19072 [03/13/2022-08:31:19] [V] [TRT] Tactic: 2097151 time 0.266196 [03/13/2022-08:31:19] [V] [TRT] Tactic: 2162687 time 0.204012 [03/13/2022-08:31:19] [V] [TRT] Tactic: 2293759 time 0.191832 [03/13/2022-08:31:19] [V] [TRT] Tactic: 2359295 time 0.150148 [03/13/2022-08:31:19] [V] [TRT] Tactic: 2686975 time 0.194056 [03/13/2022-08:31:19] [V] [TRT] Tactic: 3080191 time 0.173804 [03/13/2022-08:31:19] [V] [TRT] Tactic: 3342335 time 0.163536 [03/13/2022-08:31:19] [V] [TRT] Tactic: 3407871 time 0.170304 [03/13/2022-08:31:19] [V] [TRT] Tactic: 3538943 time 0.171428 [03/13/2022-08:31:19] [V] [TRT] Tactic: 3670015 time 0.190288 [03/13/2022-08:31:19] [V] [TRT] Tactic: 3932159 time 0.18476 [03/13/2022-08:31:19] [V] [TRT] Tactic: 3997695 time 0.247764 [03/13/2022-08:31:19] [V] [TRT] Tactic: 4063231 time 0.181208 [03/13/2022-08:31:19] [V] [TRT] Tactic: 4194303 time 0.255912 [03/13/2022-08:31:19] [V] [TRT] Tactic: 4259839 time 0.236432 [03/13/2022-08:31:19] [V] [TRT] Tactic: 4325375 time 0.229452 [03/13/2022-08:31:19] [V] [TRT] Tactic: 4521983 time 0.246428 [03/13/2022-08:31:19] [V] [TRT] Tactic: 4587519 time 0.258608 [03/13/2022-08:31:19] [V] [TRT] Tactic: 4653055 time 0.167664 [03/13/2022-08:31:19] [V] [TRT] Tactic: 4915199 time 0.250768 [03/13/2022-08:31:19] [V] [TRT] Tactic: 4980735 time 0.235264 [03/13/2022-08:31:19] [V] [TRT] Tactic: 5177343 time 0.200132 [03/13/2022-08:31:19] [V] [TRT] Tactic: 5242879 time 0.18928 [03/13/2022-08:31:19] [V] [TRT] Tactic: 5373951 time 0.282768 [03/13/2022-08:31:19] [V] [TRT] Tactic: 5439487 time 0.441304 [03/13/2022-08:31:19] [V] [TRT] Tactic: 5570559 time 0.182988 [03/13/2022-08:31:19] [V] [TRT] Tactic: 5636095 time 0.18098 [03/13/2022-08:31:19] [V] [TRT] Tactic: 5701631 time 0.193612 [03/13/2022-08:31:19] [V] [TRT] Tactic: 5767167 time 0.8662 [03/13/2022-08:31:19] [V] [TRT] Tactic: 5832703 time 0.156196 [03/13/2022-08:31:19] [V] [TRT] Tactic: 5898239 time 0.166548 [03/13/2022-08:31:19] [V] [TRT] Tactic: 6029311 time 0.236532 [03/13/2022-08:31:19] [V] [TRT] Tactic: 6225919 time 0.201492 [03/13/2022-08:31:19] [V] [TRT] Tactic: 6291455 time 0.16818 [03/13/2022-08:31:19] [V] [TRT] Tactic: 6422527 time 0.204336 [03/13/2022-08:31:19] [V] [TRT] Tactic: 6750207 time 0.303976 [03/13/2022-08:31:19] [V] [TRT] Tactic: 6815743 time 0.261344 [03/13/2022-08:31:19] [V] [TRT] Tactic: 6946815 time 0.378984 [03/13/2022-08:31:19] [V] [TRT] Tactic: 7012351 time 0.266208 [03/13/2022-08:31:19] [V] [TRT] Tactic: 7077887 time 0.15028 [03/13/2022-08:31:19] [V] [TRT] Tactic: 7143423 time 0.407748 [03/13/2022-08:31:19] [V] [TRT] Tactic: 7208959 time 0.183624 [03/13/2022-08:31:20] [V] [TRT] Tactic: 7340031 time 0.179552 [03/13/2022-08:31:20] [V] [TRT] Tactic: 7405567 time 0.175232 [03/13/2022-08:31:20] [V] [TRT] Tactic: 7536639 time 0.325284 [03/13/2022-08:31:20] [V] [TRT] Tactic: 7602175 time 0.249476 [03/13/2022-08:31:20] [V] [TRT] Tactic: 7733247 time 0.16346 [03/13/2022-08:31:20] [V] [TRT] Tactic: 7798783 time 0.24894 [03/13/2022-08:31:20] [V] [TRT] Tactic: 8191999 time 0.317828 [03/13/2022-08:31:20] [V] [TRT] Tactic: 8257535 time 0.268316 [03/13/2022-08:31:20] [V] [TRT] Tactic: 8323071 time 0.289552 [03/13/2022-08:31:20] [V] [TRT] Tactic: 8650751 time 0.29266 [03/13/2022-08:31:20] [V] [TRT] Tactic: 8716287 time 0.270836 [03/13/2022-08:31:20] [V] [TRT] Tactic: 9109503 time 0.288752 [03/13/2022-08:31:20] [V] [TRT] Tactic: 9568255 time 0.250616 [03/13/2022-08:31:20] [V] [TRT] Tactic: 9895935 time 0.255264 [03/13/2022-08:31:20] [V] [TRT] Tactic: 10223615 time 0.194512 [03/13/2022-08:31:20] [V] [TRT] Tactic: 10354687 time 0.235864 [03/13/2022-08:31:20] [V] [TRT] Tactic: 10551295 time 0.288304 [03/13/2022-08:31:20] [V] [TRT] Tactic: 10747903 time 0.153024 [03/13/2022-08:31:20] [V] [TRT] Tactic: 10944511 time 0.234272 [03/13/2022-08:31:20] [V] [TRT] Fastest Tactic: 2359295 Time: 0.150148 [03/13/2022-08:31:20] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (CaskConvolution) [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: 1651411198763708804 time 0.110636 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: 2418518597804310654 time 0.111 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: 4318470497547290900 time 0.110176 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: 4930470141256631146 time 0.128744 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: 8292881859266835088 time 0.13022 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: 8401509141903434922 time 0.10932 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: -8654297089785671176 time 0.157672 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: -7516584506774355935 time 0.120464 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: -7140760933967189247 time 0.110432 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: -6004726995029373073 time 0.130216 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: -5719726816705110014 time 0.157692 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: -4097850214384059472 time 0.12098 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: -3717489476759089008 time 0.109448 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: -3689982367035295496 time 0.158112 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: -2640575123064142123 time 0.152912 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: -2534402059426524406 time 0.15352 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: -2027588946874785071 time 0.126904 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: -1968398013367819764 time 0.157972 [03/13/2022-08:31:20] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 0.10932 [03/13/2022-08:31:20] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (CudaConvolution) [03/13/2022-08:31:20] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:20] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (CudaDepthwiseConvolution) [03/13/2022-08:31:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8401509141903434922 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:20] [V] [TRT] [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:20] [V] [TRT] *************** Autotuning format combination: Half(80,3200,1:8,96000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:31:20] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (FusedConvActConvolution) [03/13/2022-08:31:20] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:20] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (CaskConvolution) [03/13/2022-08:31:20] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:20] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (CudaConvolution) [03/13/2022-08:31:20] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:20] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (CudaDepthwiseConvolution) [03/13/2022-08:31:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:20] [V] [TRT] *************** Autotuning format combination: Half(80,3200,1:8,96000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (FusedConvActConvolution) [03/13/2022-08:31:20] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:20] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (CaskConvolution) [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:20] [V] [TRT] Tactic: 9576651994278528 time 0.752612 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: 1179757074518529353 time 0.86464 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: 2105695814191699972 time 1.59749 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: 2148106709480872763 time 0.859068 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: 2410442691266548717 time 1.71389 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: 3041642431972138763 time 1.28373 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: 3754069740140581927 time 2.44702 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: 4555462412611657028 time 0.85892 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: 5666160310350604399 time 2.4704 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:20] [V] [TRT] Tactic: 5876997871499382316 time 1.3956 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: 5925270497649423688 time 3.25686 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: 6680916730816870145 time 1.59957 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: 7158029511300006471 time 1.59856 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: 7859952145590271433 time 1.5995 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: 8283847742354150423 time 2.44658 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:20] [V] [TRT] Tactic: -8992262742606384444 time 0.858632 [03/13/2022-08:31:20] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:21] [V] [TRT] Tactic: -8391760416076885205 time 3.25619 [03/13/2022-08:31:21] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:21] [V] [TRT] Tactic: -6273232454637933930 time 0.865132 [03/13/2022-08:31:21] [V] [TRT] Conv_186 || Conv_174 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:21] [V] [TRT] Tactic: -5925110308892264213 time 1.39531 [03/13/2022-08:31:21] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:21] [V] [TRT] Tactic: -5818527483287834165 time 0.865108 [03/13/2022-08:31:21] [V] [TRT] Conv_186 || Conv_174 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:21] [V] [TRT] Tactic: -4908848143422991657 time 0.752632 [03/13/2022-08:31:21] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:21] [V] [TRT] Tactic: -4534876761957424274 time 3.21839 [03/13/2022-08:31:21] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:21] [V] [TRT] Tactic: -3237051169894153788 time 1.59827 [03/13/2022-08:31:21] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:21] [V] [TRT] Tactic: -3136088851200285532 time 1.28414 [03/13/2022-08:31:21] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:21] [V] [TRT] Tactic: -2586046817576862066 time 1.71418 [03/13/2022-08:31:21] [V] [TRT] Conv_186 || Conv_174 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:21] [V] [TRT] Tactic: -2422160065350346448 time 1.59919 [03/13/2022-08:31:21] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:21] [V] [TRT] Tactic: -1216445540764179377 time 1.7157 [03/13/2022-08:31:21] [V] [TRT] Conv_186 || Conv_174 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:21] [V] [TRT] Tactic: -229563042944049199 time 1.2843 [03/13/2022-08:31:21] [V] [TRT] Fastest Tactic: 9576651994278528 Time: 0.752612 [03/13/2022-08:31:21] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (CudaConvolution) [03/13/2022-08:31:21] [V] [TRT] Tactic: 0 time 0.508704 [03/13/2022-08:31:21] [V] [TRT] Tactic: 1 time 0.351192 [03/13/2022-08:31:21] [V] [TRT] Tactic: 2 time 0.545096 [03/13/2022-08:31:21] [V] [TRT] Fastest Tactic: 1 Time: 0.351192 [03/13/2022-08:31:21] [V] [TRT] --------------- Timing Runner: Conv_186 || Conv_174 (CudaDepthwiseConvolution) [03/13/2022-08:31:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:31:21] [V] [TRT] [03/13/2022-08:31:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:21] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_176, Mul_177) (PointWise) [03/13/2022-08:31:21] [V] [TRT] Tactic: 128 time 0.02444 [03/13/2022-08:31:21] [V] [TRT] Tactic: 256 time 0.024608 [03/13/2022-08:31:21] [V] [TRT] Tactic: 512 time 0.026652 [03/13/2022-08:31:21] [V] [TRT] Tactic: -32 time 0.034732 [03/13/2022-08:31:21] [V] [TRT] Tactic: -64 time 0.025364 [03/13/2022-08:31:21] [V] [TRT] Tactic: -128 time 0.023768 [03/13/2022-08:31:21] [V] [TRT] Fastest Tactic: -128 Time: 0.023768 [03/13/2022-08:31:21] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_176, Mul_177) (PointWiseV2) [03/13/2022-08:31:21] [V] [TRT] Tactic: 0 time 0.016552 [03/13/2022-08:31:21] [V] [TRT] Tactic: 1 time 0.014616 [03/13/2022-08:31:21] [V] [TRT] Tactic: 2 time 0.013864 [03/13/2022-08:31:21] [V] [TRT] Tactic: 3 time 0.014684 [03/13/2022-08:31:21] [V] [TRT] Tactic: 4 time 0.0128 [03/13/2022-08:31:21] [V] [TRT] Tactic: 5 time 0.012068 [03/13/2022-08:31:21] [V] [TRT] Tactic: 6 time 0.015072 [03/13/2022-08:31:21] [V] [TRT] Tactic: 7 time 0.013776 [03/13/2022-08:31:21] [V] [TRT] Tactic: 8 time 0.013772 [03/13/2022-08:31:21] [V] [TRT] Tactic: 9 time 0.011716 [03/13/2022-08:31:21] [V] [TRT] Tactic: 28 time 0.016408 [03/13/2022-08:31:21] [V] [TRT] Fastest Tactic: 9 Time: 0.011716 [03/13/2022-08:31:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:21] [V] [TRT] [03/13/2022-08:31:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,12000) -> Float(1,40,1200:32,6000) *************** [03/13/2022-08:31:21] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_176, Mul_177) (PointWise) [03/13/2022-08:31:21] [V] [TRT] Tactic: 128 time 0.023872 [03/13/2022-08:31:21] [V] [TRT] Tactic: 256 time 0.024396 [03/13/2022-08:31:21] [V] [TRT] Tactic: 512 time 0.02618 [03/13/2022-08:31:21] [V] [TRT] Tactic: -32 time 0.0348 [03/13/2022-08:31:21] [V] [TRT] Tactic: -64 time 0.025576 [03/13/2022-08:31:21] [V] [TRT] Tactic: -128 time 0.023204 [03/13/2022-08:31:21] [V] [TRT] Fastest Tactic: -128 Time: 0.023204 [03/13/2022-08:31:21] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_176, Mul_177) (PointWiseV2) [03/13/2022-08:31:21] [V] [TRT] Tactic: 24 time 0.014652 [03/13/2022-08:31:21] [V] [TRT] Tactic: 25 time 0.0138 [03/13/2022-08:31:21] [V] [TRT] Tactic: 26 time 0.01474 [03/13/2022-08:31:21] [V] [TRT] Tactic: 27 time 0.013636 [03/13/2022-08:31:21] [V] [TRT] Tactic: 31 time 0.014704 [03/13/2022-08:31:21] [V] [TRT] Fastest Tactic: 27 Time: 0.013636 [03/13/2022-08:31:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [03/13/2022-08:31:21] [V] [TRT] [03/13/2022-08:31:21] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:31:21] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_176, Mul_177) (PointWise) [03/13/2022-08:31:21] [V] [TRT] Tactic: 128 time 0.02166 [03/13/2022-08:31:21] [V] [TRT] Tactic: 256 time 0.019468 [03/13/2022-08:31:21] [V] [TRT] Tactic: 512 time 0.019848 [03/13/2022-08:31:21] [V] [TRT] Tactic: -32 time 0.028252 [03/13/2022-08:31:21] [V] [TRT] Tactic: -64 time 0.02378 [03/13/2022-08:31:21] [V] [TRT] Tactic: -128 time 0.02152 [03/13/2022-08:31:21] [V] [TRT] Fastest Tactic: 256 Time: 0.019468 [03/13/2022-08:31:21] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_176, Mul_177) (PointWiseV2) [03/13/2022-08:31:21] [V] [TRT] Tactic: 0 time 0.013116 [03/13/2022-08:31:21] [V] [TRT] Tactic: 1 time 0.011068 [03/13/2022-08:31:21] [V] [TRT] Tactic: 2 time 0.009876 [03/13/2022-08:31:21] [V] [TRT] Tactic: 3 time 0.009688 [03/13/2022-08:31:21] [V] [TRT] Tactic: 4 time 0.008648 [03/13/2022-08:31:21] [V] [TRT] Tactic: 5 time 0.008164 [03/13/2022-08:31:21] [V] [TRT] Tactic: 6 time 0.009312 [03/13/2022-08:31:21] [V] [TRT] Tactic: 7 time 0.008056 [03/13/2022-08:31:21] [V] [TRT] Tactic: 8 time 0.007888 [03/13/2022-08:31:21] [V] [TRT] Tactic: 9 time 0.007976 [03/13/2022-08:31:21] [V] [TRT] Tactic: 28 time 0.01328 [03/13/2022-08:31:21] [V] [TRT] Fastest Tactic: 8 Time: 0.007888 [03/13/2022-08:31:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:31:21] [V] [TRT] [03/13/2022-08:31:21] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:31:21] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_176, Mul_177) (PointWise) [03/13/2022-08:31:21] [V] [TRT] Tactic: 128 time 0.022164 [03/13/2022-08:31:21] [V] [TRT] Tactic: 256 time 0.019908 [03/13/2022-08:31:21] [V] [TRT] Tactic: 512 time 0.019484 [03/13/2022-08:31:21] [V] [TRT] Tactic: -32 time 0.028468 [03/13/2022-08:31:21] [V] [TRT] Tactic: -64 time 0.02388 [03/13/2022-08:31:21] [V] [TRT] Tactic: -128 time 0.021872 [03/13/2022-08:31:21] [V] [TRT] Fastest Tactic: 512 Time: 0.019484 [03/13/2022-08:31:21] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_176, Mul_177) (PointWiseV2) [03/13/2022-08:31:21] [V] [TRT] Tactic: 0 time 0.010224 [03/13/2022-08:31:21] [V] [TRT] Tactic: 1 time 0.00912 [03/13/2022-08:31:21] [V] [TRT] Tactic: 2 time 0.010048 [03/13/2022-08:31:21] [V] [TRT] Tactic: 3 time 0.008488 [03/13/2022-08:31:21] [V] [TRT] Tactic: 4 time 0.009664 [03/13/2022-08:31:21] [V] [TRT] Tactic: 5 time 0.010464 [03/13/2022-08:31:21] [V] [TRT] Tactic: 6 time 0.008068 [03/13/2022-08:31:21] [V] [TRT] Tactic: 7 time 0.00854 [03/13/2022-08:31:21] [V] [TRT] Tactic: 8 time 0.010096 [03/13/2022-08:31:21] [V] [TRT] Tactic: 9 time 0.01236 [03/13/2022-08:31:21] [V] [TRT] Tactic: 10 time 0.01412 [03/13/2022-08:31:21] [V] [TRT] Tactic: 11 time 0.010996 [03/13/2022-08:31:21] [V] [TRT] Tactic: 12 time 0.01026 [03/13/2022-08:31:21] [V] [TRT] Tactic: 13 time 0.009592 [03/13/2022-08:31:21] [V] [TRT] Tactic: 14 time 0.009196 [03/13/2022-08:31:21] [V] [TRT] Tactic: 15 time 0.008812 [03/13/2022-08:31:21] [V] [TRT] Tactic: 16 time 0.008656 [03/13/2022-08:31:21] [V] [TRT] Tactic: 17 time 0.00826 [03/13/2022-08:31:21] [V] [TRT] Tactic: 18 time 0.007968 [03/13/2022-08:31:21] [V] [TRT] Tactic: 19 time 0.008164 [03/13/2022-08:31:21] [V] [TRT] Tactic: 28 time 0.010244 [03/13/2022-08:31:21] [V] [TRT] Tactic: 29 time 0.013496 [03/13/2022-08:31:21] [V] [TRT] Fastest Tactic: 18 Time: 0.007968 [03/13/2022-08:31:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:31:21] [V] [TRT] [03/13/2022-08:31:21] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:31:21] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_176, Mul_177) (PointWise) [03/13/2022-08:31:21] [V] [TRT] Tactic: 128 time 0.02246 [03/13/2022-08:31:21] [V] [TRT] Tactic: 256 time 0.019952 [03/13/2022-08:31:21] [V] [TRT] Tactic: 512 time 0.020396 [03/13/2022-08:31:21] [V] [TRT] Tactic: -32 time 0.032756 [03/13/2022-08:31:21] [V] [TRT] Tactic: -64 time 0.027428 [03/13/2022-08:31:21] [V] [TRT] Tactic: -128 time 0.02756 [03/13/2022-08:31:21] [V] [TRT] Fastest Tactic: 256 Time: 0.019952 [03/13/2022-08:31:21] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_176, Mul_177) (PointWiseV2) [03/13/2022-08:31:21] [V] [TRT] Tactic: 0 time 0.011108 [03/13/2022-08:31:21] [V] [TRT] Tactic: 1 time 0.01212 [03/13/2022-08:31:21] [V] [TRT] Tactic: 2 time 0.011184 [03/13/2022-08:31:21] [V] [TRT] Tactic: 3 time 0.014148 [03/13/2022-08:31:22] [V] [TRT] Tactic: 4 time 0.013048 [03/13/2022-08:31:22] [V] [TRT] Tactic: 5 time 0.011968 [03/13/2022-08:31:22] [V] [TRT] Tactic: 6 time 0.019 [03/13/2022-08:31:22] [V] [TRT] Tactic: 7 time 0.01562 [03/13/2022-08:31:22] [V] [TRT] Tactic: 8 time 0.0145 [03/13/2022-08:31:22] [V] [TRT] Tactic: 9 time 0.015924 [03/13/2022-08:31:22] [V] [TRT] Tactic: 10 time 0.012336 [03/13/2022-08:31:22] [V] [TRT] Tactic: 11 time 0.010976 [03/13/2022-08:31:22] [V] [TRT] Tactic: 12 time 0.011352 [03/13/2022-08:31:22] [V] [TRT] Tactic: 13 time 0.012116 [03/13/2022-08:31:22] [V] [TRT] Tactic: 14 time 0.012004 [03/13/2022-08:31:22] [V] [TRT] Tactic: 15 time 0.011932 [03/13/2022-08:31:22] [V] [TRT] Tactic: 16 time 0.014328 [03/13/2022-08:31:22] [V] [TRT] Tactic: 17 time 0.013364 [03/13/2022-08:31:22] [V] [TRT] Tactic: 18 time 0.01342 [03/13/2022-08:31:22] [V] [TRT] Tactic: 19 time 0.012772 [03/13/2022-08:31:22] [V] [TRT] Tactic: 20 time 0.01298 [03/13/2022-08:31:22] [V] [TRT] Tactic: 21 time 0.012288 [03/13/2022-08:31:22] [V] [TRT] Tactic: 22 time 0.010988 [03/13/2022-08:31:22] [V] [TRT] Tactic: 23 time 0.012568 [03/13/2022-08:31:22] [V] [TRT] Tactic: 24 time 0.014752 [03/13/2022-08:31:22] [V] [TRT] Tactic: 25 time 0.01298 [03/13/2022-08:31:22] [V] [TRT] Tactic: 26 time 0.012884 [03/13/2022-08:31:22] [V] [TRT] Tactic: 27 time 0.010908 [03/13/2022-08:31:22] [V] [TRT] Tactic: 28 time 0.008968 [03/13/2022-08:31:22] [V] [TRT] Tactic: 29 time 0.009624 [03/13/2022-08:31:22] [V] [TRT] Tactic: 30 time 0.011184 [03/13/2022-08:31:22] [V] [TRT] Tactic: 31 time 0.015064 [03/13/2022-08:31:22] [V] [TRT] Fastest Tactic: 28 Time: 0.008968 [03/13/2022-08:31:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [03/13/2022-08:31:22] [V] [TRT] [03/13/2022-08:31:22] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:22] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:31:22] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:31:22] [V] [TRT] --------------- Timing Runner: Conv_178 (FusedConvActConvolution) [03/13/2022-08:31:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:22] [V] [TRT] --------------- Timing Runner: Conv_178 (CaskConvolution) [03/13/2022-08:31:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:22] [V] [TRT] --------------- Timing Runner: Conv_178 (CudaConvolution) [03/13/2022-08:31:22] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:22] [V] [TRT] --------------- Timing Runner: Conv_178 (CudaDepthwiseConvolution) [03/13/2022-08:31:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:22] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:31:22] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:22] [V] [TRT] --------------- Timing Runner: Conv_178 (FusedConvActConvolution) [03/13/2022-08:31:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:22] [V] [TRT] --------------- Timing Runner: Conv_178 (CaskConvolution) [03/13/2022-08:31:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:22] [V] [TRT] --------------- Timing Runner: Conv_178 (CudaConvolution) [03/13/2022-08:31:22] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:22] [V] [TRT] --------------- Timing Runner: Conv_178 (CudaDepthwiseConvolution) [03/13/2022-08:31:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:22] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:31:22] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:22] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_180, Mul_181) (PointWise) [03/13/2022-08:31:22] [V] [TRT] Tactic: 128 time 0.020872 [03/13/2022-08:31:22] [V] [TRT] Tactic: 256 time 0.021512 [03/13/2022-08:31:22] [V] [TRT] Tactic: 512 time 0.023572 [03/13/2022-08:31:22] [V] [TRT] Tactic: -32 time 0.034744 [03/13/2022-08:31:22] [V] [TRT] Tactic: -64 time 0.025512 [03/13/2022-08:31:22] [V] [TRT] Tactic: -128 time 0.023272 [03/13/2022-08:31:22] [V] [TRT] Fastest Tactic: 128 Time: 0.020872 [03/13/2022-08:31:22] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_180, Mul_181) (PointWiseV2) [03/13/2022-08:31:22] [V] [TRT] Tactic: 0 time 0.016172 [03/13/2022-08:31:22] [V] [TRT] Tactic: 1 time 0.014056 [03/13/2022-08:31:22] [V] [TRT] Tactic: 2 time 0.011936 [03/13/2022-08:31:22] [V] [TRT] Tactic: 3 time 0.0152 [03/13/2022-08:31:22] [V] [TRT] Tactic: 4 time 0.012696 [03/13/2022-08:31:22] [V] [TRT] Tactic: 5 time 0.012768 [03/13/2022-08:31:22] [V] [TRT] Tactic: 6 time 0.01446 [03/13/2022-08:31:22] [V] [TRT] Tactic: 7 time 0.013768 [03/13/2022-08:31:22] [V] [TRT] Tactic: 8 time 0.011712 [03/13/2022-08:31:22] [V] [TRT] Tactic: 9 time 0.012468 [03/13/2022-08:31:22] [V] [TRT] Tactic: 28 time 0.015272 [03/13/2022-08:31:22] [V] [TRT] Fastest Tactic: 8 Time: 0.011712 [03/13/2022-08:31:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:31:22] [V] [TRT] [03/13/2022-08:31:22] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,6000) -> Float(1,40,1200:32,6000) *************** [03/13/2022-08:31:22] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_180, Mul_181) (PointWise) [03/13/2022-08:31:22] [V] [TRT] Tactic: 128 time 0.02138 [03/13/2022-08:31:22] [V] [TRT] Tactic: 256 time 0.021964 [03/13/2022-08:31:22] [V] [TRT] Tactic: 512 time 0.02358 [03/13/2022-08:31:22] [V] [TRT] Tactic: -32 time 0.034584 [03/13/2022-08:31:22] [V] [TRT] Tactic: -64 time 0.025384 [03/13/2022-08:31:22] [V] [TRT] Tactic: -128 time 0.022956 [03/13/2022-08:31:22] [V] [TRT] Fastest Tactic: 128 Time: 0.02138 [03/13/2022-08:31:22] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_180, Mul_181) (PointWiseV2) [03/13/2022-08:31:22] [V] [TRT] Tactic: 24 time 0.013664 [03/13/2022-08:31:22] [V] [TRT] Tactic: 25 time 0.014152 [03/13/2022-08:31:22] [V] [TRT] Tactic: 26 time 0.01452 [03/13/2022-08:31:22] [V] [TRT] Tactic: 27 time 0.01418 [03/13/2022-08:31:22] [V] [TRT] Tactic: 31 time 0.015064 [03/13/2022-08:31:22] [V] [TRT] Fastest Tactic: 24 Time: 0.013664 [03/13/2022-08:31:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [03/13/2022-08:31:22] [V] [TRT] [03/13/2022-08:31:22] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:31:22] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_180, Mul_181) (PointWise) [03/13/2022-08:31:22] [V] [TRT] Tactic: 128 time 0.0207 [03/13/2022-08:31:22] [V] [TRT] Tactic: 256 time 0.0188 [03/13/2022-08:31:22] [V] [TRT] Tactic: 512 time 0.018524 [03/13/2022-08:31:22] [V] [TRT] Tactic: -32 time 0.02832 [03/13/2022-08:31:22] [V] [TRT] Tactic: -64 time 0.023768 [03/13/2022-08:31:22] [V] [TRT] Tactic: -128 time 0.021252 [03/13/2022-08:31:22] [V] [TRT] Fastest Tactic: 512 Time: 0.018524 [03/13/2022-08:31:22] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_180, Mul_181) (PointWiseV2) [03/13/2022-08:31:22] [V] [TRT] Tactic: 0 time 0.012224 [03/13/2022-08:31:22] [V] [TRT] Tactic: 1 time 0.010044 [03/13/2022-08:31:22] [V] [TRT] Tactic: 2 time 0.009164 [03/13/2022-08:31:22] [V] [TRT] Tactic: 3 time 0.00882 [03/13/2022-08:31:22] [V] [TRT] Tactic: 4 time 0.008096 [03/13/2022-08:31:22] [V] [TRT] Tactic: 5 time 0.007984 [03/13/2022-08:31:22] [V] [TRT] Tactic: 6 time 0.008568 [03/13/2022-08:31:22] [V] [TRT] Tactic: 7 time 0.00768 [03/13/2022-08:31:22] [V] [TRT] Tactic: 8 time 0.00758 [03/13/2022-08:31:22] [V] [TRT] Tactic: 9 time 0.007296 [03/13/2022-08:31:22] [V] [TRT] Tactic: 28 time 0.011908 [03/13/2022-08:31:22] [V] [TRT] Fastest Tactic: 9 Time: 0.007296 [03/13/2022-08:31:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:22] [V] [TRT] [03/13/2022-08:31:22] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:31:22] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_180, Mul_181) (PointWise) [03/13/2022-08:31:22] [V] [TRT] Tactic: 128 time 0.020812 [03/13/2022-08:31:22] [V] [TRT] Tactic: 256 time 0.018484 [03/13/2022-08:31:22] [V] [TRT] Tactic: 512 time 0.018496 [03/13/2022-08:31:22] [V] [TRT] Tactic: -32 time 0.027592 [03/13/2022-08:31:22] [V] [TRT] Tactic: -64 time 0.023264 [03/13/2022-08:31:22] [V] [TRT] Tactic: -128 time 0.021128 [03/13/2022-08:31:22] [V] [TRT] Fastest Tactic: 256 Time: 0.018484 [03/13/2022-08:31:22] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_180, Mul_181) (PointWiseV2) [03/13/2022-08:31:22] [V] [TRT] Tactic: 0 time 0.009336 [03/13/2022-08:31:22] [V] [TRT] Tactic: 1 time 0.008816 [03/13/2022-08:31:22] [V] [TRT] Tactic: 2 time 0.009568 [03/13/2022-08:31:22] [V] [TRT] Tactic: 3 time 0.008124 [03/13/2022-08:31:22] [V] [TRT] Tactic: 4 time 0.009404 [03/13/2022-08:31:22] [V] [TRT] Tactic: 5 time 0.010436 [03/13/2022-08:31:22] [V] [TRT] Tactic: 6 time 0.008044 [03/13/2022-08:31:22] [V] [TRT] Tactic: 7 time 0.0084 [03/13/2022-08:31:22] [V] [TRT] Tactic: 8 time 0.009928 [03/13/2022-08:31:22] [V] [TRT] Tactic: 9 time 0.012452 [03/13/2022-08:31:22] [V] [TRT] Tactic: 10 time 0.014224 [03/13/2022-08:31:22] [V] [TRT] Tactic: 11 time 0.010704 [03/13/2022-08:31:22] [V] [TRT] Tactic: 12 time 0.010776 [03/13/2022-08:31:22] [V] [TRT] Tactic: 13 time 0.011784 [03/13/2022-08:31:22] [V] [TRT] Tactic: 14 time 0.009796 [03/13/2022-08:31:22] [V] [TRT] Tactic: 15 time 0.008744 [03/13/2022-08:31:22] [V] [TRT] Tactic: 16 time 0.009376 [03/13/2022-08:31:22] [V] [TRT] Tactic: 17 time 0.008544 [03/13/2022-08:31:22] [V] [TRT] Tactic: 18 time 0.008792 [03/13/2022-08:31:22] [V] [TRT] Tactic: 19 time 0.008288 [03/13/2022-08:31:22] [V] [TRT] Tactic: 28 time 0.010752 [03/13/2022-08:31:22] [V] [TRT] Tactic: 29 time 0.012212 [03/13/2022-08:31:22] [V] [TRT] Fastest Tactic: 6 Time: 0.008044 [03/13/2022-08:31:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [03/13/2022-08:31:22] [V] [TRT] [03/13/2022-08:31:22] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:31:22] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_180, Mul_181) (PointWise) [03/13/2022-08:31:22] [V] [TRT] Tactic: 128 time 0.021208 [03/13/2022-08:31:22] [V] [TRT] Tactic: 256 time 0.018488 [03/13/2022-08:31:22] [V] [TRT] Tactic: 512 time 0.018444 [03/13/2022-08:31:22] [V] [TRT] Tactic: -32 time 0.028376 [03/13/2022-08:31:22] [V] [TRT] Tactic: -64 time 0.02354 [03/13/2022-08:31:22] [V] [TRT] Tactic: -128 time 0.021188 [03/13/2022-08:31:22] [V] [TRT] Fastest Tactic: 512 Time: 0.018444 [03/13/2022-08:31:22] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_180, Mul_181) (PointWiseV2) [03/13/2022-08:31:22] [V] [TRT] Tactic: 0 time 0.0086 [03/13/2022-08:31:22] [V] [TRT] Tactic: 1 time 0.008128 [03/13/2022-08:31:22] [V] [TRT] Tactic: 2 time 0.010552 [03/13/2022-08:31:22] [V] [TRT] Tactic: 3 time 0.008384 [03/13/2022-08:31:22] [V] [TRT] Tactic: 4 time 0.009952 [03/13/2022-08:31:22] [V] [TRT] Tactic: 5 time 0.013248 [03/13/2022-08:31:22] [V] [TRT] Tactic: 6 time 0.01112 [03/13/2022-08:31:22] [V] [TRT] Tactic: 7 time 0.012488 [03/13/2022-08:31:22] [V] [TRT] Tactic: 8 time 0.013488 [03/13/2022-08:31:22] [V] [TRT] Tactic: 9 time 0.01808 [03/13/2022-08:31:22] [V] [TRT] Tactic: 10 time 0.009032 [03/13/2022-08:31:22] [V] [TRT] Tactic: 11 time 0.00812 [03/13/2022-08:31:22] [V] [TRT] Tactic: 12 time 0.008692 [03/13/2022-08:31:22] [V] [TRT] Tactic: 13 time 0.00798 [03/13/2022-08:31:22] [V] [TRT] Tactic: 14 time 0.008776 [03/13/2022-08:31:22] [V] [TRT] Tactic: 15 time 0.011444 [03/13/2022-08:31:22] [V] [TRT] Tactic: 16 time 0.008988 [03/13/2022-08:31:22] [V] [TRT] Tactic: 17 time 0.008716 [03/13/2022-08:31:22] [V] [TRT] Tactic: 18 time 0.011008 [03/13/2022-08:31:22] [V] [TRT] Tactic: 19 time 0.014544 [03/13/2022-08:31:22] [V] [TRT] Tactic: 20 time 0.009984 [03/13/2022-08:31:22] [V] [TRT] Tactic: 21 time 0.0089 [03/13/2022-08:31:22] [V] [TRT] Tactic: 22 time 0.007948 [03/13/2022-08:31:22] [V] [TRT] Tactic: 23 time 0.00806 [03/13/2022-08:31:22] [V] [TRT] Tactic: 24 time 0.012612 [03/13/2022-08:31:22] [V] [TRT] Tactic: 25 time 0.01018 [03/13/2022-08:31:23] [V] [TRT] Tactic: 26 time 0.009064 [03/13/2022-08:31:23] [V] [TRT] Tactic: 27 time 0.008396 [03/13/2022-08:31:23] [V] [TRT] Tactic: 28 time 0.008776 [03/13/2022-08:31:23] [V] [TRT] Tactic: 29 time 0.00898 [03/13/2022-08:31:23] [V] [TRT] Tactic: 30 time 0.009384 [03/13/2022-08:31:23] [V] [TRT] Tactic: 31 time 0.0123 [03/13/2022-08:31:23] [V] [TRT] Fastest Tactic: 22 Time: 0.007948 [03/13/2022-08:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 22 [03/13/2022-08:31:23] [V] [TRT] [03/13/2022-08:31:23] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:23] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:31:23] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:31:23] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:23] [V] [TRT] --------------- Timing Runner: Conv_182 (FusedConvActConvolution) [03/13/2022-08:31:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:23] [V] [TRT] --------------- Timing Runner: Conv_182 (CaskConvolution) [03/13/2022-08:31:23] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:23] [V] [TRT] --------------- Timing Runner: Conv_182 (CudaConvolution) [03/13/2022-08:31:23] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:23] [V] [TRT] --------------- Timing Runner: Conv_182 (CudaDepthwiseConvolution) [03/13/2022-08:31:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:23] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:31:23] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:31:23] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_184, Mul_185) (PointWise) [03/13/2022-08:31:23] [V] [TRT] Tactic: 128 time 0.02406 [03/13/2022-08:31:23] [V] [TRT] Tactic: 256 time 0.024564 [03/13/2022-08:31:23] [V] [TRT] Tactic: 512 time 0.026868 [03/13/2022-08:31:23] [V] [TRT] Tactic: -32 time 0.036032 [03/13/2022-08:31:23] [V] [TRT] Tactic: -64 time 0.025904 [03/13/2022-08:31:23] [V] [TRT] Tactic: -128 time 0.023784 [03/13/2022-08:31:23] [V] [TRT] Fastest Tactic: -128 Time: 0.023784 [03/13/2022-08:31:23] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_184, Mul_185) (PointWiseV2) [03/13/2022-08:31:23] [V] [TRT] Tactic: 0 time 0.016364 [03/13/2022-08:31:23] [V] [TRT] Tactic: 1 time 0.014504 [03/13/2022-08:31:23] [V] [TRT] Tactic: 2 time 0.013308 [03/13/2022-08:31:23] [V] [TRT] Tactic: 3 time 0.014748 [03/13/2022-08:31:23] [V] [TRT] Tactic: 4 time 0.013732 [03/13/2022-08:31:23] [V] [TRT] Tactic: 5 time 0.012104 [03/13/2022-08:31:23] [V] [TRT] Tactic: 6 time 0.014136 [03/13/2022-08:31:23] [V] [TRT] Tactic: 7 time 0.0129 [03/13/2022-08:31:23] [V] [TRT] Tactic: 8 time 0.012204 [03/13/2022-08:31:23] [V] [TRT] Tactic: 9 time 0.012576 [03/13/2022-08:31:23] [V] [TRT] Tactic: 28 time 0.016776 [03/13/2022-08:31:23] [V] [TRT] Fastest Tactic: 5 Time: 0.012104 [03/13/2022-08:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [03/13/2022-08:31:23] [V] [TRT] [03/13/2022-08:31:23] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,6000) -> Float(1,40,1200:32,12000) *************** [03/13/2022-08:31:23] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_184, Mul_185) (PointWise) [03/13/2022-08:31:23] [V] [TRT] Tactic: 128 time 0.024168 [03/13/2022-08:31:23] [V] [TRT] Tactic: 256 time 0.024344 [03/13/2022-08:31:23] [V] [TRT] Tactic: 512 time 0.026536 [03/13/2022-08:31:23] [V] [TRT] Tactic: -32 time 0.036016 [03/13/2022-08:31:23] [V] [TRT] Tactic: -64 time 0.025608 [03/13/2022-08:31:23] [V] [TRT] Tactic: -128 time 0.023512 [03/13/2022-08:31:23] [V] [TRT] Fastest Tactic: -128 Time: 0.023512 [03/13/2022-08:31:23] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_184, Mul_185) (PointWiseV2) [03/13/2022-08:31:23] [V] [TRT] Tactic: 24 time 0.015068 [03/13/2022-08:31:23] [V] [TRT] Tactic: 25 time 0.014996 [03/13/2022-08:31:23] [V] [TRT] Tactic: 26 time 0.014792 [03/13/2022-08:31:23] [V] [TRT] Tactic: 27 time 0.014348 [03/13/2022-08:31:23] [V] [TRT] Tactic: 31 time 0.014536 [03/13/2022-08:31:23] [V] [TRT] Fastest Tactic: 27 Time: 0.014348 [03/13/2022-08:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [03/13/2022-08:31:23] [V] [TRT] [03/13/2022-08:31:23] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:31:23] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_184, Mul_185) (PointWise) [03/13/2022-08:31:23] [V] [TRT] Tactic: 128 time 0.02208 [03/13/2022-08:31:23] [V] [TRT] Tactic: 256 time 0.019756 [03/13/2022-08:31:23] [V] [TRT] Tactic: 512 time 0.01888 [03/13/2022-08:31:23] [V] [TRT] Tactic: -32 time 0.028544 [03/13/2022-08:31:23] [V] [TRT] Tactic: -64 time 0.023768 [03/13/2022-08:31:23] [V] [TRT] Tactic: -128 time 0.021532 [03/13/2022-08:31:23] [V] [TRT] Fastest Tactic: 512 Time: 0.01888 [03/13/2022-08:31:23] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_184, Mul_185) (PointWiseV2) [03/13/2022-08:31:23] [V] [TRT] Tactic: 0 time 0.0134 [03/13/2022-08:31:23] [V] [TRT] Tactic: 1 time 0.010756 [03/13/2022-08:31:23] [V] [TRT] Tactic: 2 time 0.00986 [03/13/2022-08:31:23] [V] [TRT] Tactic: 3 time 0.009328 [03/13/2022-08:31:23] [V] [TRT] Tactic: 4 time 0.008872 [03/13/2022-08:31:23] [V] [TRT] Tactic: 5 time 0.008152 [03/13/2022-08:31:23] [V] [TRT] Tactic: 6 time 0.008856 [03/13/2022-08:31:23] [V] [TRT] Tactic: 7 time 0.008036 [03/13/2022-08:31:23] [V] [TRT] Tactic: 8 time 0.007888 [03/13/2022-08:31:23] [V] [TRT] Tactic: 9 time 0.007984 [03/13/2022-08:31:23] [V] [TRT] Tactic: 28 time 0.013496 [03/13/2022-08:31:23] [V] [TRT] Fastest Tactic: 8 Time: 0.007888 [03/13/2022-08:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:31:23] [V] [TRT] [03/13/2022-08:31:23] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:31:23] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_184, Mul_185) (PointWise) [03/13/2022-08:31:23] [V] [TRT] Tactic: 128 time 0.021948 [03/13/2022-08:31:23] [V] [TRT] Tactic: 256 time 0.01964 [03/13/2022-08:31:23] [V] [TRT] Tactic: 512 time 0.01924 [03/13/2022-08:31:23] [V] [TRT] Tactic: -32 time 0.02842 [03/13/2022-08:31:23] [V] [TRT] Tactic: -64 time 0.023916 [03/13/2022-08:31:23] [V] [TRT] Tactic: -128 time 0.021504 [03/13/2022-08:31:23] [V] [TRT] Fastest Tactic: 512 Time: 0.01924 [03/13/2022-08:31:23] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_184, Mul_185) (PointWiseV2) [03/13/2022-08:31:23] [V] [TRT] Tactic: 0 time 0.01022 [03/13/2022-08:31:23] [V] [TRT] Tactic: 1 time 0.009156 [03/13/2022-08:31:23] [V] [TRT] Tactic: 2 time 0.009924 [03/13/2022-08:31:23] [V] [TRT] Tactic: 3 time 0.008328 [03/13/2022-08:31:23] [V] [TRT] Tactic: 4 time 0.009548 [03/13/2022-08:31:23] [V] [TRT] Tactic: 5 time 0.010488 [03/13/2022-08:31:23] [V] [TRT] Tactic: 6 time 0.008128 [03/13/2022-08:31:23] [V] [TRT] Tactic: 7 time 0.008528 [03/13/2022-08:31:23] [V] [TRT] Tactic: 8 time 0.01004 [03/13/2022-08:31:23] [V] [TRT] Tactic: 9 time 0.01168 [03/13/2022-08:31:23] [V] [TRT] Tactic: 10 time 0.014088 [03/13/2022-08:31:23] [V] [TRT] Tactic: 11 time 0.014132 [03/13/2022-08:31:23] [V] [TRT] Tactic: 12 time 0.012816 [03/13/2022-08:31:23] [V] [TRT] Tactic: 13 time 0.012296 [03/13/2022-08:31:23] [V] [TRT] Tactic: 14 time 0.009504 [03/13/2022-08:31:23] [V] [TRT] Tactic: 15 time 0.009472 [03/13/2022-08:31:23] [V] [TRT] Tactic: 16 time 0.011844 [03/13/2022-08:31:23] [V] [TRT] Tactic: 17 time 0.0082 [03/13/2022-08:31:23] [V] [TRT] Tactic: 18 time 0.008088 [03/13/2022-08:31:23] [V] [TRT] Tactic: 19 time 0.008692 [03/13/2022-08:31:23] [V] [TRT] Tactic: 28 time 0.01026 [03/13/2022-08:31:23] [V] [TRT] Tactic: 29 time 0.013176 [03/13/2022-08:31:23] [V] [TRT] Fastest Tactic: 18 Time: 0.008088 [03/13/2022-08:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:31:23] [V] [TRT] [03/13/2022-08:31:23] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:31:23] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_184, Mul_185) (PointWise) [03/13/2022-08:31:23] [V] [TRT] Tactic: 128 time 0.02206 [03/13/2022-08:31:23] [V] [TRT] Tactic: 256 time 0.019564 [03/13/2022-08:31:23] [V] [TRT] Tactic: 512 time 0.019428 [03/13/2022-08:31:23] [V] [TRT] Tactic: -32 time 0.032552 [03/13/2022-08:31:23] [V] [TRT] Tactic: -64 time 0.027752 [03/13/2022-08:31:23] [V] [TRT] Tactic: -128 time 0.027188 [03/13/2022-08:31:23] [V] [TRT] Fastest Tactic: 512 Time: 0.019428 [03/13/2022-08:31:23] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_184, Mul_185) (PointWiseV2) [03/13/2022-08:31:23] [V] [TRT] Tactic: 0 time 0.010824 [03/13/2022-08:31:23] [V] [TRT] Tactic: 1 time 0.01214 [03/13/2022-08:31:23] [V] [TRT] Tactic: 2 time 0.0114 [03/13/2022-08:31:23] [V] [TRT] Tactic: 3 time 0.01428 [03/13/2022-08:31:23] [V] [TRT] Tactic: 4 time 0.013188 [03/13/2022-08:31:23] [V] [TRT] Tactic: 5 time 0.012024 [03/13/2022-08:31:23] [V] [TRT] Tactic: 6 time 0.019332 [03/13/2022-08:31:23] [V] [TRT] Tactic: 7 time 0.01566 [03/13/2022-08:31:23] [V] [TRT] Tactic: 8 time 0.014004 [03/13/2022-08:31:23] [V] [TRT] Tactic: 9 time 0.015076 [03/13/2022-08:31:23] [V] [TRT] Tactic: 10 time 0.012268 [03/13/2022-08:31:23] [V] [TRT] Tactic: 11 time 0.010944 [03/13/2022-08:31:23] [V] [TRT] Tactic: 12 time 0.011328 [03/13/2022-08:31:23] [V] [TRT] Tactic: 13 time 0.012128 [03/13/2022-08:31:23] [V] [TRT] Tactic: 14 time 0.012152 [03/13/2022-08:31:23] [V] [TRT] Tactic: 15 time 0.011892 [03/13/2022-08:31:23] [V] [TRT] Tactic: 16 time 0.014372 [03/13/2022-08:31:23] [V] [TRT] Tactic: 17 time 0.01372 [03/13/2022-08:31:23] [V] [TRT] Tactic: 18 time 0.013368 [03/13/2022-08:31:23] [V] [TRT] Tactic: 19 time 0.012776 [03/13/2022-08:31:23] [V] [TRT] Tactic: 20 time 0.012676 [03/13/2022-08:31:23] [V] [TRT] Tactic: 21 time 0.012128 [03/13/2022-08:31:23] [V] [TRT] Tactic: 22 time 0.010812 [03/13/2022-08:31:23] [V] [TRT] Tactic: 23 time 0.012404 [03/13/2022-08:31:23] [V] [TRT] Tactic: 24 time 0.014284 [03/13/2022-08:31:23] [V] [TRT] Tactic: 25 time 0.0126 [03/13/2022-08:31:23] [V] [TRT] Tactic: 26 time 0.01216 [03/13/2022-08:31:23] [V] [TRT] Tactic: 27 time 0.010348 [03/13/2022-08:31:23] [V] [TRT] Tactic: 28 time 0.009096 [03/13/2022-08:31:23] [V] [TRT] Tactic: 29 time 0.00928 [03/13/2022-08:31:23] [V] [TRT] Tactic: 30 time 0.01098 [03/13/2022-08:31:23] [V] [TRT] Tactic: 31 time 0.014012 [03/13/2022-08:31:23] [V] [TRT] Fastest Tactic: 28 Time: 0.009096 [03/13/2022-08:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [03/13/2022-08:31:23] [V] [TRT] [03/13/2022-08:31:23] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:31:23] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_188, Mul_189) (PointWise) [03/13/2022-08:31:23] [V] [TRT] Tactic: 128 time 0.023944 [03/13/2022-08:31:23] [V] [TRT] Tactic: 256 time 0.024228 [03/13/2022-08:31:23] [V] [TRT] Tactic: 512 time 0.026532 [03/13/2022-08:31:23] [V] [TRT] Tactic: -32 time 0.03588 [03/13/2022-08:31:23] [V] [TRT] Tactic: -64 time 0.025304 [03/13/2022-08:31:23] [V] [TRT] Tactic: -128 time 0.023392 [03/13/2022-08:31:23] [V] [TRT] Fastest Tactic: -128 Time: 0.023392 [03/13/2022-08:31:23] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_188, Mul_189) (PointWiseV2) [03/13/2022-08:31:23] [V] [TRT] Tactic: 0 time 0.01646 [03/13/2022-08:31:23] [V] [TRT] Tactic: 1 time 0.014644 [03/13/2022-08:31:23] [V] [TRT] Tactic: 2 time 0.013232 [03/13/2022-08:31:23] [V] [TRT] Tactic: 3 time 0.014828 [03/13/2022-08:31:23] [V] [TRT] Tactic: 4 time 0.013956 [03/13/2022-08:31:23] [V] [TRT] Tactic: 5 time 0.012828 [03/13/2022-08:31:23] [V] [TRT] Tactic: 6 time 0.01516 [03/13/2022-08:31:23] [V] [TRT] Tactic: 7 time 0.013696 [03/13/2022-08:31:23] [V] [TRT] Tactic: 8 time 0.0135 [03/13/2022-08:31:23] [V] [TRT] Tactic: 9 time 0.012768 [03/13/2022-08:31:24] [V] [TRT] Tactic: 28 time 0.016656 [03/13/2022-08:31:24] [V] [TRT] Fastest Tactic: 9 Time: 0.012768 [03/13/2022-08:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:24] [V] [TRT] [03/13/2022-08:31:24] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,12000) -> Float(1,40,1200:32,12000) *************** [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_188, Mul_189) (PointWise) [03/13/2022-08:31:24] [V] [TRT] Tactic: 128 time 0.024152 [03/13/2022-08:31:24] [V] [TRT] Tactic: 256 time 0.024136 [03/13/2022-08:31:24] [V] [TRT] Tactic: 512 time 0.026588 [03/13/2022-08:31:24] [V] [TRT] Tactic: -32 time 0.035852 [03/13/2022-08:31:24] [V] [TRT] Tactic: -64 time 0.025524 [03/13/2022-08:31:24] [V] [TRT] Tactic: -128 time 0.023604 [03/13/2022-08:31:24] [V] [TRT] Fastest Tactic: -128 Time: 0.023604 [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_188, Mul_189) (PointWiseV2) [03/13/2022-08:31:24] [V] [TRT] Tactic: 24 time 0.01456 [03/13/2022-08:31:24] [V] [TRT] Tactic: 25 time 0.014924 [03/13/2022-08:31:24] [V] [TRT] Tactic: 26 time 0.014744 [03/13/2022-08:31:24] [V] [TRT] Tactic: 27 time 0.014276 [03/13/2022-08:31:24] [V] [TRT] Tactic: 31 time 0.014668 [03/13/2022-08:31:24] [V] [TRT] Fastest Tactic: 27 Time: 0.014276 [03/13/2022-08:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [03/13/2022-08:31:24] [V] [TRT] [03/13/2022-08:31:24] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_188, Mul_189) (PointWise) [03/13/2022-08:31:24] [V] [TRT] Tactic: 128 time 0.021844 [03/13/2022-08:31:24] [V] [TRT] Tactic: 256 time 0.019324 [03/13/2022-08:31:24] [V] [TRT] Tactic: 512 time 0.019284 [03/13/2022-08:31:24] [V] [TRT] Tactic: -32 time 0.028604 [03/13/2022-08:31:24] [V] [TRT] Tactic: -64 time 0.023932 [03/13/2022-08:31:24] [V] [TRT] Tactic: -128 time 0.021572 [03/13/2022-08:31:24] [V] [TRT] Fastest Tactic: 512 Time: 0.019284 [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_188, Mul_189) (PointWiseV2) [03/13/2022-08:31:24] [V] [TRT] Tactic: 0 time 0.012944 [03/13/2022-08:31:24] [V] [TRT] Tactic: 1 time 0.010592 [03/13/2022-08:31:24] [V] [TRT] Tactic: 2 time 0.010068 [03/13/2022-08:31:24] [V] [TRT] Tactic: 3 time 0.00916 [03/13/2022-08:31:24] [V] [TRT] Tactic: 4 time 0.008696 [03/13/2022-08:31:24] [V] [TRT] Tactic: 5 time 0.008048 [03/13/2022-08:31:24] [V] [TRT] Tactic: 6 time 0.008612 [03/13/2022-08:31:24] [V] [TRT] Tactic: 7 time 0.0081 [03/13/2022-08:31:24] [V] [TRT] Tactic: 8 time 0.007752 [03/13/2022-08:31:24] [V] [TRT] Tactic: 9 time 0.007992 [03/13/2022-08:31:24] [V] [TRT] Tactic: 28 time 0.01332 [03/13/2022-08:31:24] [V] [TRT] Fastest Tactic: 8 Time: 0.007752 [03/13/2022-08:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:31:24] [V] [TRT] [03/13/2022-08:31:24] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_188, Mul_189) (PointWise) [03/13/2022-08:31:24] [V] [TRT] Tactic: 128 time 0.022132 [03/13/2022-08:31:24] [V] [TRT] Tactic: 256 time 0.019708 [03/13/2022-08:31:24] [V] [TRT] Tactic: 512 time 0.019372 [03/13/2022-08:31:24] [V] [TRT] Tactic: -32 time 0.02852 [03/13/2022-08:31:24] [V] [TRT] Tactic: -64 time 0.024052 [03/13/2022-08:31:24] [V] [TRT] Tactic: -128 time 0.021584 [03/13/2022-08:31:24] [V] [TRT] Fastest Tactic: 512 Time: 0.019372 [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_188, Mul_189) (PointWiseV2) [03/13/2022-08:31:24] [V] [TRT] Tactic: 0 time 0.010284 [03/13/2022-08:31:24] [V] [TRT] Tactic: 1 time 0.008876 [03/13/2022-08:31:24] [V] [TRT] Tactic: 2 time 0.009912 [03/13/2022-08:31:24] [V] [TRT] Tactic: 3 time 0.008596 [03/13/2022-08:31:24] [V] [TRT] Tactic: 4 time 0.010748 [03/13/2022-08:31:24] [V] [TRT] Tactic: 5 time 0.011244 [03/13/2022-08:31:24] [V] [TRT] Tactic: 6 time 0.008156 [03/13/2022-08:31:24] [V] [TRT] Tactic: 7 time 0.008536 [03/13/2022-08:31:24] [V] [TRT] Tactic: 8 time 0.010208 [03/13/2022-08:31:24] [V] [TRT] Tactic: 9 time 0.012744 [03/13/2022-08:31:24] [V] [TRT] Tactic: 10 time 0.013892 [03/13/2022-08:31:24] [V] [TRT] Tactic: 11 time 0.010728 [03/13/2022-08:31:24] [V] [TRT] Tactic: 12 time 0.010224 [03/13/2022-08:31:24] [V] [TRT] Tactic: 13 time 0.009296 [03/13/2022-08:31:24] [V] [TRT] Tactic: 14 time 0.009024 [03/13/2022-08:31:24] [V] [TRT] Tactic: 15 time 0.0087 [03/13/2022-08:31:24] [V] [TRT] Tactic: 16 time 0.008808 [03/13/2022-08:31:24] [V] [TRT] Tactic: 17 time 0.008192 [03/13/2022-08:31:24] [V] [TRT] Tactic: 18 time 0.008012 [03/13/2022-08:31:24] [V] [TRT] Tactic: 19 time 0.008156 [03/13/2022-08:31:24] [V] [TRT] Tactic: 28 time 0.010252 [03/13/2022-08:31:24] [V] [TRT] Tactic: 29 time 0.013488 [03/13/2022-08:31:24] [V] [TRT] Fastest Tactic: 18 Time: 0.008012 [03/13/2022-08:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:31:24] [V] [TRT] [03/13/2022-08:31:24] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_188, Mul_189) (PointWise) [03/13/2022-08:31:24] [V] [TRT] Tactic: 128 time 0.022388 [03/13/2022-08:31:24] [V] [TRT] Tactic: 256 time 0.020248 [03/13/2022-08:31:24] [V] [TRT] Tactic: 512 time 0.019956 [03/13/2022-08:31:24] [V] [TRT] Tactic: -32 time 0.033484 [03/13/2022-08:31:24] [V] [TRT] Tactic: -64 time 0.02822 [03/13/2022-08:31:24] [V] [TRT] Tactic: -128 time 0.027672 [03/13/2022-08:31:24] [V] [TRT] Fastest Tactic: 512 Time: 0.019956 [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_188, Mul_189) (PointWiseV2) [03/13/2022-08:31:24] [V] [TRT] Tactic: 0 time 0.011212 [03/13/2022-08:31:24] [V] [TRT] Tactic: 1 time 0.011896 [03/13/2022-08:31:24] [V] [TRT] Tactic: 2 time 0.01192 [03/13/2022-08:31:24] [V] [TRT] Tactic: 3 time 0.01426 [03/13/2022-08:31:24] [V] [TRT] Tactic: 4 time 0.013548 [03/13/2022-08:31:24] [V] [TRT] Tactic: 5 time 0.01208 [03/13/2022-08:31:24] [V] [TRT] Tactic: 6 time 0.019228 [03/13/2022-08:31:24] [V] [TRT] Tactic: 7 time 0.015904 [03/13/2022-08:31:24] [V] [TRT] Tactic: 8 time 0.014296 [03/13/2022-08:31:24] [V] [TRT] Tactic: 9 time 0.015508 [03/13/2022-08:31:24] [V] [TRT] Tactic: 10 time 0.013096 [03/13/2022-08:31:24] [V] [TRT] Tactic: 11 time 0.011128 [03/13/2022-08:31:24] [V] [TRT] Tactic: 12 time 0.0117 [03/13/2022-08:31:24] [V] [TRT] Tactic: 13 time 0.01232 [03/13/2022-08:31:24] [V] [TRT] Tactic: 14 time 0.012532 [03/13/2022-08:31:24] [V] [TRT] Tactic: 15 time 0.012204 [03/13/2022-08:31:24] [V] [TRT] Tactic: 16 time 0.014504 [03/13/2022-08:31:24] [V] [TRT] Tactic: 17 time 0.01316 [03/13/2022-08:31:24] [V] [TRT] Tactic: 18 time 0.013476 [03/13/2022-08:31:24] [V] [TRT] Tactic: 19 time 0.012856 [03/13/2022-08:31:24] [V] [TRT] Tactic: 20 time 0.013176 [03/13/2022-08:31:24] [V] [TRT] Tactic: 21 time 0.012804 [03/13/2022-08:31:24] [V] [TRT] Tactic: 22 time 0.011272 [03/13/2022-08:31:24] [V] [TRT] Tactic: 23 time 0.013024 [03/13/2022-08:31:24] [V] [TRT] Tactic: 24 time 0.015336 [03/13/2022-08:31:24] [V] [TRT] Tactic: 25 time 0.014388 [03/13/2022-08:31:24] [V] [TRT] Tactic: 26 time 0.0142 [03/13/2022-08:31:24] [V] [TRT] Tactic: 27 time 0.012496 [03/13/2022-08:31:24] [V] [TRT] Tactic: 28 time 0.009432 [03/13/2022-08:31:24] [V] [TRT] Tactic: 29 time 0.010232 [03/13/2022-08:31:24] [V] [TRT] Tactic: 30 time 0.012216 [03/13/2022-08:31:24] [V] [TRT] Tactic: 31 time 0.015252 [03/13/2022-08:31:24] [V] [TRT] Fastest Tactic: 28 Time: 0.009432 [03/13/2022-08:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [03/13/2022-08:31:24] [V] [TRT] [03/13/2022-08:31:24] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:31:24] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:31:24] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: Conv_191 (FusedConvActConvolution) [03/13/2022-08:31:24] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: Conv_191 (CaskConvolution) [03/13/2022-08:31:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: Conv_191 (CudaConvolution) [03/13/2022-08:31:24] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: Conv_191 (CudaDepthwiseConvolution) [03/13/2022-08:31:24] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:24] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:31:24] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: Conv_191 (FusedConvActConvolution) [03/13/2022-08:31:24] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: Conv_191 (CaskConvolution) [03/13/2022-08:31:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: Conv_191 (CudaConvolution) [03/13/2022-08:31:24] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: Conv_191 (CudaDepthwiseConvolution) [03/13/2022-08:31:24] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:24] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:31:24] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_193, Mul_194) (PointWise) [03/13/2022-08:31:24] [V] [TRT] Tactic: 128 time 0.036932 [03/13/2022-08:31:24] [V] [TRT] Tactic: 256 time 0.037372 [03/13/2022-08:31:24] [V] [TRT] Tactic: 512 time 0.042124 [03/13/2022-08:31:24] [V] [TRT] Tactic: -32 time 0.06272 [03/13/2022-08:31:24] [V] [TRT] Tactic: -64 time 0.041264 [03/13/2022-08:31:24] [V] [TRT] Tactic: -128 time 0.039292 [03/13/2022-08:31:24] [V] [TRT] Fastest Tactic: 128 Time: 0.036932 [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_193, Mul_194) (PointWiseV2) [03/13/2022-08:31:24] [V] [TRT] Tactic: 0 time 0.026984 [03/13/2022-08:31:24] [V] [TRT] Tactic: 1 time 0.023284 [03/13/2022-08:31:24] [V] [TRT] Tactic: 2 time 0.022576 [03/13/2022-08:31:24] [V] [TRT] Tactic: 3 time 0.023212 [03/13/2022-08:31:24] [V] [TRT] Tactic: 4 time 0.022596 [03/13/2022-08:31:24] [V] [TRT] Tactic: 5 time 0.022528 [03/13/2022-08:31:24] [V] [TRT] Tactic: 6 time 0.025072 [03/13/2022-08:31:24] [V] [TRT] Tactic: 7 time 0.023076 [03/13/2022-08:31:24] [V] [TRT] Tactic: 8 time 0.02252 [03/13/2022-08:31:24] [V] [TRT] Tactic: 9 time 0.022672 [03/13/2022-08:31:24] [V] [TRT] Tactic: 28 time 0.026896 [03/13/2022-08:31:24] [V] [TRT] Fastest Tactic: 8 Time: 0.02252 [03/13/2022-08:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:31:24] [V] [TRT] [03/13/2022-08:31:24] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,12000) -> Float(1,40,1200:32,12000) *************** [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_193, Mul_194) (PointWise) [03/13/2022-08:31:24] [V] [TRT] Tactic: 128 time 0.037092 [03/13/2022-08:31:24] [V] [TRT] Tactic: 256 time 0.037644 [03/13/2022-08:31:24] [V] [TRT] Tactic: 512 time 0.042048 [03/13/2022-08:31:24] [V] [TRT] Tactic: -32 time 0.064884 [03/13/2022-08:31:24] [V] [TRT] Tactic: -64 time 0.041176 [03/13/2022-08:31:24] [V] [TRT] Tactic: -128 time 0.039132 [03/13/2022-08:31:24] [V] [TRT] Fastest Tactic: 128 Time: 0.037092 [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_193, Mul_194) (PointWiseV2) [03/13/2022-08:31:24] [V] [TRT] Tactic: 24 time 0.02564 [03/13/2022-08:31:24] [V] [TRT] Tactic: 25 time 0.026348 [03/13/2022-08:31:24] [V] [TRT] Tactic: 26 time 0.026292 [03/13/2022-08:31:24] [V] [TRT] Tactic: 27 time 0.02542 [03/13/2022-08:31:24] [V] [TRT] Tactic: 31 time 0.02542 [03/13/2022-08:31:24] [V] [TRT] Fastest Tactic: 27 Time: 0.02542 [03/13/2022-08:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [03/13/2022-08:31:24] [V] [TRT] [03/13/2022-08:31:24] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_193, Mul_194) (PointWise) [03/13/2022-08:31:24] [V] [TRT] Tactic: 128 time 0.038752 [03/13/2022-08:31:24] [V] [TRT] Tactic: 256 time 0.034028 [03/13/2022-08:31:24] [V] [TRT] Tactic: 512 time 0.034436 [03/13/2022-08:31:24] [V] [TRT] Tactic: -32 time 0.056596 [03/13/2022-08:31:24] [V] [TRT] Tactic: -64 time 0.03894 [03/13/2022-08:31:24] [V] [TRT] Tactic: -128 time 0.037232 [03/13/2022-08:31:24] [V] [TRT] Fastest Tactic: 256 Time: 0.034028 [03/13/2022-08:31:24] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_193, Mul_194) (PointWiseV2) [03/13/2022-08:31:24] [V] [TRT] Tactic: 0 time 0.02576 [03/13/2022-08:31:24] [V] [TRT] Tactic: 1 time 0.021256 [03/13/2022-08:31:24] [V] [TRT] Tactic: 2 time 0.018248 [03/13/2022-08:31:24] [V] [TRT] Tactic: 3 time 0.019936 [03/13/2022-08:31:24] [V] [TRT] Tactic: 4 time 0.015464 [03/13/2022-08:31:24] [V] [TRT] Tactic: 5 time 0.014276 [03/13/2022-08:31:24] [V] [TRT] Tactic: 6 time 0.02058 [03/13/2022-08:31:24] [V] [TRT] Tactic: 7 time 0.015288 [03/13/2022-08:31:24] [V] [TRT] Tactic: 8 time 0.014024 [03/13/2022-08:31:24] [V] [TRT] Tactic: 9 time 0.013976 [03/13/2022-08:31:24] [V] [TRT] Tactic: 28 time 0.025588 [03/13/2022-08:31:24] [V] [TRT] Fastest Tactic: 9 Time: 0.013976 [03/13/2022-08:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:24] [V] [TRT] [03/13/2022-08:31:24] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:31:25] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_193, Mul_194) (PointWise) [03/13/2022-08:31:25] [V] [TRT] Tactic: 128 time 0.04904 [03/13/2022-08:31:25] [V] [TRT] Tactic: 256 time 0.042396 [03/13/2022-08:31:25] [V] [TRT] Tactic: 512 time 0.04248 [03/13/2022-08:31:25] [V] [TRT] Tactic: -32 time 0.070268 [03/13/2022-08:31:25] [V] [TRT] Tactic: -64 time 0.049156 [03/13/2022-08:31:25] [V] [TRT] Tactic: -128 time 0.047028 [03/13/2022-08:31:25] [V] [TRT] Fastest Tactic: 256 Time: 0.042396 [03/13/2022-08:31:25] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_193, Mul_194) (PointWiseV2) [03/13/2022-08:31:25] [V] [TRT] Tactic: 0 time 0.021892 [03/13/2022-08:31:25] [V] [TRT] Tactic: 1 time 0.019232 [03/13/2022-08:31:25] [V] [TRT] Tactic: 2 time 0.01948 [03/13/2022-08:31:25] [V] [TRT] Tactic: 3 time 0.019164 [03/13/2022-08:31:25] [V] [TRT] Tactic: 4 time 0.0195 [03/13/2022-08:31:25] [V] [TRT] Tactic: 5 time 0.020324 [03/13/2022-08:31:25] [V] [TRT] Tactic: 6 time 0.019284 [03/13/2022-08:31:25] [V] [TRT] Tactic: 7 time 0.019224 [03/13/2022-08:31:25] [V] [TRT] Tactic: 8 time 0.0205 [03/13/2022-08:31:25] [V] [TRT] Tactic: 9 time 0.023552 [03/13/2022-08:31:25] [V] [TRT] Tactic: 10 time 0.031736 [03/13/2022-08:31:25] [V] [TRT] Tactic: 11 time 0.026196 [03/13/2022-08:31:25] [V] [TRT] Tactic: 12 time 0.022684 [03/13/2022-08:31:25] [V] [TRT] Tactic: 13 time 0.023872 [03/13/2022-08:31:25] [V] [TRT] Tactic: 14 time 0.018624 [03/13/2022-08:31:25] [V] [TRT] Tactic: 15 time 0.017168 [03/13/2022-08:31:25] [V] [TRT] Tactic: 16 time 0.02432 [03/13/2022-08:31:25] [V] [TRT] Tactic: 17 time 0.018396 [03/13/2022-08:31:25] [V] [TRT] Tactic: 18 time 0.015412 [03/13/2022-08:31:25] [V] [TRT] Tactic: 19 time 0.016256 [03/13/2022-08:31:25] [V] [TRT] Tactic: 28 time 0.02156 [03/13/2022-08:31:25] [V] [TRT] Tactic: 29 time 0.0314 [03/13/2022-08:31:25] [V] [TRT] Fastest Tactic: 18 Time: 0.015412 [03/13/2022-08:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:31:25] [V] [TRT] [03/13/2022-08:31:25] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:31:25] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_193, Mul_194) (PointWise) [03/13/2022-08:31:25] [V] [TRT] Tactic: 128 time 0.048628 [03/13/2022-08:31:25] [V] [TRT] Tactic: 256 time 0.042564 [03/13/2022-08:31:25] [V] [TRT] Tactic: 512 time 0.042744 [03/13/2022-08:31:25] [V] [TRT] Tactic: -32 time 0.070072 [03/13/2022-08:31:25] [V] [TRT] Tactic: -64 time 0.049112 [03/13/2022-08:31:25] [V] [TRT] Tactic: -128 time 0.046892 [03/13/2022-08:31:25] [V] [TRT] Fastest Tactic: 256 Time: 0.042564 [03/13/2022-08:31:25] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_193, Mul_194) (PointWiseV2) [03/13/2022-08:31:25] [V] [TRT] Tactic: 0 time 0.015992 [03/13/2022-08:31:25] [V] [TRT] Tactic: 1 time 0.015476 [03/13/2022-08:31:25] [V] [TRT] Tactic: 2 time 0.01922 [03/13/2022-08:31:25] [V] [TRT] Tactic: 3 time 0.016104 [03/13/2022-08:31:25] [V] [TRT] Tactic: 4 time 0.020676 [03/13/2022-08:31:25] [V] [TRT] Tactic: 5 time 0.02776 [03/13/2022-08:31:25] [V] [TRT] Tactic: 6 time 0.018068 [03/13/2022-08:31:25] [V] [TRT] Tactic: 7 time 0.020584 [03/13/2022-08:31:25] [V] [TRT] Tactic: 8 time 0.027984 [03/13/2022-08:31:25] [V] [TRT] Tactic: 9 time 0.036516 [03/13/2022-08:31:25] [V] [TRT] Tactic: 10 time 0.017476 [03/13/2022-08:31:25] [V] [TRT] Tactic: 11 time 0.01604 [03/13/2022-08:31:25] [V] [TRT] Tactic: 12 time 0.017524 [03/13/2022-08:31:25] [V] [TRT] Tactic: 13 time 0.016088 [03/13/2022-08:31:25] [V] [TRT] Tactic: 14 time 0.016704 [03/13/2022-08:31:25] [V] [TRT] Tactic: 15 time 0.021472 [03/13/2022-08:31:25] [V] [TRT] Tactic: 16 time 0.01568 [03/13/2022-08:31:25] [V] [TRT] Tactic: 17 time 0.017084 [03/13/2022-08:31:25] [V] [TRT] Tactic: 18 time 0.0226 [03/13/2022-08:31:25] [V] [TRT] Tactic: 19 time 0.028612 [03/13/2022-08:31:25] [V] [TRT] Tactic: 20 time 0.022756 [03/13/2022-08:31:25] [V] [TRT] Tactic: 21 time 0.018948 [03/13/2022-08:31:25] [V] [TRT] Tactic: 22 time 0.019076 [03/13/2022-08:31:25] [V] [TRT] Tactic: 23 time 0.019124 [03/13/2022-08:31:25] [V] [TRT] Tactic: 24 time 0.031516 [03/13/2022-08:31:25] [V] [TRT] Tactic: 25 time 0.025612 [03/13/2022-08:31:25] [V] [TRT] Tactic: 26 time 0.023728 [03/13/2022-08:31:25] [V] [TRT] Tactic: 27 time 0.024452 [03/13/2022-08:31:25] [V] [TRT] Tactic: 28 time 0.01602 [03/13/2022-08:31:25] [V] [TRT] Tactic: 29 time 0.017408 [03/13/2022-08:31:25] [V] [TRT] Tactic: 30 time 0.022596 [03/13/2022-08:31:25] [V] [TRT] Tactic: 31 time 0.031252 [03/13/2022-08:31:25] [V] [TRT] Fastest Tactic: 1 Time: 0.015476 [03/13/2022-08:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [03/13/2022-08:31:25] [V] [TRT] [03/13/2022-08:31:25] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:25] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:31:25] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:25] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:25] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:25] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:25] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:25] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:25] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:25] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:25] [V] [TRT] --------------- Timing Runner: Conv_195 (FusedConvActConvolution) [03/13/2022-08:31:25] [V] [TRT] Tactic: 589823 time 0.329296 [03/13/2022-08:31:25] [V] [TRT] Tactic: 655359 time 0.170224 [03/13/2022-08:31:25] [V] [TRT] Tactic: 786431 time 0.186388 [03/13/2022-08:31:25] [V] [TRT] Tactic: 851967 time 0.170248 [03/13/2022-08:31:25] [V] [TRT] Tactic: 1179647 time 0.146972 [03/13/2022-08:31:25] [V] [TRT] Tactic: 1310719 time 0.199644 [03/13/2022-08:31:25] [V] [TRT] Tactic: 1376255 time 0.158028 [03/13/2022-08:31:25] [V] [TRT] Tactic: 1441791 time 0.182036 [03/13/2022-08:31:25] [V] [TRT] Tactic: 1507327 time 0.15512 [03/13/2022-08:31:25] [V] [TRT] Tactic: 1638399 time 0.174528 [03/13/2022-08:31:25] [V] [TRT] Tactic: 1835007 time 0.200464 [03/13/2022-08:31:25] [V] [TRT] Tactic: 1900543 time 0.203208 [03/13/2022-08:31:25] [V] [TRT] Tactic: 2097151 time 0.183208 [03/13/2022-08:31:25] [V] [TRT] Tactic: 2162687 time 0.162328 [03/13/2022-08:31:25] [V] [TRT] Tactic: 2293759 time 0.215108 [03/13/2022-08:31:25] [V] [TRT] Tactic: 2359295 time 0.151896 [03/13/2022-08:31:25] [V] [TRT] Tactic: 2686975 time 0.165956 [03/13/2022-08:31:25] [V] [TRT] Tactic: 3080191 time 0.159096 [03/13/2022-08:31:25] [V] [TRT] Tactic: 3342335 time 0.154928 [03/13/2022-08:31:25] [V] [TRT] Tactic: 3407871 time 0.151528 [03/13/2022-08:31:25] [V] [TRT] Tactic: 3538943 time 0.150452 [03/13/2022-08:31:25] [V] [TRT] Tactic: 3670015 time 0.225068 [03/13/2022-08:31:25] [V] [TRT] Tactic: 3932159 time 0.14714 [03/13/2022-08:31:25] [V] [TRT] Tactic: 3997695 time 0.143064 [03/13/2022-08:31:25] [V] [TRT] Tactic: 4063231 time 0.136284 [03/13/2022-08:31:25] [V] [TRT] Tactic: 4194303 time 0.145704 [03/13/2022-08:31:25] [V] [TRT] Tactic: 4259839 time 0.139664 [03/13/2022-08:31:25] [V] [TRT] Tactic: 4325375 time 0.135248 [03/13/2022-08:31:25] [V] [TRT] Tactic: 4521983 time 0.152892 [03/13/2022-08:31:25] [V] [TRT] Tactic: 4587519 time 0.14474 [03/13/2022-08:31:25] [V] [TRT] Tactic: 4653055 time 0.117076 [03/13/2022-08:31:25] [V] [TRT] Tactic: 4915199 time 0.14218 [03/13/2022-08:31:25] [V] [TRT] Tactic: 4980735 time 0.142852 [03/13/2022-08:31:25] [V] [TRT] Tactic: 5177343 time 0.141296 [03/13/2022-08:31:25] [V] [TRT] Tactic: 5242879 time 0.134292 [03/13/2022-08:31:25] [V] [TRT] Tactic: 5373951 time 0.18638 [03/13/2022-08:31:26] [V] [TRT] Tactic: 5439487 time 0.235876 [03/13/2022-08:31:26] [V] [TRT] Tactic: 5570559 time 0.14056 [03/13/2022-08:31:26] [V] [TRT] Tactic: 5636095 time 0.131196 [03/13/2022-08:31:26] [V] [TRT] Tactic: 5701631 time 0.178568 [03/13/2022-08:31:26] [V] [TRT] Tactic: 5767167 time 0.392976 [03/13/2022-08:31:26] [V] [TRT] Tactic: 5832703 time 0.118112 [03/13/2022-08:31:26] [V] [TRT] Tactic: 5898239 time 0.117144 [03/13/2022-08:31:26] [V] [TRT] Tactic: 6029311 time 0.176328 [03/13/2022-08:31:26] [V] [TRT] Tactic: 6225919 time 0.129552 [03/13/2022-08:31:26] [V] [TRT] Tactic: 6291455 time 0.1158 [03/13/2022-08:31:26] [V] [TRT] Tactic: 6422527 time 0.13814 [03/13/2022-08:31:26] [V] [TRT] Tactic: 6750207 time 0.163112 [03/13/2022-08:31:26] [V] [TRT] Tactic: 6815743 time 0.170096 [03/13/2022-08:31:26] [V] [TRT] Tactic: 6946815 time 0.203948 [03/13/2022-08:31:26] [V] [TRT] Tactic: 7012351 time 0.143268 [03/13/2022-08:31:26] [V] [TRT] Tactic: 7077887 time 0.107744 [03/13/2022-08:31:26] [V] [TRT] Tactic: 7143423 time 0.232284 [03/13/2022-08:31:26] [V] [TRT] Tactic: 7208959 time 0.128912 [03/13/2022-08:31:26] [V] [TRT] Tactic: 7340031 time 0.12402 [03/13/2022-08:31:26] [V] [TRT] Tactic: 7405567 time 0.120104 [03/13/2022-08:31:26] [V] [TRT] Tactic: 7536639 time 0.221732 [03/13/2022-08:31:26] [V] [TRT] Tactic: 7602175 time 0.140916 [03/13/2022-08:31:26] [V] [TRT] Tactic: 7733247 time 0.115452 [03/13/2022-08:31:26] [V] [TRT] Tactic: 7798783 time 0.146604 [03/13/2022-08:31:26] [V] [TRT] Tactic: 8191999 time 0.170136 [03/13/2022-08:31:26] [V] [TRT] Tactic: 8257535 time 0.146516 [03/13/2022-08:31:26] [V] [TRT] Tactic: 8323071 time 0.158932 [03/13/2022-08:31:26] [V] [TRT] Tactic: 8650751 time 0.167448 [03/13/2022-08:31:26] [V] [TRT] Tactic: 8716287 time 0.175476 [03/13/2022-08:31:26] [V] [TRT] Tactic: 9109503 time 0.154904 [03/13/2022-08:31:26] [V] [TRT] Tactic: 9568255 time 0.136728 [03/13/2022-08:31:26] [V] [TRT] Tactic: 9895935 time 0.139516 [03/13/2022-08:31:26] [V] [TRT] Tactic: 10223615 time 0.132456 [03/13/2022-08:31:26] [V] [TRT] Tactic: 10354687 time 0.133804 [03/13/2022-08:31:26] [V] [TRT] Tactic: 10551295 time 0.17348 [03/13/2022-08:31:26] [V] [TRT] Tactic: 10747903 time 0.109744 [03/13/2022-08:31:26] [V] [TRT] Tactic: 10944511 time 0.137724 [03/13/2022-08:31:26] [V] [TRT] Fastest Tactic: 7077887 Time: 0.107744 [03/13/2022-08:31:26] [V] [TRT] --------------- Timing Runner: Conv_195 (CaskConvolution) [03/13/2022-08:31:26] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Tactic: 1754569683116234317 time 0.107252 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Tactic: 1825138533642645384 time 0.106896 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Tactic: 2733356012094739613 time 0.068368 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Tactic: 3915320020053085238 time 0.106936 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Tactic: 6808617066150061604 time 0.08774 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Tactic: 9091006216302412844 time 0.08326 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Tactic: -8060443123034038864 time 0.0892 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Tactic: -4420849921117327522 time 0.076488 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Tactic: -3946921629105938337 time 0.071788 [03/13/2022-08:31:26] [V] [TRT] Fastest Tactic: 2733356012094739613 Time: 0.068368 [03/13/2022-08:31:26] [V] [TRT] --------------- Timing Runner: Conv_195 (CudaConvolution) [03/13/2022-08:31:26] [V] [TRT] Tactic: 0 time 0.122424 [03/13/2022-08:31:26] [V] [TRT] Tactic: 2 time 0.236792 [03/13/2022-08:31:26] [V] [TRT] Tactic: 5 time 0.355048 [03/13/2022-08:31:26] [V] [TRT] Tactic: 57 time 0.09552 [03/13/2022-08:31:26] [V] [TRT] Fastest Tactic: 57 Time: 0.09552 [03/13/2022-08:31:26] [V] [TRT] --------------- Timing Runner: Conv_195 (CudaDepthwiseConvolution) [03/13/2022-08:31:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2733356012094739613 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:26] [V] [TRT] [03/13/2022-08:31:26] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:26] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:31:26] [V] [TRT] --------------- Timing Runner: Conv_195 (FusedConvActConvolution) [03/13/2022-08:31:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:26] [V] [TRT] --------------- Timing Runner: Conv_195 (CaskConvolution) [03/13/2022-08:31:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:26] [V] [TRT] --------------- Timing Runner: Conv_195 (CudaConvolution) [03/13/2022-08:31:26] [V] [TRT] Tactic: 0 time 0.12508 [03/13/2022-08:31:26] [V] [TRT] Tactic: 1 time 0.093704 [03/13/2022-08:31:26] [V] [TRT] Tactic: 2 time 0.22938 [03/13/2022-08:31:26] [V] [TRT] Tactic: 4 skipped. Scratch requested: 1741168640, available: 16777216 [03/13/2022-08:31:26] [V] [TRT] Tactic: 5 time 0.341936 [03/13/2022-08:31:26] [V] [TRT] Fastest Tactic: 1 Time: 0.093704 [03/13/2022-08:31:26] [V] [TRT] --------------- Timing Runner: Conv_195 (CudaDepthwiseConvolution) [03/13/2022-08:31:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:31:26] [V] [TRT] [03/13/2022-08:31:26] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:31:26] [V] [TRT] --------------- Timing Runner: Conv_195 (FusedConvActConvolution) [03/13/2022-08:31:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:26] [V] [TRT] --------------- Timing Runner: Conv_195 (CaskConvolution) [03/13/2022-08:31:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:26] [V] [TRT] --------------- Timing Runner: Conv_195 (CudaConvolution) [03/13/2022-08:31:26] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:26] [V] [TRT] --------------- Timing Runner: Conv_195 (CudaDepthwiseConvolution) [03/13/2022-08:31:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:26] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:31:26] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:26] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:26] [V] [TRT] --------------- Timing Runner: Conv_195 (FusedConvActConvolution) [03/13/2022-08:31:26] [V] [TRT] Tactic: 589823 time 0.125604 [03/13/2022-08:31:26] [V] [TRT] Tactic: 655359 time 0.067872 [03/13/2022-08:31:26] [V] [TRT] Tactic: 786431 time 0.080004 [03/13/2022-08:31:26] [V] [TRT] Tactic: 851967 time 0.076128 [03/13/2022-08:31:26] [V] [TRT] Tactic: 1179647 time 0.063052 [03/13/2022-08:31:26] [V] [TRT] Tactic: 1310719 time 0.080896 [03/13/2022-08:31:26] [V] [TRT] Tactic: 1376255 time 0.067316 [03/13/2022-08:31:26] [V] [TRT] Tactic: 1441791 time 0.07608 [03/13/2022-08:31:26] [V] [TRT] Tactic: 1507327 time 0.06428 [03/13/2022-08:31:26] [V] [TRT] Tactic: 1638399 time 0.074984 [03/13/2022-08:31:26] [V] [TRT] Tactic: 1835007 time 0.083528 [03/13/2022-08:31:26] [V] [TRT] Tactic: 1900543 time 0.081772 [03/13/2022-08:31:26] [V] [TRT] Tactic: 2097151 time 0.083832 [03/13/2022-08:31:26] [V] [TRT] Tactic: 2162687 time 0.068036 [03/13/2022-08:31:26] [V] [TRT] Tactic: 2293759 time 0.085952 [03/13/2022-08:31:26] [V] [TRT] Tactic: 2359295 time 0.06018 [03/13/2022-08:31:26] [V] [TRT] Tactic: 2686975 time 0.068676 [03/13/2022-08:31:26] [V] [TRT] Tactic: 3080191 time 0.068444 [03/13/2022-08:31:26] [V] [TRT] Tactic: 3342335 time 0.064136 [03/13/2022-08:31:26] [V] [TRT] Tactic: 3407871 time 0.063152 [03/13/2022-08:31:26] [V] [TRT] Tactic: 3538943 time 0.061628 [03/13/2022-08:31:26] [V] [TRT] Tactic: 3670015 time 0.096072 [03/13/2022-08:31:26] [V] [TRT] Tactic: 3932159 time 0.0696 [03/13/2022-08:31:26] [V] [TRT] Tactic: 3997695 time 0.0759 [03/13/2022-08:31:26] [V] [TRT] Tactic: 4063231 time 0.073988 [03/13/2022-08:31:26] [V] [TRT] Tactic: 4194303 time 0.082104 [03/13/2022-08:31:26] [V] [TRT] Tactic: 4259839 time 0.074488 [03/13/2022-08:31:26] [V] [TRT] Tactic: 4325375 time 0.070088 [03/13/2022-08:31:26] [V] [TRT] Tactic: 4521983 time 0.075716 [03/13/2022-08:31:26] [V] [TRT] Tactic: 4587519 time 0.0784 [03/13/2022-08:31:26] [V] [TRT] Tactic: 4653055 time 0.064336 [03/13/2022-08:31:26] [V] [TRT] Tactic: 4915199 time 0.077168 [03/13/2022-08:31:26] [V] [TRT] Tactic: 4980735 time 0.071368 [03/13/2022-08:31:26] [V] [TRT] Tactic: 5177343 time 0.072392 [03/13/2022-08:31:26] [V] [TRT] Tactic: 5242879 time 0.06378 [03/13/2022-08:31:26] [V] [TRT] Tactic: 5373951 time 0.087796 [03/13/2022-08:31:27] [V] [TRT] Tactic: 5439487 time 0.115924 [03/13/2022-08:31:27] [V] [TRT] Tactic: 5570559 time 0.073708 [03/13/2022-08:31:27] [V] [TRT] Tactic: 5636095 time 0.074284 [03/13/2022-08:31:27] [V] [TRT] Tactic: 5701631 time 0.083696 [03/13/2022-08:31:27] [V] [TRT] Tactic: 5767167 time 0.193272 [03/13/2022-08:31:27] [V] [TRT] Tactic: 5832703 time 0.060088 [03/13/2022-08:31:27] [V] [TRT] Tactic: 5898239 time 0.063256 [03/13/2022-08:31:27] [V] [TRT] Tactic: 6029311 time 0.089012 [03/13/2022-08:31:27] [V] [TRT] Tactic: 6225919 time 0.065228 [03/13/2022-08:31:27] [V] [TRT] Tactic: 6291455 time 0.0632 [03/13/2022-08:31:27] [V] [TRT] Tactic: 6422527 time 0.0698 [03/13/2022-08:31:27] [V] [TRT] Tactic: 6750207 time 0.083168 [03/13/2022-08:31:27] [V] [TRT] Tactic: 6815743 time 0.085756 [03/13/2022-08:31:27] [V] [TRT] Tactic: 6946815 time 0.103328 [03/13/2022-08:31:27] [V] [TRT] Tactic: 7012351 time 0.083412 [03/13/2022-08:31:27] [V] [TRT] Tactic: 7077887 time 0.055608 [03/13/2022-08:31:27] [V] [TRT] Tactic: 7143423 time 0.12112 [03/13/2022-08:31:27] [V] [TRT] Tactic: 7208959 time 0.066372 [03/13/2022-08:31:27] [V] [TRT] Tactic: 7340031 time 0.066516 [03/13/2022-08:31:27] [V] [TRT] Tactic: 7405567 time 0.065028 [03/13/2022-08:31:27] [V] [TRT] Tactic: 7536639 time 0.1134 [03/13/2022-08:31:27] [V] [TRT] Tactic: 7602175 time 0.075232 [03/13/2022-08:31:27] [V] [TRT] Tactic: 7733247 time 0.06068 [03/13/2022-08:31:27] [V] [TRT] Tactic: 7798783 time 0.079776 [03/13/2022-08:31:27] [V] [TRT] Tactic: 8191999 time 0.089576 [03/13/2022-08:31:27] [V] [TRT] Tactic: 8257535 time 0.07916 [03/13/2022-08:31:27] [V] [TRT] Tactic: 8323071 time 0.082152 [03/13/2022-08:31:27] [V] [TRT] Tactic: 8650751 time 0.08676 [03/13/2022-08:31:27] [V] [TRT] Tactic: 8716287 time 0.0875 [03/13/2022-08:31:27] [V] [TRT] Tactic: 9109503 time 0.088696 [03/13/2022-08:31:27] [V] [TRT] Tactic: 9568255 time 0.077088 [03/13/2022-08:31:27] [V] [TRT] Tactic: 9895935 time 0.082204 [03/13/2022-08:31:27] [V] [TRT] Tactic: 10223615 time 0.06888 [03/13/2022-08:31:27] [V] [TRT] Tactic: 10354687 time 0.073328 [03/13/2022-08:31:27] [V] [TRT] Tactic: 10551295 time 0.08736 [03/13/2022-08:31:27] [V] [TRT] Tactic: 10747903 time 0.05746 [03/13/2022-08:31:27] [V] [TRT] Tactic: 10944511 time 0.071932 [03/13/2022-08:31:27] [V] [TRT] Fastest Tactic: 7077887 Time: 0.055608 [03/13/2022-08:31:27] [V] [TRT] --------------- Timing Runner: Conv_195 (CaskConvolution) [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: 1651411198763708804 time 0.047136 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: 2418518597804310654 time 0.04762 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: 4318470497547290900 time 0.046864 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: 4930470141256631146 time 0.03674 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: 8292881859266835088 time 0.04834 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: 8401509141903434922 time 0.046784 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -8654297089785671176 time 0.059668 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -7516584506774355935 time 0.035356 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -7140760933967189247 time 0.045928 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -6004726995029373073 time 0.03632 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -5719726816705110014 time 0.059712 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -4097850214384059472 time 0.035348 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -3717489476759089008 time 0.04578 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -3689982367035295496 time 0.059872 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -2640575123064142123 time 0.05752 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -2534402059426524406 time 0.057604 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -2027588946874785071 time 0.035508 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -1968398013367819764 time 0.059952 [03/13/2022-08:31:27] [V] [TRT] Fastest Tactic: -4097850214384059472 Time: 0.035348 [03/13/2022-08:31:27] [V] [TRT] --------------- Timing Runner: Conv_195 (CudaConvolution) [03/13/2022-08:31:27] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:27] [V] [TRT] --------------- Timing Runner: Conv_195 (CudaDepthwiseConvolution) [03/13/2022-08:31:27] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4097850214384059472 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:27] [V] [TRT] [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:27] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:27] [V] [TRT] --------------- Timing Runner: Conv_195 (FusedConvActConvolution) [03/13/2022-08:31:27] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:27] [V] [TRT] --------------- Timing Runner: Conv_195 (CaskConvolution) [03/13/2022-08:31:27] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:27] [V] [TRT] --------------- Timing Runner: Conv_195 (CudaConvolution) [03/13/2022-08:31:27] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:27] [V] [TRT] --------------- Timing Runner: Conv_195 (CudaDepthwiseConvolution) [03/13/2022-08:31:27] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:27] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:31:27] [V] [TRT] Conv_195 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] --------------- Timing Runner: Conv_195 (FusedConvActConvolution) [03/13/2022-08:31:27] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:27] [V] [TRT] --------------- Timing Runner: Conv_195 (CaskConvolution) [03/13/2022-08:31:27] [V] [TRT] Conv_195 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:27] [V] [TRT] Tactic: 9576651994278528 time 0.19462 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: 1179757074518529353 time 0.43866 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: 2105695814191699972 time 0.804748 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: 2148106709480872763 time 0.434292 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: 2410442691266548717 time 0.43632 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: 3041642431972138763 time 0.434756 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: 3754069740140581927 time 0.80504 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: 4555462412611657028 time 0.434192 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: 5666160310350604399 time 0.804916 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:27] [V] [TRT] Tactic: 5876997871499382316 time 0.405136 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: 5925270497649423688 time 0.803236 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: 6680916730816870145 time 0.80674 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: 7158029511300006471 time 0.804988 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: 7859952145590271433 time 0.806484 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: 8283847742354150423 time 0.805396 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -8992262742606384444 time 0.434416 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -8391760416076885205 time 0.803488 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -6273232454637933930 time 0.439348 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:27] [V] [TRT] Tactic: -5925110308892264213 time 0.404184 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -5818527483287834165 time 0.439104 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:27] [V] [TRT] Tactic: -4908848143422991657 time 0.19548 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -4534876761957424274 time 0.803484 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -3237051169894153788 time 0.804976 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -3136088851200285532 time 0.435116 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -2586046817576862066 time 0.436404 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -2422160065350346448 time 0.8061 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -1216445540764179377 time 0.435908 [03/13/2022-08:31:27] [V] [TRT] Conv_195 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:27] [V] [TRT] Tactic: -229563042944049199 time 0.434952 [03/13/2022-08:31:27] [V] [TRT] Fastest Tactic: 9576651994278528 Time: 0.19462 [03/13/2022-08:31:27] [V] [TRT] --------------- Timing Runner: Conv_195 (CudaConvolution) [03/13/2022-08:31:27] [V] [TRT] Tactic: 0 time 0.204756 [03/13/2022-08:31:27] [V] [TRT] Tactic: 1 time 0.110772 [03/13/2022-08:31:27] [V] [TRT] Tactic: 2 time 0.258168 [03/13/2022-08:31:27] [V] [TRT] Fastest Tactic: 1 Time: 0.110772 [03/13/2022-08:31:27] [V] [TRT] --------------- Timing Runner: Conv_195 (CudaDepthwiseConvolution) [03/13/2022-08:31:27] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:31:27] [V] [TRT] [03/13/2022-08:31:27] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:27] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_196, Mul_197) (PointWise) [03/13/2022-08:31:27] [V] [TRT] Tactic: 128 time 0.021512 [03/13/2022-08:31:27] [V] [TRT] Tactic: 256 time 0.021656 [03/13/2022-08:31:27] [V] [TRT] Tactic: 512 time 0.023844 [03/13/2022-08:31:27] [V] [TRT] Tactic: -32 time 0.03568 [03/13/2022-08:31:27] [V] [TRT] Tactic: -64 time 0.025348 [03/13/2022-08:31:27] [V] [TRT] Tactic: -128 time 0.023224 [03/13/2022-08:31:27] [V] [TRT] Fastest Tactic: 128 Time: 0.021512 [03/13/2022-08:31:27] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_196, Mul_197) (PointWiseV2) [03/13/2022-08:31:27] [V] [TRT] Tactic: 0 time 0.016308 [03/13/2022-08:31:27] [V] [TRT] Tactic: 1 time 0.014336 [03/13/2022-08:31:27] [V] [TRT] Tactic: 2 time 0.013808 [03/13/2022-08:31:27] [V] [TRT] Tactic: 3 time 0.014768 [03/13/2022-08:31:27] [V] [TRT] Tactic: 4 time 0.013868 [03/13/2022-08:31:28] [V] [TRT] Tactic: 5 time 0.013628 [03/13/2022-08:31:28] [V] [TRT] Tactic: 6 time 0.015064 [03/13/2022-08:31:28] [V] [TRT] Tactic: 7 time 0.0137 [03/13/2022-08:31:28] [V] [TRT] Tactic: 8 time 0.013416 [03/13/2022-08:31:28] [V] [TRT] Tactic: 9 time 0.01264 [03/13/2022-08:31:28] [V] [TRT] Tactic: 28 time 0.015936 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 9 Time: 0.01264 [03/13/2022-08:31:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:28] [V] [TRT] [03/13/2022-08:31:28] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,6000) -> Float(1,40,1200:32,6000) *************** [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_196, Mul_197) (PointWise) [03/13/2022-08:31:28] [V] [TRT] Tactic: 128 time 0.021172 [03/13/2022-08:31:28] [V] [TRT] Tactic: 256 time 0.0215 [03/13/2022-08:31:28] [V] [TRT] Tactic: 512 time 0.024032 [03/13/2022-08:31:28] [V] [TRT] Tactic: -32 time 0.035644 [03/13/2022-08:31:28] [V] [TRT] Tactic: -64 time 0.025628 [03/13/2022-08:31:28] [V] [TRT] Tactic: -128 time 0.023448 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 128 Time: 0.021172 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_196, Mul_197) (PointWiseV2) [03/13/2022-08:31:28] [V] [TRT] Tactic: 24 time 0.014652 [03/13/2022-08:31:28] [V] [TRT] Tactic: 25 time 0.014908 [03/13/2022-08:31:28] [V] [TRT] Tactic: 26 time 0.01448 [03/13/2022-08:31:28] [V] [TRT] Tactic: 27 time 0.014248 [03/13/2022-08:31:28] [V] [TRT] Tactic: 31 time 0.014832 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 27 Time: 0.014248 [03/13/2022-08:31:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [03/13/2022-08:31:28] [V] [TRT] [03/13/2022-08:31:28] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_196, Mul_197) (PointWise) [03/13/2022-08:31:28] [V] [TRT] Tactic: 128 time 0.020976 [03/13/2022-08:31:28] [V] [TRT] Tactic: 256 time 0.018824 [03/13/2022-08:31:28] [V] [TRT] Tactic: 512 time 0.018676 [03/13/2022-08:31:28] [V] [TRT] Tactic: -32 time 0.028388 [03/13/2022-08:31:28] [V] [TRT] Tactic: -64 time 0.02326 [03/13/2022-08:31:28] [V] [TRT] Tactic: -128 time 0.02098 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 512 Time: 0.018676 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_196, Mul_197) (PointWiseV2) [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.011896 [03/13/2022-08:31:28] [V] [TRT] Tactic: 1 time 0.009948 [03/13/2022-08:31:28] [V] [TRT] Tactic: 2 time 0.008792 [03/13/2022-08:31:28] [V] [TRT] Tactic: 3 time 0.008696 [03/13/2022-08:31:28] [V] [TRT] Tactic: 4 time 0.008108 [03/13/2022-08:31:28] [V] [TRT] Tactic: 5 time 0.00792 [03/13/2022-08:31:28] [V] [TRT] Tactic: 6 time 0.00844 [03/13/2022-08:31:28] [V] [TRT] Tactic: 7 time 0.007788 [03/13/2022-08:31:28] [V] [TRT] Tactic: 8 time 0.00742 [03/13/2022-08:31:28] [V] [TRT] Tactic: 9 time 0.007268 [03/13/2022-08:31:28] [V] [TRT] Tactic: 28 time 0.011604 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 9 Time: 0.007268 [03/13/2022-08:31:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:28] [V] [TRT] [03/13/2022-08:31:28] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_196, Mul_197) (PointWise) [03/13/2022-08:31:28] [V] [TRT] Tactic: 128 time 0.020972 [03/13/2022-08:31:28] [V] [TRT] Tactic: 256 time 0.018584 [03/13/2022-08:31:28] [V] [TRT] Tactic: 512 time 0.01864 [03/13/2022-08:31:28] [V] [TRT] Tactic: -32 time 0.028384 [03/13/2022-08:31:28] [V] [TRT] Tactic: -64 time 0.023596 [03/13/2022-08:31:28] [V] [TRT] Tactic: -128 time 0.021044 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 256 Time: 0.018584 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_196, Mul_197) (PointWiseV2) [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.009132 [03/13/2022-08:31:28] [V] [TRT] Tactic: 1 time 0.008352 [03/13/2022-08:31:28] [V] [TRT] Tactic: 2 time 0.009476 [03/13/2022-08:31:28] [V] [TRT] Tactic: 3 time 0.008132 [03/13/2022-08:31:28] [V] [TRT] Tactic: 4 time 0.009208 [03/13/2022-08:31:28] [V] [TRT] Tactic: 5 time 0.010392 [03/13/2022-08:31:28] [V] [TRT] Tactic: 6 time 0.007852 [03/13/2022-08:31:28] [V] [TRT] Tactic: 7 time 0.008656 [03/13/2022-08:31:28] [V] [TRT] Tactic: 8 time 0.009828 [03/13/2022-08:31:28] [V] [TRT] Tactic: 9 time 0.01254 [03/13/2022-08:31:28] [V] [TRT] Tactic: 10 time 0.01248 [03/13/2022-08:31:28] [V] [TRT] Tactic: 11 time 0.01018 [03/13/2022-08:31:28] [V] [TRT] Tactic: 12 time 0.009408 [03/13/2022-08:31:28] [V] [TRT] Tactic: 13 time 0.00918 [03/13/2022-08:31:28] [V] [TRT] Tactic: 14 time 0.008428 [03/13/2022-08:31:28] [V] [TRT] Tactic: 15 time 0.008232 [03/13/2022-08:31:28] [V] [TRT] Tactic: 16 time 0.008268 [03/13/2022-08:31:28] [V] [TRT] Tactic: 17 time 0.00804 [03/13/2022-08:31:28] [V] [TRT] Tactic: 18 time 0.007932 [03/13/2022-08:31:28] [V] [TRT] Tactic: 19 time 0.008132 [03/13/2022-08:31:28] [V] [TRT] Tactic: 28 time 0.009596 [03/13/2022-08:31:28] [V] [TRT] Tactic: 29 time 0.012172 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 6 Time: 0.007852 [03/13/2022-08:31:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [03/13/2022-08:31:28] [V] [TRT] [03/13/2022-08:31:28] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_196, Mul_197) (PointWise) [03/13/2022-08:31:28] [V] [TRT] Tactic: 128 time 0.020876 [03/13/2022-08:31:28] [V] [TRT] Tactic: 256 time 0.0188 [03/13/2022-08:31:28] [V] [TRT] Tactic: 512 time 0.018612 [03/13/2022-08:31:28] [V] [TRT] Tactic: -32 time 0.028348 [03/13/2022-08:31:28] [V] [TRT] Tactic: -64 time 0.023804 [03/13/2022-08:31:28] [V] [TRT] Tactic: -128 time 0.021224 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 512 Time: 0.018612 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_196, Mul_197) (PointWiseV2) [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.008704 [03/13/2022-08:31:28] [V] [TRT] Tactic: 1 time 0.008136 [03/13/2022-08:31:28] [V] [TRT] Tactic: 2 time 0.010396 [03/13/2022-08:31:28] [V] [TRT] Tactic: 3 time 0.00836 [03/13/2022-08:31:28] [V] [TRT] Tactic: 4 time 0.009992 [03/13/2022-08:31:28] [V] [TRT] Tactic: 5 time 0.013236 [03/13/2022-08:31:28] [V] [TRT] Tactic: 6 time 0.011532 [03/13/2022-08:31:28] [V] [TRT] Tactic: 7 time 0.012488 [03/13/2022-08:31:28] [V] [TRT] Tactic: 8 time 0.013252 [03/13/2022-08:31:28] [V] [TRT] Tactic: 9 time 0.018868 [03/13/2022-08:31:28] [V] [TRT] Tactic: 10 time 0.008944 [03/13/2022-08:31:28] [V] [TRT] Tactic: 11 time 0.008148 [03/13/2022-08:31:28] [V] [TRT] Tactic: 12 time 0.008944 [03/13/2022-08:31:28] [V] [TRT] Tactic: 13 time 0.0075 [03/13/2022-08:31:28] [V] [TRT] Tactic: 14 time 0.008772 [03/13/2022-08:31:28] [V] [TRT] Tactic: 15 time 0.011556 [03/13/2022-08:31:28] [V] [TRT] Tactic: 16 time 0.008888 [03/13/2022-08:31:28] [V] [TRT] Tactic: 17 time 0.008792 [03/13/2022-08:31:28] [V] [TRT] Tactic: 18 time 0.011264 [03/13/2022-08:31:28] [V] [TRT] Tactic: 19 time 0.014648 [03/13/2022-08:31:28] [V] [TRT] Tactic: 20 time 0.009816 [03/13/2022-08:31:28] [V] [TRT] Tactic: 21 time 0.008604 [03/13/2022-08:31:28] [V] [TRT] Tactic: 22 time 0.008172 [03/13/2022-08:31:28] [V] [TRT] Tactic: 23 time 0.008068 [03/13/2022-08:31:28] [V] [TRT] Tactic: 24 time 0.012388 [03/13/2022-08:31:28] [V] [TRT] Tactic: 25 time 0.010192 [03/13/2022-08:31:28] [V] [TRT] Tactic: 26 time 0.008856 [03/13/2022-08:31:28] [V] [TRT] Tactic: 27 time 0.008344 [03/13/2022-08:31:28] [V] [TRT] Tactic: 28 time 0.00854 [03/13/2022-08:31:28] [V] [TRT] Tactic: 29 time 0.00882 [03/13/2022-08:31:28] [V] [TRT] Tactic: 30 time 0.010004 [03/13/2022-08:31:28] [V] [TRT] Tactic: 31 time 0.012548 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 13 Time: 0.0075 [03/13/2022-08:31:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 13 [03/13/2022-08:31:28] [V] [TRT] [03/13/2022-08:31:28] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: Resize_199 (Resize) [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.081956 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.081956 [03/13/2022-08:31:28] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: Resize_199 (Resize) [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.077628 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.077628 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.051968 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.040988 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.040988 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.07044 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.151776 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.07044 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.049832 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.047988 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.047988 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.098448 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.04112 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.04112 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.06974 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.042188 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.042188 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.051572 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.048784 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.048784 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.07064 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.15274 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.07064 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.049336 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.022852 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.022852 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.097676 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.039784 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.039784 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.069564 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.039448 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.039448 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.051784 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.041032 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.041032 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.05046 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.04764 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.04764 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.0973 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.04114 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.04114 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.069784 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.042324 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.042324 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.051892 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.048836 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.048836 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.049252 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.02304 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.02304 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.0977 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.039784 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.039784 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.069812 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.03904 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.03904 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 515 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.051932 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.040884 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.040884 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 515 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.050276 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.047744 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.047744 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 515 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.098072 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.050036 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.050036 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 515 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.06954 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.088028 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.06954 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 515 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.10654 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.090388 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.090388 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 515 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.10452 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.087764 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.087764 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 515 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.122068 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.089892 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.089892 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 515 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.08936 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.057376 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.057376 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 515 copy (Reformat) [03/13/2022-08:31:28] [V] [TRT] Tactic: 1002 time 0.052168 [03/13/2022-08:31:28] [V] [TRT] Tactic: 0 time 0.048876 [03/13/2022-08:31:28] [V] [TRT] Fastest Tactic: 0 Time: 0.048876 [03/13/2022-08:31:28] [V] [TRT] --------------- Timing Runner: 515 copy (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.04954 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.022836 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 0 Time: 0.022836 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: 515 copy (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.097568 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.0395 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 0 Time: 0.0395 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: 515 copy (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.069708 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.043652 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 0 Time: 0.043652 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: 515 copy (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.101136 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.049868 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 0 Time: 0.049868 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: 515 copy (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.10088 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.044988 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 0 Time: 0.044988 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: 515 copy (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.096292 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.022744 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 0 Time: 0.022744 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: 515 copy (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.067008 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.039376 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 0 Time: 0.039376 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: 515 copy (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.069328 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.09604 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.069328 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: 515 copy (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.068788 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.089364 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.068788 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: 515 copy (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.123156 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.025252 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 0 Time: 0.025252 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: 515 copy (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.119196 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.02926 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 0 Time: 0.02926 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.087196 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.097616 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.087196 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.187284 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.077324 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 0 Time: 0.077324 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.132372 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.069864 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 0 Time: 0.069864 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.09106 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.090228 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 0 Time: 0.090228 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.186192 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.074268 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 0 Time: 0.074268 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.133116 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.064312 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 0 Time: 0.064312 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.203768 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.070152 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 0 Time: 0.070152 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.200824 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.066344 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 0 Time: 0.066344 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.127712 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.055864 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 0 Time: 0.055864 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.132468 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.062652 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 0 Time: 0.062652 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.131208 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.042856 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 0 Time: 0.042856 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:29] [V] [TRT] Tactic: 1002 time 0.234848 [03/13/2022-08:31:29] [V] [TRT] Tactic: 0 time 0.041832 [03/13/2022-08:31:29] [V] [TRT] Fastest Tactic: 0 Time: 0.041832 [03/13/2022-08:31:29] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,1536000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:31:29] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:31:29] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:29] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:29] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:29] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:29] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:29] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:29] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:29] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:29] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (FusedConvActConvolution) [03/13/2022-08:31:29] [V] [TRT] Tactic: 589823 time 0.733912 [03/13/2022-08:31:29] [V] [TRT] Tactic: 655359 time 0.418896 [03/13/2022-08:31:29] [V] [TRT] Tactic: 786431 time 0.565524 [03/13/2022-08:31:29] [V] [TRT] Tactic: 851967 time 0.48808 [03/13/2022-08:31:29] [V] [TRT] Tactic: 1179647 time 0.44324 [03/13/2022-08:31:29] [V] [TRT] Tactic: 1310719 time 0.511364 [03/13/2022-08:31:29] [V] [TRT] Tactic: 1376255 time 0.413416 [03/13/2022-08:31:29] [V] [TRT] Tactic: 1441791 time 0.55214 [03/13/2022-08:31:29] [V] [TRT] Tactic: 1507327 time 0.426548 [03/13/2022-08:31:29] [V] [TRT] Tactic: 1638399 time 0.514364 [03/13/2022-08:31:29] [V] [TRT] Tactic: 1835007 time 0.607704 [03/13/2022-08:31:29] [V] [TRT] Tactic: 1900543 time 0.47882 [03/13/2022-08:31:29] [V] [TRT] Tactic: 2097151 time 0.555324 [03/13/2022-08:31:29] [V] [TRT] Tactic: 2162687 time 0.440776 [03/13/2022-08:31:29] [V] [TRT] Tactic: 2293759 time 0.457012 [03/13/2022-08:31:29] [V] [TRT] Tactic: 2359295 time 0.36908 [03/13/2022-08:31:29] [V] [TRT] Tactic: 2686975 time 0.452272 [03/13/2022-08:31:29] [V] [TRT] Tactic: 3080191 time 0.443464 [03/13/2022-08:31:29] [V] [TRT] Tactic: 3342335 time 0.43552 [03/13/2022-08:31:29] [V] [TRT] Tactic: 3407871 time 0.407248 [03/13/2022-08:31:29] [V] [TRT] Tactic: 3538943 time 0.409156 [03/13/2022-08:31:29] [V] [TRT] Tactic: 3670015 time 0.440072 [03/13/2022-08:31:29] [V] [TRT] Tactic: 3932159 time 0.486644 [03/13/2022-08:31:29] [V] [TRT] Tactic: 3997695 time 0.565588 [03/13/2022-08:31:30] [V] [TRT] Tactic: 4063231 time 0.48242 [03/13/2022-08:31:30] [V] [TRT] Tactic: 4194303 time 0.53424 [03/13/2022-08:31:30] [V] [TRT] Tactic: 4259839 time 0.504088 [03/13/2022-08:31:30] [V] [TRT] Tactic: 4325375 time 0.494768 [03/13/2022-08:31:30] [V] [TRT] Tactic: 4521983 time 0.529556 [03/13/2022-08:31:30] [V] [TRT] Tactic: 4587519 time 0.507556 [03/13/2022-08:31:30] [V] [TRT] Tactic: 4653055 time 0.387372 [03/13/2022-08:31:30] [V] [TRT] Tactic: 4915199 time 0.532844 [03/13/2022-08:31:30] [V] [TRT] Tactic: 4980735 time 0.495648 [03/13/2022-08:31:30] [V] [TRT] Tactic: 5177343 time 0.514704 [03/13/2022-08:31:30] [V] [TRT] Tactic: 5242879 time 0.484556 [03/13/2022-08:31:30] [V] [TRT] Tactic: 5373951 time 0.79322 [03/13/2022-08:31:30] [V] [TRT] Tactic: 5439487 time 1.0907 [03/13/2022-08:31:30] [V] [TRT] Tactic: 5570559 time 0.448456 [03/13/2022-08:31:30] [V] [TRT] Tactic: 5636095 time 0.482348 [03/13/2022-08:31:30] [V] [TRT] Tactic: 5701631 time 0.523652 [03/13/2022-08:31:30] [V] [TRT] Tactic: 5767167 time 4.13042 [03/13/2022-08:31:30] [V] [TRT] Tactic: 5832703 time 0.400084 [03/13/2022-08:31:30] [V] [TRT] Tactic: 5898239 time 0.417948 [03/13/2022-08:31:30] [V] [TRT] Tactic: 6029311 time 0.518212 [03/13/2022-08:31:30] [V] [TRT] Tactic: 6225919 time 0.503424 [03/13/2022-08:31:30] [V] [TRT] Tactic: 6291455 time 0.443364 [03/13/2022-08:31:30] [V] [TRT] Tactic: 6422527 time 0.501556 [03/13/2022-08:31:30] [V] [TRT] Tactic: 6750207 time 0.662872 [03/13/2022-08:31:30] [V] [TRT] Tactic: 6815743 time 0.746264 [03/13/2022-08:31:31] [V] [TRT] Tactic: 6946815 time 0.966028 [03/13/2022-08:31:31] [V] [TRT] Tactic: 7012351 time 0.555236 [03/13/2022-08:31:31] [V] [TRT] Tactic: 7077887 time 0.39918 [03/13/2022-08:31:31] [V] [TRT] Tactic: 7143423 time 0.952856 [03/13/2022-08:31:31] [V] [TRT] Tactic: 7208959 time 0.467276 [03/13/2022-08:31:31] [V] [TRT] Tactic: 7340031 time 0.43792 [03/13/2022-08:31:31] [V] [TRT] Tactic: 7405567 time 0.44932 [03/13/2022-08:31:31] [V] [TRT] Tactic: 7536639 time 0.777792 [03/13/2022-08:31:31] [V] [TRT] Tactic: 7602175 time 0.562048 [03/13/2022-08:31:31] [V] [TRT] Tactic: 7733247 time 0.401528 [03/13/2022-08:31:31] [V] [TRT] Tactic: 7798783 time 0.565824 [03/13/2022-08:31:31] [V] [TRT] Tactic: 8191999 time 0.721084 [03/13/2022-08:31:31] [V] [TRT] Tactic: 8257535 time 0.572828 [03/13/2022-08:31:31] [V] [TRT] Tactic: 8323071 time 0.661352 [03/13/2022-08:31:31] [V] [TRT] Tactic: 8650751 time 0.67016 [03/13/2022-08:31:31] [V] [TRT] Tactic: 8716287 time 0.744308 [03/13/2022-08:31:31] [V] [TRT] Tactic: 9109503 time 0.598816 [03/13/2022-08:31:31] [V] [TRT] Tactic: 9568255 time 0.53328 [03/13/2022-08:31:31] [V] [TRT] Tactic: 9895935 time 0.535136 [03/13/2022-08:31:31] [V] [TRT] Tactic: 10223615 time 0.452424 [03/13/2022-08:31:31] [V] [TRT] Tactic: 10354687 time 0.5008 [03/13/2022-08:31:31] [V] [TRT] Tactic: 10551295 time 0.656824 [03/13/2022-08:31:31] [V] [TRT] Tactic: 10747903 time 0.384748 [03/13/2022-08:31:31] [V] [TRT] Tactic: 10944511 time 0.496052 [03/13/2022-08:31:31] [V] [TRT] Fastest Tactic: 2359295 Time: 0.36908 [03/13/2022-08:31:31] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (CaskConvolution) [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Tactic: 1754569683116234317 time 0.303232 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Tactic: 1825138533642645384 time 0.304468 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Tactic: 2733356012094739613 time 0.232712 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Tactic: 3915320020053085238 time 0.304172 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Tactic: 6808617066150061604 time 0.241228 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Tactic: 9091006216302412844 time 0.230276 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Tactic: -8060443123034038864 time 0.24378 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Tactic: -4420849921117327522 time 0.256768 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Tactic: -3946921629105938337 time 0.25006 [03/13/2022-08:31:31] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.230276 [03/13/2022-08:31:31] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (CudaConvolution) [03/13/2022-08:31:31] [V] [TRT] Tactic: 0 time 0.445096 [03/13/2022-08:31:31] [V] [TRT] Tactic: 2 time 0.615556 [03/13/2022-08:31:31] [V] [TRT] Tactic: 5 time 0.850692 [03/13/2022-08:31:31] [V] [TRT] Tactic: 57 time 0.29912 [03/13/2022-08:31:31] [V] [TRT] Fastest Tactic: 57 Time: 0.29912 [03/13/2022-08:31:31] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (CudaDepthwiseConvolution) [03/13/2022-08:31:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:31] [V] [TRT] [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:31] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,1536000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:31:31] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (FusedConvActConvolution) [03/13/2022-08:31:31] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:31] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (CaskConvolution) [03/13/2022-08:31:31] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:31] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (CudaConvolution) [03/13/2022-08:31:31] [V] [TRT] Tactic: 0 time 0.480616 [03/13/2022-08:31:31] [V] [TRT] Tactic: 1 time 0.359372 [03/13/2022-08:31:31] [V] [TRT] Tactic: 2 time 0.586052 [03/13/2022-08:31:31] [V] [TRT] Tactic: 4 skipped. Scratch requested: 6858547200, available: 16777216 [03/13/2022-08:31:31] [V] [TRT] Tactic: 5 time 0.824644 [03/13/2022-08:31:31] [V] [TRT] Fastest Tactic: 1 Time: 0.359372 [03/13/2022-08:31:31] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (CudaDepthwiseConvolution) [03/13/2022-08:31:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:31:31] [V] [TRT] [03/13/2022-08:31:31] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,768000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:31:31] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (FusedConvActConvolution) [03/13/2022-08:31:31] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:31] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (CaskConvolution) [03/13/2022-08:31:31] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:31] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (CudaConvolution) [03/13/2022-08:31:31] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:31] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (CudaDepthwiseConvolution) [03/13/2022-08:31:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:31] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,768000) -> Half(1,80,4800:2,384000) *************** [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:31] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:31] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (FusedConvActConvolution) [03/13/2022-08:31:31] [V] [TRT] Tactic: 589823 time 0.363372 [03/13/2022-08:31:31] [V] [TRT] Tactic: 655359 time 0.210076 [03/13/2022-08:31:32] [V] [TRT] Tactic: 786431 time 0.294696 [03/13/2022-08:31:32] [V] [TRT] Tactic: 851967 time 0.26324 [03/13/2022-08:31:32] [V] [TRT] Tactic: 1179647 time 0.24012 [03/13/2022-08:31:32] [V] [TRT] Tactic: 1310719 time 0.254292 [03/13/2022-08:31:32] [V] [TRT] Tactic: 1376255 time 0.206928 [03/13/2022-08:31:32] [V] [TRT] Tactic: 1441791 time 0.28906 [03/13/2022-08:31:32] [V] [TRT] Tactic: 1507327 time 0.219612 [03/13/2022-08:31:32] [V] [TRT] Tactic: 1638399 time 0.278736 [03/13/2022-08:31:32] [V] [TRT] Tactic: 1835007 time 0.31292 [03/13/2022-08:31:32] [V] [TRT] Tactic: 1900543 time 0.224216 [03/13/2022-08:31:32] [V] [TRT] Tactic: 2097151 time 0.309568 [03/13/2022-08:31:32] [V] [TRT] Tactic: 2162687 time 0.217404 [03/13/2022-08:31:32] [V] [TRT] Tactic: 2293759 time 0.227748 [03/13/2022-08:31:32] [V] [TRT] Tactic: 2359295 time 0.18722 [03/13/2022-08:31:32] [V] [TRT] Tactic: 2686975 time 0.225856 [03/13/2022-08:31:32] [V] [TRT] Tactic: 3080191 time 0.226216 [03/13/2022-08:31:32] [V] [TRT] Tactic: 3342335 time 0.218544 [03/13/2022-08:31:32] [V] [TRT] Tactic: 3407871 time 0.204912 [03/13/2022-08:31:32] [V] [TRT] Tactic: 3538943 time 0.209984 [03/13/2022-08:31:32] [V] [TRT] Tactic: 3670015 time 0.219744 [03/13/2022-08:31:32] [V] [TRT] Tactic: 3932159 time 0.229868 [03/13/2022-08:31:32] [V] [TRT] Tactic: 3997695 time 0.299516 [03/13/2022-08:31:32] [V] [TRT] Tactic: 4063231 time 0.266064 [03/13/2022-08:31:32] [V] [TRT] Tactic: 4194303 time 0.283056 [03/13/2022-08:31:32] [V] [TRT] Tactic: 4259839 time 0.272548 [03/13/2022-08:31:32] [V] [TRT] Tactic: 4325375 time 0.26054 [03/13/2022-08:31:32] [V] [TRT] Tactic: 4521983 time 0.261156 [03/13/2022-08:31:32] [V] [TRT] Tactic: 4587519 time 0.270972 [03/13/2022-08:31:32] [V] [TRT] Tactic: 4653055 time 0.221376 [03/13/2022-08:31:32] [V] [TRT] Tactic: 4915199 time 0.287312 [03/13/2022-08:31:32] [V] [TRT] Tactic: 4980735 time 0.257028 [03/13/2022-08:31:32] [V] [TRT] Tactic: 5177343 time 0.271632 [03/13/2022-08:31:32] [V] [TRT] Tactic: 5242879 time 0.238696 [03/13/2022-08:31:32] [V] [TRT] Tactic: 5373951 time 0.36368 [03/13/2022-08:31:32] [V] [TRT] Tactic: 5439487 time 0.495764 [03/13/2022-08:31:32] [V] [TRT] Tactic: 5570559 time 0.22994 [03/13/2022-08:31:32] [V] [TRT] Tactic: 5636095 time 0.266204 [03/13/2022-08:31:32] [V] [TRT] Tactic: 5701631 time 0.262204 [03/13/2022-08:31:32] [V] [TRT] Tactic: 5767167 time 1.32423 [03/13/2022-08:31:32] [V] [TRT] Tactic: 5832703 time 0.20194 [03/13/2022-08:31:32] [V] [TRT] Tactic: 5898239 time 0.226324 [03/13/2022-08:31:32] [V] [TRT] Tactic: 6029311 time 0.257336 [03/13/2022-08:31:32] [V] [TRT] Tactic: 6225919 time 0.251004 [03/13/2022-08:31:32] [V] [TRT] Tactic: 6291455 time 0.240264 [03/13/2022-08:31:32] [V] [TRT] Tactic: 6422527 time 0.254656 [03/13/2022-08:31:32] [V] [TRT] Tactic: 6750207 time 0.341356 [03/13/2022-08:31:32] [V] [TRT] Tactic: 6815743 time 0.337344 [03/13/2022-08:31:32] [V] [TRT] Tactic: 6946815 time 0.466408 [03/13/2022-08:31:32] [V] [TRT] Tactic: 7012351 time 0.309468 [03/13/2022-08:31:32] [V] [TRT] Tactic: 7077887 time 0.2057 [03/13/2022-08:31:33] [V] [TRT] Tactic: 7143423 time 0.480816 [03/13/2022-08:31:33] [V] [TRT] Tactic: 7208959 time 0.234588 [03/13/2022-08:31:33] [V] [TRT] Tactic: 7340031 time 0.233256 [03/13/2022-08:31:33] [V] [TRT] Tactic: 7405567 time 0.245332 [03/13/2022-08:31:33] [V] [TRT] Tactic: 7536639 time 0.380248 [03/13/2022-08:31:33] [V] [TRT] Tactic: 7602175 time 0.292952 [03/13/2022-08:31:33] [V] [TRT] Tactic: 7733247 time 0.208816 [03/13/2022-08:31:33] [V] [TRT] Tactic: 7798783 time 0.2951 [03/13/2022-08:31:33] [V] [TRT] Tactic: 8191999 time 0.373056 [03/13/2022-08:31:33] [V] [TRT] Tactic: 8257535 time 0.29922 [03/13/2022-08:31:33] [V] [TRT] Tactic: 8323071 time 0.336948 [03/13/2022-08:31:33] [V] [TRT] Tactic: 8650751 time 0.344988 [03/13/2022-08:31:33] [V] [TRT] Tactic: 8716287 time 0.348212 [03/13/2022-08:31:33] [V] [TRT] Tactic: 9109503 time 0.325652 [03/13/2022-08:31:33] [V] [TRT] Tactic: 9568255 time 0.288284 [03/13/2022-08:31:33] [V] [TRT] Tactic: 9895935 time 0.28122 [03/13/2022-08:31:33] [V] [TRT] Tactic: 10223615 time 0.225448 [03/13/2022-08:31:33] [V] [TRT] Tactic: 10354687 time 0.270604 [03/13/2022-08:31:33] [V] [TRT] Tactic: 10551295 time 0.33306 [03/13/2022-08:31:33] [V] [TRT] Tactic: 10747903 time 0.200408 [03/13/2022-08:31:33] [V] [TRT] Tactic: 10944511 time 0.256324 [03/13/2022-08:31:33] [V] [TRT] Fastest Tactic: 2359295 Time: 0.18722 [03/13/2022-08:31:33] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (CaskConvolution) [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: 1651411198763708804 time 0.125816 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: 2418518597804310654 time 0.126388 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: 4318470497547290900 time 0.125332 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: 4930470141256631146 time 0.122364 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: 8292881859266835088 time 0.121728 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: 8401509141903434922 time 0.125232 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: -8654297089785671176 time 0.171248 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: -7516584506774355935 time 0.118444 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: -7140760933967189247 time 0.123848 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: -6004726995029373073 time 0.120228 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: -5719726816705110014 time 0.171652 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: -4097850214384059472 time 0.118644 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: -3717489476759089008 time 0.123332 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: -3689982367035295496 time 0.171668 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: -2640575123064142123 time 0.159424 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: -2534402059426524406 time 0.15946 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: -2027588946874785071 time 0.120592 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: -1968398013367819764 time 0.171912 [03/13/2022-08:31:33] [V] [TRT] Fastest Tactic: -7516584506774355935 Time: 0.118444 [03/13/2022-08:31:33] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (CudaConvolution) [03/13/2022-08:31:33] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:33] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (CudaDepthwiseConvolution) [03/13/2022-08:31:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7516584506774355935 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:33] [V] [TRT] [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:33] [V] [TRT] *************** Autotuning format combination: Half(40,3200,1:8,192000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:31:33] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (FusedConvActConvolution) [03/13/2022-08:31:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:33] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (CaskConvolution) [03/13/2022-08:31:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:33] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (CudaConvolution) [03/13/2022-08:31:33] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:33] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (CudaDepthwiseConvolution) [03/13/2022-08:31:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:33] [V] [TRT] *************** Autotuning format combination: Half(40,3200,1:8,192000) -> Half(20,1600,1:8,96000) *************** [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (FusedConvActConvolution) [03/13/2022-08:31:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:33] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (CaskConvolution) [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:33] [V] [TRT] Tactic: 9576651994278528 time 0.727852 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: 1179757074518529353 time 1.0914 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: 2105695814191699972 time 2.00722 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: 2148106709480872763 time 1.07306 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: 2410442691266548717 time 1.29838 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: 3041642431972138763 time 1.28541 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: 3754069740140581927 time 2.40604 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: 4555462412611657028 time 1.07304 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: 5666160310350604399 time 2.40792 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:33] [V] [TRT] Tactic: 5876997871499382316 time 1.35314 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: 5925270497649423688 time 2.40286 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: 6680916730816870145 time 2.01483 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:33] [V] [TRT] Tactic: 7158029511300006471 time 2.01581 [03/13/2022-08:31:33] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:34] [V] [TRT] Tactic: 7859952145590271433 time 2.01412 [03/13/2022-08:31:34] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:34] [V] [TRT] Tactic: 8283847742354150423 time 2.41222 [03/13/2022-08:31:34] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:34] [V] [TRT] Tactic: -8992262742606384444 time 1.07324 [03/13/2022-08:31:34] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:34] [V] [TRT] Tactic: -8391760416076885205 time 2.39928 [03/13/2022-08:31:34] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:34] [V] [TRT] Tactic: -6273232454637933930 time 1.09309 [03/13/2022-08:31:34] [V] [TRT] Conv_468 || Conv_456 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:34] [V] [TRT] Tactic: -5925110308892264213 time 1.34776 [03/13/2022-08:31:34] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:34] [V] [TRT] Tactic: -5818527483287834165 time 1.09275 [03/13/2022-08:31:34] [V] [TRT] Conv_468 || Conv_456 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:34] [V] [TRT] Tactic: -4908848143422991657 time 0.728312 [03/13/2022-08:31:34] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:34] [V] [TRT] Tactic: -4534876761957424274 time 2.39925 [03/13/2022-08:31:34] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:34] [V] [TRT] Tactic: -3237051169894153788 time 2.00808 [03/13/2022-08:31:34] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:34] [V] [TRT] Tactic: -3136088851200285532 time 1.28535 [03/13/2022-08:31:34] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:34] [V] [TRT] Tactic: -2586046817576862066 time 1.29866 [03/13/2022-08:31:34] [V] [TRT] Conv_468 || Conv_456 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:34] [V] [TRT] Tactic: -2422160065350346448 time 2.00942 [03/13/2022-08:31:34] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:34] [V] [TRT] Tactic: -1216445540764179377 time 1.29784 [03/13/2022-08:31:34] [V] [TRT] Conv_468 || Conv_456 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:34] [V] [TRT] Tactic: -229563042944049199 time 1.2856 [03/13/2022-08:31:34] [V] [TRT] Fastest Tactic: 9576651994278528 Time: 0.727852 [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (CudaConvolution) [03/13/2022-08:31:34] [V] [TRT] Tactic: 0 time 0.731264 [03/13/2022-08:31:34] [V] [TRT] Tactic: 1 time 0.418412 [03/13/2022-08:31:34] [V] [TRT] Tactic: 2 time 0.757108 [03/13/2022-08:31:34] [V] [TRT] Fastest Tactic: 1 Time: 0.418412 [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: Conv_468 || Conv_456 (CudaDepthwiseConvolution) [03/13/2022-08:31:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:31:34] [V] [TRT] [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:34] [V] [TRT] Tactic: 1002 time 0.217424 [03/13/2022-08:31:34] [V] [TRT] Tactic: 0 time 0.176036 [03/13/2022-08:31:34] [V] [TRT] Fastest Tactic: 0 Time: 0.176036 [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:34] [V] [TRT] Tactic: 1002 time 0.217648 [03/13/2022-08:31:34] [V] [TRT] Tactic: 0 time 0.169892 [03/13/2022-08:31:34] [V] [TRT] Fastest Tactic: 0 Time: 0.169892 [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:34] [V] [TRT] Tactic: 1002 time 0.234144 [03/13/2022-08:31:34] [V] [TRT] Tactic: 0 time 0.174248 [03/13/2022-08:31:34] [V] [TRT] Fastest Tactic: 0 Time: 0.174248 [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:34] [V] [TRT] Tactic: 1002 time 0.169556 [03/13/2022-08:31:34] [V] [TRT] Tactic: 0 time 0.108216 [03/13/2022-08:31:34] [V] [TRT] Fastest Tactic: 0 Time: 0.108216 [03/13/2022-08:31:34] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,1536000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:31:34] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,1536000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:31:34] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,768000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: Conv_213 || Conv_201 (FusedConvActConvolution) [03/13/2022-08:31:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: Conv_213 || Conv_201 (CaskConvolution) [03/13/2022-08:31:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: Conv_213 || Conv_201 (CudaConvolution) [03/13/2022-08:31:34] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: Conv_213 || Conv_201 (CudaDepthwiseConvolution) [03/13/2022-08:31:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:34] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,768000) -> Half(1,80,4800:2,384000) *************** [03/13/2022-08:31:34] [V] [TRT] *************** Autotuning format combination: Half(40,3200,1:8,192000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: Conv_213 || Conv_201 (FusedConvActConvolution) [03/13/2022-08:31:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: Conv_213 || Conv_201 (CaskConvolution) [03/13/2022-08:31:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: Conv_213 || Conv_201 (CudaConvolution) [03/13/2022-08:31:34] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: Conv_213 || Conv_201 (CudaDepthwiseConvolution) [03/13/2022-08:31:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:34] [V] [TRT] *************** Autotuning format combination: Half(40,3200,1:8,192000) -> Half(20,1600,1:8,96000) *************** [03/13/2022-08:31:34] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,768000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_458, Mul_459) (PointWise) [03/13/2022-08:31:34] [V] [TRT] Tactic: 128 time 0.04306 [03/13/2022-08:31:34] [V] [TRT] Tactic: 256 time 0.043872 [03/13/2022-08:31:34] [V] [TRT] Tactic: 512 time 0.047756 [03/13/2022-08:31:34] [V] [TRT] Tactic: -32 time 0.064696 [03/13/2022-08:31:34] [V] [TRT] Tactic: -64 time 0.041436 [03/13/2022-08:31:34] [V] [TRT] Tactic: -128 time 0.040176 [03/13/2022-08:31:34] [V] [TRT] Fastest Tactic: -128 Time: 0.040176 [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_458, Mul_459) (PointWiseV2) [03/13/2022-08:31:34] [V] [TRT] Tactic: 0 time 0.029088 [03/13/2022-08:31:34] [V] [TRT] Tactic: 1 time 0.024452 [03/13/2022-08:31:34] [V] [TRT] Tactic: 2 time 0.022812 [03/13/2022-08:31:34] [V] [TRT] Tactic: 3 time 0.024204 [03/13/2022-08:31:34] [V] [TRT] Tactic: 4 time 0.022956 [03/13/2022-08:31:34] [V] [TRT] Tactic: 5 time 0.022972 [03/13/2022-08:31:34] [V] [TRT] Tactic: 6 time 0.025624 [03/13/2022-08:31:34] [V] [TRT] Tactic: 7 time 0.02332 [03/13/2022-08:31:34] [V] [TRT] Tactic: 8 time 0.02298 [03/13/2022-08:31:34] [V] [TRT] Tactic: 9 time 0.022708 [03/13/2022-08:31:34] [V] [TRT] Tactic: 28 time 0.02938 [03/13/2022-08:31:34] [V] [TRT] Fastest Tactic: 9 Time: 0.022708 [03/13/2022-08:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:34] [V] [TRT] [03/13/2022-08:31:34] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,24000) -> Float(1,80,4800:32,14400) *************** [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_458, Mul_459) (PointWise) [03/13/2022-08:31:34] [V] [TRT] Tactic: 128 time 0.055828 [03/13/2022-08:31:34] [V] [TRT] Tactic: 256 time 0.056068 [03/13/2022-08:31:34] [V] [TRT] Tactic: 512 time 0.062764 [03/13/2022-08:31:34] [V] [TRT] Tactic: -32 time 0.086444 [03/13/2022-08:31:34] [V] [TRT] Tactic: -64 time 0.052124 [03/13/2022-08:31:34] [V] [TRT] Tactic: -128 time 0.047944 [03/13/2022-08:31:34] [V] [TRT] Fastest Tactic: -128 Time: 0.047944 [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_458, Mul_459) (PointWiseV2) [03/13/2022-08:31:34] [V] [TRT] Tactic: 24 time 0.029852 [03/13/2022-08:31:34] [V] [TRT] Tactic: 25 time 0.031008 [03/13/2022-08:31:34] [V] [TRT] Tactic: 26 time 0.031508 [03/13/2022-08:31:34] [V] [TRT] Tactic: 27 time 0.032116 [03/13/2022-08:31:34] [V] [TRT] Tactic: 31 time 0.030068 [03/13/2022-08:31:34] [V] [TRT] Fastest Tactic: 24 Time: 0.029852 [03/13/2022-08:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [03/13/2022-08:31:34] [V] [TRT] [03/13/2022-08:31:34] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,768000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_458, Mul_459) (PointWise) [03/13/2022-08:31:34] [V] [TRT] Tactic: 128 time 0.042296 [03/13/2022-08:31:34] [V] [TRT] Tactic: 256 time 0.035488 [03/13/2022-08:31:34] [V] [TRT] Tactic: 512 time 0.035524 [03/13/2022-08:31:34] [V] [TRT] Tactic: -32 time 0.05646 [03/13/2022-08:31:34] [V] [TRT] Tactic: -64 time 0.039892 [03/13/2022-08:31:34] [V] [TRT] Tactic: -128 time 0.03878 [03/13/2022-08:31:34] [V] [TRT] Fastest Tactic: 256 Time: 0.035488 [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_458, Mul_459) (PointWiseV2) [03/13/2022-08:31:34] [V] [TRT] Tactic: 0 time 0.027532 [03/13/2022-08:31:34] [V] [TRT] Tactic: 1 time 0.022608 [03/13/2022-08:31:34] [V] [TRT] Tactic: 2 time 0.019132 [03/13/2022-08:31:34] [V] [TRT] Tactic: 3 time 0.02058 [03/13/2022-08:31:34] [V] [TRT] Tactic: 4 time 0.016276 [03/13/2022-08:31:34] [V] [TRT] Tactic: 5 time 0.014692 [03/13/2022-08:31:34] [V] [TRT] Tactic: 6 time 0.02134 [03/13/2022-08:31:34] [V] [TRT] Tactic: 7 time 0.01602 [03/13/2022-08:31:34] [V] [TRT] Tactic: 8 time 0.014172 [03/13/2022-08:31:34] [V] [TRT] Tactic: 9 time 0.013948 [03/13/2022-08:31:34] [V] [TRT] Tactic: 28 time 0.027936 [03/13/2022-08:31:34] [V] [TRT] Fastest Tactic: 9 Time: 0.013948 [03/13/2022-08:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:34] [V] [TRT] [03/13/2022-08:31:34] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800:2,192000) *************** [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_458, Mul_459) (PointWise) [03/13/2022-08:31:34] [V] [TRT] Tactic: 128 time 0.042296 [03/13/2022-08:31:34] [V] [TRT] Tactic: 256 time 0.0357 [03/13/2022-08:31:34] [V] [TRT] Tactic: 512 time 0.03548 [03/13/2022-08:31:34] [V] [TRT] Tactic: -32 time 0.056808 [03/13/2022-08:31:34] [V] [TRT] Tactic: -64 time 0.039676 [03/13/2022-08:31:34] [V] [TRT] Tactic: -128 time 0.038728 [03/13/2022-08:31:34] [V] [TRT] Fastest Tactic: 512 Time: 0.03548 [03/13/2022-08:31:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_458, Mul_459) (PointWiseV2) [03/13/2022-08:31:34] [V] [TRT] Tactic: 0 time 0.019276 [03/13/2022-08:31:34] [V] [TRT] Tactic: 1 time 0.016816 [03/13/2022-08:31:34] [V] [TRT] Tactic: 2 time 0.017428 [03/13/2022-08:31:34] [V] [TRT] Tactic: 3 time 0.016656 [03/13/2022-08:31:34] [V] [TRT] Tactic: 4 time 0.017016 [03/13/2022-08:31:34] [V] [TRT] Tactic: 5 time 0.018176 [03/13/2022-08:31:34] [V] [TRT] Tactic: 6 time 0.0166 [03/13/2022-08:31:34] [V] [TRT] Tactic: 7 time 0.017096 [03/13/2022-08:31:34] [V] [TRT] Tactic: 8 time 0.01842 [03/13/2022-08:31:34] [V] [TRT] Tactic: 9 time 0.022536 [03/13/2022-08:31:35] [V] [TRT] Tactic: 10 time 0.028868 [03/13/2022-08:31:35] [V] [TRT] Tactic: 11 time 0.023208 [03/13/2022-08:31:35] [V] [TRT] Tactic: 12 time 0.019524 [03/13/2022-08:31:35] [V] [TRT] Tactic: 13 time 0.02082 [03/13/2022-08:31:35] [V] [TRT] Tactic: 14 time 0.016556 [03/13/2022-08:31:35] [V] [TRT] Tactic: 15 time 0.0146 [03/13/2022-08:31:35] [V] [TRT] Tactic: 16 time 0.02122 [03/13/2022-08:31:35] [V] [TRT] Tactic: 17 time 0.016132 [03/13/2022-08:31:35] [V] [TRT] Tactic: 18 time 0.014076 [03/13/2022-08:31:35] [V] [TRT] Tactic: 19 time 0.0139 [03/13/2022-08:31:35] [V] [TRT] Tactic: 28 time 0.01912 [03/13/2022-08:31:35] [V] [TRT] Tactic: 29 time 0.028736 [03/13/2022-08:31:35] [V] [TRT] Fastest Tactic: 19 Time: 0.0139 [03/13/2022-08:31:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 19 [03/13/2022-08:31:35] [V] [TRT] [03/13/2022-08:31:35] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Half(10,800,1:8,48000) *************** [03/13/2022-08:31:35] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_458, Mul_459) (PointWise) [03/13/2022-08:31:35] [V] [TRT] Tactic: 128 time 0.042104 [03/13/2022-08:31:35] [V] [TRT] Tactic: 256 time 0.03594 [03/13/2022-08:31:35] [V] [TRT] Tactic: 512 time 0.0354 [03/13/2022-08:31:35] [V] [TRT] Tactic: -32 time 0.080716 [03/13/2022-08:31:35] [V] [TRT] Tactic: -64 time 0.065588 [03/13/2022-08:31:35] [V] [TRT] Tactic: -128 time 0.0656 [03/13/2022-08:31:35] [V] [TRT] Fastest Tactic: 512 Time: 0.0354 [03/13/2022-08:31:35] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_458, Mul_459) (PointWiseV2) [03/13/2022-08:31:35] [V] [TRT] Tactic: 0 time 0.028044 [03/13/2022-08:31:35] [V] [TRT] Tactic: 1 time 0.030804 [03/13/2022-08:31:35] [V] [TRT] Tactic: 2 time 0.030508 [03/13/2022-08:31:35] [V] [TRT] Tactic: 3 time 0.038976 [03/13/2022-08:31:35] [V] [TRT] Tactic: 4 time 0.036472 [03/13/2022-08:31:35] [V] [TRT] Tactic: 5 time 0.032388 [03/13/2022-08:31:35] [V] [TRT] Tactic: 6 time 0.058284 [03/13/2022-08:31:35] [V] [TRT] Tactic: 7 time 0.046184 [03/13/2022-08:31:35] [V] [TRT] Tactic: 8 time 0.040872 [03/13/2022-08:31:35] [V] [TRT] Tactic: 9 time 0.046148 [03/13/2022-08:31:35] [V] [TRT] Tactic: 10 time 0.021276 [03/13/2022-08:31:35] [V] [TRT] Tactic: 11 time 0.022656 [03/13/2022-08:31:35] [V] [TRT] Tactic: 12 time 0.0218 [03/13/2022-08:31:35] [V] [TRT] Tactic: 13 time 0.026828 [03/13/2022-08:31:35] [V] [TRT] Tactic: 14 time 0.026388 [03/13/2022-08:31:35] [V] [TRT] Tactic: 15 time 0.023024 [03/13/2022-08:31:35] [V] [TRT] Tactic: 16 time 0.036592 [03/13/2022-08:31:35] [V] [TRT] Tactic: 17 time 0.031568 [03/13/2022-08:31:35] [V] [TRT] Tactic: 18 time 0.028712 [03/13/2022-08:31:35] [V] [TRT] Tactic: 19 time 0.027264 [03/13/2022-08:31:35] [V] [TRT] Tactic: 20 time 0.028828 [03/13/2022-08:31:35] [V] [TRT] Tactic: 21 time 0.022748 [03/13/2022-08:31:35] [V] [TRT] Tactic: 22 time 0.025392 [03/13/2022-08:31:35] [V] [TRT] Tactic: 23 time 0.030736 [03/13/2022-08:31:35] [V] [TRT] Tactic: 24 time 0.033412 [03/13/2022-08:31:35] [V] [TRT] Tactic: 25 time 0.031276 [03/13/2022-08:31:35] [V] [TRT] Tactic: 26 time 0.025284 [03/13/2022-08:31:35] [V] [TRT] Tactic: 27 time 0.029452 [03/13/2022-08:31:35] [V] [TRT] Tactic: 28 time 0.016328 [03/13/2022-08:31:35] [V] [TRT] Tactic: 29 time 0.015224 [03/13/2022-08:31:35] [V] [TRT] Tactic: 30 time 0.020136 [03/13/2022-08:31:35] [V] [TRT] Tactic: 31 time 0.029252 [03/13/2022-08:31:35] [V] [TRT] Fastest Tactic: 29 Time: 0.015224 [03/13/2022-08:31:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 29 [03/13/2022-08:31:35] [V] [TRT] [03/13/2022-08:31:35] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,768000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:31:35] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_203, Mul_204) (PointWise) [03/13/2022-08:31:35] [V] [TRT] Tactic: 128 time 0.043164 [03/13/2022-08:31:35] [V] [TRT] Tactic: 256 time 0.043704 [03/13/2022-08:31:35] [V] [TRT] Tactic: 512 time 0.047664 [03/13/2022-08:31:35] [V] [TRT] Tactic: -32 time 0.064548 [03/13/2022-08:31:35] [V] [TRT] Tactic: -64 time 0.041924 [03/13/2022-08:31:35] [V] [TRT] Tactic: -128 time 0.040176 [03/13/2022-08:31:35] [V] [TRT] Fastest Tactic: -128 Time: 0.040176 [03/13/2022-08:31:35] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_203, Mul_204) (PointWiseV2) [03/13/2022-08:31:35] [V] [TRT] Tactic: 0 time 0.029208 [03/13/2022-08:31:35] [V] [TRT] Tactic: 1 time 0.024416 [03/13/2022-08:31:35] [V] [TRT] Tactic: 2 time 0.022876 [03/13/2022-08:31:35] [V] [TRT] Tactic: 3 time 0.024012 [03/13/2022-08:31:35] [V] [TRT] Tactic: 4 time 0.023016 [03/13/2022-08:31:35] [V] [TRT] Tactic: 5 time 0.02286 [03/13/2022-08:31:35] [V] [TRT] Tactic: 6 time 0.026004 [03/13/2022-08:31:35] [V] [TRT] Tactic: 7 time 0.023248 [03/13/2022-08:31:35] [V] [TRT] Tactic: 8 time 0.02268 [03/13/2022-08:31:35] [V] [TRT] Tactic: 9 time 0.02256 [03/13/2022-08:31:35] [V] [TRT] Tactic: 28 time 0.029412 [03/13/2022-08:31:35] [V] [TRT] Fastest Tactic: 9 Time: 0.02256 [03/13/2022-08:31:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:35] [V] [TRT] [03/13/2022-08:31:35] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,24000) -> Float(1,80,4800:32,14400) *************** [03/13/2022-08:31:35] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_203, Mul_204) (PointWise) [03/13/2022-08:31:35] [V] [TRT] Tactic: 128 time 0.055824 [03/13/2022-08:31:35] [V] [TRT] Tactic: 256 time 0.056104 [03/13/2022-08:31:35] [V] [TRT] Tactic: 512 time 0.062564 [03/13/2022-08:31:35] [V] [TRT] Tactic: -32 time 0.086328 [03/13/2022-08:31:35] [V] [TRT] Tactic: -64 time 0.051944 [03/13/2022-08:31:35] [V] [TRT] Tactic: -128 time 0.048188 [03/13/2022-08:31:35] [V] [TRT] Fastest Tactic: -128 Time: 0.048188 [03/13/2022-08:31:35] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_203, Mul_204) (PointWiseV2) [03/13/2022-08:31:35] [V] [TRT] Tactic: 24 time 0.030228 [03/13/2022-08:31:35] [V] [TRT] Tactic: 25 time 0.030884 [03/13/2022-08:31:35] [V] [TRT] Tactic: 26 time 0.031524 [03/13/2022-08:31:35] [V] [TRT] Tactic: 27 time 0.03274 [03/13/2022-08:31:35] [V] [TRT] Tactic: 31 time 0.030084 [03/13/2022-08:31:35] [V] [TRT] Fastest Tactic: 31 Time: 0.030084 [03/13/2022-08:31:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [03/13/2022-08:31:35] [V] [TRT] [03/13/2022-08:31:35] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,768000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:31:35] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_203, Mul_204) (PointWise) [03/13/2022-08:31:35] [V] [TRT] Tactic: 128 time 0.04214 [03/13/2022-08:31:35] [V] [TRT] Tactic: 256 time 0.035384 [03/13/2022-08:31:35] [V] [TRT] Tactic: 512 time 0.035616 [03/13/2022-08:31:35] [V] [TRT] Tactic: -32 time 0.05664 [03/13/2022-08:31:35] [V] [TRT] Tactic: -64 time 0.039588 [03/13/2022-08:31:35] [V] [TRT] Tactic: -128 time 0.038792 [03/13/2022-08:31:35] [V] [TRT] Fastest Tactic: 256 Time: 0.035384 [03/13/2022-08:31:35] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_203, Mul_204) (PointWiseV2) [03/13/2022-08:31:35] [V] [TRT] Tactic: 0 time 0.027736 [03/13/2022-08:31:35] [V] [TRT] Tactic: 1 time 0.022768 [03/13/2022-08:31:35] [V] [TRT] Tactic: 2 time 0.019112 [03/13/2022-08:31:35] [V] [TRT] Tactic: 3 time 0.020508 [03/13/2022-08:31:35] [V] [TRT] Tactic: 4 time 0.016268 [03/13/2022-08:31:35] [V] [TRT] Tactic: 5 time 0.01424 [03/13/2022-08:31:35] [V] [TRT] Tactic: 6 time 0.021148 [03/13/2022-08:31:35] [V] [TRT] Tactic: 7 time 0.0161 [03/13/2022-08:31:35] [V] [TRT] Tactic: 8 time 0.014064 [03/13/2022-08:31:35] [V] [TRT] Tactic: 9 time 0.01352 [03/13/2022-08:31:35] [V] [TRT] Tactic: 28 time 0.028048 [03/13/2022-08:31:35] [V] [TRT] Fastest Tactic: 9 Time: 0.01352 [03/13/2022-08:31:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:35] [V] [TRT] [03/13/2022-08:31:35] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800:2,192000) *************** [03/13/2022-08:31:35] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_203, Mul_204) (PointWise) [03/13/2022-08:31:35] [V] [TRT] Tactic: 128 time 0.042004 [03/13/2022-08:31:35] [V] [TRT] Tactic: 256 time 0.035572 [03/13/2022-08:31:35] [V] [TRT] Tactic: 512 time 0.035948 [03/13/2022-08:31:35] [V] [TRT] Tactic: -32 time 0.05694 [03/13/2022-08:31:35] [V] [TRT] Tactic: -64 time 0.040052 [03/13/2022-08:31:35] [V] [TRT] Tactic: -128 time 0.038752 [03/13/2022-08:31:35] [V] [TRT] Fastest Tactic: 256 Time: 0.035572 [03/13/2022-08:31:35] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_203, Mul_204) (PointWiseV2) [03/13/2022-08:31:35] [V] [TRT] Tactic: 0 time 0.019332 [03/13/2022-08:31:35] [V] [TRT] Tactic: 1 time 0.016808 [03/13/2022-08:31:35] [V] [TRT] Tactic: 2 time 0.01722 [03/13/2022-08:31:35] [V] [TRT] Tactic: 3 time 0.016792 [03/13/2022-08:31:35] [V] [TRT] Tactic: 4 time 0.01676 [03/13/2022-08:31:35] [V] [TRT] Tactic: 5 time 0.018292 [03/13/2022-08:31:35] [V] [TRT] Tactic: 6 time 0.016648 [03/13/2022-08:31:35] [V] [TRT] Tactic: 7 time 0.016816 [03/13/2022-08:31:35] [V] [TRT] Tactic: 8 time 0.018476 [03/13/2022-08:31:35] [V] [TRT] Tactic: 9 time 0.022364 [03/13/2022-08:31:35] [V] [TRT] Tactic: 10 time 0.028644 [03/13/2022-08:31:35] [V] [TRT] Tactic: 11 time 0.023016 [03/13/2022-08:31:35] [V] [TRT] Tactic: 12 time 0.019384 [03/13/2022-08:31:35] [V] [TRT] Tactic: 13 time 0.020836 [03/13/2022-08:31:35] [V] [TRT] Tactic: 14 time 0.016428 [03/13/2022-08:31:35] [V] [TRT] Tactic: 15 time 0.014704 [03/13/2022-08:31:35] [V] [TRT] Tactic: 16 time 0.021004 [03/13/2022-08:31:35] [V] [TRT] Tactic: 17 time 0.016132 [03/13/2022-08:31:35] [V] [TRT] Tactic: 18 time 0.013984 [03/13/2022-08:31:35] [V] [TRT] Tactic: 19 time 0.013972 [03/13/2022-08:31:35] [V] [TRT] Tactic: 28 time 0.019156 [03/13/2022-08:31:35] [V] [TRT] Tactic: 29 time 0.028692 [03/13/2022-08:31:35] [V] [TRT] Fastest Tactic: 19 Time: 0.013972 [03/13/2022-08:31:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 19 [03/13/2022-08:31:35] [V] [TRT] [03/13/2022-08:31:35] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Half(10,800,1:8,48000) *************** [03/13/2022-08:31:35] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_203, Mul_204) (PointWise) [03/13/2022-08:31:35] [V] [TRT] Tactic: 128 time 0.041916 [03/13/2022-08:31:35] [V] [TRT] Tactic: 256 time 0.035884 [03/13/2022-08:31:35] [V] [TRT] Tactic: 512 time 0.035844 [03/13/2022-08:31:35] [V] [TRT] Tactic: -32 time 0.080696 [03/13/2022-08:31:35] [V] [TRT] Tactic: -64 time 0.06558 [03/13/2022-08:31:35] [V] [TRT] Tactic: -128 time 0.065672 [03/13/2022-08:31:35] [V] [TRT] Fastest Tactic: 512 Time: 0.035844 [03/13/2022-08:31:35] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_203, Mul_204) (PointWiseV2) [03/13/2022-08:31:35] [V] [TRT] Tactic: 0 time 0.028016 [03/13/2022-08:31:35] [V] [TRT] Tactic: 1 time 0.030828 [03/13/2022-08:31:35] [V] [TRT] Tactic: 2 time 0.030556 [03/13/2022-08:31:35] [V] [TRT] Tactic: 3 time 0.03914 [03/13/2022-08:31:35] [V] [TRT] Tactic: 4 time 0.036388 [03/13/2022-08:31:35] [V] [TRT] Tactic: 5 time 0.032508 [03/13/2022-08:31:35] [V] [TRT] Tactic: 6 time 0.058132 [03/13/2022-08:31:35] [V] [TRT] Tactic: 7 time 0.046088 [03/13/2022-08:31:35] [V] [TRT] Tactic: 8 time 0.040872 [03/13/2022-08:31:35] [V] [TRT] Tactic: 9 time 0.0459 [03/13/2022-08:31:35] [V] [TRT] Tactic: 10 time 0.02122 [03/13/2022-08:31:35] [V] [TRT] Tactic: 11 time 0.022812 [03/13/2022-08:31:36] [V] [TRT] Tactic: 12 time 0.022344 [03/13/2022-08:31:36] [V] [TRT] Tactic: 13 time 0.02678 [03/13/2022-08:31:36] [V] [TRT] Tactic: 14 time 0.026068 [03/13/2022-08:31:36] [V] [TRT] Tactic: 15 time 0.023116 [03/13/2022-08:31:36] [V] [TRT] Tactic: 16 time 0.03652 [03/13/2022-08:31:36] [V] [TRT] Tactic: 17 time 0.031428 [03/13/2022-08:31:36] [V] [TRT] Tactic: 18 time 0.028676 [03/13/2022-08:31:36] [V] [TRT] Tactic: 19 time 0.02736 [03/13/2022-08:31:36] [V] [TRT] Tactic: 20 time 0.028808 [03/13/2022-08:31:36] [V] [TRT] Tactic: 21 time 0.022888 [03/13/2022-08:31:36] [V] [TRT] Tactic: 22 time 0.02524 [03/13/2022-08:31:36] [V] [TRT] Tactic: 23 time 0.030744 [03/13/2022-08:31:36] [V] [TRT] Tactic: 24 time 0.033776 [03/13/2022-08:31:36] [V] [TRT] Tactic: 25 time 0.031248 [03/13/2022-08:31:36] [V] [TRT] Tactic: 26 time 0.025436 [03/13/2022-08:31:36] [V] [TRT] Tactic: 27 time 0.029416 [03/13/2022-08:31:36] [V] [TRT] Tactic: 28 time 0.01604 [03/13/2022-08:31:36] [V] [TRT] Tactic: 29 time 0.015368 [03/13/2022-08:31:36] [V] [TRT] Tactic: 30 time 0.02008 [03/13/2022-08:31:36] [V] [TRT] Tactic: 31 time 0.029268 [03/13/2022-08:31:36] [V] [TRT] Fastest Tactic: 29 Time: 0.015368 [03/13/2022-08:31:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 29 [03/13/2022-08:31:36] [V] [TRT] [03/13/2022-08:31:36] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,384000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:31:36] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,384000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:31:36] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: Conv_205 (FusedConvActConvolution) [03/13/2022-08:31:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: Conv_205 (CaskConvolution) [03/13/2022-08:31:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: Conv_205 (CudaConvolution) [03/13/2022-08:31:36] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: Conv_205 (CudaDepthwiseConvolution) [03/13/2022-08:31:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:36] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800:2,192000) *************** [03/13/2022-08:31:36] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: Conv_205 (FusedConvActConvolution) [03/13/2022-08:31:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: Conv_205 (CaskConvolution) [03/13/2022-08:31:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: Conv_205 (CudaConvolution) [03/13/2022-08:31:36] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: Conv_205 (CudaDepthwiseConvolution) [03/13/2022-08:31:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:36] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Half(10,800,1:8,48000) *************** [03/13/2022-08:31:36] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,384000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:31:36] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,384000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:31:36] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: Conv_460 (FusedConvActConvolution) [03/13/2022-08:31:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: Conv_460 (CaskConvolution) [03/13/2022-08:31:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: Conv_460 (CudaConvolution) [03/13/2022-08:31:36] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: Conv_460 (CudaDepthwiseConvolution) [03/13/2022-08:31:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:36] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800:2,192000) *************** [03/13/2022-08:31:36] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: Conv_460 (FusedConvActConvolution) [03/13/2022-08:31:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: Conv_460 (CaskConvolution) [03/13/2022-08:31:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: Conv_460 (CudaConvolution) [03/13/2022-08:31:36] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: Conv_460 (CudaDepthwiseConvolution) [03/13/2022-08:31:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:36] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Half(10,800,1:8,48000) *************** [03/13/2022-08:31:36] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,384000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_207, Mul_208) (PointWise) [03/13/2022-08:31:36] [V] [TRT] Tactic: 128 time 0.037428 [03/13/2022-08:31:36] [V] [TRT] Tactic: 256 time 0.037712 [03/13/2022-08:31:36] [V] [TRT] Tactic: 512 time 0.041824 [03/13/2022-08:31:36] [V] [TRT] Tactic: -32 time 0.063764 [03/13/2022-08:31:36] [V] [TRT] Tactic: -64 time 0.041432 [03/13/2022-08:31:36] [V] [TRT] Tactic: -128 time 0.039508 [03/13/2022-08:31:36] [V] [TRT] Fastest Tactic: 128 Time: 0.037428 [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_207, Mul_208) (PointWiseV2) [03/13/2022-08:31:36] [V] [TRT] Tactic: 0 time 0.02742 [03/13/2022-08:31:36] [V] [TRT] Tactic: 1 time 0.023328 [03/13/2022-08:31:36] [V] [TRT] Tactic: 2 time 0.022544 [03/13/2022-08:31:36] [V] [TRT] Tactic: 3 time 0.023448 [03/13/2022-08:31:36] [V] [TRT] Tactic: 4 time 0.022892 [03/13/2022-08:31:36] [V] [TRT] Tactic: 5 time 0.022512 [03/13/2022-08:31:36] [V] [TRT] Tactic: 6 time 0.02532 [03/13/2022-08:31:36] [V] [TRT] Tactic: 7 time 0.023056 [03/13/2022-08:31:36] [V] [TRT] Tactic: 8 time 0.022884 [03/13/2022-08:31:36] [V] [TRT] Tactic: 9 time 0.022476 [03/13/2022-08:31:36] [V] [TRT] Tactic: 28 time 0.02706 [03/13/2022-08:31:36] [V] [TRT] Fastest Tactic: 9 Time: 0.022476 [03/13/2022-08:31:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:36] [V] [TRT] [03/13/2022-08:31:36] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,14400) -> Float(1,80,4800:32,14400) *************** [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_207, Mul_208) (PointWise) [03/13/2022-08:31:36] [V] [TRT] Tactic: 128 time 0.055276 [03/13/2022-08:31:36] [V] [TRT] Tactic: 256 time 0.05568 [03/13/2022-08:31:36] [V] [TRT] Tactic: 512 time 0.062248 [03/13/2022-08:31:36] [V] [TRT] Tactic: -32 time 0.08688 [03/13/2022-08:31:36] [V] [TRT] Tactic: -64 time 0.05236 [03/13/2022-08:31:36] [V] [TRT] Tactic: -128 time 0.04782 [03/13/2022-08:31:36] [V] [TRT] Fastest Tactic: -128 Time: 0.04782 [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_207, Mul_208) (PointWiseV2) [03/13/2022-08:31:36] [V] [TRT] Tactic: 24 time 0.030072 [03/13/2022-08:31:36] [V] [TRT] Tactic: 25 time 0.030792 [03/13/2022-08:31:36] [V] [TRT] Tactic: 26 time 0.031452 [03/13/2022-08:31:36] [V] [TRT] Tactic: 27 time 0.032292 [03/13/2022-08:31:36] [V] [TRT] Tactic: 31 time 0.029608 [03/13/2022-08:31:36] [V] [TRT] Fastest Tactic: 31 Time: 0.029608 [03/13/2022-08:31:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [03/13/2022-08:31:36] [V] [TRT] [03/13/2022-08:31:36] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,384000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_207, Mul_208) (PointWise) [03/13/2022-08:31:36] [V] [TRT] Tactic: 128 time 0.038968 [03/13/2022-08:31:36] [V] [TRT] Tactic: 256 time 0.034368 [03/13/2022-08:31:36] [V] [TRT] Tactic: 512 time 0.03444 [03/13/2022-08:31:36] [V] [TRT] Tactic: -32 time 0.05608 [03/13/2022-08:31:36] [V] [TRT] Tactic: -64 time 0.039096 [03/13/2022-08:31:36] [V] [TRT] Tactic: -128 time 0.037584 [03/13/2022-08:31:36] [V] [TRT] Fastest Tactic: 256 Time: 0.034368 [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_207, Mul_208) (PointWiseV2) [03/13/2022-08:31:36] [V] [TRT] Tactic: 0 time 0.026056 [03/13/2022-08:31:36] [V] [TRT] Tactic: 1 time 0.02142 [03/13/2022-08:31:36] [V] [TRT] Tactic: 2 time 0.018528 [03/13/2022-08:31:36] [V] [TRT] Tactic: 3 time 0.019776 [03/13/2022-08:31:36] [V] [TRT] Tactic: 4 time 0.014968 [03/13/2022-08:31:36] [V] [TRT] Tactic: 5 time 0.014756 [03/13/2022-08:31:36] [V] [TRT] Tactic: 6 time 0.024148 [03/13/2022-08:31:36] [V] [TRT] Tactic: 7 time 0.01792 [03/13/2022-08:31:36] [V] [TRT] Tactic: 8 time 0.015124 [03/13/2022-08:31:36] [V] [TRT] Tactic: 9 time 0.014744 [03/13/2022-08:31:36] [V] [TRT] Tactic: 28 time 0.030584 [03/13/2022-08:31:36] [V] [TRT] Fastest Tactic: 9 Time: 0.014744 [03/13/2022-08:31:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:36] [V] [TRT] [03/13/2022-08:31:36] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800:2,192000) *************** [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_207, Mul_208) (PointWise) [03/13/2022-08:31:36] [V] [TRT] Tactic: 128 time 0.049004 [03/13/2022-08:31:36] [V] [TRT] Tactic: 256 time 0.042604 [03/13/2022-08:31:36] [V] [TRT] Tactic: 512 time 0.042468 [03/13/2022-08:31:36] [V] [TRT] Tactic: -32 time 0.070408 [03/13/2022-08:31:36] [V] [TRT] Tactic: -64 time 0.049112 [03/13/2022-08:31:36] [V] [TRT] Tactic: -128 time 0.046904 [03/13/2022-08:31:36] [V] [TRT] Fastest Tactic: 512 Time: 0.042468 [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_207, Mul_208) (PointWiseV2) [03/13/2022-08:31:36] [V] [TRT] Tactic: 0 time 0.022384 [03/13/2022-08:31:36] [V] [TRT] Tactic: 1 time 0.019048 [03/13/2022-08:31:36] [V] [TRT] Tactic: 2 time 0.019732 [03/13/2022-08:31:36] [V] [TRT] Tactic: 3 time 0.019096 [03/13/2022-08:31:36] [V] [TRT] Tactic: 4 time 0.019236 [03/13/2022-08:31:36] [V] [TRT] Tactic: 5 time 0.020292 [03/13/2022-08:31:36] [V] [TRT] Tactic: 6 time 0.0197 [03/13/2022-08:31:36] [V] [TRT] Tactic: 7 time 0.01918 [03/13/2022-08:31:36] [V] [TRT] Tactic: 8 time 0.02056 [03/13/2022-08:31:36] [V] [TRT] Tactic: 9 time 0.023956 [03/13/2022-08:31:36] [V] [TRT] Tactic: 10 time 0.031344 [03/13/2022-08:31:36] [V] [TRT] Tactic: 11 time 0.025688 [03/13/2022-08:31:36] [V] [TRT] Tactic: 12 time 0.022768 [03/13/2022-08:31:36] [V] [TRT] Tactic: 13 time 0.023864 [03/13/2022-08:31:36] [V] [TRT] Tactic: 14 time 0.01866 [03/13/2022-08:31:36] [V] [TRT] Tactic: 15 time 0.01728 [03/13/2022-08:31:36] [V] [TRT] Tactic: 16 time 0.024452 [03/13/2022-08:31:36] [V] [TRT] Tactic: 17 time 0.018376 [03/13/2022-08:31:36] [V] [TRT] Tactic: 18 time 0.015264 [03/13/2022-08:31:36] [V] [TRT] Tactic: 19 time 0.015916 [03/13/2022-08:31:36] [V] [TRT] Tactic: 28 time 0.022036 [03/13/2022-08:31:36] [V] [TRT] Tactic: 29 time 0.031412 [03/13/2022-08:31:36] [V] [TRT] Fastest Tactic: 18 Time: 0.015264 [03/13/2022-08:31:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:31:36] [V] [TRT] [03/13/2022-08:31:36] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Half(10,800,1:8,48000) *************** [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_207, Mul_208) (PointWise) [03/13/2022-08:31:36] [V] [TRT] Tactic: 128 time 0.048584 [03/13/2022-08:31:36] [V] [TRT] Tactic: 256 time 0.042872 [03/13/2022-08:31:36] [V] [TRT] Tactic: 512 time 0.042604 [03/13/2022-08:31:36] [V] [TRT] Tactic: -32 time 0.070404 [03/13/2022-08:31:36] [V] [TRT] Tactic: -64 time 0.049064 [03/13/2022-08:31:36] [V] [TRT] Tactic: -128 time 0.047028 [03/13/2022-08:31:36] [V] [TRT] Fastest Tactic: 512 Time: 0.042604 [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_207, Mul_208) (PointWiseV2) [03/13/2022-08:31:36] [V] [TRT] Tactic: 0 time 0.015744 [03/13/2022-08:31:36] [V] [TRT] Tactic: 1 time 0.015812 [03/13/2022-08:31:36] [V] [TRT] Tactic: 2 time 0.019516 [03/13/2022-08:31:36] [V] [TRT] Tactic: 3 time 0.015868 [03/13/2022-08:31:36] [V] [TRT] Tactic: 4 time 0.020568 [03/13/2022-08:31:36] [V] [TRT] Tactic: 5 time 0.028172 [03/13/2022-08:31:36] [V] [TRT] Tactic: 6 time 0.018128 [03/13/2022-08:31:36] [V] [TRT] Tactic: 7 time 0.020536 [03/13/2022-08:31:36] [V] [TRT] Tactic: 8 time 0.028552 [03/13/2022-08:31:36] [V] [TRT] Tactic: 9 time 0.037044 [03/13/2022-08:31:36] [V] [TRT] Tactic: 10 time 0.017728 [03/13/2022-08:31:36] [V] [TRT] Tactic: 11 time 0.016324 [03/13/2022-08:31:36] [V] [TRT] Tactic: 12 time 0.017432 [03/13/2022-08:31:36] [V] [TRT] Tactic: 13 time 0.015576 [03/13/2022-08:31:36] [V] [TRT] Tactic: 14 time 0.016924 [03/13/2022-08:31:36] [V] [TRT] Tactic: 15 time 0.020832 [03/13/2022-08:31:36] [V] [TRT] Tactic: 16 time 0.01562 [03/13/2022-08:31:36] [V] [TRT] Tactic: 17 time 0.01704 [03/13/2022-08:31:36] [V] [TRT] Tactic: 18 time 0.02258 [03/13/2022-08:31:36] [V] [TRT] Tactic: 19 time 0.028904 [03/13/2022-08:31:36] [V] [TRT] Tactic: 20 time 0.022456 [03/13/2022-08:31:36] [V] [TRT] Tactic: 21 time 0.019196 [03/13/2022-08:31:36] [V] [TRT] Tactic: 22 time 0.019408 [03/13/2022-08:31:36] [V] [TRT] Tactic: 23 time 0.019016 [03/13/2022-08:31:36] [V] [TRT] Tactic: 24 time 0.031112 [03/13/2022-08:31:36] [V] [TRT] Tactic: 25 time 0.025804 [03/13/2022-08:31:36] [V] [TRT] Tactic: 26 time 0.023856 [03/13/2022-08:31:36] [V] [TRT] Tactic: 27 time 0.02452 [03/13/2022-08:31:36] [V] [TRT] Tactic: 28 time 0.016068 [03/13/2022-08:31:36] [V] [TRT] Tactic: 29 time 0.017564 [03/13/2022-08:31:36] [V] [TRT] Tactic: 30 time 0.022732 [03/13/2022-08:31:36] [V] [TRT] Tactic: 31 time 0.031444 [03/13/2022-08:31:36] [V] [TRT] Fastest Tactic: 13 Time: 0.015576 [03/13/2022-08:31:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 13 [03/13/2022-08:31:36] [V] [TRT] [03/13/2022-08:31:36] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,384000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_462, Mul_463) (PointWise) [03/13/2022-08:31:36] [V] [TRT] Tactic: 128 time 0.045724 [03/13/2022-08:31:36] [V] [TRT] Tactic: 256 time 0.046776 [03/13/2022-08:31:36] [V] [TRT] Tactic: 512 time 0.05132 [03/13/2022-08:31:36] [V] [TRT] Tactic: -32 time 0.07774 [03/13/2022-08:31:36] [V] [TRT] Tactic: -64 time 0.051292 [03/13/2022-08:31:36] [V] [TRT] Tactic: -128 time 0.04876 [03/13/2022-08:31:36] [V] [TRT] Fastest Tactic: 128 Time: 0.045724 [03/13/2022-08:31:36] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_462, Mul_463) (PointWiseV2) [03/13/2022-08:31:36] [V] [TRT] Tactic: 0 time 0.032208 [03/13/2022-08:31:36] [V] [TRT] Tactic: 1 time 0.027132 [03/13/2022-08:31:36] [V] [TRT] Tactic: 2 time 0.023312 [03/13/2022-08:31:37] [V] [TRT] Tactic: 3 time 0.025644 [03/13/2022-08:31:37] [V] [TRT] Tactic: 4 time 0.023216 [03/13/2022-08:31:37] [V] [TRT] Tactic: 5 time 0.023088 [03/13/2022-08:31:37] [V] [TRT] Tactic: 6 time 0.02756 [03/13/2022-08:31:37] [V] [TRT] Tactic: 7 time 0.023416 [03/13/2022-08:31:37] [V] [TRT] Tactic: 8 time 0.023148 [03/13/2022-08:31:37] [V] [TRT] Tactic: 9 time 0.023156 [03/13/2022-08:31:37] [V] [TRT] Tactic: 28 time 0.032292 [03/13/2022-08:31:37] [V] [TRT] Fastest Tactic: 5 Time: 0.023088 [03/13/2022-08:31:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [03/13/2022-08:31:37] [V] [TRT] [03/13/2022-08:31:37] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,14400) -> Float(1,80,4800:32,14400) *************** [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_462, Mul_463) (PointWise) [03/13/2022-08:31:37] [V] [TRT] Tactic: 128 time 0.06934 [03/13/2022-08:31:37] [V] [TRT] Tactic: 256 time 0.07004 [03/13/2022-08:31:37] [V] [TRT] Tactic: 512 time 0.077708 [03/13/2022-08:31:37] [V] [TRT] Tactic: -32 time 0.106288 [03/13/2022-08:31:37] [V] [TRT] Tactic: -64 time 0.064136 [03/13/2022-08:31:37] [V] [TRT] Tactic: -128 time 0.0594 [03/13/2022-08:31:37] [V] [TRT] Fastest Tactic: -128 Time: 0.0594 [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_462, Mul_463) (PointWiseV2) [03/13/2022-08:31:37] [V] [TRT] Tactic: 24 time 0.030236 [03/13/2022-08:31:37] [V] [TRT] Tactic: 25 time 0.031192 [03/13/2022-08:31:37] [V] [TRT] Tactic: 26 time 0.031992 [03/13/2022-08:31:37] [V] [TRT] Tactic: 27 time 0.033304 [03/13/2022-08:31:37] [V] [TRT] Tactic: 31 time 0.030112 [03/13/2022-08:31:37] [V] [TRT] Fastest Tactic: 31 Time: 0.030112 [03/13/2022-08:31:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [03/13/2022-08:31:37] [V] [TRT] [03/13/2022-08:31:37] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,384000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_462, Mul_463) (PointWise) [03/13/2022-08:31:37] [V] [TRT] Tactic: 128 time 0.04894 [03/13/2022-08:31:37] [V] [TRT] Tactic: 256 time 0.042676 [03/13/2022-08:31:37] [V] [TRT] Tactic: 512 time 0.042252 [03/13/2022-08:31:37] [V] [TRT] Tactic: -32 time 0.070068 [03/13/2022-08:31:37] [V] [TRT] Tactic: -64 time 0.049076 [03/13/2022-08:31:37] [V] [TRT] Tactic: -128 time 0.046992 [03/13/2022-08:31:37] [V] [TRT] Fastest Tactic: 512 Time: 0.042252 [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_462, Mul_463) (PointWiseV2) [03/13/2022-08:31:37] [V] [TRT] Tactic: 0 time 0.030596 [03/13/2022-08:31:37] [V] [TRT] Tactic: 1 time 0.025464 [03/13/2022-08:31:37] [V] [TRT] Tactic: 2 time 0.022088 [03/13/2022-08:31:37] [V] [TRT] Tactic: 3 time 0.023324 [03/13/2022-08:31:37] [V] [TRT] Tactic: 4 time 0.018124 [03/13/2022-08:31:37] [V] [TRT] Tactic: 5 time 0.016372 [03/13/2022-08:31:37] [V] [TRT] Tactic: 6 time 0.024076 [03/13/2022-08:31:37] [V] [TRT] Tactic: 7 time 0.01818 [03/13/2022-08:31:37] [V] [TRT] Tactic: 8 time 0.015124 [03/13/2022-08:31:37] [V] [TRT] Tactic: 9 time 0.014596 [03/13/2022-08:31:37] [V] [TRT] Tactic: 28 time 0.030588 [03/13/2022-08:31:37] [V] [TRT] Fastest Tactic: 9 Time: 0.014596 [03/13/2022-08:31:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:37] [V] [TRT] [03/13/2022-08:31:37] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800:2,192000) *************** [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_462, Mul_463) (PointWise) [03/13/2022-08:31:37] [V] [TRT] Tactic: 128 time 0.048796 [03/13/2022-08:31:37] [V] [TRT] Tactic: 256 time 0.042568 [03/13/2022-08:31:37] [V] [TRT] Tactic: 512 time 0.042696 [03/13/2022-08:31:37] [V] [TRT] Tactic: -32 time 0.069764 [03/13/2022-08:31:37] [V] [TRT] Tactic: -64 time 0.049072 [03/13/2022-08:31:37] [V] [TRT] Tactic: -128 time 0.047024 [03/13/2022-08:31:37] [V] [TRT] Fastest Tactic: 256 Time: 0.042568 [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_462, Mul_463) (PointWiseV2) [03/13/2022-08:31:37] [V] [TRT] Tactic: 0 time 0.022316 [03/13/2022-08:31:37] [V] [TRT] Tactic: 1 time 0.019148 [03/13/2022-08:31:37] [V] [TRT] Tactic: 2 time 0.019012 [03/13/2022-08:31:37] [V] [TRT] Tactic: 3 time 0.01922 [03/13/2022-08:31:37] [V] [TRT] Tactic: 4 time 0.019068 [03/13/2022-08:31:37] [V] [TRT] Tactic: 5 time 0.020208 [03/13/2022-08:31:37] [V] [TRT] Tactic: 6 time 0.019024 [03/13/2022-08:31:37] [V] [TRT] Tactic: 7 time 0.01908 [03/13/2022-08:31:37] [V] [TRT] Tactic: 8 time 0.020444 [03/13/2022-08:31:37] [V] [TRT] Tactic: 9 time 0.023564 [03/13/2022-08:31:37] [V] [TRT] Tactic: 10 time 0.031616 [03/13/2022-08:31:37] [V] [TRT] Tactic: 11 time 0.025848 [03/13/2022-08:31:37] [V] [TRT] Tactic: 12 time 0.022784 [03/13/2022-08:31:37] [V] [TRT] Tactic: 13 time 0.023524 [03/13/2022-08:31:37] [V] [TRT] Tactic: 14 time 0.0186 [03/13/2022-08:31:37] [V] [TRT] Tactic: 15 time 0.017164 [03/13/2022-08:31:37] [V] [TRT] Tactic: 16 time 0.024524 [03/13/2022-08:31:37] [V] [TRT] Tactic: 17 time 0.018348 [03/13/2022-08:31:37] [V] [TRT] Tactic: 18 time 0.015032 [03/13/2022-08:31:37] [V] [TRT] Tactic: 19 time 0.016032 [03/13/2022-08:31:37] [V] [TRT] Tactic: 28 time 0.022404 [03/13/2022-08:31:37] [V] [TRT] Tactic: 29 time 0.031384 [03/13/2022-08:31:37] [V] [TRT] Fastest Tactic: 18 Time: 0.015032 [03/13/2022-08:31:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:31:37] [V] [TRT] [03/13/2022-08:31:37] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Half(10,800,1:8,48000) *************** [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_462, Mul_463) (PointWise) [03/13/2022-08:31:37] [V] [TRT] Tactic: 128 time 0.049084 [03/13/2022-08:31:37] [V] [TRT] Tactic: 256 time 0.042344 [03/13/2022-08:31:37] [V] [TRT] Tactic: 512 time 0.042424 [03/13/2022-08:31:37] [V] [TRT] Tactic: -32 time 0.070144 [03/13/2022-08:31:37] [V] [TRT] Tactic: -64 time 0.049096 [03/13/2022-08:31:37] [V] [TRT] Tactic: -128 time 0.046976 [03/13/2022-08:31:37] [V] [TRT] Fastest Tactic: 256 Time: 0.042344 [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_462, Mul_463) (PointWiseV2) [03/13/2022-08:31:37] [V] [TRT] Tactic: 0 time 0.01568 [03/13/2022-08:31:37] [V] [TRT] Tactic: 1 time 0.015636 [03/13/2022-08:31:37] [V] [TRT] Tactic: 2 time 0.019444 [03/13/2022-08:31:37] [V] [TRT] Tactic: 3 time 0.015928 [03/13/2022-08:31:37] [V] [TRT] Tactic: 4 time 0.020744 [03/13/2022-08:31:37] [V] [TRT] Tactic: 5 time 0.028008 [03/13/2022-08:31:37] [V] [TRT] Tactic: 6 time 0.0184 [03/13/2022-08:31:37] [V] [TRT] Tactic: 7 time 0.020428 [03/13/2022-08:31:37] [V] [TRT] Tactic: 8 time 0.028064 [03/13/2022-08:31:37] [V] [TRT] Tactic: 9 time 0.0365 [03/13/2022-08:31:37] [V] [TRT] Tactic: 10 time 0.017684 [03/13/2022-08:31:37] [V] [TRT] Tactic: 11 time 0.015732 [03/13/2022-08:31:37] [V] [TRT] Tactic: 12 time 0.01776 [03/13/2022-08:31:37] [V] [TRT] Tactic: 13 time 0.015576 [03/13/2022-08:31:37] [V] [TRT] Tactic: 14 time 0.016764 [03/13/2022-08:31:37] [V] [TRT] Tactic: 15 time 0.02138 [03/13/2022-08:31:37] [V] [TRT] Tactic: 16 time 0.015224 [03/13/2022-08:31:37] [V] [TRT] Tactic: 17 time 0.017548 [03/13/2022-08:31:37] [V] [TRT] Tactic: 18 time 0.022472 [03/13/2022-08:31:37] [V] [TRT] Tactic: 19 time 0.028672 [03/13/2022-08:31:37] [V] [TRT] Tactic: 20 time 0.022716 [03/13/2022-08:31:37] [V] [TRT] Tactic: 21 time 0.019248 [03/13/2022-08:31:37] [V] [TRT] Tactic: 22 time 0.019088 [03/13/2022-08:31:37] [V] [TRT] Tactic: 23 time 0.019352 [03/13/2022-08:31:37] [V] [TRT] Tactic: 24 time 0.031476 [03/13/2022-08:31:37] [V] [TRT] Tactic: 25 time 0.025628 [03/13/2022-08:31:37] [V] [TRT] Tactic: 26 time 0.023696 [03/13/2022-08:31:37] [V] [TRT] Tactic: 27 time 0.024428 [03/13/2022-08:31:37] [V] [TRT] Tactic: 28 time 0.015548 [03/13/2022-08:31:37] [V] [TRT] Tactic: 29 time 0.017628 [03/13/2022-08:31:37] [V] [TRT] Tactic: 30 time 0.022512 [03/13/2022-08:31:37] [V] [TRT] Tactic: 31 time 0.031304 [03/13/2022-08:31:37] [V] [TRT] Fastest Tactic: 16 Time: 0.015224 [03/13/2022-08:31:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 16 [03/13/2022-08:31:37] [V] [TRT] [03/13/2022-08:31:37] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,384000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:31:37] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,384000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:31:37] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800:2,192000) *************** [03/13/2022-08:31:37] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: Conv_464 (FusedConvActConvolution) [03/13/2022-08:31:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: Conv_464 (CaskConvolution) [03/13/2022-08:31:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: Conv_464 (CudaConvolution) [03/13/2022-08:31:37] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: Conv_464 (CudaDepthwiseConvolution) [03/13/2022-08:31:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:37] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Half(10,800,1:8,48000) *************** [03/13/2022-08:31:37] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,384000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:31:37] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,384000) -> Half(1,80,4800,384000) *************** [03/13/2022-08:31:37] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800:2,192000) *************** [03/13/2022-08:31:37] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Float(1,80,4800,384000) *************** [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: Conv_209 (FusedConvActConvolution) [03/13/2022-08:31:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: Conv_209 (CaskConvolution) [03/13/2022-08:31:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: Conv_209 (CudaConvolution) [03/13/2022-08:31:37] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: Conv_209 (CudaDepthwiseConvolution) [03/13/2022-08:31:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:37] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Half(10,800,1:8,48000) *************** [03/13/2022-08:31:37] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,384000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_466, Mul_467) (PointWise) [03/13/2022-08:31:37] [V] [TRT] Tactic: 128 time 0.052972 [03/13/2022-08:31:37] [V] [TRT] Tactic: 256 time 0.05366 [03/13/2022-08:31:37] [V] [TRT] Tactic: 512 time 0.059368 [03/13/2022-08:31:37] [V] [TRT] Tactic: -32 time 0.07806 [03/13/2022-08:31:37] [V] [TRT] Tactic: -64 time 0.051824 [03/13/2022-08:31:37] [V] [TRT] Tactic: -128 time 0.049508 [03/13/2022-08:31:37] [V] [TRT] Fastest Tactic: -128 Time: 0.049508 [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_466, Mul_467) (PointWiseV2) [03/13/2022-08:31:37] [V] [TRT] Tactic: 0 time 0.0347 [03/13/2022-08:31:37] [V] [TRT] Tactic: 1 time 0.02864 [03/13/2022-08:31:37] [V] [TRT] Tactic: 2 time 0.024016 [03/13/2022-08:31:37] [V] [TRT] Tactic: 3 time 0.02696 [03/13/2022-08:31:37] [V] [TRT] Tactic: 4 time 0.022916 [03/13/2022-08:31:37] [V] [TRT] Tactic: 5 time 0.022932 [03/13/2022-08:31:37] [V] [TRT] Tactic: 6 time 0.027672 [03/13/2022-08:31:37] [V] [TRT] Tactic: 7 time 0.023444 [03/13/2022-08:31:37] [V] [TRT] Tactic: 8 time 0.023148 [03/13/2022-08:31:37] [V] [TRT] Tactic: 9 time 0.023056 [03/13/2022-08:31:37] [V] [TRT] Tactic: 28 time 0.034564 [03/13/2022-08:31:37] [V] [TRT] Fastest Tactic: 4 Time: 0.022916 [03/13/2022-08:31:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [03/13/2022-08:31:37] [V] [TRT] [03/13/2022-08:31:37] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,14400) -> Float(1,80,4800:32,24000) *************** [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_466, Mul_467) (PointWise) [03/13/2022-08:31:37] [V] [TRT] Tactic: 128 time 0.0696 [03/13/2022-08:31:37] [V] [TRT] Tactic: 256 time 0.070004 [03/13/2022-08:31:37] [V] [TRT] Tactic: 512 time 0.077712 [03/13/2022-08:31:37] [V] [TRT] Tactic: -32 time 0.105612 [03/13/2022-08:31:37] [V] [TRT] Tactic: -64 time 0.064248 [03/13/2022-08:31:37] [V] [TRT] Tactic: -128 time 0.059092 [03/13/2022-08:31:37] [V] [TRT] Fastest Tactic: -128 Time: 0.059092 [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_466, Mul_467) (PointWiseV2) [03/13/2022-08:31:37] [V] [TRT] Tactic: 24 time 0.030084 [03/13/2022-08:31:37] [V] [TRT] Tactic: 25 time 0.031164 [03/13/2022-08:31:37] [V] [TRT] Tactic: 26 time 0.031952 [03/13/2022-08:31:37] [V] [TRT] Tactic: 27 time 0.0334 [03/13/2022-08:31:37] [V] [TRT] Tactic: 31 time 0.030244 [03/13/2022-08:31:37] [V] [TRT] Fastest Tactic: 24 Time: 0.030084 [03/13/2022-08:31:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [03/13/2022-08:31:37] [V] [TRT] [03/13/2022-08:31:37] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,384000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_466, Mul_467) (PointWise) [03/13/2022-08:31:37] [V] [TRT] Tactic: 128 time 0.052572 [03/13/2022-08:31:37] [V] [TRT] Tactic: 256 time 0.043768 [03/13/2022-08:31:37] [V] [TRT] Tactic: 512 time 0.043756 [03/13/2022-08:31:37] [V] [TRT] Tactic: -32 time 0.07126 [03/13/2022-08:31:37] [V] [TRT] Tactic: -64 time 0.049768 [03/13/2022-08:31:37] [V] [TRT] Tactic: -128 time 0.048756 [03/13/2022-08:31:37] [V] [TRT] Fastest Tactic: 512 Time: 0.043756 [03/13/2022-08:31:37] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_466, Mul_467) (PointWiseV2) [03/13/2022-08:31:37] [V] [TRT] Tactic: 0 time 0.032752 [03/13/2022-08:31:37] [V] [TRT] Tactic: 1 time 0.027084 [03/13/2022-08:31:37] [V] [TRT] Tactic: 2 time 0.022768 [03/13/2022-08:31:37] [V] [TRT] Tactic: 3 time 0.02438 [03/13/2022-08:31:37] [V] [TRT] Tactic: 4 time 0.019164 [03/13/2022-08:31:37] [V] [TRT] Tactic: 5 time 0.016924 [03/13/2022-08:31:37] [V] [TRT] Tactic: 6 time 0.024968 [03/13/2022-08:31:37] [V] [TRT] Tactic: 7 time 0.018872 [03/13/2022-08:31:37] [V] [TRT] Tactic: 8 time 0.015352 [03/13/2022-08:31:38] [V] [TRT] Tactic: 9 time 0.014588 [03/13/2022-08:31:38] [V] [TRT] Tactic: 28 time 0.032716 [03/13/2022-08:31:38] [V] [TRT] Fastest Tactic: 9 Time: 0.014588 [03/13/2022-08:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:38] [V] [TRT] [03/13/2022-08:31:38] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800:2,384000) *************** [03/13/2022-08:31:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_466, Mul_467) (PointWise) [03/13/2022-08:31:38] [V] [TRT] Tactic: 128 time 0.052624 [03/13/2022-08:31:38] [V] [TRT] Tactic: 256 time 0.044624 [03/13/2022-08:31:38] [V] [TRT] Tactic: 512 time 0.044964 [03/13/2022-08:31:38] [V] [TRT] Tactic: -32 time 0.07046 [03/13/2022-08:31:38] [V] [TRT] Tactic: -64 time 0.050132 [03/13/2022-08:31:38] [V] [TRT] Tactic: -128 time 0.048744 [03/13/2022-08:31:38] [V] [TRT] Fastest Tactic: 256 Time: 0.044624 [03/13/2022-08:31:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_466, Mul_467) (PointWiseV2) [03/13/2022-08:31:38] [V] [TRT] Tactic: 0 time 0.023696 [03/13/2022-08:31:38] [V] [TRT] Tactic: 1 time 0.020116 [03/13/2022-08:31:38] [V] [TRT] Tactic: 2 time 0.020044 [03/13/2022-08:31:38] [V] [TRT] Tactic: 3 time 0.019348 [03/13/2022-08:31:38] [V] [TRT] Tactic: 4 time 0.019644 [03/13/2022-08:31:38] [V] [TRT] Tactic: 5 time 0.020404 [03/13/2022-08:31:38] [V] [TRT] Tactic: 6 time 0.01948 [03/13/2022-08:31:38] [V] [TRT] Tactic: 7 time 0.018984 [03/13/2022-08:31:38] [V] [TRT] Tactic: 8 time 0.020948 [03/13/2022-08:31:38] [V] [TRT] Tactic: 9 time 0.024224 [03/13/2022-08:31:38] [V] [TRT] Tactic: 10 time 0.034404 [03/13/2022-08:31:38] [V] [TRT] Tactic: 11 time 0.02736 [03/13/2022-08:31:38] [V] [TRT] Tactic: 12 time 0.023544 [03/13/2022-08:31:38] [V] [TRT] Tactic: 13 time 0.02448 [03/13/2022-08:31:38] [V] [TRT] Tactic: 14 time 0.019952 [03/13/2022-08:31:38] [V] [TRT] Tactic: 15 time 0.017812 [03/13/2022-08:31:38] [V] [TRT] Tactic: 16 time 0.024868 [03/13/2022-08:31:38] [V] [TRT] Tactic: 17 time 0.01904 [03/13/2022-08:31:38] [V] [TRT] Tactic: 18 time 0.015648 [03/13/2022-08:31:38] [V] [TRT] Tactic: 19 time 0.015744 [03/13/2022-08:31:38] [V] [TRT] Tactic: 28 time 0.023788 [03/13/2022-08:31:38] [V] [TRT] Tactic: 29 time 0.034012 [03/13/2022-08:31:38] [V] [TRT] Fastest Tactic: 18 Time: 0.015648 [03/13/2022-08:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:31:38] [V] [TRT] [03/13/2022-08:31:38] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Half(20,1600,1:8,96000) *************** [03/13/2022-08:31:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_466, Mul_467) (PointWise) [03/13/2022-08:31:38] [V] [TRT] Tactic: 128 time 0.051896 [03/13/2022-08:31:38] [V] [TRT] Tactic: 256 time 0.044128 [03/13/2022-08:31:38] [V] [TRT] Tactic: 512 time 0.043804 [03/13/2022-08:31:38] [V] [TRT] Tactic: -32 time 0.102088 [03/13/2022-08:31:38] [V] [TRT] Tactic: -64 time 0.0838 [03/13/2022-08:31:38] [V] [TRT] Tactic: -128 time 0.083736 [03/13/2022-08:31:38] [V] [TRT] Fastest Tactic: 512 Time: 0.043804 [03/13/2022-08:31:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_466, Mul_467) (PointWiseV2) [03/13/2022-08:31:38] [V] [TRT] Tactic: 0 time 0.034668 [03/13/2022-08:31:38] [V] [TRT] Tactic: 1 time 0.03864 [03/13/2022-08:31:38] [V] [TRT] Tactic: 2 time 0.037492 [03/13/2022-08:31:38] [V] [TRT] Tactic: 3 time 0.049672 [03/13/2022-08:31:38] [V] [TRT] Tactic: 4 time 0.045676 [03/13/2022-08:31:38] [V] [TRT] Tactic: 5 time 0.040036 [03/13/2022-08:31:38] [V] [TRT] Tactic: 6 time 0.074408 [03/13/2022-08:31:38] [V] [TRT] Tactic: 7 time 0.057912 [03/13/2022-08:31:38] [V] [TRT] Tactic: 8 time 0.0512 [03/13/2022-08:31:38] [V] [TRT] Tactic: 9 time 0.05786 [03/13/2022-08:31:38] [V] [TRT] Tactic: 10 time 0.026312 [03/13/2022-08:31:38] [V] [TRT] Tactic: 11 time 0.02796 [03/13/2022-08:31:38] [V] [TRT] Tactic: 12 time 0.027316 [03/13/2022-08:31:38] [V] [TRT] Tactic: 13 time 0.033648 [03/13/2022-08:31:38] [V] [TRT] Tactic: 14 time 0.032508 [03/13/2022-08:31:38] [V] [TRT] Tactic: 15 time 0.028688 [03/13/2022-08:31:38] [V] [TRT] Tactic: 16 time 0.045724 [03/13/2022-08:31:38] [V] [TRT] Tactic: 17 time 0.039724 [03/13/2022-08:31:38] [V] [TRT] Tactic: 18 time 0.035576 [03/13/2022-08:31:38] [V] [TRT] Tactic: 19 time 0.033304 [03/13/2022-08:31:38] [V] [TRT] Tactic: 20 time 0.035336 [03/13/2022-08:31:38] [V] [TRT] Tactic: 21 time 0.027332 [03/13/2022-08:31:38] [V] [TRT] Tactic: 22 time 0.030936 [03/13/2022-08:31:38] [V] [TRT] Tactic: 23 time 0.037572 [03/13/2022-08:31:38] [V] [TRT] Tactic: 24 time 0.04066 [03/13/2022-08:31:38] [V] [TRT] Tactic: 25 time 0.037548 [03/13/2022-08:31:38] [V] [TRT] Tactic: 26 time 0.030624 [03/13/2022-08:31:38] [V] [TRT] Tactic: 27 time 0.035228 [03/13/2022-08:31:38] [V] [TRT] Tactic: 28 time 0.018728 [03/13/2022-08:31:38] [V] [TRT] Tactic: 29 time 0.018052 [03/13/2022-08:31:38] [V] [TRT] Tactic: 30 time 0.0244 [03/13/2022-08:31:38] [V] [TRT] Tactic: 31 time 0.034592 [03/13/2022-08:31:38] [V] [TRT] Fastest Tactic: 29 Time: 0.018052 [03/13/2022-08:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 29 [03/13/2022-08:31:38] [V] [TRT] [03/13/2022-08:31:38] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,768000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:31:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_470, Mul_471) (PointWise) [03/13/2022-08:31:38] [V] [TRT] Tactic: 128 time 0.052972 [03/13/2022-08:31:38] [V] [TRT] Tactic: 256 time 0.053828 [03/13/2022-08:31:38] [V] [TRT] Tactic: 512 time 0.059364 [03/13/2022-08:31:38] [V] [TRT] Tactic: -32 time 0.078612 [03/13/2022-08:31:38] [V] [TRT] Tactic: -64 time 0.051496 [03/13/2022-08:31:38] [V] [TRT] Tactic: -128 time 0.050044 [03/13/2022-08:31:38] [V] [TRT] Fastest Tactic: -128 Time: 0.050044 [03/13/2022-08:31:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_470, Mul_471) (PointWiseV2) [03/13/2022-08:31:38] [V] [TRT] Tactic: 0 time 0.034308 [03/13/2022-08:31:38] [V] [TRT] Tactic: 1 time 0.028376 [03/13/2022-08:31:38] [V] [TRT] Tactic: 2 time 0.024176 [03/13/2022-08:31:38] [V] [TRT] Tactic: 3 time 0.026912 [03/13/2022-08:31:38] [V] [TRT] Tactic: 4 time 0.023376 [03/13/2022-08:31:38] [V] [TRT] Tactic: 5 time 0.022976 [03/13/2022-08:31:38] [V] [TRT] Tactic: 6 time 0.028004 [03/13/2022-08:31:38] [V] [TRT] Tactic: 7 time 0.024076 [03/13/2022-08:31:38] [V] [TRT] Tactic: 8 time 0.022908 [03/13/2022-08:31:38] [V] [TRT] Tactic: 9 time 0.023088 [03/13/2022-08:31:38] [V] [TRT] Tactic: 28 time 0.034388 [03/13/2022-08:31:38] [V] [TRT] Fastest Tactic: 8 Time: 0.022908 [03/13/2022-08:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:31:38] [V] [TRT] [03/13/2022-08:31:38] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,24000) -> Float(1,80,4800:32,24000) *************** [03/13/2022-08:31:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_470, Mul_471) (PointWise) [03/13/2022-08:31:38] [V] [TRT] Tactic: 128 time 0.06934 [03/13/2022-08:31:38] [V] [TRT] Tactic: 256 time 0.069772 [03/13/2022-08:31:38] [V] [TRT] Tactic: 512 time 0.077784 [03/13/2022-08:31:38] [V] [TRT] Tactic: -32 time 0.10536 [03/13/2022-08:31:38] [V] [TRT] Tactic: -64 time 0.064528 [03/13/2022-08:31:38] [V] [TRT] Tactic: -128 time 0.05916 [03/13/2022-08:31:38] [V] [TRT] Fastest Tactic: -128 Time: 0.05916 [03/13/2022-08:31:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_470, Mul_471) (PointWiseV2) [03/13/2022-08:31:38] [V] [TRT] Tactic: 24 time 0.030144 [03/13/2022-08:31:38] [V] [TRT] Tactic: 25 time 0.031172 [03/13/2022-08:31:38] [V] [TRT] Tactic: 26 time 0.03228 [03/13/2022-08:31:38] [V] [TRT] Tactic: 27 time 0.033532 [03/13/2022-08:31:38] [V] [TRT] Tactic: 31 time 0.030532 [03/13/2022-08:31:38] [V] [TRT] Fastest Tactic: 24 Time: 0.030144 [03/13/2022-08:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [03/13/2022-08:31:38] [V] [TRT] [03/13/2022-08:31:38] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,768000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:31:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_470, Mul_471) (PointWise) [03/13/2022-08:31:38] [V] [TRT] Tactic: 128 time 0.052784 [03/13/2022-08:31:38] [V] [TRT] Tactic: 256 time 0.044492 [03/13/2022-08:31:38] [V] [TRT] Tactic: 512 time 0.044924 [03/13/2022-08:31:38] [V] [TRT] Tactic: -32 time 0.070504 [03/13/2022-08:31:38] [V] [TRT] Tactic: -64 time 0.04968 [03/13/2022-08:31:38] [V] [TRT] Tactic: -128 time 0.048732 [03/13/2022-08:31:38] [V] [TRT] Fastest Tactic: 256 Time: 0.044492 [03/13/2022-08:31:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_470, Mul_471) (PointWiseV2) [03/13/2022-08:31:38] [V] [TRT] Tactic: 0 time 0.032768 [03/13/2022-08:31:38] [V] [TRT] Tactic: 1 time 0.027268 [03/13/2022-08:31:38] [V] [TRT] Tactic: 2 time 0.02254 [03/13/2022-08:31:38] [V] [TRT] Tactic: 3 time 0.02436 [03/13/2022-08:31:38] [V] [TRT] Tactic: 4 time 0.019592 [03/13/2022-08:31:38] [V] [TRT] Tactic: 5 time 0.017048 [03/13/2022-08:31:38] [V] [TRT] Tactic: 6 time 0.024984 [03/13/2022-08:31:38] [V] [TRT] Tactic: 7 time 0.0187 [03/13/2022-08:31:38] [V] [TRT] Tactic: 8 time 0.01556 [03/13/2022-08:31:38] [V] [TRT] Tactic: 9 time 0.014552 [03/13/2022-08:31:38] [V] [TRT] Tactic: 28 time 0.032816 [03/13/2022-08:31:38] [V] [TRT] Fastest Tactic: 9 Time: 0.014552 [03/13/2022-08:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:38] [V] [TRT] [03/13/2022-08:31:38] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800:2,384000) *************** [03/13/2022-08:31:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_470, Mul_471) (PointWise) [03/13/2022-08:31:38] [V] [TRT] Tactic: 128 time 0.05248 [03/13/2022-08:31:38] [V] [TRT] Tactic: 256 time 0.043856 [03/13/2022-08:31:38] [V] [TRT] Tactic: 512 time 0.043896 [03/13/2022-08:31:38] [V] [TRT] Tactic: -32 time 0.0704 [03/13/2022-08:31:38] [V] [TRT] Tactic: -64 time 0.049544 [03/13/2022-08:31:38] [V] [TRT] Tactic: -128 time 0.048608 [03/13/2022-08:31:38] [V] [TRT] Fastest Tactic: 256 Time: 0.043856 [03/13/2022-08:31:38] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_470, Mul_471) (PointWiseV2) [03/13/2022-08:31:38] [V] [TRT] Tactic: 0 time 0.023332 [03/13/2022-08:31:38] [V] [TRT] Tactic: 1 time 0.020108 [03/13/2022-08:31:38] [V] [TRT] Tactic: 2 time 0.020308 [03/13/2022-08:31:38] [V] [TRT] Tactic: 3 time 0.019864 [03/13/2022-08:31:38] [V] [TRT] Tactic: 4 time 0.019652 [03/13/2022-08:31:38] [V] [TRT] Tactic: 5 time 0.020472 [03/13/2022-08:31:38] [V] [TRT] Tactic: 6 time 0.019288 [03/13/2022-08:31:38] [V] [TRT] Tactic: 7 time 0.019452 [03/13/2022-08:31:38] [V] [TRT] Tactic: 8 time 0.0205 [03/13/2022-08:31:38] [V] [TRT] Tactic: 9 time 0.024272 [03/13/2022-08:31:38] [V] [TRT] Tactic: 10 time 0.034108 [03/13/2022-08:31:38] [V] [TRT] Tactic: 11 time 0.027164 [03/13/2022-08:31:38] [V] [TRT] Tactic: 12 time 0.0233 [03/13/2022-08:31:38] [V] [TRT] Tactic: 13 time 0.024496 [03/13/2022-08:31:38] [V] [TRT] Tactic: 14 time 0.019976 [03/13/2022-08:31:38] [V] [TRT] Tactic: 15 time 0.01734 [03/13/2022-08:31:38] [V] [TRT] Tactic: 16 time 0.02506 [03/13/2022-08:31:38] [V] [TRT] Tactic: 17 time 0.019008 [03/13/2022-08:31:38] [V] [TRT] Tactic: 18 time 0.015464 [03/13/2022-08:31:38] [V] [TRT] Tactic: 19 time 0.015584 [03/13/2022-08:31:38] [V] [TRT] Tactic: 28 time 0.02298 [03/13/2022-08:31:38] [V] [TRT] Tactic: 29 time 0.033772 [03/13/2022-08:31:38] [V] [TRT] Fastest Tactic: 18 Time: 0.015464 [03/13/2022-08:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:31:38] [V] [TRT] [03/13/2022-08:31:38] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Half(20,1600,1:8,96000) *************** [03/13/2022-08:31:39] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_470, Mul_471) (PointWise) [03/13/2022-08:31:39] [V] [TRT] Tactic: 128 time 0.052244 [03/13/2022-08:31:39] [V] [TRT] Tactic: 256 time 0.044464 [03/13/2022-08:31:39] [V] [TRT] Tactic: 512 time 0.04438 [03/13/2022-08:31:39] [V] [TRT] Tactic: -32 time 0.10502 [03/13/2022-08:31:39] [V] [TRT] Tactic: -64 time 0.083852 [03/13/2022-08:31:39] [V] [TRT] Tactic: -128 time 0.08386 [03/13/2022-08:31:39] [V] [TRT] Fastest Tactic: 512 Time: 0.04438 [03/13/2022-08:31:39] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_470, Mul_471) (PointWiseV2) [03/13/2022-08:31:39] [V] [TRT] Tactic: 0 time 0.034788 [03/13/2022-08:31:39] [V] [TRT] Tactic: 1 time 0.03856 [03/13/2022-08:31:39] [V] [TRT] Tactic: 2 time 0.037664 [03/13/2022-08:31:39] [V] [TRT] Tactic: 3 time 0.049308 [03/13/2022-08:31:39] [V] [TRT] Tactic: 4 time 0.045568 [03/13/2022-08:31:39] [V] [TRT] Tactic: 5 time 0.040116 [03/13/2022-08:31:39] [V] [TRT] Tactic: 6 time 0.074448 [03/13/2022-08:31:39] [V] [TRT] Tactic: 7 time 0.057968 [03/13/2022-08:31:39] [V] [TRT] Tactic: 8 time 0.051516 [03/13/2022-08:31:39] [V] [TRT] Tactic: 9 time 0.058184 [03/13/2022-08:31:39] [V] [TRT] Tactic: 10 time 0.025848 [03/13/2022-08:31:39] [V] [TRT] Tactic: 11 time 0.028232 [03/13/2022-08:31:39] [V] [TRT] Tactic: 12 time 0.027328 [03/13/2022-08:31:39] [V] [TRT] Tactic: 13 time 0.033524 [03/13/2022-08:31:39] [V] [TRT] Tactic: 14 time 0.032344 [03/13/2022-08:31:39] [V] [TRT] Tactic: 15 time 0.028912 [03/13/2022-08:31:39] [V] [TRT] Tactic: 16 time 0.04574 [03/13/2022-08:31:39] [V] [TRT] Tactic: 17 time 0.039632 [03/13/2022-08:31:39] [V] [TRT] Tactic: 18 time 0.03544 [03/13/2022-08:31:39] [V] [TRT] Tactic: 19 time 0.03416 [03/13/2022-08:31:39] [V] [TRT] Tactic: 20 time 0.035184 [03/13/2022-08:31:39] [V] [TRT] Tactic: 21 time 0.029472 [03/13/2022-08:31:39] [V] [TRT] Tactic: 22 time 0.0323 [03/13/2022-08:31:39] [V] [TRT] Tactic: 23 time 0.038632 [03/13/2022-08:31:39] [V] [TRT] Tactic: 24 time 0.040612 [03/13/2022-08:31:39] [V] [TRT] Tactic: 25 time 0.038344 [03/13/2022-08:31:39] [V] [TRT] Tactic: 26 time 0.03182 [03/13/2022-08:31:39] [V] [TRT] Tactic: 27 time 0.036048 [03/13/2022-08:31:39] [V] [TRT] Tactic: 28 time 0.019492 [03/13/2022-08:31:39] [V] [TRT] Tactic: 29 time 0.018212 [03/13/2022-08:31:39] [V] [TRT] Tactic: 30 time 0.024804 [03/13/2022-08:31:39] [V] [TRT] Tactic: 31 time 0.035336 [03/13/2022-08:31:39] [V] [TRT] Fastest Tactic: 29 Time: 0.018212 [03/13/2022-08:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 29 [03/13/2022-08:31:39] [V] [TRT] [03/13/2022-08:31:39] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,384000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:31:39] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_211, Mul_212) (PointWise) [03/13/2022-08:31:39] [V] [TRT] Tactic: 128 time 0.052688 [03/13/2022-08:31:39] [V] [TRT] Tactic: 256 time 0.05428 [03/13/2022-08:31:39] [V] [TRT] Tactic: 512 time 0.059396 [03/13/2022-08:31:39] [V] [TRT] Tactic: -32 time 0.078144 [03/13/2022-08:31:39] [V] [TRT] Tactic: -64 time 0.05174 [03/13/2022-08:31:39] [V] [TRT] Tactic: -128 time 0.049216 [03/13/2022-08:31:39] [V] [TRT] Fastest Tactic: -128 Time: 0.049216 [03/13/2022-08:31:39] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_211, Mul_212) (PointWiseV2) [03/13/2022-08:31:39] [V] [TRT] Tactic: 0 time 0.03464 [03/13/2022-08:31:39] [V] [TRT] Tactic: 1 time 0.028504 [03/13/2022-08:31:39] [V] [TRT] Tactic: 2 time 0.024016 [03/13/2022-08:31:39] [V] [TRT] Tactic: 3 time 0.026612 [03/13/2022-08:31:39] [V] [TRT] Tactic: 4 time 0.023044 [03/13/2022-08:31:39] [V] [TRT] Tactic: 5 time 0.022996 [03/13/2022-08:31:39] [V] [TRT] Tactic: 6 time 0.027844 [03/13/2022-08:31:39] [V] [TRT] Tactic: 7 time 0.023952 [03/13/2022-08:31:39] [V] [TRT] Tactic: 8 time 0.023472 [03/13/2022-08:31:39] [V] [TRT] Tactic: 9 time 0.022972 [03/13/2022-08:31:39] [V] [TRT] Tactic: 28 time 0.03468 [03/13/2022-08:31:39] [V] [TRT] Fastest Tactic: 9 Time: 0.022972 [03/13/2022-08:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:39] [V] [TRT] [03/13/2022-08:31:39] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,14400) -> Float(1,80,4800:32,24000) *************** [03/13/2022-08:31:39] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_211, Mul_212) (PointWise) [03/13/2022-08:31:39] [V] [TRT] Tactic: 128 time 0.069592 [03/13/2022-08:31:39] [V] [TRT] Tactic: 256 time 0.069956 [03/13/2022-08:31:39] [V] [TRT] Tactic: 512 time 0.078568 [03/13/2022-08:31:39] [V] [TRT] Tactic: -32 time 0.10566 [03/13/2022-08:31:39] [V] [TRT] Tactic: -64 time 0.064604 [03/13/2022-08:31:39] [V] [TRT] Tactic: -128 time 0.059304 [03/13/2022-08:31:39] [V] [TRT] Fastest Tactic: -128 Time: 0.059304 [03/13/2022-08:31:39] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_211, Mul_212) (PointWiseV2) [03/13/2022-08:31:39] [V] [TRT] Tactic: 24 time 0.030368 [03/13/2022-08:31:39] [V] [TRT] Tactic: 25 time 0.031196 [03/13/2022-08:31:39] [V] [TRT] Tactic: 26 time 0.032548 [03/13/2022-08:31:39] [V] [TRT] Tactic: 27 time 0.033328 [03/13/2022-08:31:39] [V] [TRT] Tactic: 31 time 0.030316 [03/13/2022-08:31:39] [V] [TRT] Fastest Tactic: 31 Time: 0.030316 [03/13/2022-08:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [03/13/2022-08:31:39] [V] [TRT] [03/13/2022-08:31:39] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,384000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:31:39] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_211, Mul_212) (PointWise) [03/13/2022-08:31:39] [V] [TRT] Tactic: 128 time 0.052324 [03/13/2022-08:31:39] [V] [TRT] Tactic: 256 time 0.04366 [03/13/2022-08:31:39] [V] [TRT] Tactic: 512 time 0.04358 [03/13/2022-08:31:39] [V] [TRT] Tactic: -32 time 0.0705 [03/13/2022-08:31:39] [V] [TRT] Tactic: -64 time 0.04986 [03/13/2022-08:31:39] [V] [TRT] Tactic: -128 time 0.048552 [03/13/2022-08:31:39] [V] [TRT] Fastest Tactic: 512 Time: 0.04358 [03/13/2022-08:31:39] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_211, Mul_212) (PointWiseV2) [03/13/2022-08:31:39] [V] [TRT] Tactic: 0 time 0.032772 [03/13/2022-08:31:39] [V] [TRT] Tactic: 1 time 0.027044 [03/13/2022-08:31:39] [V] [TRT] Tactic: 2 time 0.02266 [03/13/2022-08:31:39] [V] [TRT] Tactic: 3 time 0.024324 [03/13/2022-08:31:39] [V] [TRT] Tactic: 4 time 0.019188 [03/13/2022-08:31:39] [V] [TRT] Tactic: 5 time 0.016928 [03/13/2022-08:31:39] [V] [TRT] Tactic: 6 time 0.024896 [03/13/2022-08:31:39] [V] [TRT] Tactic: 7 time 0.018668 [03/13/2022-08:31:39] [V] [TRT] Tactic: 8 time 0.01532 [03/13/2022-08:31:39] [V] [TRT] Tactic: 9 time 0.014636 [03/13/2022-08:31:39] [V] [TRT] Tactic: 28 time 0.032768 [03/13/2022-08:31:39] [V] [TRT] Fastest Tactic: 9 Time: 0.014636 [03/13/2022-08:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:39] [V] [TRT] [03/13/2022-08:31:39] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,192000) -> Half(1,80,4800:2,384000) *************** [03/13/2022-08:31:39] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_211, Mul_212) (PointWise) [03/13/2022-08:31:39] [V] [TRT] Tactic: 128 time 0.052856 [03/13/2022-08:31:39] [V] [TRT] Tactic: 256 time 0.044696 [03/13/2022-08:31:39] [V] [TRT] Tactic: 512 time 0.045008 [03/13/2022-08:31:39] [V] [TRT] Tactic: -32 time 0.070932 [03/13/2022-08:31:39] [V] [TRT] Tactic: -64 time 0.050056 [03/13/2022-08:31:39] [V] [TRT] Tactic: -128 time 0.048632 [03/13/2022-08:31:39] [V] [TRT] Fastest Tactic: 256 Time: 0.044696 [03/13/2022-08:31:39] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_211, Mul_212) (PointWiseV2) [03/13/2022-08:31:39] [V] [TRT] Tactic: 0 time 0.023116 [03/13/2022-08:31:39] [V] [TRT] Tactic: 1 time 0.019996 [03/13/2022-08:31:39] [V] [TRT] Tactic: 2 time 0.0203 [03/13/2022-08:31:39] [V] [TRT] Tactic: 3 time 0.019484 [03/13/2022-08:31:39] [V] [TRT] Tactic: 4 time 0.020052 [03/13/2022-08:31:39] [V] [TRT] Tactic: 5 time 0.020844 [03/13/2022-08:31:39] [V] [TRT] Tactic: 6 time 0.019476 [03/13/2022-08:31:39] [V] [TRT] Tactic: 7 time 0.019304 [03/13/2022-08:31:39] [V] [TRT] Tactic: 8 time 0.020628 [03/13/2022-08:31:39] [V] [TRT] Tactic: 9 time 0.024228 [03/13/2022-08:31:39] [V] [TRT] Tactic: 10 time 0.034284 [03/13/2022-08:31:39] [V] [TRT] Tactic: 11 time 0.027304 [03/13/2022-08:31:39] [V] [TRT] Tactic: 12 time 0.023264 [03/13/2022-08:31:39] [V] [TRT] Tactic: 13 time 0.024564 [03/13/2022-08:31:39] [V] [TRT] Tactic: 14 time 0.0197 [03/13/2022-08:31:39] [V] [TRT] Tactic: 15 time 0.017684 [03/13/2022-08:31:39] [V] [TRT] Tactic: 16 time 0.024604 [03/13/2022-08:31:39] [V] [TRT] Tactic: 17 time 0.018804 [03/13/2022-08:31:39] [V] [TRT] Tactic: 18 time 0.015688 [03/13/2022-08:31:39] [V] [TRT] Tactic: 19 time 0.01582 [03/13/2022-08:31:39] [V] [TRT] Tactic: 28 time 0.023556 [03/13/2022-08:31:39] [V] [TRT] Tactic: 29 time 0.034076 [03/13/2022-08:31:39] [V] [TRT] Fastest Tactic: 18 Time: 0.015688 [03/13/2022-08:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:31:39] [V] [TRT] [03/13/2022-08:31:39] [V] [TRT] *************** Autotuning format combination: Half(10,800,1:8,48000) -> Half(20,1600,1:8,96000) *************** [03/13/2022-08:31:39] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_211, Mul_212) (PointWise) [03/13/2022-08:31:39] [V] [TRT] Tactic: 128 time 0.051896 [03/13/2022-08:31:39] [V] [TRT] Tactic: 256 time 0.044696 [03/13/2022-08:31:39] [V] [TRT] Tactic: 512 time 0.044876 [03/13/2022-08:31:39] [V] [TRT] Tactic: -32 time 0.102224 [03/13/2022-08:31:39] [V] [TRT] Tactic: -64 time 0.084372 [03/13/2022-08:31:39] [V] [TRT] Tactic: -128 time 0.084088 [03/13/2022-08:31:39] [V] [TRT] Fastest Tactic: 256 Time: 0.044696 [03/13/2022-08:31:39] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_211, Mul_212) (PointWiseV2) [03/13/2022-08:31:39] [V] [TRT] Tactic: 0 time 0.034916 [03/13/2022-08:31:39] [V] [TRT] Tactic: 1 time 0.038668 [03/13/2022-08:31:39] [V] [TRT] Tactic: 2 time 0.03784 [03/13/2022-08:31:39] [V] [TRT] Tactic: 3 time 0.049652 [03/13/2022-08:31:39] [V] [TRT] Tactic: 4 time 0.045524 [03/13/2022-08:31:39] [V] [TRT] Tactic: 5 time 0.040312 [03/13/2022-08:31:39] [V] [TRT] Tactic: 6 time 0.074136 [03/13/2022-08:31:39] [V] [TRT] Tactic: 7 time 0.057996 [03/13/2022-08:31:39] [V] [TRT] Tactic: 8 time 0.051324 [03/13/2022-08:31:39] [V] [TRT] Tactic: 9 time 0.057884 [03/13/2022-08:31:39] [V] [TRT] Tactic: 10 time 0.02672 [03/13/2022-08:31:39] [V] [TRT] Tactic: 11 time 0.028584 [03/13/2022-08:31:39] [V] [TRT] Tactic: 12 time 0.02826 [03/13/2022-08:31:39] [V] [TRT] Tactic: 13 time 0.033708 [03/13/2022-08:31:39] [V] [TRT] Tactic: 14 time 0.032464 [03/13/2022-08:31:39] [V] [TRT] Tactic: 15 time 0.029188 [03/13/2022-08:31:39] [V] [TRT] Tactic: 16 time 0.045828 [03/13/2022-08:31:39] [V] [TRT] Tactic: 17 time 0.039544 [03/13/2022-08:31:39] [V] [TRT] Tactic: 18 time 0.035608 [03/13/2022-08:31:39] [V] [TRT] Tactic: 19 time 0.034372 [03/13/2022-08:31:39] [V] [TRT] Tactic: 20 time 0.03546 [03/13/2022-08:31:39] [V] [TRT] Tactic: 21 time 0.027484 [03/13/2022-08:31:39] [V] [TRT] Tactic: 22 time 0.031024 [03/13/2022-08:31:39] [V] [TRT] Tactic: 23 time 0.037564 [03/13/2022-08:31:39] [V] [TRT] Tactic: 24 time 0.040488 [03/13/2022-08:31:39] [V] [TRT] Tactic: 25 time 0.037688 [03/13/2022-08:31:40] [V] [TRT] Tactic: 26 time 0.030688 [03/13/2022-08:31:40] [V] [TRT] Tactic: 27 time 0.03536 [03/13/2022-08:31:40] [V] [TRT] Tactic: 28 time 0.01876 [03/13/2022-08:31:40] [V] [TRT] Tactic: 29 time 0.018088 [03/13/2022-08:31:40] [V] [TRT] Tactic: 30 time 0.024636 [03/13/2022-08:31:40] [V] [TRT] Tactic: 31 time 0.034684 [03/13/2022-08:31:40] [V] [TRT] Fastest Tactic: 29 Time: 0.018088 [03/13/2022-08:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 29 [03/13/2022-08:31:40] [V] [TRT] [03/13/2022-08:31:40] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,768000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_215, Mul_216) (PointWise) [03/13/2022-08:31:40] [V] [TRT] Tactic: 128 time 0.052836 [03/13/2022-08:31:40] [V] [TRT] Tactic: 256 time 0.05386 [03/13/2022-08:31:40] [V] [TRT] Tactic: 512 time 0.0594 [03/13/2022-08:31:40] [V] [TRT] Tactic: -32 time 0.078192 [03/13/2022-08:31:40] [V] [TRT] Tactic: -64 time 0.051444 [03/13/2022-08:31:40] [V] [TRT] Tactic: -128 time 0.04968 [03/13/2022-08:31:40] [V] [TRT] Fastest Tactic: -128 Time: 0.04968 [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_215, Mul_216) (PointWiseV2) [03/13/2022-08:31:40] [V] [TRT] Tactic: 0 time 0.034388 [03/13/2022-08:31:40] [V] [TRT] Tactic: 1 time 0.028652 [03/13/2022-08:31:40] [V] [TRT] Tactic: 2 time 0.023956 [03/13/2022-08:31:40] [V] [TRT] Tactic: 3 time 0.026988 [03/13/2022-08:31:40] [V] [TRT] Tactic: 4 time 0.023828 [03/13/2022-08:31:40] [V] [TRT] Tactic: 5 time 0.022912 [03/13/2022-08:31:40] [V] [TRT] Tactic: 6 time 0.027568 [03/13/2022-08:31:40] [V] [TRT] Tactic: 7 time 0.023892 [03/13/2022-08:31:40] [V] [TRT] Tactic: 8 time 0.023024 [03/13/2022-08:31:40] [V] [TRT] Tactic: 9 time 0.02332 [03/13/2022-08:31:40] [V] [TRT] Tactic: 28 time 0.034276 [03/13/2022-08:31:40] [V] [TRT] Fastest Tactic: 5 Time: 0.022912 [03/13/2022-08:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [03/13/2022-08:31:40] [V] [TRT] [03/13/2022-08:31:40] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,24000) -> Float(1,80,4800:32,24000) *************** [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_215, Mul_216) (PointWise) [03/13/2022-08:31:40] [V] [TRT] Tactic: 128 time 0.069428 [03/13/2022-08:31:40] [V] [TRT] Tactic: 256 time 0.069972 [03/13/2022-08:31:40] [V] [TRT] Tactic: 512 time 0.07772 [03/13/2022-08:31:40] [V] [TRT] Tactic: -32 time 0.105596 [03/13/2022-08:31:40] [V] [TRT] Tactic: -64 time 0.06424 [03/13/2022-08:31:40] [V] [TRT] Tactic: -128 time 0.059272 [03/13/2022-08:31:40] [V] [TRT] Fastest Tactic: -128 Time: 0.059272 [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_215, Mul_216) (PointWiseV2) [03/13/2022-08:31:40] [V] [TRT] Tactic: 24 time 0.030472 [03/13/2022-08:31:40] [V] [TRT] Tactic: 25 time 0.03092 [03/13/2022-08:31:40] [V] [TRT] Tactic: 26 time 0.032196 [03/13/2022-08:31:40] [V] [TRT] Tactic: 27 time 0.033344 [03/13/2022-08:31:40] [V] [TRT] Tactic: 31 time 0.030344 [03/13/2022-08:31:40] [V] [TRT] Fastest Tactic: 31 Time: 0.030344 [03/13/2022-08:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [03/13/2022-08:31:40] [V] [TRT] [03/13/2022-08:31:40] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,768000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_215, Mul_216) (PointWise) [03/13/2022-08:31:40] [V] [TRT] Tactic: 128 time 0.052632 [03/13/2022-08:31:40] [V] [TRT] Tactic: 256 time 0.044208 [03/13/2022-08:31:40] [V] [TRT] Tactic: 512 time 0.044872 [03/13/2022-08:31:40] [V] [TRT] Tactic: -32 time 0.070376 [03/13/2022-08:31:40] [V] [TRT] Tactic: -64 time 0.04964 [03/13/2022-08:31:40] [V] [TRT] Tactic: -128 time 0.048564 [03/13/2022-08:31:40] [V] [TRT] Fastest Tactic: 256 Time: 0.044208 [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_215, Mul_216) (PointWiseV2) [03/13/2022-08:31:40] [V] [TRT] Tactic: 0 time 0.03284 [03/13/2022-08:31:40] [V] [TRT] Tactic: 1 time 0.02706 [03/13/2022-08:31:40] [V] [TRT] Tactic: 2 time 0.022712 [03/13/2022-08:31:40] [V] [TRT] Tactic: 3 time 0.024316 [03/13/2022-08:31:40] [V] [TRT] Tactic: 4 time 0.019392 [03/13/2022-08:31:40] [V] [TRT] Tactic: 5 time 0.016876 [03/13/2022-08:31:40] [V] [TRT] Tactic: 6 time 0.02472 [03/13/2022-08:31:40] [V] [TRT] Tactic: 7 time 0.01884 [03/13/2022-08:31:40] [V] [TRT] Tactic: 8 time 0.015424 [03/13/2022-08:31:40] [V] [TRT] Tactic: 9 time 0.014544 [03/13/2022-08:31:40] [V] [TRT] Tactic: 28 time 0.032804 [03/13/2022-08:31:40] [V] [TRT] Fastest Tactic: 9 Time: 0.014544 [03/13/2022-08:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:40] [V] [TRT] [03/13/2022-08:31:40] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800:2,384000) *************** [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_215, Mul_216) (PointWise) [03/13/2022-08:31:40] [V] [TRT] Tactic: 128 time 0.052572 [03/13/2022-08:31:40] [V] [TRT] Tactic: 256 time 0.044032 [03/13/2022-08:31:40] [V] [TRT] Tactic: 512 time 0.043788 [03/13/2022-08:31:40] [V] [TRT] Tactic: -32 time 0.070328 [03/13/2022-08:31:40] [V] [TRT] Tactic: -64 time 0.050012 [03/13/2022-08:31:40] [V] [TRT] Tactic: -128 time 0.0487 [03/13/2022-08:31:40] [V] [TRT] Fastest Tactic: 512 Time: 0.043788 [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_215, Mul_216) (PointWiseV2) [03/13/2022-08:31:40] [V] [TRT] Tactic: 0 time 0.023212 [03/13/2022-08:31:40] [V] [TRT] Tactic: 1 time 0.020176 [03/13/2022-08:31:40] [V] [TRT] Tactic: 2 time 0.020252 [03/13/2022-08:31:40] [V] [TRT] Tactic: 3 time 0.019356 [03/13/2022-08:31:40] [V] [TRT] Tactic: 4 time 0.01964 [03/13/2022-08:31:40] [V] [TRT] Tactic: 5 time 0.02052 [03/13/2022-08:31:40] [V] [TRT] Tactic: 6 time 0.019528 [03/13/2022-08:31:40] [V] [TRT] Tactic: 7 time 0.019304 [03/13/2022-08:31:40] [V] [TRT] Tactic: 8 time 0.021024 [03/13/2022-08:31:40] [V] [TRT] Tactic: 9 time 0.023692 [03/13/2022-08:31:40] [V] [TRT] Tactic: 10 time 0.034164 [03/13/2022-08:31:40] [V] [TRT] Tactic: 11 time 0.02732 [03/13/2022-08:31:40] [V] [TRT] Tactic: 12 time 0.022876 [03/13/2022-08:31:40] [V] [TRT] Tactic: 13 time 0.024508 [03/13/2022-08:31:40] [V] [TRT] Tactic: 14 time 0.019936 [03/13/2022-08:31:40] [V] [TRT] Tactic: 15 time 0.0175 [03/13/2022-08:31:40] [V] [TRT] Tactic: 16 time 0.024904 [03/13/2022-08:31:40] [V] [TRT] Tactic: 17 time 0.018896 [03/13/2022-08:31:40] [V] [TRT] Tactic: 18 time 0.015492 [03/13/2022-08:31:40] [V] [TRT] Tactic: 19 time 0.015856 [03/13/2022-08:31:40] [V] [TRT] Tactic: 28 time 0.023384 [03/13/2022-08:31:40] [V] [TRT] Tactic: 29 time 0.03408 [03/13/2022-08:31:40] [V] [TRT] Fastest Tactic: 18 Time: 0.015492 [03/13/2022-08:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:31:40] [V] [TRT] [03/13/2022-08:31:40] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Half(20,1600,1:8,96000) *************** [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_215, Mul_216) (PointWise) [03/13/2022-08:31:40] [V] [TRT] Tactic: 128 time 0.05282 [03/13/2022-08:31:40] [V] [TRT] Tactic: 256 time 0.04474 [03/13/2022-08:31:40] [V] [TRT] Tactic: 512 time 0.04448 [03/13/2022-08:31:40] [V] [TRT] Tactic: -32 time 0.10474 [03/13/2022-08:31:40] [V] [TRT] Tactic: -64 time 0.084388 [03/13/2022-08:31:40] [V] [TRT] Tactic: -128 time 0.08472 [03/13/2022-08:31:40] [V] [TRT] Fastest Tactic: 512 Time: 0.04448 [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_215, Mul_216) (PointWiseV2) [03/13/2022-08:31:40] [V] [TRT] Tactic: 0 time 0.035056 [03/13/2022-08:31:40] [V] [TRT] Tactic: 1 time 0.038736 [03/13/2022-08:31:40] [V] [TRT] Tactic: 2 time 0.037936 [03/13/2022-08:31:40] [V] [TRT] Tactic: 3 time 0.0496 [03/13/2022-08:31:40] [V] [TRT] Tactic: 4 time 0.045612 [03/13/2022-08:31:40] [V] [TRT] Tactic: 5 time 0.04056 [03/13/2022-08:31:40] [V] [TRT] Tactic: 6 time 0.073952 [03/13/2022-08:31:40] [V] [TRT] Tactic: 7 time 0.058244 [03/13/2022-08:31:40] [V] [TRT] Tactic: 8 time 0.051292 [03/13/2022-08:31:40] [V] [TRT] Tactic: 9 time 0.058584 [03/13/2022-08:31:40] [V] [TRT] Tactic: 10 time 0.026912 [03/13/2022-08:31:40] [V] [TRT] Tactic: 11 time 0.028772 [03/13/2022-08:31:40] [V] [TRT] Tactic: 12 time 0.028228 [03/13/2022-08:31:40] [V] [TRT] Tactic: 13 time 0.033504 [03/13/2022-08:31:40] [V] [TRT] Tactic: 14 time 0.032668 [03/13/2022-08:31:40] [V] [TRT] Tactic: 15 time 0.02934 [03/13/2022-08:31:40] [V] [TRT] Tactic: 16 time 0.045452 [03/13/2022-08:31:40] [V] [TRT] Tactic: 17 time 0.039692 [03/13/2022-08:31:40] [V] [TRT] Tactic: 18 time 0.035976 [03/13/2022-08:31:40] [V] [TRT] Tactic: 19 time 0.034228 [03/13/2022-08:31:40] [V] [TRT] Tactic: 20 time 0.035264 [03/13/2022-08:31:40] [V] [TRT] Tactic: 21 time 0.02932 [03/13/2022-08:31:40] [V] [TRT] Tactic: 22 time 0.032364 [03/13/2022-08:31:40] [V] [TRT] Tactic: 23 time 0.03856 [03/13/2022-08:31:40] [V] [TRT] Tactic: 24 time 0.040788 [03/13/2022-08:31:40] [V] [TRT] Tactic: 25 time 0.0381 [03/13/2022-08:31:40] [V] [TRT] Tactic: 26 time 0.032212 [03/13/2022-08:31:40] [V] [TRT] Tactic: 27 time 0.036356 [03/13/2022-08:31:40] [V] [TRT] Tactic: 28 time 0.020064 [03/13/2022-08:31:40] [V] [TRT] Tactic: 29 time 0.018508 [03/13/2022-08:31:40] [V] [TRT] Tactic: 30 time 0.025212 [03/13/2022-08:31:40] [V] [TRT] Tactic: 31 time 0.035124 [03/13/2022-08:31:40] [V] [TRT] Fastest Tactic: 29 Time: 0.018508 [03/13/2022-08:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 29 [03/13/2022-08:31:40] [V] [TRT] [03/13/2022-08:31:40] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,768000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:31:40] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,768000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:31:40] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: Conv_218 (FusedConvActConvolution) [03/13/2022-08:31:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: Conv_218 (CaskConvolution) [03/13/2022-08:31:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: Conv_218 (CudaConvolution) [03/13/2022-08:31:40] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: Conv_218 (CudaDepthwiseConvolution) [03/13/2022-08:31:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:40] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800:2,384000) *************** [03/13/2022-08:31:40] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: Conv_218 (FusedConvActConvolution) [03/13/2022-08:31:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: Conv_218 (CaskConvolution) [03/13/2022-08:31:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: Conv_218 (CudaConvolution) [03/13/2022-08:31:40] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: Conv_218 (CudaDepthwiseConvolution) [03/13/2022-08:31:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:40] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Half(20,1600,1:8,96000) *************** [03/13/2022-08:31:40] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,768000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:31:40] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,768000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:31:40] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: Conv_473 (FusedConvActConvolution) [03/13/2022-08:31:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: Conv_473 (CaskConvolution) [03/13/2022-08:31:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: Conv_473 (CudaConvolution) [03/13/2022-08:31:40] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: Conv_473 (CudaDepthwiseConvolution) [03/13/2022-08:31:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:40] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800:2,384000) *************** [03/13/2022-08:31:40] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: Conv_473 (FusedConvActConvolution) [03/13/2022-08:31:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: Conv_473 (CaskConvolution) [03/13/2022-08:31:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: Conv_473 (CudaConvolution) [03/13/2022-08:31:40] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: Conv_473 (CudaDepthwiseConvolution) [03/13/2022-08:31:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:40] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Half(20,1600,1:8,96000) *************** [03/13/2022-08:31:40] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,768000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_220, Mul_221) (PointWise) [03/13/2022-08:31:40] [V] [TRT] Tactic: 128 time 0.085856 [03/13/2022-08:31:40] [V] [TRT] Tactic: 256 time 0.086736 [03/13/2022-08:31:40] [V] [TRT] Tactic: 512 time 0.097336 [03/13/2022-08:31:40] [V] [TRT] Tactic: -32 time 0.14478 [03/13/2022-08:31:40] [V] [TRT] Tactic: -64 time 0.09142 [03/13/2022-08:31:40] [V] [TRT] Tactic: -128 time 0.087964 [03/13/2022-08:31:40] [V] [TRT] Fastest Tactic: 128 Time: 0.085856 [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_220, Mul_221) (PointWiseV2) [03/13/2022-08:31:40] [V] [TRT] Tactic: 0 time 0.05876 [03/13/2022-08:31:40] [V] [TRT] Tactic: 1 time 0.048304 [03/13/2022-08:31:40] [V] [TRT] Tactic: 2 time 0.04096 [03/13/2022-08:31:40] [V] [TRT] Tactic: 3 time 0.045708 [03/13/2022-08:31:40] [V] [TRT] Tactic: 4 time 0.041184 [03/13/2022-08:31:40] [V] [TRT] Tactic: 5 time 0.040696 [03/13/2022-08:31:40] [V] [TRT] Tactic: 6 time 0.046536 [03/13/2022-08:31:40] [V] [TRT] Tactic: 7 time 0.0416 [03/13/2022-08:31:40] [V] [TRT] Tactic: 8 time 0.041128 [03/13/2022-08:31:40] [V] [TRT] Tactic: 9 time 0.040724 [03/13/2022-08:31:40] [V] [TRT] Tactic: 28 time 0.058296 [03/13/2022-08:31:40] [V] [TRT] Fastest Tactic: 5 Time: 0.040696 [03/13/2022-08:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [03/13/2022-08:31:40] [V] [TRT] [03/13/2022-08:31:40] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,24000) -> Float(1,80,4800:32,24000) *************** [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_220, Mul_221) (PointWise) [03/13/2022-08:31:40] [V] [TRT] Tactic: 128 time 0.085004 [03/13/2022-08:31:40] [V] [TRT] Tactic: 256 time 0.086548 [03/13/2022-08:31:40] [V] [TRT] Tactic: 512 time 0.09742 [03/13/2022-08:31:40] [V] [TRT] Tactic: -32 time 0.144756 [03/13/2022-08:31:40] [V] [TRT] Tactic: -64 time 0.091344 [03/13/2022-08:31:40] [V] [TRT] Tactic: -128 time 0.087796 [03/13/2022-08:31:40] [V] [TRT] Fastest Tactic: 128 Time: 0.085004 [03/13/2022-08:31:40] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_220, Mul_221) (PointWiseV2) [03/13/2022-08:31:40] [V] [TRT] Tactic: 24 time 0.04674 [03/13/2022-08:31:41] [V] [TRT] Tactic: 25 time 0.048024 [03/13/2022-08:31:41] [V] [TRT] Tactic: 26 time 0.048428 [03/13/2022-08:31:41] [V] [TRT] Tactic: 27 time 0.048692 [03/13/2022-08:31:41] [V] [TRT] Tactic: 31 time 0.04678 [03/13/2022-08:31:41] [V] [TRT] Fastest Tactic: 24 Time: 0.04674 [03/13/2022-08:31:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [03/13/2022-08:31:41] [V] [TRT] [03/13/2022-08:31:41] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,768000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:31:41] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_220, Mul_221) (PointWise) [03/13/2022-08:31:41] [V] [TRT] Tactic: 128 time 0.091088 [03/13/2022-08:31:41] [V] [TRT] Tactic: 256 time 0.076824 [03/13/2022-08:31:41] [V] [TRT] Tactic: 512 time 0.075048 [03/13/2022-08:31:41] [V] [TRT] Tactic: -32 time 0.130952 [03/13/2022-08:31:41] [V] [TRT] Tactic: -64 time 0.087732 [03/13/2022-08:31:41] [V] [TRT] Tactic: -128 time 0.084692 [03/13/2022-08:31:41] [V] [TRT] Fastest Tactic: 512 Time: 0.075048 [03/13/2022-08:31:41] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_220, Mul_221) (PointWiseV2) [03/13/2022-08:31:41] [V] [TRT] Tactic: 0 time 0.055256 [03/13/2022-08:31:41] [V] [TRT] Tactic: 1 time 0.045008 [03/13/2022-08:31:41] [V] [TRT] Tactic: 2 time 0.037176 [03/13/2022-08:31:41] [V] [TRT] Tactic: 3 time 0.040892 [03/13/2022-08:31:41] [V] [TRT] Tactic: 4 time 0.03128 [03/13/2022-08:31:41] [V] [TRT] Tactic: 5 time 0.026828 [03/13/2022-08:31:41] [V] [TRT] Tactic: 6 time 0.040728 [03/13/2022-08:31:41] [V] [TRT] Tactic: 7 time 0.029716 [03/13/2022-08:31:41] [V] [TRT] Tactic: 8 time 0.023804 [03/13/2022-08:31:41] [V] [TRT] Tactic: 9 time 0.02386 [03/13/2022-08:31:41] [V] [TRT] Tactic: 28 time 0.0549 [03/13/2022-08:31:41] [V] [TRT] Fastest Tactic: 8 Time: 0.023804 [03/13/2022-08:31:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:31:41] [V] [TRT] [03/13/2022-08:31:41] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800:2,384000) *************** [03/13/2022-08:31:41] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_220, Mul_221) (PointWise) [03/13/2022-08:31:41] [V] [TRT] Tactic: 128 time 0.091372 [03/13/2022-08:31:41] [V] [TRT] Tactic: 256 time 0.076416 [03/13/2022-08:31:41] [V] [TRT] Tactic: 512 time 0.07478 [03/13/2022-08:31:41] [V] [TRT] Tactic: -32 time 0.130996 [03/13/2022-08:31:41] [V] [TRT] Tactic: -64 time 0.0863 [03/13/2022-08:31:41] [V] [TRT] Tactic: -128 time 0.08472 [03/13/2022-08:31:41] [V] [TRT] Fastest Tactic: 512 Time: 0.07478 [03/13/2022-08:31:41] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_220, Mul_221) (PointWiseV2) [03/13/2022-08:31:41] [V] [TRT] Tactic: 0 time 0.037756 [03/13/2022-08:31:41] [V] [TRT] Tactic: 1 time 0.03274 [03/13/2022-08:31:41] [V] [TRT] Tactic: 2 time 0.03352 [03/13/2022-08:31:41] [V] [TRT] Tactic: 3 time 0.030924 [03/13/2022-08:31:41] [V] [TRT] Tactic: 4 time 0.03092 [03/13/2022-08:31:41] [V] [TRT] Tactic: 5 time 0.03306 [03/13/2022-08:31:41] [V] [TRT] Tactic: 6 time 0.032544 [03/13/2022-08:31:41] [V] [TRT] Tactic: 7 time 0.032232 [03/13/2022-08:31:41] [V] [TRT] Tactic: 8 time 0.034188 [03/13/2022-08:31:41] [V] [TRT] Tactic: 9 time 0.041032 [03/13/2022-08:31:41] [V] [TRT] Tactic: 10 time 0.057768 [03/13/2022-08:31:41] [V] [TRT] Tactic: 11 time 0.045676 [03/13/2022-08:31:41] [V] [TRT] Tactic: 12 time 0.038564 [03/13/2022-08:31:41] [V] [TRT] Tactic: 13 time 0.041148 [03/13/2022-08:31:41] [V] [TRT] Tactic: 14 time 0.031412 [03/13/2022-08:31:41] [V] [TRT] Tactic: 15 time 0.02834 [03/13/2022-08:31:41] [V] [TRT] Tactic: 16 time 0.041104 [03/13/2022-08:31:41] [V] [TRT] Tactic: 17 time 0.029696 [03/13/2022-08:31:41] [V] [TRT] Tactic: 18 time 0.024304 [03/13/2022-08:31:41] [V] [TRT] Tactic: 19 time 0.025236 [03/13/2022-08:31:41] [V] [TRT] Tactic: 28 time 0.037688 [03/13/2022-08:31:41] [V] [TRT] Tactic: 29 time 0.057276 [03/13/2022-08:31:41] [V] [TRT] Fastest Tactic: 18 Time: 0.024304 [03/13/2022-08:31:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:31:41] [V] [TRT] [03/13/2022-08:31:41] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Half(20,1600,1:8,96000) *************** [03/13/2022-08:31:41] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_220, Mul_221) (PointWise) [03/13/2022-08:31:41] [V] [TRT] Tactic: 128 time 0.091604 [03/13/2022-08:31:41] [V] [TRT] Tactic: 256 time 0.076592 [03/13/2022-08:31:41] [V] [TRT] Tactic: 512 time 0.074704 [03/13/2022-08:31:41] [V] [TRT] Tactic: -32 time 0.130848 [03/13/2022-08:31:41] [V] [TRT] Tactic: -64 time 0.087892 [03/13/2022-08:31:41] [V] [TRT] Tactic: -128 time 0.08576 [03/13/2022-08:31:41] [V] [TRT] Fastest Tactic: 512 Time: 0.074704 [03/13/2022-08:31:41] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_220, Mul_221) (PointWiseV2) [03/13/2022-08:31:41] [V] [TRT] Tactic: 0 time 0.026488 [03/13/2022-08:31:41] [V] [TRT] Tactic: 1 time 0.02706 [03/13/2022-08:31:41] [V] [TRT] Tactic: 2 time 0.032928 [03/13/2022-08:31:41] [V] [TRT] Tactic: 3 time 0.0272 [03/13/2022-08:31:41] [V] [TRT] Tactic: 4 time 0.034504 [03/13/2022-08:31:41] [V] [TRT] Tactic: 5 time 0.045652 [03/13/2022-08:31:41] [V] [TRT] Tactic: 6 time 0.026796 [03/13/2022-08:31:41] [V] [TRT] Tactic: 7 time 0.036804 [03/13/2022-08:31:41] [V] [TRT] Tactic: 8 time 0.044728 [03/13/2022-08:31:41] [V] [TRT] Tactic: 9 time 0.063784 [03/13/2022-08:31:41] [V] [TRT] Tactic: 10 time 0.029032 [03/13/2022-08:31:41] [V] [TRT] Tactic: 11 time 0.025248 [03/13/2022-08:31:41] [V] [TRT] Tactic: 12 time 0.02804 [03/13/2022-08:31:41] [V] [TRT] Tactic: 13 time 0.025752 [03/13/2022-08:31:41] [V] [TRT] Tactic: 14 time 0.02808 [03/13/2022-08:31:41] [V] [TRT] Tactic: 15 time 0.035184 [03/13/2022-08:31:41] [V] [TRT] Tactic: 16 time 0.026008 [03/13/2022-08:31:41] [V] [TRT] Tactic: 17 time 0.028284 [03/13/2022-08:31:41] [V] [TRT] Tactic: 18 time 0.03818 [03/13/2022-08:31:41] [V] [TRT] Tactic: 19 time 0.050136 [03/13/2022-08:31:41] [V] [TRT] Tactic: 20 time 0.038952 [03/13/2022-08:31:41] [V] [TRT] Tactic: 21 time 0.033216 [03/13/2022-08:31:41] [V] [TRT] Tactic: 22 time 0.03116 [03/13/2022-08:31:41] [V] [TRT] Tactic: 23 time 0.03238 [03/13/2022-08:31:41] [V] [TRT] Tactic: 24 time 0.05764 [03/13/2022-08:31:41] [V] [TRT] Tactic: 25 time 0.0459 [03/13/2022-08:31:41] [V] [TRT] Tactic: 26 time 0.041256 [03/13/2022-08:31:41] [V] [TRT] Tactic: 27 time 0.041088 [03/13/2022-08:31:41] [V] [TRT] Tactic: 28 time 0.026684 [03/13/2022-08:31:41] [V] [TRT] Tactic: 29 time 0.02884 [03/13/2022-08:31:41] [V] [TRT] Tactic: 30 time 0.038892 [03/13/2022-08:31:41] [V] [TRT] Tactic: 31 time 0.057512 [03/13/2022-08:31:41] [V] [TRT] Fastest Tactic: 11 Time: 0.025248 [03/13/2022-08:31:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 11 [03/13/2022-08:31:41] [V] [TRT] [03/13/2022-08:31:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:41] [V] [TRT] Tactic: 1002 time 0.131372 [03/13/2022-08:31:41] [V] [TRT] Tactic: 0 time 0.108992 [03/13/2022-08:31:41] [V] [TRT] Fastest Tactic: 0 Time: 0.108992 [03/13/2022-08:31:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:41] [V] [TRT] Tactic: 1002 time 0.13004 [03/13/2022-08:31:41] [V] [TRT] Tactic: 0 time 0.106428 [03/13/2022-08:31:41] [V] [TRT] Fastest Tactic: 0 Time: 0.106428 [03/13/2022-08:31:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:41] [V] [TRT] Tactic: 1002 time 0.156248 [03/13/2022-08:31:41] [V] [TRT] Tactic: 0 time 0.10868 [03/13/2022-08:31:41] [V] [TRT] Fastest Tactic: 0 Time: 0.10868 [03/13/2022-08:31:41] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:41] [V] [TRT] Tactic: 1002 time 0.111764 [03/13/2022-08:31:41] [V] [TRT] Tactic: 0 time 0.071036 [03/13/2022-08:31:41] [V] [TRT] Fastest Tactic: 0 Time: 0.071036 [03/13/2022-08:31:41] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,768000) -> Float(1,80,4800,768000) *************** [03/13/2022-08:31:41] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_475, Mul_476) (PointWise) [03/13/2022-08:31:41] [V] [TRT] Tactic: 128 time 0.085068 [03/13/2022-08:31:41] [V] [TRT] Tactic: 256 time 0.086636 [03/13/2022-08:31:41] [V] [TRT] Tactic: 512 time 0.097516 [03/13/2022-08:31:41] [V] [TRT] Tactic: -32 time 0.144744 [03/13/2022-08:31:41] [V] [TRT] Tactic: -64 time 0.091296 [03/13/2022-08:31:41] [V] [TRT] Tactic: -128 time 0.08806 [03/13/2022-08:31:41] [V] [TRT] Fastest Tactic: 128 Time: 0.085068 [03/13/2022-08:31:41] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_475, Mul_476) (PointWiseV2) [03/13/2022-08:31:41] [V] [TRT] Tactic: 0 time 0.059116 [03/13/2022-08:31:41] [V] [TRT] Tactic: 1 time 0.048396 [03/13/2022-08:31:41] [V] [TRT] Tactic: 2 time 0.040956 [03/13/2022-08:31:41] [V] [TRT] Tactic: 3 time 0.045616 [03/13/2022-08:31:41] [V] [TRT] Tactic: 4 time 0.041004 [03/13/2022-08:31:41] [V] [TRT] Tactic: 5 time 0.040968 [03/13/2022-08:31:41] [V] [TRT] Tactic: 6 time 0.046648 [03/13/2022-08:31:41] [V] [TRT] Tactic: 7 time 0.041328 [03/13/2022-08:31:41] [V] [TRT] Tactic: 8 time 0.040996 [03/13/2022-08:31:41] [V] [TRT] Tactic: 9 time 0.040972 [03/13/2022-08:31:41] [V] [TRT] Tactic: 28 time 0.058072 [03/13/2022-08:31:41] [V] [TRT] Fastest Tactic: 2 Time: 0.040956 [03/13/2022-08:31:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [03/13/2022-08:31:41] [V] [TRT] [03/13/2022-08:31:41] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,24000) -> Float(1,80,4800:32,24000) *************** [03/13/2022-08:31:41] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_475, Mul_476) (PointWise) [03/13/2022-08:31:41] [V] [TRT] Tactic: 128 time 0.084672 [03/13/2022-08:31:41] [V] [TRT] Tactic: 256 time 0.086676 [03/13/2022-08:31:41] [V] [TRT] Tactic: 512 time 0.097472 [03/13/2022-08:31:41] [V] [TRT] Tactic: -32 time 0.14414 [03/13/2022-08:31:41] [V] [TRT] Tactic: -64 time 0.091272 [03/13/2022-08:31:41] [V] [TRT] Tactic: -128 time 0.087976 [03/13/2022-08:31:41] [V] [TRT] Fastest Tactic: 128 Time: 0.084672 [03/13/2022-08:31:41] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_475, Mul_476) (PointWiseV2) [03/13/2022-08:31:41] [V] [TRT] Tactic: 24 time 0.046624 [03/13/2022-08:31:41] [V] [TRT] Tactic: 25 time 0.048008 [03/13/2022-08:31:41] [V] [TRT] Tactic: 26 time 0.048696 [03/13/2022-08:31:41] [V] [TRT] Tactic: 27 time 0.048424 [03/13/2022-08:31:41] [V] [TRT] Tactic: 31 time 0.046528 [03/13/2022-08:31:41] [V] [TRT] Fastest Tactic: 31 Time: 0.046528 [03/13/2022-08:31:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [03/13/2022-08:31:41] [V] [TRT] [03/13/2022-08:31:41] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,768000) -> Half(1,80,4800,768000) *************** [03/13/2022-08:31:41] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_475, Mul_476) (PointWise) [03/13/2022-08:31:41] [V] [TRT] Tactic: 128 time 0.09096 [03/13/2022-08:31:41] [V] [TRT] Tactic: 256 time 0.076448 [03/13/2022-08:31:41] [V] [TRT] Tactic: 512 time 0.07464 [03/13/2022-08:31:41] [V] [TRT] Tactic: -32 time 0.130936 [03/13/2022-08:31:41] [V] [TRT] Tactic: -64 time 0.087308 [03/13/2022-08:31:41] [V] [TRT] Tactic: -128 time 0.084448 [03/13/2022-08:31:41] [V] [TRT] Fastest Tactic: 512 Time: 0.07464 [03/13/2022-08:31:41] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_475, Mul_476) (PointWiseV2) [03/13/2022-08:31:41] [V] [TRT] Tactic: 0 time 0.055184 [03/13/2022-08:31:41] [V] [TRT] Tactic: 1 time 0.04482 [03/13/2022-08:31:41] [V] [TRT] Tactic: 2 time 0.037272 [03/13/2022-08:31:41] [V] [TRT] Tactic: 3 time 0.040736 [03/13/2022-08:31:41] [V] [TRT] Tactic: 4 time 0.031396 [03/13/2022-08:31:41] [V] [TRT] Tactic: 5 time 0.02678 [03/13/2022-08:31:41] [V] [TRT] Tactic: 6 time 0.040908 [03/13/2022-08:31:41] [V] [TRT] Tactic: 7 time 0.029664 [03/13/2022-08:31:41] [V] [TRT] Tactic: 8 time 0.024112 [03/13/2022-08:31:41] [V] [TRT] Tactic: 9 time 0.023388 [03/13/2022-08:31:41] [V] [TRT] Tactic: 28 time 0.05504 [03/13/2022-08:31:41] [V] [TRT] Fastest Tactic: 9 Time: 0.023388 [03/13/2022-08:31:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:41] [V] [TRT] [03/13/2022-08:31:41] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800:2,384000) *************** [03/13/2022-08:31:41] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_475, Mul_476) (PointWise) [03/13/2022-08:31:41] [V] [TRT] Tactic: 128 time 0.091056 [03/13/2022-08:31:41] [V] [TRT] Tactic: 256 time 0.076748 [03/13/2022-08:31:41] [V] [TRT] Tactic: 512 time 0.074544 [03/13/2022-08:31:41] [V] [TRT] Tactic: -32 time 0.130876 [03/13/2022-08:31:41] [V] [TRT] Tactic: -64 time 0.087748 [03/13/2022-08:31:41] [V] [TRT] Tactic: -128 time 0.084748 [03/13/2022-08:31:41] [V] [TRT] Fastest Tactic: 512 Time: 0.074544 [03/13/2022-08:31:41] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_475, Mul_476) (PointWiseV2) [03/13/2022-08:31:41] [V] [TRT] Tactic: 0 time 0.03786 [03/13/2022-08:31:41] [V] [TRT] Tactic: 1 time 0.03278 [03/13/2022-08:31:41] [V] [TRT] Tactic: 2 time 0.033576 [03/13/2022-08:31:41] [V] [TRT] Tactic: 3 time 0.030956 [03/13/2022-08:31:42] [V] [TRT] Tactic: 4 time 0.030892 [03/13/2022-08:31:42] [V] [TRT] Tactic: 5 time 0.032928 [03/13/2022-08:31:42] [V] [TRT] Tactic: 6 time 0.032372 [03/13/2022-08:31:42] [V] [TRT] Tactic: 7 time 0.03206 [03/13/2022-08:31:42] [V] [TRT] Tactic: 8 time 0.034284 [03/13/2022-08:31:42] [V] [TRT] Tactic: 9 time 0.041368 [03/13/2022-08:31:42] [V] [TRT] Tactic: 10 time 0.05736 [03/13/2022-08:31:42] [V] [TRT] Tactic: 11 time 0.045404 [03/13/2022-08:31:42] [V] [TRT] Tactic: 12 time 0.03864 [03/13/2022-08:31:42] [V] [TRT] Tactic: 13 time 0.041164 [03/13/2022-08:31:42] [V] [TRT] Tactic: 14 time 0.031632 [03/13/2022-08:31:42] [V] [TRT] Tactic: 15 time 0.028444 [03/13/2022-08:31:42] [V] [TRT] Tactic: 16 time 0.040744 [03/13/2022-08:31:42] [V] [TRT] Tactic: 17 time 0.029636 [03/13/2022-08:31:42] [V] [TRT] Tactic: 18 time 0.024404 [03/13/2022-08:31:42] [V] [TRT] Tactic: 19 time 0.025396 [03/13/2022-08:31:42] [V] [TRT] Tactic: 28 time 0.03746 [03/13/2022-08:31:42] [V] [TRT] Tactic: 29 time 0.057248 [03/13/2022-08:31:42] [V] [TRT] Fastest Tactic: 18 Time: 0.024404 [03/13/2022-08:31:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:31:42] [V] [TRT] [03/13/2022-08:31:42] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Half(20,1600,1:8,96000) *************** [03/13/2022-08:31:42] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_475, Mul_476) (PointWise) [03/13/2022-08:31:42] [V] [TRT] Tactic: 128 time 0.09168 [03/13/2022-08:31:42] [V] [TRT] Tactic: 256 time 0.076532 [03/13/2022-08:31:42] [V] [TRT] Tactic: 512 time 0.07442 [03/13/2022-08:31:42] [V] [TRT] Tactic: -32 time 0.130788 [03/13/2022-08:31:42] [V] [TRT] Tactic: -64 time 0.086232 [03/13/2022-08:31:42] [V] [TRT] Tactic: -128 time 0.08564 [03/13/2022-08:31:42] [V] [TRT] Fastest Tactic: 512 Time: 0.07442 [03/13/2022-08:31:42] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_475, Mul_476) (PointWiseV2) [03/13/2022-08:31:42] [V] [TRT] Tactic: 0 time 0.026444 [03/13/2022-08:31:42] [V] [TRT] Tactic: 1 time 0.02728 [03/13/2022-08:31:42] [V] [TRT] Tactic: 2 time 0.032988 [03/13/2022-08:31:42] [V] [TRT] Tactic: 3 time 0.027456 [03/13/2022-08:31:42] [V] [TRT] Tactic: 4 time 0.035048 [03/13/2022-08:31:42] [V] [TRT] Tactic: 5 time 0.045744 [03/13/2022-08:31:42] [V] [TRT] Tactic: 6 time 0.027164 [03/13/2022-08:31:42] [V] [TRT] Tactic: 7 time 0.0362 [03/13/2022-08:31:42] [V] [TRT] Tactic: 8 time 0.045192 [03/13/2022-08:31:42] [V] [TRT] Tactic: 9 time 0.063964 [03/13/2022-08:31:42] [V] [TRT] Tactic: 10 time 0.028816 [03/13/2022-08:31:42] [V] [TRT] Tactic: 11 time 0.024892 [03/13/2022-08:31:42] [V] [TRT] Tactic: 12 time 0.028128 [03/13/2022-08:31:42] [V] [TRT] Tactic: 13 time 0.025888 [03/13/2022-08:31:42] [V] [TRT] Tactic: 14 time 0.027924 [03/13/2022-08:31:42] [V] [TRT] Tactic: 15 time 0.035296 [03/13/2022-08:31:42] [V] [TRT] Tactic: 16 time 0.02608 [03/13/2022-08:31:42] [V] [TRT] Tactic: 17 time 0.02826 [03/13/2022-08:31:42] [V] [TRT] Tactic: 18 time 0.038148 [03/13/2022-08:31:42] [V] [TRT] Tactic: 19 time 0.05038 [03/13/2022-08:31:42] [V] [TRT] Tactic: 20 time 0.038976 [03/13/2022-08:31:42] [V] [TRT] Tactic: 21 time 0.033668 [03/13/2022-08:31:42] [V] [TRT] Tactic: 22 time 0.031068 [03/13/2022-08:31:42] [V] [TRT] Tactic: 23 time 0.032516 [03/13/2022-08:31:42] [V] [TRT] Tactic: 24 time 0.058064 [03/13/2022-08:31:42] [V] [TRT] Tactic: 25 time 0.045992 [03/13/2022-08:31:42] [V] [TRT] Tactic: 26 time 0.04146 [03/13/2022-08:31:42] [V] [TRT] Tactic: 27 time 0.040992 [03/13/2022-08:31:42] [V] [TRT] Tactic: 28 time 0.026452 [03/13/2022-08:31:42] [V] [TRT] Tactic: 29 time 0.028624 [03/13/2022-08:31:42] [V] [TRT] Tactic: 30 time 0.038968 [03/13/2022-08:31:42] [V] [TRT] Tactic: 31 time 0.057496 [03/13/2022-08:31:42] [V] [TRT] Fastest Tactic: 11 Time: 0.024892 [03/13/2022-08:31:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 11 [03/13/2022-08:31:42] [V] [TRT] [03/13/2022-08:31:42] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,768000) -> Float(1,80,4800,14400) *************** [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:42] [V] [TRT] --------------- Timing Runner: Conv_477 (FusedConvActConvolution) [03/13/2022-08:31:42] [V] [TRT] Tactic: 589823 time 0.087388 [03/13/2022-08:31:42] [V] [TRT] Tactic: 786431 time 0.075688 [03/13/2022-08:31:42] [V] [TRT] Tactic: 1310719 time 0.066572 [03/13/2022-08:31:42] [V] [TRT] Tactic: 1638399 time 0.072804 [03/13/2022-08:31:42] [V] [TRT] Tactic: 1835007 time 0.089028 [03/13/2022-08:31:42] [V] [TRT] Tactic: 2097151 time 0.077652 [03/13/2022-08:31:42] [V] [TRT] Tactic: 3997695 time 0.076492 [03/13/2022-08:31:42] [V] [TRT] Tactic: 4194303 time 0.07324 [03/13/2022-08:31:42] [V] [TRT] Tactic: 4259839 time 0.070264 [03/13/2022-08:31:42] [V] [TRT] Tactic: 4325375 time 0.06868 [03/13/2022-08:31:42] [V] [TRT] Tactic: 4521983 time 0.06772 [03/13/2022-08:31:42] [V] [TRT] Tactic: 4587519 time 0.068312 [03/13/2022-08:31:42] [V] [TRT] Tactic: 4915199 time 0.071888 [03/13/2022-08:31:42] [V] [TRT] Tactic: 4980735 time 0.068124 [03/13/2022-08:31:42] [V] [TRT] Tactic: 5439487 time 0.131344 [03/13/2022-08:31:42] [V] [TRT] Tactic: 5767167 time 0.312852 [03/13/2022-08:31:42] [V] [TRT] Tactic: 6750207 time 0.088932 [03/13/2022-08:31:42] [V] [TRT] Tactic: 6946815 time 0.126024 [03/13/2022-08:31:42] [V] [TRT] Tactic: 7012351 time 0.07772 [03/13/2022-08:31:42] [V] [TRT] Tactic: 7143423 time 0.13262 [03/13/2022-08:31:42] [V] [TRT] Tactic: 7602175 time 0.08002 [03/13/2022-08:31:42] [V] [TRT] Tactic: 7798783 time 0.075528 [03/13/2022-08:31:42] [V] [TRT] Tactic: 8191999 time 0.097712 [03/13/2022-08:31:42] [V] [TRT] Tactic: 8257535 time 0.076656 [03/13/2022-08:31:42] [V] [TRT] Tactic: 8323071 time 0.090476 [03/13/2022-08:31:42] [V] [TRT] Tactic: 8650751 time 0.09464 [03/13/2022-08:31:42] [V] [TRT] Tactic: 9109503 time 0.082108 [03/13/2022-08:31:42] [V] [TRT] Tactic: 9568255 time 0.072012 [03/13/2022-08:31:42] [V] [TRT] Tactic: 9895935 time 0.07356 [03/13/2022-08:31:42] [V] [TRT] Tactic: 10354687 time 0.07008 [03/13/2022-08:31:42] [V] [TRT] Tactic: 10551295 time 0.086012 [03/13/2022-08:31:42] [V] [TRT] Tactic: 10944511 time 0.067984 [03/13/2022-08:31:42] [V] [TRT] Fastest Tactic: 1310719 Time: 0.066572 [03/13/2022-08:31:42] [V] [TRT] --------------- Timing Runner: Conv_477 (CaskConvolution) [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Tactic: 1754569683116234317 time 0.106368 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Tactic: 1825138533642645384 time 0.107144 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Tactic: 2733356012094739613 time 0.04796 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Tactic: 3915320020053085238 time 0.106472 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Tactic: 6808617066150061604 time 0.062568 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Tactic: 9091006216302412844 time 0.059956 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Tactic: -8060443123034038864 time 0.063304 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Tactic: -4420849921117327522 time 0.040672 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Tactic: -3946921629105938337 time 0.050048 [03/13/2022-08:31:42] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.040672 [03/13/2022-08:31:42] [V] [TRT] --------------- Timing Runner: Conv_477 (CudaConvolution) [03/13/2022-08:31:42] [V] [TRT] Tactic: 0 time 0.057888 [03/13/2022-08:31:42] [V] [TRT] Tactic: 2 time 0.152212 [03/13/2022-08:31:42] [V] [TRT] Tactic: 5 time 0.190964 [03/13/2022-08:31:42] [V] [TRT] Tactic: 57 time 0.058168 [03/13/2022-08:31:42] [V] [TRT] Fastest Tactic: 0 Time: 0.057888 [03/13/2022-08:31:42] [V] [TRT] --------------- Timing Runner: Conv_477 (CudaDepthwiseConvolution) [03/13/2022-08:31:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4420849921117327522 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:42] [V] [TRT] [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:42] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,768000) -> Half(1,80,4800,14400) *************** [03/13/2022-08:31:42] [V] [TRT] --------------- Timing Runner: Conv_477 (FusedConvActConvolution) [03/13/2022-08:31:42] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:42] [V] [TRT] --------------- Timing Runner: Conv_477 (CaskConvolution) [03/13/2022-08:31:42] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:42] [V] [TRT] --------------- Timing Runner: Conv_477 (CudaConvolution) [03/13/2022-08:31:42] [V] [TRT] Tactic: 0 time 0.0632 [03/13/2022-08:31:42] [V] [TRT] Tactic: 1 time 0.063204 [03/13/2022-08:31:42] [V] [TRT] Tactic: 2 time 0.144244 [03/13/2022-08:31:42] [V] [TRT] Tactic: 4 skipped. Scratch requested: 85198848, available: 16777216 [03/13/2022-08:31:42] [V] [TRT] Tactic: 5 time 0.191856 [03/13/2022-08:31:42] [V] [TRT] Fastest Tactic: 0 Time: 0.0632 [03/13/2022-08:31:42] [V] [TRT] --------------- Timing Runner: Conv_477 (CudaDepthwiseConvolution) [03/13/2022-08:31:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0 [03/13/2022-08:31:42] [V] [TRT] [03/13/2022-08:31:42] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800,14400) *************** [03/13/2022-08:31:42] [V] [TRT] --------------- Timing Runner: Conv_477 (FusedConvActConvolution) [03/13/2022-08:31:42] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:42] [V] [TRT] --------------- Timing Runner: Conv_477 (CaskConvolution) [03/13/2022-08:31:42] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:42] [V] [TRT] --------------- Timing Runner: Conv_477 (CudaConvolution) [03/13/2022-08:31:42] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:42] [V] [TRT] --------------- Timing Runner: Conv_477 (CudaDepthwiseConvolution) [03/13/2022-08:31:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:42] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800:2,9600) *************** [03/13/2022-08:31:42] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:42] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:42] [V] [TRT] --------------- Timing Runner: Conv_477 (FusedConvActConvolution) [03/13/2022-08:31:42] [V] [TRT] Tactic: 589823 time 0.050996 [03/13/2022-08:31:42] [V] [TRT] Tactic: 786431 time 0.048112 [03/13/2022-08:31:42] [V] [TRT] Tactic: 1310719 time 0.041692 [03/13/2022-08:31:42] [V] [TRT] Tactic: 1638399 time 0.04622 [03/13/2022-08:31:42] [V] [TRT] Tactic: 1835007 time 0.048632 [03/13/2022-08:31:42] [V] [TRT] Tactic: 3997695 time 0.049372 [03/13/2022-08:31:42] [V] [TRT] Tactic: 4194303 time 0.045916 [03/13/2022-08:31:42] [V] [TRT] Tactic: 4325375 time 0.042072 [03/13/2022-08:31:42] [V] [TRT] Tactic: 4521983 time 0.043212 [03/13/2022-08:31:42] [V] [TRT] Tactic: 4587519 time 0.04618 [03/13/2022-08:31:42] [V] [TRT] Tactic: 4915199 time 0.047308 [03/13/2022-08:31:42] [V] [TRT] Tactic: 4980735 time 0.04474 [03/13/2022-08:31:42] [V] [TRT] Tactic: 5439487 time 0.071756 [03/13/2022-08:31:42] [V] [TRT] Tactic: 5767167 time 0.157176 [03/13/2022-08:31:43] [V] [TRT] Tactic: 6750207 time 0.05212 [03/13/2022-08:31:43] [V] [TRT] Tactic: 6946815 time 0.07036 [03/13/2022-08:31:43] [V] [TRT] Tactic: 7143423 time 0.073112 [03/13/2022-08:31:43] [V] [TRT] Tactic: 7602175 time 0.04712 [03/13/2022-08:31:43] [V] [TRT] Tactic: 7798783 time 0.047348 [03/13/2022-08:31:43] [V] [TRT] Tactic: 8191999 time 0.055688 [03/13/2022-08:31:43] [V] [TRT] Tactic: 8257535 time 0.047428 [03/13/2022-08:31:43] [V] [TRT] Tactic: 8323071 time 0.050492 [03/13/2022-08:31:43] [V] [TRT] Tactic: 8650751 time 0.057236 [03/13/2022-08:31:43] [V] [TRT] Tactic: 9568255 time 0.047456 [03/13/2022-08:31:43] [V] [TRT] Tactic: 9895935 time 0.045848 [03/13/2022-08:31:43] [V] [TRT] Tactic: 10354687 time 0.044992 [03/13/2022-08:31:43] [V] [TRT] Tactic: 10551295 time 0.05082 [03/13/2022-08:31:43] [V] [TRT] Tactic: 10944511 time 0.044444 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 1310719 Time: 0.041692 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: Conv_477 (CaskConvolution) [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 1651411198763708804 time 0.035804 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 2418518597804310654 time 0.03552 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 4318470497547290900 time 0.03536 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 4930470141256631146 time 0.027388 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 8292881859266835088 time 0.0275 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 8401509141903434922 time 0.035272 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -8654297089785671176 time 0.0657 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -7516584506774355935 time 0.026496 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -7140760933967189247 time 0.035244 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -6004726995029373073 time 0.026968 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -5719726816705110014 time 0.065872 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -4097850214384059472 time 0.026348 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -3717489476759089008 time 0.035232 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -3689982367035295496 time 0.06582 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -2640575123064142123 time 0.059108 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -2534402059426524406 time 0.059048 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -2027588946874785071 time 0.027296 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -1968398013367819764 time 0.066268 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: -4097850214384059472 Time: 0.026348 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: Conv_477 (CudaConvolution) [03/13/2022-08:31:43] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: Conv_477 (CudaDepthwiseConvolution) [03/13/2022-08:31:43] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4097850214384059472 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:43] [V] [TRT] [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:43] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Float(1,80,4800,14400) *************** [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: Conv_477 (FusedConvActConvolution) [03/13/2022-08:31:43] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: Conv_477 (CaskConvolution) [03/13/2022-08:31:43] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: Conv_477 (CudaConvolution) [03/13/2022-08:31:43] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: Conv_477 (CudaDepthwiseConvolution) [03/13/2022-08:31:43] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:43] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Half(1,80,1:8,4800) *************** [03/13/2022-08:31:43] [V] [TRT] Conv_477 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: Conv_477 (FusedConvActConvolution) [03/13/2022-08:31:43] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: Conv_477 (CaskConvolution) [03/13/2022-08:31:43] [V] [TRT] Conv_477 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:43] [V] [TRT] Tactic: 9576651994278528 time 0.133576 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 1179757074518529353 time 0.348872 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 2105695814191699972 time 0.527208 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 2148106709480872763 time 0.289792 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 2410442691266548717 time 0.679116 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 3041642431972138763 time 0.506204 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 3754069740140581927 time 0.786776 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 4555462412611657028 time 0.291076 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 5666160310350604399 time 0.78632 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:43] [V] [TRT] Tactic: 5876997871499382316 time 0.241044 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 5925270497649423688 time 1.04028 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 6680916730816870145 time 0.633148 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 7158029511300006471 time 0.528112 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 7859952145590271433 time 0.633044 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 8283847742354150423 time 0.786744 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -8992262742606384444 time 0.291336 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -8391760416076885205 time 0.806708 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -6273232454637933930 time 0.272228 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:43] [V] [TRT] Tactic: -5925110308892264213 time 0.187156 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -5818527483287834165 time 0.272156 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:43] [V] [TRT] Tactic: -4908848143422991657 time 0.10526 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -4534876761957424274 time 0.806512 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -3237051169894153788 time 0.410192 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -3136088851200285532 time 0.394108 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -2586046817576862066 time 0.527572 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -2422160065350346448 time 0.491352 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -1216445540764179377 time 0.526968 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -229563042944049199 time 0.393604 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: -4908848143422991657 Time: 0.10526 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: Conv_477 (CudaConvolution) [03/13/2022-08:31:43] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: Conv_477 (CudaDepthwiseConvolution) [03/13/2022-08:31:43] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4908848143422991657 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:43] [V] [TRT] [03/13/2022-08:31:43] [V] [TRT] Conv_477 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_477 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:43] [V] [TRT] Tactic: 1002 time 0.014048 [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.007176 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.007176 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:43] [V] [TRT] Tactic: 1002 time 0.005036 [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.005156 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 1002 Time: 0.005036 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:43] [V] [TRT] Tactic: 1002 time 0.014224 [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.00492 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.00492 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:43] [V] [TRT] Tactic: 1002 time 0.018168 [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.005212 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.005212 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:43] [V] [TRT] Tactic: 1002 time 0.007436 [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.006432 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.006432 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:43] [V] [TRT] Tactic: 1002 time 0.006904 [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.006188 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.006188 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:43] [V] [TRT] Tactic: 1002 time 0.01418 [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.006212 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.006212 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:43] [V] [TRT] Tactic: 1002 time 0.015396 [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.006364 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.006364 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:43] [V] [TRT] Tactic: 1002 time 0.00518 [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.004932 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.004932 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:43] [V] [TRT] Tactic: 1002 time 0.014084 [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.007208 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.007208 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:43] [V] [TRT] Tactic: 1002 time 0.0142 [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.005008 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.005008 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:43] [V] [TRT] Tactic: 1002 time 0.018308 [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.004928 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.004928 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:43] [V] [TRT] Tactic: 1002 time 0.0077 [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.004812 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.004812 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:43] [V] [TRT] Tactic: 1002 time 0.014128 [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.00758 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.00758 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:43] [V] [TRT] Tactic: 1002 time 0.007448 [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.004844 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.004844 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:43] [V] [TRT] Tactic: 1002 time 0.018332 [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.005132 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.005132 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:43] [V] [TRT] Tactic: 1002 time 0.009424 [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.004688 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.004688 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:43] [V] [TRT] Tactic: 1002 time 0.015008 [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.007836 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.007836 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:43] [V] [TRT] Tactic: 1002 time 0.009468 [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.004952 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.004952 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:43] [V] [TRT] Tactic: 1002 time 0.018088 [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.005048 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.005048 [03/13/2022-08:31:43] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,14400) -> Float(1,1,80,4800,14400) *************** [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: Reshape_479 + Transpose_480 (Shuffle) [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.004608 [03/13/2022-08:31:43] [V] [TRT] Tactic: 1 time 0.008448 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.004608 [03/13/2022-08:31:43] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,4800) -> Float(1,1,80:32,160,480) *************** [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: Reshape_479 + Transpose_480 (Shuffle) [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.008264 [03/13/2022-08:31:43] [V] [TRT] Tactic: 1 time 0.01248 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.008264 [03/13/2022-08:31:43] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,14400) -> Half(1,1,80,4800,14400) *************** [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: Reshape_479 + Transpose_480 (Shuffle) [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.004472 [03/13/2022-08:31:43] [V] [TRT] Tactic: 1 time 0.008328 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.004472 [03/13/2022-08:31:43] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,9600) -> Half(1,1,80:2,2400,7200) *************** [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: Reshape_479 + Transpose_480 (Shuffle) [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.005176 [03/13/2022-08:31:43] [V] [TRT] Tactic: 1 time 0.013348 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.005176 [03/13/2022-08:31:43] [V] [TRT] *************** Autotuning format combination: Half(1,80,1:8,4800) -> Half(8,8,1:8,640,1920) *************** [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: Reshape_479 + Transpose_480 (Shuffle) [03/13/2022-08:31:43] [V] [TRT] Tactic: 0 time 0.007992 [03/13/2022-08:31:43] [V] [TRT] Tactic: 1 time 0.023644 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 0 Time: 0.007992 [03/13/2022-08:31:43] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,768000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:43] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: Conv_263 (FusedConvActConvolution) [03/13/2022-08:31:43] [V] [TRT] Tactic: 458751 time 0.369952 [03/13/2022-08:31:43] [V] [TRT] Fastest Tactic: 458751 Time: 0.369952 [03/13/2022-08:31:43] [V] [TRT] --------------- Timing Runner: Conv_263 (CaskConvolution) [03/13/2022-08:31:43] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 1825138533642645384 time 0.434636 [03/13/2022-08:31:43] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 2842488832350522458 time 0.34202 [03/13/2022-08:31:43] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 3915320020053085238 time 0.431916 [03/13/2022-08:31:43] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 6448355332020552203 time 0.4438 [03/13/2022-08:31:43] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: 6808617066150061604 time 0.353016 [03/13/2022-08:31:43] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:43] [V] [TRT] Tactic: -8060443123034038864 time 0.360624 [03/13/2022-08:31:43] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: -4420849921117327522 time 0.339988 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: -3946921629105938337 time 0.300832 [03/13/2022-08:31:44] [V] [TRT] Fastest Tactic: -3946921629105938337 Time: 0.300832 [03/13/2022-08:31:44] [V] [TRT] --------------- Timing Runner: Conv_263 (CudaConvolution) [03/13/2022-08:31:44] [V] [TRT] Tactic: 0 time 0.553284 [03/13/2022-08:31:44] [V] [TRT] Tactic: 2 time 0.604984 [03/13/2022-08:31:44] [V] [TRT] Tactic: 5 skipped. Scratch requested: 114196480, available: 16777216 [03/13/2022-08:31:44] [V] [TRT] Tactic: 57 time 0.35528 [03/13/2022-08:31:44] [V] [TRT] Fastest Tactic: 57 Time: 0.35528 [03/13/2022-08:31:44] [V] [TRT] --------------- Timing Runner: Conv_263 (CudaDepthwiseConvolution) [03/13/2022-08:31:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3946921629105938337 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] [03/13/2022-08:31:44] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,768000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:31:44] [V] [TRT] --------------- Timing Runner: Conv_263 (FusedConvActConvolution) [03/13/2022-08:31:44] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:44] [V] [TRT] --------------- Timing Runner: Conv_263 (CaskConvolution) [03/13/2022-08:31:44] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:44] [V] [TRT] --------------- Timing Runner: Conv_263 (CudaConvolution) [03/13/2022-08:31:44] [V] [TRT] Tactic: 0 time 0.557544 [03/13/2022-08:31:44] [V] [TRT] Tactic: 1 time 0.35496 [03/13/2022-08:31:44] [V] [TRT] Tactic: 2 time 0.589028 [03/13/2022-08:31:44] [V] [TRT] Tactic: 5 skipped. Scratch requested: 114196480, available: 16777216 [03/13/2022-08:31:44] [V] [TRT] Fastest Tactic: 1 Time: 0.35496 [03/13/2022-08:31:44] [V] [TRT] --------------- Timing Runner: Conv_263 (CudaDepthwiseConvolution) [03/13/2022-08:31:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:31:44] [V] [TRT] [03/13/2022-08:31:44] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:31:44] [V] [TRT] --------------- Timing Runner: Conv_263 (FusedConvActConvolution) [03/13/2022-08:31:44] [V] [TRT] Tactic: 458751 time 0.187852 [03/13/2022-08:31:44] [V] [TRT] Fastest Tactic: 458751 Time: 0.187852 [03/13/2022-08:31:44] [V] [TRT] --------------- Timing Runner: Conv_263 (CaskConvolution) [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: 1145226902788474763 time 0.179768 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: 1651411198763708804 time 0.179472 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: 2418518597804310654 time 0.179832 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: 4318470497547290900 time 0.176152 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: 4653005425971292725 time 0.181236 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: 4930470141256631146 time 0.134956 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: 8292881859266835088 time 0.13436 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: 8401509141903434922 time 0.175848 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: -8654297089785671176 time 0.225004 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: -7448936905981214224 time 0.192544 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: -6004726995029373073 time 0.133456 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: -5719726816705110014 time 0.225472 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: -3754890472406891741 time 0.2317 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: -3689982367035295496 time 0.226508 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: -2894005464278291378 time 0.19656 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: -2027588946874785071 time 0.183008 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: -1968398013367819764 time 0.226908 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: -245090590808296743 time 0.231396 [03/13/2022-08:31:44] [V] [TRT] Fastest Tactic: -6004726995029373073 Time: 0.133456 [03/13/2022-08:31:44] [V] [TRT] --------------- Timing Runner: Conv_263 (CudaConvolution) [03/13/2022-08:31:44] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:44] [V] [TRT] --------------- Timing Runner: Conv_263 (CudaDepthwiseConvolution) [03/13/2022-08:31:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6004726995029373073 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:44] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:44] [V] [TRT] --------------- Timing Runner: Conv_263 (FusedConvActConvolution) [03/13/2022-08:31:44] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:44] [V] [TRT] --------------- Timing Runner: Conv_263 (CaskConvolution) [03/13/2022-08:31:44] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:44] [V] [TRT] --------------- Timing Runner: Conv_263 (CudaConvolution) [03/13/2022-08:31:44] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:44] [V] [TRT] --------------- Timing Runner: Conv_263 (CudaDepthwiseConvolution) [03/13/2022-08:31:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:44] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:31:44] [V] [TRT] Conv_263 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:44] [V] [TRT] Conv_263 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:44] [V] [TRT] Conv_263 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] --------------- Timing Runner: Conv_263 (FusedConvActConvolution) [03/13/2022-08:31:44] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:44] [V] [TRT] --------------- Timing Runner: Conv_263 (CaskConvolution) [03/13/2022-08:31:44] [V] [TRT] Conv_263 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:44] [V] [TRT] Tactic: 130343752241278875 time 1.15726 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: 2148106709480872763 time 1.92108 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: 2410442691266548717 time 2.30579 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:44] [V] [TRT] Tactic: 2921824978225832523 time 1.01406 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:44] [V] [TRT] Tactic: 3030711443478140260 time 2.14956 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: 3754069740140581927 time 3.5862 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: 3823144360994712832 time 2.31548 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: 5635311898703673455 time 2.31375 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: 5925270497649423688 time 3.58281 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: 6680916730816870145 time 4.29439 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: 7158029511300006471 time 3.58628 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: 7859952145590271433 time 4.29843 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: 8283847742354150423 time 3.58562 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:44] [V] [TRT] Tactic: -8992262742606384444 time 1.92958 [03/13/2022-08:31:44] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:31:45] [V] [TRT] Tactic: -8682550625095202832 time 1.92667 [03/13/2022-08:31:45] [V] [TRT] Conv_263 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:45] [V] [TRT] Tactic: -8379842433586149932 time 2.15337 [03/13/2022-08:31:45] [V] [TRT] Conv_263 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:45] [V] [TRT] Tactic: -6352769237623756264 time 2.15291 [03/13/2022-08:31:45] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:45] [V] [TRT] Tactic: -6273232454637933930 time 2.31548 [03/13/2022-08:31:45] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:45] [V] [TRT] Tactic: -5818527483287834165 time 2.31698 [03/13/2022-08:31:45] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:31:45] [V] [TRT] Tactic: -4954692664176521434 time 2.31268 [03/13/2022-08:31:45] [V] [TRT] Conv_263 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:45] [V] [TRT] Tactic: -4953888146171240997 time 1.01863 [03/13/2022-08:31:45] [V] [TRT] Conv_263 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:45] [V] [TRT] Tactic: -4534876761957424274 time 3.57891 [03/13/2022-08:31:45] [V] [TRT] Conv_263 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:45] [V] [TRT] Tactic: -3237051169894153788 time 3.58798 [03/13/2022-08:31:45] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:45] [V] [TRT] Tactic: -3136088851200285532 time 2.31182 [03/13/2022-08:31:45] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:45] [V] [TRT] Tactic: -2586046817576862066 time 2.31271 [03/13/2022-08:31:45] [V] [TRT] Conv_263 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:45] [V] [TRT] Tactic: -229563042944049199 time 2.31215 [03/13/2022-08:31:45] [V] [TRT] Fastest Tactic: 2921824978225832523 Time: 1.01406 [03/13/2022-08:31:45] [V] [TRT] --------------- Timing Runner: Conv_263 (CudaConvolution) [03/13/2022-08:31:45] [V] [TRT] Tactic: 0 time 0.681568 [03/13/2022-08:31:45] [V] [TRT] Tactic: 1 time 1.04312 [03/13/2022-08:31:45] [V] [TRT] Tactic: 2 time 0.984644 [03/13/2022-08:31:45] [V] [TRT] Fastest Tactic: 0 Time: 0.681568 [03/13/2022-08:31:45] [V] [TRT] --------------- Timing Runner: Conv_263 (CudaDepthwiseConvolution) [03/13/2022-08:31:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0 [03/13/2022-08:31:45] [V] [TRT] [03/13/2022-08:31:45] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,768000) -> Float(1,80,4800,158400) *************** [03/13/2022-08:31:45] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:31:45] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:45] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:45] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:45] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:45] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:45] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:45] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:45] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:45] [V] [TRT] --------------- Timing Runner: Conv_222 (FusedConvActConvolution) [03/13/2022-08:31:45] [V] [TRT] Tactic: 589823 time 0.156596 [03/13/2022-08:31:45] [V] [TRT] Tactic: 786431 time 0.124416 [03/13/2022-08:31:45] [V] [TRT] Tactic: 1310719 time 0.107348 [03/13/2022-08:31:45] [V] [TRT] Tactic: 1638399 time 0.117212 [03/13/2022-08:31:45] [V] [TRT] Tactic: 1835007 time 0.135192 [03/13/2022-08:31:45] [V] [TRT] Tactic: 2097151 time 0.126708 [03/13/2022-08:31:45] [V] [TRT] Tactic: 3997695 time 0.124564 [03/13/2022-08:31:45] [V] [TRT] Tactic: 4194303 time 0.117568 [03/13/2022-08:31:45] [V] [TRT] Tactic: 4259839 time 0.114092 [03/13/2022-08:31:45] [V] [TRT] Tactic: 4325375 time 0.109512 [03/13/2022-08:31:45] [V] [TRT] Tactic: 4521983 time 0.119624 [03/13/2022-08:31:45] [V] [TRT] Tactic: 4587519 time 0.112212 [03/13/2022-08:31:45] [V] [TRT] Tactic: 4915199 time 0.117556 [03/13/2022-08:31:45] [V] [TRT] Tactic: 4980735 time 0.108624 [03/13/2022-08:31:45] [V] [TRT] Tactic: 5439487 time 0.207072 [03/13/2022-08:31:45] [V] [TRT] Tactic: 5767167 time 0.55002 [03/13/2022-08:31:45] [V] [TRT] Tactic: 6750207 time 0.143608 [03/13/2022-08:31:45] [V] [TRT] Tactic: 6946815 time 0.193984 [03/13/2022-08:31:45] [V] [TRT] Tactic: 7012351 time 0.126728 [03/13/2022-08:31:45] [V] [TRT] Tactic: 7143423 time 0.199368 [03/13/2022-08:31:45] [V] [TRT] Tactic: 7602175 time 0.124608 [03/13/2022-08:31:45] [V] [TRT] Tactic: 7798783 time 0.124544 [03/13/2022-08:31:45] [V] [TRT] Tactic: 8191999 time 0.155628 [03/13/2022-08:31:45] [V] [TRT] Tactic: 8257535 time 0.124936 [03/13/2022-08:31:45] [V] [TRT] Tactic: 8323071 time 0.143456 [03/13/2022-08:31:46] [V] [TRT] Tactic: 8650751 time 0.14594 [03/13/2022-08:31:46] [V] [TRT] Tactic: 9109503 time 0.133696 [03/13/2022-08:31:46] [V] [TRT] Tactic: 9568255 time 0.117332 [03/13/2022-08:31:46] [V] [TRT] Tactic: 9895935 time 0.118568 [03/13/2022-08:31:46] [V] [TRT] Tactic: 10354687 time 0.11376 [03/13/2022-08:31:46] [V] [TRT] Tactic: 10551295 time 0.14284 [03/13/2022-08:31:46] [V] [TRT] Tactic: 10944511 time 0.10844 [03/13/2022-08:31:46] [V] [TRT] Fastest Tactic: 1310719 Time: 0.107348 [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (CaskConvolution) [03/13/2022-08:31:46] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 1754569683116234317 time 0.083756 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 1825138533642645384 time 0.084288 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 2733356012094739613 time 0.062064 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 3915320020053085238 time 0.083964 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 6808617066150061604 time 0.0514 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 9091006216302412844 time 0.048988 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -8060443123034038864 time 0.052132 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -4420849921117327522 time 0.066832 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -3946921629105938337 time 0.068264 [03/13/2022-08:31:46] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.048988 [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (CudaConvolution) [03/13/2022-08:31:46] [V] [TRT] Tactic: 0 time 0.091056 [03/13/2022-08:31:46] [V] [TRT] Tactic: 2 time 0.175924 [03/13/2022-08:31:46] [V] [TRT] Tactic: 5 time 0.226976 [03/13/2022-08:31:46] [V] [TRT] Tactic: 57 time 0.091144 [03/13/2022-08:31:46] [V] [TRT] Fastest Tactic: 0 Time: 0.091056 [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (CudaDepthwiseConvolution) [03/13/2022-08:31:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] [03/13/2022-08:31:46] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,768000) -> Half(1,80,4800,158400) *************** [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (FusedConvActConvolution) [03/13/2022-08:31:46] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (CaskConvolution) [03/13/2022-08:31:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (CudaConvolution) [03/13/2022-08:31:46] [V] [TRT] Tactic: 0 time 0.091784 [03/13/2022-08:31:46] [V] [TRT] Tactic: 1 time 0.091624 [03/13/2022-08:31:46] [V] [TRT] Tactic: 2 time 0.165032 [03/13/2022-08:31:46] [V] [TRT] Tactic: 4 skipped. Scratch requested: 724194304, available: 16777216 [03/13/2022-08:31:46] [V] [TRT] Tactic: 5 time 0.226 [03/13/2022-08:31:46] [V] [TRT] Fastest Tactic: 1 Time: 0.091624 [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (CudaDepthwiseConvolution) [03/13/2022-08:31:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:31:46] [V] [TRT] [03/13/2022-08:31:46] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800,158400) *************** [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (FusedConvActConvolution) [03/13/2022-08:31:46] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (CaskConvolution) [03/13/2022-08:31:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (CudaConvolution) [03/13/2022-08:31:46] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (CudaDepthwiseConvolution) [03/13/2022-08:31:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:46] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,384000) -> Half(1,80,4800:2,81600) *************** [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (FusedConvActConvolution) [03/13/2022-08:31:46] [V] [TRT] Tactic: 589823 time 0.085808 [03/13/2022-08:31:46] [V] [TRT] Tactic: 786431 time 0.071136 [03/13/2022-08:31:46] [V] [TRT] Tactic: 1310719 time 0.062096 [03/13/2022-08:31:46] [V] [TRT] Tactic: 1638399 time 0.07018 [03/13/2022-08:31:46] [V] [TRT] Tactic: 1835007 time 0.073944 [03/13/2022-08:31:46] [V] [TRT] Tactic: 3997695 time 0.07268 [03/13/2022-08:31:46] [V] [TRT] Tactic: 4194303 time 0.068328 [03/13/2022-08:31:46] [V] [TRT] Tactic: 4325375 time 0.063184 [03/13/2022-08:31:46] [V] [TRT] Tactic: 4521983 time 0.065256 [03/13/2022-08:31:46] [V] [TRT] Tactic: 4587519 time 0.066884 [03/13/2022-08:31:46] [V] [TRT] Tactic: 4915199 time 0.06946 [03/13/2022-08:31:46] [V] [TRT] Tactic: 4980735 time 0.062512 [03/13/2022-08:31:46] [V] [TRT] Tactic: 5439487 time 0.109668 [03/13/2022-08:31:46] [V] [TRT] Tactic: 5767167 time 0.244372 [03/13/2022-08:31:46] [V] [TRT] Tactic: 6750207 time 0.079852 [03/13/2022-08:31:46] [V] [TRT] Tactic: 6946815 time 0.104124 [03/13/2022-08:31:46] [V] [TRT] Tactic: 7143423 time 0.106172 [03/13/2022-08:31:46] [V] [TRT] Tactic: 7602175 time 0.069428 [03/13/2022-08:31:46] [V] [TRT] Tactic: 7798783 time 0.071036 [03/13/2022-08:31:46] [V] [TRT] Tactic: 8191999 time 0.085256 [03/13/2022-08:31:46] [V] [TRT] Tactic: 8257535 time 0.071648 [03/13/2022-08:31:46] [V] [TRT] Tactic: 8323071 time 0.078716 [03/13/2022-08:31:46] [V] [TRT] Tactic: 8650751 time 0.080592 [03/13/2022-08:31:46] [V] [TRT] Tactic: 9568255 time 0.069392 [03/13/2022-08:31:46] [V] [TRT] Tactic: 9895935 time 0.068848 [03/13/2022-08:31:46] [V] [TRT] Tactic: 10354687 time 0.068384 [03/13/2022-08:31:46] [V] [TRT] Tactic: 10551295 time 0.077804 [03/13/2022-08:31:46] [V] [TRT] Tactic: 10944511 time 0.062852 [03/13/2022-08:31:46] [V] [TRT] Fastest Tactic: 1310719 Time: 0.062096 [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (CaskConvolution) [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 1651411198763708804 time 0.02882 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 2418518597804310654 time 0.028904 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 4318470497547290900 time 0.028736 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 4930470141256631146 time 0.030692 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 8292881859266835088 time 0.030084 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 8401509141903434922 time 0.028656 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -8654297089785671176 time 0.051992 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -7516584506774355935 time 0.03502 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -7140760933967189247 time 0.028596 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -6004726995029373073 time 0.036804 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -5719726816705110014 time 0.052292 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -4097850214384059472 time 0.034896 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -3717489476759089008 time 0.028552 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -3689982367035295496 time 0.05192 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -2640575123064142123 time 0.04712 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -2534402059426524406 time 0.046704 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -2027588946874785071 time 0.039684 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -1968398013367819764 time 0.05252 [03/13/2022-08:31:46] [V] [TRT] Fastest Tactic: -3717489476759089008 Time: 0.028552 [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (CudaConvolution) [03/13/2022-08:31:46] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (CudaDepthwiseConvolution) [03/13/2022-08:31:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3717489476759089008 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:31:46] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Float(1,80,4800,158400) *************** [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (FusedConvActConvolution) [03/13/2022-08:31:46] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (CaskConvolution) [03/13/2022-08:31:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (CudaConvolution) [03/13/2022-08:31:46] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (CudaDepthwiseConvolution) [03/13/2022-08:31:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:46] [V] [TRT] *************** Autotuning format combination: Half(20,1600,1:8,96000) -> Half(5,400,1:8,24000) *************** [03/13/2022-08:31:46] [V] [TRT] Conv_222 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (FusedConvActConvolution) [03/13/2022-08:31:46] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (CaskConvolution) [03/13/2022-08:31:46] [V] [TRT] Conv_222 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:46] [V] [TRT] Tactic: 9576651994278528 time 0.18416 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 1179757074518529353 time 0.273344 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 2105695814191699972 time 0.410596 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 2148106709480872763 time 0.224508 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 2410442691266548717 time 0.529324 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 3041642431972138763 time 0.39444 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 3754069740140581927 time 0.610796 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 4555462412611657028 time 0.224108 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 5666160310350604399 time 0.61048 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:46] [V] [TRT] Tactic: 5876997871499382316 time 0.336428 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 5925270497649423688 time 0.807548 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 6680916730816870145 time 0.492644 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 7158029511300006471 time 0.411556 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 7859952145590271433 time 0.492328 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: 8283847742354150423 time 0.6109 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -8992262742606384444 time 0.225132 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -8391760416076885205 time 0.80748 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -6273232454637933930 time 0.274308 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:46] [V] [TRT] Tactic: -5925110308892264213 time 0.335776 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -5818527483287834165 time 0.2734 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:46] [V] [TRT] Tactic: -4908848143422991657 time 0.185132 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -4534876761957424274 time 0.807472 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -3237051169894153788 time 0.410772 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -3136088851200285532 time 0.395144 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -2586046817576862066 time 0.529044 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -2422160065350346448 time 0.492156 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -1216445540764179377 time 0.528648 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Tactic: -229563042944049199 time 0.395152 [03/13/2022-08:31:46] [V] [TRT] Fastest Tactic: 9576651994278528 Time: 0.18416 [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (CudaConvolution) [03/13/2022-08:31:46] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: Conv_222 (CudaDepthwiseConvolution) [03/13/2022-08:31:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9576651994278528 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:46] [V] [TRT] [03/13/2022-08:31:46] [V] [TRT] Conv_222 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:31:46] [V] [TRT] Conv_222 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:46] [V] [TRT] Tactic: 1002 time 0.028204 [03/13/2022-08:31:46] [V] [TRT] Tactic: 0 time 0.03728 [03/13/2022-08:31:46] [V] [TRT] Fastest Tactic: 1002 Time: 0.028204 [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:46] [V] [TRT] Tactic: 1002 time 0.009068 [03/13/2022-08:31:46] [V] [TRT] Tactic: 0 time 0.01454 [03/13/2022-08:31:46] [V] [TRT] Fastest Tactic: 1002 Time: 0.009068 [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:46] [V] [TRT] Tactic: 1002 time 0.029612 [03/13/2022-08:31:46] [V] [TRT] Tactic: 0 time 0.008864 [03/13/2022-08:31:46] [V] [TRT] Fastest Tactic: 0 Time: 0.008864 [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:46] [V] [TRT] Tactic: 1002 time 0.026552 [03/13/2022-08:31:46] [V] [TRT] Tactic: 0 time 0.00938 [03/13/2022-08:31:46] [V] [TRT] Fastest Tactic: 0 Time: 0.00938 [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:46] [V] [TRT] Tactic: 1002 time 0.027012 [03/13/2022-08:31:46] [V] [TRT] Tactic: 0 time 0.024312 [03/13/2022-08:31:46] [V] [TRT] Fastest Tactic: 0 Time: 0.024312 [03/13/2022-08:31:46] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:46] [V] [TRT] Tactic: 1002 time 0.026292 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.023508 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.023508 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.036348 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.024184 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.024184 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.029532 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.016824 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.016824 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.009056 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.013272 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.009056 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.028456 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.0372 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.028456 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.02992 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.009032 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.009032 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.025408 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.009124 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.009124 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.023812 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.008616 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.008616 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.02804 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.035324 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.02804 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.024376 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.008408 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.008408 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.025684 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.008452 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.008452 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.02944 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.008076 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.008076 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.026656 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.04048 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.026656 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.029368 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.00706 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.00706 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.0299 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.006828 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.006828 [03/13/2022-08:31:47] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800,158400) -> Float(1,11,880,52800,158400) *************** [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Reshape_224 + Transpose_225 (Shuffle) [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.015792 [03/13/2022-08:31:47] [V] [TRT] Tactic: 1 time 0.034568 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.015792 [03/13/2022-08:31:47] [V] [TRT] *************** Autotuning format combination: Float(1,80,4800:32,9600) -> Float(1,11,880:32,1760,5280) *************** [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Reshape_224 + Transpose_225 (Shuffle) [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.034312 [03/13/2022-08:31:47] [V] [TRT] Tactic: 1 time 0.051344 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.034312 [03/13/2022-08:31:47] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800,158400) -> Half(1,11,880,52800,158400) *************** [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Reshape_224 + Transpose_225 (Shuffle) [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.012004 [03/13/2022-08:31:47] [V] [TRT] Tactic: 1 time 0.027544 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.012004 [03/13/2022-08:31:47] [V] [TRT] *************** Autotuning format combination: Half(1,80,4800:2,81600) -> Half(1,11,880:2,26400,79200) *************** [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Reshape_224 + Transpose_225 (Shuffle) [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.015008 [03/13/2022-08:31:47] [V] [TRT] Tactic: 1 time 0.047784 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.015008 [03/13/2022-08:31:47] [V] [TRT] *************** Autotuning format combination: Half(5,400,1:8,24000) -> Half(8,88,1:8,7040,21120) *************** [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Reshape_224 + Transpose_225 (Shuffle) [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.041624 [03/13/2022-08:31:47] [V] [TRT] Tactic: 1 time 0.051856 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.041624 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.00878 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.014384 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.00878 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.028012 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.021568 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.021568 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.027788 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.019844 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.019844 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.008988 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.013628 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.008988 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.02782 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.008472 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.008472 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.0275 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.008648 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.008648 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.019032 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.007936 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.007936 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.01922 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.007224 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.007224 [03/13/2022-08:31:47] [V] [TRT] *************** Autotuning format combination: Float(1,11,880,52800,158400) -> Float(1,11) *************** [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Reshape_227 (Shuffle) [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.012108 [03/13/2022-08:31:47] [V] [TRT] Tactic: 1 time 0.026168 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.012108 [03/13/2022-08:31:47] [V] [TRT] *************** Autotuning format combination: Half(1,11,880,52800,158400) -> Half(1,11) *************** [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Reshape_227 (Shuffle) [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.006104 [03/13/2022-08:31:47] [V] [TRT] Tactic: 1 time 0.01488 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.006104 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.010184 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.014448 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.010184 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.01014 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.013576 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.01014 [03/13/2022-08:31:47] [V] [TRT] *************** Autotuning format combination: Float(1,11) -> Float(1,11) *************** [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Sigmoid_228 (Activation) [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.012696 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.012696 [03/13/2022-08:31:47] [V] [TRT] *************** Autotuning format combination: Half(1,11) -> Half(1,11) *************** [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Sigmoid_228 (Activation) [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.009112 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.009112 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.01014 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.014496 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.01014 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.01022 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.013204 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.01022 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Slice_259 (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.019448 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.006012 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.006012 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Slice_259 (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.01952 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.005996 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.005996 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Slice_259 (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.01962 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.005648 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.005648 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Slice_259 (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.01984 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.005392 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.005392 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Slice_254 (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.11656 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.008856 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.008856 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Slice_254 (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.118748 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.008232 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.008232 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Slice_254 (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.118928 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.008232 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.008232 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Slice_254 (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.121536 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.007976 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.007976 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.00794 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.009556 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.00794 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.007872 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.00906 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.007872 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.005592 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.004984 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.004984 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.0054 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.005104 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.005104 [03/13/2022-08:31:47] [V] [TRT] *************** Autotuning format combination: Float(1,6), Float(1,1) -> Float(1,6) *************** [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Mul_260 (ElementWise) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1 time 0.007068 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 1 Time: 0.007068 [03/13/2022-08:31:47] [V] [TRT] *************** Autotuning format combination: Half(1,6), Half(1,1) -> Half(1,6) *************** [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Mul_260 (ElementWise) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1 time 0.00666 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 1 Time: 0.00666 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Slice_244 (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.115632 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.006284 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.006284 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Slice_244 (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.118708 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.00622 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.00622 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Slice_244 (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.118896 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.005892 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.005892 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Slice_244 (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.12164 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.00582 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.00582 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Slice_233 (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.115768 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.006388 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.006388 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Slice_233 (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.118732 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.006636 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.006636 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Slice_233 (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.119092 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.006216 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.006216 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: Slice_233 (Reformat) [03/13/2022-08:31:47] [V] [TRT] Tactic: 1002 time 0.121412 [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.0056 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 0 Time: 0.0056 [03/13/2022-08:31:47] [V] [TRT] *************** Autotuning format combination: -> Float(1,1,1,1,3) *************** [03/13/2022-08:31:47] [V] [TRT] *************** Autotuning format combination: -> Half(1,1,1,1,3) *************** [03/13/2022-08:31:47] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_264, Mul_265) (PointWise) [03/13/2022-08:31:47] [V] [TRT] Tactic: 128 time 0.02398 [03/13/2022-08:31:47] [V] [TRT] Tactic: 256 time 0.024592 [03/13/2022-08:31:47] [V] [TRT] Tactic: 512 time 0.026816 [03/13/2022-08:31:47] [V] [TRT] Tactic: -32 time 0.035564 [03/13/2022-08:31:47] [V] [TRT] Tactic: -64 time 0.025632 [03/13/2022-08:31:47] [V] [TRT] Tactic: -128 time 0.023344 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: -128 Time: 0.023344 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_264, Mul_265) (PointWiseV2) [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.017072 [03/13/2022-08:31:47] [V] [TRT] Tactic: 1 time 0.01486 [03/13/2022-08:31:47] [V] [TRT] Tactic: 2 time 0.014048 [03/13/2022-08:31:47] [V] [TRT] Tactic: 3 time 0.01486 [03/13/2022-08:31:47] [V] [TRT] Tactic: 4 time 0.013584 [03/13/2022-08:31:47] [V] [TRT] Tactic: 5 time 0.01368 [03/13/2022-08:31:47] [V] [TRT] Tactic: 6 time 0.0149 [03/13/2022-08:31:47] [V] [TRT] Tactic: 7 time 0.013876 [03/13/2022-08:31:47] [V] [TRT] Tactic: 8 time 0.013588 [03/13/2022-08:31:47] [V] [TRT] Tactic: 9 time 0.012856 [03/13/2022-08:31:47] [V] [TRT] Tactic: 28 time 0.017144 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 9 Time: 0.012856 [03/13/2022-08:31:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:47] [V] [TRT] [03/13/2022-08:31:47] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,6000) -> Float(1,40,1200:32,12000) *************** [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_264, Mul_265) (PointWise) [03/13/2022-08:31:47] [V] [TRT] Tactic: 128 time 0.024452 [03/13/2022-08:31:47] [V] [TRT] Tactic: 256 time 0.02444 [03/13/2022-08:31:47] [V] [TRT] Tactic: 512 time 0.02662 [03/13/2022-08:31:47] [V] [TRT] Tactic: -32 time 0.035916 [03/13/2022-08:31:47] [V] [TRT] Tactic: -64 time 0.02622 [03/13/2022-08:31:47] [V] [TRT] Tactic: -128 time 0.023776 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: -128 Time: 0.023776 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_264, Mul_265) (PointWiseV2) [03/13/2022-08:31:47] [V] [TRT] Tactic: 24 time 0.015048 [03/13/2022-08:31:47] [V] [TRT] Tactic: 25 time 0.014936 [03/13/2022-08:31:47] [V] [TRT] Tactic: 26 time 0.014676 [03/13/2022-08:31:47] [V] [TRT] Tactic: 27 time 0.014336 [03/13/2022-08:31:47] [V] [TRT] Tactic: 31 time 0.015072 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 27 Time: 0.014336 [03/13/2022-08:31:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [03/13/2022-08:31:47] [V] [TRT] [03/13/2022-08:31:47] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_264, Mul_265) (PointWise) [03/13/2022-08:31:47] [V] [TRT] Tactic: 128 time 0.021908 [03/13/2022-08:31:47] [V] [TRT] Tactic: 256 time 0.02008 [03/13/2022-08:31:47] [V] [TRT] Tactic: 512 time 0.019552 [03/13/2022-08:31:47] [V] [TRT] Tactic: -32 time 0.028584 [03/13/2022-08:31:47] [V] [TRT] Tactic: -64 time 0.024084 [03/13/2022-08:31:47] [V] [TRT] Tactic: -128 time 0.021792 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 512 Time: 0.019552 [03/13/2022-08:31:47] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_264, Mul_265) (PointWiseV2) [03/13/2022-08:31:47] [V] [TRT] Tactic: 0 time 0.013268 [03/13/2022-08:31:47] [V] [TRT] Tactic: 1 time 0.010768 [03/13/2022-08:31:47] [V] [TRT] Tactic: 2 time 0.009984 [03/13/2022-08:31:47] [V] [TRT] Tactic: 3 time 0.009056 [03/13/2022-08:31:47] [V] [TRT] Tactic: 4 time 0.008784 [03/13/2022-08:31:47] [V] [TRT] Tactic: 5 time 0.00814 [03/13/2022-08:31:47] [V] [TRT] Tactic: 6 time 0.0089 [03/13/2022-08:31:47] [V] [TRT] Tactic: 7 time 0.00806 [03/13/2022-08:31:47] [V] [TRT] Tactic: 8 time 0.007812 [03/13/2022-08:31:47] [V] [TRT] Tactic: 9 time 0.007972 [03/13/2022-08:31:47] [V] [TRT] Tactic: 28 time 0.013492 [03/13/2022-08:31:47] [V] [TRT] Fastest Tactic: 8 Time: 0.007812 [03/13/2022-08:31:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:31:47] [V] [TRT] [03/13/2022-08:31:48] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_264, Mul_265) (PointWise) [03/13/2022-08:31:48] [V] [TRT] Tactic: 128 time 0.02234 [03/13/2022-08:31:48] [V] [TRT] Tactic: 256 time 0.01968 [03/13/2022-08:31:48] [V] [TRT] Tactic: 512 time 0.019604 [03/13/2022-08:31:48] [V] [TRT] Tactic: -32 time 0.028644 [03/13/2022-08:31:48] [V] [TRT] Tactic: -64 time 0.02404 [03/13/2022-08:31:48] [V] [TRT] Tactic: -128 time 0.021528 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 512 Time: 0.019604 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_264, Mul_265) (PointWiseV2) [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.010256 [03/13/2022-08:31:48] [V] [TRT] Tactic: 1 time 0.00898 [03/13/2022-08:31:48] [V] [TRT] Tactic: 2 time 0.010092 [03/13/2022-08:31:48] [V] [TRT] Tactic: 3 time 0.008304 [03/13/2022-08:31:48] [V] [TRT] Tactic: 4 time 0.008888 [03/13/2022-08:31:48] [V] [TRT] Tactic: 5 time 0.010332 [03/13/2022-08:31:48] [V] [TRT] Tactic: 6 time 0.008128 [03/13/2022-08:31:48] [V] [TRT] Tactic: 7 time 0.008464 [03/13/2022-08:31:48] [V] [TRT] Tactic: 8 time 0.010028 [03/13/2022-08:31:48] [V] [TRT] Tactic: 9 time 0.012724 [03/13/2022-08:31:48] [V] [TRT] Tactic: 10 time 0.013984 [03/13/2022-08:31:48] [V] [TRT] Tactic: 11 time 0.011012 [03/13/2022-08:31:48] [V] [TRT] Tactic: 12 time 0.010244 [03/13/2022-08:31:48] [V] [TRT] Tactic: 13 time 0.009616 [03/13/2022-08:31:48] [V] [TRT] Tactic: 14 time 0.008556 [03/13/2022-08:31:48] [V] [TRT] Tactic: 15 time 0.008736 [03/13/2022-08:31:48] [V] [TRT] Tactic: 16 time 0.00878 [03/13/2022-08:31:48] [V] [TRT] Tactic: 17 time 0.008248 [03/13/2022-08:31:48] [V] [TRT] Tactic: 18 time 0.008116 [03/13/2022-08:31:48] [V] [TRT] Tactic: 19 time 0.00816 [03/13/2022-08:31:48] [V] [TRT] Tactic: 28 time 0.010196 [03/13/2022-08:31:48] [V] [TRT] Tactic: 29 time 0.013304 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 18 Time: 0.008116 [03/13/2022-08:31:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:31:48] [V] [TRT] [03/13/2022-08:31:48] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_264, Mul_265) (PointWise) [03/13/2022-08:31:48] [V] [TRT] Tactic: 128 time 0.022388 [03/13/2022-08:31:48] [V] [TRT] Tactic: 256 time 0.019888 [03/13/2022-08:31:48] [V] [TRT] Tactic: 512 time 0.01972 [03/13/2022-08:31:48] [V] [TRT] Tactic: -32 time 0.032264 [03/13/2022-08:31:48] [V] [TRT] Tactic: -64 time 0.027652 [03/13/2022-08:31:48] [V] [TRT] Tactic: -128 time 0.027336 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 512 Time: 0.01972 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_264, Mul_265) (PointWiseV2) [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.01078 [03/13/2022-08:31:48] [V] [TRT] Tactic: 1 time 0.0118 [03/13/2022-08:31:48] [V] [TRT] Tactic: 2 time 0.01156 [03/13/2022-08:31:48] [V] [TRT] Tactic: 3 time 0.014156 [03/13/2022-08:31:48] [V] [TRT] Tactic: 4 time 0.013304 [03/13/2022-08:31:48] [V] [TRT] Tactic: 5 time 0.012112 [03/13/2022-08:31:48] [V] [TRT] Tactic: 6 time 0.019148 [03/13/2022-08:31:48] [V] [TRT] Tactic: 7 time 0.016116 [03/13/2022-08:31:48] [V] [TRT] Tactic: 8 time 0.01408 [03/13/2022-08:31:48] [V] [TRT] Tactic: 9 time 0.015264 [03/13/2022-08:31:48] [V] [TRT] Tactic: 10 time 0.012452 [03/13/2022-08:31:48] [V] [TRT] Tactic: 11 time 0.01082 [03/13/2022-08:31:48] [V] [TRT] Tactic: 12 time 0.011344 [03/13/2022-08:31:48] [V] [TRT] Tactic: 13 time 0.012152 [03/13/2022-08:31:48] [V] [TRT] Tactic: 14 time 0.012224 [03/13/2022-08:31:48] [V] [TRT] Tactic: 15 time 0.011972 [03/13/2022-08:31:48] [V] [TRT] Tactic: 16 time 0.014536 [03/13/2022-08:31:48] [V] [TRT] Tactic: 17 time 0.013992 [03/13/2022-08:31:48] [V] [TRT] Tactic: 18 time 0.012884 [03/13/2022-08:31:48] [V] [TRT] Tactic: 19 time 0.012568 [03/13/2022-08:31:48] [V] [TRT] Tactic: 20 time 0.01292 [03/13/2022-08:31:48] [V] [TRT] Tactic: 21 time 0.012128 [03/13/2022-08:31:48] [V] [TRT] Tactic: 22 time 0.010732 [03/13/2022-08:31:48] [V] [TRT] Tactic: 23 time 0.012452 [03/13/2022-08:31:48] [V] [TRT] Tactic: 24 time 0.014124 [03/13/2022-08:31:48] [V] [TRT] Tactic: 25 time 0.0124 [03/13/2022-08:31:48] [V] [TRT] Tactic: 26 time 0.012112 [03/13/2022-08:31:48] [V] [TRT] Tactic: 27 time 0.010692 [03/13/2022-08:31:48] [V] [TRT] Tactic: 28 time 0.008504 [03/13/2022-08:31:48] [V] [TRT] Tactic: 29 time 0.009912 [03/13/2022-08:31:48] [V] [TRT] Tactic: 30 time 0.01112 [03/13/2022-08:31:48] [V] [TRT] Tactic: 31 time 0.014076 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 28 Time: 0.008504 [03/13/2022-08:31:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [03/13/2022-08:31:48] [V] [TRT] [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.01792 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.013068 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.013068 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.021488 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.040568 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.021488 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.017068 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.015748 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.015748 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.02956 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.013992 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.013992 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.021084 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.014556 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.014556 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.030496 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.026148 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.026148 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.027864 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.013472 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.013472 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.029784 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.023948 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.023948 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.035248 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.024932 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.024932 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.027676 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.018376 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.018376 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.017156 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.015788 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.015788 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.020876 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.03968 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.020876 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.01088 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.006516 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.006516 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.028992 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.01002 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.01002 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.018652 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.011316 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.011316 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.030312 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.016612 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.016612 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.025364 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.05002 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.025364 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.036376 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.016364 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.016364 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.03628 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.007324 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.007324 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.023232 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.010304 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.010304 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.024608 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.025556 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.024608 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.029964 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.062964 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.029964 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.023108 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.024712 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.023108 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.04018 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.010164 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.010164 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.037896 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.012204 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.012204 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 710 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.02036 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.015508 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.015508 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 710 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.019168 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.018552 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.018552 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 710 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.037236 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.019784 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.019784 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 710 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.025184 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.028224 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.025184 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 710 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.037372 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.031948 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.031948 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 710 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.037012 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.029444 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.029444 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 710 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.045304 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.030872 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.030872 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 710 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.033916 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.022036 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.022036 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 710 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.020432 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.019588 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.019588 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 710 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.013676 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.007088 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.007088 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 710 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.036724 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.011976 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.011976 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 710 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.0233 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.014292 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.014292 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 710 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.03718 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.020432 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.020432 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 710 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.036244 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.016408 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.016408 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 710 copy (Reformat) [03/13/2022-08:31:48] [V] [TRT] Tactic: 1002 time 0.036128 [03/13/2022-08:31:48] [V] [TRT] Tactic: 0 time 0.00732 [03/13/2022-08:31:48] [V] [TRT] Fastest Tactic: 0 Time: 0.00732 [03/13/2022-08:31:48] [V] [TRT] --------------- Timing Runner: 710 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.023116 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.010252 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.010252 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 710 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.025304 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.031256 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.025304 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 710 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.023272 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.029096 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.023272 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 710 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.044308 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.009952 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.009952 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 710 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.038524 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.012944 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.012944 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.020776 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.014556 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.014556 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.019792 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.018844 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.018844 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.036744 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.01606 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.01606 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.025552 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.01756 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.01756 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.037548 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.031192 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.031192 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.036872 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.030236 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.030236 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.044768 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.030928 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.030928 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.03406 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.022184 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.022184 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.020304 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.01882 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.01882 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.013412 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.00738 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00738 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.03642 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.011964 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.011964 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.023224 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.014212 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.014212 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.037028 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.020012 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.020012 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.036412 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.016388 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.016388 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.036012 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.007536 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.007536 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.022924 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.010212 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.010212 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.024468 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.025556 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.024468 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.022948 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.024572 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.022948 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.03992 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.010092 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.010092 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: 632 copy (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.037788 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.012096 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.012096 [03/13/2022-08:31:49] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:31:49] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:31:49] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Conv_438 || Conv_426 (FusedConvActConvolution) [03/13/2022-08:31:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Conv_438 || Conv_426 (CaskConvolution) [03/13/2022-08:31:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Conv_438 || Conv_426 (CudaConvolution) [03/13/2022-08:31:49] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Conv_438 || Conv_426 (CudaDepthwiseConvolution) [03/13/2022-08:31:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:49] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:31:49] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Conv_438 || Conv_426 (FusedConvActConvolution) [03/13/2022-08:31:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Conv_438 || Conv_426 (CaskConvolution) [03/13/2022-08:31:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Conv_438 || Conv_426 (CudaConvolution) [03/13/2022-08:31:49] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Conv_438 || Conv_426 (CudaDepthwiseConvolution) [03/13/2022-08:31:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:49] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:31:49] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:31:49] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:31:49] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Conv_279 || Conv_267 (FusedConvActConvolution) [03/13/2022-08:31:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Conv_279 || Conv_267 (CaskConvolution) [03/13/2022-08:31:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Conv_279 || Conv_267 (CudaConvolution) [03/13/2022-08:31:49] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Conv_279 || Conv_267 (CudaDepthwiseConvolution) [03/13/2022-08:31:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:49] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:31:49] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Conv_279 || Conv_267 (FusedConvActConvolution) [03/13/2022-08:31:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Conv_279 || Conv_267 (CaskConvolution) [03/13/2022-08:31:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Conv_279 || Conv_267 (CudaConvolution) [03/13/2022-08:31:49] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Conv_279 || Conv_267 (CudaDepthwiseConvolution) [03/13/2022-08:31:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:49] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.009428 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.009196 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.009196 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.007384 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.006028 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.006028 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.01076 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005576 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005576 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.009796 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.006468 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.006468 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.0118 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.00694 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00694 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.011744 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.006752 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.006752 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.010896 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.007048 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.007048 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.010188 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.006124 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.006124 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.007332 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.00558 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00558 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.009916 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.008524 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.008524 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.010468 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005516 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005516 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.009772 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.006452 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.006452 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.011988 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.00552 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00552 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.009916 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.009004 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.009004 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.011876 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005512 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005512 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.009828 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005308 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005308 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.010132 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005396 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005396 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.01008 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.009924 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.009924 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.009924 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005856 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005856 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.01106 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005684 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005684 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.006532 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005336 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005336 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.005656 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.00516 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00516 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.006752 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.00532 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00532 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.006796 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005416 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005416 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.006932 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005348 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005348 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.006932 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005244 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005244 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.006796 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005428 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005428 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.006772 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005296 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005296 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.005792 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005312 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005312 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.006912 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005432 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005432 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.006624 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.00526 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00526 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.006828 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005232 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005232 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.00668 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005388 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005388 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.00678 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005584 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005584 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.0068 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.00534 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00534 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.006848 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005508 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005508 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.00672 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005572 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005572 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.006652 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005284 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005284 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.006996 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005328 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005328 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1002 time 0.007084 [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005548 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005548 [03/13/2022-08:31:49] [V] [TRT] *************** Autotuning format combination: Float(1,1,80,4800,14400), Float(1,1,1,1,3) -> Float(1,1,80,4800,14400) *************** [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Mul_482 (ElementWise) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1 time 0.005956 [03/13/2022-08:31:49] [V] [TRT] Tactic: 2 time 0.010584 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 1 Time: 0.005956 [03/13/2022-08:31:49] [V] [TRT] *************** Autotuning format combination: Float(1,1,80:32,160,480), Float(1,1,1:32,1,3) -> Float(1,1,80:32,160,480) *************** [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Mul_482 (ElementWise) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1 time 0.006156 [03/13/2022-08:31:49] [V] [TRT] Tactic: 2 time 0.00898 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 1 Time: 0.006156 [03/13/2022-08:31:49] [V] [TRT] *************** Autotuning format combination: Half(1,1,80,4800,14400), Half(1,1,1,1,3) -> Half(1,1,80,4800,14400) *************** [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Mul_482 (ElementWise) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1 time 0.005676 [03/13/2022-08:31:49] [V] [TRT] Tactic: 2 time 0.008668 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 1 Time: 0.005676 [03/13/2022-08:31:49] [V] [TRT] *************** Autotuning format combination: Half(1,1,80:2,2400,7200), Half(1,1,1:2,1,3) -> Half(1,1,80:2,2400,7200) *************** [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Mul_482 (ElementWise) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1 time 0.005544 [03/13/2022-08:31:49] [V] [TRT] Tactic: 2 time 0.009052 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 1 Time: 0.005544 [03/13/2022-08:31:49] [V] [TRT] *************** Autotuning format combination: Half(8,8,1:8,640,1920), Half(1,1,1:8,1,3) -> Half(8,8,1:8,640,1920) *************** [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Mul_482 (ElementWise) [03/13/2022-08:31:49] [V] [TRT] Tactic: 1 time 0.006024 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 1 Time: 0.006024 [03/13/2022-08:31:49] [V] [TRT] *************** Autotuning format combination: Float(1,1,80,4800,14400) -> Float(1,1) *************** [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Reshape_484 (Shuffle) [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005156 [03/13/2022-08:31:49] [V] [TRT] Tactic: 1 time 0.010364 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005156 [03/13/2022-08:31:49] [V] [TRT] *************** Autotuning format combination: Half(1,1,80,4800,14400) -> Half(1,1) *************** [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: Reshape_484 (Shuffle) [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.005008 [03/13/2022-08:31:49] [V] [TRT] Tactic: 1 time 0.01068 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005008 [03/13/2022-08:31:49] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_428, Mul_429) (PointWise) [03/13/2022-08:31:49] [V] [TRT] Tactic: 128 time 0.029924 [03/13/2022-08:31:49] [V] [TRT] Tactic: 256 time 0.030264 [03/13/2022-08:31:49] [V] [TRT] Tactic: 512 time 0.032736 [03/13/2022-08:31:49] [V] [TRT] Tactic: -32 time 0.043356 [03/13/2022-08:31:49] [V] [TRT] Tactic: -64 time 0.03164 [03/13/2022-08:31:49] [V] [TRT] Tactic: -128 time 0.02898 [03/13/2022-08:31:49] [V] [TRT] Fastest Tactic: -128 Time: 0.02898 [03/13/2022-08:31:49] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_428, Mul_429) (PointWiseV2) [03/13/2022-08:31:49] [V] [TRT] Tactic: 0 time 0.020164 [03/13/2022-08:31:49] [V] [TRT] Tactic: 1 time 0.016888 [03/13/2022-08:31:49] [V] [TRT] Tactic: 2 time 0.01482 [03/13/2022-08:31:49] [V] [TRT] Tactic: 3 time 0.016632 [03/13/2022-08:31:49] [V] [TRT] Tactic: 4 time 0.014372 [03/13/2022-08:31:50] [V] [TRT] Tactic: 5 time 0.014192 [03/13/2022-08:31:50] [V] [TRT] Tactic: 6 time 0.016896 [03/13/2022-08:31:50] [V] [TRT] Tactic: 7 time 0.014396 [03/13/2022-08:31:50] [V] [TRT] Tactic: 8 time 0.014124 [03/13/2022-08:31:50] [V] [TRT] Tactic: 9 time 0.0136 [03/13/2022-08:31:50] [V] [TRT] Tactic: 28 time 0.0203 [03/13/2022-08:31:50] [V] [TRT] Fastest Tactic: 9 Time: 0.0136 [03/13/2022-08:31:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:50] [V] [TRT] [03/13/2022-08:31:50] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,12000) -> Float(1,40,1200:32,6000) *************** [03/13/2022-08:31:50] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_428, Mul_429) (PointWise) [03/13/2022-08:31:50] [V] [TRT] Tactic: 128 time 0.029488 [03/13/2022-08:31:50] [V] [TRT] Tactic: 256 time 0.030232 [03/13/2022-08:31:50] [V] [TRT] Tactic: 512 time 0.032808 [03/13/2022-08:31:50] [V] [TRT] Tactic: -32 time 0.04348 [03/13/2022-08:31:50] [V] [TRT] Tactic: -64 time 0.03224 [03/13/2022-08:31:50] [V] [TRT] Tactic: -128 time 0.02936 [03/13/2022-08:31:50] [V] [TRT] Fastest Tactic: -128 Time: 0.02936 [03/13/2022-08:31:50] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_428, Mul_429) (PointWiseV2) [03/13/2022-08:31:50] [V] [TRT] Tactic: 24 time 0.015476 [03/13/2022-08:31:50] [V] [TRT] Tactic: 25 time 0.015292 [03/13/2022-08:31:50] [V] [TRT] Tactic: 26 time 0.014904 [03/13/2022-08:31:50] [V] [TRT] Tactic: 27 time 0.01502 [03/13/2022-08:31:50] [V] [TRT] Tactic: 31 time 0.015464 [03/13/2022-08:31:50] [V] [TRT] Fastest Tactic: 26 Time: 0.014904 [03/13/2022-08:31:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [03/13/2022-08:31:50] [V] [TRT] [03/13/2022-08:31:50] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:31:50] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_428, Mul_429) (PointWise) [03/13/2022-08:31:50] [V] [TRT] Tactic: 128 time 0.027784 [03/13/2022-08:31:50] [V] [TRT] Tactic: 256 time 0.024652 [03/13/2022-08:31:50] [V] [TRT] Tactic: 512 time 0.02426 [03/13/2022-08:31:50] [V] [TRT] Tactic: -32 time 0.036028 [03/13/2022-08:31:50] [V] [TRT] Tactic: -64 time 0.030448 [03/13/2022-08:31:50] [V] [TRT] Tactic: -128 time 0.027284 [03/13/2022-08:31:50] [V] [TRT] Fastest Tactic: 512 Time: 0.02426 [03/13/2022-08:31:50] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_428, Mul_429) (PointWiseV2) [03/13/2022-08:31:50] [V] [TRT] Tactic: 0 time 0.016452 [03/13/2022-08:31:50] [V] [TRT] Tactic: 1 time 0.012916 [03/13/2022-08:31:50] [V] [TRT] Tactic: 2 time 0.012204 [03/13/2022-08:31:50] [V] [TRT] Tactic: 3 time 0.011328 [03/13/2022-08:31:50] [V] [TRT] Tactic: 4 time 0.0108 [03/13/2022-08:31:50] [V] [TRT] Tactic: 5 time 0.010156 [03/13/2022-08:31:50] [V] [TRT] Tactic: 6 time 0.01058 [03/13/2022-08:31:50] [V] [TRT] Tactic: 7 time 0.010076 [03/13/2022-08:31:50] [V] [TRT] Tactic: 8 time 0.00904 [03/13/2022-08:31:50] [V] [TRT] Tactic: 9 time 0.008848 [03/13/2022-08:31:50] [V] [TRT] Tactic: 28 time 0.016344 [03/13/2022-08:31:50] [V] [TRT] Fastest Tactic: 9 Time: 0.008848 [03/13/2022-08:31:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:50] [V] [TRT] [03/13/2022-08:31:50] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:31:50] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_428, Mul_429) (PointWise) [03/13/2022-08:31:50] [V] [TRT] Tactic: 128 time 0.027912 [03/13/2022-08:31:50] [V] [TRT] Tactic: 256 time 0.024452 [03/13/2022-08:31:50] [V] [TRT] Tactic: 512 time 0.024428 [03/13/2022-08:31:50] [V] [TRT] Tactic: -32 time 0.035704 [03/13/2022-08:31:50] [V] [TRT] Tactic: -64 time 0.030452 [03/13/2022-08:31:50] [V] [TRT] Tactic: -128 time 0.027608 [03/13/2022-08:31:50] [V] [TRT] Fastest Tactic: 512 Time: 0.024428 [03/13/2022-08:31:50] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_428, Mul_429) (PointWiseV2) [03/13/2022-08:31:50] [V] [TRT] Tactic: 0 time 0.01268 [03/13/2022-08:31:50] [V] [TRT] Tactic: 1 time 0.011392 [03/13/2022-08:31:50] [V] [TRT] Tactic: 2 time 0.012008 [03/13/2022-08:31:50] [V] [TRT] Tactic: 3 time 0.010112 [03/13/2022-08:31:50] [V] [TRT] Tactic: 4 time 0.01122 [03/13/2022-08:31:50] [V] [TRT] Tactic: 5 time 0.01266 [03/13/2022-08:31:50] [V] [TRT] Tactic: 6 time 0.010072 [03/13/2022-08:31:50] [V] [TRT] Tactic: 7 time 0.010548 [03/13/2022-08:31:50] [V] [TRT] Tactic: 8 time 0.01202 [03/13/2022-08:31:50] [V] [TRT] Tactic: 9 time 0.01468 [03/13/2022-08:31:50] [V] [TRT] Tactic: 10 time 0.016944 [03/13/2022-08:31:50] [V] [TRT] Tactic: 11 time 0.013912 [03/13/2022-08:31:50] [V] [TRT] Tactic: 12 time 0.012948 [03/13/2022-08:31:50] [V] [TRT] Tactic: 13 time 0.011832 [03/13/2022-08:31:50] [V] [TRT] Tactic: 14 time 0.010912 [03/13/2022-08:31:50] [V] [TRT] Tactic: 15 time 0.010552 [03/13/2022-08:31:50] [V] [TRT] Tactic: 16 time 0.011228 [03/13/2022-08:31:50] [V] [TRT] Tactic: 17 time 0.010088 [03/13/2022-08:31:50] [V] [TRT] Tactic: 18 time 0.009832 [03/13/2022-08:31:50] [V] [TRT] Tactic: 19 time 0.010068 [03/13/2022-08:31:50] [V] [TRT] Tactic: 28 time 0.01282 [03/13/2022-08:31:50] [V] [TRT] Tactic: 29 time 0.016844 [03/13/2022-08:31:50] [V] [TRT] Fastest Tactic: 18 Time: 0.009832 [03/13/2022-08:31:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:31:50] [V] [TRT] [03/13/2022-08:31:50] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:31:50] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_428, Mul_429) (PointWise) [03/13/2022-08:31:50] [V] [TRT] Tactic: 128 time 0.0279 [03/13/2022-08:31:50] [V] [TRT] Tactic: 256 time 0.024544 [03/13/2022-08:31:50] [V] [TRT] Tactic: 512 time 0.024348 [03/13/2022-08:31:50] [V] [TRT] Tactic: -32 time 0.041404 [03/13/2022-08:31:50] [V] [TRT] Tactic: -64 time 0.034888 [03/13/2022-08:31:50] [V] [TRT] Tactic: -128 time 0.034836 [03/13/2022-08:31:50] [V] [TRT] Fastest Tactic: 512 Time: 0.024348 [03/13/2022-08:31:50] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_428, Mul_429) (PointWiseV2) [03/13/2022-08:31:50] [V] [TRT] Tactic: 0 time 0.013252 [03/13/2022-08:31:50] [V] [TRT] Tactic: 1 time 0.014356 [03/13/2022-08:31:50] [V] [TRT] Tactic: 2 time 0.014288 [03/13/2022-08:31:50] [V] [TRT] Tactic: 3 time 0.017232 [03/13/2022-08:31:50] [V] [TRT] Tactic: 4 time 0.016176 [03/13/2022-08:31:50] [V] [TRT] Tactic: 5 time 0.01456 [03/13/2022-08:31:50] [V] [TRT] Tactic: 6 time 0.023788 [03/13/2022-08:31:50] [V] [TRT] Tactic: 7 time 0.019612 [03/13/2022-08:31:50] [V] [TRT] Tactic: 8 time 0.017208 [03/13/2022-08:31:50] [V] [TRT] Tactic: 9 time 0.018884 [03/13/2022-08:31:50] [V] [TRT] Tactic: 10 time 0.015012 [03/13/2022-08:31:50] [V] [TRT] Tactic: 11 time 0.013036 [03/13/2022-08:31:50] [V] [TRT] Tactic: 12 time 0.014012 [03/13/2022-08:31:50] [V] [TRT] Tactic: 13 time 0.014464 [03/13/2022-08:31:50] [V] [TRT] Tactic: 14 time 0.014628 [03/13/2022-08:31:50] [V] [TRT] Tactic: 15 time 0.014268 [03/13/2022-08:31:50] [V] [TRT] Tactic: 16 time 0.017696 [03/13/2022-08:31:50] [V] [TRT] Tactic: 17 time 0.016508 [03/13/2022-08:31:50] [V] [TRT] Tactic: 18 time 0.01598 [03/13/2022-08:31:50] [V] [TRT] Tactic: 19 time 0.01494 [03/13/2022-08:31:50] [V] [TRT] Tactic: 20 time 0.015788 [03/13/2022-08:31:50] [V] [TRT] Tactic: 21 time 0.0147 [03/13/2022-08:31:50] [V] [TRT] Tactic: 22 time 0.013024 [03/13/2022-08:31:50] [V] [TRT] Tactic: 23 time 0.01502 [03/13/2022-08:31:50] [V] [TRT] Tactic: 24 time 0.017888 [03/13/2022-08:31:50] [V] [TRT] Tactic: 25 time 0.015728 [03/13/2022-08:31:50] [V] [TRT] Tactic: 26 time 0.015376 [03/13/2022-08:31:50] [V] [TRT] Tactic: 27 time 0.013028 [03/13/2022-08:31:50] [V] [TRT] Tactic: 28 time 0.01032 [03/13/2022-08:31:50] [V] [TRT] Tactic: 29 time 0.011204 [03/13/2022-08:31:50] [V] [TRT] Tactic: 30 time 0.014004 [03/13/2022-08:31:50] [V] [TRT] Tactic: 31 time 0.017732 [03/13/2022-08:31:50] [V] [TRT] Fastest Tactic: 28 Time: 0.01032 [03/13/2022-08:31:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [03/13/2022-08:31:50] [V] [TRT] [03/13/2022-08:31:50] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:50] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_269, Mul_270) (PointWise) [03/13/2022-08:31:50] [V] [TRT] Tactic: 128 time 0.029344 [03/13/2022-08:31:50] [V] [TRT] Tactic: 256 time 0.030392 [03/13/2022-08:31:50] [V] [TRT] Tactic: 512 time 0.032848 [03/13/2022-08:31:50] [V] [TRT] Tactic: -32 time 0.043496 [03/13/2022-08:31:50] [V] [TRT] Tactic: -64 time 0.032368 [03/13/2022-08:31:50] [V] [TRT] Tactic: -128 time 0.029136 [03/13/2022-08:31:50] [V] [TRT] Fastest Tactic: -128 Time: 0.029136 [03/13/2022-08:31:50] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_269, Mul_270) (PointWiseV2) [03/13/2022-08:31:50] [V] [TRT] Tactic: 0 time 0.02006 [03/13/2022-08:31:50] [V] [TRT] Tactic: 1 time 0.017144 [03/13/2022-08:31:50] [V] [TRT] Tactic: 2 time 0.014788 [03/13/2022-08:31:50] [V] [TRT] Tactic: 3 time 0.016504 [03/13/2022-08:31:50] [V] [TRT] Tactic: 4 time 0.014356 [03/13/2022-08:31:50] [V] [TRT] Tactic: 5 time 0.013888 [03/13/2022-08:31:50] [V] [TRT] Tactic: 6 time 0.016452 [03/13/2022-08:31:50] [V] [TRT] Tactic: 7 time 0.014468 [03/13/2022-08:31:50] [V] [TRT] Tactic: 8 time 0.014124 [03/13/2022-08:31:50] [V] [TRT] Tactic: 9 time 0.013364 [03/13/2022-08:31:50] [V] [TRT] Tactic: 28 time 0.020332 [03/13/2022-08:31:50] [V] [TRT] Fastest Tactic: 9 Time: 0.013364 [03/13/2022-08:31:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:50] [V] [TRT] [03/13/2022-08:31:50] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,12000) -> Float(1,40,1200:32,6000) *************** [03/13/2022-08:31:50] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_269, Mul_270) (PointWise) [03/13/2022-08:31:50] [V] [TRT] Tactic: 128 time 0.029864 [03/13/2022-08:31:50] [V] [TRT] Tactic: 256 time 0.030416 [03/13/2022-08:31:50] [V] [TRT] Tactic: 512 time 0.03318 [03/13/2022-08:31:50] [V] [TRT] Tactic: -32 time 0.043472 [03/13/2022-08:31:50] [V] [TRT] Tactic: -64 time 0.032432 [03/13/2022-08:31:50] [V] [TRT] Tactic: -128 time 0.029784 [03/13/2022-08:31:50] [V] [TRT] Fastest Tactic: -128 Time: 0.029784 [03/13/2022-08:31:50] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_269, Mul_270) (PointWiseV2) [03/13/2022-08:31:50] [V] [TRT] Tactic: 24 time 0.015084 [03/13/2022-08:31:50] [V] [TRT] Tactic: 25 time 0.015352 [03/13/2022-08:31:50] [V] [TRT] Tactic: 26 time 0.0154 [03/13/2022-08:31:50] [V] [TRT] Tactic: 27 time 0.01536 [03/13/2022-08:31:50] [V] [TRT] Tactic: 31 time 0.015204 [03/13/2022-08:31:50] [V] [TRT] Fastest Tactic: 24 Time: 0.015084 [03/13/2022-08:31:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [03/13/2022-08:31:50] [V] [TRT] [03/13/2022-08:31:50] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:31:50] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_269, Mul_270) (PointWise) [03/13/2022-08:31:50] [V] [TRT] Tactic: 128 time 0.028208 [03/13/2022-08:31:50] [V] [TRT] Tactic: 256 time 0.024472 [03/13/2022-08:31:50] [V] [TRT] Tactic: 512 time 0.024544 [03/13/2022-08:31:50] [V] [TRT] Tactic: -32 time 0.035524 [03/13/2022-08:31:50] [V] [TRT] Tactic: -64 time 0.030512 [03/13/2022-08:31:50] [V] [TRT] Tactic: -128 time 0.027448 [03/13/2022-08:31:50] [V] [TRT] Fastest Tactic: 256 Time: 0.024472 [03/13/2022-08:31:50] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_269, Mul_270) (PointWiseV2) [03/13/2022-08:31:50] [V] [TRT] Tactic: 0 time 0.016348 [03/13/2022-08:31:50] [V] [TRT] Tactic: 1 time 0.013552 [03/13/2022-08:31:50] [V] [TRT] Tactic: 2 time 0.012268 [03/13/2022-08:31:50] [V] [TRT] Tactic: 3 time 0.01128 [03/13/2022-08:31:50] [V] [TRT] Tactic: 4 time 0.010652 [03/13/2022-08:31:50] [V] [TRT] Tactic: 5 time 0.009996 [03/13/2022-08:31:50] [V] [TRT] Tactic: 6 time 0.010588 [03/13/2022-08:31:50] [V] [TRT] Tactic: 7 time 0.010024 [03/13/2022-08:31:50] [V] [TRT] Tactic: 8 time 0.00914 [03/13/2022-08:31:50] [V] [TRT] Tactic: 9 time 0.009184 [03/13/2022-08:31:51] [V] [TRT] Tactic: 28 time 0.016312 [03/13/2022-08:31:51] [V] [TRT] Fastest Tactic: 8 Time: 0.00914 [03/13/2022-08:31:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:31:51] [V] [TRT] [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_269, Mul_270) (PointWise) [03/13/2022-08:31:51] [V] [TRT] Tactic: 128 time 0.027816 [03/13/2022-08:31:51] [V] [TRT] Tactic: 256 time 0.024708 [03/13/2022-08:31:51] [V] [TRT] Tactic: 512 time 0.024588 [03/13/2022-08:31:51] [V] [TRT] Tactic: -32 time 0.03552 [03/13/2022-08:31:51] [V] [TRT] Tactic: -64 time 0.030332 [03/13/2022-08:31:51] [V] [TRT] Tactic: -128 time 0.027548 [03/13/2022-08:31:51] [V] [TRT] Fastest Tactic: 512 Time: 0.024588 [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_269, Mul_270) (PointWiseV2) [03/13/2022-08:31:51] [V] [TRT] Tactic: 0 time 0.012808 [03/13/2022-08:31:51] [V] [TRT] Tactic: 1 time 0.011068 [03/13/2022-08:31:51] [V] [TRT] Tactic: 2 time 0.012116 [03/13/2022-08:31:51] [V] [TRT] Tactic: 3 time 0.010268 [03/13/2022-08:31:51] [V] [TRT] Tactic: 4 time 0.010864 [03/13/2022-08:31:51] [V] [TRT] Tactic: 5 time 0.012528 [03/13/2022-08:31:51] [V] [TRT] Tactic: 6 time 0.010172 [03/13/2022-08:31:51] [V] [TRT] Tactic: 7 time 0.010444 [03/13/2022-08:31:51] [V] [TRT] Tactic: 8 time 0.01182 [03/13/2022-08:31:51] [V] [TRT] Tactic: 9 time 0.014772 [03/13/2022-08:31:51] [V] [TRT] Tactic: 10 time 0.0171 [03/13/2022-08:31:51] [V] [TRT] Tactic: 11 time 0.013972 [03/13/2022-08:31:51] [V] [TRT] Tactic: 12 time 0.012916 [03/13/2022-08:31:51] [V] [TRT] Tactic: 13 time 0.01188 [03/13/2022-08:31:51] [V] [TRT] Tactic: 14 time 0.010936 [03/13/2022-08:31:51] [V] [TRT] Tactic: 15 time 0.010344 [03/13/2022-08:31:51] [V] [TRT] Tactic: 16 time 0.010912 [03/13/2022-08:31:51] [V] [TRT] Tactic: 17 time 0.010156 [03/13/2022-08:31:51] [V] [TRT] Tactic: 18 time 0.009848 [03/13/2022-08:31:51] [V] [TRT] Tactic: 19 time 0.010064 [03/13/2022-08:31:51] [V] [TRT] Tactic: 28 time 0.012612 [03/13/2022-08:31:51] [V] [TRT] Tactic: 29 time 0.01682 [03/13/2022-08:31:51] [V] [TRT] Fastest Tactic: 18 Time: 0.009848 [03/13/2022-08:31:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:31:51] [V] [TRT] [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_269, Mul_270) (PointWise) [03/13/2022-08:31:51] [V] [TRT] Tactic: 128 time 0.028284 [03/13/2022-08:31:51] [V] [TRT] Tactic: 256 time 0.025152 [03/13/2022-08:31:51] [V] [TRT] Tactic: 512 time 0.024584 [03/13/2022-08:31:51] [V] [TRT] Tactic: -32 time 0.04156 [03/13/2022-08:31:51] [V] [TRT] Tactic: -64 time 0.034876 [03/13/2022-08:31:51] [V] [TRT] Tactic: -128 time 0.034836 [03/13/2022-08:31:51] [V] [TRT] Fastest Tactic: 512 Time: 0.024584 [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_269, Mul_270) (PointWiseV2) [03/13/2022-08:31:51] [V] [TRT] Tactic: 0 time 0.013628 [03/13/2022-08:31:51] [V] [TRT] Tactic: 1 time 0.014308 [03/13/2022-08:31:51] [V] [TRT] Tactic: 2 time 0.014252 [03/13/2022-08:31:51] [V] [TRT] Tactic: 3 time 0.017364 [03/13/2022-08:31:51] [V] [TRT] Tactic: 4 time 0.0163 [03/13/2022-08:31:51] [V] [TRT] Tactic: 5 time 0.014424 [03/13/2022-08:31:51] [V] [TRT] Tactic: 6 time 0.02416 [03/13/2022-08:31:51] [V] [TRT] Tactic: 7 time 0.019856 [03/13/2022-08:31:51] [V] [TRT] Tactic: 8 time 0.017044 [03/13/2022-08:31:51] [V] [TRT] Tactic: 9 time 0.018884 [03/13/2022-08:31:51] [V] [TRT] Tactic: 10 time 0.014872 [03/13/2022-08:31:51] [V] [TRT] Tactic: 11 time 0.013308 [03/13/2022-08:31:51] [V] [TRT] Tactic: 12 time 0.014124 [03/13/2022-08:31:51] [V] [TRT] Tactic: 13 time 0.014484 [03/13/2022-08:31:51] [V] [TRT] Tactic: 14 time 0.014764 [03/13/2022-08:31:51] [V] [TRT] Tactic: 15 time 0.014392 [03/13/2022-08:31:51] [V] [TRT] Tactic: 16 time 0.017776 [03/13/2022-08:31:51] [V] [TRT] Tactic: 17 time 0.01662 [03/13/2022-08:31:51] [V] [TRT] Tactic: 18 time 0.016028 [03/13/2022-08:31:51] [V] [TRT] Tactic: 19 time 0.015188 [03/13/2022-08:31:51] [V] [TRT] Tactic: 20 time 0.015396 [03/13/2022-08:31:51] [V] [TRT] Tactic: 21 time 0.015136 [03/13/2022-08:31:51] [V] [TRT] Tactic: 22 time 0.013036 [03/13/2022-08:31:51] [V] [TRT] Tactic: 23 time 0.015228 [03/13/2022-08:31:51] [V] [TRT] Tactic: 24 time 0.01792 [03/13/2022-08:31:51] [V] [TRT] Tactic: 25 time 0.015952 [03/13/2022-08:31:51] [V] [TRT] Tactic: 26 time 0.01522 [03/13/2022-08:31:51] [V] [TRT] Tactic: 27 time 0.012964 [03/13/2022-08:31:51] [V] [TRT] Tactic: 28 time 0.010476 [03/13/2022-08:31:51] [V] [TRT] Tactic: 29 time 0.011372 [03/13/2022-08:31:51] [V] [TRT] Tactic: 30 time 0.013644 [03/13/2022-08:31:51] [V] [TRT] Tactic: 31 time 0.01766 [03/13/2022-08:31:51] [V] [TRT] Fastest Tactic: 28 Time: 0.010476 [03/13/2022-08:31:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [03/13/2022-08:31:51] [V] [TRT] [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: Conv_271 (FusedConvActConvolution) [03/13/2022-08:31:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: Conv_271 (CaskConvolution) [03/13/2022-08:31:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: Conv_271 (CudaConvolution) [03/13/2022-08:31:51] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: Conv_271 (CudaDepthwiseConvolution) [03/13/2022-08:31:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: Conv_271 (FusedConvActConvolution) [03/13/2022-08:31:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: Conv_271 (CaskConvolution) [03/13/2022-08:31:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: Conv_271 (CudaConvolution) [03/13/2022-08:31:51] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: Conv_271 (CudaDepthwiseConvolution) [03/13/2022-08:31:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: Conv_430 (FusedConvActConvolution) [03/13/2022-08:31:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: Conv_430 (CaskConvolution) [03/13/2022-08:31:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: Conv_430 (CudaConvolution) [03/13/2022-08:31:51] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: Conv_430 (CudaDepthwiseConvolution) [03/13/2022-08:31:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: Conv_430 (FusedConvActConvolution) [03/13/2022-08:31:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: Conv_430 (CaskConvolution) [03/13/2022-08:31:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: Conv_430 (CudaConvolution) [03/13/2022-08:31:51] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: Conv_430 (CudaDepthwiseConvolution) [03/13/2022-08:31:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: -> Float(1,2) *************** [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: -> Half(1,2) *************** [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: -> Float(1,2) *************** [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: -> Half(1,2) *************** [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_273, Mul_274) (PointWise) [03/13/2022-08:31:51] [V] [TRT] Tactic: 128 time 0.026364 [03/13/2022-08:31:51] [V] [TRT] Tactic: 256 time 0.026756 [03/13/2022-08:31:51] [V] [TRT] Tactic: 512 time 0.029584 [03/13/2022-08:31:51] [V] [TRT] Tactic: -32 time 0.043216 [03/13/2022-08:31:51] [V] [TRT] Tactic: -64 time 0.031772 [03/13/2022-08:31:51] [V] [TRT] Tactic: -128 time 0.028708 [03/13/2022-08:31:51] [V] [TRT] Fastest Tactic: 128 Time: 0.026364 [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_273, Mul_274) (PointWiseV2) [03/13/2022-08:31:51] [V] [TRT] Tactic: 0 time 0.018976 [03/13/2022-08:31:51] [V] [TRT] Tactic: 1 time 0.016116 [03/13/2022-08:31:51] [V] [TRT] Tactic: 2 time 0.01474 [03/13/2022-08:31:51] [V] [TRT] Tactic: 3 time 0.016348 [03/13/2022-08:31:51] [V] [TRT] Tactic: 4 time 0.014528 [03/13/2022-08:31:51] [V] [TRT] Tactic: 5 time 0.013828 [03/13/2022-08:31:51] [V] [TRT] Tactic: 6 time 0.016308 [03/13/2022-08:31:51] [V] [TRT] Tactic: 7 time 0.014324 [03/13/2022-08:31:51] [V] [TRT] Tactic: 8 time 0.014108 [03/13/2022-08:31:51] [V] [TRT] Tactic: 9 time 0.01326 [03/13/2022-08:31:51] [V] [TRT] Tactic: 28 time 0.018752 [03/13/2022-08:31:51] [V] [TRT] Fastest Tactic: 9 Time: 0.01326 [03/13/2022-08:31:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:51] [V] [TRT] [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,6000) -> Float(1,40,1200:32,6000) *************** [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_273, Mul_274) (PointWise) [03/13/2022-08:31:51] [V] [TRT] Tactic: 128 time 0.026192 [03/13/2022-08:31:51] [V] [TRT] Tactic: 256 time 0.026816 [03/13/2022-08:31:51] [V] [TRT] Tactic: 512 time 0.029348 [03/13/2022-08:31:51] [V] [TRT] Tactic: -32 time 0.043384 [03/13/2022-08:31:51] [V] [TRT] Tactic: -64 time 0.031976 [03/13/2022-08:31:51] [V] [TRT] Tactic: -128 time 0.028712 [03/13/2022-08:31:51] [V] [TRT] Fastest Tactic: 128 Time: 0.026192 [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_273, Mul_274) (PointWiseV2) [03/13/2022-08:31:51] [V] [TRT] Tactic: 24 time 0.015672 [03/13/2022-08:31:51] [V] [TRT] Tactic: 25 time 0.015648 [03/13/2022-08:31:51] [V] [TRT] Tactic: 26 time 0.014968 [03/13/2022-08:31:51] [V] [TRT] Tactic: 27 time 0.014888 [03/13/2022-08:31:51] [V] [TRT] Tactic: 31 time 0.015288 [03/13/2022-08:31:51] [V] [TRT] Fastest Tactic: 27 Time: 0.014888 [03/13/2022-08:31:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [03/13/2022-08:31:51] [V] [TRT] [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_273, Mul_274) (PointWise) [03/13/2022-08:31:51] [V] [TRT] Tactic: 128 time 0.026408 [03/13/2022-08:31:51] [V] [TRT] Tactic: 256 time 0.023396 [03/13/2022-08:31:51] [V] [TRT] Tactic: 512 time 0.023084 [03/13/2022-08:31:51] [V] [TRT] Tactic: -32 time 0.03598 [03/13/2022-08:31:51] [V] [TRT] Tactic: -64 time 0.02998 [03/13/2022-08:31:51] [V] [TRT] Tactic: -128 time 0.026876 [03/13/2022-08:31:51] [V] [TRT] Fastest Tactic: 512 Time: 0.023084 [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_273, Mul_274) (PointWiseV2) [03/13/2022-08:31:51] [V] [TRT] Tactic: 0 time 0.01452 [03/13/2022-08:31:51] [V] [TRT] Tactic: 1 time 0.012272 [03/13/2022-08:31:51] [V] [TRT] Tactic: 2 time 0.01106 [03/13/2022-08:31:51] [V] [TRT] Tactic: 3 time 0.010892 [03/13/2022-08:31:51] [V] [TRT] Tactic: 4 time 0.009964 [03/13/2022-08:31:51] [V] [TRT] Tactic: 5 time 0.008976 [03/13/2022-08:31:51] [V] [TRT] Tactic: 6 time 0.01032 [03/13/2022-08:31:51] [V] [TRT] Tactic: 7 time 0.008884 [03/13/2022-08:31:51] [V] [TRT] Tactic: 8 time 0.008996 [03/13/2022-08:31:51] [V] [TRT] Tactic: 9 time 0.008784 [03/13/2022-08:31:51] [V] [TRT] Tactic: 28 time 0.014456 [03/13/2022-08:31:51] [V] [TRT] Fastest Tactic: 9 Time: 0.008784 [03/13/2022-08:31:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:51] [V] [TRT] [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_273, Mul_274) (PointWise) [03/13/2022-08:31:51] [V] [TRT] Tactic: 128 time 0.02652 [03/13/2022-08:31:51] [V] [TRT] Tactic: 256 time 0.022952 [03/13/2022-08:31:51] [V] [TRT] Tactic: 512 time 0.023116 [03/13/2022-08:31:51] [V] [TRT] Tactic: -32 time 0.035404 [03/13/2022-08:31:51] [V] [TRT] Tactic: -64 time 0.03002 [03/13/2022-08:31:51] [V] [TRT] Tactic: -128 time 0.026848 [03/13/2022-08:31:51] [V] [TRT] Fastest Tactic: 256 Time: 0.022952 [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_273, Mul_274) (PointWiseV2) [03/13/2022-08:31:51] [V] [TRT] Tactic: 0 time 0.011812 [03/13/2022-08:31:51] [V] [TRT] Tactic: 1 time 0.010396 [03/13/2022-08:31:51] [V] [TRT] Tactic: 2 time 0.011232 [03/13/2022-08:31:51] [V] [TRT] Tactic: 3 time 0.00992 [03/13/2022-08:31:51] [V] [TRT] Tactic: 4 time 0.01102 [03/13/2022-08:31:51] [V] [TRT] Tactic: 5 time 0.012272 [03/13/2022-08:31:51] [V] [TRT] Tactic: 6 time 0.009016 [03/13/2022-08:31:51] [V] [TRT] Tactic: 7 time 0.01014 [03/13/2022-08:31:51] [V] [TRT] Tactic: 8 time 0.01146 [03/13/2022-08:31:51] [V] [TRT] Tactic: 9 time 0.014468 [03/13/2022-08:31:51] [V] [TRT] Tactic: 10 time 0.01532 [03/13/2022-08:31:51] [V] [TRT] Tactic: 11 time 0.012472 [03/13/2022-08:31:51] [V] [TRT] Tactic: 12 time 0.011784 [03/13/2022-08:31:51] [V] [TRT] Tactic: 13 time 0.0114 [03/13/2022-08:31:51] [V] [TRT] Tactic: 14 time 0.0101 [03/13/2022-08:31:51] [V] [TRT] Tactic: 15 time 0.010012 [03/13/2022-08:31:51] [V] [TRT] Tactic: 16 time 0.010324 [03/13/2022-08:31:51] [V] [TRT] Tactic: 17 time 0.009768 [03/13/2022-08:31:51] [V] [TRT] Tactic: 18 time 0.009376 [03/13/2022-08:31:51] [V] [TRT] Tactic: 19 time 0.009812 [03/13/2022-08:31:51] [V] [TRT] Tactic: 28 time 0.011552 [03/13/2022-08:31:51] [V] [TRT] Tactic: 29 time 0.015012 [03/13/2022-08:31:51] [V] [TRT] Fastest Tactic: 6 Time: 0.009016 [03/13/2022-08:31:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [03/13/2022-08:31:51] [V] [TRT] [03/13/2022-08:31:51] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:31:51] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_273, Mul_274) (PointWise) [03/13/2022-08:31:51] [V] [TRT] Tactic: 128 time 0.02656 [03/13/2022-08:31:51] [V] [TRT] Tactic: 256 time 0.023248 [03/13/2022-08:31:52] [V] [TRT] Tactic: 512 time 0.02298 [03/13/2022-08:31:52] [V] [TRT] Tactic: -32 time 0.035808 [03/13/2022-08:31:52] [V] [TRT] Tactic: -64 time 0.030216 [03/13/2022-08:31:52] [V] [TRT] Tactic: -128 time 0.026964 [03/13/2022-08:31:52] [V] [TRT] Fastest Tactic: 512 Time: 0.02298 [03/13/2022-08:31:52] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_273, Mul_274) (PointWiseV2) [03/13/2022-08:31:52] [V] [TRT] Tactic: 0 time 0.01042 [03/13/2022-08:31:52] [V] [TRT] Tactic: 1 time 0.010108 [03/13/2022-08:31:52] [V] [TRT] Tactic: 2 time 0.011876 [03/13/2022-08:31:52] [V] [TRT] Tactic: 3 time 0.01032 [03/13/2022-08:31:52] [V] [TRT] Tactic: 4 time 0.012412 [03/13/2022-08:31:52] [V] [TRT] Tactic: 5 time 0.015028 [03/13/2022-08:31:52] [V] [TRT] Tactic: 6 time 0.014184 [03/13/2022-08:31:52] [V] [TRT] Tactic: 7 time 0.014852 [03/13/2022-08:31:52] [V] [TRT] Tactic: 8 time 0.016168 [03/13/2022-08:31:52] [V] [TRT] Tactic: 9 time 0.022684 [03/13/2022-08:31:52] [V] [TRT] Tactic: 10 time 0.010672 [03/13/2022-08:31:52] [V] [TRT] Tactic: 11 time 0.009764 [03/13/2022-08:31:52] [V] [TRT] Tactic: 12 time 0.010628 [03/13/2022-08:31:52] [V] [TRT] Tactic: 13 time 0.009496 [03/13/2022-08:31:52] [V] [TRT] Tactic: 14 time 0.010356 [03/13/2022-08:31:52] [V] [TRT] Tactic: 15 time 0.012624 [03/13/2022-08:31:52] [V] [TRT] Tactic: 16 time 0.011548 [03/13/2022-08:31:52] [V] [TRT] Tactic: 17 time 0.011192 [03/13/2022-08:31:52] [V] [TRT] Tactic: 18 time 0.0132 [03/13/2022-08:31:52] [V] [TRT] Tactic: 19 time 0.017592 [03/13/2022-08:31:52] [V] [TRT] Tactic: 20 time 0.011856 [03/13/2022-08:31:52] [V] [TRT] Tactic: 21 time 0.01034 [03/13/2022-08:31:52] [V] [TRT] Tactic: 22 time 0.009716 [03/13/2022-08:31:52] [V] [TRT] Tactic: 23 time 0.009728 [03/13/2022-08:31:52] [V] [TRT] Tactic: 24 time 0.015352 [03/13/2022-08:31:52] [V] [TRT] Tactic: 25 time 0.012568 [03/13/2022-08:31:52] [V] [TRT] Tactic: 26 time 0.01162 [03/13/2022-08:31:52] [V] [TRT] Tactic: 27 time 0.010272 [03/13/2022-08:31:52] [V] [TRT] Tactic: 28 time 0.010432 [03/13/2022-08:31:52] [V] [TRT] Tactic: 29 time 0.010832 [03/13/2022-08:31:52] [V] [TRT] Tactic: 30 time 0.01204 [03/13/2022-08:31:52] [V] [TRT] Tactic: 31 time 0.015256 [03/13/2022-08:31:52] [V] [TRT] Fastest Tactic: 13 Time: 0.009496 [03/13/2022-08:31:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 13 [03/13/2022-08:31:52] [V] [TRT] [03/13/2022-08:31:52] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:52] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_432, Mul_433) (PointWise) [03/13/2022-08:31:52] [V] [TRT] Tactic: 128 time 0.026224 [03/13/2022-08:31:52] [V] [TRT] Tactic: 256 time 0.026776 [03/13/2022-08:31:52] [V] [TRT] Tactic: 512 time 0.029228 [03/13/2022-08:31:52] [V] [TRT] Tactic: -32 time 0.043328 [03/13/2022-08:31:52] [V] [TRT] Tactic: -64 time 0.031408 [03/13/2022-08:31:52] [V] [TRT] Tactic: -128 time 0.02874 [03/13/2022-08:31:52] [V] [TRT] Fastest Tactic: 128 Time: 0.026224 [03/13/2022-08:31:52] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_432, Mul_433) (PointWiseV2) [03/13/2022-08:31:52] [V] [TRT] Tactic: 0 time 0.019208 [03/13/2022-08:31:52] [V] [TRT] Tactic: 1 time 0.016516 [03/13/2022-08:31:52] [V] [TRT] Tactic: 2 time 0.014596 [03/13/2022-08:31:52] [V] [TRT] Tactic: 3 time 0.01618 [03/13/2022-08:31:52] [V] [TRT] Tactic: 4 time 0.014268 [03/13/2022-08:31:52] [V] [TRT] Tactic: 5 time 0.013904 [03/13/2022-08:31:52] [V] [TRT] Tactic: 6 time 0.01602 [03/13/2022-08:31:52] [V] [TRT] Tactic: 7 time 0.0143 [03/13/2022-08:31:52] [V] [TRT] Tactic: 8 time 0.013944 [03/13/2022-08:31:52] [V] [TRT] Tactic: 9 time 0.013192 [03/13/2022-08:31:52] [V] [TRT] Tactic: 28 time 0.018844 [03/13/2022-08:31:52] [V] [TRT] Fastest Tactic: 9 Time: 0.013192 [03/13/2022-08:31:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:52] [V] [TRT] [03/13/2022-08:31:52] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,6000) -> Float(1,40,1200:32,6000) *************** [03/13/2022-08:31:52] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_432, Mul_433) (PointWise) [03/13/2022-08:31:52] [V] [TRT] Tactic: 128 time 0.025764 [03/13/2022-08:31:52] [V] [TRT] Tactic: 256 time 0.026816 [03/13/2022-08:31:52] [V] [TRT] Tactic: 512 time 0.029152 [03/13/2022-08:31:52] [V] [TRT] Tactic: -32 time 0.043416 [03/13/2022-08:31:52] [V] [TRT] Tactic: -64 time 0.032092 [03/13/2022-08:31:52] [V] [TRT] Tactic: -128 time 0.028848 [03/13/2022-08:31:52] [V] [TRT] Fastest Tactic: 128 Time: 0.025764 [03/13/2022-08:31:52] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_432, Mul_433) (PointWiseV2) [03/13/2022-08:31:52] [V] [TRT] Tactic: 24 time 0.015356 [03/13/2022-08:31:52] [V] [TRT] Tactic: 25 time 0.015292 [03/13/2022-08:31:52] [V] [TRT] Tactic: 26 time 0.015224 [03/13/2022-08:31:52] [V] [TRT] Tactic: 27 time 0.015004 [03/13/2022-08:31:52] [V] [TRT] Tactic: 31 time 0.014948 [03/13/2022-08:31:52] [V] [TRT] Fastest Tactic: 31 Time: 0.014948 [03/13/2022-08:31:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [03/13/2022-08:31:52] [V] [TRT] [03/13/2022-08:31:52] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:31:52] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_432, Mul_433) (PointWise) [03/13/2022-08:31:52] [V] [TRT] Tactic: 128 time 0.026328 [03/13/2022-08:31:52] [V] [TRT] Tactic: 256 time 0.023392 [03/13/2022-08:31:52] [V] [TRT] Tactic: 512 time 0.023276 [03/13/2022-08:31:52] [V] [TRT] Tactic: -32 time 0.035416 [03/13/2022-08:31:52] [V] [TRT] Tactic: -64 time 0.02974 [03/13/2022-08:31:52] [V] [TRT] Tactic: -128 time 0.026964 [03/13/2022-08:31:52] [V] [TRT] Fastest Tactic: 512 Time: 0.023276 [03/13/2022-08:31:52] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_432, Mul_433) (PointWiseV2) [03/13/2022-08:31:52] [V] [TRT] Tactic: 0 time 0.014384 [03/13/2022-08:31:52] [V] [TRT] Tactic: 1 time 0.012072 [03/13/2022-08:31:52] [V] [TRT] Tactic: 2 time 0.011616 [03/13/2022-08:31:52] [V] [TRT] Tactic: 3 time 0.01144 [03/13/2022-08:31:52] [V] [TRT] Tactic: 4 time 0.009892 [03/13/2022-08:31:52] [V] [TRT] Tactic: 5 time 0.009436 [03/13/2022-08:31:52] [V] [TRT] Tactic: 6 time 0.010088 [03/13/2022-08:31:52] [V] [TRT] Tactic: 7 time 0.009584 [03/13/2022-08:31:52] [V] [TRT] Tactic: 8 time 0.009232 [03/13/2022-08:31:52] [V] [TRT] Tactic: 9 time 0.009068 [03/13/2022-08:31:52] [V] [TRT] Tactic: 28 time 0.014328 [03/13/2022-08:31:52] [V] [TRT] Fastest Tactic: 9 Time: 0.009068 [03/13/2022-08:31:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:52] [V] [TRT] [03/13/2022-08:31:52] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:31:52] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_432, Mul_433) (PointWise) [03/13/2022-08:31:52] [V] [TRT] Tactic: 128 time 0.026484 [03/13/2022-08:31:52] [V] [TRT] Tactic: 256 time 0.023504 [03/13/2022-08:31:52] [V] [TRT] Tactic: 512 time 0.022984 [03/13/2022-08:31:52] [V] [TRT] Tactic: -32 time 0.035616 [03/13/2022-08:31:52] [V] [TRT] Tactic: -64 time 0.029532 [03/13/2022-08:31:52] [V] [TRT] Tactic: -128 time 0.026868 [03/13/2022-08:31:52] [V] [TRT] Fastest Tactic: 512 Time: 0.022984 [03/13/2022-08:31:52] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_432, Mul_433) (PointWiseV2) [03/13/2022-08:31:52] [V] [TRT] Tactic: 0 time 0.011964 [03/13/2022-08:31:52] [V] [TRT] Tactic: 1 time 0.010312 [03/13/2022-08:31:52] [V] [TRT] Tactic: 2 time 0.011964 [03/13/2022-08:31:52] [V] [TRT] Tactic: 3 time 0.00968 [03/13/2022-08:31:52] [V] [TRT] Tactic: 4 time 0.01116 [03/13/2022-08:31:52] [V] [TRT] Tactic: 5 time 0.012344 [03/13/2022-08:31:52] [V] [TRT] Tactic: 6 time 0.009652 [03/13/2022-08:31:52] [V] [TRT] Tactic: 7 time 0.010076 [03/13/2022-08:31:52] [V] [TRT] Tactic: 8 time 0.011772 [03/13/2022-08:31:52] [V] [TRT] Tactic: 9 time 0.014636 [03/13/2022-08:31:52] [V] [TRT] Tactic: 10 time 0.01536 [03/13/2022-08:31:52] [V] [TRT] Tactic: 11 time 0.0126 [03/13/2022-08:31:52] [V] [TRT] Tactic: 12 time 0.011876 [03/13/2022-08:31:52] [V] [TRT] Tactic: 13 time 0.011492 [03/13/2022-08:31:52] [V] [TRT] Tactic: 14 time 0.010172 [03/13/2022-08:31:52] [V] [TRT] Tactic: 15 time 0.010268 [03/13/2022-08:31:52] [V] [TRT] Tactic: 16 time 0.010388 [03/13/2022-08:31:52] [V] [TRT] Tactic: 17 time 0.009404 [03/13/2022-08:31:52] [V] [TRT] Tactic: 18 time 0.009508 [03/13/2022-08:31:52] [V] [TRT] Tactic: 19 time 0.009744 [03/13/2022-08:31:52] [V] [TRT] Tactic: 28 time 0.011592 [03/13/2022-08:31:52] [V] [TRT] Tactic: 29 time 0.014776 [03/13/2022-08:31:52] [V] [TRT] Fastest Tactic: 17 Time: 0.009404 [03/13/2022-08:31:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 17 [03/13/2022-08:31:52] [V] [TRT] [03/13/2022-08:31:52] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:31:52] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_432, Mul_433) (PointWise) [03/13/2022-08:31:52] [V] [TRT] Tactic: 128 time 0.026192 [03/13/2022-08:31:52] [V] [TRT] Tactic: 256 time 0.02356 [03/13/2022-08:31:52] [V] [TRT] Tactic: 512 time 0.023044 [03/13/2022-08:31:52] [V] [TRT] Tactic: -32 time 0.035448 [03/13/2022-08:31:52] [V] [TRT] Tactic: -64 time 0.029884 [03/13/2022-08:31:52] [V] [TRT] Tactic: -128 time 0.026804 [03/13/2022-08:31:52] [V] [TRT] Fastest Tactic: 512 Time: 0.023044 [03/13/2022-08:31:52] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_432, Mul_433) (PointWiseV2) [03/13/2022-08:31:52] [V] [TRT] Tactic: 0 time 0.01034 [03/13/2022-08:31:52] [V] [TRT] Tactic: 1 time 0.009996 [03/13/2022-08:31:52] [V] [TRT] Tactic: 2 time 0.011944 [03/13/2022-08:31:52] [V] [TRT] Tactic: 3 time 0.01028 [03/13/2022-08:31:52] [V] [TRT] Tactic: 4 time 0.01212 [03/13/2022-08:31:52] [V] [TRT] Tactic: 5 time 0.01532 [03/13/2022-08:31:52] [V] [TRT] Tactic: 6 time 0.014008 [03/13/2022-08:31:52] [V] [TRT] Tactic: 7 time 0.01516 [03/13/2022-08:31:52] [V] [TRT] Tactic: 8 time 0.016356 [03/13/2022-08:31:52] [V] [TRT] Tactic: 9 time 0.022648 [03/13/2022-08:31:52] [V] [TRT] Tactic: 10 time 0.010624 [03/13/2022-08:31:52] [V] [TRT] Tactic: 11 time 0.00996 [03/13/2022-08:31:52] [V] [TRT] Tactic: 12 time 0.010668 [03/13/2022-08:31:52] [V] [TRT] Tactic: 13 time 0.008756 [03/13/2022-08:31:52] [V] [TRT] Tactic: 14 time 0.01028 [03/13/2022-08:31:52] [V] [TRT] Tactic: 15 time 0.013504 [03/13/2022-08:31:52] [V] [TRT] Tactic: 16 time 0.010932 [03/13/2022-08:31:52] [V] [TRT] Tactic: 17 time 0.01092 [03/13/2022-08:31:52] [V] [TRT] Tactic: 18 time 0.013168 [03/13/2022-08:31:52] [V] [TRT] Tactic: 19 time 0.01782 [03/13/2022-08:31:52] [V] [TRT] Tactic: 20 time 0.011936 [03/13/2022-08:31:52] [V] [TRT] Tactic: 21 time 0.01046 [03/13/2022-08:31:52] [V] [TRT] Tactic: 22 time 0.009916 [03/13/2022-08:31:52] [V] [TRT] Tactic: 23 time 0.009036 [03/13/2022-08:31:52] [V] [TRT] Tactic: 24 time 0.01508 [03/13/2022-08:31:52] [V] [TRT] Tactic: 25 time 0.012452 [03/13/2022-08:31:52] [V] [TRT] Tactic: 26 time 0.010852 [03/13/2022-08:31:52] [V] [TRT] Tactic: 27 time 0.010488 [03/13/2022-08:31:52] [V] [TRT] Tactic: 28 time 0.010288 [03/13/2022-08:31:52] [V] [TRT] Tactic: 29 time 0.010812 [03/13/2022-08:31:52] [V] [TRT] Tactic: 30 time 0.011824 [03/13/2022-08:31:52] [V] [TRT] Tactic: 31 time 0.015128 [03/13/2022-08:31:52] [V] [TRT] Fastest Tactic: 13 Time: 0.008756 [03/13/2022-08:31:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 13 [03/13/2022-08:31:52] [V] [TRT] [03/13/2022-08:31:53] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:53] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:31:53] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:31:53] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:53] [V] [TRT] --------------- Timing Runner: Conv_434 (FusedConvActConvolution) [03/13/2022-08:31:53] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:53] [V] [TRT] --------------- Timing Runner: Conv_434 (CaskConvolution) [03/13/2022-08:31:53] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:53] [V] [TRT] --------------- Timing Runner: Conv_434 (CudaConvolution) [03/13/2022-08:31:53] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:53] [V] [TRT] --------------- Timing Runner: Conv_434 (CudaDepthwiseConvolution) [03/13/2022-08:31:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:53] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:31:53] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:53] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,192000) *************** [03/13/2022-08:31:53] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,96000) *************** [03/13/2022-08:31:53] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Float(1,40,1200,192000) *************** [03/13/2022-08:31:53] [V] [TRT] --------------- Timing Runner: Conv_275 (FusedConvActConvolution) [03/13/2022-08:31:53] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:53] [V] [TRT] --------------- Timing Runner: Conv_275 (CaskConvolution) [03/13/2022-08:31:53] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:53] [V] [TRT] --------------- Timing Runner: Conv_275 (CudaConvolution) [03/13/2022-08:31:53] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:53] [V] [TRT] --------------- Timing Runner: Conv_275 (CudaDepthwiseConvolution) [03/13/2022-08:31:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:53] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(20,800,1:8,24000) *************** [03/13/2022-08:31:53] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:53] [V] [TRT] Tactic: 1002 time 0.006612 [03/13/2022-08:31:53] [V] [TRT] Tactic: 0 time 0.006904 [03/13/2022-08:31:53] [V] [TRT] Fastest Tactic: 1002 Time: 0.006612 [03/13/2022-08:31:53] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:31:53] [V] [TRT] Tactic: 1002 time 0.006844 [03/13/2022-08:31:53] [V] [TRT] Tactic: 0 time 0.0066 [03/13/2022-08:31:53] [V] [TRT] Fastest Tactic: 0 Time: 0.0066 [03/13/2022-08:31:53] [V] [TRT] *************** Autotuning format combination: Float(1,2), Float(1,2) -> Float(1,2) *************** [03/13/2022-08:31:54] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 238) [Constant] + (Unnamed Layer* 239) [Shuffle], PWN(PWN((Unnamed Layer* 235) [Constant] + (Unnamed Layer* 236) [Shuffle], Mul_246), Pow_247)), Mul_249) (PointWise) [03/13/2022-08:31:54] [V] [TRT] Tactic: 128 time 0.012452 [03/13/2022-08:31:54] [V] [TRT] Tactic: 256 time 0.01034 [03/13/2022-08:31:54] [V] [TRT] Tactic: 512 time 0.010712 [03/13/2022-08:31:54] [V] [TRT] Tactic: -32 time 0.047492 [03/13/2022-08:31:54] [V] [TRT] Tactic: -64 time 0.02746 [03/13/2022-08:31:54] [V] [TRT] Tactic: -128 time 0.017688 [03/13/2022-08:31:54] [V] [TRT] Fastest Tactic: 256 Time: 0.01034 [03/13/2022-08:31:54] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 238) [Constant] + (Unnamed Layer* 239) [Shuffle], PWN(PWN((Unnamed Layer* 235) [Constant] + (Unnamed Layer* 236) [Shuffle], Mul_246), Pow_247)), Mul_249) (PointWiseV2) [03/13/2022-08:31:54] [V] [TRT] Tactic: 0 time 0.006604 [03/13/2022-08:31:54] [V] [TRT] Tactic: 1 time 0.0063 [03/13/2022-08:31:54] [V] [TRT] Tactic: 2 time 0.006528 [03/13/2022-08:31:54] [V] [TRT] Tactic: 3 time 0.006148 [03/13/2022-08:31:54] [V] [TRT] Tactic: 4 time 0.006184 [03/13/2022-08:31:54] [V] [TRT] Tactic: 5 time 0.00636 [03/13/2022-08:31:54] [V] [TRT] Tactic: 6 time 0.006648 [03/13/2022-08:31:54] [V] [TRT] Tactic: 7 time 0.006948 [03/13/2022-08:31:54] [V] [TRT] Tactic: 8 time 0.006504 [03/13/2022-08:31:54] [V] [TRT] Tactic: 9 time 0.006608 [03/13/2022-08:31:54] [V] [TRT] Tactic: 28 time 0.006632 [03/13/2022-08:31:54] [V] [TRT] Fastest Tactic: 3 Time: 0.006148 [03/13/2022-08:31:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [03/13/2022-08:31:54] [V] [TRT] [03/13/2022-08:31:54] [V] [TRT] *************** Autotuning format combination: Half(1,2), Half(1,2) -> Half(1,2) *************** [03/13/2022-08:31:56] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 238) [Constant] + (Unnamed Layer* 239) [Shuffle], PWN(PWN((Unnamed Layer* 235) [Constant] + (Unnamed Layer* 236) [Shuffle], Mul_246), Pow_247)), Mul_249) (PointWise) [03/13/2022-08:31:56] [V] [TRT] Tactic: 128 time 0.012248 [03/13/2022-08:31:56] [V] [TRT] Tactic: 256 time 0.012296 [03/13/2022-08:31:56] [V] [TRT] Tactic: 512 time 0.012388 [03/13/2022-08:31:56] [V] [TRT] Tactic: -32 time 0.050844 [03/13/2022-08:31:56] [V] [TRT] Tactic: -64 time 0.031216 [03/13/2022-08:31:56] [V] [TRT] Tactic: -128 time 0.018732 [03/13/2022-08:31:56] [V] [TRT] Fastest Tactic: 128 Time: 0.012248 [03/13/2022-08:31:56] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 238) [Constant] + (Unnamed Layer* 239) [Shuffle], PWN(PWN((Unnamed Layer* 235) [Constant] + (Unnamed Layer* 236) [Shuffle], Mul_246), Pow_247)), Mul_249) (PointWiseV2) [03/13/2022-08:31:56] [V] [TRT] Tactic: 0 time 0.006424 [03/13/2022-08:31:56] [V] [TRT] Tactic: 1 time 0.006348 [03/13/2022-08:31:56] [V] [TRT] Tactic: 2 time 0.006252 [03/13/2022-08:31:56] [V] [TRT] Tactic: 3 time 0.006224 [03/13/2022-08:31:56] [V] [TRT] Tactic: 4 time 0.005828 [03/13/2022-08:31:56] [V] [TRT] Tactic: 5 time 0.005816 [03/13/2022-08:31:56] [V] [TRT] Tactic: 6 time 0.006812 [03/13/2022-08:31:56] [V] [TRT] Tactic: 7 time 0.006364 [03/13/2022-08:31:56] [V] [TRT] Tactic: 8 time 0.006132 [03/13/2022-08:31:56] [V] [TRT] Tactic: 9 time 0.006316 [03/13/2022-08:31:56] [V] [TRT] Tactic: 28 time 0.006328 [03/13/2022-08:31:56] [V] [TRT] Fastest Tactic: 5 Time: 0.005816 [03/13/2022-08:31:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [03/13/2022-08:31:56] [V] [TRT] [03/13/2022-08:31:56] [V] [TRT] *************** Autotuning format combination: -> Float(1,2) *************** [03/13/2022-08:31:56] [V] [TRT] *************** Autotuning format combination: -> Half(1,2) *************** [03/13/2022-08:31:56] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:31:56] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_436, Mul_437) (PointWise) [03/13/2022-08:31:56] [V] [TRT] Tactic: 128 time 0.029508 [03/13/2022-08:31:56] [V] [TRT] Tactic: 256 time 0.030252 [03/13/2022-08:31:56] [V] [TRT] Tactic: 512 time 0.03274 [03/13/2022-08:31:56] [V] [TRT] Tactic: -32 time 0.043184 [03/13/2022-08:31:56] [V] [TRT] Tactic: -64 time 0.031912 [03/13/2022-08:31:56] [V] [TRT] Tactic: -128 time 0.029176 [03/13/2022-08:31:56] [V] [TRT] Fastest Tactic: -128 Time: 0.029176 [03/13/2022-08:31:56] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_436, Mul_437) (PointWiseV2) [03/13/2022-08:31:56] [V] [TRT] Tactic: 0 time 0.019984 [03/13/2022-08:31:56] [V] [TRT] Tactic: 1 time 0.017024 [03/13/2022-08:31:56] [V] [TRT] Tactic: 2 time 0.014728 [03/13/2022-08:31:56] [V] [TRT] Tactic: 3 time 0.016576 [03/13/2022-08:31:56] [V] [TRT] Tactic: 4 time 0.01424 [03/13/2022-08:31:56] [V] [TRT] Tactic: 5 time 0.013892 [03/13/2022-08:31:56] [V] [TRT] Tactic: 6 time 0.016688 [03/13/2022-08:31:56] [V] [TRT] Tactic: 7 time 0.01432 [03/13/2022-08:31:56] [V] [TRT] Tactic: 8 time 0.014228 [03/13/2022-08:31:56] [V] [TRT] Tactic: 9 time 0.013188 [03/13/2022-08:31:56] [V] [TRT] Tactic: 28 time 0.020188 [03/13/2022-08:31:56] [V] [TRT] Fastest Tactic: 9 Time: 0.013188 [03/13/2022-08:31:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:56] [V] [TRT] [03/13/2022-08:31:56] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,6000) -> Float(1,40,1200:32,12000) *************** [03/13/2022-08:31:56] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_436, Mul_437) (PointWise) [03/13/2022-08:31:56] [V] [TRT] Tactic: 128 time 0.029712 [03/13/2022-08:31:56] [V] [TRT] Tactic: 256 time 0.030508 [03/13/2022-08:31:56] [V] [TRT] Tactic: 512 time 0.033128 [03/13/2022-08:31:56] [V] [TRT] Tactic: -32 time 0.043524 [03/13/2022-08:31:56] [V] [TRT] Tactic: -64 time 0.03204 [03/13/2022-08:31:56] [V] [TRT] Tactic: -128 time 0.029496 [03/13/2022-08:31:56] [V] [TRT] Fastest Tactic: -128 Time: 0.029496 [03/13/2022-08:31:56] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_436, Mul_437) (PointWiseV2) [03/13/2022-08:31:56] [V] [TRT] Tactic: 24 time 0.015156 [03/13/2022-08:31:56] [V] [TRT] Tactic: 25 time 0.015524 [03/13/2022-08:31:56] [V] [TRT] Tactic: 26 time 0.015724 [03/13/2022-08:31:56] [V] [TRT] Tactic: 27 time 0.014768 [03/13/2022-08:31:56] [V] [TRT] Tactic: 31 time 0.015236 [03/13/2022-08:31:56] [V] [TRT] Fastest Tactic: 27 Time: 0.014768 [03/13/2022-08:31:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [03/13/2022-08:31:56] [V] [TRT] [03/13/2022-08:31:56] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:31:56] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_436, Mul_437) (PointWise) [03/13/2022-08:31:56] [V] [TRT] Tactic: 128 time 0.028136 [03/13/2022-08:31:56] [V] [TRT] Tactic: 256 time 0.024428 [03/13/2022-08:31:56] [V] [TRT] Tactic: 512 time 0.02446 [03/13/2022-08:31:56] [V] [TRT] Tactic: -32 time 0.035808 [03/13/2022-08:31:56] [V] [TRT] Tactic: -64 time 0.030524 [03/13/2022-08:31:56] [V] [TRT] Tactic: -128 time 0.027396 [03/13/2022-08:31:56] [V] [TRT] Fastest Tactic: 256 Time: 0.024428 [03/13/2022-08:31:56] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_436, Mul_437) (PointWiseV2) [03/13/2022-08:31:56] [V] [TRT] Tactic: 0 time 0.016328 [03/13/2022-08:31:56] [V] [TRT] Tactic: 1 time 0.013336 [03/13/2022-08:31:56] [V] [TRT] Tactic: 2 time 0.01222 [03/13/2022-08:31:56] [V] [TRT] Tactic: 3 time 0.011044 [03/13/2022-08:31:56] [V] [TRT] Tactic: 4 time 0.010428 [03/13/2022-08:31:56] [V] [TRT] Tactic: 5 time 0.010172 [03/13/2022-08:31:56] [V] [TRT] Tactic: 6 time 0.010644 [03/13/2022-08:31:56] [V] [TRT] Tactic: 7 time 0.010128 [03/13/2022-08:31:56] [V] [TRT] Tactic: 8 time 0.009104 [03/13/2022-08:31:56] [V] [TRT] Tactic: 9 time 0.009632 [03/13/2022-08:31:56] [V] [TRT] Tactic: 28 time 0.016204 [03/13/2022-08:31:56] [V] [TRT] Fastest Tactic: 8 Time: 0.009104 [03/13/2022-08:31:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:31:56] [V] [TRT] [03/13/2022-08:31:56] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:31:56] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_436, Mul_437) (PointWise) [03/13/2022-08:31:56] [V] [TRT] Tactic: 128 time 0.028032 [03/13/2022-08:31:56] [V] [TRT] Tactic: 256 time 0.024576 [03/13/2022-08:31:56] [V] [TRT] Tactic: 512 time 0.024388 [03/13/2022-08:31:56] [V] [TRT] Tactic: -32 time 0.035772 [03/13/2022-08:31:56] [V] [TRT] Tactic: -64 time 0.030444 [03/13/2022-08:31:56] [V] [TRT] Tactic: -128 time 0.027704 [03/13/2022-08:31:56] [V] [TRT] Fastest Tactic: 512 Time: 0.024388 [03/13/2022-08:31:56] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_436, Mul_437) (PointWiseV2) [03/13/2022-08:31:56] [V] [TRT] Tactic: 0 time 0.012704 [03/13/2022-08:31:56] [V] [TRT] Tactic: 1 time 0.011044 [03/13/2022-08:31:56] [V] [TRT] Tactic: 2 time 0.011808 [03/13/2022-08:31:56] [V] [TRT] Tactic: 3 time 0.010316 [03/13/2022-08:31:56] [V] [TRT] Tactic: 4 time 0.010632 [03/13/2022-08:31:56] [V] [TRT] Tactic: 5 time 0.012584 [03/13/2022-08:31:56] [V] [TRT] Tactic: 6 time 0.010064 [03/13/2022-08:31:56] [V] [TRT] Tactic: 7 time 0.010188 [03/13/2022-08:31:57] [V] [TRT] Tactic: 8 time 0.011748 [03/13/2022-08:31:57] [V] [TRT] Tactic: 9 time 0.014572 [03/13/2022-08:31:57] [V] [TRT] Tactic: 10 time 0.017268 [03/13/2022-08:31:57] [V] [TRT] Tactic: 11 time 0.013724 [03/13/2022-08:31:57] [V] [TRT] Tactic: 12 time 0.013616 [03/13/2022-08:31:57] [V] [TRT] Tactic: 13 time 0.012048 [03/13/2022-08:31:57] [V] [TRT] Tactic: 14 time 0.010804 [03/13/2022-08:31:57] [V] [TRT] Tactic: 15 time 0.010804 [03/13/2022-08:31:57] [V] [TRT] Tactic: 16 time 0.010712 [03/13/2022-08:31:57] [V] [TRT] Tactic: 17 time 0.010168 [03/13/2022-08:31:57] [V] [TRT] Tactic: 18 time 0.00976 [03/13/2022-08:31:57] [V] [TRT] Tactic: 19 time 0.010212 [03/13/2022-08:31:57] [V] [TRT] Tactic: 28 time 0.013116 [03/13/2022-08:31:57] [V] [TRT] Tactic: 29 time 0.01702 [03/13/2022-08:31:57] [V] [TRT] Fastest Tactic: 18 Time: 0.00976 [03/13/2022-08:31:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:31:57] [V] [TRT] [03/13/2022-08:31:57] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:31:57] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_436, Mul_437) (PointWise) [03/13/2022-08:31:57] [V] [TRT] Tactic: 128 time 0.028348 [03/13/2022-08:31:57] [V] [TRT] Tactic: 256 time 0.024684 [03/13/2022-08:31:57] [V] [TRT] Tactic: 512 time 0.024292 [03/13/2022-08:31:57] [V] [TRT] Tactic: -32 time 0.04086 [03/13/2022-08:31:57] [V] [TRT] Tactic: -64 time 0.034664 [03/13/2022-08:31:57] [V] [TRT] Tactic: -128 time 0.034828 [03/13/2022-08:31:57] [V] [TRT] Fastest Tactic: 512 Time: 0.024292 [03/13/2022-08:31:57] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_436, Mul_437) (PointWiseV2) [03/13/2022-08:31:57] [V] [TRT] Tactic: 0 time 0.013432 [03/13/2022-08:31:57] [V] [TRT] Tactic: 1 time 0.014452 [03/13/2022-08:31:57] [V] [TRT] Tactic: 2 time 0.01432 [03/13/2022-08:31:57] [V] [TRT] Tactic: 3 time 0.017456 [03/13/2022-08:31:57] [V] [TRT] Tactic: 4 time 0.016276 [03/13/2022-08:31:57] [V] [TRT] Tactic: 5 time 0.014528 [03/13/2022-08:31:57] [V] [TRT] Tactic: 6 time 0.024016 [03/13/2022-08:31:57] [V] [TRT] Tactic: 7 time 0.019888 [03/13/2022-08:31:57] [V] [TRT] Tactic: 8 time 0.017344 [03/13/2022-08:31:57] [V] [TRT] Tactic: 9 time 0.019144 [03/13/2022-08:31:57] [V] [TRT] Tactic: 10 time 0.015132 [03/13/2022-08:31:57] [V] [TRT] Tactic: 11 time 0.012976 [03/13/2022-08:31:57] [V] [TRT] Tactic: 12 time 0.013952 [03/13/2022-08:31:57] [V] [TRT] Tactic: 13 time 0.014796 [03/13/2022-08:31:57] [V] [TRT] Tactic: 14 time 0.01472 [03/13/2022-08:31:57] [V] [TRT] Tactic: 15 time 0.014456 [03/13/2022-08:31:57] [V] [TRT] Tactic: 16 time 0.017448 [03/13/2022-08:31:57] [V] [TRT] Tactic: 17 time 0.0166 [03/13/2022-08:31:57] [V] [TRT] Tactic: 18 time 0.016044 [03/13/2022-08:31:57] [V] [TRT] Tactic: 19 time 0.015036 [03/13/2022-08:31:57] [V] [TRT] Tactic: 20 time 0.014808 [03/13/2022-08:31:57] [V] [TRT] Tactic: 21 time 0.014852 [03/13/2022-08:31:57] [V] [TRT] Tactic: 22 time 0.01308 [03/13/2022-08:31:57] [V] [TRT] Tactic: 23 time 0.014688 [03/13/2022-08:31:57] [V] [TRT] Tactic: 24 time 0.017136 [03/13/2022-08:31:57] [V] [TRT] Tactic: 25 time 0.015256 [03/13/2022-08:31:57] [V] [TRT] Tactic: 26 time 0.015136 [03/13/2022-08:31:57] [V] [TRT] Tactic: 27 time 0.012848 [03/13/2022-08:31:57] [V] [TRT] Tactic: 28 time 0.010412 [03/13/2022-08:31:57] [V] [TRT] Tactic: 29 time 0.011424 [03/13/2022-08:31:57] [V] [TRT] Tactic: 30 time 0.013656 [03/13/2022-08:31:57] [V] [TRT] Tactic: 31 time 0.016992 [03/13/2022-08:31:57] [V] [TRT] Fastest Tactic: 28 Time: 0.010412 [03/13/2022-08:31:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [03/13/2022-08:31:57] [V] [TRT] [03/13/2022-08:31:57] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:31:57] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_440, Mul_441) (PointWise) [03/13/2022-08:31:57] [V] [TRT] Tactic: 128 time 0.029336 [03/13/2022-08:31:57] [V] [TRT] Tactic: 256 time 0.030208 [03/13/2022-08:31:57] [V] [TRT] Tactic: 512 time 0.032736 [03/13/2022-08:31:57] [V] [TRT] Tactic: -32 time 0.043692 [03/13/2022-08:31:57] [V] [TRT] Tactic: -64 time 0.0325 [03/13/2022-08:31:57] [V] [TRT] Tactic: -128 time 0.029468 [03/13/2022-08:31:57] [V] [TRT] Fastest Tactic: 128 Time: 0.029336 [03/13/2022-08:31:57] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_440, Mul_441) (PointWiseV2) [03/13/2022-08:31:57] [V] [TRT] Tactic: 0 time 0.019648 [03/13/2022-08:31:57] [V] [TRT] Tactic: 1 time 0.017064 [03/13/2022-08:31:57] [V] [TRT] Tactic: 2 time 0.014832 [03/13/2022-08:31:57] [V] [TRT] Tactic: 3 time 0.016476 [03/13/2022-08:31:57] [V] [TRT] Tactic: 4 time 0.014192 [03/13/2022-08:31:57] [V] [TRT] Tactic: 5 time 0.013812 [03/13/2022-08:31:57] [V] [TRT] Tactic: 6 time 0.01654 [03/13/2022-08:31:57] [V] [TRT] Tactic: 7 time 0.014508 [03/13/2022-08:31:57] [V] [TRT] Tactic: 8 time 0.014068 [03/13/2022-08:31:57] [V] [TRT] Tactic: 9 time 0.013532 [03/13/2022-08:31:57] [V] [TRT] Tactic: 28 time 0.01988 [03/13/2022-08:31:57] [V] [TRT] Fastest Tactic: 9 Time: 0.013532 [03/13/2022-08:31:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:57] [V] [TRT] [03/13/2022-08:31:57] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,12000) -> Float(1,40,1200:32,12000) *************** [03/13/2022-08:31:57] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_440, Mul_441) (PointWise) [03/13/2022-08:31:57] [V] [TRT] Tactic: 128 time 0.0295 [03/13/2022-08:31:57] [V] [TRT] Tactic: 256 time 0.030596 [03/13/2022-08:31:57] [V] [TRT] Tactic: 512 time 0.033024 [03/13/2022-08:31:57] [V] [TRT] Tactic: -32 time 0.043264 [03/13/2022-08:31:57] [V] [TRT] Tactic: -64 time 0.032336 [03/13/2022-08:31:57] [V] [TRT] Tactic: -128 time 0.029632 [03/13/2022-08:31:57] [V] [TRT] Fastest Tactic: 128 Time: 0.0295 [03/13/2022-08:31:57] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_440, Mul_441) (PointWiseV2) [03/13/2022-08:31:57] [V] [TRT] Tactic: 24 time 0.015436 [03/13/2022-08:31:57] [V] [TRT] Tactic: 25 time 0.015508 [03/13/2022-08:31:57] [V] [TRT] Tactic: 26 time 0.015568 [03/13/2022-08:31:57] [V] [TRT] Tactic: 27 time 0.015248 [03/13/2022-08:31:57] [V] [TRT] Tactic: 31 time 0.015544 [03/13/2022-08:31:57] [V] [TRT] Fastest Tactic: 27 Time: 0.015248 [03/13/2022-08:31:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [03/13/2022-08:31:57] [V] [TRT] [03/13/2022-08:31:57] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:31:57] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_440, Mul_441) (PointWise) [03/13/2022-08:31:57] [V] [TRT] Tactic: 128 time 0.02794 [03/13/2022-08:31:57] [V] [TRT] Tactic: 256 time 0.024448 [03/13/2022-08:31:57] [V] [TRT] Tactic: 512 time 0.024524 [03/13/2022-08:31:57] [V] [TRT] Tactic: -32 time 0.03572 [03/13/2022-08:31:57] [V] [TRT] Tactic: -64 time 0.03052 [03/13/2022-08:31:57] [V] [TRT] Tactic: -128 time 0.027492 [03/13/2022-08:31:57] [V] [TRT] Fastest Tactic: 256 Time: 0.024448 [03/13/2022-08:31:57] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_440, Mul_441) (PointWiseV2) [03/13/2022-08:31:57] [V] [TRT] Tactic: 0 time 0.016396 [03/13/2022-08:31:57] [V] [TRT] Tactic: 1 time 0.013288 [03/13/2022-08:31:57] [V] [TRT] Tactic: 2 time 0.01222 [03/13/2022-08:31:57] [V] [TRT] Tactic: 3 time 0.010968 [03/13/2022-08:31:57] [V] [TRT] Tactic: 4 time 0.010784 [03/13/2022-08:31:57] [V] [TRT] Tactic: 5 time 0.010096 [03/13/2022-08:31:57] [V] [TRT] Tactic: 6 time 0.010712 [03/13/2022-08:31:57] [V] [TRT] Tactic: 7 time 0.010172 [03/13/2022-08:31:57] [V] [TRT] Tactic: 8 time 0.008896 [03/13/2022-08:31:57] [V] [TRT] Tactic: 9 time 0.009164 [03/13/2022-08:31:57] [V] [TRT] Tactic: 28 time 0.016592 [03/13/2022-08:31:57] [V] [TRT] Fastest Tactic: 8 Time: 0.008896 [03/13/2022-08:31:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:31:57] [V] [TRT] [03/13/2022-08:31:57] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:31:57] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_440, Mul_441) (PointWise) [03/13/2022-08:31:57] [V] [TRT] Tactic: 128 time 0.028072 [03/13/2022-08:31:57] [V] [TRT] Tactic: 256 time 0.024572 [03/13/2022-08:31:57] [V] [TRT] Tactic: 512 time 0.024332 [03/13/2022-08:31:57] [V] [TRT] Tactic: -32 time 0.036 [03/13/2022-08:31:57] [V] [TRT] Tactic: -64 time 0.030476 [03/13/2022-08:31:57] [V] [TRT] Tactic: -128 time 0.027364 [03/13/2022-08:31:57] [V] [TRT] Fastest Tactic: 512 Time: 0.024332 [03/13/2022-08:31:57] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_440, Mul_441) (PointWiseV2) [03/13/2022-08:31:57] [V] [TRT] Tactic: 0 time 0.013068 [03/13/2022-08:31:57] [V] [TRT] Tactic: 1 time 0.010864 [03/13/2022-08:31:57] [V] [TRT] Tactic: 2 time 0.01198 [03/13/2022-08:31:57] [V] [TRT] Tactic: 3 time 0.010428 [03/13/2022-08:31:57] [V] [TRT] Tactic: 4 time 0.01114 [03/13/2022-08:31:57] [V] [TRT] Tactic: 5 time 0.012536 [03/13/2022-08:31:57] [V] [TRT] Tactic: 6 time 0.009828 [03/13/2022-08:31:57] [V] [TRT] Tactic: 7 time 0.0104 [03/13/2022-08:31:57] [V] [TRT] Tactic: 8 time 0.012004 [03/13/2022-08:31:57] [V] [TRT] Tactic: 9 time 0.0147 [03/13/2022-08:31:57] [V] [TRT] Tactic: 10 time 0.016816 [03/13/2022-08:31:57] [V] [TRT] Tactic: 11 time 0.01392 [03/13/2022-08:31:57] [V] [TRT] Tactic: 12 time 0.013052 [03/13/2022-08:31:57] [V] [TRT] Tactic: 13 time 0.01188 [03/13/2022-08:31:57] [V] [TRT] Tactic: 14 time 0.01112 [03/13/2022-08:31:57] [V] [TRT] Tactic: 15 time 0.010704 [03/13/2022-08:31:57] [V] [TRT] Tactic: 16 time 0.010976 [03/13/2022-08:31:57] [V] [TRT] Tactic: 17 time 0.010084 [03/13/2022-08:31:57] [V] [TRT] Tactic: 18 time 0.009744 [03/13/2022-08:31:57] [V] [TRT] Tactic: 19 time 0.010088 [03/13/2022-08:31:57] [V] [TRT] Tactic: 28 time 0.012844 [03/13/2022-08:31:57] [V] [TRT] Tactic: 29 time 0.017112 [03/13/2022-08:31:57] [V] [TRT] Fastest Tactic: 18 Time: 0.009744 [03/13/2022-08:31:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:31:57] [V] [TRT] [03/13/2022-08:31:57] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:31:57] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_440, Mul_441) (PointWise) [03/13/2022-08:31:57] [V] [TRT] Tactic: 128 time 0.028352 [03/13/2022-08:31:57] [V] [TRT] Tactic: 256 time 0.025236 [03/13/2022-08:31:57] [V] [TRT] Tactic: 512 time 0.02486 [03/13/2022-08:31:57] [V] [TRT] Tactic: -32 time 0.041832 [03/13/2022-08:31:57] [V] [TRT] Tactic: -64 time 0.035496 [03/13/2022-08:31:57] [V] [TRT] Tactic: -128 time 0.035036 [03/13/2022-08:31:57] [V] [TRT] Fastest Tactic: 512 Time: 0.02486 [03/13/2022-08:31:57] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_440, Mul_441) (PointWiseV2) [03/13/2022-08:31:57] [V] [TRT] Tactic: 0 time 0.013816 [03/13/2022-08:31:57] [V] [TRT] Tactic: 1 time 0.01454 [03/13/2022-08:31:57] [V] [TRT] Tactic: 2 time 0.014364 [03/13/2022-08:31:57] [V] [TRT] Tactic: 3 time 0.017024 [03/13/2022-08:31:57] [V] [TRT] Tactic: 4 time 0.016344 [03/13/2022-08:31:57] [V] [TRT] Tactic: 5 time 0.014788 [03/13/2022-08:31:57] [V] [TRT] Tactic: 6 time 0.023956 [03/13/2022-08:31:57] [V] [TRT] Tactic: 7 time 0.01934 [03/13/2022-08:31:57] [V] [TRT] Tactic: 8 time 0.017436 [03/13/2022-08:31:57] [V] [TRT] Tactic: 9 time 0.019176 [03/13/2022-08:31:57] [V] [TRT] Tactic: 10 time 0.0154 [03/13/2022-08:31:57] [V] [TRT] Tactic: 11 time 0.013384 [03/13/2022-08:31:58] [V] [TRT] Tactic: 12 time 0.013992 [03/13/2022-08:31:58] [V] [TRT] Tactic: 13 time 0.014884 [03/13/2022-08:31:58] [V] [TRT] Tactic: 14 time 0.014896 [03/13/2022-08:31:58] [V] [TRT] Tactic: 15 time 0.014516 [03/13/2022-08:31:58] [V] [TRT] Tactic: 16 time 0.017992 [03/13/2022-08:31:58] [V] [TRT] Tactic: 17 time 0.016716 [03/13/2022-08:31:58] [V] [TRT] Tactic: 18 time 0.016276 [03/13/2022-08:31:58] [V] [TRT] Tactic: 19 time 0.015484 [03/13/2022-08:31:58] [V] [TRT] Tactic: 20 time 0.01612 [03/13/2022-08:31:58] [V] [TRT] Tactic: 21 time 0.015384 [03/13/2022-08:31:58] [V] [TRT] Tactic: 22 time 0.014108 [03/13/2022-08:31:58] [V] [TRT] Tactic: 23 time 0.015636 [03/13/2022-08:31:58] [V] [TRT] Tactic: 24 time 0.018872 [03/13/2022-08:31:58] [V] [TRT] Tactic: 25 time 0.017164 [03/13/2022-08:31:58] [V] [TRT] Tactic: 26 time 0.01668 [03/13/2022-08:31:58] [V] [TRT] Tactic: 27 time 0.014704 [03/13/2022-08:31:58] [V] [TRT] Tactic: 28 time 0.010624 [03/13/2022-08:31:58] [V] [TRT] Tactic: 29 time 0.01226 [03/13/2022-08:31:58] [V] [TRT] Tactic: 30 time 0.014544 [03/13/2022-08:31:58] [V] [TRT] Tactic: 31 time 0.018776 [03/13/2022-08:31:58] [V] [TRT] Fastest Tactic: 28 Time: 0.010624 [03/13/2022-08:31:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [03/13/2022-08:31:58] [V] [TRT] [03/13/2022-08:31:58] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,192000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:31:58] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_277, Mul_278) (PointWise) [03/13/2022-08:31:58] [V] [TRT] Tactic: 128 time 0.029356 [03/13/2022-08:31:58] [V] [TRT] Tactic: 256 time 0.030328 [03/13/2022-08:31:58] [V] [TRT] Tactic: 512 time 0.032744 [03/13/2022-08:31:58] [V] [TRT] Tactic: -32 time 0.04386 [03/13/2022-08:31:58] [V] [TRT] Tactic: -64 time 0.031828 [03/13/2022-08:31:58] [V] [TRT] Tactic: -128 time 0.029 [03/13/2022-08:31:58] [V] [TRT] Fastest Tactic: -128 Time: 0.029 [03/13/2022-08:31:58] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_277, Mul_278) (PointWiseV2) [03/13/2022-08:31:58] [V] [TRT] Tactic: 0 time 0.019864 [03/13/2022-08:31:58] [V] [TRT] Tactic: 1 time 0.017264 [03/13/2022-08:31:58] [V] [TRT] Tactic: 2 time 0.014736 [03/13/2022-08:31:58] [V] [TRT] Tactic: 3 time 0.016816 [03/13/2022-08:31:58] [V] [TRT] Tactic: 4 time 0.014356 [03/13/2022-08:31:58] [V] [TRT] Tactic: 5 time 0.013656 [03/13/2022-08:31:58] [V] [TRT] Tactic: 6 time 0.0166 [03/13/2022-08:31:58] [V] [TRT] Tactic: 7 time 0.014596 [03/13/2022-08:31:58] [V] [TRT] Tactic: 8 time 0.014196 [03/13/2022-08:31:58] [V] [TRT] Tactic: 9 time 0.013288 [03/13/2022-08:31:58] [V] [TRT] Tactic: 28 time 0.019928 [03/13/2022-08:31:58] [V] [TRT] Fastest Tactic: 9 Time: 0.013288 [03/13/2022-08:31:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:58] [V] [TRT] [03/13/2022-08:31:58] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,6000) -> Float(1,40,1200:32,12000) *************** [03/13/2022-08:31:58] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_277, Mul_278) (PointWise) [03/13/2022-08:31:58] [V] [TRT] Tactic: 128 time 0.030304 [03/13/2022-08:31:58] [V] [TRT] Tactic: 256 time 0.03042 [03/13/2022-08:31:58] [V] [TRT] Tactic: 512 time 0.03328 [03/13/2022-08:31:58] [V] [TRT] Tactic: -32 time 0.043308 [03/13/2022-08:31:58] [V] [TRT] Tactic: -64 time 0.032192 [03/13/2022-08:31:58] [V] [TRT] Tactic: -128 time 0.029624 [03/13/2022-08:31:58] [V] [TRT] Fastest Tactic: -128 Time: 0.029624 [03/13/2022-08:31:58] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_277, Mul_278) (PointWiseV2) [03/13/2022-08:31:58] [V] [TRT] Tactic: 24 time 0.015408 [03/13/2022-08:31:58] [V] [TRT] Tactic: 25 time 0.015536 [03/13/2022-08:31:58] [V] [TRT] Tactic: 26 time 0.015688 [03/13/2022-08:31:58] [V] [TRT] Tactic: 27 time 0.015196 [03/13/2022-08:31:58] [V] [TRT] Tactic: 31 time 0.01548 [03/13/2022-08:31:58] [V] [TRT] Fastest Tactic: 27 Time: 0.015196 [03/13/2022-08:31:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [03/13/2022-08:31:58] [V] [TRT] [03/13/2022-08:31:58] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,192000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:31:58] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_277, Mul_278) (PointWise) [03/13/2022-08:31:58] [V] [TRT] Tactic: 128 time 0.02774 [03/13/2022-08:31:58] [V] [TRT] Tactic: 256 time 0.02454 [03/13/2022-08:31:58] [V] [TRT] Tactic: 512 time 0.024236 [03/13/2022-08:31:58] [V] [TRT] Tactic: -32 time 0.0359 [03/13/2022-08:31:58] [V] [TRT] Tactic: -64 time 0.030452 [03/13/2022-08:31:58] [V] [TRT] Tactic: -128 time 0.027264 [03/13/2022-08:31:58] [V] [TRT] Fastest Tactic: 512 Time: 0.024236 [03/13/2022-08:31:58] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_277, Mul_278) (PointWiseV2) [03/13/2022-08:31:58] [V] [TRT] Tactic: 0 time 0.01638 [03/13/2022-08:31:58] [V] [TRT] Tactic: 1 time 0.013364 [03/13/2022-08:31:58] [V] [TRT] Tactic: 2 time 0.012188 [03/13/2022-08:31:58] [V] [TRT] Tactic: 3 time 0.011324 [03/13/2022-08:31:58] [V] [TRT] Tactic: 4 time 0.0107 [03/13/2022-08:31:58] [V] [TRT] Tactic: 5 time 0.00998 [03/13/2022-08:31:58] [V] [TRT] Tactic: 6 time 0.0107 [03/13/2022-08:31:58] [V] [TRT] Tactic: 7 time 0.010024 [03/13/2022-08:31:58] [V] [TRT] Tactic: 8 time 0.00932 [03/13/2022-08:31:58] [V] [TRT] Tactic: 9 time 0.009152 [03/13/2022-08:31:58] [V] [TRT] Tactic: 28 time 0.016408 [03/13/2022-08:31:58] [V] [TRT] Fastest Tactic: 9 Time: 0.009152 [03/13/2022-08:31:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:58] [V] [TRT] [03/13/2022-08:31:58] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,96000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:31:58] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_277, Mul_278) (PointWise) [03/13/2022-08:31:58] [V] [TRT] Tactic: 128 time 0.02772 [03/13/2022-08:31:58] [V] [TRT] Tactic: 256 time 0.024576 [03/13/2022-08:31:58] [V] [TRT] Tactic: 512 time 0.024672 [03/13/2022-08:31:58] [V] [TRT] Tactic: -32 time 0.036192 [03/13/2022-08:31:58] [V] [TRT] Tactic: -64 time 0.03054 [03/13/2022-08:31:58] [V] [TRT] Tactic: -128 time 0.027464 [03/13/2022-08:31:58] [V] [TRT] Fastest Tactic: 256 Time: 0.024576 [03/13/2022-08:31:58] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_277, Mul_278) (PointWiseV2) [03/13/2022-08:31:58] [V] [TRT] Tactic: 0 time 0.013124 [03/13/2022-08:31:58] [V] [TRT] Tactic: 1 time 0.011008 [03/13/2022-08:31:58] [V] [TRT] Tactic: 2 time 0.011592 [03/13/2022-08:31:58] [V] [TRT] Tactic: 3 time 0.010212 [03/13/2022-08:31:58] [V] [TRT] Tactic: 4 time 0.010768 [03/13/2022-08:31:58] [V] [TRT] Tactic: 5 time 0.012828 [03/13/2022-08:31:58] [V] [TRT] Tactic: 6 time 0.010088 [03/13/2022-08:31:58] [V] [TRT] Tactic: 7 time 0.010312 [03/13/2022-08:31:58] [V] [TRT] Tactic: 8 time 0.011944 [03/13/2022-08:31:58] [V] [TRT] Tactic: 9 time 0.0146 [03/13/2022-08:31:58] [V] [TRT] Tactic: 10 time 0.017008 [03/13/2022-08:31:58] [V] [TRT] Tactic: 11 time 0.013864 [03/13/2022-08:31:58] [V] [TRT] Tactic: 12 time 0.012736 [03/13/2022-08:31:58] [V] [TRT] Tactic: 13 time 0.011848 [03/13/2022-08:31:58] [V] [TRT] Tactic: 14 time 0.011224 [03/13/2022-08:31:58] [V] [TRT] Tactic: 15 time 0.01072 [03/13/2022-08:31:58] [V] [TRT] Tactic: 16 time 0.011348 [03/13/2022-08:31:58] [V] [TRT] Tactic: 17 time 0.010048 [03/13/2022-08:31:58] [V] [TRT] Tactic: 18 time 0.009576 [03/13/2022-08:31:58] [V] [TRT] Tactic: 19 time 0.00996 [03/13/2022-08:31:58] [V] [TRT] Tactic: 28 time 0.012484 [03/13/2022-08:31:58] [V] [TRT] Tactic: 29 time 0.017244 [03/13/2022-08:31:58] [V] [TRT] Fastest Tactic: 18 Time: 0.009576 [03/13/2022-08:31:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:31:58] [V] [TRT] [03/13/2022-08:31:58] [V] [TRT] *************** Autotuning format combination: Half(20,800,1:8,24000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:31:58] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_277, Mul_278) (PointWise) [03/13/2022-08:31:58] [V] [TRT] Tactic: 128 time 0.028272 [03/13/2022-08:31:58] [V] [TRT] Tactic: 256 time 0.024648 [03/13/2022-08:31:58] [V] [TRT] Tactic: 512 time 0.024616 [03/13/2022-08:31:58] [V] [TRT] Tactic: -32 time 0.040716 [03/13/2022-08:31:58] [V] [TRT] Tactic: -64 time 0.034808 [03/13/2022-08:31:58] [V] [TRT] Tactic: -128 time 0.0348 [03/13/2022-08:31:58] [V] [TRT] Fastest Tactic: 512 Time: 0.024616 [03/13/2022-08:31:58] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_277, Mul_278) (PointWiseV2) [03/13/2022-08:31:58] [V] [TRT] Tactic: 0 time 0.0135 [03/13/2022-08:31:58] [V] [TRT] Tactic: 1 time 0.014536 [03/13/2022-08:31:58] [V] [TRT] Tactic: 2 time 0.014376 [03/13/2022-08:31:58] [V] [TRT] Tactic: 3 time 0.017452 [03/13/2022-08:31:58] [V] [TRT] Tactic: 4 time 0.016496 [03/13/2022-08:31:58] [V] [TRT] Tactic: 5 time 0.014548 [03/13/2022-08:31:58] [V] [TRT] Tactic: 6 time 0.024012 [03/13/2022-08:31:58] [V] [TRT] Tactic: 7 time 0.019792 [03/13/2022-08:31:58] [V] [TRT] Tactic: 8 time 0.017092 [03/13/2022-08:31:58] [V] [TRT] Tactic: 9 time 0.018716 [03/13/2022-08:31:58] [V] [TRT] Tactic: 10 time 0.014984 [03/13/2022-08:31:58] [V] [TRT] Tactic: 11 time 0.013268 [03/13/2022-08:31:58] [V] [TRT] Tactic: 12 time 0.014072 [03/13/2022-08:31:58] [V] [TRT] Tactic: 13 time 0.014632 [03/13/2022-08:31:58] [V] [TRT] Tactic: 14 time 0.01462 [03/13/2022-08:31:58] [V] [TRT] Tactic: 15 time 0.014484 [03/13/2022-08:31:58] [V] [TRT] Tactic: 16 time 0.017692 [03/13/2022-08:31:58] [V] [TRT] Tactic: 17 time 0.01646 [03/13/2022-08:31:58] [V] [TRT] Tactic: 18 time 0.016084 [03/13/2022-08:31:58] [V] [TRT] Tactic: 19 time 0.014972 [03/13/2022-08:31:58] [V] [TRT] Tactic: 20 time 0.015192 [03/13/2022-08:31:58] [V] [TRT] Tactic: 21 time 0.014644 [03/13/2022-08:31:58] [V] [TRT] Tactic: 22 time 0.0128 [03/13/2022-08:31:58] [V] [TRT] Tactic: 23 time 0.014628 [03/13/2022-08:31:58] [V] [TRT] Tactic: 24 time 0.016904 [03/13/2022-08:31:58] [V] [TRT] Tactic: 25 time 0.015024 [03/13/2022-08:31:58] [V] [TRT] Tactic: 26 time 0.01496 [03/13/2022-08:31:58] [V] [TRT] Tactic: 27 time 0.012956 [03/13/2022-08:31:58] [V] [TRT] Tactic: 28 time 0.010488 [03/13/2022-08:31:58] [V] [TRT] Tactic: 29 time 0.011732 [03/13/2022-08:31:58] [V] [TRT] Tactic: 30 time 0.0132 [03/13/2022-08:31:58] [V] [TRT] Tactic: 31 time 0.016776 [03/13/2022-08:31:58] [V] [TRT] Fastest Tactic: 28 Time: 0.010488 [03/13/2022-08:31:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [03/13/2022-08:31:58] [V] [TRT] [03/13/2022-08:31:58] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:31:58] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_281, Mul_282) (PointWise) [03/13/2022-08:31:58] [V] [TRT] Tactic: 128 time 0.02906 [03/13/2022-08:31:58] [V] [TRT] Tactic: 256 time 0.030136 [03/13/2022-08:31:58] [V] [TRT] Tactic: 512 time 0.03288 [03/13/2022-08:31:58] [V] [TRT] Tactic: -32 time 0.04308 [03/13/2022-08:31:58] [V] [TRT] Tactic: -64 time 0.031832 [03/13/2022-08:31:58] [V] [TRT] Tactic: -128 time 0.029356 [03/13/2022-08:31:58] [V] [TRT] Fastest Tactic: 128 Time: 0.02906 [03/13/2022-08:31:58] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_281, Mul_282) (PointWiseV2) [03/13/2022-08:31:58] [V] [TRT] Tactic: 0 time 0.019988 [03/13/2022-08:31:58] [V] [TRT] Tactic: 1 time 0.01716 [03/13/2022-08:31:58] [V] [TRT] Tactic: 2 time 0.014568 [03/13/2022-08:31:58] [V] [TRT] Tactic: 3 time 0.016568 [03/13/2022-08:31:58] [V] [TRT] Tactic: 4 time 0.014328 [03/13/2022-08:31:58] [V] [TRT] Tactic: 5 time 0.013512 [03/13/2022-08:31:59] [V] [TRT] Tactic: 6 time 0.01674 [03/13/2022-08:31:59] [V] [TRT] Tactic: 7 time 0.014356 [03/13/2022-08:31:59] [V] [TRT] Tactic: 8 time 0.014072 [03/13/2022-08:31:59] [V] [TRT] Tactic: 9 time 0.013356 [03/13/2022-08:31:59] [V] [TRT] Tactic: 28 time 0.019748 [03/13/2022-08:31:59] [V] [TRT] Fastest Tactic: 9 Time: 0.013356 [03/13/2022-08:31:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:31:59] [V] [TRT] [03/13/2022-08:31:59] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,12000) -> Float(1,40,1200:32,12000) *************** [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_281, Mul_282) (PointWise) [03/13/2022-08:31:59] [V] [TRT] Tactic: 128 time 0.03026 [03/13/2022-08:31:59] [V] [TRT] Tactic: 256 time 0.030524 [03/13/2022-08:31:59] [V] [TRT] Tactic: 512 time 0.03312 [03/13/2022-08:31:59] [V] [TRT] Tactic: -32 time 0.043584 [03/13/2022-08:31:59] [V] [TRT] Tactic: -64 time 0.032364 [03/13/2022-08:31:59] [V] [TRT] Tactic: -128 time 0.029468 [03/13/2022-08:31:59] [V] [TRT] Fastest Tactic: -128 Time: 0.029468 [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_281, Mul_282) (PointWiseV2) [03/13/2022-08:31:59] [V] [TRT] Tactic: 24 time 0.015156 [03/13/2022-08:31:59] [V] [TRT] Tactic: 25 time 0.015404 [03/13/2022-08:31:59] [V] [TRT] Tactic: 26 time 0.015516 [03/13/2022-08:31:59] [V] [TRT] Tactic: 27 time 0.0152 [03/13/2022-08:31:59] [V] [TRT] Tactic: 31 time 0.015004 [03/13/2022-08:31:59] [V] [TRT] Fastest Tactic: 31 Time: 0.015004 [03/13/2022-08:31:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [03/13/2022-08:31:59] [V] [TRT] [03/13/2022-08:31:59] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_281, Mul_282) (PointWise) [03/13/2022-08:31:59] [V] [TRT] Tactic: 128 time 0.028328 [03/13/2022-08:31:59] [V] [TRT] Tactic: 256 time 0.024564 [03/13/2022-08:31:59] [V] [TRT] Tactic: 512 time 0.02452 [03/13/2022-08:31:59] [V] [TRT] Tactic: -32 time 0.035964 [03/13/2022-08:31:59] [V] [TRT] Tactic: -64 time 0.030432 [03/13/2022-08:31:59] [V] [TRT] Tactic: -128 time 0.027696 [03/13/2022-08:31:59] [V] [TRT] Fastest Tactic: 512 Time: 0.02452 [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_281, Mul_282) (PointWiseV2) [03/13/2022-08:31:59] [V] [TRT] Tactic: 0 time 0.016324 [03/13/2022-08:31:59] [V] [TRT] Tactic: 1 time 0.01318 [03/13/2022-08:31:59] [V] [TRT] Tactic: 2 time 0.012172 [03/13/2022-08:31:59] [V] [TRT] Tactic: 3 time 0.01126 [03/13/2022-08:31:59] [V] [TRT] Tactic: 4 time 0.010688 [03/13/2022-08:31:59] [V] [TRT] Tactic: 5 time 0.010056 [03/13/2022-08:31:59] [V] [TRT] Tactic: 6 time 0.010984 [03/13/2022-08:31:59] [V] [TRT] Tactic: 7 time 0.010016 [03/13/2022-08:31:59] [V] [TRT] Tactic: 8 time 0.008788 [03/13/2022-08:31:59] [V] [TRT] Tactic: 9 time 0.009064 [03/13/2022-08:31:59] [V] [TRT] Tactic: 28 time 0.016392 [03/13/2022-08:31:59] [V] [TRT] Fastest Tactic: 8 Time: 0.008788 [03/13/2022-08:31:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:31:59] [V] [TRT] [03/13/2022-08:31:59] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_281, Mul_282) (PointWise) [03/13/2022-08:31:59] [V] [TRT] Tactic: 128 time 0.028164 [03/13/2022-08:31:59] [V] [TRT] Tactic: 256 time 0.024572 [03/13/2022-08:31:59] [V] [TRT] Tactic: 512 time 0.024348 [03/13/2022-08:31:59] [V] [TRT] Tactic: -32 time 0.03604 [03/13/2022-08:31:59] [V] [TRT] Tactic: -64 time 0.030372 [03/13/2022-08:31:59] [V] [TRT] Tactic: -128 time 0.02762 [03/13/2022-08:31:59] [V] [TRT] Fastest Tactic: 512 Time: 0.024348 [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_281, Mul_282) (PointWiseV2) [03/13/2022-08:31:59] [V] [TRT] Tactic: 0 time 0.012844 [03/13/2022-08:31:59] [V] [TRT] Tactic: 1 time 0.010828 [03/13/2022-08:31:59] [V] [TRT] Tactic: 2 time 0.011712 [03/13/2022-08:31:59] [V] [TRT] Tactic: 3 time 0.010392 [03/13/2022-08:31:59] [V] [TRT] Tactic: 4 time 0.01064 [03/13/2022-08:31:59] [V] [TRT] Tactic: 5 time 0.012468 [03/13/2022-08:31:59] [V] [TRT] Tactic: 6 time 0.009984 [03/13/2022-08:31:59] [V] [TRT] Tactic: 7 time 0.010384 [03/13/2022-08:31:59] [V] [TRT] Tactic: 8 time 0.012072 [03/13/2022-08:31:59] [V] [TRT] Tactic: 9 time 0.014556 [03/13/2022-08:31:59] [V] [TRT] Tactic: 10 time 0.016812 [03/13/2022-08:31:59] [V] [TRT] Tactic: 11 time 0.013896 [03/13/2022-08:31:59] [V] [TRT] Tactic: 12 time 0.013256 [03/13/2022-08:31:59] [V] [TRT] Tactic: 13 time 0.011968 [03/13/2022-08:31:59] [V] [TRT] Tactic: 14 time 0.010832 [03/13/2022-08:31:59] [V] [TRT] Tactic: 15 time 0.010684 [03/13/2022-08:31:59] [V] [TRT] Tactic: 16 time 0.011128 [03/13/2022-08:31:59] [V] [TRT] Tactic: 17 time 0.010104 [03/13/2022-08:31:59] [V] [TRT] Tactic: 18 time 0.009684 [03/13/2022-08:31:59] [V] [TRT] Tactic: 19 time 0.010004 [03/13/2022-08:31:59] [V] [TRT] Tactic: 28 time 0.012716 [03/13/2022-08:31:59] [V] [TRT] Tactic: 29 time 0.016952 [03/13/2022-08:31:59] [V] [TRT] Fastest Tactic: 18 Time: 0.009684 [03/13/2022-08:31:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:31:59] [V] [TRT] [03/13/2022-08:31:59] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_281, Mul_282) (PointWise) [03/13/2022-08:31:59] [V] [TRT] Tactic: 128 time 0.028072 [03/13/2022-08:31:59] [V] [TRT] Tactic: 256 time 0.025384 [03/13/2022-08:31:59] [V] [TRT] Tactic: 512 time 0.024976 [03/13/2022-08:31:59] [V] [TRT] Tactic: -32 time 0.041812 [03/13/2022-08:31:59] [V] [TRT] Tactic: -64 time 0.035548 [03/13/2022-08:31:59] [V] [TRT] Tactic: -128 time 0.034916 [03/13/2022-08:31:59] [V] [TRT] Fastest Tactic: 512 Time: 0.024976 [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_281, Mul_282) (PointWiseV2) [03/13/2022-08:31:59] [V] [TRT] Tactic: 0 time 0.0137 [03/13/2022-08:31:59] [V] [TRT] Tactic: 1 time 0.01464 [03/13/2022-08:31:59] [V] [TRT] Tactic: 2 time 0.014508 [03/13/2022-08:31:59] [V] [TRT] Tactic: 3 time 0.01724 [03/13/2022-08:31:59] [V] [TRT] Tactic: 4 time 0.016488 [03/13/2022-08:31:59] [V] [TRT] Tactic: 5 time 0.01448 [03/13/2022-08:31:59] [V] [TRT] Tactic: 6 time 0.02432 [03/13/2022-08:31:59] [V] [TRT] Tactic: 7 time 0.019632 [03/13/2022-08:31:59] [V] [TRT] Tactic: 8 time 0.01742 [03/13/2022-08:31:59] [V] [TRT] Tactic: 9 time 0.01944 [03/13/2022-08:31:59] [V] [TRT] Tactic: 10 time 0.015568 [03/13/2022-08:31:59] [V] [TRT] Tactic: 11 time 0.013552 [03/13/2022-08:31:59] [V] [TRT] Tactic: 12 time 0.014288 [03/13/2022-08:31:59] [V] [TRT] Tactic: 13 time 0.0149 [03/13/2022-08:31:59] [V] [TRT] Tactic: 14 time 0.014952 [03/13/2022-08:31:59] [V] [TRT] Tactic: 15 time 0.014436 [03/13/2022-08:31:59] [V] [TRT] Tactic: 16 time 0.01798 [03/13/2022-08:31:59] [V] [TRT] Tactic: 17 time 0.016648 [03/13/2022-08:31:59] [V] [TRT] Tactic: 18 time 0.016196 [03/13/2022-08:31:59] [V] [TRT] Tactic: 19 time 0.015524 [03/13/2022-08:31:59] [V] [TRT] Tactic: 20 time 0.016144 [03/13/2022-08:31:59] [V] [TRT] Tactic: 21 time 0.0151 [03/13/2022-08:31:59] [V] [TRT] Tactic: 22 time 0.013684 [03/13/2022-08:31:59] [V] [TRT] Tactic: 23 time 0.015548 [03/13/2022-08:31:59] [V] [TRT] Tactic: 24 time 0.01876 [03/13/2022-08:31:59] [V] [TRT] Tactic: 25 time 0.016912 [03/13/2022-08:31:59] [V] [TRT] Tactic: 26 time 0.016468 [03/13/2022-08:31:59] [V] [TRT] Tactic: 27 time 0.01504 [03/13/2022-08:31:59] [V] [TRT] Tactic: 28 time 0.010712 [03/13/2022-08:31:59] [V] [TRT] Tactic: 29 time 0.012216 [03/13/2022-08:31:59] [V] [TRT] Tactic: 30 time 0.01494 [03/13/2022-08:31:59] [V] [TRT] Tactic: 31 time 0.018544 [03/13/2022-08:31:59] [V] [TRT] Fastest Tactic: 28 Time: 0.010712 [03/13/2022-08:31:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [03/13/2022-08:31:59] [V] [TRT] [03/13/2022-08:31:59] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:31:59] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:31:59] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: Conv_284 (FusedConvActConvolution) [03/13/2022-08:31:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: Conv_284 (CaskConvolution) [03/13/2022-08:31:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: Conv_284 (CudaConvolution) [03/13/2022-08:31:59] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: Conv_284 (CudaDepthwiseConvolution) [03/13/2022-08:31:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:59] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:31:59] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: Conv_284 (FusedConvActConvolution) [03/13/2022-08:31:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: Conv_284 (CaskConvolution) [03/13/2022-08:31:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: Conv_284 (CudaConvolution) [03/13/2022-08:31:59] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: Conv_284 (CudaDepthwiseConvolution) [03/13/2022-08:31:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:59] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:31:59] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:31:59] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:31:59] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: Conv_443 (FusedConvActConvolution) [03/13/2022-08:31:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: Conv_443 (CaskConvolution) [03/13/2022-08:31:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: Conv_443 (CudaConvolution) [03/13/2022-08:31:59] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: Conv_443 (CudaDepthwiseConvolution) [03/13/2022-08:31:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:59] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:31:59] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: Conv_443 (FusedConvActConvolution) [03/13/2022-08:31:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: Conv_443 (CaskConvolution) [03/13/2022-08:31:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: Conv_443 (CudaConvolution) [03/13/2022-08:31:59] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:59] [V] [TRT] --------------- Timing Runner: Conv_443 (CudaDepthwiseConvolution) [03/13/2022-08:31:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:31:59] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:31:59] [V] [TRT] *************** Autotuning format combination: Float(1,2), Float(1,2), Float(1,2) -> Float(1,2) *************** [03/13/2022-08:32:01] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN((Unnamed Layer* 229) [Constant] + (Unnamed Layer* 230) [Shuffle], PWN(PWN((Unnamed Layer* 226) [Constant] + (Unnamed Layer* 227) [Shuffle], Mul_235), Sub_237)), Add_239), Mul_262) (PointWise) [03/13/2022-08:32:01] [V] [TRT] Tactic: 128 time 0.010864 [03/13/2022-08:32:01] [V] [TRT] Tactic: 256 time 0.010852 [03/13/2022-08:32:01] [V] [TRT] Tactic: 512 time 0.010792 [03/13/2022-08:32:01] [V] [TRT] Tactic: -32 time 0.050912 [03/13/2022-08:32:01] [V] [TRT] Tactic: -64 time 0.0293 [03/13/2022-08:32:01] [V] [TRT] Tactic: -128 time 0.018856 [03/13/2022-08:32:01] [V] [TRT] Fastest Tactic: 512 Time: 0.010792 [03/13/2022-08:32:01] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN((Unnamed Layer* 229) [Constant] + (Unnamed Layer* 230) [Shuffle], PWN(PWN((Unnamed Layer* 226) [Constant] + (Unnamed Layer* 227) [Shuffle], Mul_235), Sub_237)), Add_239), Mul_262) (PointWiseV2) [03/13/2022-08:32:01] [V] [TRT] Tactic: 0 time 0.006884 [03/13/2022-08:32:01] [V] [TRT] Tactic: 1 time 0.00648 [03/13/2022-08:32:01] [V] [TRT] Tactic: 2 time 0.006468 [03/13/2022-08:32:01] [V] [TRT] Tactic: 3 time 0.006412 [03/13/2022-08:32:01] [V] [TRT] Tactic: 4 time 0.00662 [03/13/2022-08:32:01] [V] [TRT] Tactic: 5 time 0.00634 [03/13/2022-08:32:01] [V] [TRT] Tactic: 6 time 0.006632 [03/13/2022-08:32:01] [V] [TRT] Tactic: 7 time 0.00652 [03/13/2022-08:32:01] [V] [TRT] Tactic: 8 time 0.00674 [03/13/2022-08:32:01] [V] [TRT] Tactic: 9 time 0.006684 [03/13/2022-08:32:01] [V] [TRT] Tactic: 28 time 0.00688 [03/13/2022-08:32:01] [V] [TRT] Fastest Tactic: 5 Time: 0.00634 [03/13/2022-08:32:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [03/13/2022-08:32:01] [V] [TRT] [03/13/2022-08:32:01] [V] [TRT] *************** Autotuning format combination: Half(1,2), Half(1,2), Half(1,2) -> Half(1,2) *************** [03/13/2022-08:32:02] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN((Unnamed Layer* 229) [Constant] + (Unnamed Layer* 230) [Shuffle], PWN(PWN((Unnamed Layer* 226) [Constant] + (Unnamed Layer* 227) [Shuffle], Mul_235), Sub_237)), Add_239), Mul_262) (PointWise) [03/13/2022-08:32:02] [V] [TRT] Tactic: 128 time 0.013136 [03/13/2022-08:32:02] [V] [TRT] Tactic: 256 time 0.013104 [03/13/2022-08:32:02] [V] [TRT] Tactic: 512 time 0.013168 [03/13/2022-08:32:03] [V] [TRT] Tactic: -32 time 0.057368 [03/13/2022-08:32:03] [V] [TRT] Tactic: -64 time 0.034864 [03/13/2022-08:32:03] [V] [TRT] Tactic: -128 time 0.020512 [03/13/2022-08:32:03] [V] [TRT] Fastest Tactic: 256 Time: 0.013104 [03/13/2022-08:32:03] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN((Unnamed Layer* 229) [Constant] + (Unnamed Layer* 230) [Shuffle], PWN(PWN((Unnamed Layer* 226) [Constant] + (Unnamed Layer* 227) [Shuffle], Mul_235), Sub_237)), Add_239), Mul_262) (PointWiseV2) [03/13/2022-08:32:03] [V] [TRT] Tactic: 0 time 0.006484 [03/13/2022-08:32:03] [V] [TRT] Tactic: 1 time 0.006476 [03/13/2022-08:32:03] [V] [TRT] Tactic: 2 time 0.006492 [03/13/2022-08:32:03] [V] [TRT] Tactic: 3 time 0.006284 [03/13/2022-08:32:03] [V] [TRT] Tactic: 4 time 0.006176 [03/13/2022-08:32:03] [V] [TRT] Tactic: 5 time 0.005936 [03/13/2022-08:32:03] [V] [TRT] Tactic: 6 time 0.00682 [03/13/2022-08:32:03] [V] [TRT] Tactic: 7 time 0.006832 [03/13/2022-08:32:03] [V] [TRT] Tactic: 8 time 0.006156 [03/13/2022-08:32:03] [V] [TRT] Tactic: 9 time 0.0062 [03/13/2022-08:32:03] [V] [TRT] Tactic: 28 time 0.006716 [03/13/2022-08:32:03] [V] [TRT] Fastest Tactic: 5 Time: 0.005936 [03/13/2022-08:32:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [03/13/2022-08:32:03] [V] [TRT] [03/13/2022-08:32:03] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:32:03] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_286, Mul_287) (PointWise) [03/13/2022-08:32:03] [V] [TRT] Tactic: 128 time 0.045644 [03/13/2022-08:32:03] [V] [TRT] Tactic: 256 time 0.046656 [03/13/2022-08:32:03] [V] [TRT] Tactic: 512 time 0.051752 [03/13/2022-08:32:03] [V] [TRT] Tactic: -32 time 0.077564 [03/13/2022-08:32:03] [V] [TRT] Tactic: -64 time 0.051428 [03/13/2022-08:32:03] [V] [TRT] Tactic: -128 time 0.048448 [03/13/2022-08:32:03] [V] [TRT] Fastest Tactic: 128 Time: 0.045644 [03/13/2022-08:32:03] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_286, Mul_287) (PointWiseV2) [03/13/2022-08:32:03] [V] [TRT] Tactic: 0 time 0.032588 [03/13/2022-08:32:03] [V] [TRT] Tactic: 1 time 0.027152 [03/13/2022-08:32:03] [V] [TRT] Tactic: 2 time 0.023104 [03/13/2022-08:32:03] [V] [TRT] Tactic: 3 time 0.025944 [03/13/2022-08:32:03] [V] [TRT] Tactic: 4 time 0.022744 [03/13/2022-08:32:03] [V] [TRT] Tactic: 5 time 0.022772 [03/13/2022-08:32:03] [V] [TRT] Tactic: 6 time 0.027 [03/13/2022-08:32:03] [V] [TRT] Tactic: 7 time 0.023416 [03/13/2022-08:32:03] [V] [TRT] Tactic: 8 time 0.023216 [03/13/2022-08:32:03] [V] [TRT] Tactic: 9 time 0.022936 [03/13/2022-08:32:03] [V] [TRT] Tactic: 28 time 0.032188 [03/13/2022-08:32:03] [V] [TRT] Fastest Tactic: 4 Time: 0.022744 [03/13/2022-08:32:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [03/13/2022-08:32:03] [V] [TRT] [03/13/2022-08:32:03] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,12000) -> Float(1,40,1200:32,12000) *************** [03/13/2022-08:32:03] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_286, Mul_287) (PointWise) [03/13/2022-08:32:03] [V] [TRT] Tactic: 128 time 0.045968 [03/13/2022-08:32:03] [V] [TRT] Tactic: 256 time 0.046828 [03/13/2022-08:32:03] [V] [TRT] Tactic: 512 time 0.052404 [03/13/2022-08:32:03] [V] [TRT] Tactic: -32 time 0.077924 [03/13/2022-08:32:03] [V] [TRT] Tactic: -64 time 0.05116 [03/13/2022-08:32:03] [V] [TRT] Tactic: -128 time 0.049172 [03/13/2022-08:32:03] [V] [TRT] Fastest Tactic: 128 Time: 0.045968 [03/13/2022-08:32:03] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_286, Mul_287) (PointWiseV2) [03/13/2022-08:32:03] [V] [TRT] Tactic: 24 time 0.026024 [03/13/2022-08:32:03] [V] [TRT] Tactic: 25 time 0.026684 [03/13/2022-08:32:03] [V] [TRT] Tactic: 26 time 0.02644 [03/13/2022-08:32:03] [V] [TRT] Tactic: 27 time 0.026044 [03/13/2022-08:32:03] [V] [TRT] Tactic: 31 time 0.025796 [03/13/2022-08:32:03] [V] [TRT] Fastest Tactic: 31 Time: 0.025796 [03/13/2022-08:32:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [03/13/2022-08:32:03] [V] [TRT] [03/13/2022-08:32:03] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:32:03] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_286, Mul_287) (PointWise) [03/13/2022-08:32:03] [V] [TRT] Tactic: 128 time 0.049056 [03/13/2022-08:32:03] [V] [TRT] Tactic: 256 time 0.042412 [03/13/2022-08:32:03] [V] [TRT] Tactic: 512 time 0.042876 [03/13/2022-08:32:03] [V] [TRT] Tactic: -32 time 0.070016 [03/13/2022-08:32:03] [V] [TRT] Tactic: -64 time 0.049048 [03/13/2022-08:32:03] [V] [TRT] Tactic: -128 time 0.046836 [03/13/2022-08:32:03] [V] [TRT] Fastest Tactic: 256 Time: 0.042412 [03/13/2022-08:32:03] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_286, Mul_287) (PointWiseV2) [03/13/2022-08:32:03] [V] [TRT] Tactic: 0 time 0.030608 [03/13/2022-08:32:03] [V] [TRT] Tactic: 1 time 0.025296 [03/13/2022-08:32:03] [V] [TRT] Tactic: 2 time 0.021936 [03/13/2022-08:32:03] [V] [TRT] Tactic: 3 time 0.023036 [03/13/2022-08:32:03] [V] [TRT] Tactic: 4 time 0.018392 [03/13/2022-08:32:03] [V] [TRT] Tactic: 5 time 0.016332 [03/13/2022-08:32:03] [V] [TRT] Tactic: 6 time 0.023952 [03/13/2022-08:32:03] [V] [TRT] Tactic: 7 time 0.018072 [03/13/2022-08:32:03] [V] [TRT] Tactic: 8 time 0.015528 [03/13/2022-08:32:03] [V] [TRT] Tactic: 9 time 0.014524 [03/13/2022-08:32:03] [V] [TRT] Tactic: 28 time 0.030396 [03/13/2022-08:32:03] [V] [TRT] Fastest Tactic: 9 Time: 0.014524 [03/13/2022-08:32:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:32:03] [V] [TRT] [03/13/2022-08:32:03] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:32:03] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_286, Mul_287) (PointWise) [03/13/2022-08:32:03] [V] [TRT] Tactic: 128 time 0.048988 [03/13/2022-08:32:03] [V] [TRT] Tactic: 256 time 0.042568 [03/13/2022-08:32:03] [V] [TRT] Tactic: 512 time 0.042508 [03/13/2022-08:32:03] [V] [TRT] Tactic: -32 time 0.069836 [03/13/2022-08:32:03] [V] [TRT] Tactic: -64 time 0.049092 [03/13/2022-08:32:03] [V] [TRT] Tactic: -128 time 0.046948 [03/13/2022-08:32:03] [V] [TRT] Fastest Tactic: 512 Time: 0.042508 [03/13/2022-08:32:03] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_286, Mul_287) (PointWiseV2) [03/13/2022-08:32:03] [V] [TRT] Tactic: 0 time 0.022224 [03/13/2022-08:32:03] [V] [TRT] Tactic: 1 time 0.019276 [03/13/2022-08:32:03] [V] [TRT] Tactic: 2 time 0.01982 [03/13/2022-08:32:03] [V] [TRT] Tactic: 3 time 0.019056 [03/13/2022-08:32:03] [V] [TRT] Tactic: 4 time 0.019376 [03/13/2022-08:32:03] [V] [TRT] Tactic: 5 time 0.020532 [03/13/2022-08:32:03] [V] [TRT] Tactic: 6 time 0.019168 [03/13/2022-08:32:03] [V] [TRT] Tactic: 7 time 0.018936 [03/13/2022-08:32:03] [V] [TRT] Tactic: 8 time 0.020652 [03/13/2022-08:32:03] [V] [TRT] Tactic: 9 time 0.024132 [03/13/2022-08:32:03] [V] [TRT] Tactic: 10 time 0.031472 [03/13/2022-08:32:03] [V] [TRT] Tactic: 11 time 0.026104 [03/13/2022-08:32:03] [V] [TRT] Tactic: 12 time 0.022484 [03/13/2022-08:32:03] [V] [TRT] Tactic: 13 time 0.023448 [03/13/2022-08:32:03] [V] [TRT] Tactic: 14 time 0.018756 [03/13/2022-08:32:03] [V] [TRT] Tactic: 15 time 0.01768 [03/13/2022-08:32:03] [V] [TRT] Tactic: 16 time 0.024388 [03/13/2022-08:32:03] [V] [TRT] Tactic: 17 time 0.018348 [03/13/2022-08:32:03] [V] [TRT] Tactic: 18 time 0.015328 [03/13/2022-08:32:03] [V] [TRT] Tactic: 19 time 0.016216 [03/13/2022-08:32:03] [V] [TRT] Tactic: 28 time 0.022012 [03/13/2022-08:32:03] [V] [TRT] Tactic: 29 time 0.031428 [03/13/2022-08:32:03] [V] [TRT] Fastest Tactic: 18 Time: 0.015328 [03/13/2022-08:32:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:32:03] [V] [TRT] [03/13/2022-08:32:03] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:32:03] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_286, Mul_287) (PointWise) [03/13/2022-08:32:03] [V] [TRT] Tactic: 128 time 0.04858 [03/13/2022-08:32:03] [V] [TRT] Tactic: 256 time 0.042488 [03/13/2022-08:32:03] [V] [TRT] Tactic: 512 time 0.042268 [03/13/2022-08:32:03] [V] [TRT] Tactic: -32 time 0.070496 [03/13/2022-08:32:03] [V] [TRT] Tactic: -64 time 0.049056 [03/13/2022-08:32:03] [V] [TRT] Tactic: -128 time 0.047012 [03/13/2022-08:32:03] [V] [TRT] Fastest Tactic: 512 Time: 0.042268 [03/13/2022-08:32:03] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_286, Mul_287) (PointWiseV2) [03/13/2022-08:32:03] [V] [TRT] Tactic: 0 time 0.015776 [03/13/2022-08:32:03] [V] [TRT] Tactic: 1 time 0.015892 [03/13/2022-08:32:03] [V] [TRT] Tactic: 2 time 0.019448 [03/13/2022-08:32:03] [V] [TRT] Tactic: 3 time 0.016272 [03/13/2022-08:32:03] [V] [TRT] Tactic: 4 time 0.02004 [03/13/2022-08:32:03] [V] [TRT] Tactic: 5 time 0.028136 [03/13/2022-08:32:03] [V] [TRT] Tactic: 6 time 0.018404 [03/13/2022-08:32:03] [V] [TRT] Tactic: 7 time 0.020368 [03/13/2022-08:32:03] [V] [TRT] Tactic: 8 time 0.027876 [03/13/2022-08:32:03] [V] [TRT] Tactic: 9 time 0.036368 [03/13/2022-08:32:03] [V] [TRT] Tactic: 10 time 0.017492 [03/13/2022-08:32:03] [V] [TRT] Tactic: 11 time 0.015852 [03/13/2022-08:32:03] [V] [TRT] Tactic: 12 time 0.017128 [03/13/2022-08:32:03] [V] [TRT] Tactic: 13 time 0.0161 [03/13/2022-08:32:03] [V] [TRT] Tactic: 14 time 0.016964 [03/13/2022-08:32:03] [V] [TRT] Tactic: 15 time 0.020928 [03/13/2022-08:32:03] [V] [TRT] Tactic: 16 time 0.015244 [03/13/2022-08:32:03] [V] [TRT] Tactic: 17 time 0.017516 [03/13/2022-08:32:03] [V] [TRT] Tactic: 18 time 0.022548 [03/13/2022-08:32:03] [V] [TRT] Tactic: 19 time 0.0284 [03/13/2022-08:32:03] [V] [TRT] Tactic: 20 time 0.022548 [03/13/2022-08:32:03] [V] [TRT] Tactic: 21 time 0.0195 [03/13/2022-08:32:03] [V] [TRT] Tactic: 22 time 0.019032 [03/13/2022-08:32:03] [V] [TRT] Tactic: 23 time 0.019196 [03/13/2022-08:32:03] [V] [TRT] Tactic: 24 time 0.03174 [03/13/2022-08:32:03] [V] [TRT] Tactic: 25 time 0.025624 [03/13/2022-08:32:03] [V] [TRT] Tactic: 26 time 0.023616 [03/13/2022-08:32:03] [V] [TRT] Tactic: 27 time 0.024396 [03/13/2022-08:32:03] [V] [TRT] Tactic: 28 time 0.016168 [03/13/2022-08:32:03] [V] [TRT] Tactic: 29 time 0.01722 [03/13/2022-08:32:03] [V] [TRT] Tactic: 30 time 0.022732 [03/13/2022-08:32:03] [V] [TRT] Tactic: 31 time 0.031424 [03/13/2022-08:32:03] [V] [TRT] Fastest Tactic: 16 Time: 0.015244 [03/13/2022-08:32:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 16 [03/13/2022-08:32:03] [V] [TRT] [03/13/2022-08:32:03] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:03] [V] [TRT] Tactic: 1002 time 0.07082 [03/13/2022-08:32:03] [V] [TRT] Tactic: 0 time 0.0567 [03/13/2022-08:32:03] [V] [TRT] Fastest Tactic: 0 Time: 0.0567 [03/13/2022-08:32:03] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:03] [V] [TRT] Tactic: 1002 time 0.070684 [03/13/2022-08:32:03] [V] [TRT] Tactic: 0 time 0.055156 [03/13/2022-08:32:03] [V] [TRT] Fastest Tactic: 0 Time: 0.055156 [03/13/2022-08:32:03] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:03] [V] [TRT] Tactic: 1002 time 0.080564 [03/13/2022-08:32:03] [V] [TRT] Tactic: 0 time 0.05642 [03/13/2022-08:32:03] [V] [TRT] Fastest Tactic: 0 Time: 0.05642 [03/13/2022-08:32:03] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:03] [V] [TRT] Tactic: 1002 time 0.059868 [03/13/2022-08:32:03] [V] [TRT] Tactic: 0 time 0.038 [03/13/2022-08:32:03] [V] [TRT] Fastest Tactic: 0 Time: 0.038 [03/13/2022-08:32:03] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,384000) *************** [03/13/2022-08:32:03] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_445, Mul_446) (PointWise) [03/13/2022-08:32:03] [V] [TRT] Tactic: 128 time 0.04568 [03/13/2022-08:32:03] [V] [TRT] Tactic: 256 time 0.04672 [03/13/2022-08:32:03] [V] [TRT] Tactic: 512 time 0.051692 [03/13/2022-08:32:03] [V] [TRT] Tactic: -32 time 0.07758 [03/13/2022-08:32:03] [V] [TRT] Tactic: -64 time 0.051172 [03/13/2022-08:32:03] [V] [TRT] Tactic: -128 time 0.048624 [03/13/2022-08:32:03] [V] [TRT] Fastest Tactic: 128 Time: 0.04568 [03/13/2022-08:32:03] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_445, Mul_446) (PointWiseV2) [03/13/2022-08:32:03] [V] [TRT] Tactic: 0 time 0.03254 [03/13/2022-08:32:03] [V] [TRT] Tactic: 1 time 0.027076 [03/13/2022-08:32:03] [V] [TRT] Tactic: 2 time 0.0233 [03/13/2022-08:32:03] [V] [TRT] Tactic: 3 time 0.025968 [03/13/2022-08:32:03] [V] [TRT] Tactic: 4 time 0.022996 [03/13/2022-08:32:03] [V] [TRT] Tactic: 5 time 0.022708 [03/13/2022-08:32:03] [V] [TRT] Tactic: 6 time 0.02706 [03/13/2022-08:32:04] [V] [TRT] Tactic: 7 time 0.0235 [03/13/2022-08:32:04] [V] [TRT] Tactic: 8 time 0.023088 [03/13/2022-08:32:04] [V] [TRT] Tactic: 9 time 0.02286 [03/13/2022-08:32:04] [V] [TRT] Tactic: 28 time 0.032452 [03/13/2022-08:32:04] [V] [TRT] Fastest Tactic: 5 Time: 0.022708 [03/13/2022-08:32:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [03/13/2022-08:32:04] [V] [TRT] [03/13/2022-08:32:04] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,12000) -> Float(1,40,1200:32,12000) *************** [03/13/2022-08:32:04] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_445, Mul_446) (PointWise) [03/13/2022-08:32:04] [V] [TRT] Tactic: 128 time 0.045712 [03/13/2022-08:32:04] [V] [TRT] Tactic: 256 time 0.04692 [03/13/2022-08:32:04] [V] [TRT] Tactic: 512 time 0.052152 [03/13/2022-08:32:04] [V] [TRT] Tactic: -32 time 0.077848 [03/13/2022-08:32:04] [V] [TRT] Tactic: -64 time 0.051076 [03/13/2022-08:32:04] [V] [TRT] Tactic: -128 time 0.049032 [03/13/2022-08:32:04] [V] [TRT] Fastest Tactic: 128 Time: 0.045712 [03/13/2022-08:32:04] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_445, Mul_446) (PointWiseV2) [03/13/2022-08:32:04] [V] [TRT] Tactic: 24 time 0.02604 [03/13/2022-08:32:04] [V] [TRT] Tactic: 25 time 0.026652 [03/13/2022-08:32:04] [V] [TRT] Tactic: 26 time 0.02666 [03/13/2022-08:32:04] [V] [TRT] Tactic: 27 time 0.026212 [03/13/2022-08:32:04] [V] [TRT] Tactic: 31 time 0.026012 [03/13/2022-08:32:04] [V] [TRT] Fastest Tactic: 31 Time: 0.026012 [03/13/2022-08:32:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [03/13/2022-08:32:04] [V] [TRT] [03/13/2022-08:32:04] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,384000) *************** [03/13/2022-08:32:04] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_445, Mul_446) (PointWise) [03/13/2022-08:32:04] [V] [TRT] Tactic: 128 time 0.048896 [03/13/2022-08:32:04] [V] [TRT] Tactic: 256 time 0.042504 [03/13/2022-08:32:04] [V] [TRT] Tactic: 512 time 0.042348 [03/13/2022-08:32:04] [V] [TRT] Tactic: -32 time 0.070112 [03/13/2022-08:32:04] [V] [TRT] Tactic: -64 time 0.049132 [03/13/2022-08:32:04] [V] [TRT] Tactic: -128 time 0.046996 [03/13/2022-08:32:04] [V] [TRT] Fastest Tactic: 512 Time: 0.042348 [03/13/2022-08:32:04] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_445, Mul_446) (PointWiseV2) [03/13/2022-08:32:04] [V] [TRT] Tactic: 0 time 0.030588 [03/13/2022-08:32:04] [V] [TRT] Tactic: 1 time 0.025456 [03/13/2022-08:32:04] [V] [TRT] Tactic: 2 time 0.021284 [03/13/2022-08:32:04] [V] [TRT] Tactic: 3 time 0.023192 [03/13/2022-08:32:04] [V] [TRT] Tactic: 4 time 0.01818 [03/13/2022-08:32:04] [V] [TRT] Tactic: 5 time 0.016384 [03/13/2022-08:32:04] [V] [TRT] Tactic: 6 time 0.024232 [03/13/2022-08:32:04] [V] [TRT] Tactic: 7 time 0.017884 [03/13/2022-08:32:04] [V] [TRT] Tactic: 8 time 0.015088 [03/13/2022-08:32:04] [V] [TRT] Tactic: 9 time 0.0149 [03/13/2022-08:32:04] [V] [TRT] Tactic: 28 time 0.030336 [03/13/2022-08:32:04] [V] [TRT] Fastest Tactic: 9 Time: 0.0149 [03/13/2022-08:32:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:32:04] [V] [TRT] [03/13/2022-08:32:04] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,192000) *************** [03/13/2022-08:32:04] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_445, Mul_446) (PointWise) [03/13/2022-08:32:04] [V] [TRT] Tactic: 128 time 0.048984 [03/13/2022-08:32:04] [V] [TRT] Tactic: 256 time 0.042184 [03/13/2022-08:32:04] [V] [TRT] Tactic: 512 time 0.042248 [03/13/2022-08:32:04] [V] [TRT] Tactic: -32 time 0.070216 [03/13/2022-08:32:04] [V] [TRT] Tactic: -64 time 0.049012 [03/13/2022-08:32:04] [V] [TRT] Tactic: -128 time 0.046944 [03/13/2022-08:32:04] [V] [TRT] Fastest Tactic: 256 Time: 0.042184 [03/13/2022-08:32:04] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_445, Mul_446) (PointWiseV2) [03/13/2022-08:32:04] [V] [TRT] Tactic: 0 time 0.022128 [03/13/2022-08:32:04] [V] [TRT] Tactic: 1 time 0.019252 [03/13/2022-08:32:04] [V] [TRT] Tactic: 2 time 0.019548 [03/13/2022-08:32:04] [V] [TRT] Tactic: 3 time 0.019064 [03/13/2022-08:32:04] [V] [TRT] Tactic: 4 time 0.019736 [03/13/2022-08:32:04] [V] [TRT] Tactic: 5 time 0.020056 [03/13/2022-08:32:04] [V] [TRT] Tactic: 6 time 0.018808 [03/13/2022-08:32:04] [V] [TRT] Tactic: 7 time 0.019312 [03/13/2022-08:32:04] [V] [TRT] Tactic: 8 time 0.02058 [03/13/2022-08:32:04] [V] [TRT] Tactic: 9 time 0.023868 [03/13/2022-08:32:04] [V] [TRT] Tactic: 10 time 0.031412 [03/13/2022-08:32:04] [V] [TRT] Tactic: 11 time 0.025388 [03/13/2022-08:32:04] [V] [TRT] Tactic: 12 time 0.022748 [03/13/2022-08:32:04] [V] [TRT] Tactic: 13 time 0.023764 [03/13/2022-08:32:04] [V] [TRT] Tactic: 14 time 0.01874 [03/13/2022-08:32:04] [V] [TRT] Tactic: 15 time 0.017184 [03/13/2022-08:32:04] [V] [TRT] Tactic: 16 time 0.0243 [03/13/2022-08:32:04] [V] [TRT] Tactic: 17 time 0.01846 [03/13/2022-08:32:04] [V] [TRT] Tactic: 18 time 0.015124 [03/13/2022-08:32:04] [V] [TRT] Tactic: 19 time 0.016072 [03/13/2022-08:32:04] [V] [TRT] Tactic: 28 time 0.022256 [03/13/2022-08:32:04] [V] [TRT] Tactic: 29 time 0.031188 [03/13/2022-08:32:04] [V] [TRT] Fastest Tactic: 18 Time: 0.015124 [03/13/2022-08:32:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:32:04] [V] [TRT] [03/13/2022-08:32:04] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(40,1600,1:8,48000) *************** [03/13/2022-08:32:04] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_445, Mul_446) (PointWise) [03/13/2022-08:32:04] [V] [TRT] Tactic: 128 time 0.048756 [03/13/2022-08:32:04] [V] [TRT] Tactic: 256 time 0.042576 [03/13/2022-08:32:04] [V] [TRT] Tactic: 512 time 0.042304 [03/13/2022-08:32:04] [V] [TRT] Tactic: -32 time 0.069932 [03/13/2022-08:32:04] [V] [TRT] Tactic: -64 time 0.0491 [03/13/2022-08:32:04] [V] [TRT] Tactic: -128 time 0.046996 [03/13/2022-08:32:04] [V] [TRT] Fastest Tactic: 512 Time: 0.042304 [03/13/2022-08:32:04] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_445, Mul_446) (PointWiseV2) [03/13/2022-08:32:04] [V] [TRT] Tactic: 0 time 0.015968 [03/13/2022-08:32:04] [V] [TRT] Tactic: 1 time 0.015868 [03/13/2022-08:32:04] [V] [TRT] Tactic: 2 time 0.019228 [03/13/2022-08:32:04] [V] [TRT] Tactic: 3 time 0.016248 [03/13/2022-08:32:04] [V] [TRT] Tactic: 4 time 0.020644 [03/13/2022-08:32:04] [V] [TRT] Tactic: 5 time 0.028068 [03/13/2022-08:32:04] [V] [TRT] Tactic: 6 time 0.018208 [03/13/2022-08:32:04] [V] [TRT] Tactic: 7 time 0.020568 [03/13/2022-08:32:04] [V] [TRT] Tactic: 8 time 0.028568 [03/13/2022-08:32:04] [V] [TRT] Tactic: 9 time 0.037036 [03/13/2022-08:32:04] [V] [TRT] Tactic: 10 time 0.017564 [03/13/2022-08:32:04] [V] [TRT] Tactic: 11 time 0.015848 [03/13/2022-08:32:04] [V] [TRT] Tactic: 12 time 0.017516 [03/13/2022-08:32:04] [V] [TRT] Tactic: 13 time 0.016124 [03/13/2022-08:32:04] [V] [TRT] Tactic: 14 time 0.0165 [03/13/2022-08:32:04] [V] [TRT] Tactic: 15 time 0.020944 [03/13/2022-08:32:04] [V] [TRT] Tactic: 16 time 0.015348 [03/13/2022-08:32:04] [V] [TRT] Tactic: 17 time 0.017164 [03/13/2022-08:32:04] [V] [TRT] Tactic: 18 time 0.02252 [03/13/2022-08:32:04] [V] [TRT] Tactic: 19 time 0.029012 [03/13/2022-08:32:04] [V] [TRT] Tactic: 20 time 0.022664 [03/13/2022-08:32:04] [V] [TRT] Tactic: 21 time 0.019196 [03/13/2022-08:32:04] [V] [TRT] Tactic: 22 time 0.0192 [03/13/2022-08:32:04] [V] [TRT] Tactic: 23 time 0.01926 [03/13/2022-08:32:04] [V] [TRT] Tactic: 24 time 0.031692 [03/13/2022-08:32:04] [V] [TRT] Tactic: 25 time 0.025832 [03/13/2022-08:32:04] [V] [TRT] Tactic: 26 time 0.023548 [03/13/2022-08:32:04] [V] [TRT] Tactic: 27 time 0.024476 [03/13/2022-08:32:04] [V] [TRT] Tactic: 28 time 0.01606 [03/13/2022-08:32:04] [V] [TRT] Tactic: 29 time 0.017556 [03/13/2022-08:32:04] [V] [TRT] Tactic: 30 time 0.022732 [03/13/2022-08:32:04] [V] [TRT] Tactic: 31 time 0.031316 [03/13/2022-08:32:04] [V] [TRT] Fastest Tactic: 16 Time: 0.015348 [03/13/2022-08:32:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 16 [03/13/2022-08:32:04] [V] [TRT] [03/13/2022-08:32:04] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,3600) *************** [03/13/2022-08:32:04] [V] [TRT] Conv_447 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:32:04] [V] [TRT] Conv_447 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:32:04] [V] [TRT] Conv_447 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:32:04] [V] [TRT] Conv_447 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:32:04] [V] [TRT] Conv_447 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:32:04] [V] [TRT] Conv_447 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:32:04] [V] [TRT] Conv_447 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:32:04] [V] [TRT] Conv_447 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:32:04] [V] [TRT] Conv_447 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:32:04] [V] [TRT] --------------- Timing Runner: Conv_447 (FusedConvActConvolution) [03/13/2022-08:32:04] [V] [TRT] Tactic: 589823 time 0.145464 [03/13/2022-08:32:04] [V] [TRT] Tactic: 786431 time 0.04296 [03/13/2022-08:32:04] [V] [TRT] Tactic: 1310719 time 0.070156 [03/13/2022-08:32:04] [V] [TRT] Tactic: 1638399 time 0.038972 [03/13/2022-08:32:04] [V] [TRT] Tactic: 1835007 time 0.045584 [03/13/2022-08:32:04] [V] [TRT] Tactic: 2097151 time 0.042784 [03/13/2022-08:32:04] [V] [TRT] Tactic: 3997695 time 0.038876 [03/13/2022-08:32:04] [V] [TRT] Tactic: 4194303 time 0.040912 [03/13/2022-08:32:04] [V] [TRT] Tactic: 4259839 time 0.037416 [03/13/2022-08:32:04] [V] [TRT] Tactic: 4325375 time 0.037424 [03/13/2022-08:32:04] [V] [TRT] Tactic: 4521983 time 0.095904 [03/13/2022-08:32:04] [V] [TRT] Tactic: 4587519 time 0.04182 [03/13/2022-08:32:04] [V] [TRT] Tactic: 4915199 time 0.040828 [03/13/2022-08:32:04] [V] [TRT] Tactic: 4980735 time 0.050996 [03/13/2022-08:32:04] [V] [TRT] Tactic: 5439487 time 0.060964 [03/13/2022-08:32:04] [V] [TRT] Tactic: 5767167 time 0.100544 [03/13/2022-08:32:04] [V] [TRT] Tactic: 6750207 time 0.043872 [03/13/2022-08:32:04] [V] [TRT] Tactic: 6946815 time 0.053992 [03/13/2022-08:32:04] [V] [TRT] Tactic: 7012351 time 0.042676 [03/13/2022-08:32:04] [V] [TRT] Tactic: 7143423 time 0.056128 [03/13/2022-08:32:04] [V] [TRT] Tactic: 7602175 time 0.044296 [03/13/2022-08:32:04] [V] [TRT] Tactic: 7798783 time 0.042992 [03/13/2022-08:32:04] [V] [TRT] Tactic: 8191999 time 0.04482 [03/13/2022-08:32:04] [V] [TRT] Tactic: 8257535 time 0.043576 [03/13/2022-08:32:04] [V] [TRT] Tactic: 8323071 time 0.047244 [03/13/2022-08:32:04] [V] [TRT] Tactic: 8650751 time 0.046628 [03/13/2022-08:32:04] [V] [TRT] Tactic: 9109503 time 0.044312 [03/13/2022-08:32:04] [V] [TRT] Tactic: 9568255 time 0.04086 [03/13/2022-08:32:04] [V] [TRT] Tactic: 9895935 time 0.042796 [03/13/2022-08:32:04] [V] [TRT] Tactic: 10354687 time 0.03778 [03/13/2022-08:32:04] [V] [TRT] Tactic: 10551295 time 0.056356 [03/13/2022-08:32:04] [V] [TRT] Tactic: 10944511 time 0.050988 [03/13/2022-08:32:04] [V] [TRT] Fastest Tactic: 4259839 Time: 0.037416 [03/13/2022-08:32:04] [V] [TRT] --------------- Timing Runner: Conv_447 (CaskConvolution) [03/13/2022-08:32:04] [V] [TRT] Conv_447 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:32:04] [V] [TRT] Tactic: 1754569683116234317 time 0.072452 [03/13/2022-08:32:04] [V] [TRT] Conv_447 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:32:04] [V] [TRT] Tactic: 1825138533642645384 time 0.072756 [03/13/2022-08:32:04] [V] [TRT] Conv_447 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 2733356012094739613 time 0.065348 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 3915320020053085238 time 0.072524 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 6808617066150061604 time 0.046716 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 9091006216302412844 time 0.045152 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -8060443123034038864 time 0.048768 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -4420849921117327522 time 0.055144 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -3946921629105938337 time 0.065488 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.045152 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (CudaConvolution) [03/13/2022-08:32:05] [V] [TRT] Tactic: 0 time 0.038772 [03/13/2022-08:32:05] [V] [TRT] Tactic: 2 time 0.186448 [03/13/2022-08:32:05] [V] [TRT] Tactic: 5 time 0.131176 [03/13/2022-08:32:05] [V] [TRT] Tactic: 57 time 0.040156 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 0 Time: 0.038772 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (CudaDepthwiseConvolution) [03/13/2022-08:32:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 4259839 [03/13/2022-08:32:05] [V] [TRT] [03/13/2022-08:32:05] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,3600) *************** [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (FusedConvActConvolution) [03/13/2022-08:32:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (CaskConvolution) [03/13/2022-08:32:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (CudaConvolution) [03/13/2022-08:32:05] [V] [TRT] Tactic: 0 time 0.04158 [03/13/2022-08:32:05] [V] [TRT] Tactic: 1 time 0.040348 [03/13/2022-08:32:05] [V] [TRT] Tactic: 2 time 0.145748 [03/13/2022-08:32:05] [V] [TRT] Tactic: 4 skipped. Scratch requested: 43257856, available: 16777216 [03/13/2022-08:32:05] [V] [TRT] Tactic: 5 time 0.12756 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 1 Time: 0.040348 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (CudaDepthwiseConvolution) [03/13/2022-08:32:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:32:05] [V] [TRT] [03/13/2022-08:32:05] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200,3600) *************** [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (FusedConvActConvolution) [03/13/2022-08:32:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (CaskConvolution) [03/13/2022-08:32:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (CudaConvolution) [03/13/2022-08:32:05] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (CudaDepthwiseConvolution) [03/13/2022-08:32:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:05] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,2400) *************** [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (FusedConvActConvolution) [03/13/2022-08:32:05] [V] [TRT] Tactic: 589823 time 0.055272 [03/13/2022-08:32:05] [V] [TRT] Tactic: 786431 time 0.02662 [03/13/2022-08:32:05] [V] [TRT] Tactic: 1310719 time 0.035308 [03/13/2022-08:32:05] [V] [TRT] Tactic: 1638399 time 0.023568 [03/13/2022-08:32:05] [V] [TRT] Tactic: 1835007 time 0.027084 [03/13/2022-08:32:05] [V] [TRT] Tactic: 2097151 time 0.027736 [03/13/2022-08:32:05] [V] [TRT] Tactic: 3997695 time 0.023912 [03/13/2022-08:32:05] [V] [TRT] Tactic: 4194303 time 0.0266 [03/13/2022-08:32:05] [V] [TRT] Tactic: 4259839 time 0.023568 [03/13/2022-08:32:05] [V] [TRT] Tactic: 4325375 time 0.0226 [03/13/2022-08:32:05] [V] [TRT] Tactic: 4521983 time 0.041644 [03/13/2022-08:32:05] [V] [TRT] Tactic: 4587519 time 0.025452 [03/13/2022-08:32:05] [V] [TRT] Tactic: 4915199 time 0.024492 [03/13/2022-08:32:05] [V] [TRT] Tactic: 4980735 time 0.026604 [03/13/2022-08:32:05] [V] [TRT] Tactic: 5439487 time 0.032976 [03/13/2022-08:32:05] [V] [TRT] Tactic: 5767167 time 0.054152 [03/13/2022-08:32:05] [V] [TRT] Tactic: 6750207 time 0.02628 [03/13/2022-08:32:05] [V] [TRT] Tactic: 6946815 time 0.031092 [03/13/2022-08:32:05] [V] [TRT] Tactic: 7012351 time 0.027192 [03/13/2022-08:32:05] [V] [TRT] Tactic: 7143423 time 0.032748 [03/13/2022-08:32:05] [V] [TRT] Tactic: 7602175 time 0.025144 [03/13/2022-08:32:05] [V] [TRT] Tactic: 7798783 time 0.026564 [03/13/2022-08:32:05] [V] [TRT] Tactic: 8191999 time 0.026632 [03/13/2022-08:32:05] [V] [TRT] Tactic: 8257535 time 0.026472 [03/13/2022-08:32:05] [V] [TRT] Tactic: 8323071 time 0.027388 [03/13/2022-08:32:05] [V] [TRT] Tactic: 8650751 time 0.029016 [03/13/2022-08:32:05] [V] [TRT] Tactic: 9109503 time 0.0286 [03/13/2022-08:32:05] [V] [TRT] Tactic: 9568255 time 0.024572 [03/13/2022-08:32:05] [V] [TRT] Tactic: 9895935 time 0.02634 [03/13/2022-08:32:05] [V] [TRT] Tactic: 10354687 time 0.023108 [03/13/2022-08:32:05] [V] [TRT] Tactic: 10551295 time 0.027232 [03/13/2022-08:32:05] [V] [TRT] Tactic: 10944511 time 0.026612 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 4325375 Time: 0.0226 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (CaskConvolution) [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 1651411198763708804 time 0.028388 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 2418518597804310654 time 0.028384 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 4318470497547290900 time 0.02756 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 4930470141256631146 time 0.03042 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 8292881859266835088 time 0.030288 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 8401509141903434922 time 0.026964 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -8654297089785671176 time 0.040468 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -7516584506774355935 time 0.026264 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -7140760933967189247 time 0.026144 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -6004726995029373073 time 0.029304 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -5719726816705110014 time 0.040624 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -4097850214384059472 time 0.02622 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -3717489476759089008 time 0.026484 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -3689982367035295496 time 0.040464 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -2640575123064142123 time 0.039648 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -2534402059426524406 time 0.03976 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -2027588946874785071 time 0.027604 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -1968398013367819764 time 0.040628 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: -7140760933967189247 Time: 0.026144 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (CudaConvolution) [03/13/2022-08:32:05] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (CudaDepthwiseConvolution) [03/13/2022-08:32:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 4325375 [03/13/2022-08:32:05] [V] [TRT] [03/13/2022-08:32:05] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Float(1,40,1200,3600) *************** [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (FusedConvActConvolution) [03/13/2022-08:32:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (CaskConvolution) [03/13/2022-08:32:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (CudaConvolution) [03/13/2022-08:32:05] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (CudaDepthwiseConvolution) [03/13/2022-08:32:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:05] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(1,40,1:8,1200) *************** [03/13/2022-08:32:05] [V] [TRT] Conv_447 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (FusedConvActConvolution) [03/13/2022-08:32:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (CaskConvolution) [03/13/2022-08:32:05] [V] [TRT] Conv_447 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:05] [V] [TRT] Tactic: 9576651994278528 time 0.076332 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 1179757074518529353 time 0.29216 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 2105695814191699972 time 0.521764 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 2148106709480872763 time 0.289888 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 2410442691266548717 time 0.560132 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 3041642431972138763 time 0.287416 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 3754069740140581927 time 0.522096 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 4555462412611657028 time 0.288932 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 5666160310350604399 time 0.52194 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:05] [V] [TRT] Tactic: 5876997871499382316 time 0.136684 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 5925270497649423688 time 1.03493 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 6680916730816870145 time 0.522912 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 7158029511300006471 time 0.522184 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 7859952145590271433 time 0.523092 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: 8283847742354150423 time 0.52194 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -8992262742606384444 time 0.290224 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -8391760416076885205 time 1.03482 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -6273232454637933930 time 0.285772 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:05] [V] [TRT] Tactic: -5925110308892264213 time 0.136108 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -5818527483287834165 time 0.290844 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:05] [V] [TRT] Tactic: -4908848143422991657 time 0.076456 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -4534876761957424274 time 0.80172 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -3237051169894153788 time 0.40434 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -3136088851200285532 time 0.22104 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -2586046817576862066 time 0.434236 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -2422160065350346448 time 0.405292 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -1216445540764179377 time 0.434096 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Tactic: -229563042944049199 time 0.221096 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 9576651994278528 Time: 0.076332 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (CudaConvolution) [03/13/2022-08:32:05] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: Conv_447 (CudaDepthwiseConvolution) [03/13/2022-08:32:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9576651994278528 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:05] [V] [TRT] [03/13/2022-08:32:05] [V] [TRT] Conv_447 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:05] [V] [TRT] Conv_447 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:05] [V] [TRT] Tactic: 1002 time 0.00734 [03/13/2022-08:32:05] [V] [TRT] Tactic: 0 time 0.004984 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 0 Time: 0.004984 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:05] [V] [TRT] Tactic: 1002 time 0.005196 [03/13/2022-08:32:05] [V] [TRT] Tactic: 0 time 0.004916 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 0 Time: 0.004916 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:05] [V] [TRT] Tactic: 1002 time 0.007252 [03/13/2022-08:32:05] [V] [TRT] Tactic: 0 time 0.004288 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 0 Time: 0.004288 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:05] [V] [TRT] Tactic: 1002 time 0.009132 [03/13/2022-08:32:05] [V] [TRT] Tactic: 0 time 0.004824 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 0 Time: 0.004824 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:05] [V] [TRT] Tactic: 1002 time 0.00704 [03/13/2022-08:32:05] [V] [TRT] Tactic: 0 time 0.00486 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 0 Time: 0.00486 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:05] [V] [TRT] Tactic: 1002 time 0.006632 [03/13/2022-08:32:05] [V] [TRT] Tactic: 0 time 0.004656 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 0 Time: 0.004656 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:05] [V] [TRT] Tactic: 1002 time 0.007144 [03/13/2022-08:32:05] [V] [TRT] Tactic: 0 time 0.004956 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 0 Time: 0.004956 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:05] [V] [TRT] Tactic: 1002 time 0.009044 [03/13/2022-08:32:05] [V] [TRT] Tactic: 0 time 0.004892 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 0 Time: 0.004892 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:05] [V] [TRT] Tactic: 1002 time 0.005168 [03/13/2022-08:32:05] [V] [TRT] Tactic: 0 time 0.004368 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 0 Time: 0.004368 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:05] [V] [TRT] Tactic: 1002 time 0.006892 [03/13/2022-08:32:05] [V] [TRT] Tactic: 0 time 0.005136 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 0 Time: 0.005136 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:05] [V] [TRT] Tactic: 1002 time 0.007384 [03/13/2022-08:32:05] [V] [TRT] Tactic: 0 time 0.004536 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 0 Time: 0.004536 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:05] [V] [TRT] Tactic: 1002 time 0.009528 [03/13/2022-08:32:05] [V] [TRT] Tactic: 0 time 0.00478 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 0 Time: 0.00478 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:05] [V] [TRT] Tactic: 1002 time 0.006972 [03/13/2022-08:32:05] [V] [TRT] Tactic: 0 time 0.004376 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 0 Time: 0.004376 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:05] [V] [TRT] Tactic: 1002 time 0.007032 [03/13/2022-08:32:05] [V] [TRT] Tactic: 0 time 0.005212 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 0 Time: 0.005212 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:05] [V] [TRT] Tactic: 1002 time 0.006764 [03/13/2022-08:32:05] [V] [TRT] Tactic: 0 time 0.004388 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 0 Time: 0.004388 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:05] [V] [TRT] Tactic: 1002 time 0.00938 [03/13/2022-08:32:05] [V] [TRT] Tactic: 0 time 0.00466 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 0 Time: 0.00466 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:05] [V] [TRT] Tactic: 1002 time 0.006972 [03/13/2022-08:32:05] [V] [TRT] Tactic: 0 time 0.004356 [03/13/2022-08:32:05] [V] [TRT] Fastest Tactic: 0 Time: 0.004356 [03/13/2022-08:32:05] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:06] [V] [TRT] Tactic: 1002 time 0.008664 [03/13/2022-08:32:06] [V] [TRT] Tactic: 0 time 0.00504 [03/13/2022-08:32:06] [V] [TRT] Fastest Tactic: 0 Time: 0.00504 [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:06] [V] [TRT] Tactic: 1002 time 0.00696 [03/13/2022-08:32:06] [V] [TRT] Tactic: 0 time 0.0044 [03/13/2022-08:32:06] [V] [TRT] Fastest Tactic: 0 Time: 0.0044 [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:06] [V] [TRT] Tactic: 1002 time 0.009228 [03/13/2022-08:32:06] [V] [TRT] Tactic: 0 time 0.004488 [03/13/2022-08:32:06] [V] [TRT] Fastest Tactic: 0 Time: 0.004488 [03/13/2022-08:32:06] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,3600) -> Float(1,1,40,1200,3600) *************** [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Reshape_449 + Transpose_450 (Shuffle) [03/13/2022-08:32:06] [V] [TRT] Tactic: 0 time 0.004168 [03/13/2022-08:32:06] [V] [TRT] Tactic: 1 time 0.007664 [03/13/2022-08:32:06] [V] [TRT] Fastest Tactic: 0 Time: 0.004168 [03/13/2022-08:32:06] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,1200) -> Float(1,1,40:32,40,120) *************** [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Reshape_449 + Transpose_450 (Shuffle) [03/13/2022-08:32:06] [V] [TRT] Tactic: 0 time 0.005228 [03/13/2022-08:32:06] [V] [TRT] Tactic: 1 time 0.012056 [03/13/2022-08:32:06] [V] [TRT] Fastest Tactic: 0 Time: 0.005228 [03/13/2022-08:32:06] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,3600) -> Half(1,1,40,1200,3600) *************** [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Reshape_449 + Transpose_450 (Shuffle) [03/13/2022-08:32:06] [V] [TRT] Tactic: 0 time 0.004332 [03/13/2022-08:32:06] [V] [TRT] Tactic: 1 time 0.007576 [03/13/2022-08:32:06] [V] [TRT] Fastest Tactic: 0 Time: 0.004332 [03/13/2022-08:32:06] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,2400) -> Half(1,1,40:2,600,1800) *************** [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Reshape_449 + Transpose_450 (Shuffle) [03/13/2022-08:32:06] [V] [TRT] Tactic: 0 time 0.005232 [03/13/2022-08:32:06] [V] [TRT] Tactic: 1 time 0.012072 [03/13/2022-08:32:06] [V] [TRT] Fastest Tactic: 0 Time: 0.005232 [03/13/2022-08:32:06] [V] [TRT] *************** Autotuning format combination: Half(1,40,1:8,1200) -> Half(4,4,1:8,160,480) *************** [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Reshape_449 + Transpose_450 (Shuffle) [03/13/2022-08:32:06] [V] [TRT] Tactic: 0 time 0.005132 [03/13/2022-08:32:06] [V] [TRT] Tactic: 1 time 0.013088 [03/13/2022-08:32:06] [V] [TRT] Fastest Tactic: 0 Time: 0.005132 [03/13/2022-08:32:06] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,20,300,96000) *************** [03/13/2022-08:32:06] [V] [TRT] Conv_329 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Conv_329 (FusedConvActConvolution) [03/13/2022-08:32:06] [V] [TRT] Tactic: 458751 time 0.425756 [03/13/2022-08:32:06] [V] [TRT] Fastest Tactic: 458751 Time: 0.425756 [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Conv_329 (CaskConvolution) [03/13/2022-08:32:06] [V] [TRT] Conv_329 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: 1825138533642645384 time 0.4391 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: 2842488832350522458 time 0.457524 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: 3915320020053085238 time 0.433012 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: 6448355332020552203 time 0.443964 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: 6808617066150061604 time 0.478716 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: -8060443123034038864 time 0.493284 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: -4420849921117327522 time 0.48206 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: -3946921629105938337 time 0.55556 [03/13/2022-08:32:06] [V] [TRT] Fastest Tactic: 3915320020053085238 Time: 0.433012 [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Conv_329 (CudaConvolution) [03/13/2022-08:32:06] [V] [TRT] Tactic: 0 time 0.726864 [03/13/2022-08:32:06] [V] [TRT] Tactic: 2 time 0.669924 [03/13/2022-08:32:06] [V] [TRT] Tactic: 5 skipped. Scratch requested: 451215360, available: 16777216 [03/13/2022-08:32:06] [V] [TRT] Tactic: 57 time 0.440948 [03/13/2022-08:32:06] [V] [TRT] Fastest Tactic: 57 Time: 0.440948 [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Conv_329 (CudaDepthwiseConvolution) [03/13/2022-08:32:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 458751 [03/13/2022-08:32:06] [V] [TRT] [03/13/2022-08:32:06] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,20,300,96000) *************** [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Conv_329 (FusedConvActConvolution) [03/13/2022-08:32:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Conv_329 (CaskConvolution) [03/13/2022-08:32:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Conv_329 (CudaConvolution) [03/13/2022-08:32:06] [V] [TRT] Tactic: 0 time 0.70914 [03/13/2022-08:32:06] [V] [TRT] Tactic: 1 time 0.447652 [03/13/2022-08:32:06] [V] [TRT] Tactic: 2 time 0.669736 [03/13/2022-08:32:06] [V] [TRT] Tactic: 5 skipped. Scratch requested: 451215360, available: 16777216 [03/13/2022-08:32:06] [V] [TRT] Fastest Tactic: 1 Time: 0.447652 [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Conv_329 (CudaDepthwiseConvolution) [03/13/2022-08:32:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:32:06] [V] [TRT] [03/13/2022-08:32:06] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,20,300:2,48000) *************** [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Conv_329 (FusedConvActConvolution) [03/13/2022-08:32:06] [V] [TRT] Tactic: 458751 time 0.213356 [03/13/2022-08:32:06] [V] [TRT] Fastest Tactic: 458751 Time: 0.213356 [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Conv_329 (CaskConvolution) [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: 1145226902788474763 time 0.239248 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: 1651411198763708804 time 0.236444 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: 2418518597804310654 time 0.238112 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: 4318470497547290900 time 0.23294 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: 4653005425971292725 time 0.239604 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: 4930470141256631146 time 0.246472 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: 8292881859266835088 time 0.245712 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: 8401509141903434922 time 0.231936 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: -8654297089785671176 time 0.221504 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: -7448936905981214224 time 0.253316 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: -6004726995029373073 time 0.24062 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: -5719726816705110014 time 0.222204 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: -3754890472406891741 time 0.229952 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: -3689982367035295496 time 0.224064 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: -2894005464278291378 time 0.252 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: -2027588946874785071 time 0.23592 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: -1968398013367819764 time 0.22436 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: -245090590808296743 time 0.229948 [03/13/2022-08:32:06] [V] [TRT] Fastest Tactic: -8654297089785671176 Time: 0.221504 [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Conv_329 (CudaConvolution) [03/13/2022-08:32:06] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Conv_329 (CudaDepthwiseConvolution) [03/13/2022-08:32:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 458751 [03/13/2022-08:32:06] [V] [TRT] [03/13/2022-08:32:06] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Float(1,20,300,96000) *************** [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Conv_329 (FusedConvActConvolution) [03/13/2022-08:32:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Conv_329 (CaskConvolution) [03/13/2022-08:32:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Conv_329 (CudaConvolution) [03/13/2022-08:32:06] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Conv_329 (CudaDepthwiseConvolution) [03/13/2022-08:32:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:06] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(40,800,1:8,12000) *************** [03/13/2022-08:32:06] [V] [TRT] Conv_329 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:06] [V] [TRT] Conv_329 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:06] [V] [TRT] Conv_329 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Conv_329 (FusedConvActConvolution) [03/13/2022-08:32:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:06] [V] [TRT] --------------- Timing Runner: Conv_329 (CaskConvolution) [03/13/2022-08:32:06] [V] [TRT] Conv_329 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:06] [V] [TRT] Tactic: 130343752241278875 time 0.965792 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: 2148106709480872763 time 1.92377 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: 2410442691266548717 time 3.83885 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:06] [V] [TRT] Tactic: 2921824978225832523 time 0.973252 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:06] [V] [TRT] Tactic: 3030711443478140260 time 1.79825 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: 3754069740140581927 time 3.58675 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: 3823144360994712832 time 1.9312 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:32:06] [V] [TRT] Tactic: 5635311898703673455 time 1.92878 [03/13/2022-08:32:06] [V] [TRT] Conv_329 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:07] [V] [TRT] Tactic: 5925270497649423688 time 7.14968 [03/13/2022-08:32:07] [V] [TRT] Conv_329 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:07] [V] [TRT] Tactic: 6680916730816870145 time 3.58506 [03/13/2022-08:32:07] [V] [TRT] Conv_329 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:07] [V] [TRT] Tactic: 7158029511300006471 time 3.58811 [03/13/2022-08:32:07] [V] [TRT] Conv_329 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:07] [V] [TRT] Tactic: 7859952145590271433 time 3.58633 [03/13/2022-08:32:07] [V] [TRT] Conv_329 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:07] [V] [TRT] Tactic: 8283847742354150423 time 3.58445 [03/13/2022-08:32:07] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:07] [V] [TRT] Tactic: -8992262742606384444 time 1.92841 [03/13/2022-08:32:07] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:32:07] [V] [TRT] Tactic: -8682550625095202832 time 1.93162 [03/13/2022-08:32:07] [V] [TRT] Conv_329 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:07] [V] [TRT] Tactic: -8379842433586149932 time 1.79983 [03/13/2022-08:32:07] [V] [TRT] Conv_329 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:07] [V] [TRT] Tactic: -6352769237623756264 time 1.80271 [03/13/2022-08:32:07] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:07] [V] [TRT] Tactic: -6273232454637933930 time 1.93072 [03/13/2022-08:32:07] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:07] [V] [TRT] Tactic: -5818527483287834165 time 1.93137 [03/13/2022-08:32:07] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [03/13/2022-08:32:07] [V] [TRT] Tactic: -4954692664176521434 time 3.84379 [03/13/2022-08:32:07] [V] [TRT] Conv_329 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:07] [V] [TRT] Tactic: -4953888146171240997 time 0.966268 [03/13/2022-08:32:07] [V] [TRT] Conv_329 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:07] [V] [TRT] Tactic: -4534876761957424274 time 7.15115 [03/13/2022-08:32:07] [V] [TRT] Conv_329 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:07] [V] [TRT] Tactic: -3237051169894153788 time 3.58608 [03/13/2022-08:32:07] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:07] [V] [TRT] Tactic: -3136088851200285532 time 1.92796 [03/13/2022-08:32:07] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: -2586046817576862066 time 3.84136 [03/13/2022-08:32:08] [V] [TRT] Conv_329 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: -229563042944049199 time 1.9318 [03/13/2022-08:32:08] [V] [TRT] Fastest Tactic: 130343752241278875 Time: 0.965792 [03/13/2022-08:32:08] [V] [TRT] --------------- Timing Runner: Conv_329 (CudaConvolution) [03/13/2022-08:32:08] [V] [TRT] Tactic: 0 time 0.909772 [03/13/2022-08:32:08] [V] [TRT] Tactic: 1 time 0.467336 [03/13/2022-08:32:08] [V] [TRT] Tactic: 2 time 0.729008 [03/13/2022-08:32:08] [V] [TRT] Fastest Tactic: 1 Time: 0.467336 [03/13/2022-08:32:08] [V] [TRT] --------------- Timing Runner: Conv_329 (CudaDepthwiseConvolution) [03/13/2022-08:32:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:32:08] [V] [TRT] [03/13/2022-08:32:08] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,384000) -> Float(1,40,1200,39600) *************** [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:32:08] [V] [TRT] --------------- Timing Runner: Conv_288 (FusedConvActConvolution) [03/13/2022-08:32:08] [V] [TRT] Tactic: 589823 time 0.129892 [03/13/2022-08:32:08] [V] [TRT] Tactic: 786431 time 0.056552 [03/13/2022-08:32:08] [V] [TRT] Tactic: 1310719 time 0.067572 [03/13/2022-08:32:08] [V] [TRT] Tactic: 1638399 time 0.056412 [03/13/2022-08:32:08] [V] [TRT] Tactic: 1835007 time 0.074804 [03/13/2022-08:32:08] [V] [TRT] Tactic: 2097151 time 0.058996 [03/13/2022-08:32:08] [V] [TRT] Tactic: 3997695 time 0.059136 [03/13/2022-08:32:08] [V] [TRT] Tactic: 4194303 time 0.062924 [03/13/2022-08:32:08] [V] [TRT] Tactic: 4259839 time 0.054744 [03/13/2022-08:32:08] [V] [TRT] Tactic: 4325375 time 0.054 [03/13/2022-08:32:08] [V] [TRT] Tactic: 4521983 time 0.088328 [03/13/2022-08:32:08] [V] [TRT] Tactic: 4587519 time 0.059744 [03/13/2022-08:32:08] [V] [TRT] Tactic: 4915199 time 0.056752 [03/13/2022-08:32:08] [V] [TRT] Tactic: 4980735 time 0.059096 [03/13/2022-08:32:08] [V] [TRT] Tactic: 5439487 time 0.093272 [03/13/2022-08:32:08] [V] [TRT] Tactic: 5767167 time 0.162136 [03/13/2022-08:32:08] [V] [TRT] Tactic: 6750207 time 0.064996 [03/13/2022-08:32:08] [V] [TRT] Tactic: 6946815 time 0.09384 [03/13/2022-08:32:08] [V] [TRT] Tactic: 7012351 time 0.058648 [03/13/2022-08:32:08] [V] [TRT] Tactic: 7143423 time 0.094716 [03/13/2022-08:32:08] [V] [TRT] Tactic: 7602175 time 0.068424 [03/13/2022-08:32:08] [V] [TRT] Tactic: 7798783 time 0.057284 [03/13/2022-08:32:08] [V] [TRT] Tactic: 8191999 time 0.071636 [03/13/2022-08:32:08] [V] [TRT] Tactic: 8257535 time 0.062552 [03/13/2022-08:32:08] [V] [TRT] Tactic: 8323071 time 0.067232 [03/13/2022-08:32:08] [V] [TRT] Tactic: 8650751 time 0.078092 [03/13/2022-08:32:08] [V] [TRT] Tactic: 9109503 time 0.064848 [03/13/2022-08:32:08] [V] [TRT] Tactic: 9568255 time 0.056704 [03/13/2022-08:32:08] [V] [TRT] Tactic: 9895935 time 0.062544 [03/13/2022-08:32:08] [V] [TRT] Tactic: 10354687 time 0.055276 [03/13/2022-08:32:08] [V] [TRT] Tactic: 10551295 time 0.067944 [03/13/2022-08:32:08] [V] [TRT] Tactic: 10944511 time 0.060372 [03/13/2022-08:32:08] [V] [TRT] Fastest Tactic: 4325375 Time: 0.054 [03/13/2022-08:32:08] [V] [TRT] --------------- Timing Runner: Conv_288 (CaskConvolution) [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: 1754569683116234317 time 0.057228 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: 1825138533642645384 time 0.057884 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: 2733356012094739613 time 0.059264 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: 3915320020053085238 time 0.057348 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: 6808617066150061604 time 0.039312 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: 9091006216302412844 time 0.037856 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: -8060443123034038864 time 0.041044 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: -4420849921117327522 time 0.051176 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: -3946921629105938337 time 0.063636 [03/13/2022-08:32:08] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.037856 [03/13/2022-08:32:08] [V] [TRT] --------------- Timing Runner: Conv_288 (CudaConvolution) [03/13/2022-08:32:08] [V] [TRT] Tactic: 0 time 0.056584 [03/13/2022-08:32:08] [V] [TRT] Tactic: 2 time 0.166568 [03/13/2022-08:32:08] [V] [TRT] Tactic: 5 time 0.173232 [03/13/2022-08:32:08] [V] [TRT] Tactic: 57 time 0.05742 [03/13/2022-08:32:08] [V] [TRT] Fastest Tactic: 0 Time: 0.056584 [03/13/2022-08:32:08] [V] [TRT] --------------- Timing Runner: Conv_288 (CudaDepthwiseConvolution) [03/13/2022-08:32:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,384000) -> Half(1,40,1200,39600) *************** [03/13/2022-08:32:08] [V] [TRT] --------------- Timing Runner: Conv_288 (FusedConvActConvolution) [03/13/2022-08:32:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:08] [V] [TRT] --------------- Timing Runner: Conv_288 (CaskConvolution) [03/13/2022-08:32:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:08] [V] [TRT] --------------- Timing Runner: Conv_288 (CudaConvolution) [03/13/2022-08:32:08] [V] [TRT] Tactic: 0 time 0.3276 [03/13/2022-08:32:08] [V] [TRT] Tactic: 1 time 0.060284 [03/13/2022-08:32:08] [V] [TRT] Tactic: 2 time 0.157004 [03/13/2022-08:32:08] [V] [TRT] Tactic: 4 skipped. Scratch requested: 367699456, available: 16777216 [03/13/2022-08:32:08] [V] [TRT] Tactic: 5 time 0.163808 [03/13/2022-08:32:08] [V] [TRT] Fastest Tactic: 1 Time: 0.060284 [03/13/2022-08:32:08] [V] [TRT] --------------- Timing Runner: Conv_288 (CudaDepthwiseConvolution) [03/13/2022-08:32:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:32:08] [V] [TRT] [03/13/2022-08:32:08] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200,39600) *************** [03/13/2022-08:32:08] [V] [TRT] --------------- Timing Runner: Conv_288 (FusedConvActConvolution) [03/13/2022-08:32:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:08] [V] [TRT] --------------- Timing Runner: Conv_288 (CaskConvolution) [03/13/2022-08:32:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:08] [V] [TRT] --------------- Timing Runner: Conv_288 (CudaConvolution) [03/13/2022-08:32:08] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:08] [V] [TRT] --------------- Timing Runner: Conv_288 (CudaDepthwiseConvolution) [03/13/2022-08:32:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:08] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,192000) -> Half(1,40,1200:2,20400) *************** [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:08] [V] [TRT] --------------- Timing Runner: Conv_288 (FusedConvActConvolution) [03/13/2022-08:32:08] [V] [TRT] Tactic: 589823 time 0.045792 [03/13/2022-08:32:08] [V] [TRT] Tactic: 786431 time 0.032868 [03/13/2022-08:32:08] [V] [TRT] Tactic: 1310719 time 0.034728 [03/13/2022-08:32:08] [V] [TRT] Tactic: 1638399 time 0.032996 [03/13/2022-08:32:08] [V] [TRT] Tactic: 1835007 time 0.036104 [03/13/2022-08:32:08] [V] [TRT] Tactic: 2097151 time 0.035696 [03/13/2022-08:32:08] [V] [TRT] Tactic: 3997695 time 0.03284 [03/13/2022-08:32:08] [V] [TRT] Tactic: 4194303 time 0.033496 [03/13/2022-08:32:08] [V] [TRT] Tactic: 4259839 time 0.032568 [03/13/2022-08:32:08] [V] [TRT] Tactic: 4325375 time 0.031192 [03/13/2022-08:32:08] [V] [TRT] Tactic: 4521983 time 0.035716 [03/13/2022-08:32:08] [V] [TRT] Tactic: 4587519 time 0.03484 [03/13/2022-08:32:08] [V] [TRT] Tactic: 4915199 time 0.03296 [03/13/2022-08:32:08] [V] [TRT] Tactic: 4980735 time 0.034436 [03/13/2022-08:32:08] [V] [TRT] Tactic: 5439487 time 0.050588 [03/13/2022-08:32:08] [V] [TRT] Tactic: 5767167 time 0.083072 [03/13/2022-08:32:08] [V] [TRT] Tactic: 6750207 time 0.03548 [03/13/2022-08:32:08] [V] [TRT] Tactic: 6946815 time 0.050912 [03/13/2022-08:32:08] [V] [TRT] Tactic: 7012351 time 0.036148 [03/13/2022-08:32:08] [V] [TRT] Tactic: 7143423 time 0.049236 [03/13/2022-08:32:08] [V] [TRT] Tactic: 7602175 time 0.035392 [03/13/2022-08:32:08] [V] [TRT] Tactic: 7798783 time 0.032716 [03/13/2022-08:32:08] [V] [TRT] Tactic: 8191999 time 0.039784 [03/13/2022-08:32:08] [V] [TRT] Tactic: 8257535 time 0.035688 [03/13/2022-08:32:08] [V] [TRT] Tactic: 8323071 time 0.036872 [03/13/2022-08:32:08] [V] [TRT] Tactic: 8650751 time 0.03972 [03/13/2022-08:32:08] [V] [TRT] Tactic: 9109503 time 0.039668 [03/13/2022-08:32:08] [V] [TRT] Tactic: 9568255 time 0.032972 [03/13/2022-08:32:08] [V] [TRT] Tactic: 9895935 time 0.033988 [03/13/2022-08:32:08] [V] [TRT] Tactic: 10354687 time 0.032256 [03/13/2022-08:32:08] [V] [TRT] Tactic: 10551295 time 0.0382 [03/13/2022-08:32:08] [V] [TRT] Tactic: 10944511 time 0.035652 [03/13/2022-08:32:08] [V] [TRT] Fastest Tactic: 4325375 Time: 0.031192 [03/13/2022-08:32:08] [V] [TRT] --------------- Timing Runner: Conv_288 (CaskConvolution) [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: 1651411198763708804 time 0.0225 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: 2418518597804310654 time 0.022392 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: 4318470497547290900 time 0.021456 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: 4930470141256631146 time 0.02462 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: 8292881859266835088 time 0.024556 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: 8401509141903434922 time 0.021432 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: -8654297089785671176 time 0.031596 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: -7516584506774355935 time 0.032512 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: -7140760933967189247 time 0.02056 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: -6004726995029373073 time 0.023588 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: -5719726816705110014 time 0.032092 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: -4097850214384059472 time 0.032616 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: -3717489476759089008 time 0.020604 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: -3689982367035295496 time 0.032372 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: -2640575123064142123 time 0.03126 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: -2534402059426524406 time 0.031624 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:08] [V] [TRT] Tactic: -2027588946874785071 time 0.022776 [03/13/2022-08:32:08] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: -1968398013367819764 time 0.032384 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: -7140760933967189247 Time: 0.02056 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Conv_288 (CudaConvolution) [03/13/2022-08:32:09] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Conv_288 (CudaDepthwiseConvolution) [03/13/2022-08:32:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7140760933967189247 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:09] [V] [TRT] [03/13/2022-08:32:09] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:09] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Float(1,40,1200,39600) *************** [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Conv_288 (FusedConvActConvolution) [03/13/2022-08:32:09] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Conv_288 (CaskConvolution) [03/13/2022-08:32:09] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Conv_288 (CudaConvolution) [03/13/2022-08:32:09] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Conv_288 (CudaDepthwiseConvolution) [03/13/2022-08:32:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:09] [V] [TRT] *************** Autotuning format combination: Half(40,1600,1:8,48000) -> Half(5,200,1:8,6000) *************** [03/13/2022-08:32:09] [V] [TRT] Conv_288 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Conv_288 (FusedConvActConvolution) [03/13/2022-08:32:09] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Conv_288 (CaskConvolution) [03/13/2022-08:32:09] [V] [TRT] Conv_288 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:09] [V] [TRT] Tactic: 9576651994278528 time 0.0869 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: 1179757074518529353 time 0.22136 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: 2105695814191699972 time 0.404472 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: 2148106709480872763 time 0.22078 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: 2410442691266548717 time 0.434196 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: 3041642431972138763 time 0.220972 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: 3754069740140581927 time 0.404296 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: 4555462412611657028 time 0.220764 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: 5666160310350604399 time 0.40446 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:09] [V] [TRT] Tactic: 5876997871499382316 time 0.156568 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: 5925270497649423688 time 0.801556 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: 6680916730816870145 time 0.405444 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: 7158029511300006471 time 0.40466 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: 7859952145590271433 time 0.405352 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: 8283847742354150423 time 0.404636 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: -8992262742606384444 time 0.22102 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: -8391760416076885205 time 0.801708 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: -6273232454637933930 time 0.221976 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:09] [V] [TRT] Tactic: -5925110308892264213 time 0.15624 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: -5818527483287834165 time 0.221464 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:09] [V] [TRT] Tactic: -4908848143422991657 time 0.087516 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: -4534876761957424274 time 0.801132 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: -3237051169894153788 time 0.404936 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: -3136088851200285532 time 0.22108 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: -2586046817576862066 time 0.434168 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: -2422160065350346448 time 0.405304 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: -1216445540764179377 time 0.434488 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Tactic: -229563042944049199 time 0.221096 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 9576651994278528 Time: 0.0869 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Conv_288 (CudaConvolution) [03/13/2022-08:32:09] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Conv_288 (CudaDepthwiseConvolution) [03/13/2022-08:32:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9576651994278528 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:09] [V] [TRT] [03/13/2022-08:32:09] [V] [TRT] Conv_288 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:09] [V] [TRT] Conv_288 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.010284 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.011816 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.010284 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.00616 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.006924 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.00616 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.01218 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.005472 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005472 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.010352 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.005904 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005904 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.011056 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.008828 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.008828 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.011032 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.00856 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00856 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.013724 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.008936 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.008936 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.012184 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.006892 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.006892 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.006232 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.006716 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.006232 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.010388 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.011788 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.010388 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.01218 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.004968 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004968 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.010528 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.005748 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005748 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.011104 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.005052 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005052 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.01042 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.012116 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.01042 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.011024 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.004968 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004968 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.01042 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.005484 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005484 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.0112 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.004588 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004588 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.010276 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.012696 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.010276 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.010924 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.005136 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005136 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.012636 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.005188 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005188 [03/13/2022-08:32:09] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200,39600) -> Float(1,11,440,13200,39600) *************** [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Reshape_290 + Transpose_291 (Shuffle) [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.006804 [03/13/2022-08:32:09] [V] [TRT] Tactic: 1 time 0.011928 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.006804 [03/13/2022-08:32:09] [V] [TRT] *************** Autotuning format combination: Float(1,40,1200:32,2400) -> Float(1,11,440:32,440,1320) *************** [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Reshape_290 + Transpose_291 (Shuffle) [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.012576 [03/13/2022-08:32:09] [V] [TRT] Tactic: 1 time 0.021684 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.012576 [03/13/2022-08:32:09] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200,39600) -> Half(1,11,440,13200,39600) *************** [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Reshape_290 + Transpose_291 (Shuffle) [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.006444 [03/13/2022-08:32:09] [V] [TRT] Tactic: 1 time 0.012404 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.006444 [03/13/2022-08:32:09] [V] [TRT] *************** Autotuning format combination: Half(1,40,1200:2,20400) -> Half(1,11,440:2,6600,19800) *************** [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Reshape_290 + Transpose_291 (Shuffle) [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.00682 [03/13/2022-08:32:09] [V] [TRT] Tactic: 1 time 0.021432 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00682 [03/13/2022-08:32:09] [V] [TRT] *************** Autotuning format combination: Half(5,200,1:8,6000) -> Half(4,44,1:8,1760,5280) *************** [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Reshape_290 + Transpose_291 (Shuffle) [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.014124 [03/13/2022-08:32:09] [V] [TRT] Tactic: 1 time 0.020656 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.014124 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.006132 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.006844 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.006132 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.011152 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.0087 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0087 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.0109 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.008524 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.008524 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.006444 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.0065 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.006444 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.010696 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.005052 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005052 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.01082 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.004896 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004896 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.009264 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.00516 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00516 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.009012 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.005268 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005268 [03/13/2022-08:32:09] [V] [TRT] *************** Autotuning format combination: Float(1,11,440,13200,39600) -> Float(1,11) *************** [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Reshape_293 (Shuffle) [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.004988 [03/13/2022-08:32:09] [V] [TRT] Tactic: 1 time 0.0087 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004988 [03/13/2022-08:32:09] [V] [TRT] *************** Autotuning format combination: Half(1,11,440,13200,39600) -> Half(1,11) *************** [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Reshape_293 (Shuffle) [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.004936 [03/13/2022-08:32:09] [V] [TRT] Tactic: 1 time 0.008976 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004936 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.006736 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.007104 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.006736 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.00654 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.006836 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.00654 [03/13/2022-08:32:09] [V] [TRT] *************** Autotuning format combination: Float(1,11) -> Float(1,11) *************** [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Sigmoid_294 (Activation) [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.006036 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.006036 [03/13/2022-08:32:09] [V] [TRT] *************** Autotuning format combination: Half(1,11) -> Half(1,11) *************** [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Sigmoid_294 (Activation) [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.006064 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.006064 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.006568 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.007096 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.006568 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.006792 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.006892 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.006792 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Slice_325 (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.0084 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.005204 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005204 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Slice_325 (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.009144 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.0048 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0048 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Slice_325 (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.008712 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.005012 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005012 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Slice_325 (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.008716 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.004984 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004984 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Slice_320 (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.032576 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.00478 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00478 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Slice_320 (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.03332 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.005408 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005408 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Slice_320 (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.0332 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.005204 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005204 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Slice_320 (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.033832 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.005144 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005144 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.005288 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.005384 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.005288 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.005212 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.005052 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005052 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.004612 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.004712 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.004612 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.005232 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.004328 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004328 [03/13/2022-08:32:09] [V] [TRT] *************** Autotuning format combination: Float(1,6), Float(1,1) -> Float(1,6) *************** [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Mul_326 (ElementWise) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1 time 0.004944 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 1 Time: 0.004944 [03/13/2022-08:32:09] [V] [TRT] *************** Autotuning format combination: Half(1,6), Half(1,1) -> Half(1,6) *************** [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Mul_326 (ElementWise) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1 time 0.004644 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 1 Time: 0.004644 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Slice_310 (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.032564 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.005168 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005168 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Slice_310 (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.033376 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.005144 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005144 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Slice_310 (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.03344 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.0048 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0048 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Slice_310 (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.033464 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.00498 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00498 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Slice_299 (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.032596 [03/13/2022-08:32:09] [V] [TRT] Tactic: 0 time 0.004824 [03/13/2022-08:32:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004824 [03/13/2022-08:32:09] [V] [TRT] --------------- Timing Runner: Slice_299 (Reformat) [03/13/2022-08:32:09] [V] [TRT] Tactic: 1002 time 0.033488 [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.004868 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 0 Time: 0.004868 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: Slice_299 (Reformat) [03/13/2022-08:32:10] [V] [TRT] Tactic: 1002 time 0.033328 [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.005068 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 0 Time: 0.005068 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: Slice_299 (Reformat) [03/13/2022-08:32:10] [V] [TRT] Tactic: 1002 time 0.033504 [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.004716 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 0 Time: 0.004716 [03/13/2022-08:32:10] [V] [TRT] *************** Autotuning format combination: -> Float(1,1,1,1,3) *************** [03/13/2022-08:32:10] [V] [TRT] *************** Autotuning format combination: -> Half(1,1,1,1,3) *************** [03/13/2022-08:32:10] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,96000) -> Float(1,20,300,192000) *************** [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_330, Mul_331) (PointWise) [03/13/2022-08:32:10] [V] [TRT] Tactic: 128 time 0.013368 [03/13/2022-08:32:10] [V] [TRT] Tactic: 256 time 0.013344 [03/13/2022-08:32:10] [V] [TRT] Tactic: 512 time 0.01444 [03/13/2022-08:32:10] [V] [TRT] Tactic: -32 time 0.02576 [03/13/2022-08:32:10] [V] [TRT] Tactic: -64 time 0.016896 [03/13/2022-08:32:10] [V] [TRT] Tactic: -128 time 0.013908 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 256 Time: 0.013344 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_330, Mul_331) (PointWiseV2) [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.00878 [03/13/2022-08:32:10] [V] [TRT] Tactic: 1 time 0.007816 [03/13/2022-08:32:10] [V] [TRT] Tactic: 2 time 0.006704 [03/13/2022-08:32:10] [V] [TRT] Tactic: 3 time 0.00678 [03/13/2022-08:32:10] [V] [TRT] Tactic: 4 time 0.006804 [03/13/2022-08:32:10] [V] [TRT] Tactic: 5 time 0.006552 [03/13/2022-08:32:10] [V] [TRT] Tactic: 6 time 0.006816 [03/13/2022-08:32:10] [V] [TRT] Tactic: 7 time 0.006404 [03/13/2022-08:32:10] [V] [TRT] Tactic: 8 time 0.00648 [03/13/2022-08:32:10] [V] [TRT] Tactic: 9 time 0.006604 [03/13/2022-08:32:10] [V] [TRT] Tactic: 28 time 0.008824 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 7 Time: 0.006404 [03/13/2022-08:32:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [03/13/2022-08:32:10] [V] [TRT] [03/13/2022-08:32:10] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,3000) -> Float(1,20,300:32,6000) *************** [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_330, Mul_331) (PointWise) [03/13/2022-08:32:10] [V] [TRT] Tactic: 128 time 0.01318 [03/13/2022-08:32:10] [V] [TRT] Tactic: 256 time 0.013504 [03/13/2022-08:32:10] [V] [TRT] Tactic: 512 time 0.014264 [03/13/2022-08:32:10] [V] [TRT] Tactic: -32 time 0.025468 [03/13/2022-08:32:10] [V] [TRT] Tactic: -64 time 0.016556 [03/13/2022-08:32:10] [V] [TRT] Tactic: -128 time 0.013916 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 128 Time: 0.01318 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_330, Mul_331) (PointWiseV2) [03/13/2022-08:32:10] [V] [TRT] Tactic: 24 time 0.007452 [03/13/2022-08:32:10] [V] [TRT] Tactic: 25 time 0.007696 [03/13/2022-08:32:10] [V] [TRT] Tactic: 26 time 0.007072 [03/13/2022-08:32:10] [V] [TRT] Tactic: 27 time 0.008792 [03/13/2022-08:32:10] [V] [TRT] Tactic: 31 time 0.007228 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 26 Time: 0.007072 [03/13/2022-08:32:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [03/13/2022-08:32:10] [V] [TRT] [03/13/2022-08:32:10] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,96000) -> Half(1,20,300,192000) *************** [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_330, Mul_331) (PointWise) [03/13/2022-08:32:10] [V] [TRT] Tactic: 128 time 0.012948 [03/13/2022-08:32:10] [V] [TRT] Tactic: 256 time 0.012656 [03/13/2022-08:32:10] [V] [TRT] Tactic: 512 time 0.012948 [03/13/2022-08:32:10] [V] [TRT] Tactic: -32 time 0.025516 [03/13/2022-08:32:10] [V] [TRT] Tactic: -64 time 0.016648 [03/13/2022-08:32:10] [V] [TRT] Tactic: -128 time 0.0137 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 256 Time: 0.012656 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_330, Mul_331) (PointWiseV2) [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.009068 [03/13/2022-08:32:10] [V] [TRT] Tactic: 1 time 0.007328 [03/13/2022-08:32:10] [V] [TRT] Tactic: 2 time 0.006832 [03/13/2022-08:32:10] [V] [TRT] Tactic: 3 time 0.006776 [03/13/2022-08:32:10] [V] [TRT] Tactic: 4 time 0.006624 [03/13/2022-08:32:10] [V] [TRT] Tactic: 5 time 0.006524 [03/13/2022-08:32:10] [V] [TRT] Tactic: 6 time 0.006776 [03/13/2022-08:32:10] [V] [TRT] Tactic: 7 time 0.006412 [03/13/2022-08:32:10] [V] [TRT] Tactic: 8 time 0.006296 [03/13/2022-08:32:10] [V] [TRT] Tactic: 9 time 0.006272 [03/13/2022-08:32:10] [V] [TRT] Tactic: 28 time 0.008852 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 9 Time: 0.006272 [03/13/2022-08:32:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:32:10] [V] [TRT] [03/13/2022-08:32:10] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,48000) -> Half(1,20,300:2,96000) *************** [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_330, Mul_331) (PointWise) [03/13/2022-08:32:10] [V] [TRT] Tactic: 128 time 0.013056 [03/13/2022-08:32:10] [V] [TRT] Tactic: 256 time 0.01222 [03/13/2022-08:32:10] [V] [TRT] Tactic: 512 time 0.013024 [03/13/2022-08:32:10] [V] [TRT] Tactic: -32 time 0.025408 [03/13/2022-08:32:10] [V] [TRT] Tactic: -64 time 0.01652 [03/13/2022-08:32:10] [V] [TRT] Tactic: -128 time 0.013612 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 256 Time: 0.01222 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_330, Mul_331) (PointWiseV2) [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.006844 [03/13/2022-08:32:10] [V] [TRT] Tactic: 1 time 0.006844 [03/13/2022-08:32:10] [V] [TRT] Tactic: 2 time 0.00696 [03/13/2022-08:32:10] [V] [TRT] Tactic: 3 time 0.006476 [03/13/2022-08:32:10] [V] [TRT] Tactic: 4 time 0.006484 [03/13/2022-08:32:10] [V] [TRT] Tactic: 5 time 0.00668 [03/13/2022-08:32:10] [V] [TRT] Tactic: 6 time 0.007076 [03/13/2022-08:32:10] [V] [TRT] Tactic: 7 time 0.007192 [03/13/2022-08:32:10] [V] [TRT] Tactic: 8 time 0.00706 [03/13/2022-08:32:10] [V] [TRT] Tactic: 9 time 0.007168 [03/13/2022-08:32:10] [V] [TRT] Tactic: 10 time 0.009048 [03/13/2022-08:32:10] [V] [TRT] Tactic: 11 time 0.007788 [03/13/2022-08:32:10] [V] [TRT] Tactic: 12 time 0.0073 [03/13/2022-08:32:10] [V] [TRT] Tactic: 13 time 0.00706 [03/13/2022-08:32:10] [V] [TRT] Tactic: 14 time 0.006424 [03/13/2022-08:32:10] [V] [TRT] Tactic: 15 time 0.006592 [03/13/2022-08:32:10] [V] [TRT] Tactic: 16 time 0.006728 [03/13/2022-08:32:10] [V] [TRT] Tactic: 17 time 0.006432 [03/13/2022-08:32:10] [V] [TRT] Tactic: 18 time 0.006524 [03/13/2022-08:32:10] [V] [TRT] Tactic: 19 time 0.0065 [03/13/2022-08:32:10] [V] [TRT] Tactic: 28 time 0.007208 [03/13/2022-08:32:10] [V] [TRT] Tactic: 29 time 0.008804 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 14 Time: 0.006424 [03/13/2022-08:32:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 14 [03/13/2022-08:32:10] [V] [TRT] [03/13/2022-08:32:10] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Half(80,1600,1:8,24000) *************** [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_330, Mul_331) (PointWise) [03/13/2022-08:32:10] [V] [TRT] Tactic: 128 time 0.016668 [03/13/2022-08:32:10] [V] [TRT] Tactic: 256 time 0.0125 [03/13/2022-08:32:10] [V] [TRT] Tactic: 512 time 0.012788 [03/13/2022-08:32:10] [V] [TRT] Tactic: -32 time 0.018664 [03/13/2022-08:32:10] [V] [TRT] Tactic: -64 time 0.014564 [03/13/2022-08:32:10] [V] [TRT] Tactic: -128 time 0.01502 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 256 Time: 0.0125 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_330, Mul_331) (PointWiseV2) [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.007188 [03/13/2022-08:32:10] [V] [TRT] Tactic: 1 time 0.006816 [03/13/2022-08:32:10] [V] [TRT] Tactic: 2 time 0.007468 [03/13/2022-08:32:10] [V] [TRT] Tactic: 3 time 0.008024 [03/13/2022-08:32:10] [V] [TRT] Tactic: 4 time 0.007872 [03/13/2022-08:32:10] [V] [TRT] Tactic: 5 time 0.007824 [03/13/2022-08:32:10] [V] [TRT] Tactic: 6 time 0.009352 [03/13/2022-08:32:10] [V] [TRT] Tactic: 7 time 0.008696 [03/13/2022-08:32:10] [V] [TRT] Tactic: 8 time 0.00816 [03/13/2022-08:32:10] [V] [TRT] Tactic: 9 time 0.008712 [03/13/2022-08:32:10] [V] [TRT] Tactic: 10 time 0.007256 [03/13/2022-08:32:10] [V] [TRT] Tactic: 11 time 0.006848 [03/13/2022-08:32:10] [V] [TRT] Tactic: 12 time 0.007132 [03/13/2022-08:32:10] [V] [TRT] Tactic: 13 time 0.006732 [03/13/2022-08:32:10] [V] [TRT] Tactic: 14 time 0.006792 [03/13/2022-08:32:10] [V] [TRT] Tactic: 15 time 0.007032 [03/13/2022-08:32:10] [V] [TRT] Tactic: 16 time 0.007908 [03/13/2022-08:32:10] [V] [TRT] Tactic: 17 time 0.007292 [03/13/2022-08:32:10] [V] [TRT] Tactic: 18 time 0.007616 [03/13/2022-08:32:10] [V] [TRT] Tactic: 19 time 0.0073 [03/13/2022-08:32:10] [V] [TRT] Tactic: 20 time 0.007172 [03/13/2022-08:32:10] [V] [TRT] Tactic: 21 time 0.007148 [03/13/2022-08:32:10] [V] [TRT] Tactic: 22 time 0.008076 [03/13/2022-08:32:10] [V] [TRT] Tactic: 23 time 0.006496 [03/13/2022-08:32:10] [V] [TRT] Tactic: 24 time 0.008712 [03/13/2022-08:32:10] [V] [TRT] Tactic: 25 time 0.008008 [03/13/2022-08:32:10] [V] [TRT] Tactic: 26 time 0.007976 [03/13/2022-08:32:10] [V] [TRT] Tactic: 27 time 0.008628 [03/13/2022-08:32:10] [V] [TRT] Tactic: 28 time 0.00666 [03/13/2022-08:32:10] [V] [TRT] Tactic: 29 time 0.006556 [03/13/2022-08:32:10] [V] [TRT] Tactic: 30 time 0.00726 [03/13/2022-08:32:10] [V] [TRT] Tactic: 31 time 0.00898 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 23 Time: 0.006496 [03/13/2022-08:32:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 23 [03/13/2022-08:32:10] [V] [TRT] [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:10] [V] [TRT] Tactic: 1002 time 0.00798 [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.00656 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00656 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:10] [V] [TRT] Tactic: 1002 time 0.013316 [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.02144 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.013316 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:10] [V] [TRT] Tactic: 1002 time 0.00792 [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.008632 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.00792 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:10] [V] [TRT] Tactic: 1002 time 0.016668 [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.007204 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 0 Time: 0.007204 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:10] [V] [TRT] Tactic: 1002 time 0.013288 [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.007036 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 0 Time: 0.007036 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:10] [V] [TRT] Tactic: 1002 time 0.02276 [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.014128 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 0 Time: 0.014128 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:10] [V] [TRT] Tactic: 1002 time 0.016732 [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.006428 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 0 Time: 0.006428 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:10] [V] [TRT] Tactic: 1002 time 0.022992 [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.013592 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 0 Time: 0.013592 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:10] [V] [TRT] Tactic: 1002 time 0.021072 [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.014172 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 0 Time: 0.014172 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:10] [V] [TRT] Tactic: 1002 time 0.016864 [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.010048 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 0 Time: 0.010048 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:10] [V] [TRT] Tactic: 1002 time 0.008024 [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.008828 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.008024 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:10] [V] [TRT] Tactic: 1002 time 0.013204 [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.021532 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.013204 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:10] [V] [TRT] Tactic: 1002 time 0.008036 [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.004652 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 0 Time: 0.004652 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:10] [V] [TRT] Tactic: 1002 time 0.01698 [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.006992 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 0 Time: 0.006992 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:10] [V] [TRT] Tactic: 1002 time 0.013304 [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.007284 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 0 Time: 0.007284 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:10] [V] [TRT] Tactic: 1002 time 0.0233 [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.009156 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 0 Time: 0.009156 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:10] [V] [TRT] Tactic: 1002 time 0.01308 [03/13/2022-08:32:10] [V] [TRT] Tactic: 0 time 0.021832 [03/13/2022-08:32:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.01308 [03/13/2022-08:32:10] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:10] [V] [TRT] Tactic: 1002 time 0.023536 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.008696 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.008696 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.016808 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.004904 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.004904 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.013196 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.006088 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.006088 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.012612 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.01428 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.012612 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.016868 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.027296 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.016868 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.012736 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.014116 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.012736 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.02146 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.006448 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.006448 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.0196 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.006936 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.006936 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 778 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.00804 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.006356 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.006356 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 778 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.008072 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.008768 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.008072 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 778 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.016824 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.008752 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.008752 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 778 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.016532 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.015116 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.015116 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 778 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.029548 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.017032 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.017032 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 778 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.02952 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.016828 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.016828 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 778 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.0267 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.017432 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.017432 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 778 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.021256 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.012512 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.012512 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 778 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.009432 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.010268 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.009432 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 778 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.00948 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.006456 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.006456 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 778 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.021376 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.008216 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.008216 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 778 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.016648 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.008336 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.008336 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 778 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.029516 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.011492 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.011492 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 778 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.029624 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.010592 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.010592 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 778 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.020932 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.006248 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.006248 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 778 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.016312 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.00714 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00714 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 778 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.01516 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.017756 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.01516 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 778 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.01546 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.01726 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.01546 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 778 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.027144 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.007076 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.007076 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 778 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.024356 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.008644 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.008644 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.00956 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.00722 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00722 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.008848 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.010308 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.008848 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.021076 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.008416 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.008416 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.016336 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.009068 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.009068 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.02928 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.017088 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.017088 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.028528 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.017108 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.017108 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.026596 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.01742 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.01742 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.021 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.013044 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.013044 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.009532 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.01046 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.009532 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.009344 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.006228 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.006228 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.021268 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.008224 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.008224 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.01654 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.00832 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00832 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.029592 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.01082 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.01082 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.02928 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.010956 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.010956 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.02104 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.006212 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.006212 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.016452 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.006412 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.006412 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.015192 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.017896 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.015192 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.015484 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.017236 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.015484 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.027376 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.00738 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00738 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: 597 copy (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.0242 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.008536 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.008536 [03/13/2022-08:32:11] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,192000) -> Float(1,20,300,192000) *************** [03/13/2022-08:32:11] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,192000) -> Half(1,20,300,192000) *************** [03/13/2022-08:32:11] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300,192000) *************** [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Conv_408 || Conv_396 (FusedConvActConvolution) [03/13/2022-08:32:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Conv_408 || Conv_396 (CaskConvolution) [03/13/2022-08:32:11] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Conv_408 || Conv_396 (CudaConvolution) [03/13/2022-08:32:11] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Conv_408 || Conv_396 (CudaDepthwiseConvolution) [03/13/2022-08:32:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:11] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300:2,96000) *************** [03/13/2022-08:32:11] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Float(1,20,300,192000) *************** [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Conv_408 || Conv_396 (FusedConvActConvolution) [03/13/2022-08:32:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Conv_408 || Conv_396 (CaskConvolution) [03/13/2022-08:32:11] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Conv_408 || Conv_396 (CudaConvolution) [03/13/2022-08:32:11] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Conv_408 || Conv_396 (CudaDepthwiseConvolution) [03/13/2022-08:32:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:11] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Half(80,1600,1:8,24000) *************** [03/13/2022-08:32:11] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,192000) -> Float(1,20,300,192000) *************** [03/13/2022-08:32:11] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,192000) -> Half(1,20,300,192000) *************** [03/13/2022-08:32:11] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300,192000) *************** [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Conv_345 || Conv_333 (FusedConvActConvolution) [03/13/2022-08:32:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Conv_345 || Conv_333 (CaskConvolution) [03/13/2022-08:32:11] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Conv_345 || Conv_333 (CudaConvolution) [03/13/2022-08:32:11] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Conv_345 || Conv_333 (CudaDepthwiseConvolution) [03/13/2022-08:32:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:11] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300:2,96000) *************** [03/13/2022-08:32:11] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Float(1,20,300,192000) *************** [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Conv_345 || Conv_333 (FusedConvActConvolution) [03/13/2022-08:32:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Conv_345 || Conv_333 (CaskConvolution) [03/13/2022-08:32:11] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Conv_345 || Conv_333 (CudaConvolution) [03/13/2022-08:32:11] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Conv_345 || Conv_333 (CudaDepthwiseConvolution) [03/13/2022-08:32:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:11] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Half(80,1600,1:8,24000) *************** [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.009088 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.006204 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.006204 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.006692 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.005568 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.005568 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.009196 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.005444 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.005444 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.009144 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.0057 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0057 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.008236 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.005876 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.005876 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.00828 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.006084 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.006084 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.009512 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.005948 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.005948 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.00894 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.005904 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.005904 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.006392 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.005008 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.005008 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.009216 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.006096 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.006096 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.009292 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.005388 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.005388 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.00928 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.0059 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0059 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.008232 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.005052 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.005052 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.008812 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.00638 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00638 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.008328 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.005324 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.005324 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.009004 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.005232 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.005232 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.008968 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.004676 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.004676 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.008572 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.00654 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00654 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.009448 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.004968 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.004968 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1002 time 0.008788 [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.005044 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.005044 [03/13/2022-08:32:11] [V] [TRT] *************** Autotuning format combination: Float(1,1,40,1200,3600), Float(1,1,1,1,3) -> Float(1,1,40,1200,3600) *************** [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Mul_452 (ElementWise) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1 time 0.00572 [03/13/2022-08:32:11] [V] [TRT] Tactic: 2 time 0.008804 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 1 Time: 0.00572 [03/13/2022-08:32:11] [V] [TRT] *************** Autotuning format combination: Float(1,1,40:32,40,120), Float(1,1,1:32,1,3) -> Float(1,1,40:32,40,120) *************** [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Mul_452 (ElementWise) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1 time 0.005552 [03/13/2022-08:32:11] [V] [TRT] Tactic: 2 time 0.009264 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 1 Time: 0.005552 [03/13/2022-08:32:11] [V] [TRT] *************** Autotuning format combination: Half(1,1,40,1200,3600), Half(1,1,1,1,3) -> Half(1,1,40,1200,3600) *************** [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Mul_452 (ElementWise) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1 time 0.005292 [03/13/2022-08:32:11] [V] [TRT] Tactic: 2 time 0.006716 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 1 Time: 0.005292 [03/13/2022-08:32:11] [V] [TRT] *************** Autotuning format combination: Half(1,1,40:2,600,1800), Half(1,1,1:2,1,3) -> Half(1,1,40:2,600,1800) *************** [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Mul_452 (ElementWise) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1 time 0.005356 [03/13/2022-08:32:11] [V] [TRT] Tactic: 2 time 0.007376 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 1 Time: 0.005356 [03/13/2022-08:32:11] [V] [TRT] *************** Autotuning format combination: Half(4,4,1:8,160,480), Half(1,1,1:8,1,3) -> Half(4,4,1:8,160,480) *************** [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Mul_452 (ElementWise) [03/13/2022-08:32:11] [V] [TRT] Tactic: 1 time 0.005396 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 1 Time: 0.005396 [03/13/2022-08:32:11] [V] [TRT] *************** Autotuning format combination: Float(1,1,40,1200,3600) -> Float(1,1) *************** [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Reshape_454 (Shuffle) [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.004548 [03/13/2022-08:32:11] [V] [TRT] Tactic: 1 time 0.009048 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.004548 [03/13/2022-08:32:11] [V] [TRT] *************** Autotuning format combination: Half(1,1,40,1200,3600) -> Half(1,1) *************** [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: Reshape_454 (Shuffle) [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.005008 [03/13/2022-08:32:11] [V] [TRT] Tactic: 1 time 0.008876 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 0 Time: 0.005008 [03/13/2022-08:32:11] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,192000) -> Float(1,20,300,96000) *************** [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_398, Mul_399) (PointWise) [03/13/2022-08:32:11] [V] [TRT] Tactic: 128 time 0.01644 [03/13/2022-08:32:11] [V] [TRT] Tactic: 256 time 0.016604 [03/13/2022-08:32:11] [V] [TRT] Tactic: 512 time 0.017592 [03/13/2022-08:32:11] [V] [TRT] Tactic: -32 time 0.032552 [03/13/2022-08:32:11] [V] [TRT] Tactic: -64 time 0.020992 [03/13/2022-08:32:11] [V] [TRT] Tactic: -128 time 0.017144 [03/13/2022-08:32:11] [V] [TRT] Fastest Tactic: 128 Time: 0.01644 [03/13/2022-08:32:11] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_398, Mul_399) (PointWiseV2) [03/13/2022-08:32:11] [V] [TRT] Tactic: 0 time 0.010412 [03/13/2022-08:32:12] [V] [TRT] Tactic: 1 time 0.009116 [03/13/2022-08:32:12] [V] [TRT] Tactic: 2 time 0.008536 [03/13/2022-08:32:12] [V] [TRT] Tactic: 3 time 0.00824 [03/13/2022-08:32:12] [V] [TRT] Tactic: 4 time 0.007972 [03/13/2022-08:32:12] [V] [TRT] Tactic: 5 time 0.007916 [03/13/2022-08:32:12] [V] [TRT] Tactic: 6 time 0.008068 [03/13/2022-08:32:12] [V] [TRT] Tactic: 7 time 0.007328 [03/13/2022-08:32:12] [V] [TRT] Tactic: 8 time 0.007096 [03/13/2022-08:32:12] [V] [TRT] Tactic: 9 time 0.007764 [03/13/2022-08:32:12] [V] [TRT] Tactic: 28 time 0.010636 [03/13/2022-08:32:12] [V] [TRT] Fastest Tactic: 8 Time: 0.007096 [03/13/2022-08:32:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:32:12] [V] [TRT] [03/13/2022-08:32:12] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,6000) -> Float(1,20,300:32,3000) *************** [03/13/2022-08:32:12] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_398, Mul_399) (PointWise) [03/13/2022-08:32:12] [V] [TRT] Tactic: 128 time 0.01666 [03/13/2022-08:32:12] [V] [TRT] Tactic: 256 time 0.01672 [03/13/2022-08:32:12] [V] [TRT] Tactic: 512 time 0.017328 [03/13/2022-08:32:12] [V] [TRT] Tactic: -32 time 0.03244 [03/13/2022-08:32:12] [V] [TRT] Tactic: -64 time 0.020636 [03/13/2022-08:32:12] [V] [TRT] Tactic: -128 time 0.016784 [03/13/2022-08:32:12] [V] [TRT] Fastest Tactic: 128 Time: 0.01666 [03/13/2022-08:32:12] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_398, Mul_399) (PointWiseV2) [03/13/2022-08:32:12] [V] [TRT] Tactic: 24 time 0.009124 [03/13/2022-08:32:12] [V] [TRT] Tactic: 25 time 0.008904 [03/13/2022-08:32:12] [V] [TRT] Tactic: 26 time 0.008824 [03/13/2022-08:32:12] [V] [TRT] Tactic: 27 time 0.010776 [03/13/2022-08:32:12] [V] [TRT] Tactic: 31 time 0.009128 [03/13/2022-08:32:12] [V] [TRT] Fastest Tactic: 26 Time: 0.008824 [03/13/2022-08:32:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [03/13/2022-08:32:12] [V] [TRT] [03/13/2022-08:32:12] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,192000) -> Half(1,20,300,96000) *************** [03/13/2022-08:32:12] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_398, Mul_399) (PointWise) [03/13/2022-08:32:12] [V] [TRT] Tactic: 128 time 0.016076 [03/13/2022-08:32:12] [V] [TRT] Tactic: 256 time 0.015084 [03/13/2022-08:32:12] [V] [TRT] Tactic: 512 time 0.016356 [03/13/2022-08:32:12] [V] [TRT] Tactic: -32 time 0.032496 [03/13/2022-08:32:12] [V] [TRT] Tactic: -64 time 0.0207 [03/13/2022-08:32:12] [V] [TRT] Tactic: -128 time 0.016704 [03/13/2022-08:32:12] [V] [TRT] Fastest Tactic: 256 Time: 0.015084 [03/13/2022-08:32:12] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_398, Mul_399) (PointWiseV2) [03/13/2022-08:32:12] [V] [TRT] Tactic: 0 time 0.010924 [03/13/2022-08:32:12] [V] [TRT] Tactic: 1 time 0.009376 [03/13/2022-08:32:12] [V] [TRT] Tactic: 2 time 0.008548 [03/13/2022-08:32:12] [V] [TRT] Tactic: 3 time 0.008192 [03/13/2022-08:32:12] [V] [TRT] Tactic: 4 time 0.008028 [03/13/2022-08:32:12] [V] [TRT] Tactic: 5 time 0.00756 [03/13/2022-08:32:12] [V] [TRT] Tactic: 6 time 0.007788 [03/13/2022-08:32:12] [V] [TRT] Tactic: 7 time 0.007416 [03/13/2022-08:32:12] [V] [TRT] Tactic: 8 time 0.007068 [03/13/2022-08:32:12] [V] [TRT] Tactic: 9 time 0.006952 [03/13/2022-08:32:12] [V] [TRT] Tactic: 28 time 0.010464 [03/13/2022-08:32:12] [V] [TRT] Fastest Tactic: 9 Time: 0.006952 [03/13/2022-08:32:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:32:12] [V] [TRT] [03/13/2022-08:32:12] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300:2,48000) *************** [03/13/2022-08:32:12] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_398, Mul_399) (PointWise) [03/13/2022-08:32:12] [V] [TRT] Tactic: 128 time 0.016232 [03/13/2022-08:32:12] [V] [TRT] Tactic: 256 time 0.015156 [03/13/2022-08:32:12] [V] [TRT] Tactic: 512 time 0.016172 [03/13/2022-08:32:12] [V] [TRT] Tactic: -32 time 0.032464 [03/13/2022-08:32:12] [V] [TRT] Tactic: -64 time 0.020632 [03/13/2022-08:32:12] [V] [TRT] Tactic: -128 time 0.016824 [03/13/2022-08:32:12] [V] [TRT] Fastest Tactic: 256 Time: 0.015156 [03/13/2022-08:32:12] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_398, Mul_399) (PointWiseV2) [03/13/2022-08:32:12] [V] [TRT] Tactic: 0 time 0.009224 [03/13/2022-08:32:12] [V] [TRT] Tactic: 1 time 0.00792 [03/13/2022-08:32:12] [V] [TRT] Tactic: 2 time 0.007984 [03/13/2022-08:32:12] [V] [TRT] Tactic: 3 time 0.007316 [03/13/2022-08:32:12] [V] [TRT] Tactic: 4 time 0.007704 [03/13/2022-08:32:12] [V] [TRT] Tactic: 5 time 0.008008 [03/13/2022-08:32:12] [V] [TRT] Tactic: 6 time 0.009016 [03/13/2022-08:32:12] [V] [TRT] Tactic: 7 time 0.008736 [03/13/2022-08:32:12] [V] [TRT] Tactic: 8 time 0.008832 [03/13/2022-08:32:12] [V] [TRT] Tactic: 9 time 0.008972 [03/13/2022-08:32:12] [V] [TRT] Tactic: 10 time 0.011304 [03/13/2022-08:32:12] [V] [TRT] Tactic: 11 time 0.009768 [03/13/2022-08:32:12] [V] [TRT] Tactic: 12 time 0.009108 [03/13/2022-08:32:12] [V] [TRT] Tactic: 13 time 0.008252 [03/13/2022-08:32:12] [V] [TRT] Tactic: 14 time 0.008096 [03/13/2022-08:32:12] [V] [TRT] Tactic: 15 time 0.007944 [03/13/2022-08:32:12] [V] [TRT] Tactic: 16 time 0.00798 [03/13/2022-08:32:12] [V] [TRT] Tactic: 17 time 0.007668 [03/13/2022-08:32:12] [V] [TRT] Tactic: 18 time 0.007072 [03/13/2022-08:32:12] [V] [TRT] Tactic: 19 time 0.007564 [03/13/2022-08:32:12] [V] [TRT] Tactic: 28 time 0.00944 [03/13/2022-08:32:12] [V] [TRT] Tactic: 29 time 0.011164 [03/13/2022-08:32:12] [V] [TRT] Fastest Tactic: 18 Time: 0.007072 [03/13/2022-08:32:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:32:12] [V] [TRT] [03/13/2022-08:32:12] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Half(40,800,1:8,12000) *************** [03/13/2022-08:32:12] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_398, Mul_399) (PointWise) [03/13/2022-08:32:12] [V] [TRT] Tactic: 128 time 0.01608 [03/13/2022-08:32:12] [V] [TRT] Tactic: 256 time 0.014872 [03/13/2022-08:32:12] [V] [TRT] Tactic: 512 time 0.016184 [03/13/2022-08:32:12] [V] [TRT] Tactic: -32 time 0.02326 [03/13/2022-08:32:12] [V] [TRT] Tactic: -64 time 0.0184 [03/13/2022-08:32:12] [V] [TRT] Tactic: -128 time 0.01918 [03/13/2022-08:32:12] [V] [TRT] Fastest Tactic: 256 Time: 0.014872 [03/13/2022-08:32:12] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_398, Mul_399) (PointWiseV2) [03/13/2022-08:32:12] [V] [TRT] Tactic: 0 time 0.009132 [03/13/2022-08:32:12] [V] [TRT] Tactic: 1 time 0.008804 [03/13/2022-08:32:12] [V] [TRT] Tactic: 2 time 0.00918 [03/13/2022-08:32:12] [V] [TRT] Tactic: 3 time 0.009276 [03/13/2022-08:32:12] [V] [TRT] Tactic: 4 time 0.009648 [03/13/2022-08:32:12] [V] [TRT] Tactic: 5 time 0.00932 [03/13/2022-08:32:12] [V] [TRT] Tactic: 6 time 0.011496 [03/13/2022-08:32:12] [V] [TRT] Tactic: 7 time 0.010312 [03/13/2022-08:32:12] [V] [TRT] Tactic: 8 time 0.010036 [03/13/2022-08:32:12] [V] [TRT] Tactic: 9 time 0.010196 [03/13/2022-08:32:12] [V] [TRT] Tactic: 10 time 0.00888 [03/13/2022-08:32:12] [V] [TRT] Tactic: 11 time 0.009336 [03/13/2022-08:32:12] [V] [TRT] Tactic: 12 time 0.009208 [03/13/2022-08:32:12] [V] [TRT] Tactic: 13 time 0.008124 [03/13/2022-08:32:12] [V] [TRT] Tactic: 14 time 0.008192 [03/13/2022-08:32:12] [V] [TRT] Tactic: 15 time 0.008164 [03/13/2022-08:32:12] [V] [TRT] Tactic: 16 time 0.009288 [03/13/2022-08:32:12] [V] [TRT] Tactic: 17 time 0.008808 [03/13/2022-08:32:12] [V] [TRT] Tactic: 18 time 0.00958 [03/13/2022-08:32:12] [V] [TRT] Tactic: 19 time 0.008752 [03/13/2022-08:32:12] [V] [TRT] Tactic: 20 time 0.008936 [03/13/2022-08:32:12] [V] [TRT] Tactic: 21 time 0.00944 [03/13/2022-08:32:12] [V] [TRT] Tactic: 22 time 0.009248 [03/13/2022-08:32:12] [V] [TRT] Tactic: 23 time 0.008108 [03/13/2022-08:32:12] [V] [TRT] Tactic: 24 time 0.011536 [03/13/2022-08:32:12] [V] [TRT] Tactic: 25 time 0.009612 [03/13/2022-08:32:12] [V] [TRT] Tactic: 26 time 0.009316 [03/13/2022-08:32:12] [V] [TRT] Tactic: 27 time 0.010116 [03/13/2022-08:32:12] [V] [TRT] Tactic: 28 time 0.007528 [03/13/2022-08:32:12] [V] [TRT] Tactic: 29 time 0.007956 [03/13/2022-08:32:12] [V] [TRT] Tactic: 30 time 0.0092 [03/13/2022-08:32:12] [V] [TRT] Tactic: 31 time 0.010988 [03/13/2022-08:32:12] [V] [TRT] Fastest Tactic: 28 Time: 0.007528 [03/13/2022-08:32:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [03/13/2022-08:32:12] [V] [TRT] [03/13/2022-08:32:12] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,192000) -> Float(1,20,300,96000) *************** [03/13/2022-08:32:12] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_335, Mul_336) (PointWise) [03/13/2022-08:32:12] [V] [TRT] Tactic: 128 time 0.016448 [03/13/2022-08:32:12] [V] [TRT] Tactic: 256 time 0.01648 [03/13/2022-08:32:12] [V] [TRT] Tactic: 512 time 0.017452 [03/13/2022-08:32:12] [V] [TRT] Tactic: -32 time 0.032516 [03/13/2022-08:32:12] [V] [TRT] Tactic: -64 time 0.0209 [03/13/2022-08:32:12] [V] [TRT] Tactic: -128 time 0.016988 [03/13/2022-08:32:12] [V] [TRT] Fastest Tactic: 128 Time: 0.016448 [03/13/2022-08:32:12] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_335, Mul_336) (PointWiseV2) [03/13/2022-08:32:12] [V] [TRT] Tactic: 0 time 0.010588 [03/13/2022-08:32:12] [V] [TRT] Tactic: 1 time 0.009448 [03/13/2022-08:32:12] [V] [TRT] Tactic: 2 time 0.0087 [03/13/2022-08:32:12] [V] [TRT] Tactic: 3 time 0.0082 [03/13/2022-08:32:12] [V] [TRT] Tactic: 4 time 0.00796 [03/13/2022-08:32:12] [V] [TRT] Tactic: 5 time 0.00774 [03/13/2022-08:32:12] [V] [TRT] Tactic: 6 time 0.007972 [03/13/2022-08:32:12] [V] [TRT] Tactic: 7 time 0.00728 [03/13/2022-08:32:12] [V] [TRT] Tactic: 8 time 0.007608 [03/13/2022-08:32:12] [V] [TRT] Tactic: 9 time 0.007572 [03/13/2022-08:32:12] [V] [TRT] Tactic: 28 time 0.010672 [03/13/2022-08:32:12] [V] [TRT] Fastest Tactic: 7 Time: 0.00728 [03/13/2022-08:32:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [03/13/2022-08:32:12] [V] [TRT] [03/13/2022-08:32:12] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,6000) -> Float(1,20,300:32,3000) *************** [03/13/2022-08:32:12] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_335, Mul_336) (PointWise) [03/13/2022-08:32:12] [V] [TRT] Tactic: 128 time 0.01646 [03/13/2022-08:32:12] [V] [TRT] Tactic: 256 time 0.01648 [03/13/2022-08:32:12] [V] [TRT] Tactic: 512 time 0.017276 [03/13/2022-08:32:12] [V] [TRT] Tactic: -32 time 0.03254 [03/13/2022-08:32:12] [V] [TRT] Tactic: -64 time 0.020992 [03/13/2022-08:32:12] [V] [TRT] Tactic: -128 time 0.016888 [03/13/2022-08:32:12] [V] [TRT] Fastest Tactic: 128 Time: 0.01646 [03/13/2022-08:32:12] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_335, Mul_336) (PointWiseV2) [03/13/2022-08:32:12] [V] [TRT] Tactic: 24 time 0.009072 [03/13/2022-08:32:12] [V] [TRT] Tactic: 25 time 0.00902 [03/13/2022-08:32:12] [V] [TRT] Tactic: 26 time 0.008892 [03/13/2022-08:32:12] [V] [TRT] Tactic: 27 time 0.01088 [03/13/2022-08:32:12] [V] [TRT] Tactic: 31 time 0.009072 [03/13/2022-08:32:12] [V] [TRT] Fastest Tactic: 26 Time: 0.008892 [03/13/2022-08:32:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [03/13/2022-08:32:12] [V] [TRT] [03/13/2022-08:32:12] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,192000) -> Half(1,20,300,96000) *************** [03/13/2022-08:32:12] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_335, Mul_336) (PointWise) [03/13/2022-08:32:12] [V] [TRT] Tactic: 128 time 0.016156 [03/13/2022-08:32:12] [V] [TRT] Tactic: 256 time 0.014864 [03/13/2022-08:32:12] [V] [TRT] Tactic: 512 time 0.016156 [03/13/2022-08:32:12] [V] [TRT] Tactic: -32 time 0.03248 [03/13/2022-08:32:12] [V] [TRT] Tactic: -64 time 0.020824 [03/13/2022-08:32:12] [V] [TRT] Tactic: -128 time 0.016968 [03/13/2022-08:32:12] [V] [TRT] Fastest Tactic: 256 Time: 0.014864 [03/13/2022-08:32:12] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_335, Mul_336) (PointWiseV2) [03/13/2022-08:32:12] [V] [TRT] Tactic: 0 time 0.010708 [03/13/2022-08:32:12] [V] [TRT] Tactic: 1 time 0.009432 [03/13/2022-08:32:12] [V] [TRT] Tactic: 2 time 0.008656 [03/13/2022-08:32:12] [V] [TRT] Tactic: 3 time 0.008196 [03/13/2022-08:32:12] [V] [TRT] Tactic: 4 time 0.008076 [03/13/2022-08:32:12] [V] [TRT] Tactic: 5 time 0.0078 [03/13/2022-08:32:12] [V] [TRT] Tactic: 6 time 0.008036 [03/13/2022-08:32:12] [V] [TRT] Tactic: 7 time 0.006916 [03/13/2022-08:32:12] [V] [TRT] Tactic: 8 time 0.006964 [03/13/2022-08:32:12] [V] [TRT] Tactic: 9 time 0.006824 [03/13/2022-08:32:12] [V] [TRT] Tactic: 28 time 0.010752 [03/13/2022-08:32:12] [V] [TRT] Fastest Tactic: 9 Time: 0.006824 [03/13/2022-08:32:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:32:12] [V] [TRT] [03/13/2022-08:32:12] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300:2,48000) *************** [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_335, Mul_336) (PointWise) [03/13/2022-08:32:13] [V] [TRT] Tactic: 128 time 0.016112 [03/13/2022-08:32:13] [V] [TRT] Tactic: 256 time 0.01456 [03/13/2022-08:32:13] [V] [TRT] Tactic: 512 time 0.016036 [03/13/2022-08:32:13] [V] [TRT] Tactic: -32 time 0.032516 [03/13/2022-08:32:13] [V] [TRT] Tactic: -64 time 0.02094 [03/13/2022-08:32:13] [V] [TRT] Tactic: -128 time 0.01682 [03/13/2022-08:32:13] [V] [TRT] Fastest Tactic: 256 Time: 0.01456 [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_335, Mul_336) (PointWiseV2) [03/13/2022-08:32:13] [V] [TRT] Tactic: 0 time 0.009092 [03/13/2022-08:32:13] [V] [TRT] Tactic: 1 time 0.008032 [03/13/2022-08:32:13] [V] [TRT] Tactic: 2 time 0.00802 [03/13/2022-08:32:13] [V] [TRT] Tactic: 3 time 0.007528 [03/13/2022-08:32:13] [V] [TRT] Tactic: 4 time 0.007736 [03/13/2022-08:32:13] [V] [TRT] Tactic: 5 time 0.007912 [03/13/2022-08:32:13] [V] [TRT] Tactic: 6 time 0.009068 [03/13/2022-08:32:13] [V] [TRT] Tactic: 7 time 0.00876 [03/13/2022-08:32:13] [V] [TRT] Tactic: 8 time 0.009088 [03/13/2022-08:32:13] [V] [TRT] Tactic: 9 time 0.009256 [03/13/2022-08:32:13] [V] [TRT] Tactic: 10 time 0.010836 [03/13/2022-08:32:13] [V] [TRT] Tactic: 11 time 0.009504 [03/13/2022-08:32:13] [V] [TRT] Tactic: 12 time 0.009368 [03/13/2022-08:32:13] [V] [TRT] Tactic: 13 time 0.008264 [03/13/2022-08:32:13] [V] [TRT] Tactic: 14 time 0.008016 [03/13/2022-08:32:13] [V] [TRT] Tactic: 15 time 0.007816 [03/13/2022-08:32:13] [V] [TRT] Tactic: 16 time 0.007912 [03/13/2022-08:32:13] [V] [TRT] Tactic: 17 time 0.007364 [03/13/2022-08:32:13] [V] [TRT] Tactic: 18 time 0.007064 [03/13/2022-08:32:13] [V] [TRT] Tactic: 19 time 0.007652 [03/13/2022-08:32:13] [V] [TRT] Tactic: 28 time 0.008904 [03/13/2022-08:32:13] [V] [TRT] Tactic: 29 time 0.010796 [03/13/2022-08:32:13] [V] [TRT] Fastest Tactic: 18 Time: 0.007064 [03/13/2022-08:32:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:32:13] [V] [TRT] [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Half(40,800,1:8,12000) *************** [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_335, Mul_336) (PointWise) [03/13/2022-08:32:13] [V] [TRT] Tactic: 128 time 0.016136 [03/13/2022-08:32:13] [V] [TRT] Tactic: 256 time 0.014896 [03/13/2022-08:32:13] [V] [TRT] Tactic: 512 time 0.01602 [03/13/2022-08:32:13] [V] [TRT] Tactic: -32 time 0.02312 [03/13/2022-08:32:13] [V] [TRT] Tactic: -64 time 0.018092 [03/13/2022-08:32:13] [V] [TRT] Tactic: -128 time 0.018932 [03/13/2022-08:32:13] [V] [TRT] Fastest Tactic: 256 Time: 0.014896 [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_335, Mul_336) (PointWiseV2) [03/13/2022-08:32:13] [V] [TRT] Tactic: 0 time 0.008912 [03/13/2022-08:32:13] [V] [TRT] Tactic: 1 time 0.008516 [03/13/2022-08:32:13] [V] [TRT] Tactic: 2 time 0.008812 [03/13/2022-08:32:13] [V] [TRT] Tactic: 3 time 0.009504 [03/13/2022-08:32:13] [V] [TRT] Tactic: 4 time 0.009476 [03/13/2022-08:32:13] [V] [TRT] Tactic: 5 time 0.009548 [03/13/2022-08:32:13] [V] [TRT] Tactic: 6 time 0.011044 [03/13/2022-08:32:13] [V] [TRT] Tactic: 7 time 0.010476 [03/13/2022-08:32:13] [V] [TRT] Tactic: 8 time 0.01006 [03/13/2022-08:32:13] [V] [TRT] Tactic: 9 time 0.010324 [03/13/2022-08:32:13] [V] [TRT] Tactic: 10 time 0.008528 [03/13/2022-08:32:13] [V] [TRT] Tactic: 11 time 0.008824 [03/13/2022-08:32:13] [V] [TRT] Tactic: 12 time 0.009072 [03/13/2022-08:32:13] [V] [TRT] Tactic: 13 time 0.00822 [03/13/2022-08:32:13] [V] [TRT] Tactic: 14 time 0.00822 [03/13/2022-08:32:13] [V] [TRT] Tactic: 15 time 0.0082 [03/13/2022-08:32:13] [V] [TRT] Tactic: 16 time 0.008472 [03/13/2022-08:32:13] [V] [TRT] Tactic: 17 time 0.0087 [03/13/2022-08:32:13] [V] [TRT] Tactic: 18 time 0.008812 [03/13/2022-08:32:13] [V] [TRT] Tactic: 19 time 0.008524 [03/13/2022-08:32:13] [V] [TRT] Tactic: 20 time 0.009192 [03/13/2022-08:32:13] [V] [TRT] Tactic: 21 time 0.008688 [03/13/2022-08:32:13] [V] [TRT] Tactic: 22 time 0.008848 [03/13/2022-08:32:13] [V] [TRT] Tactic: 23 time 0.008244 [03/13/2022-08:32:13] [V] [TRT] Tactic: 24 time 0.010916 [03/13/2022-08:32:13] [V] [TRT] Tactic: 25 time 0.009008 [03/13/2022-08:32:13] [V] [TRT] Tactic: 26 time 0.009036 [03/13/2022-08:32:13] [V] [TRT] Tactic: 27 time 0.01012 [03/13/2022-08:32:13] [V] [TRT] Tactic: 28 time 0.007132 [03/13/2022-08:32:13] [V] [TRT] Tactic: 29 time 0.007876 [03/13/2022-08:32:13] [V] [TRT] Tactic: 30 time 0.008932 [03/13/2022-08:32:13] [V] [TRT] Tactic: 31 time 0.010796 [03/13/2022-08:32:13] [V] [TRT] Fastest Tactic: 28 Time: 0.007132 [03/13/2022-08:32:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [03/13/2022-08:32:13] [V] [TRT] [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,96000) -> Float(1,20,300,96000) *************** [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,96000) -> Half(1,20,300,96000) *************** [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,48000) -> Half(1,20,300,96000) *************** [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: Conv_337 (FusedConvActConvolution) [03/13/2022-08:32:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: Conv_337 (CaskConvolution) [03/13/2022-08:32:13] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: Conv_337 (CudaConvolution) [03/13/2022-08:32:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: Conv_337 (CudaDepthwiseConvolution) [03/13/2022-08:32:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,48000) -> Half(1,20,300:2,48000) *************** [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Float(1,20,300,96000) *************** [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: Conv_337 (FusedConvActConvolution) [03/13/2022-08:32:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: Conv_337 (CaskConvolution) [03/13/2022-08:32:13] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: Conv_337 (CudaConvolution) [03/13/2022-08:32:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: Conv_337 (CudaDepthwiseConvolution) [03/13/2022-08:32:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Half(40,800,1:8,12000) *************** [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,96000) -> Float(1,20,300,96000) *************** [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,96000) -> Half(1,20,300,96000) *************** [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,48000) -> Half(1,20,300,96000) *************** [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: Conv_400 (FusedConvActConvolution) [03/13/2022-08:32:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: Conv_400 (CaskConvolution) [03/13/2022-08:32:13] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: Conv_400 (CudaConvolution) [03/13/2022-08:32:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: Conv_400 (CudaDepthwiseConvolution) [03/13/2022-08:32:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,48000) -> Half(1,20,300:2,48000) *************** [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Float(1,20,300,96000) *************** [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: Conv_400 (FusedConvActConvolution) [03/13/2022-08:32:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: Conv_400 (CaskConvolution) [03/13/2022-08:32:13] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: Conv_400 (CudaConvolution) [03/13/2022-08:32:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: Conv_400 (CudaDepthwiseConvolution) [03/13/2022-08:32:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Half(40,800,1:8,12000) *************** [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: -> Float(1,2) *************** [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: -> Half(1,2) *************** [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: -> Float(1,2) *************** [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: -> Half(1,2) *************** [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,96000) -> Float(1,20,300,96000) *************** [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_339, Mul_340) (PointWise) [03/13/2022-08:32:13] [V] [TRT] Tactic: 128 time 0.017096 [03/13/2022-08:32:13] [V] [TRT] Tactic: 256 time 0.01452 [03/13/2022-08:32:13] [V] [TRT] Tactic: 512 time 0.014772 [03/13/2022-08:32:13] [V] [TRT] Tactic: -32 time 0.032488 [03/13/2022-08:32:13] [V] [TRT] Tactic: -64 time 0.020528 [03/13/2022-08:32:13] [V] [TRT] Tactic: -128 time 0.016732 [03/13/2022-08:32:13] [V] [TRT] Fastest Tactic: 256 Time: 0.01452 [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_339, Mul_340) (PointWiseV2) [03/13/2022-08:32:13] [V] [TRT] Tactic: 0 time 0.010044 [03/13/2022-08:32:13] [V] [TRT] Tactic: 1 time 0.00864 [03/13/2022-08:32:13] [V] [TRT] Tactic: 2 time 0.008076 [03/13/2022-08:32:13] [V] [TRT] Tactic: 3 time 0.00804 [03/13/2022-08:32:13] [V] [TRT] Tactic: 4 time 0.007392 [03/13/2022-08:32:13] [V] [TRT] Tactic: 5 time 0.00714 [03/13/2022-08:32:13] [V] [TRT] Tactic: 6 time 0.007896 [03/13/2022-08:32:13] [V] [TRT] Tactic: 7 time 0.007296 [03/13/2022-08:32:13] [V] [TRT] Tactic: 8 time 0.00682 [03/13/2022-08:32:13] [V] [TRT] Tactic: 9 time 0.00766 [03/13/2022-08:32:13] [V] [TRT] Tactic: 28 time 0.009808 [03/13/2022-08:32:13] [V] [TRT] Fastest Tactic: 8 Time: 0.00682 [03/13/2022-08:32:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:32:13] [V] [TRT] [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,3000) -> Float(1,20,300:32,3000) *************** [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_339, Mul_340) (PointWise) [03/13/2022-08:32:13] [V] [TRT] Tactic: 128 time 0.014224 [03/13/2022-08:32:13] [V] [TRT] Tactic: 256 time 0.01452 [03/13/2022-08:32:13] [V] [TRT] Tactic: 512 time 0.01514 [03/13/2022-08:32:13] [V] [TRT] Tactic: -32 time 0.032036 [03/13/2022-08:32:13] [V] [TRT] Tactic: -64 time 0.020524 [03/13/2022-08:32:13] [V] [TRT] Tactic: -128 time 0.016616 [03/13/2022-08:32:13] [V] [TRT] Fastest Tactic: 128 Time: 0.014224 [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_339, Mul_340) (PointWiseV2) [03/13/2022-08:32:13] [V] [TRT] Tactic: 24 time 0.009232 [03/13/2022-08:32:13] [V] [TRT] Tactic: 25 time 0.009144 [03/13/2022-08:32:13] [V] [TRT] Tactic: 26 time 0.00846 [03/13/2022-08:32:13] [V] [TRT] Tactic: 27 time 0.010672 [03/13/2022-08:32:13] [V] [TRT] Tactic: 31 time 0.008964 [03/13/2022-08:32:13] [V] [TRT] Fastest Tactic: 26 Time: 0.00846 [03/13/2022-08:32:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [03/13/2022-08:32:13] [V] [TRT] [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,96000) -> Half(1,20,300,96000) *************** [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_339, Mul_340) (PointWise) [03/13/2022-08:32:13] [V] [TRT] Tactic: 128 time 0.015188 [03/13/2022-08:32:13] [V] [TRT] Tactic: 256 time 0.014656 [03/13/2022-08:32:13] [V] [TRT] Tactic: 512 time 0.015232 [03/13/2022-08:32:13] [V] [TRT] Tactic: -32 time 0.032164 [03/13/2022-08:32:13] [V] [TRT] Tactic: -64 time 0.020528 [03/13/2022-08:32:13] [V] [TRT] Tactic: -128 time 0.016412 [03/13/2022-08:32:13] [V] [TRT] Fastest Tactic: 256 Time: 0.014656 [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_339, Mul_340) (PointWiseV2) [03/13/2022-08:32:13] [V] [TRT] Tactic: 0 time 0.009952 [03/13/2022-08:32:13] [V] [TRT] Tactic: 1 time 0.008452 [03/13/2022-08:32:13] [V] [TRT] Tactic: 2 time 0.008016 [03/13/2022-08:32:13] [V] [TRT] Tactic: 3 time 0.007896 [03/13/2022-08:32:13] [V] [TRT] Tactic: 4 time 0.007096 [03/13/2022-08:32:13] [V] [TRT] Tactic: 5 time 0.00722 [03/13/2022-08:32:13] [V] [TRT] Tactic: 6 time 0.007364 [03/13/2022-08:32:13] [V] [TRT] Tactic: 7 time 0.006704 [03/13/2022-08:32:13] [V] [TRT] Tactic: 8 time 0.006516 [03/13/2022-08:32:13] [V] [TRT] Tactic: 9 time 0.007104 [03/13/2022-08:32:13] [V] [TRT] Tactic: 28 time 0.009288 [03/13/2022-08:32:13] [V] [TRT] Fastest Tactic: 8 Time: 0.006516 [03/13/2022-08:32:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:32:13] [V] [TRT] [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,48000) -> Half(1,20,300:2,48000) *************** [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_339, Mul_340) (PointWise) [03/13/2022-08:32:13] [V] [TRT] Tactic: 128 time 0.01514 [03/13/2022-08:32:13] [V] [TRT] Tactic: 256 time 0.014404 [03/13/2022-08:32:13] [V] [TRT] Tactic: 512 time 0.015824 [03/13/2022-08:32:13] [V] [TRT] Tactic: -32 time 0.032332 [03/13/2022-08:32:13] [V] [TRT] Tactic: -64 time 0.02052 [03/13/2022-08:32:13] [V] [TRT] Tactic: -128 time 0.016592 [03/13/2022-08:32:13] [V] [TRT] Fastest Tactic: 256 Time: 0.014404 [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_339, Mul_340) (PointWiseV2) [03/13/2022-08:32:13] [V] [TRT] Tactic: 0 time 0.00828 [03/13/2022-08:32:13] [V] [TRT] Tactic: 1 time 0.007808 [03/13/2022-08:32:13] [V] [TRT] Tactic: 2 time 0.007684 [03/13/2022-08:32:13] [V] [TRT] Tactic: 3 time 0.00706 [03/13/2022-08:32:13] [V] [TRT] Tactic: 4 time 0.007004 [03/13/2022-08:32:13] [V] [TRT] Tactic: 5 time 0.007828 [03/13/2022-08:32:13] [V] [TRT] Tactic: 6 time 0.008524 [03/13/2022-08:32:13] [V] [TRT] Tactic: 7 time 0.008324 [03/13/2022-08:32:13] [V] [TRT] Tactic: 8 time 0.008416 [03/13/2022-08:32:13] [V] [TRT] Tactic: 9 time 0.008756 [03/13/2022-08:32:13] [V] [TRT] Tactic: 10 time 0.010184 [03/13/2022-08:32:13] [V] [TRT] Tactic: 11 time 0.009268 [03/13/2022-08:32:13] [V] [TRT] Tactic: 12 time 0.008224 [03/13/2022-08:32:13] [V] [TRT] Tactic: 13 time 0.008048 [03/13/2022-08:32:13] [V] [TRT] Tactic: 14 time 0.007816 [03/13/2022-08:32:13] [V] [TRT] Tactic: 15 time 0.007812 [03/13/2022-08:32:13] [V] [TRT] Tactic: 16 time 0.007884 [03/13/2022-08:32:13] [V] [TRT] Tactic: 17 time 0.007004 [03/13/2022-08:32:13] [V] [TRT] Tactic: 18 time 0.006764 [03/13/2022-08:32:13] [V] [TRT] Tactic: 19 time 0.007296 [03/13/2022-08:32:13] [V] [TRT] Tactic: 28 time 0.0083 [03/13/2022-08:32:13] [V] [TRT] Tactic: 29 time 0.010068 [03/13/2022-08:32:13] [V] [TRT] Fastest Tactic: 18 Time: 0.006764 [03/13/2022-08:32:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:32:13] [V] [TRT] [03/13/2022-08:32:13] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Half(40,800,1:8,12000) *************** [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_339, Mul_340) (PointWise) [03/13/2022-08:32:13] [V] [TRT] Tactic: 128 time 0.014996 [03/13/2022-08:32:13] [V] [TRT] Tactic: 256 time 0.014436 [03/13/2022-08:32:13] [V] [TRT] Tactic: 512 time 0.015288 [03/13/2022-08:32:13] [V] [TRT] Tactic: -32 time 0.032264 [03/13/2022-08:32:13] [V] [TRT] Tactic: -64 time 0.020712 [03/13/2022-08:32:13] [V] [TRT] Tactic: -128 time 0.016384 [03/13/2022-08:32:13] [V] [TRT] Fastest Tactic: 256 Time: 0.014436 [03/13/2022-08:32:13] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_339, Mul_340) (PointWiseV2) [03/13/2022-08:32:13] [V] [TRT] Tactic: 0 time 0.007748 [03/13/2022-08:32:14] [V] [TRT] Tactic: 1 time 0.007932 [03/13/2022-08:32:14] [V] [TRT] Tactic: 2 time 0.008116 [03/13/2022-08:32:14] [V] [TRT] Tactic: 3 time 0.009088 [03/13/2022-08:32:14] [V] [TRT] Tactic: 4 time 0.009908 [03/13/2022-08:32:14] [V] [TRT] Tactic: 5 time 0.010324 [03/13/2022-08:32:14] [V] [TRT] Tactic: 6 time 0.012768 [03/13/2022-08:32:14] [V] [TRT] Tactic: 7 time 0.014084 [03/13/2022-08:32:14] [V] [TRT] Tactic: 8 time 0.013364 [03/13/2022-08:32:14] [V] [TRT] Tactic: 9 time 0.01418 [03/13/2022-08:32:14] [V] [TRT] Tactic: 10 time 0.007896 [03/13/2022-08:32:14] [V] [TRT] Tactic: 11 time 0.00678 [03/13/2022-08:32:14] [V] [TRT] Tactic: 12 time 0.00704 [03/13/2022-08:32:14] [V] [TRT] Tactic: 13 time 0.008128 [03/13/2022-08:32:14] [V] [TRT] Tactic: 14 time 0.008 [03/13/2022-08:32:14] [V] [TRT] Tactic: 15 time 0.00818 [03/13/2022-08:32:14] [V] [TRT] Tactic: 16 time 0.010244 [03/13/2022-08:32:14] [V] [TRT] Tactic: 17 time 0.01012 [03/13/2022-08:32:14] [V] [TRT] Tactic: 18 time 0.010412 [03/13/2022-08:32:14] [V] [TRT] Tactic: 19 time 0.011924 [03/13/2022-08:32:14] [V] [TRT] Tactic: 20 time 0.008556 [03/13/2022-08:32:14] [V] [TRT] Tactic: 21 time 0.007772 [03/13/2022-08:32:14] [V] [TRT] Tactic: 22 time 0.00706 [03/13/2022-08:32:14] [V] [TRT] Tactic: 23 time 0.009008 [03/13/2022-08:32:14] [V] [TRT] Tactic: 24 time 0.010076 [03/13/2022-08:32:14] [V] [TRT] Tactic: 25 time 0.008972 [03/13/2022-08:32:14] [V] [TRT] Tactic: 26 time 0.008008 [03/13/2022-08:32:14] [V] [TRT] Tactic: 27 time 0.007608 [03/13/2022-08:32:14] [V] [TRT] Tactic: 28 time 0.007228 [03/13/2022-08:32:14] [V] [TRT] Tactic: 29 time 0.007696 [03/13/2022-08:32:14] [V] [TRT] Tactic: 30 time 0.008352 [03/13/2022-08:32:14] [V] [TRT] Tactic: 31 time 0.010012 [03/13/2022-08:32:14] [V] [TRT] Fastest Tactic: 11 Time: 0.00678 [03/13/2022-08:32:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 11 [03/13/2022-08:32:14] [V] [TRT] [03/13/2022-08:32:14] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,96000) -> Float(1,20,300,96000) *************** [03/13/2022-08:32:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_402, Mul_403) (PointWise) [03/13/2022-08:32:14] [V] [TRT] Tactic: 128 time 0.014548 [03/13/2022-08:32:14] [V] [TRT] Tactic: 256 time 0.014388 [03/13/2022-08:32:14] [V] [TRT] Tactic: 512 time 0.015196 [03/13/2022-08:32:14] [V] [TRT] Tactic: -32 time 0.032228 [03/13/2022-08:32:14] [V] [TRT] Tactic: -64 time 0.020584 [03/13/2022-08:32:14] [V] [TRT] Tactic: -128 time 0.01652 [03/13/2022-08:32:14] [V] [TRT] Fastest Tactic: 256 Time: 0.014388 [03/13/2022-08:32:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_402, Mul_403) (PointWiseV2) [03/13/2022-08:32:14] [V] [TRT] Tactic: 0 time 0.010028 [03/13/2022-08:32:14] [V] [TRT] Tactic: 1 time 0.008476 [03/13/2022-08:32:14] [V] [TRT] Tactic: 2 time 0.008124 [03/13/2022-08:32:14] [V] [TRT] Tactic: 3 time 0.00804 [03/13/2022-08:32:14] [V] [TRT] Tactic: 4 time 0.00734 [03/13/2022-08:32:14] [V] [TRT] Tactic: 5 time 0.007584 [03/13/2022-08:32:14] [V] [TRT] Tactic: 6 time 0.007928 [03/13/2022-08:32:14] [V] [TRT] Tactic: 7 time 0.007064 [03/13/2022-08:32:14] [V] [TRT] Tactic: 8 time 0.007348 [03/13/2022-08:32:14] [V] [TRT] Tactic: 9 time 0.00732 [03/13/2022-08:32:14] [V] [TRT] Tactic: 28 time 0.009612 [03/13/2022-08:32:14] [V] [TRT] Fastest Tactic: 7 Time: 0.007064 [03/13/2022-08:32:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [03/13/2022-08:32:14] [V] [TRT] [03/13/2022-08:32:14] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,3000) -> Float(1,20,300:32,3000) *************** [03/13/2022-08:32:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_402, Mul_403) (PointWise) [03/13/2022-08:32:14] [V] [TRT] Tactic: 128 time 0.014232 [03/13/2022-08:32:14] [V] [TRT] Tactic: 256 time 0.014452 [03/13/2022-08:32:14] [V] [TRT] Tactic: 512 time 0.015216 [03/13/2022-08:32:14] [V] [TRT] Tactic: -32 time 0.03236 [03/13/2022-08:32:14] [V] [TRT] Tactic: -64 time 0.020484 [03/13/2022-08:32:14] [V] [TRT] Tactic: -128 time 0.01668 [03/13/2022-08:32:14] [V] [TRT] Fastest Tactic: 128 Time: 0.014232 [03/13/2022-08:32:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_402, Mul_403) (PointWiseV2) [03/13/2022-08:32:14] [V] [TRT] Tactic: 24 time 0.00928 [03/13/2022-08:32:14] [V] [TRT] Tactic: 25 time 0.008976 [03/13/2022-08:32:14] [V] [TRT] Tactic: 26 time 0.008352 [03/13/2022-08:32:14] [V] [TRT] Tactic: 27 time 0.010416 [03/13/2022-08:32:14] [V] [TRT] Tactic: 31 time 0.009096 [03/13/2022-08:32:14] [V] [TRT] Fastest Tactic: 26 Time: 0.008352 [03/13/2022-08:32:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [03/13/2022-08:32:14] [V] [TRT] [03/13/2022-08:32:14] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,96000) -> Half(1,20,300,96000) *************** [03/13/2022-08:32:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_402, Mul_403) (PointWise) [03/13/2022-08:32:14] [V] [TRT] Tactic: 128 time 0.015332 [03/13/2022-08:32:14] [V] [TRT] Tactic: 256 time 0.014792 [03/13/2022-08:32:14] [V] [TRT] Tactic: 512 time 0.01472 [03/13/2022-08:32:14] [V] [TRT] Tactic: -32 time 0.032348 [03/13/2022-08:32:14] [V] [TRT] Tactic: -64 time 0.020588 [03/13/2022-08:32:14] [V] [TRT] Tactic: -128 time 0.016452 [03/13/2022-08:32:14] [V] [TRT] Fastest Tactic: 512 Time: 0.01472 [03/13/2022-08:32:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_402, Mul_403) (PointWiseV2) [03/13/2022-08:32:14] [V] [TRT] Tactic: 0 time 0.0098 [03/13/2022-08:32:14] [V] [TRT] Tactic: 1 time 0.008764 [03/13/2022-08:32:14] [V] [TRT] Tactic: 2 time 0.008084 [03/13/2022-08:32:14] [V] [TRT] Tactic: 3 time 0.007952 [03/13/2022-08:32:14] [V] [TRT] Tactic: 4 time 0.007004 [03/13/2022-08:32:14] [V] [TRT] Tactic: 5 time 0.006784 [03/13/2022-08:32:14] [V] [TRT] Tactic: 6 time 0.007824 [03/13/2022-08:32:14] [V] [TRT] Tactic: 7 time 0.006704 [03/13/2022-08:32:14] [V] [TRT] Tactic: 8 time 0.006592 [03/13/2022-08:32:14] [V] [TRT] Tactic: 9 time 0.006792 [03/13/2022-08:32:14] [V] [TRT] Tactic: 28 time 0.009692 [03/13/2022-08:32:14] [V] [TRT] Fastest Tactic: 8 Time: 0.006592 [03/13/2022-08:32:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:32:14] [V] [TRT] [03/13/2022-08:32:14] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,48000) -> Half(1,20,300:2,48000) *************** [03/13/2022-08:32:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_402, Mul_403) (PointWise) [03/13/2022-08:32:14] [V] [TRT] Tactic: 128 time 0.015544 [03/13/2022-08:32:14] [V] [TRT] Tactic: 256 time 0.014548 [03/13/2022-08:32:14] [V] [TRT] Tactic: 512 time 0.015588 [03/13/2022-08:32:14] [V] [TRT] Tactic: -32 time 0.032392 [03/13/2022-08:32:14] [V] [TRT] Tactic: -64 time 0.020736 [03/13/2022-08:32:14] [V] [TRT] Tactic: -128 time 0.016588 [03/13/2022-08:32:14] [V] [TRT] Fastest Tactic: 256 Time: 0.014548 [03/13/2022-08:32:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_402, Mul_403) (PointWiseV2) [03/13/2022-08:32:14] [V] [TRT] Tactic: 0 time 0.00828 [03/13/2022-08:32:14] [V] [TRT] Tactic: 1 time 0.007548 [03/13/2022-08:32:14] [V] [TRT] Tactic: 2 time 0.00788 [03/13/2022-08:32:14] [V] [TRT] Tactic: 3 time 0.007212 [03/13/2022-08:32:14] [V] [TRT] Tactic: 4 time 0.006776 [03/13/2022-08:32:14] [V] [TRT] Tactic: 5 time 0.007776 [03/13/2022-08:32:14] [V] [TRT] Tactic: 6 time 0.008928 [03/13/2022-08:32:14] [V] [TRT] Tactic: 7 time 0.008684 [03/13/2022-08:32:14] [V] [TRT] Tactic: 8 time 0.008828 [03/13/2022-08:32:14] [V] [TRT] Tactic: 9 time 0.008908 [03/13/2022-08:32:14] [V] [TRT] Tactic: 10 time 0.010128 [03/13/2022-08:32:14] [V] [TRT] Tactic: 11 time 0.00852 [03/13/2022-08:32:14] [V] [TRT] Tactic: 12 time 0.00824 [03/13/2022-08:32:14] [V] [TRT] Tactic: 13 time 0.00802 [03/13/2022-08:32:14] [V] [TRT] Tactic: 14 time 0.007868 [03/13/2022-08:32:14] [V] [TRT] Tactic: 15 time 0.007908 [03/13/2022-08:32:14] [V] [TRT] Tactic: 16 time 0.00764 [03/13/2022-08:32:14] [V] [TRT] Tactic: 17 time 0.006936 [03/13/2022-08:32:14] [V] [TRT] Tactic: 18 time 0.007164 [03/13/2022-08:32:14] [V] [TRT] Tactic: 19 time 0.007216 [03/13/2022-08:32:14] [V] [TRT] Tactic: 28 time 0.008224 [03/13/2022-08:32:14] [V] [TRT] Tactic: 29 time 0.010016 [03/13/2022-08:32:14] [V] [TRT] Fastest Tactic: 4 Time: 0.006776 [03/13/2022-08:32:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [03/13/2022-08:32:14] [V] [TRT] [03/13/2022-08:32:14] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Half(40,800,1:8,12000) *************** [03/13/2022-08:32:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_402, Mul_403) (PointWise) [03/13/2022-08:32:14] [V] [TRT] Tactic: 128 time 0.017276 [03/13/2022-08:32:14] [V] [TRT] Tactic: 256 time 0.014564 [03/13/2022-08:32:14] [V] [TRT] Tactic: 512 time 0.01514 [03/13/2022-08:32:14] [V] [TRT] Tactic: -32 time 0.032268 [03/13/2022-08:32:14] [V] [TRT] Tactic: -64 time 0.020516 [03/13/2022-08:32:14] [V] [TRT] Tactic: -128 time 0.01642 [03/13/2022-08:32:14] [V] [TRT] Fastest Tactic: 256 Time: 0.014564 [03/13/2022-08:32:14] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_402, Mul_403) (PointWiseV2) [03/13/2022-08:32:14] [V] [TRT] Tactic: 0 time 0.007296 [03/13/2022-08:32:14] [V] [TRT] Tactic: 1 time 0.007872 [03/13/2022-08:32:14] [V] [TRT] Tactic: 2 time 0.008092 [03/13/2022-08:32:14] [V] [TRT] Tactic: 3 time 0.00934 [03/13/2022-08:32:14] [V] [TRT] Tactic: 4 time 0.010116 [03/13/2022-08:32:14] [V] [TRT] Tactic: 5 time 0.010396 [03/13/2022-08:32:14] [V] [TRT] Tactic: 6 time 0.013296 [03/13/2022-08:32:14] [V] [TRT] Tactic: 7 time 0.014052 [03/13/2022-08:32:14] [V] [TRT] Tactic: 8 time 0.01338 [03/13/2022-08:32:14] [V] [TRT] Tactic: 9 time 0.014416 [03/13/2022-08:32:14] [V] [TRT] Tactic: 10 time 0.007624 [03/13/2022-08:32:14] [V] [TRT] Tactic: 11 time 0.007192 [03/13/2022-08:32:14] [V] [TRT] Tactic: 12 time 0.007628 [03/13/2022-08:32:14] [V] [TRT] Tactic: 13 time 0.008096 [03/13/2022-08:32:14] [V] [TRT] Tactic: 14 time 0.0079 [03/13/2022-08:32:14] [V] [TRT] Tactic: 15 time 0.008176 [03/13/2022-08:32:14] [V] [TRT] Tactic: 16 time 0.010312 [03/13/2022-08:32:14] [V] [TRT] Tactic: 17 time 0.009824 [03/13/2022-08:32:14] [V] [TRT] Tactic: 18 time 0.01034 [03/13/2022-08:32:14] [V] [TRT] Tactic: 19 time 0.011784 [03/13/2022-08:32:14] [V] [TRT] Tactic: 20 time 0.008432 [03/13/2022-08:32:14] [V] [TRT] Tactic: 21 time 0.00796 [03/13/2022-08:32:14] [V] [TRT] Tactic: 22 time 0.007304 [03/13/2022-08:32:14] [V] [TRT] Tactic: 23 time 0.008588 [03/13/2022-08:32:14] [V] [TRT] Tactic: 24 time 0.010244 [03/13/2022-08:32:14] [V] [TRT] Tactic: 25 time 0.008856 [03/13/2022-08:32:14] [V] [TRT] Tactic: 26 time 0.008056 [03/13/2022-08:32:14] [V] [TRT] Tactic: 27 time 0.007896 [03/13/2022-08:32:14] [V] [TRT] Tactic: 28 time 0.007216 [03/13/2022-08:32:14] [V] [TRT] Tactic: 29 time 0.007848 [03/13/2022-08:32:14] [V] [TRT] Tactic: 30 time 0.008436 [03/13/2022-08:32:14] [V] [TRT] Tactic: 31 time 0.010144 [03/13/2022-08:32:14] [V] [TRT] Fastest Tactic: 11 Time: 0.007192 [03/13/2022-08:32:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 11 [03/13/2022-08:32:14] [V] [TRT] [03/13/2022-08:32:14] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,96000) -> Float(1,20,300,96000) *************** [03/13/2022-08:32:14] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,96000) -> Half(1,20,300,96000) *************** [03/13/2022-08:32:14] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,48000) -> Half(1,20,300:2,48000) *************** [03/13/2022-08:32:14] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Float(1,20,300,96000) *************** [03/13/2022-08:32:14] [V] [TRT] --------------- Timing Runner: Conv_404 (FusedConvActConvolution) [03/13/2022-08:32:14] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:14] [V] [TRT] --------------- Timing Runner: Conv_404 (CaskConvolution) [03/13/2022-08:32:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:14] [V] [TRT] --------------- Timing Runner: Conv_404 (CudaConvolution) [03/13/2022-08:32:14] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:14] [V] [TRT] --------------- Timing Runner: Conv_404 (CudaDepthwiseConvolution) [03/13/2022-08:32:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:14] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Half(40,800,1:8,12000) *************** [03/13/2022-08:32:14] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,96000) -> Float(1,20,300,96000) *************** [03/13/2022-08:32:14] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,96000) -> Half(1,20,300,96000) *************** [03/13/2022-08:32:14] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,48000) -> Half(1,20,300:2,48000) *************** [03/13/2022-08:32:14] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Float(1,20,300,96000) *************** [03/13/2022-08:32:14] [V] [TRT] --------------- Timing Runner: Conv_341 (FusedConvActConvolution) [03/13/2022-08:32:14] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:14] [V] [TRT] --------------- Timing Runner: Conv_341 (CaskConvolution) [03/13/2022-08:32:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:14] [V] [TRT] --------------- Timing Runner: Conv_341 (CudaConvolution) [03/13/2022-08:32:14] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:14] [V] [TRT] --------------- Timing Runner: Conv_341 (CudaDepthwiseConvolution) [03/13/2022-08:32:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:14] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Half(40,800,1:8,12000) *************** [03/13/2022-08:32:14] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:14] [V] [TRT] Tactic: 1002 time 0.006852 [03/13/2022-08:32:14] [V] [TRT] Tactic: 0 time 0.005636 [03/13/2022-08:32:14] [V] [TRT] Fastest Tactic: 0 Time: 0.005636 [03/13/2022-08:32:14] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:14] [V] [TRT] Tactic: 1002 time 0.00664 [03/13/2022-08:32:14] [V] [TRT] Tactic: 0 time 0.005224 [03/13/2022-08:32:14] [V] [TRT] Fastest Tactic: 0 Time: 0.005224 [03/13/2022-08:32:14] [V] [TRT] *************** Autotuning format combination: Float(1,2), Float(1,2) -> Float(1,2) *************** [03/13/2022-08:32:14] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 291) [Constant] + (Unnamed Layer* 292) [Shuffle], PWN(PWN((Unnamed Layer* 288) [Constant] + (Unnamed Layer* 289) [Shuffle], Mul_312), Pow_313)), Mul_315) (PointWise) [03/13/2022-08:32:14] [V] [TRT] Tactic: 128 time 0.006756 [03/13/2022-08:32:15] [V] [TRT] Tactic: 256 time 0.006644 [03/13/2022-08:32:15] [V] [TRT] Tactic: 512 time 0.006748 [03/13/2022-08:32:15] [V] [TRT] Tactic: -32 time 0.045716 [03/13/2022-08:32:15] [V] [TRT] Tactic: -64 time 0.026484 [03/13/2022-08:32:15] [V] [TRT] Tactic: -128 time 0.016632 [03/13/2022-08:32:15] [V] [TRT] Fastest Tactic: 256 Time: 0.006644 [03/13/2022-08:32:15] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 291) [Constant] + (Unnamed Layer* 292) [Shuffle], PWN(PWN((Unnamed Layer* 288) [Constant] + (Unnamed Layer* 289) [Shuffle], Mul_312), Pow_313)), Mul_315) (PointWiseV2) [03/13/2022-08:32:15] [V] [TRT] Tactic: 0 time 0.0048 [03/13/2022-08:32:15] [V] [TRT] Tactic: 1 time 0.005028 [03/13/2022-08:32:15] [V] [TRT] Tactic: 2 time 0.004744 [03/13/2022-08:32:15] [V] [TRT] Tactic: 3 time 0.006216 [03/13/2022-08:32:15] [V] [TRT] Tactic: 4 time 0.005676 [03/13/2022-08:32:15] [V] [TRT] Tactic: 5 time 0.005856 [03/13/2022-08:32:15] [V] [TRT] Tactic: 6 time 0.006596 [03/13/2022-08:32:15] [V] [TRT] Tactic: 7 time 0.00658 [03/13/2022-08:32:15] [V] [TRT] Tactic: 8 time 0.00578 [03/13/2022-08:32:15] [V] [TRT] Tactic: 9 time 0.006116 [03/13/2022-08:32:15] [V] [TRT] Tactic: 28 time 0.005352 [03/13/2022-08:32:15] [V] [TRT] Fastest Tactic: 2 Time: 0.004744 [03/13/2022-08:32:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [03/13/2022-08:32:15] [V] [TRT] [03/13/2022-08:32:15] [V] [TRT] *************** Autotuning format combination: Half(1,2), Half(1,2) -> Half(1,2) *************** [03/13/2022-08:32:15] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 291) [Constant] + (Unnamed Layer* 292) [Shuffle], PWN(PWN((Unnamed Layer* 288) [Constant] + (Unnamed Layer* 289) [Shuffle], Mul_312), Pow_313)), Mul_315) (PointWise) [03/13/2022-08:32:15] [V] [TRT] Tactic: 128 time 0.010644 [03/13/2022-08:32:15] [V] [TRT] Tactic: 256 time 0.011088 [03/13/2022-08:32:15] [V] [TRT] Tactic: 512 time 0.011764 [03/13/2022-08:32:15] [V] [TRT] Tactic: -32 time 0.050732 [03/13/2022-08:32:15] [V] [TRT] Tactic: -64 time 0.030368 [03/13/2022-08:32:15] [V] [TRT] Tactic: -128 time 0.017636 [03/13/2022-08:32:15] [V] [TRT] Fastest Tactic: 128 Time: 0.010644 [03/13/2022-08:32:15] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 291) [Constant] + (Unnamed Layer* 292) [Shuffle], PWN(PWN((Unnamed Layer* 288) [Constant] + (Unnamed Layer* 289) [Shuffle], Mul_312), Pow_313)), Mul_315) (PointWiseV2) [03/13/2022-08:32:15] [V] [TRT] Tactic: 0 time 0.0051 [03/13/2022-08:32:15] [V] [TRT] Tactic: 1 time 0.00516 [03/13/2022-08:32:15] [V] [TRT] Tactic: 2 time 0.004516 [03/13/2022-08:32:15] [V] [TRT] Tactic: 3 time 0.006292 [03/13/2022-08:32:15] [V] [TRT] Tactic: 4 time 0.00562 [03/13/2022-08:32:15] [V] [TRT] Tactic: 5 time 0.005136 [03/13/2022-08:32:15] [V] [TRT] Tactic: 6 time 0.00688 [03/13/2022-08:32:15] [V] [TRT] Tactic: 7 time 0.006452 [03/13/2022-08:32:15] [V] [TRT] Tactic: 8 time 0.005704 [03/13/2022-08:32:15] [V] [TRT] Tactic: 9 time 0.005672 [03/13/2022-08:32:15] [V] [TRT] Tactic: 28 time 0.004792 [03/13/2022-08:32:15] [V] [TRT] Fastest Tactic: 2 Time: 0.004516 [03/13/2022-08:32:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [03/13/2022-08:32:15] [V] [TRT] [03/13/2022-08:32:15] [V] [TRT] *************** Autotuning format combination: -> Float(1,2) *************** [03/13/2022-08:32:15] [V] [TRT] *************** Autotuning format combination: -> Half(1,2) *************** [03/13/2022-08:32:15] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,96000) -> Float(1,20,300,192000) *************** [03/13/2022-08:32:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_406, Mul_407) (PointWise) [03/13/2022-08:32:15] [V] [TRT] Tactic: 128 time 0.016608 [03/13/2022-08:32:15] [V] [TRT] Tactic: 256 time 0.016724 [03/13/2022-08:32:15] [V] [TRT] Tactic: 512 time 0.017672 [03/13/2022-08:32:15] [V] [TRT] Tactic: -32 time 0.032428 [03/13/2022-08:32:15] [V] [TRT] Tactic: -64 time 0.020948 [03/13/2022-08:32:15] [V] [TRT] Tactic: -128 time 0.017032 [03/13/2022-08:32:15] [V] [TRT] Fastest Tactic: 128 Time: 0.016608 [03/13/2022-08:32:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_406, Mul_407) (PointWiseV2) [03/13/2022-08:32:15] [V] [TRT] Tactic: 0 time 0.01094 [03/13/2022-08:32:15] [V] [TRT] Tactic: 1 time 0.0095 [03/13/2022-08:32:15] [V] [TRT] Tactic: 2 time 0.008576 [03/13/2022-08:32:15] [V] [TRT] Tactic: 3 time 0.008372 [03/13/2022-08:32:15] [V] [TRT] Tactic: 4 time 0.008048 [03/13/2022-08:32:15] [V] [TRT] Tactic: 5 time 0.007476 [03/13/2022-08:32:15] [V] [TRT] Tactic: 6 time 0.008044 [03/13/2022-08:32:15] [V] [TRT] Tactic: 7 time 0.007272 [03/13/2022-08:32:15] [V] [TRT] Tactic: 8 time 0.00744 [03/13/2022-08:32:15] [V] [TRT] Tactic: 9 time 0.007688 [03/13/2022-08:32:15] [V] [TRT] Tactic: 28 time 0.010788 [03/13/2022-08:32:15] [V] [TRT] Fastest Tactic: 7 Time: 0.007272 [03/13/2022-08:32:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [03/13/2022-08:32:15] [V] [TRT] [03/13/2022-08:32:15] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,3000) -> Float(1,20,300:32,6000) *************** [03/13/2022-08:32:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_406, Mul_407) (PointWise) [03/13/2022-08:32:15] [V] [TRT] Tactic: 128 time 0.016708 [03/13/2022-08:32:15] [V] [TRT] Tactic: 256 time 0.016688 [03/13/2022-08:32:15] [V] [TRT] Tactic: 512 time 0.017512 [03/13/2022-08:32:15] [V] [TRT] Tactic: -32 time 0.032512 [03/13/2022-08:32:15] [V] [TRT] Tactic: -64 time 0.020644 [03/13/2022-08:32:15] [V] [TRT] Tactic: -128 time 0.0173 [03/13/2022-08:32:15] [V] [TRT] Fastest Tactic: 256 Time: 0.016688 [03/13/2022-08:32:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_406, Mul_407) (PointWiseV2) [03/13/2022-08:32:15] [V] [TRT] Tactic: 24 time 0.008972 [03/13/2022-08:32:15] [V] [TRT] Tactic: 25 time 0.00922 [03/13/2022-08:32:15] [V] [TRT] Tactic: 26 time 0.008504 [03/13/2022-08:32:15] [V] [TRT] Tactic: 27 time 0.010764 [03/13/2022-08:32:15] [V] [TRT] Tactic: 31 time 0.009464 [03/13/2022-08:32:15] [V] [TRT] Fastest Tactic: 26 Time: 0.008504 [03/13/2022-08:32:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [03/13/2022-08:32:15] [V] [TRT] [03/13/2022-08:32:15] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,96000) -> Half(1,20,300,192000) *************** [03/13/2022-08:32:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_406, Mul_407) (PointWise) [03/13/2022-08:32:15] [V] [TRT] Tactic: 128 time 0.016072 [03/13/2022-08:32:15] [V] [TRT] Tactic: 256 time 0.015184 [03/13/2022-08:32:15] [V] [TRT] Tactic: 512 time 0.015984 [03/13/2022-08:32:15] [V] [TRT] Tactic: -32 time 0.032468 [03/13/2022-08:32:15] [V] [TRT] Tactic: -64 time 0.020888 [03/13/2022-08:32:15] [V] [TRT] Tactic: -128 time 0.01686 [03/13/2022-08:32:15] [V] [TRT] Fastest Tactic: 256 Time: 0.015184 [03/13/2022-08:32:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_406, Mul_407) (PointWiseV2) [03/13/2022-08:32:15] [V] [TRT] Tactic: 0 time 0.011024 [03/13/2022-08:32:15] [V] [TRT] Tactic: 1 time 0.00902 [03/13/2022-08:32:15] [V] [TRT] Tactic: 2 time 0.008648 [03/13/2022-08:32:15] [V] [TRT] Tactic: 3 time 0.008196 [03/13/2022-08:32:15] [V] [TRT] Tactic: 4 time 0.008016 [03/13/2022-08:32:15] [V] [TRT] Tactic: 5 time 0.007748 [03/13/2022-08:32:15] [V] [TRT] Tactic: 6 time 0.008068 [03/13/2022-08:32:15] [V] [TRT] Tactic: 7 time 0.0072 [03/13/2022-08:32:15] [V] [TRT] Tactic: 8 time 0.007304 [03/13/2022-08:32:15] [V] [TRT] Tactic: 9 time 0.007388 [03/13/2022-08:32:15] [V] [TRT] Tactic: 28 time 0.0108 [03/13/2022-08:32:15] [V] [TRT] Fastest Tactic: 7 Time: 0.0072 [03/13/2022-08:32:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [03/13/2022-08:32:15] [V] [TRT] [03/13/2022-08:32:15] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,48000) -> Half(1,20,300:2,96000) *************** [03/13/2022-08:32:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_406, Mul_407) (PointWise) [03/13/2022-08:32:15] [V] [TRT] Tactic: 128 time 0.016204 [03/13/2022-08:32:15] [V] [TRT] Tactic: 256 time 0.015156 [03/13/2022-08:32:15] [V] [TRT] Tactic: 512 time 0.016376 [03/13/2022-08:32:15] [V] [TRT] Tactic: -32 time 0.032532 [03/13/2022-08:32:15] [V] [TRT] Tactic: -64 time 0.021036 [03/13/2022-08:32:15] [V] [TRT] Tactic: -128 time 0.016776 [03/13/2022-08:32:15] [V] [TRT] Fastest Tactic: 256 Time: 0.015156 [03/13/2022-08:32:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_406, Mul_407) (PointWiseV2) [03/13/2022-08:32:15] [V] [TRT] Tactic: 0 time 0.009112 [03/13/2022-08:32:15] [V] [TRT] Tactic: 1 time 0.007968 [03/13/2022-08:32:15] [V] [TRT] Tactic: 2 time 0.008096 [03/13/2022-08:32:15] [V] [TRT] Tactic: 3 time 0.007748 [03/13/2022-08:32:15] [V] [TRT] Tactic: 4 time 0.00722 [03/13/2022-08:32:15] [V] [TRT] Tactic: 5 time 0.008044 [03/13/2022-08:32:15] [V] [TRT] Tactic: 6 time 0.008416 [03/13/2022-08:32:15] [V] [TRT] Tactic: 7 time 0.008652 [03/13/2022-08:32:15] [V] [TRT] Tactic: 8 time 0.008744 [03/13/2022-08:32:15] [V] [TRT] Tactic: 9 time 0.009212 [03/13/2022-08:32:15] [V] [TRT] Tactic: 10 time 0.011376 [03/13/2022-08:32:15] [V] [TRT] Tactic: 11 time 0.009696 [03/13/2022-08:32:15] [V] [TRT] Tactic: 12 time 0.009408 [03/13/2022-08:32:15] [V] [TRT] Tactic: 13 time 0.008368 [03/13/2022-08:32:15] [V] [TRT] Tactic: 14 time 0.008128 [03/13/2022-08:32:15] [V] [TRT] Tactic: 15 time 0.008048 [03/13/2022-08:32:15] [V] [TRT] Tactic: 16 time 0.008024 [03/13/2022-08:32:15] [V] [TRT] Tactic: 17 time 0.007704 [03/13/2022-08:32:15] [V] [TRT] Tactic: 18 time 0.007112 [03/13/2022-08:32:15] [V] [TRT] Tactic: 19 time 0.007752 [03/13/2022-08:32:15] [V] [TRT] Tactic: 28 time 0.009012 [03/13/2022-08:32:15] [V] [TRT] Tactic: 29 time 0.011276 [03/13/2022-08:32:15] [V] [TRT] Fastest Tactic: 18 Time: 0.007112 [03/13/2022-08:32:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:32:15] [V] [TRT] [03/13/2022-08:32:15] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Half(80,1600,1:8,24000) *************** [03/13/2022-08:32:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_406, Mul_407) (PointWise) [03/13/2022-08:32:15] [V] [TRT] Tactic: 128 time 0.016004 [03/13/2022-08:32:15] [V] [TRT] Tactic: 256 time 0.014868 [03/13/2022-08:32:15] [V] [TRT] Tactic: 512 time 0.01638 [03/13/2022-08:32:15] [V] [TRT] Tactic: -32 time 0.023004 [03/13/2022-08:32:15] [V] [TRT] Tactic: -64 time 0.018276 [03/13/2022-08:32:15] [V] [TRT] Tactic: -128 time 0.018912 [03/13/2022-08:32:15] [V] [TRT] Fastest Tactic: 256 Time: 0.014868 [03/13/2022-08:32:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_406, Mul_407) (PointWiseV2) [03/13/2022-08:32:15] [V] [TRT] Tactic: 0 time 0.008832 [03/13/2022-08:32:15] [V] [TRT] Tactic: 1 time 0.00844 [03/13/2022-08:32:15] [V] [TRT] Tactic: 2 time 0.008912 [03/13/2022-08:32:15] [V] [TRT] Tactic: 3 time 0.009472 [03/13/2022-08:32:15] [V] [TRT] Tactic: 4 time 0.009664 [03/13/2022-08:32:15] [V] [TRT] Tactic: 5 time 0.009796 [03/13/2022-08:32:15] [V] [TRT] Tactic: 6 time 0.011264 [03/13/2022-08:32:15] [V] [TRT] Tactic: 7 time 0.01038 [03/13/2022-08:32:15] [V] [TRT] Tactic: 8 time 0.00986 [03/13/2022-08:32:15] [V] [TRT] Tactic: 9 time 0.010176 [03/13/2022-08:32:15] [V] [TRT] Tactic: 10 time 0.0088 [03/13/2022-08:32:15] [V] [TRT] Tactic: 11 time 0.009048 [03/13/2022-08:32:15] [V] [TRT] Tactic: 12 time 0.009304 [03/13/2022-08:32:15] [V] [TRT] Tactic: 13 time 0.008164 [03/13/2022-08:32:15] [V] [TRT] Tactic: 14 time 0.008192 [03/13/2022-08:32:15] [V] [TRT] Tactic: 15 time 0.0083 [03/13/2022-08:32:15] [V] [TRT] Tactic: 16 time 0.00968 [03/13/2022-08:32:15] [V] [TRT] Tactic: 17 time 0.009176 [03/13/2022-08:32:15] [V] [TRT] Tactic: 18 time 0.009152 [03/13/2022-08:32:15] [V] [TRT] Tactic: 19 time 0.008656 [03/13/2022-08:32:15] [V] [TRT] Tactic: 20 time 0.009348 [03/13/2022-08:32:15] [V] [TRT] Tactic: 21 time 0.009276 [03/13/2022-08:32:15] [V] [TRT] Tactic: 22 time 0.009448 [03/13/2022-08:32:15] [V] [TRT] Tactic: 23 time 0.0081 [03/13/2022-08:32:15] [V] [TRT] Tactic: 24 time 0.011448 [03/13/2022-08:32:15] [V] [TRT] Tactic: 25 time 0.009764 [03/13/2022-08:32:15] [V] [TRT] Tactic: 26 time 0.009388 [03/13/2022-08:32:15] [V] [TRT] Tactic: 27 time 0.01016 [03/13/2022-08:32:15] [V] [TRT] Tactic: 28 time 0.007532 [03/13/2022-08:32:15] [V] [TRT] Tactic: 29 time 0.0081 [03/13/2022-08:32:15] [V] [TRT] Tactic: 30 time 0.009616 [03/13/2022-08:32:15] [V] [TRT] Tactic: 31 time 0.011564 [03/13/2022-08:32:15] [V] [TRT] Fastest Tactic: 28 Time: 0.007532 [03/13/2022-08:32:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [03/13/2022-08:32:15] [V] [TRT] [03/13/2022-08:32:15] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,192000) -> Float(1,20,300,192000) *************** [03/13/2022-08:32:15] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_410, Mul_411) (PointWise) [03/13/2022-08:32:15] [V] [TRT] Tactic: 128 time 0.016276 [03/13/2022-08:32:15] [V] [TRT] Tactic: 256 time 0.01662 [03/13/2022-08:32:15] [V] [TRT] Tactic: 512 time 0.017396 [03/13/2022-08:32:16] [V] [TRT] Tactic: -32 time 0.032504 [03/13/2022-08:32:16] [V] [TRT] Tactic: -64 time 0.020724 [03/13/2022-08:32:16] [V] [TRT] Tactic: -128 time 0.01694 [03/13/2022-08:32:16] [V] [TRT] Fastest Tactic: 128 Time: 0.016276 [03/13/2022-08:32:16] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_410, Mul_411) (PointWiseV2) [03/13/2022-08:32:16] [V] [TRT] Tactic: 0 time 0.010868 [03/13/2022-08:32:16] [V] [TRT] Tactic: 1 time 0.008908 [03/13/2022-08:32:16] [V] [TRT] Tactic: 2 time 0.00862 [03/13/2022-08:32:16] [V] [TRT] Tactic: 3 time 0.008292 [03/13/2022-08:32:16] [V] [TRT] Tactic: 4 time 0.008056 [03/13/2022-08:32:16] [V] [TRT] Tactic: 5 time 0.007564 [03/13/2022-08:32:16] [V] [TRT] Tactic: 6 time 0.007848 [03/13/2022-08:32:16] [V] [TRT] Tactic: 7 time 0.007356 [03/13/2022-08:32:16] [V] [TRT] Tactic: 8 time 0.00684 [03/13/2022-08:32:16] [V] [TRT] Tactic: 9 time 0.007056 [03/13/2022-08:32:16] [V] [TRT] Tactic: 28 time 0.011008 [03/13/2022-08:32:16] [V] [TRT] Fastest Tactic: 8 Time: 0.00684 [03/13/2022-08:32:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:32:16] [V] [TRT] [03/13/2022-08:32:16] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,6000) -> Float(1,20,300:32,6000) *************** [03/13/2022-08:32:16] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_410, Mul_411) (PointWise) [03/13/2022-08:32:16] [V] [TRT] Tactic: 128 time 0.016392 [03/13/2022-08:32:16] [V] [TRT] Tactic: 256 time 0.016616 [03/13/2022-08:32:16] [V] [TRT] Tactic: 512 time 0.0171 [03/13/2022-08:32:16] [V] [TRT] Tactic: -32 time 0.032464 [03/13/2022-08:32:16] [V] [TRT] Tactic: -64 time 0.020784 [03/13/2022-08:32:16] [V] [TRT] Tactic: -128 time 0.01682 [03/13/2022-08:32:16] [V] [TRT] Fastest Tactic: 128 Time: 0.016392 [03/13/2022-08:32:16] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_410, Mul_411) (PointWiseV2) [03/13/2022-08:32:16] [V] [TRT] Tactic: 24 time 0.009224 [03/13/2022-08:32:16] [V] [TRT] Tactic: 25 time 0.008972 [03/13/2022-08:32:16] [V] [TRT] Tactic: 26 time 0.008748 [03/13/2022-08:32:16] [V] [TRT] Tactic: 27 time 0.010792 [03/13/2022-08:32:16] [V] [TRT] Tactic: 31 time 0.008996 [03/13/2022-08:32:16] [V] [TRT] Fastest Tactic: 26 Time: 0.008748 [03/13/2022-08:32:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [03/13/2022-08:32:16] [V] [TRT] [03/13/2022-08:32:16] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,192000) -> Half(1,20,300,192000) *************** [03/13/2022-08:32:16] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_410, Mul_411) (PointWise) [03/13/2022-08:32:16] [V] [TRT] Tactic: 128 time 0.01606 [03/13/2022-08:32:16] [V] [TRT] Tactic: 256 time 0.015236 [03/13/2022-08:32:16] [V] [TRT] Tactic: 512 time 0.015684 [03/13/2022-08:32:16] [V] [TRT] Tactic: -32 time 0.032408 [03/13/2022-08:32:16] [V] [TRT] Tactic: -64 time 0.020824 [03/13/2022-08:32:16] [V] [TRT] Tactic: -128 time 0.017104 [03/13/2022-08:32:16] [V] [TRT] Fastest Tactic: 256 Time: 0.015236 [03/13/2022-08:32:16] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_410, Mul_411) (PointWiseV2) [03/13/2022-08:32:16] [V] [TRT] Tactic: 0 time 0.010704 [03/13/2022-08:32:16] [V] [TRT] Tactic: 1 time 0.008988 [03/13/2022-08:32:16] [V] [TRT] Tactic: 2 time 0.008772 [03/13/2022-08:32:16] [V] [TRT] Tactic: 3 time 0.008204 [03/13/2022-08:32:16] [V] [TRT] Tactic: 4 time 0.007908 [03/13/2022-08:32:16] [V] [TRT] Tactic: 5 time 0.007672 [03/13/2022-08:32:16] [V] [TRT] Tactic: 6 time 0.00788 [03/13/2022-08:32:16] [V] [TRT] Tactic: 7 time 0.007028 [03/13/2022-08:32:16] [V] [TRT] Tactic: 8 time 0.00698 [03/13/2022-08:32:16] [V] [TRT] Tactic: 9 time 0.007024 [03/13/2022-08:32:16] [V] [TRT] Tactic: 28 time 0.010808 [03/13/2022-08:32:16] [V] [TRT] Fastest Tactic: 8 Time: 0.00698 [03/13/2022-08:32:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:32:16] [V] [TRT] [03/13/2022-08:32:16] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300:2,96000) *************** [03/13/2022-08:32:16] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_410, Mul_411) (PointWise) [03/13/2022-08:32:16] [V] [TRT] Tactic: 128 time 0.016124 [03/13/2022-08:32:16] [V] [TRT] Tactic: 256 time 0.015308 [03/13/2022-08:32:16] [V] [TRT] Tactic: 512 time 0.015956 [03/13/2022-08:32:16] [V] [TRT] Tactic: -32 time 0.032464 [03/13/2022-08:32:16] [V] [TRT] Tactic: -64 time 0.02072 [03/13/2022-08:32:16] [V] [TRT] Tactic: -128 time 0.016804 [03/13/2022-08:32:16] [V] [TRT] Fastest Tactic: 256 Time: 0.015308 [03/13/2022-08:32:16] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_410, Mul_411) (PointWiseV2) [03/13/2022-08:32:16] [V] [TRT] Tactic: 0 time 0.00894 [03/13/2022-08:32:16] [V] [TRT] Tactic: 1 time 0.008032 [03/13/2022-08:32:16] [V] [TRT] Tactic: 2 time 0.00802 [03/13/2022-08:32:16] [V] [TRT] Tactic: 3 time 0.007032 [03/13/2022-08:32:16] [V] [TRT] Tactic: 4 time 0.007252 [03/13/2022-08:32:16] [V] [TRT] Tactic: 5 time 0.00776 [03/13/2022-08:32:16] [V] [TRT] Tactic: 6 time 0.008724 [03/13/2022-08:32:16] [V] [TRT] Tactic: 7 time 0.008768 [03/13/2022-08:32:16] [V] [TRT] Tactic: 8 time 0.008732 [03/13/2022-08:32:16] [V] [TRT] Tactic: 9 time 0.009164 [03/13/2022-08:32:16] [V] [TRT] Tactic: 10 time 0.011024 [03/13/2022-08:32:16] [V] [TRT] Tactic: 11 time 0.008772 [03/13/2022-08:32:16] [V] [TRT] Tactic: 12 time 0.008756 [03/13/2022-08:32:16] [V] [TRT] Tactic: 13 time 0.008332 [03/13/2022-08:32:16] [V] [TRT] Tactic: 14 time 0.008112 [03/13/2022-08:32:16] [V] [TRT] Tactic: 15 time 0.007752 [03/13/2022-08:32:16] [V] [TRT] Tactic: 16 time 0.008032 [03/13/2022-08:32:16] [V] [TRT] Tactic: 17 time 0.007652 [03/13/2022-08:32:16] [V] [TRT] Tactic: 18 time 0.007028 [03/13/2022-08:32:16] [V] [TRT] Tactic: 19 time 0.007444 [03/13/2022-08:32:16] [V] [TRT] Tactic: 28 time 0.009004 [03/13/2022-08:32:16] [V] [TRT] Tactic: 29 time 0.010784 [03/13/2022-08:32:16] [V] [TRT] Fastest Tactic: 18 Time: 0.007028 [03/13/2022-08:32:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:32:16] [V] [TRT] [03/13/2022-08:32:16] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Half(80,1600,1:8,24000) *************** [03/13/2022-08:32:16] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_410, Mul_411) (PointWise) [03/13/2022-08:32:16] [V] [TRT] Tactic: 128 time 0.016012 [03/13/2022-08:32:16] [V] [TRT] Tactic: 256 time 0.0148 [03/13/2022-08:32:16] [V] [TRT] Tactic: 512 time 0.015976 [03/13/2022-08:32:16] [V] [TRT] Tactic: -32 time 0.023104 [03/13/2022-08:32:16] [V] [TRT] Tactic: -64 time 0.018456 [03/13/2022-08:32:16] [V] [TRT] Tactic: -128 time 0.018912 [03/13/2022-08:32:16] [V] [TRT] Fastest Tactic: 256 Time: 0.0148 [03/13/2022-08:32:16] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_410, Mul_411) (PointWiseV2) [03/13/2022-08:32:16] [V] [TRT] Tactic: 0 time 0.009036 [03/13/2022-08:32:16] [V] [TRT] Tactic: 1 time 0.008764 [03/13/2022-08:32:16] [V] [TRT] Tactic: 2 time 0.009116 [03/13/2022-08:32:16] [V] [TRT] Tactic: 3 time 0.008608 [03/13/2022-08:32:16] [V] [TRT] Tactic: 4 time 0.009464 [03/13/2022-08:32:16] [V] [TRT] Tactic: 5 time 0.008856 [03/13/2022-08:32:16] [V] [TRT] Tactic: 6 time 0.0112 [03/13/2022-08:32:16] [V] [TRT] Tactic: 7 time 0.010552 [03/13/2022-08:32:16] [V] [TRT] Tactic: 8 time 0.01012 [03/13/2022-08:32:16] [V] [TRT] Tactic: 9 time 0.010448 [03/13/2022-08:32:16] [V] [TRT] Tactic: 10 time 0.008928 [03/13/2022-08:32:16] [V] [TRT] Tactic: 11 time 0.008788 [03/13/2022-08:32:16] [V] [TRT] Tactic: 12 time 0.008548 [03/13/2022-08:32:16] [V] [TRT] Tactic: 13 time 0.0081 [03/13/2022-08:32:16] [V] [TRT] Tactic: 14 time 0.008176 [03/13/2022-08:32:16] [V] [TRT] Tactic: 15 time 0.008324 [03/13/2022-08:32:16] [V] [TRT] Tactic: 16 time 0.008864 [03/13/2022-08:32:16] [V] [TRT] Tactic: 17 time 0.00872 [03/13/2022-08:32:16] [V] [TRT] Tactic: 18 time 0.009188 [03/13/2022-08:32:16] [V] [TRT] Tactic: 19 time 0.008416 [03/13/2022-08:32:16] [V] [TRT] Tactic: 20 time 0.008732 [03/13/2022-08:32:16] [V] [TRT] Tactic: 21 time 0.008936 [03/13/2022-08:32:16] [V] [TRT] Tactic: 22 time 0.008716 [03/13/2022-08:32:16] [V] [TRT] Tactic: 23 time 0.008032 [03/13/2022-08:32:16] [V] [TRT] Tactic: 24 time 0.011036 [03/13/2022-08:32:16] [V] [TRT] Tactic: 25 time 0.008948 [03/13/2022-08:32:16] [V] [TRT] Tactic: 26 time 0.009148 [03/13/2022-08:32:16] [V] [TRT] Tactic: 27 time 0.010188 [03/13/2022-08:32:16] [V] [TRT] Tactic: 28 time 0.007648 [03/13/2022-08:32:16] [V] [TRT] Tactic: 29 time 0.007924 [03/13/2022-08:32:16] [V] [TRT] Tactic: 30 time 0.008416 [03/13/2022-08:32:16] [V] [TRT] Tactic: 31 time 0.010624 [03/13/2022-08:32:16] [V] [TRT] Fastest Tactic: 28 Time: 0.007648 [03/13/2022-08:32:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [03/13/2022-08:32:16] [V] [TRT] [03/13/2022-08:32:16] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,96000) -> Float(1,20,300,192000) *************** [03/13/2022-08:32:16] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_343, Mul_344) (PointWise) [03/13/2022-08:32:16] [V] [TRT] Tactic: 128 time 0.016472 [03/13/2022-08:32:16] [V] [TRT] Tactic: 256 time 0.016504 [03/13/2022-08:32:16] [V] [TRT] Tactic: 512 time 0.017716 [03/13/2022-08:32:16] [V] [TRT] Tactic: -32 time 0.032528 [03/13/2022-08:32:16] [V] [TRT] Tactic: -64 time 0.020696 [03/13/2022-08:32:16] [V] [TRT] Tactic: -128 time 0.017152 [03/13/2022-08:32:16] [V] [TRT] Fastest Tactic: 128 Time: 0.016472 [03/13/2022-08:32:16] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_343, Mul_344) (PointWiseV2) [03/13/2022-08:32:16] [V] [TRT] Tactic: 0 time 0.010956 [03/13/2022-08:32:16] [V] [TRT] Tactic: 1 time 0.00936 [03/13/2022-08:32:16] [V] [TRT] Tactic: 2 time 0.008792 [03/13/2022-08:32:16] [V] [TRT] Tactic: 3 time 0.00822 [03/13/2022-08:32:16] [V] [TRT] Tactic: 4 time 0.007916 [03/13/2022-08:32:16] [V] [TRT] Tactic: 5 time 0.007412 [03/13/2022-08:32:16] [V] [TRT] Tactic: 6 time 0.008024 [03/13/2022-08:32:16] [V] [TRT] Tactic: 7 time 0.006624 [03/13/2022-08:32:16] [V] [TRT] Tactic: 8 time 0.007012 [03/13/2022-08:32:16] [V] [TRT] Tactic: 9 time 0.007616 [03/13/2022-08:32:16] [V] [TRT] Tactic: 28 time 0.010672 [03/13/2022-08:32:16] [V] [TRT] Fastest Tactic: 7 Time: 0.006624 [03/13/2022-08:32:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [03/13/2022-08:32:16] [V] [TRT] [03/13/2022-08:32:16] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,3000) -> Float(1,20,300:32,6000) *************** [03/13/2022-08:32:16] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_343, Mul_344) (PointWise) [03/13/2022-08:32:16] [V] [TRT] Tactic: 128 time 0.016288 [03/13/2022-08:32:16] [V] [TRT] Tactic: 256 time 0.01664 [03/13/2022-08:32:16] [V] [TRT] Tactic: 512 time 0.0178 [03/13/2022-08:32:16] [V] [TRT] Tactic: -32 time 0.032444 [03/13/2022-08:32:16] [V] [TRT] Tactic: -64 time 0.020808 [03/13/2022-08:32:16] [V] [TRT] Tactic: -128 time 0.017028 [03/13/2022-08:32:16] [V] [TRT] Fastest Tactic: 128 Time: 0.016288 [03/13/2022-08:32:16] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_343, Mul_344) (PointWiseV2) [03/13/2022-08:32:16] [V] [TRT] Tactic: 24 time 0.0091 [03/13/2022-08:32:16] [V] [TRT] Tactic: 25 time 0.008916 [03/13/2022-08:32:16] [V] [TRT] Tactic: 26 time 0.008836 [03/13/2022-08:32:16] [V] [TRT] Tactic: 27 time 0.010464 [03/13/2022-08:32:16] [V] [TRT] Tactic: 31 time 0.00934 [03/13/2022-08:32:16] [V] [TRT] Fastest Tactic: 26 Time: 0.008836 [03/13/2022-08:32:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [03/13/2022-08:32:16] [V] [TRT] [03/13/2022-08:32:16] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,96000) -> Half(1,20,300,192000) *************** [03/13/2022-08:32:16] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_343, Mul_344) (PointWise) [03/13/2022-08:32:16] [V] [TRT] Tactic: 128 time 0.01616 [03/13/2022-08:32:16] [V] [TRT] Tactic: 256 time 0.014888 [03/13/2022-08:32:16] [V] [TRT] Tactic: 512 time 0.016188 [03/13/2022-08:32:16] [V] [TRT] Tactic: -32 time 0.03224 [03/13/2022-08:32:16] [V] [TRT] Tactic: -64 time 0.02078 [03/13/2022-08:32:16] [V] [TRT] Tactic: -128 time 0.016532 [03/13/2022-08:32:16] [V] [TRT] Fastest Tactic: 256 Time: 0.014888 [03/13/2022-08:32:16] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_343, Mul_344) (PointWiseV2) [03/13/2022-08:32:16] [V] [TRT] Tactic: 0 time 0.010628 [03/13/2022-08:32:16] [V] [TRT] Tactic: 1 time 0.00886 [03/13/2022-08:32:16] [V] [TRT] Tactic: 2 time 0.008532 [03/13/2022-08:32:16] [V] [TRT] Tactic: 3 time 0.008364 [03/13/2022-08:32:16] [V] [TRT] Tactic: 4 time 0.007868 [03/13/2022-08:32:16] [V] [TRT] Tactic: 5 time 0.007712 [03/13/2022-08:32:16] [V] [TRT] Tactic: 6 time 0.007948 [03/13/2022-08:32:17] [V] [TRT] Tactic: 7 time 0.006816 [03/13/2022-08:32:17] [V] [TRT] Tactic: 8 time 0.00696 [03/13/2022-08:32:17] [V] [TRT] Tactic: 9 time 0.007 [03/13/2022-08:32:17] [V] [TRT] Tactic: 28 time 0.010708 [03/13/2022-08:32:17] [V] [TRT] Fastest Tactic: 7 Time: 0.006816 [03/13/2022-08:32:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [03/13/2022-08:32:17] [V] [TRT] [03/13/2022-08:32:17] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,48000) -> Half(1,20,300:2,96000) *************** [03/13/2022-08:32:17] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_343, Mul_344) (PointWise) [03/13/2022-08:32:17] [V] [TRT] Tactic: 128 time 0.01592 [03/13/2022-08:32:17] [V] [TRT] Tactic: 256 time 0.015268 [03/13/2022-08:32:17] [V] [TRT] Tactic: 512 time 0.016272 [03/13/2022-08:32:17] [V] [TRT] Tactic: -32 time 0.032484 [03/13/2022-08:32:17] [V] [TRT] Tactic: -64 time 0.020916 [03/13/2022-08:32:17] [V] [TRT] Tactic: -128 time 0.01668 [03/13/2022-08:32:17] [V] [TRT] Fastest Tactic: 256 Time: 0.015268 [03/13/2022-08:32:17] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_343, Mul_344) (PointWiseV2) [03/13/2022-08:32:17] [V] [TRT] Tactic: 0 time 0.008808 [03/13/2022-08:32:17] [V] [TRT] Tactic: 1 time 0.008052 [03/13/2022-08:32:17] [V] [TRT] Tactic: 2 time 0.008088 [03/13/2022-08:32:17] [V] [TRT] Tactic: 3 time 0.007544 [03/13/2022-08:32:17] [V] [TRT] Tactic: 4 time 0.007644 [03/13/2022-08:32:17] [V] [TRT] Tactic: 5 time 0.008056 [03/13/2022-08:32:17] [V] [TRT] Tactic: 6 time 0.008544 [03/13/2022-08:32:17] [V] [TRT] Tactic: 7 time 0.008624 [03/13/2022-08:32:17] [V] [TRT] Tactic: 8 time 0.00856 [03/13/2022-08:32:17] [V] [TRT] Tactic: 9 time 0.008772 [03/13/2022-08:32:17] [V] [TRT] Tactic: 10 time 0.01086 [03/13/2022-08:32:17] [V] [TRT] Tactic: 11 time 0.008616 [03/13/2022-08:32:17] [V] [TRT] Tactic: 12 time 0.0086 [03/13/2022-08:32:17] [V] [TRT] Tactic: 13 time 0.00836 [03/13/2022-08:32:17] [V] [TRT] Tactic: 14 time 0.008144 [03/13/2022-08:32:17] [V] [TRT] Tactic: 15 time 0.00784 [03/13/2022-08:32:17] [V] [TRT] Tactic: 16 time 0.007988 [03/13/2022-08:32:17] [V] [TRT] Tactic: 17 time 0.007804 [03/13/2022-08:32:17] [V] [TRT] Tactic: 18 time 0.006808 [03/13/2022-08:32:17] [V] [TRT] Tactic: 19 time 0.007804 [03/13/2022-08:32:17] [V] [TRT] Tactic: 28 time 0.008668 [03/13/2022-08:32:17] [V] [TRT] Tactic: 29 time 0.011112 [03/13/2022-08:32:17] [V] [TRT] Fastest Tactic: 18 Time: 0.006808 [03/13/2022-08:32:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:32:17] [V] [TRT] [03/13/2022-08:32:17] [V] [TRT] *************** Autotuning format combination: Half(40,800,1:8,12000) -> Half(80,1600,1:8,24000) *************** [03/13/2022-08:32:17] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_343, Mul_344) (PointWise) [03/13/2022-08:32:17] [V] [TRT] Tactic: 128 time 0.01596 [03/13/2022-08:32:17] [V] [TRT] Tactic: 256 time 0.014812 [03/13/2022-08:32:17] [V] [TRT] Tactic: 512 time 0.016112 [03/13/2022-08:32:17] [V] [TRT] Tactic: -32 time 0.023132 [03/13/2022-08:32:17] [V] [TRT] Tactic: -64 time 0.018428 [03/13/2022-08:32:17] [V] [TRT] Tactic: -128 time 0.019084 [03/13/2022-08:32:17] [V] [TRT] Fastest Tactic: 256 Time: 0.014812 [03/13/2022-08:32:17] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_343, Mul_344) (PointWiseV2) [03/13/2022-08:32:17] [V] [TRT] Tactic: 0 time 0.008592 [03/13/2022-08:32:17] [V] [TRT] Tactic: 1 time 0.008724 [03/13/2022-08:32:17] [V] [TRT] Tactic: 2 time 0.00882 [03/13/2022-08:32:17] [V] [TRT] Tactic: 3 time 0.008884 [03/13/2022-08:32:17] [V] [TRT] Tactic: 4 time 0.009824 [03/13/2022-08:32:17] [V] [TRT] Tactic: 5 time 0.009096 [03/13/2022-08:32:17] [V] [TRT] Tactic: 6 time 0.010584 [03/13/2022-08:32:17] [V] [TRT] Tactic: 7 time 0.010724 [03/13/2022-08:32:17] [V] [TRT] Tactic: 8 time 0.009924 [03/13/2022-08:32:17] [V] [TRT] Tactic: 9 time 0.010136 [03/13/2022-08:32:17] [V] [TRT] Tactic: 10 time 0.009036 [03/13/2022-08:32:17] [V] [TRT] Tactic: 11 time 0.008576 [03/13/2022-08:32:17] [V] [TRT] Tactic: 12 time 0.008548 [03/13/2022-08:32:17] [V] [TRT] Tactic: 13 time 0.008128 [03/13/2022-08:32:17] [V] [TRT] Tactic: 14 time 0.008216 [03/13/2022-08:32:17] [V] [TRT] Tactic: 15 time 0.0085 [03/13/2022-08:32:17] [V] [TRT] Tactic: 16 time 0.008724 [03/13/2022-08:32:17] [V] [TRT] Tactic: 17 time 0.008868 [03/13/2022-08:32:17] [V] [TRT] Tactic: 18 time 0.008788 [03/13/2022-08:32:17] [V] [TRT] Tactic: 19 time 0.008664 [03/13/2022-08:32:17] [V] [TRT] Tactic: 20 time 0.008804 [03/13/2022-08:32:17] [V] [TRT] Tactic: 21 time 0.00892 [03/13/2022-08:32:17] [V] [TRT] Tactic: 22 time 0.0085 [03/13/2022-08:32:17] [V] [TRT] Tactic: 23 time 0.0081 [03/13/2022-08:32:17] [V] [TRT] Tactic: 24 time 0.011068 [03/13/2022-08:32:17] [V] [TRT] Tactic: 25 time 0.009404 [03/13/2022-08:32:17] [V] [TRT] Tactic: 26 time 0.009188 [03/13/2022-08:32:17] [V] [TRT] Tactic: 27 time 0.010264 [03/13/2022-08:32:17] [V] [TRT] Tactic: 28 time 0.007672 [03/13/2022-08:32:17] [V] [TRT] Tactic: 29 time 0.007984 [03/13/2022-08:32:17] [V] [TRT] Tactic: 30 time 0.008736 [03/13/2022-08:32:17] [V] [TRT] Tactic: 31 time 0.010676 [03/13/2022-08:32:17] [V] [TRT] Fastest Tactic: 28 Time: 0.007672 [03/13/2022-08:32:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [03/13/2022-08:32:17] [V] [TRT] [03/13/2022-08:32:17] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,192000) -> Float(1,20,300,192000) *************** [03/13/2022-08:32:17] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_347, Mul_348) (PointWise) [03/13/2022-08:32:17] [V] [TRT] Tactic: 128 time 0.017336 [03/13/2022-08:32:17] [V] [TRT] Tactic: 256 time 0.016452 [03/13/2022-08:32:17] [V] [TRT] Tactic: 512 time 0.017776 [03/13/2022-08:32:17] [V] [TRT] Tactic: -32 time 0.032516 [03/13/2022-08:32:17] [V] [TRT] Tactic: -64 time 0.020704 [03/13/2022-08:32:17] [V] [TRT] Tactic: -128 time 0.0168 [03/13/2022-08:32:17] [V] [TRT] Fastest Tactic: 256 Time: 0.016452 [03/13/2022-08:32:17] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_347, Mul_348) (PointWiseV2) [03/13/2022-08:32:17] [V] [TRT] Tactic: 0 time 0.010796 [03/13/2022-08:32:17] [V] [TRT] Tactic: 1 time 0.0092 [03/13/2022-08:32:17] [V] [TRT] Tactic: 2 time 0.00862 [03/13/2022-08:32:17] [V] [TRT] Tactic: 3 time 0.008224 [03/13/2022-08:32:17] [V] [TRT] Tactic: 4 time 0.008108 [03/13/2022-08:32:17] [V] [TRT] Tactic: 5 time 0.007544 [03/13/2022-08:32:17] [V] [TRT] Tactic: 6 time 0.007892 [03/13/2022-08:32:17] [V] [TRT] Tactic: 7 time 0.007328 [03/13/2022-08:32:17] [V] [TRT] Tactic: 8 time 0.006868 [03/13/2022-08:32:17] [V] [TRT] Tactic: 9 time 0.00754 [03/13/2022-08:32:17] [V] [TRT] Tactic: 28 time 0.010544 [03/13/2022-08:32:17] [V] [TRT] Fastest Tactic: 8 Time: 0.006868 [03/13/2022-08:32:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:32:17] [V] [TRT] [03/13/2022-08:32:17] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,6000) -> Float(1,20,300:32,6000) *************** [03/13/2022-08:32:17] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_347, Mul_348) (PointWise) [03/13/2022-08:32:17] [V] [TRT] Tactic: 128 time 0.016456 [03/13/2022-08:32:17] [V] [TRT] Tactic: 256 time 0.016608 [03/13/2022-08:32:17] [V] [TRT] Tactic: 512 time 0.017496 [03/13/2022-08:32:17] [V] [TRT] Tactic: -32 time 0.032468 [03/13/2022-08:32:17] [V] [TRT] Tactic: -64 time 0.020884 [03/13/2022-08:32:17] [V] [TRT] Tactic: -128 time 0.016972 [03/13/2022-08:32:17] [V] [TRT] Fastest Tactic: 128 Time: 0.016456 [03/13/2022-08:32:17] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_347, Mul_348) (PointWiseV2) [03/13/2022-08:32:17] [V] [TRT] Tactic: 24 time 0.009188 [03/13/2022-08:32:17] [V] [TRT] Tactic: 25 time 0.008808 [03/13/2022-08:32:17] [V] [TRT] Tactic: 26 time 0.009 [03/13/2022-08:32:17] [V] [TRT] Tactic: 27 time 0.010648 [03/13/2022-08:32:17] [V] [TRT] Tactic: 31 time 0.009184 [03/13/2022-08:32:17] [V] [TRT] Fastest Tactic: 25 Time: 0.008808 [03/13/2022-08:32:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [03/13/2022-08:32:17] [V] [TRT] [03/13/2022-08:32:17] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,192000) -> Half(1,20,300,192000) *************** [03/13/2022-08:32:17] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_347, Mul_348) (PointWise) [03/13/2022-08:32:17] [V] [TRT] Tactic: 128 time 0.016016 [03/13/2022-08:32:17] [V] [TRT] Tactic: 256 time 0.015128 [03/13/2022-08:32:17] [V] [TRT] Tactic: 512 time 0.016196 [03/13/2022-08:32:17] [V] [TRT] Tactic: -32 time 0.032512 [03/13/2022-08:32:17] [V] [TRT] Tactic: -64 time 0.021144 [03/13/2022-08:32:17] [V] [TRT] Tactic: -128 time 0.01686 [03/13/2022-08:32:17] [V] [TRT] Fastest Tactic: 256 Time: 0.015128 [03/13/2022-08:32:17] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_347, Mul_348) (PointWiseV2) [03/13/2022-08:32:17] [V] [TRT] Tactic: 0 time 0.010736 [03/13/2022-08:32:17] [V] [TRT] Tactic: 1 time 0.009792 [03/13/2022-08:32:17] [V] [TRT] Tactic: 2 time 0.008504 [03/13/2022-08:32:17] [V] [TRT] Tactic: 3 time 0.008196 [03/13/2022-08:32:17] [V] [TRT] Tactic: 4 time 0.008016 [03/13/2022-08:32:17] [V] [TRT] Tactic: 5 time 0.00762 [03/13/2022-08:32:17] [V] [TRT] Tactic: 6 time 0.00798 [03/13/2022-08:32:17] [V] [TRT] Tactic: 7 time 0.007184 [03/13/2022-08:32:17] [V] [TRT] Tactic: 8 time 0.007132 [03/13/2022-08:32:17] [V] [TRT] Tactic: 9 time 0.007132 [03/13/2022-08:32:17] [V] [TRT] Tactic: 28 time 0.010604 [03/13/2022-08:32:17] [V] [TRT] Fastest Tactic: 8 Time: 0.007132 [03/13/2022-08:32:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:32:17] [V] [TRT] [03/13/2022-08:32:17] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300:2,96000) *************** [03/13/2022-08:32:17] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_347, Mul_348) (PointWise) [03/13/2022-08:32:17] [V] [TRT] Tactic: 128 time 0.016112 [03/13/2022-08:32:17] [V] [TRT] Tactic: 256 time 0.014936 [03/13/2022-08:32:17] [V] [TRT] Tactic: 512 time 0.015944 [03/13/2022-08:32:17] [V] [TRT] Tactic: -32 time 0.032468 [03/13/2022-08:32:17] [V] [TRT] Tactic: -64 time 0.02088 [03/13/2022-08:32:17] [V] [TRT] Tactic: -128 time 0.016724 [03/13/2022-08:32:17] [V] [TRT] Fastest Tactic: 256 Time: 0.014936 [03/13/2022-08:32:17] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_347, Mul_348) (PointWiseV2) [03/13/2022-08:32:17] [V] [TRT] Tactic: 0 time 0.008912 [03/13/2022-08:32:17] [V] [TRT] Tactic: 1 time 0.008064 [03/13/2022-08:32:17] [V] [TRT] Tactic: 2 time 0.008024 [03/13/2022-08:32:17] [V] [TRT] Tactic: 3 time 0.007656 [03/13/2022-08:32:17] [V] [TRT] Tactic: 4 time 0.007808 [03/13/2022-08:32:17] [V] [TRT] Tactic: 5 time 0.0079 [03/13/2022-08:32:17] [V] [TRT] Tactic: 6 time 0.008848 [03/13/2022-08:32:17] [V] [TRT] Tactic: 7 time 0.008632 [03/13/2022-08:32:17] [V] [TRT] Tactic: 8 time 0.00854 [03/13/2022-08:32:17] [V] [TRT] Tactic: 9 time 0.009148 [03/13/2022-08:32:17] [V] [TRT] Tactic: 10 time 0.01106 [03/13/2022-08:32:17] [V] [TRT] Tactic: 11 time 0.009036 [03/13/2022-08:32:17] [V] [TRT] Tactic: 12 time 0.008784 [03/13/2022-08:32:17] [V] [TRT] Tactic: 13 time 0.008264 [03/13/2022-08:32:17] [V] [TRT] Tactic: 14 time 0.008112 [03/13/2022-08:32:17] [V] [TRT] Tactic: 15 time 0.008004 [03/13/2022-08:32:17] [V] [TRT] Tactic: 16 time 0.008008 [03/13/2022-08:32:17] [V] [TRT] Tactic: 17 time 0.007976 [03/13/2022-08:32:17] [V] [TRT] Tactic: 18 time 0.007772 [03/13/2022-08:32:17] [V] [TRT] Tactic: 19 time 0.007716 [03/13/2022-08:32:17] [V] [TRT] Tactic: 28 time 0.009284 [03/13/2022-08:32:17] [V] [TRT] Tactic: 29 time 0.011244 [03/13/2022-08:32:17] [V] [TRT] Fastest Tactic: 3 Time: 0.007656 [03/13/2022-08:32:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [03/13/2022-08:32:17] [V] [TRT] [03/13/2022-08:32:17] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Half(80,1600,1:8,24000) *************** [03/13/2022-08:32:17] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_347, Mul_348) (PointWise) [03/13/2022-08:32:17] [V] [TRT] Tactic: 128 time 0.016136 [03/13/2022-08:32:17] [V] [TRT] Tactic: 256 time 0.015364 [03/13/2022-08:32:17] [V] [TRT] Tactic: 512 time 0.016244 [03/13/2022-08:32:18] [V] [TRT] Tactic: -32 time 0.02312 [03/13/2022-08:32:18] [V] [TRT] Tactic: -64 time 0.018312 [03/13/2022-08:32:18] [V] [TRT] Tactic: -128 time 0.018872 [03/13/2022-08:32:18] [V] [TRT] Fastest Tactic: 256 Time: 0.015364 [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_347, Mul_348) (PointWiseV2) [03/13/2022-08:32:18] [V] [TRT] Tactic: 0 time 0.00882 [03/13/2022-08:32:18] [V] [TRT] Tactic: 1 time 0.00858 [03/13/2022-08:32:18] [V] [TRT] Tactic: 2 time 0.009228 [03/13/2022-08:32:18] [V] [TRT] Tactic: 3 time 0.009176 [03/13/2022-08:32:18] [V] [TRT] Tactic: 4 time 0.009992 [03/13/2022-08:32:18] [V] [TRT] Tactic: 5 time 0.009396 [03/13/2022-08:32:18] [V] [TRT] Tactic: 6 time 0.011336 [03/13/2022-08:32:18] [V] [TRT] Tactic: 7 time 0.0106 [03/13/2022-08:32:18] [V] [TRT] Tactic: 8 time 0.010132 [03/13/2022-08:32:18] [V] [TRT] Tactic: 9 time 0.01024 [03/13/2022-08:32:18] [V] [TRT] Tactic: 10 time 0.009036 [03/13/2022-08:32:18] [V] [TRT] Tactic: 11 time 0.00868 [03/13/2022-08:32:18] [V] [TRT] Tactic: 12 time 0.008388 [03/13/2022-08:32:18] [V] [TRT] Tactic: 13 time 0.008068 [03/13/2022-08:32:18] [V] [TRT] Tactic: 14 time 0.008212 [03/13/2022-08:32:18] [V] [TRT] Tactic: 15 time 0.008388 [03/13/2022-08:32:18] [V] [TRT] Tactic: 16 time 0.008692 [03/13/2022-08:32:18] [V] [TRT] Tactic: 17 time 0.008856 [03/13/2022-08:32:18] [V] [TRT] Tactic: 18 time 0.008928 [03/13/2022-08:32:18] [V] [TRT] Tactic: 19 time 0.008948 [03/13/2022-08:32:18] [V] [TRT] Tactic: 20 time 0.009088 [03/13/2022-08:32:18] [V] [TRT] Tactic: 21 time 0.008816 [03/13/2022-08:32:18] [V] [TRT] Tactic: 22 time 0.009136 [03/13/2022-08:32:18] [V] [TRT] Tactic: 23 time 0.008128 [03/13/2022-08:32:18] [V] [TRT] Tactic: 24 time 0.010928 [03/13/2022-08:32:18] [V] [TRT] Tactic: 25 time 0.008872 [03/13/2022-08:32:18] [V] [TRT] Tactic: 26 time 0.009044 [03/13/2022-08:32:18] [V] [TRT] Tactic: 27 time 0.010196 [03/13/2022-08:32:18] [V] [TRT] Tactic: 28 time 0.007668 [03/13/2022-08:32:18] [V] [TRT] Tactic: 29 time 0.008112 [03/13/2022-08:32:18] [V] [TRT] Tactic: 30 time 0.008428 [03/13/2022-08:32:18] [V] [TRT] Tactic: 31 time 0.010788 [03/13/2022-08:32:18] [V] [TRT] Fastest Tactic: 28 Time: 0.007668 [03/13/2022-08:32:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [03/13/2022-08:32:18] [V] [TRT] [03/13/2022-08:32:18] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,192000) -> Float(1,20,300,192000) *************** [03/13/2022-08:32:18] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,192000) -> Half(1,20,300,192000) *************** [03/13/2022-08:32:18] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300,192000) *************** [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: Conv_350 (FusedConvActConvolution) [03/13/2022-08:32:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: Conv_350 (CaskConvolution) [03/13/2022-08:32:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: Conv_350 (CudaConvolution) [03/13/2022-08:32:18] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: Conv_350 (CudaDepthwiseConvolution) [03/13/2022-08:32:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:18] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300:2,96000) *************** [03/13/2022-08:32:18] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Float(1,20,300,192000) *************** [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: Conv_350 (FusedConvActConvolution) [03/13/2022-08:32:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: Conv_350 (CaskConvolution) [03/13/2022-08:32:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: Conv_350 (CudaConvolution) [03/13/2022-08:32:18] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: Conv_350 (CudaDepthwiseConvolution) [03/13/2022-08:32:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:18] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Half(80,1600,1:8,24000) *************** [03/13/2022-08:32:18] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,192000) -> Float(1,20,300,192000) *************** [03/13/2022-08:32:18] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,192000) -> Half(1,20,300,192000) *************** [03/13/2022-08:32:18] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300,192000) *************** [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: Conv_413 (FusedConvActConvolution) [03/13/2022-08:32:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: Conv_413 (CaskConvolution) [03/13/2022-08:32:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: Conv_413 (CudaConvolution) [03/13/2022-08:32:18] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: Conv_413 (CudaDepthwiseConvolution) [03/13/2022-08:32:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:18] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300:2,96000) *************** [03/13/2022-08:32:18] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Float(1,20,300,192000) *************** [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: Conv_413 (FusedConvActConvolution) [03/13/2022-08:32:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: Conv_413 (CaskConvolution) [03/13/2022-08:32:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: Conv_413 (CudaConvolution) [03/13/2022-08:32:18] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: Conv_413 (CudaDepthwiseConvolution) [03/13/2022-08:32:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:18] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Half(80,1600,1:8,24000) *************** [03/13/2022-08:32:18] [V] [TRT] *************** Autotuning format combination: Float(1,2), Float(1,2), Float(1,2) -> Float(1,2) *************** [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN((Unnamed Layer* 282) [Constant] + (Unnamed Layer* 283) [Shuffle], PWN(PWN((Unnamed Layer* 279) [Constant] + (Unnamed Layer* 280) [Shuffle], Mul_301), Sub_303)), Add_305), Mul_328) (PointWise) [03/13/2022-08:32:18] [V] [TRT] Tactic: 128 time 0.00696 [03/13/2022-08:32:18] [V] [TRT] Tactic: 256 time 0.006708 [03/13/2022-08:32:18] [V] [TRT] Tactic: 512 time 0.006544 [03/13/2022-08:32:18] [V] [TRT] Tactic: -32 time 0.049068 [03/13/2022-08:32:18] [V] [TRT] Tactic: -64 time 0.028608 [03/13/2022-08:32:18] [V] [TRT] Tactic: -128 time 0.017304 [03/13/2022-08:32:18] [V] [TRT] Fastest Tactic: 512 Time: 0.006544 [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN((Unnamed Layer* 282) [Constant] + (Unnamed Layer* 283) [Shuffle], PWN(PWN((Unnamed Layer* 279) [Constant] + (Unnamed Layer* 280) [Shuffle], Mul_301), Sub_303)), Add_305), Mul_328) (PointWiseV2) [03/13/2022-08:32:18] [V] [TRT] Tactic: 0 time 0.0053 [03/13/2022-08:32:18] [V] [TRT] Tactic: 1 time 0.005416 [03/13/2022-08:32:18] [V] [TRT] Tactic: 2 time 0.005212 [03/13/2022-08:32:18] [V] [TRT] Tactic: 3 time 0.005988 [03/13/2022-08:32:18] [V] [TRT] Tactic: 4 time 0.005656 [03/13/2022-08:32:18] [V] [TRT] Tactic: 5 time 0.005568 [03/13/2022-08:32:18] [V] [TRT] Tactic: 6 time 0.006764 [03/13/2022-08:32:18] [V] [TRT] Tactic: 7 time 0.006404 [03/13/2022-08:32:18] [V] [TRT] Tactic: 8 time 0.00592 [03/13/2022-08:32:18] [V] [TRT] Tactic: 9 time 0.006528 [03/13/2022-08:32:18] [V] [TRT] Tactic: 28 time 0.005448 [03/13/2022-08:32:18] [V] [TRT] Fastest Tactic: 2 Time: 0.005212 [03/13/2022-08:32:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [03/13/2022-08:32:18] [V] [TRT] [03/13/2022-08:32:18] [V] [TRT] *************** Autotuning format combination: Half(1,2), Half(1,2), Half(1,2) -> Half(1,2) *************** [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN((Unnamed Layer* 282) [Constant] + (Unnamed Layer* 283) [Shuffle], PWN(PWN((Unnamed Layer* 279) [Constant] + (Unnamed Layer* 280) [Shuffle], Mul_301), Sub_303)), Add_305), Mul_328) (PointWise) [03/13/2022-08:32:18] [V] [TRT] Tactic: 128 time 0.010908 [03/13/2022-08:32:18] [V] [TRT] Tactic: 256 time 0.011192 [03/13/2022-08:32:18] [V] [TRT] Tactic: 512 time 0.012128 [03/13/2022-08:32:18] [V] [TRT] Tactic: -32 time 0.05722 [03/13/2022-08:32:18] [V] [TRT] Tactic: -64 time 0.03352 [03/13/2022-08:32:18] [V] [TRT] Tactic: -128 time 0.019088 [03/13/2022-08:32:18] [V] [TRT] Fastest Tactic: 128 Time: 0.010908 [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN((Unnamed Layer* 282) [Constant] + (Unnamed Layer* 283) [Shuffle], PWN(PWN((Unnamed Layer* 279) [Constant] + (Unnamed Layer* 280) [Shuffle], Mul_301), Sub_303)), Add_305), Mul_328) (PointWiseV2) [03/13/2022-08:32:18] [V] [TRT] Tactic: 0 time 0.00508 [03/13/2022-08:32:18] [V] [TRT] Tactic: 1 time 0.004808 [03/13/2022-08:32:18] [V] [TRT] Tactic: 2 time 0.004972 [03/13/2022-08:32:18] [V] [TRT] Tactic: 3 time 0.006232 [03/13/2022-08:32:18] [V] [TRT] Tactic: 4 time 0.005768 [03/13/2022-08:32:18] [V] [TRT] Tactic: 5 time 0.005304 [03/13/2022-08:32:18] [V] [TRT] Tactic: 6 time 0.006632 [03/13/2022-08:32:18] [V] [TRT] Tactic: 7 time 0.00652 [03/13/2022-08:32:18] [V] [TRT] Tactic: 8 time 0.006204 [03/13/2022-08:32:18] [V] [TRT] Tactic: 9 time 0.005636 [03/13/2022-08:32:18] [V] [TRT] Tactic: 28 time 0.004892 [03/13/2022-08:32:18] [V] [TRT] Fastest Tactic: 1 Time: 0.004808 [03/13/2022-08:32:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [03/13/2022-08:32:18] [V] [TRT] [03/13/2022-08:32:18] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,192000) -> Float(1,20,300,192000) *************** [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_352, Mul_353) (PointWise) [03/13/2022-08:32:18] [V] [TRT] Tactic: 128 time 0.025796 [03/13/2022-08:32:18] [V] [TRT] Tactic: 256 time 0.026656 [03/13/2022-08:32:18] [V] [TRT] Tactic: 512 time 0.029432 [03/13/2022-08:32:18] [V] [TRT] Tactic: -32 time 0.043064 [03/13/2022-08:32:18] [V] [TRT] Tactic: -64 time 0.031904 [03/13/2022-08:32:18] [V] [TRT] Tactic: -128 time 0.028692 [03/13/2022-08:32:18] [V] [TRT] Fastest Tactic: 128 Time: 0.025796 [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_352, Mul_353) (PointWiseV2) [03/13/2022-08:32:18] [V] [TRT] Tactic: 0 time 0.019068 [03/13/2022-08:32:18] [V] [TRT] Tactic: 1 time 0.016424 [03/13/2022-08:32:18] [V] [TRT] Tactic: 2 time 0.014724 [03/13/2022-08:32:18] [V] [TRT] Tactic: 3 time 0.0164 [03/13/2022-08:32:18] [V] [TRT] Tactic: 4 time 0.014668 [03/13/2022-08:32:18] [V] [TRT] Tactic: 5 time 0.013804 [03/13/2022-08:32:18] [V] [TRT] Tactic: 6 time 0.01662 [03/13/2022-08:32:18] [V] [TRT] Tactic: 7 time 0.014316 [03/13/2022-08:32:18] [V] [TRT] Tactic: 8 time 0.013992 [03/13/2022-08:32:18] [V] [TRT] Tactic: 9 time 0.012924 [03/13/2022-08:32:18] [V] [TRT] Tactic: 28 time 0.018748 [03/13/2022-08:32:18] [V] [TRT] Fastest Tactic: 9 Time: 0.012924 [03/13/2022-08:32:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:32:18] [V] [TRT] [03/13/2022-08:32:18] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,6000) -> Float(1,20,300:32,6000) *************** [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_352, Mul_353) (PointWise) [03/13/2022-08:32:18] [V] [TRT] Tactic: 128 time 0.026308 [03/13/2022-08:32:18] [V] [TRT] Tactic: 256 time 0.026608 [03/13/2022-08:32:18] [V] [TRT] Tactic: 512 time 0.029204 [03/13/2022-08:32:18] [V] [TRT] Tactic: -32 time 0.0434 [03/13/2022-08:32:18] [V] [TRT] Tactic: -64 time 0.03154 [03/13/2022-08:32:18] [V] [TRT] Tactic: -128 time 0.028696 [03/13/2022-08:32:18] [V] [TRT] Fastest Tactic: 128 Time: 0.026308 [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_352, Mul_353) (PointWiseV2) [03/13/2022-08:32:18] [V] [TRT] Tactic: 24 time 0.015256 [03/13/2022-08:32:18] [V] [TRT] Tactic: 25 time 0.01532 [03/13/2022-08:32:18] [V] [TRT] Tactic: 26 time 0.015064 [03/13/2022-08:32:18] [V] [TRT] Tactic: 27 time 0.015128 [03/13/2022-08:32:18] [V] [TRT] Tactic: 31 time 0.015496 [03/13/2022-08:32:18] [V] [TRT] Fastest Tactic: 26 Time: 0.015064 [03/13/2022-08:32:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [03/13/2022-08:32:18] [V] [TRT] [03/13/2022-08:32:18] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,192000) -> Half(1,20,300,192000) *************** [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_352, Mul_353) (PointWise) [03/13/2022-08:32:18] [V] [TRT] Tactic: 128 time 0.026404 [03/13/2022-08:32:18] [V] [TRT] Tactic: 256 time 0.023592 [03/13/2022-08:32:18] [V] [TRT] Tactic: 512 time 0.023068 [03/13/2022-08:32:18] [V] [TRT] Tactic: -32 time 0.035828 [03/13/2022-08:32:18] [V] [TRT] Tactic: -64 time 0.029992 [03/13/2022-08:32:18] [V] [TRT] Tactic: -128 time 0.026904 [03/13/2022-08:32:18] [V] [TRT] Fastest Tactic: 512 Time: 0.023068 [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_352, Mul_353) (PointWiseV2) [03/13/2022-08:32:18] [V] [TRT] Tactic: 0 time 0.014632 [03/13/2022-08:32:18] [V] [TRT] Tactic: 1 time 0.012152 [03/13/2022-08:32:18] [V] [TRT] Tactic: 2 time 0.0107 [03/13/2022-08:32:18] [V] [TRT] Tactic: 3 time 0.010744 [03/13/2022-08:32:18] [V] [TRT] Tactic: 4 time 0.01 [03/13/2022-08:32:18] [V] [TRT] Tactic: 5 time 0.009116 [03/13/2022-08:32:18] [V] [TRT] Tactic: 6 time 0.010236 [03/13/2022-08:32:18] [V] [TRT] Tactic: 7 time 0.008884 [03/13/2022-08:32:18] [V] [TRT] Tactic: 8 time 0.008712 [03/13/2022-08:32:18] [V] [TRT] Tactic: 9 time 0.008576 [03/13/2022-08:32:18] [V] [TRT] Tactic: 28 time 0.014316 [03/13/2022-08:32:18] [V] [TRT] Fastest Tactic: 9 Time: 0.008576 [03/13/2022-08:32:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:32:18] [V] [TRT] [03/13/2022-08:32:18] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300:2,96000) *************** [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_352, Mul_353) (PointWise) [03/13/2022-08:32:18] [V] [TRT] Tactic: 128 time 0.026636 [03/13/2022-08:32:18] [V] [TRT] Tactic: 256 time 0.023132 [03/13/2022-08:32:18] [V] [TRT] Tactic: 512 time 0.022812 [03/13/2022-08:32:18] [V] [TRT] Tactic: -32 time 0.03542 [03/13/2022-08:32:18] [V] [TRT] Tactic: -64 time 0.029748 [03/13/2022-08:32:18] [V] [TRT] Tactic: -128 time 0.026868 [03/13/2022-08:32:18] [V] [TRT] Fastest Tactic: 512 Time: 0.022812 [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_352, Mul_353) (PointWiseV2) [03/13/2022-08:32:18] [V] [TRT] Tactic: 0 time 0.011668 [03/13/2022-08:32:18] [V] [TRT] Tactic: 1 time 0.010248 [03/13/2022-08:32:18] [V] [TRT] Tactic: 2 time 0.0109 [03/13/2022-08:32:18] [V] [TRT] Tactic: 3 time 0.009908 [03/13/2022-08:32:18] [V] [TRT] Tactic: 4 time 0.011252 [03/13/2022-08:32:18] [V] [TRT] Tactic: 5 time 0.01222 [03/13/2022-08:32:18] [V] [TRT] Tactic: 6 time 0.009228 [03/13/2022-08:32:18] [V] [TRT] Tactic: 7 time 0.010156 [03/13/2022-08:32:18] [V] [TRT] Tactic: 8 time 0.011484 [03/13/2022-08:32:18] [V] [TRT] Tactic: 9 time 0.014384 [03/13/2022-08:32:18] [V] [TRT] Tactic: 10 time 0.015076 [03/13/2022-08:32:18] [V] [TRT] Tactic: 11 time 0.012584 [03/13/2022-08:32:18] [V] [TRT] Tactic: 12 time 0.011928 [03/13/2022-08:32:18] [V] [TRT] Tactic: 13 time 0.010952 [03/13/2022-08:32:18] [V] [TRT] Tactic: 14 time 0.01024 [03/13/2022-08:32:18] [V] [TRT] Tactic: 15 time 0.010096 [03/13/2022-08:32:18] [V] [TRT] Tactic: 16 time 0.010356 [03/13/2022-08:32:18] [V] [TRT] Tactic: 17 time 0.00944 [03/13/2022-08:32:18] [V] [TRT] Tactic: 18 time 0.008884 [03/13/2022-08:32:18] [V] [TRT] Tactic: 19 time 0.010008 [03/13/2022-08:32:18] [V] [TRT] Tactic: 28 time 0.01116 [03/13/2022-08:32:18] [V] [TRT] Tactic: 29 time 0.015264 [03/13/2022-08:32:18] [V] [TRT] Fastest Tactic: 18 Time: 0.008884 [03/13/2022-08:32:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:32:18] [V] [TRT] [03/13/2022-08:32:18] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Half(80,1600,1:8,24000) *************** [03/13/2022-08:32:18] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_352, Mul_353) (PointWise) [03/13/2022-08:32:18] [V] [TRT] Tactic: 128 time 0.026464 [03/13/2022-08:32:19] [V] [TRT] Tactic: 256 time 0.023024 [03/13/2022-08:32:19] [V] [TRT] Tactic: 512 time 0.023092 [03/13/2022-08:32:19] [V] [TRT] Tactic: -32 time 0.0356 [03/13/2022-08:32:19] [V] [TRT] Tactic: -64 time 0.030088 [03/13/2022-08:32:19] [V] [TRT] Tactic: -128 time 0.026844 [03/13/2022-08:32:19] [V] [TRT] Fastest Tactic: 256 Time: 0.023024 [03/13/2022-08:32:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_352, Mul_353) (PointWiseV2) [03/13/2022-08:32:19] [V] [TRT] Tactic: 0 time 0.010268 [03/13/2022-08:32:19] [V] [TRT] Tactic: 1 time 0.009928 [03/13/2022-08:32:19] [V] [TRT] Tactic: 2 time 0.011864 [03/13/2022-08:32:19] [V] [TRT] Tactic: 3 time 0.010292 [03/13/2022-08:32:19] [V] [TRT] Tactic: 4 time 0.012104 [03/13/2022-08:32:19] [V] [TRT] Tactic: 5 time 0.015144 [03/13/2022-08:32:19] [V] [TRT] Tactic: 6 time 0.014176 [03/13/2022-08:32:19] [V] [TRT] Tactic: 7 time 0.01506 [03/13/2022-08:32:19] [V] [TRT] Tactic: 8 time 0.016232 [03/13/2022-08:32:19] [V] [TRT] Tactic: 9 time 0.02274 [03/13/2022-08:32:19] [V] [TRT] Tactic: 10 time 0.010564 [03/13/2022-08:32:19] [V] [TRT] Tactic: 11 time 0.009596 [03/13/2022-08:32:19] [V] [TRT] Tactic: 12 time 0.010664 [03/13/2022-08:32:19] [V] [TRT] Tactic: 13 time 0.009344 [03/13/2022-08:32:19] [V] [TRT] Tactic: 14 time 0.010172 [03/13/2022-08:32:19] [V] [TRT] Tactic: 15 time 0.013036 [03/13/2022-08:32:19] [V] [TRT] Tactic: 16 time 0.01116 [03/13/2022-08:32:19] [V] [TRT] Tactic: 17 time 0.011036 [03/13/2022-08:32:19] [V] [TRT] Tactic: 18 time 0.013284 [03/13/2022-08:32:19] [V] [TRT] Tactic: 19 time 0.017604 [03/13/2022-08:32:19] [V] [TRT] Tactic: 20 time 0.011992 [03/13/2022-08:32:19] [V] [TRT] Tactic: 21 time 0.010608 [03/13/2022-08:32:19] [V] [TRT] Tactic: 22 time 0.009976 [03/13/2022-08:32:19] [V] [TRT] Tactic: 23 time 0.008976 [03/13/2022-08:32:19] [V] [TRT] Tactic: 24 time 0.015176 [03/13/2022-08:32:19] [V] [TRT] Tactic: 25 time 0.01282 [03/13/2022-08:32:19] [V] [TRT] Tactic: 26 time 0.0108 [03/13/2022-08:32:19] [V] [TRT] Tactic: 27 time 0.010484 [03/13/2022-08:32:19] [V] [TRT] Tactic: 28 time 0.010228 [03/13/2022-08:32:19] [V] [TRT] Tactic: 29 time 0.010556 [03/13/2022-08:32:19] [V] [TRT] Tactic: 30 time 0.01176 [03/13/2022-08:32:19] [V] [TRT] Tactic: 31 time 0.015432 [03/13/2022-08:32:19] [V] [TRT] Fastest Tactic: 23 Time: 0.008976 [03/13/2022-08:32:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 23 [03/13/2022-08:32:19] [V] [TRT] [03/13/2022-08:32:19] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,192000) -> Float(1,20,300,192000) *************** [03/13/2022-08:32:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_415, Mul_416) (PointWise) [03/13/2022-08:32:19] [V] [TRT] Tactic: 128 time 0.026652 [03/13/2022-08:32:19] [V] [TRT] Tactic: 256 time 0.026652 [03/13/2022-08:32:19] [V] [TRT] Tactic: 512 time 0.029408 [03/13/2022-08:32:19] [V] [TRT] Tactic: -32 time 0.04316 [03/13/2022-08:32:19] [V] [TRT] Tactic: -64 time 0.031828 [03/13/2022-08:32:19] [V] [TRT] Tactic: -128 time 0.0288 [03/13/2022-08:32:19] [V] [TRT] Fastest Tactic: 128 Time: 0.026652 [03/13/2022-08:32:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_415, Mul_416) (PointWiseV2) [03/13/2022-08:32:19] [V] [TRT] Tactic: 0 time 0.01922 [03/13/2022-08:32:19] [V] [TRT] Tactic: 1 time 0.01628 [03/13/2022-08:32:19] [V] [TRT] Tactic: 2 time 0.014536 [03/13/2022-08:32:19] [V] [TRT] Tactic: 3 time 0.016284 [03/13/2022-08:32:19] [V] [TRT] Tactic: 4 time 0.014364 [03/13/2022-08:32:19] [V] [TRT] Tactic: 5 time 0.013916 [03/13/2022-08:32:19] [V] [TRT] Tactic: 6 time 0.016248 [03/13/2022-08:32:19] [V] [TRT] Tactic: 7 time 0.014376 [03/13/2022-08:32:19] [V] [TRT] Tactic: 8 time 0.014208 [03/13/2022-08:32:19] [V] [TRT] Tactic: 9 time 0.013192 [03/13/2022-08:32:19] [V] [TRT] Tactic: 28 time 0.019304 [03/13/2022-08:32:19] [V] [TRT] Fastest Tactic: 9 Time: 0.013192 [03/13/2022-08:32:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [03/13/2022-08:32:19] [V] [TRT] [03/13/2022-08:32:19] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,6000) -> Float(1,20,300:32,6000) *************** [03/13/2022-08:32:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_415, Mul_416) (PointWise) [03/13/2022-08:32:19] [V] [TRT] Tactic: 128 time 0.026276 [03/13/2022-08:32:19] [V] [TRT] Tactic: 256 time 0.026688 [03/13/2022-08:32:19] [V] [TRT] Tactic: 512 time 0.029572 [03/13/2022-08:32:19] [V] [TRT] Tactic: -32 time 0.043496 [03/13/2022-08:32:19] [V] [TRT] Tactic: -64 time 0.031684 [03/13/2022-08:32:19] [V] [TRT] Tactic: -128 time 0.028708 [03/13/2022-08:32:19] [V] [TRT] Fastest Tactic: 128 Time: 0.026276 [03/13/2022-08:32:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_415, Mul_416) (PointWiseV2) [03/13/2022-08:32:19] [V] [TRT] Tactic: 24 time 0.015332 [03/13/2022-08:32:19] [V] [TRT] Tactic: 25 time 0.0153 [03/13/2022-08:32:19] [V] [TRT] Tactic: 26 time 0.015224 [03/13/2022-08:32:19] [V] [TRT] Tactic: 27 time 0.015164 [03/13/2022-08:32:19] [V] [TRT] Tactic: 31 time 0.014832 [03/13/2022-08:32:19] [V] [TRT] Fastest Tactic: 31 Time: 0.014832 [03/13/2022-08:32:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [03/13/2022-08:32:19] [V] [TRT] [03/13/2022-08:32:19] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,192000) -> Half(1,20,300,192000) *************** [03/13/2022-08:32:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_415, Mul_416) (PointWise) [03/13/2022-08:32:19] [V] [TRT] Tactic: 128 time 0.02644 [03/13/2022-08:32:19] [V] [TRT] Tactic: 256 time 0.023408 [03/13/2022-08:32:19] [V] [TRT] Tactic: 512 time 0.023036 [03/13/2022-08:32:19] [V] [TRT] Tactic: -32 time 0.035608 [03/13/2022-08:32:19] [V] [TRT] Tactic: -64 time 0.030172 [03/13/2022-08:32:19] [V] [TRT] Tactic: -128 time 0.02674 [03/13/2022-08:32:19] [V] [TRT] Fastest Tactic: 512 Time: 0.023036 [03/13/2022-08:32:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_415, Mul_416) (PointWiseV2) [03/13/2022-08:32:19] [V] [TRT] Tactic: 0 time 0.014664 [03/13/2022-08:32:19] [V] [TRT] Tactic: 1 time 0.012176 [03/13/2022-08:32:19] [V] [TRT] Tactic: 2 time 0.010936 [03/13/2022-08:32:19] [V] [TRT] Tactic: 3 time 0.010832 [03/13/2022-08:32:19] [V] [TRT] Tactic: 4 time 0.010116 [03/13/2022-08:32:19] [V] [TRT] Tactic: 5 time 0.009084 [03/13/2022-08:32:19] [V] [TRT] Tactic: 6 time 0.010232 [03/13/2022-08:32:19] [V] [TRT] Tactic: 7 time 0.0092 [03/13/2022-08:32:19] [V] [TRT] Tactic: 8 time 0.008504 [03/13/2022-08:32:19] [V] [TRT] Tactic: 9 time 0.00916 [03/13/2022-08:32:19] [V] [TRT] Tactic: 28 time 0.014352 [03/13/2022-08:32:19] [V] [TRT] Fastest Tactic: 8 Time: 0.008504 [03/13/2022-08:32:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [03/13/2022-08:32:19] [V] [TRT] [03/13/2022-08:32:19] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300:2,96000) *************** [03/13/2022-08:32:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_415, Mul_416) (PointWise) [03/13/2022-08:32:19] [V] [TRT] Tactic: 128 time 0.026344 [03/13/2022-08:32:19] [V] [TRT] Tactic: 256 time 0.023396 [03/13/2022-08:32:19] [V] [TRT] Tactic: 512 time 0.022832 [03/13/2022-08:32:19] [V] [TRT] Tactic: -32 time 0.035444 [03/13/2022-08:32:19] [V] [TRT] Tactic: -64 time 0.030148 [03/13/2022-08:32:19] [V] [TRT] Tactic: -128 time 0.026736 [03/13/2022-08:32:19] [V] [TRT] Fastest Tactic: 512 Time: 0.022832 [03/13/2022-08:32:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_415, Mul_416) (PointWiseV2) [03/13/2022-08:32:19] [V] [TRT] Tactic: 0 time 0.011828 [03/13/2022-08:32:19] [V] [TRT] Tactic: 1 time 0.010224 [03/13/2022-08:32:19] [V] [TRT] Tactic: 2 time 0.011768 [03/13/2022-08:32:19] [V] [TRT] Tactic: 3 time 0.009932 [03/13/2022-08:32:19] [V] [TRT] Tactic: 4 time 0.010904 [03/13/2022-08:32:19] [V] [TRT] Tactic: 5 time 0.012312 [03/13/2022-08:32:19] [V] [TRT] Tactic: 6 time 0.009768 [03/13/2022-08:32:19] [V] [TRT] Tactic: 7 time 0.009996 [03/13/2022-08:32:19] [V] [TRT] Tactic: 8 time 0.011488 [03/13/2022-08:32:19] [V] [TRT] Tactic: 9 time 0.014316 [03/13/2022-08:32:19] [V] [TRT] Tactic: 10 time 0.01516 [03/13/2022-08:32:19] [V] [TRT] Tactic: 11 time 0.012584 [03/13/2022-08:32:19] [V] [TRT] Tactic: 12 time 0.011752 [03/13/2022-08:32:19] [V] [TRT] Tactic: 13 time 0.011632 [03/13/2022-08:32:19] [V] [TRT] Tactic: 14 time 0.010168 [03/13/2022-08:32:19] [V] [TRT] Tactic: 15 time 0.010076 [03/13/2022-08:32:19] [V] [TRT] Tactic: 16 time 0.010304 [03/13/2022-08:32:19] [V] [TRT] Tactic: 17 time 0.009504 [03/13/2022-08:32:19] [V] [TRT] Tactic: 18 time 0.009476 [03/13/2022-08:32:19] [V] [TRT] Tactic: 19 time 0.009764 [03/13/2022-08:32:19] [V] [TRT] Tactic: 28 time 0.011508 [03/13/2022-08:32:19] [V] [TRT] Tactic: 29 time 0.015204 [03/13/2022-08:32:19] [V] [TRT] Fastest Tactic: 18 Time: 0.009476 [03/13/2022-08:32:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18 [03/13/2022-08:32:19] [V] [TRT] [03/13/2022-08:32:19] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Half(80,1600,1:8,24000) *************** [03/13/2022-08:32:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_415, Mul_416) (PointWise) [03/13/2022-08:32:19] [V] [TRT] Tactic: 128 time 0.026308 [03/13/2022-08:32:19] [V] [TRT] Tactic: 256 time 0.023256 [03/13/2022-08:32:19] [V] [TRT] Tactic: 512 time 0.022956 [03/13/2022-08:32:19] [V] [TRT] Tactic: -32 time 0.035664 [03/13/2022-08:32:19] [V] [TRT] Tactic: -64 time 0.029616 [03/13/2022-08:32:19] [V] [TRT] Tactic: -128 time 0.026864 [03/13/2022-08:32:19] [V] [TRT] Fastest Tactic: 512 Time: 0.022956 [03/13/2022-08:32:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_415, Mul_416) (PointWiseV2) [03/13/2022-08:32:19] [V] [TRT] Tactic: 0 time 0.010204 [03/13/2022-08:32:19] [V] [TRT] Tactic: 1 time 0.010112 [03/13/2022-08:32:19] [V] [TRT] Tactic: 2 time 0.011912 [03/13/2022-08:32:19] [V] [TRT] Tactic: 3 time 0.010272 [03/13/2022-08:32:19] [V] [TRT] Tactic: 4 time 0.012208 [03/13/2022-08:32:19] [V] [TRT] Tactic: 5 time 0.01566 [03/13/2022-08:32:19] [V] [TRT] Tactic: 6 time 0.014204 [03/13/2022-08:32:19] [V] [TRT] Tactic: 7 time 0.015324 [03/13/2022-08:32:19] [V] [TRT] Tactic: 8 time 0.016136 [03/13/2022-08:32:19] [V] [TRT] Tactic: 9 time 0.0225 [03/13/2022-08:32:19] [V] [TRT] Tactic: 10 time 0.010684 [03/13/2022-08:32:19] [V] [TRT] Tactic: 11 time 0.00974 [03/13/2022-08:32:19] [V] [TRT] Tactic: 12 time 0.010716 [03/13/2022-08:32:19] [V] [TRT] Tactic: 13 time 0.009276 [03/13/2022-08:32:19] [V] [TRT] Tactic: 14 time 0.010496 [03/13/2022-08:32:19] [V] [TRT] Tactic: 15 time 0.012812 [03/13/2022-08:32:19] [V] [TRT] Tactic: 16 time 0.011376 [03/13/2022-08:32:19] [V] [TRT] Tactic: 17 time 0.010964 [03/13/2022-08:32:19] [V] [TRT] Tactic: 18 time 0.013332 [03/13/2022-08:32:19] [V] [TRT] Tactic: 19 time 0.017612 [03/13/2022-08:32:19] [V] [TRT] Tactic: 20 time 0.011884 [03/13/2022-08:32:19] [V] [TRT] Tactic: 21 time 0.010332 [03/13/2022-08:32:19] [V] [TRT] Tactic: 22 time 0.009876 [03/13/2022-08:32:19] [V] [TRT] Tactic: 23 time 0.009096 [03/13/2022-08:32:19] [V] [TRT] Tactic: 24 time 0.015292 [03/13/2022-08:32:19] [V] [TRT] Tactic: 25 time 0.012396 [03/13/2022-08:32:19] [V] [TRT] Tactic: 26 time 0.011156 [03/13/2022-08:32:19] [V] [TRT] Tactic: 27 time 0.010336 [03/13/2022-08:32:19] [V] [TRT] Tactic: 28 time 0.010316 [03/13/2022-08:32:19] [V] [TRT] Tactic: 29 time 0.010804 [03/13/2022-08:32:20] [V] [TRT] Tactic: 30 time 0.011768 [03/13/2022-08:32:20] [V] [TRT] Tactic: 31 time 0.01502 [03/13/2022-08:32:20] [V] [TRT] Fastest Tactic: 23 Time: 0.009096 [03/13/2022-08:32:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 23 [03/13/2022-08:32:20] [V] [TRT] [03/13/2022-08:32:20] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,192000) -> Float(1,20,300,900) *************** [03/13/2022-08:32:20] [V] [TRT] Conv_417 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (FusedConvActConvolution) [03/13/2022-08:32:20] [V] [TRT] Tactic: 589823 time 0.184476 [03/13/2022-08:32:20] [V] [TRT] Tactic: 786431 time 0.058012 [03/13/2022-08:32:20] [V] [TRT] Tactic: 1310719 time 0.100084 [03/13/2022-08:32:20] [V] [TRT] Tactic: 1638399 time 0.03086 [03/13/2022-08:32:20] [V] [TRT] Tactic: 1835007 time 0.05974 [03/13/2022-08:32:20] [V] [TRT] Tactic: 2097151 time 0.023396 [03/13/2022-08:32:20] [V] [TRT] Tactic: 3997695 time 0.033404 [03/13/2022-08:32:20] [V] [TRT] Tactic: 4194303 time 0.04922 [03/13/2022-08:32:20] [V] [TRT] Tactic: 4259839 time 0.025988 [03/13/2022-08:32:20] [V] [TRT] Tactic: 4325375 time 0.035272 [03/13/2022-08:32:20] [V] [TRT] Tactic: 4521983 time 0.129524 [03/13/2022-08:32:20] [V] [TRT] Tactic: 4587519 time 0.034248 [03/13/2022-08:32:20] [V] [TRT] Tactic: 4915199 time 0.028992 [03/13/2022-08:32:20] [V] [TRT] Tactic: 4980735 time 0.061892 [03/13/2022-08:32:20] [V] [TRT] Tactic: 5439487 time 0.041456 [03/13/2022-08:32:20] [V] [TRT] Tactic: 5767167 time 0.06212 [03/13/2022-08:32:20] [V] [TRT] Tactic: 6750207 time 0.028664 [03/13/2022-08:32:20] [V] [TRT] Tactic: 6946815 time 0.052488 [03/13/2022-08:32:20] [V] [TRT] Tactic: 7012351 time 0.023936 [03/13/2022-08:32:20] [V] [TRT] Tactic: 7143423 time 0.059616 [03/13/2022-08:32:20] [V] [TRT] Tactic: 7602175 time 0.050404 [03/13/2022-08:32:20] [V] [TRT] Tactic: 7798783 time 0.0583 [03/13/2022-08:32:20] [V] [TRT] Tactic: 8191999 time 0.035172 [03/13/2022-08:32:20] [V] [TRT] Tactic: 8257535 time 0.035324 [03/13/2022-08:32:20] [V] [TRT] Tactic: 8323071 time 0.039988 [03/13/2022-08:32:20] [V] [TRT] Tactic: 8650751 time 0.049772 [03/13/2022-08:32:20] [V] [TRT] Tactic: 9109503 time 0.035276 [03/13/2022-08:32:20] [V] [TRT] Tactic: 9568255 time 0.02892 [03/13/2022-08:32:20] [V] [TRT] Tactic: 9895935 time 0.049216 [03/13/2022-08:32:20] [V] [TRT] Tactic: 10354687 time 0.026028 [03/13/2022-08:32:20] [V] [TRT] Tactic: 10551295 time 0.073224 [03/13/2022-08:32:20] [V] [TRT] Tactic: 10944511 time 0.061868 [03/13/2022-08:32:20] [V] [TRT] Fastest Tactic: 2097151 Time: 0.023396 [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (CaskConvolution) [03/13/2022-08:32:20] [V] [TRT] Conv_417 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 1754569683116234317 time 0.131076 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 1825138533642645384 time 0.132384 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 2733356012094739613 time 0.09272 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 3915320020053085238 time 0.131008 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 6808617066150061604 time 0.08054 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 9091006216302412844 time 0.07912 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: -8060443123034038864 time 0.08494 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: -4420849921117327522 time 0.073316 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: -3946921629105938337 time 0.093924 [03/13/2022-08:32:20] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.073316 [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (CudaConvolution) [03/13/2022-08:32:20] [V] [TRT] Tactic: 0 time 0.039336 [03/13/2022-08:32:20] [V] [TRT] Tactic: 2 time 0.16444 [03/13/2022-08:32:20] [V] [TRT] Tactic: 5 time 0.142044 [03/13/2022-08:32:20] [V] [TRT] Tactic: 57 time 0.039532 [03/13/2022-08:32:20] [V] [TRT] Fastest Tactic: 0 Time: 0.039336 [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (CudaDepthwiseConvolution) [03/13/2022-08:32:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2097151 [03/13/2022-08:32:20] [V] [TRT] [03/13/2022-08:32:20] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,192000) -> Half(1,20,300,900) *************** [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (FusedConvActConvolution) [03/13/2022-08:32:20] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (CaskConvolution) [03/13/2022-08:32:20] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (CudaConvolution) [03/13/2022-08:32:20] [V] [TRT] Tactic: 0 time 0.051992 [03/13/2022-08:32:20] [V] [TRT] Tactic: 1 time 0.051536 [03/13/2022-08:32:20] [V] [TRT] Tactic: 2 time 0.119896 [03/13/2022-08:32:20] [V] [TRT] Tactic: 4 skipped. Scratch requested: 22289920, available: 16777216 [03/13/2022-08:32:20] [V] [TRT] Tactic: 5 time 0.140684 [03/13/2022-08:32:20] [V] [TRT] Fastest Tactic: 1 Time: 0.051536 [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (CudaDepthwiseConvolution) [03/13/2022-08:32:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:32:20] [V] [TRT] [03/13/2022-08:32:20] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300,900) *************** [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (FusedConvActConvolution) [03/13/2022-08:32:20] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (CaskConvolution) [03/13/2022-08:32:20] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (CudaConvolution) [03/13/2022-08:32:20] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (CudaDepthwiseConvolution) [03/13/2022-08:32:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:20] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300:2,600) *************** [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (FusedConvActConvolution) [03/13/2022-08:32:20] [V] [TRT] Tactic: 589823 time 0.100172 [03/13/2022-08:32:20] [V] [TRT] Tactic: 786431 time 0.036756 [03/13/2022-08:32:20] [V] [TRT] Tactic: 1310719 time 0.057024 [03/13/2022-08:32:20] [V] [TRT] Tactic: 1638399 time 0.018696 [03/13/2022-08:32:20] [V] [TRT] Tactic: 1835007 time 0.032984 [03/13/2022-08:32:20] [V] [TRT] Tactic: 2097151 time 0.01718 [03/13/2022-08:32:20] [V] [TRT] Tactic: 3997695 time 0.022436 [03/13/2022-08:32:20] [V] [TRT] Tactic: 4194303 time 0.035392 [03/13/2022-08:32:20] [V] [TRT] Tactic: 4259839 time 0.017092 [03/13/2022-08:32:20] [V] [TRT] Tactic: 4325375 time 0.021 [03/13/2022-08:32:20] [V] [TRT] Tactic: 4521983 time 0.071428 [03/13/2022-08:32:20] [V] [TRT] Tactic: 4587519 time 0.02326 [03/13/2022-08:32:20] [V] [TRT] Tactic: 4915199 time 0.02172 [03/13/2022-08:32:20] [V] [TRT] Tactic: 4980735 time 0.0354 [03/13/2022-08:32:20] [V] [TRT] Tactic: 5439487 time 0.026608 [03/13/2022-08:32:20] [V] [TRT] Tactic: 5767167 time 0.034728 [03/13/2022-08:32:20] [V] [TRT] Tactic: 6750207 time 0.018856 [03/13/2022-08:32:20] [V] [TRT] Tactic: 6946815 time 0.029348 [03/13/2022-08:32:20] [V] [TRT] Tactic: 7012351 time 0.017096 [03/13/2022-08:32:20] [V] [TRT] Tactic: 7143423 time 0.033708 [03/13/2022-08:32:20] [V] [TRT] Tactic: 7602175 time 0.029356 [03/13/2022-08:32:20] [V] [TRT] Tactic: 7798783 time 0.036804 [03/13/2022-08:32:20] [V] [TRT] Tactic: 8191999 time 0.020992 [03/13/2022-08:32:20] [V] [TRT] Tactic: 8257535 time 0.022176 [03/13/2022-08:32:20] [V] [TRT] Tactic: 8323071 time 0.025172 [03/13/2022-08:32:20] [V] [TRT] Tactic: 8650751 time 0.02862 [03/13/2022-08:32:20] [V] [TRT] Tactic: 9109503 time 0.02198 [03/13/2022-08:32:20] [V] [TRT] Tactic: 9568255 time 0.021612 [03/13/2022-08:32:20] [V] [TRT] Tactic: 9895935 time 0.035376 [03/13/2022-08:32:20] [V] [TRT] Tactic: 10354687 time 0.016772 [03/13/2022-08:32:20] [V] [TRT] Tactic: 10551295 time 0.041744 [03/13/2022-08:32:20] [V] [TRT] Tactic: 10944511 time 0.03576 [03/13/2022-08:32:20] [V] [TRT] Fastest Tactic: 10354687 Time: 0.016772 [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (CaskConvolution) [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 1651411198763708804 time 0.04716 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 2418518597804310654 time 0.046828 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 4318470497547290900 time 0.045104 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 4930470141256631146 time 0.04744 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 8292881859266835088 time 0.046852 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 8401509141903434922 time 0.044464 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: -8654297089785671176 time 0.069984 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: -7516584506774355935 time 0.042988 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: -7140760933967189247 time 0.043072 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: -6004726995029373073 time 0.045804 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: -5719726816705110014 time 0.070156 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: -4097850214384059472 time 0.042976 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: -3717489476759089008 time 0.042948 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: -3689982367035295496 time 0.070472 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: -2640575123064142123 time 0.069712 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: -2534402059426524406 time 0.06966 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: -2027588946874785071 time 0.04368 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: -1968398013367819764 time 0.070292 [03/13/2022-08:32:20] [V] [TRT] Fastest Tactic: -3717489476759089008 Time: 0.042948 [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (CudaConvolution) [03/13/2022-08:32:20] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (CudaDepthwiseConvolution) [03/13/2022-08:32:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10354687 [03/13/2022-08:32:20] [V] [TRT] [03/13/2022-08:32:20] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Float(1,20,300,900) *************** [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (FusedConvActConvolution) [03/13/2022-08:32:20] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (CaskConvolution) [03/13/2022-08:32:20] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (CudaConvolution) [03/13/2022-08:32:20] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (CudaDepthwiseConvolution) [03/13/2022-08:32:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:20] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Half(1,20,1:8,300) *************** [03/13/2022-08:32:20] [V] [TRT] Conv_417 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (FusedConvActConvolution) [03/13/2022-08:32:20] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:20] [V] [TRT] --------------- Timing Runner: Conv_417 (CaskConvolution) [03/13/2022-08:32:20] [V] [TRT] Conv_417 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:20] [V] [TRT] Tactic: 9576651994278528 time 0.077232 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 1179757074518529353 time 0.559404 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 2105695814191699972 time 1.03401 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 2148106709480872763 time 0.55852 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 2410442691266548717 time 1.10918 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 3041642431972138763 time 0.558768 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 3754069740140581927 time 1.03387 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 4555462412611657028 time 0.558788 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 5666160310350604399 time 1.03373 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:20] [V] [TRT] Tactic: 5876997871499382316 time 0.1371 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 5925270497649423688 time 1.59519 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:20] [V] [TRT] Tactic: 6680916730816870145 time 0.801288 [03/13/2022-08:32:20] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: 7158029511300006471 time 0.800928 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: 7859952145590271433 time 0.801348 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: 8283847742354150423 time 0.800276 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: -8992262742606384444 time 0.432808 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: -8391760416076885205 time 1.59418 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: -6273232454637933930 time 0.434064 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:21] [V] [TRT] Tactic: -5925110308892264213 time 0.10862 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: -5818527483287834165 time 0.434168 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:21] [V] [TRT] Tactic: -4908848143422991657 time 0.060208 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: -4534876761957424274 time 1.59402 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: -3237051169894153788 time 0.800696 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: -3136088851200285532 time 0.433348 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: -2586046817576862066 time 0.860916 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: -2422160065350346448 time 0.802248 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: -1216445540764179377 time 0.858876 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: -229563042944049199 time 0.434124 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: -4908848143422991657 Time: 0.060208 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: Conv_417 (CudaConvolution) [03/13/2022-08:32:21] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: Conv_417 (CudaDepthwiseConvolution) [03/13/2022-08:32:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4908848143422991657 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:21] [V] [TRT] [03/13/2022-08:32:21] [V] [TRT] Conv_417 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_417 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:21] [V] [TRT] Tactic: 1002 time 0.006536 [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.00486 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00486 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:21] [V] [TRT] Tactic: 1002 time 0.004952 [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.004644 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004644 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:21] [V] [TRT] Tactic: 1002 time 0.006648 [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.004148 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004148 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:21] [V] [TRT] Tactic: 1002 time 0.00694 [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.004724 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004724 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:21] [V] [TRT] Tactic: 1002 time 0.006716 [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.004748 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004748 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:21] [V] [TRT] Tactic: 1002 time 0.007004 [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.004564 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004564 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:21] [V] [TRT] Tactic: 1002 time 0.006484 [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.005116 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.005116 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:21] [V] [TRT] Tactic: 1002 time 0.006596 [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.00468 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00468 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:21] [V] [TRT] Tactic: 1002 time 0.004792 [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.004252 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004252 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:21] [V] [TRT] Tactic: 1002 time 0.006596 [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.00484 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00484 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:21] [V] [TRT] Tactic: 1002 time 0.00656 [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.004144 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004144 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:21] [V] [TRT] Tactic: 1002 time 0.006752 [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.004404 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004404 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:21] [V] [TRT] Tactic: 1002 time 0.006992 [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.004156 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004156 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:21] [V] [TRT] Tactic: 1002 time 0.006676 [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.004816 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004816 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:21] [V] [TRT] Tactic: 1002 time 0.006896 [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.004168 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004168 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:21] [V] [TRT] Tactic: 1002 time 0.006892 [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.004692 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004692 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:21] [V] [TRT] Tactic: 1002 time 0.00658 [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.004412 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004412 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:21] [V] [TRT] Tactic: 1002 time 0.006512 [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.004996 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004996 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:21] [V] [TRT] Tactic: 1002 time 0.006388 [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.004336 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004336 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:21] [V] [TRT] Tactic: 1002 time 0.00686 [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.004164 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004164 [03/13/2022-08:32:21] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,900) -> Float(1,1,20,300,900) *************** [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: Reshape_419 + Transpose_420 (Shuffle) [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.004272 [03/13/2022-08:32:21] [V] [TRT] Tactic: 1 time 0.0072 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004272 [03/13/2022-08:32:21] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,300) -> Float(1,1,20:32,20,60) *************** [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: Reshape_419 + Transpose_420 (Shuffle) [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.005148 [03/13/2022-08:32:21] [V] [TRT] Tactic: 1 time 0.010912 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.005148 [03/13/2022-08:32:21] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,900) -> Half(1,1,20,300,900) *************** [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: Reshape_419 + Transpose_420 (Shuffle) [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.004088 [03/13/2022-08:32:21] [V] [TRT] Tactic: 1 time 0.007096 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004088 [03/13/2022-08:32:21] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,600) -> Half(1,1,20:2,160,480) *************** [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: Reshape_419 + Transpose_420 (Shuffle) [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.004852 [03/13/2022-08:32:21] [V] [TRT] Tactic: 1 time 0.01106 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004852 [03/13/2022-08:32:21] [V] [TRT] *************** Autotuning format combination: Half(1,20,1:8,300) -> Half(2,2,1:8,40,120) *************** [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: Reshape_419 + Transpose_420 (Shuffle) [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.005008 [03/13/2022-08:32:21] [V] [TRT] Tactic: 1 time 0.01116 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.005008 [03/13/2022-08:32:21] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,192000) -> Float(1,20,300,9900) *************** [03/13/2022-08:32:21] [V] [TRT] Conv_354 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_354 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_354 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_354 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_354 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_354 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_354 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_354 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:32:21] [V] [TRT] Conv_354 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: Conv_354 (FusedConvActConvolution) [03/13/2022-08:32:21] [V] [TRT] Tactic: 589823 time 0.170048 [03/13/2022-08:32:21] [V] [TRT] Tactic: 786431 time 0.0508 [03/13/2022-08:32:21] [V] [TRT] Tactic: 1310719 time 0.085984 [03/13/2022-08:32:21] [V] [TRT] Tactic: 1638399 time 0.034452 [03/13/2022-08:32:21] [V] [TRT] Tactic: 1835007 time 0.052008 [03/13/2022-08:32:21] [V] [TRT] Tactic: 2097151 time 0.03356 [03/13/2022-08:32:21] [V] [TRT] Tactic: 3997695 time 0.033016 [03/13/2022-08:32:21] [V] [TRT] Tactic: 4194303 time 0.04706 [03/13/2022-08:32:21] [V] [TRT] Tactic: 4259839 time 0.036096 [03/13/2022-08:32:21] [V] [TRT] Tactic: 4325375 time 0.034512 [03/13/2022-08:32:21] [V] [TRT] Tactic: 4521983 time 0.112176 [03/13/2022-08:32:21] [V] [TRT] Tactic: 4587519 time 0.041224 [03/13/2022-08:32:21] [V] [TRT] Tactic: 4915199 time 0.033548 [03/13/2022-08:32:21] [V] [TRT] Tactic: 4980735 time 0.057508 [03/13/2022-08:32:21] [V] [TRT] Tactic: 5439487 time 0.047708 [03/13/2022-08:32:21] [V] [TRT] Tactic: 5767167 time 0.060532 [03/13/2022-08:32:21] [V] [TRT] Tactic: 6750207 time 0.03738 [03/13/2022-08:32:21] [V] [TRT] Tactic: 6946815 time 0.047348 [03/13/2022-08:32:21] [V] [TRT] Tactic: 7012351 time 0.033496 [03/13/2022-08:32:21] [V] [TRT] Tactic: 7143423 time 0.05766 [03/13/2022-08:32:21] [V] [TRT] Tactic: 7602175 time 0.048428 [03/13/2022-08:32:21] [V] [TRT] Tactic: 7798783 time 0.050788 [03/13/2022-08:32:21] [V] [TRT] Tactic: 8191999 time 0.04518 [03/13/2022-08:32:21] [V] [TRT] Tactic: 8257535 time 0.042456 [03/13/2022-08:32:21] [V] [TRT] Tactic: 8323071 time 0.040848 [03/13/2022-08:32:21] [V] [TRT] Tactic: 8650751 time 0.049404 [03/13/2022-08:32:21] [V] [TRT] Tactic: 9109503 time 0.042876 [03/13/2022-08:32:21] [V] [TRT] Tactic: 9568255 time 0.033712 [03/13/2022-08:32:21] [V] [TRT] Tactic: 9895935 time 0.046696 [03/13/2022-08:32:21] [V] [TRT] Tactic: 10354687 time 0.03676 [03/13/2022-08:32:21] [V] [TRT] Tactic: 10551295 time 0.066912 [03/13/2022-08:32:21] [V] [TRT] Tactic: 10944511 time 0.058 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 3997695 Time: 0.033016 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: Conv_354 (CaskConvolution) [03/13/2022-08:32:21] [V] [TRT] Conv_354 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: 1754569683116234317 time 0.102344 [03/13/2022-08:32:21] [V] [TRT] Conv_354 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: 1825138533642645384 time 0.103528 [03/13/2022-08:32:21] [V] [TRT] Conv_354 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: 2733356012094739613 time 0.075512 [03/13/2022-08:32:21] [V] [TRT] Conv_354 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: 3915320020053085238 time 0.102408 [03/13/2022-08:32:21] [V] [TRT] Conv_354 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: 6808617066150061604 time 0.063776 [03/13/2022-08:32:21] [V] [TRT] Conv_354 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: 9091006216302412844 time 0.061784 [03/13/2022-08:32:21] [V] [TRT] Conv_354 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: -8060443123034038864 time 0.066512 [03/13/2022-08:32:21] [V] [TRT] Conv_354 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: -4420849921117327522 time 0.058252 [03/13/2022-08:32:21] [V] [TRT] Conv_354 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [03/13/2022-08:32:21] [V] [TRT] Tactic: -3946921629105938337 time 0.078936 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.058252 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: Conv_354 (CudaConvolution) [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.04596 [03/13/2022-08:32:21] [V] [TRT] Tactic: 2 time 0.147196 [03/13/2022-08:32:21] [V] [TRT] Tactic: 5 time 0.161036 [03/13/2022-08:32:21] [V] [TRT] Tactic: 57 time 0.047096 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 0 Time: 0.04596 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: Conv_354 (CudaDepthwiseConvolution) [03/13/2022-08:32:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 3997695 [03/13/2022-08:32:21] [V] [TRT] [03/13/2022-08:32:21] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,192000) -> Half(1,20,300,9900) *************** [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: Conv_354 (FusedConvActConvolution) [03/13/2022-08:32:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: Conv_354 (CaskConvolution) [03/13/2022-08:32:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: Conv_354 (CudaConvolution) [03/13/2022-08:32:21] [V] [TRT] Tactic: 0 time 0.054656 [03/13/2022-08:32:21] [V] [TRT] Tactic: 1 time 0.052932 [03/13/2022-08:32:21] [V] [TRT] Tactic: 2 time 0.100548 [03/13/2022-08:32:21] [V] [TRT] Tactic: 4 skipped. Scratch requested: 189483520, available: 16777216 [03/13/2022-08:32:21] [V] [TRT] Tactic: 5 time 0.150816 [03/13/2022-08:32:21] [V] [TRT] Fastest Tactic: 1 Time: 0.052932 [03/13/2022-08:32:21] [V] [TRT] --------------- Timing Runner: Conv_354 (CudaDepthwiseConvolution) [03/13/2022-08:32:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [03/13/2022-08:32:21] [V] [TRT] [03/13/2022-08:32:21] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300,9900) *************** [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: Conv_354 (FusedConvActConvolution) [03/13/2022-08:32:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: Conv_354 (CaskConvolution) [03/13/2022-08:32:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: Conv_354 (CudaConvolution) [03/13/2022-08:32:22] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: Conv_354 (CudaDepthwiseConvolution) [03/13/2022-08:32:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:22] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,96000) -> Half(1,20,300:2,5100) *************** [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: Conv_354 (FusedConvActConvolution) [03/13/2022-08:32:22] [V] [TRT] Tactic: 589823 time 0.077968 [03/13/2022-08:32:22] [V] [TRT] Tactic: 786431 time 0.030344 [03/13/2022-08:32:22] [V] [TRT] Tactic: 1310719 time 0.04556 [03/13/2022-08:32:22] [V] [TRT] Tactic: 1638399 time 0.019328 [03/13/2022-08:32:22] [V] [TRT] Tactic: 1835007 time 0.027792 [03/13/2022-08:32:22] [V] [TRT] Tactic: 2097151 time 0.020156 [03/13/2022-08:32:22] [V] [TRT] Tactic: 3997695 time 0.020916 [03/13/2022-08:32:22] [V] [TRT] Tactic: 4194303 time 0.029332 [03/13/2022-08:32:22] [V] [TRT] Tactic: 4259839 time 0.021472 [03/13/2022-08:32:22] [V] [TRT] Tactic: 4325375 time 0.017828 [03/13/2022-08:32:22] [V] [TRT] Tactic: 4521983 time 0.05596 [03/13/2022-08:32:22] [V] [TRT] Tactic: 4587519 time 0.023812 [03/13/2022-08:32:22] [V] [TRT] Tactic: 4915199 time 0.020764 [03/13/2022-08:32:22] [V] [TRT] Tactic: 4980735 time 0.029128 [03/13/2022-08:32:22] [V] [TRT] Tactic: 5439487 time 0.027072 [03/13/2022-08:32:22] [V] [TRT] Tactic: 5767167 time 0.031404 [03/13/2022-08:32:22] [V] [TRT] Tactic: 6750207 time 0.021064 [03/13/2022-08:32:22] [V] [TRT] Tactic: 6946815 time 0.025756 [03/13/2022-08:32:22] [V] [TRT] Tactic: 7012351 time 0.020168 [03/13/2022-08:32:22] [V] [TRT] Tactic: 7143423 time 0.028472 [03/13/2022-08:32:22] [V] [TRT] Tactic: 7602175 time 0.02714 [03/13/2022-08:32:22] [V] [TRT] Tactic: 7798783 time 0.030224 [03/13/2022-08:32:22] [V] [TRT] Tactic: 8191999 time 0.025592 [03/13/2022-08:32:22] [V] [TRT] Tactic: 8257535 time 0.023916 [03/13/2022-08:32:22] [V] [TRT] Tactic: 8323071 time 0.02392 [03/13/2022-08:32:22] [V] [TRT] Tactic: 8650751 time 0.024732 [03/13/2022-08:32:22] [V] [TRT] Tactic: 9109503 time 0.027 [03/13/2022-08:32:22] [V] [TRT] Tactic: 9568255 time 0.020584 [03/13/2022-08:32:22] [V] [TRT] Tactic: 9895935 time 0.029964 [03/13/2022-08:32:22] [V] [TRT] Tactic: 10354687 time 0.021004 [03/13/2022-08:32:22] [V] [TRT] Tactic: 10551295 time 0.033508 [03/13/2022-08:32:22] [V] [TRT] Tactic: 10944511 time 0.029288 [03/13/2022-08:32:22] [V] [TRT] Fastest Tactic: 4325375 Time: 0.017828 [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: Conv_354 (CaskConvolution) [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: 1651411198763708804 time 0.037376 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: 2418518597804310654 time 0.037036 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: 4318470497547290900 time 0.035648 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: 4930470141256631146 time 0.037748 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: 8292881859266835088 time 0.037588 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: 8401509141903434922 time 0.035416 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -8654297089785671176 time 0.055232 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -7516584506774355935 time 0.034076 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -7140760933967189247 time 0.033772 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -6004726995029373073 time 0.035592 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -5719726816705110014 time 0.055172 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -4097850214384059472 time 0.03446 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -3717489476759089008 time 0.033824 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -3689982367035295496 time 0.05526 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -2640575123064142123 time 0.05504 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -2534402059426524406 time 0.054948 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -2027588946874785071 time 0.034716 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -1968398013367819764 time 0.055108 [03/13/2022-08:32:22] [V] [TRT] Fastest Tactic: -7140760933967189247 Time: 0.033772 [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: Conv_354 (CudaConvolution) [03/13/2022-08:32:22] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: Conv_354 (CudaDepthwiseConvolution) [03/13/2022-08:32:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 4325375 [03/13/2022-08:32:22] [V] [TRT] [03/13/2022-08:32:22] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Float(1,20,300,9900) *************** [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: Conv_354 (FusedConvActConvolution) [03/13/2022-08:32:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: Conv_354 (CaskConvolution) [03/13/2022-08:32:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: Conv_354 (CudaConvolution) [03/13/2022-08:32:22] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: Conv_354 (CudaDepthwiseConvolution) [03/13/2022-08:32:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:22] [V] [TRT] *************** Autotuning format combination: Half(80,1600,1:8,24000) -> Half(5,100,1:8,1500) *************** [03/13/2022-08:32:22] [V] [TRT] Conv_354 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: Conv_354 (FusedConvActConvolution) [03/13/2022-08:32:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: Conv_354 (CaskConvolution) [03/13/2022-08:32:22] [V] [TRT] Conv_354 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:22] [V] [TRT] Tactic: 9576651994278528 time 0.060068 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: 1179757074518529353 time 0.433724 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: 2105695814191699972 time 0.80054 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: 2148106709480872763 time 0.432904 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: 2410442691266548717 time 0.858996 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: 3041642431972138763 time 0.433 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: 3754069740140581927 time 0.800648 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: 4555462412611657028 time 0.432708 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: 5666160310350604399 time 0.800576 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:22] [V] [TRT] Tactic: 5876997871499382316 time 0.106692 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: 5925270497649423688 time 1.59361 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: 6680916730816870145 time 0.802348 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: 7158029511300006471 time 0.801784 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: 7859952145590271433 time 0.801872 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: 8283847742354150423 time 0.803296 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -8992262742606384444 time 0.432772 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -8391760416076885205 time 1.59398 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -6273232454637933930 time 0.434208 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:22] [V] [TRT] Tactic: -5925110308892264213 time 0.10656 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -5818527483287834165 time 0.434136 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:22] [V] [TRT] Tactic: -4908848143422991657 time 0.060092 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -4534876761957424274 time 1.59391 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -3237051169894153788 time 0.800496 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -3136088851200285532 time 0.432708 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -2586046817576862066 time 0.859036 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -2422160065350346448 time 0.801552 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -1216445540764179377 time 0.858812 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Tactic: -229563042944049199 time 0.43414 [03/13/2022-08:32:22] [V] [TRT] Fastest Tactic: 9576651994278528 Time: 0.060068 [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: Conv_354 (CudaConvolution) [03/13/2022-08:32:22] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: Conv_354 (CudaDepthwiseConvolution) [03/13/2022-08:32:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [03/13/2022-08:32:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9576651994278528 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:22] [V] [TRT] [03/13/2022-08:32:22] [V] [TRT] Conv_354 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [03/13/2022-08:32:22] [V] [TRT] Conv_354 (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:22] [V] [TRT] Tactic: 1002 time 0.007496 [03/13/2022-08:32:22] [V] [TRT] Tactic: 0 time 0.006584 [03/13/2022-08:32:22] [V] [TRT] Fastest Tactic: 0 Time: 0.006584 [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:22] [V] [TRT] Tactic: 1002 time 0.00536 [03/13/2022-08:32:22] [V] [TRT] Tactic: 0 time 0.005028 [03/13/2022-08:32:22] [V] [TRT] Fastest Tactic: 0 Time: 0.005028 [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:22] [V] [TRT] Tactic: 1002 time 0.008008 [03/13/2022-08:32:22] [V] [TRT] Tactic: 0 time 0.00472 [03/13/2022-08:32:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00472 [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:22] [V] [TRT] Tactic: 1002 time 0.007496 [03/13/2022-08:32:22] [V] [TRT] Tactic: 0 time 0.00484 [03/13/2022-08:32:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00484 [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:22] [V] [TRT] Tactic: 1002 time 0.007256 [03/13/2022-08:32:22] [V] [TRT] Tactic: 0 time 0.005816 [03/13/2022-08:32:22] [V] [TRT] Fastest Tactic: 0 Time: 0.005816 [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:22] [V] [TRT] Tactic: 1002 time 0.007312 [03/13/2022-08:32:22] [V] [TRT] Tactic: 0 time 0.005772 [03/13/2022-08:32:22] [V] [TRT] Fastest Tactic: 0 Time: 0.005772 [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:22] [V] [TRT] Tactic: 1002 time 0.008232 [03/13/2022-08:32:22] [V] [TRT] Tactic: 0 time 0.00588 [03/13/2022-08:32:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00588 [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:22] [V] [TRT] Tactic: 1002 time 0.007644 [03/13/2022-08:32:22] [V] [TRT] Tactic: 0 time 0.00488 [03/13/2022-08:32:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00488 [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:22] [V] [TRT] Tactic: 1002 time 0.005112 [03/13/2022-08:32:22] [V] [TRT] Tactic: 0 time 0.004768 [03/13/2022-08:32:22] [V] [TRT] Fastest Tactic: 0 Time: 0.004768 [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:22] [V] [TRT] Tactic: 1002 time 0.007012 [03/13/2022-08:32:22] [V] [TRT] Tactic: 0 time 0.006856 [03/13/2022-08:32:22] [V] [TRT] Fastest Tactic: 0 Time: 0.006856 [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:22] [V] [TRT] Tactic: 1002 time 0.007972 [03/13/2022-08:32:22] [V] [TRT] Tactic: 0 time 0.004748 [03/13/2022-08:32:22] [V] [TRT] Fastest Tactic: 0 Time: 0.004748 [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:22] [V] [TRT] Tactic: 1002 time 0.007448 [03/13/2022-08:32:22] [V] [TRT] Tactic: 0 time 0.005032 [03/13/2022-08:32:22] [V] [TRT] Fastest Tactic: 0 Time: 0.005032 [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:22] [V] [TRT] Tactic: 1002 time 0.007252 [03/13/2022-08:32:22] [V] [TRT] Tactic: 0 time 0.004204 [03/13/2022-08:32:22] [V] [TRT] Fastest Tactic: 0 Time: 0.004204 [03/13/2022-08:32:22] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.007316 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.006812 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.006812 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.007484 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004152 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004152 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.007344 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004752 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004752 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.00684 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004816 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004816 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.007204 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.006916 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.006916 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.00734 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004876 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004876 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.00786 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.0049 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0049 [03/13/2022-08:32:23] [V] [TRT] *************** Autotuning format combination: Float(1,20,300,9900) -> Float(1,11,220,3300,9900) *************** [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Reshape_356 + Transpose_357 (Shuffle) [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004784 [03/13/2022-08:32:23] [V] [TRT] Tactic: 1 time 0.008028 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004784 [03/13/2022-08:32:23] [V] [TRT] *************** Autotuning format combination: Float(1,20,300:32,600) -> Float(1,11,220:32,220,660) *************** [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Reshape_356 + Transpose_357 (Shuffle) [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.0068 [03/13/2022-08:32:23] [V] [TRT] Tactic: 1 time 0.01412 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0068 [03/13/2022-08:32:23] [V] [TRT] *************** Autotuning format combination: Half(1,20,300,9900) -> Half(1,11,220,3300,9900) *************** [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Reshape_356 + Transpose_357 (Shuffle) [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.005256 [03/13/2022-08:32:23] [V] [TRT] Tactic: 1 time 0.00826 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.005256 [03/13/2022-08:32:23] [V] [TRT] *************** Autotuning format combination: Half(1,20,300:2,5100) -> Half(1,11,220:2,1760,5280) *************** [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Reshape_356 + Transpose_357 (Shuffle) [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.005104 [03/13/2022-08:32:23] [V] [TRT] Tactic: 1 time 0.013304 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.005104 [03/13/2022-08:32:23] [V] [TRT] *************** Autotuning format combination: Half(5,100,1:8,1500) -> Half(2,22,1:8,440,1320) *************** [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Reshape_356 + Transpose_357 (Shuffle) [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.00624 [03/13/2022-08:32:23] [V] [TRT] Tactic: 1 time 0.013316 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00624 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.005076 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004608 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004608 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.007432 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.005696 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.005696 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.007528 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.0058 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0058 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.005116 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004748 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004748 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.007024 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.00434 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00434 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.007168 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.00438 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00438 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.008072 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004836 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004836 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.008132 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004832 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004832 [03/13/2022-08:32:23] [V] [TRT] *************** Autotuning format combination: Float(1,11,220,3300,9900) -> Float(1,11) *************** [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Reshape_359 (Shuffle) [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.0048 [03/13/2022-08:32:23] [V] [TRT] Tactic: 1 time 0.00762 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0048 [03/13/2022-08:32:23] [V] [TRT] *************** Autotuning format combination: Half(1,11,220,3300,9900) -> Half(1,11) *************** [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Reshape_359 (Shuffle) [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.005468 [03/13/2022-08:32:23] [V] [TRT] Tactic: 1 time 0.008204 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.005468 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.00568 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004864 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.005216 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004808 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004808 [03/13/2022-08:32:23] [V] [TRT] *************** Autotuning format combination: Float(1,11) -> Float(1,11) *************** [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Sigmoid_360 (Activation) [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.005032 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.005032 [03/13/2022-08:32:23] [V] [TRT] *************** Autotuning format combination: Half(1,11) -> Half(1,11) *************** [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Sigmoid_360 (Activation) [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.00546 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00546 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.005084 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004792 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004792 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.00568 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.005112 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.005112 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Slice_391 (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.00594 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004804 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004804 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Slice_391 (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.006104 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.005028 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.005028 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Slice_391 (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.006024 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004864 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Slice_391 (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.006156 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.00496 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00496 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Slice_386 (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.01194 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.00494 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00494 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Slice_386 (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.011376 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.005108 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.005108 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Slice_386 (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.011632 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004916 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004916 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Slice_386 (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.0116 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004856 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004856 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.005156 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004892 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004892 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.005384 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004464 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004464 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.005324 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004664 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004664 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.005664 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.00432 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00432 [03/13/2022-08:32:23] [V] [TRT] *************** Autotuning format combination: Float(1,6), Float(1,1) -> Float(1,6) *************** [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Mul_392 (ElementWise) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1 time 0.004972 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 1 Time: 0.004972 [03/13/2022-08:32:23] [V] [TRT] *************** Autotuning format combination: Half(1,6), Half(1,1) -> Half(1,6) *************** [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Mul_392 (ElementWise) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1 time 0.004896 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 1 Time: 0.004896 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: 705 copy (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.008424 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.006532 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.006532 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: 705 copy (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.011144 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.009972 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.009972 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: 773 copy (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.007296 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.00536 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00536 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: 773 copy (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.0063 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.007052 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.0063 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: 841 copy (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.005896 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004552 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004552 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: 841 copy (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.00632 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.00486 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00486 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Slice_376 (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.011352 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.00514 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00514 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Slice_376 (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.011308 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.005176 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.005176 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Slice_376 (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.011928 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004672 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004672 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Slice_376 (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.011596 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004928 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004928 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Slice_365 (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.011636 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004892 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004892 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Slice_365 (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.011056 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004788 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004788 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Slice_365 (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.011032 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.005016 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.005016 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: Slice_365 (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.0114 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004776 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004776 [03/13/2022-08:32:23] [V] [TRT] *************** Autotuning format combination: -> Float(1,1,1,1,3) *************** [03/13/2022-08:32:23] [V] [TRT] *************** Autotuning format combination: -> Half(1,1,1,1,3) *************** [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.006804 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004844 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004844 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.005168 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.00466 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00466 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.007112 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.005012 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.005012 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.007548 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004528 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004528 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.006592 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004708 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004708 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.006444 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.00504 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00504 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.006944 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004984 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004984 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.006816 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004788 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004788 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.005304 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004184 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004184 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.006892 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004796 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004796 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.00716 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004328 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004328 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.007016 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.00468 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00468 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.006244 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004292 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004292 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.007028 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.005112 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.005112 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.00662 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004836 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004836 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.007236 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004208 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004208 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.007148 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.0049 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0049 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.006624 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004708 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004708 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.007112 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004336 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004336 [03/13/2022-08:32:23] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:23] [V] [TRT] Tactic: 1002 time 0.006728 [03/13/2022-08:32:23] [V] [TRT] Tactic: 0 time 0.004132 [03/13/2022-08:32:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004132 [03/13/2022-08:32:24] [V] [TRT] *************** Autotuning format combination: Float(1,1,20,300,900), Float(1,1,1,1,3) -> Float(1,1,20,300,900) *************** [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: Mul_422 (ElementWise) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1 time 0.0048 [03/13/2022-08:32:24] [V] [TRT] Tactic: 2 time 0.006028 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 1 Time: 0.0048 [03/13/2022-08:32:24] [V] [TRT] *************** Autotuning format combination: Float(1,1,20:32,20,60), Float(1,1,1:32,1,3) -> Float(1,1,20:32,20,60) *************** [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: Mul_422 (ElementWise) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1 time 0.004816 [03/13/2022-08:32:24] [V] [TRT] Tactic: 2 time 0.006948 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 1 Time: 0.004816 [03/13/2022-08:32:24] [V] [TRT] *************** Autotuning format combination: Half(1,1,20,300,900), Half(1,1,1,1,3) -> Half(1,1,20,300,900) *************** [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: Mul_422 (ElementWise) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1 time 0.004832 [03/13/2022-08:32:24] [V] [TRT] Tactic: 2 time 0.004772 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 2 Time: 0.004772 [03/13/2022-08:32:24] [V] [TRT] *************** Autotuning format combination: Half(1,1,20:2,160,480), Half(1,1,1:2,1,3) -> Half(1,1,20:2,160,480) *************** [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: Mul_422 (ElementWise) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1 time 0.00478 [03/13/2022-08:32:24] [V] [TRT] Tactic: 2 time 0.005132 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 1 Time: 0.00478 [03/13/2022-08:32:24] [V] [TRT] *************** Autotuning format combination: Half(2,2,1:8,40,120), Half(1,1,1:8,1,3) -> Half(2,2,1:8,40,120) *************** [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: Mul_422 (ElementWise) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1 time 0.005084 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 1 Time: 0.005084 [03/13/2022-08:32:24] [V] [TRT] *************** Autotuning format combination: Float(1,1,20,300,900) -> Float(1,1) *************** [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: Reshape_424 (Shuffle) [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.004084 [03/13/2022-08:32:24] [V] [TRT] Tactic: 1 time 0.007032 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004084 [03/13/2022-08:32:24] [V] [TRT] *************** Autotuning format combination: Half(1,1,20,300,900) -> Half(1,1) *************** [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: Reshape_424 (Shuffle) [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.00408 [03/13/2022-08:32:24] [V] [TRT] Tactic: 1 time 0.007312 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00408 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: 933 copy (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.005712 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.004712 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004712 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: 933 copy (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.005612 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.005356 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.005356 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: 903 copy (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.005128 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.004092 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004092 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: 903 copy (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.005124 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.004592 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004592 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: 873 copy (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.005428 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.004648 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004648 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: 873 copy (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.00522 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.004736 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004736 [03/13/2022-08:32:24] [V] [TRT] *************** Autotuning format combination: -> Float(1,2) *************** [03/13/2022-08:32:24] [V] [TRT] *************** Autotuning format combination: -> Half(1,2) *************** [03/13/2022-08:32:24] [V] [TRT] *************** Autotuning format combination: -> Float(1,2) *************** [03/13/2022-08:32:24] [V] [TRT] *************** Autotuning format combination: -> Half(1,2) *************** [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.005092 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.004916 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004916 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.0057 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.004732 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004732 [03/13/2022-08:32:24] [V] [TRT] *************** Autotuning format combination: Float(1,2), Float(1,2) -> Float(1,2) *************** [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 344) [Constant] + (Unnamed Layer* 345) [Shuffle], PWN(PWN((Unnamed Layer* 341) [Constant] + (Unnamed Layer* 342) [Shuffle], Mul_378), Pow_379)), Mul_381) (PointWise) [03/13/2022-08:32:24] [V] [TRT] Tactic: 128 time 0.005504 [03/13/2022-08:32:24] [V] [TRT] Tactic: 256 time 0.005372 [03/13/2022-08:32:24] [V] [TRT] Tactic: 512 time 0.005488 [03/13/2022-08:32:24] [V] [TRT] Tactic: -32 time 0.035992 [03/13/2022-08:32:24] [V] [TRT] Tactic: -64 time 0.02122 [03/13/2022-08:32:24] [V] [TRT] Tactic: -128 time 0.01316 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 256 Time: 0.005372 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 344) [Constant] + (Unnamed Layer* 345) [Shuffle], PWN(PWN((Unnamed Layer* 341) [Constant] + (Unnamed Layer* 342) [Shuffle], Mul_378), Pow_379)), Mul_381) (PointWiseV2) [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.004628 [03/13/2022-08:32:24] [V] [TRT] Tactic: 1 time 0.004948 [03/13/2022-08:32:24] [V] [TRT] Tactic: 2 time 0.004852 [03/13/2022-08:32:24] [V] [TRT] Tactic: 3 time 0.004944 [03/13/2022-08:32:24] [V] [TRT] Tactic: 4 time 0.00474 [03/13/2022-08:32:24] [V] [TRT] Tactic: 5 time 0.004664 [03/13/2022-08:32:24] [V] [TRT] Tactic: 6 time 0.005692 [03/13/2022-08:32:24] [V] [TRT] Tactic: 7 time 0.005408 [03/13/2022-08:32:24] [V] [TRT] Tactic: 8 time 0.004972 [03/13/2022-08:32:24] [V] [TRT] Tactic: 9 time 0.004916 [03/13/2022-08:32:24] [V] [TRT] Tactic: 28 time 0.004252 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 28 Time: 0.004252 [03/13/2022-08:32:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [03/13/2022-08:32:24] [V] [TRT] [03/13/2022-08:32:24] [V] [TRT] *************** Autotuning format combination: Half(1,2), Half(1,2) -> Half(1,2) *************** [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 344) [Constant] + (Unnamed Layer* 345) [Shuffle], PWN(PWN((Unnamed Layer* 341) [Constant] + (Unnamed Layer* 342) [Shuffle], Mul_378), Pow_379)), Mul_381) (PointWise) [03/13/2022-08:32:24] [V] [TRT] Tactic: 128 time 0.008912 [03/13/2022-08:32:24] [V] [TRT] Tactic: 256 time 0.00928 [03/13/2022-08:32:24] [V] [TRT] Tactic: 512 time 0.009208 [03/13/2022-08:32:24] [V] [TRT] Tactic: -32 time 0.039864 [03/13/2022-08:32:24] [V] [TRT] Tactic: -64 time 0.023924 [03/13/2022-08:32:24] [V] [TRT] Tactic: -128 time 0.014384 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 128 Time: 0.008912 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: PWN(PWN((Unnamed Layer* 344) [Constant] + (Unnamed Layer* 345) [Shuffle], PWN(PWN((Unnamed Layer* 341) [Constant] + (Unnamed Layer* 342) [Shuffle], Mul_378), Pow_379)), Mul_381) (PointWiseV2) [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.00418 [03/13/2022-08:32:24] [V] [TRT] Tactic: 1 time 0.004768 [03/13/2022-08:32:24] [V] [TRT] Tactic: 2 time 0.004604 [03/13/2022-08:32:24] [V] [TRT] Tactic: 3 time 0.004968 [03/13/2022-08:32:24] [V] [TRT] Tactic: 4 time 0.00486 [03/13/2022-08:32:24] [V] [TRT] Tactic: 5 time 0.004744 [03/13/2022-08:32:24] [V] [TRT] Tactic: 6 time 0.005836 [03/13/2022-08:32:24] [V] [TRT] Tactic: 7 time 0.005332 [03/13/2022-08:32:24] [V] [TRT] Tactic: 8 time 0.004968 [03/13/2022-08:32:24] [V] [TRT] Tactic: 9 time 0.004712 [03/13/2022-08:32:24] [V] [TRT] Tactic: 28 time 0.004236 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00418 [03/13/2022-08:32:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [03/13/2022-08:32:24] [V] [TRT] [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: 694 copy (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.005884 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.004912 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004912 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: 694 copy (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.006068 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.0059 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0059 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: 762 copy (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.005296 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.004108 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004108 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: 762 copy (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.004976 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.004924 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004924 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: 830 copy (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.00524 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.004312 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004312 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: 830 copy (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.0055 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.004648 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004648 [03/13/2022-08:32:24] [V] [TRT] *************** Autotuning format combination: -> Float(1,2) *************** [03/13/2022-08:32:24] [V] [TRT] *************** Autotuning format combination: -> Half(1,2) *************** [03/13/2022-08:32:24] [V] [TRT] *************** Autotuning format combination: Float(1,2), Float(1,2), Float(1,2) -> Float(1,2) *************** [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN((Unnamed Layer* 335) [Constant] + (Unnamed Layer* 336) [Shuffle], PWN(PWN((Unnamed Layer* 332) [Constant] + (Unnamed Layer* 333) [Shuffle], Mul_367), Sub_369)), Add_371), Mul_394) (PointWise) [03/13/2022-08:32:24] [V] [TRT] Tactic: 128 time 0.005128 [03/13/2022-08:32:24] [V] [TRT] Tactic: 256 time 0.004812 [03/13/2022-08:32:24] [V] [TRT] Tactic: 512 time 0.005496 [03/13/2022-08:32:24] [V] [TRT] Tactic: -32 time 0.03874 [03/13/2022-08:32:24] [V] [TRT] Tactic: -64 time 0.022368 [03/13/2022-08:32:24] [V] [TRT] Tactic: -128 time 0.014176 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 256 Time: 0.004812 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN((Unnamed Layer* 335) [Constant] + (Unnamed Layer* 336) [Shuffle], PWN(PWN((Unnamed Layer* 332) [Constant] + (Unnamed Layer* 333) [Shuffle], Mul_367), Sub_369)), Add_371), Mul_394) (PointWiseV2) [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.00468 [03/13/2022-08:32:24] [V] [TRT] Tactic: 1 time 0.00514 [03/13/2022-08:32:24] [V] [TRT] Tactic: 2 time 0.004428 [03/13/2022-08:32:24] [V] [TRT] Tactic: 3 time 0.00552 [03/13/2022-08:32:24] [V] [TRT] Tactic: 4 time 0.004752 [03/13/2022-08:32:24] [V] [TRT] Tactic: 5 time 0.005288 [03/13/2022-08:32:24] [V] [TRT] Tactic: 6 time 0.0052 [03/13/2022-08:32:24] [V] [TRT] Tactic: 7 time 0.005004 [03/13/2022-08:32:24] [V] [TRT] Tactic: 8 time 0.005284 [03/13/2022-08:32:24] [V] [TRT] Tactic: 9 time 0.005288 [03/13/2022-08:32:24] [V] [TRT] Tactic: 28 time 0.00428 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 28 Time: 0.00428 [03/13/2022-08:32:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [03/13/2022-08:32:24] [V] [TRT] [03/13/2022-08:32:24] [V] [TRT] *************** Autotuning format combination: Half(1,2), Half(1,2), Half(1,2) -> Half(1,2) *************** [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN((Unnamed Layer* 335) [Constant] + (Unnamed Layer* 336) [Shuffle], PWN(PWN((Unnamed Layer* 332) [Constant] + (Unnamed Layer* 333) [Shuffle], Mul_367), Sub_369)), Add_371), Mul_394) (PointWise) [03/13/2022-08:32:24] [V] [TRT] Tactic: 128 time 0.008816 [03/13/2022-08:32:24] [V] [TRT] Tactic: 256 time 0.009036 [03/13/2022-08:32:24] [V] [TRT] Tactic: 512 time 0.00982 [03/13/2022-08:32:24] [V] [TRT] Tactic: -32 time 0.045052 [03/13/2022-08:32:24] [V] [TRT] Tactic: -64 time 0.02668 [03/13/2022-08:32:24] [V] [TRT] Tactic: -128 time 0.014984 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 128 Time: 0.008816 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN((Unnamed Layer* 335) [Constant] + (Unnamed Layer* 336) [Shuffle], PWN(PWN((Unnamed Layer* 332) [Constant] + (Unnamed Layer* 333) [Shuffle], Mul_367), Sub_369)), Add_371), Mul_394) (PointWiseV2) [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.004208 [03/13/2022-08:32:24] [V] [TRT] Tactic: 1 time 0.004652 [03/13/2022-08:32:24] [V] [TRT] Tactic: 2 time 0.004796 [03/13/2022-08:32:24] [V] [TRT] Tactic: 3 time 0.004904 [03/13/2022-08:32:24] [V] [TRT] Tactic: 4 time 0.004812 [03/13/2022-08:32:24] [V] [TRT] Tactic: 5 time 0.004648 [03/13/2022-08:32:24] [V] [TRT] Tactic: 6 time 0.005788 [03/13/2022-08:32:24] [V] [TRT] Tactic: 7 time 0.00518 [03/13/2022-08:32:24] [V] [TRT] Tactic: 8 time 0.00496 [03/13/2022-08:32:24] [V] [TRT] Tactic: 9 time 0.004824 [03/13/2022-08:32:24] [V] [TRT] Tactic: 28 time 0.0047 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004208 [03/13/2022-08:32:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [03/13/2022-08:32:24] [V] [TRT] [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: 707 copy (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.005944 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.004916 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004916 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: 707 copy (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.006092 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.006012 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.006012 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: 775 copy (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.006256 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.005052 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.005052 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: 775 copy (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.006228 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.005596 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.005596 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: 843 copy (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.006136 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.005392 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.005392 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: 843 copy (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.006472 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.005032 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.005032 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: 935 copy (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.193812 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.00716 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00716 [03/13/2022-08:32:24] [V] [TRT] --------------- Timing Runner: 936 copy (Reformat) [03/13/2022-08:32:24] [V] [TRT] Tactic: 1002 time 0.19426 [03/13/2022-08:32:24] [V] [TRT] Tactic: 0 time 0.007016 [03/13/2022-08:32:24] [V] [TRT] Fastest Tactic: 0 Time: 0.007016 [03/13/2022-08:32:24] [V] [TRT] Adding reformat layer: Conv_17 reformatted input 0 (443) from Float(1,320,76800,307200) to Half(1,320,76800:2,153600) [03/13/2022-08:32:24] [V] [TRT] Adding reformat layer: PWN(Sigmoid_169, Mul_170) reformatted input 0 (595) from Half(1,20,300:2,48000) to Half(1,20,300,96000) [03/13/2022-08:32:24] [V] [TRT] Adding reformat layer: PWN(Sigmoid_196, Mul_197) reformatted input 0 (630) from Half(1,40,1200:2,96000) to Half(1,40,1200,192000) [03/13/2022-08:32:24] [V] [TRT] Adding reformat layer: Reshape_479 + Transpose_480 reformatted input 0 (926) from Half(1,80,4800:2,9600) to Float(1,80,4800,14400) [03/13/2022-08:32:24] [V] [TRT] Adding reformat layer: Reshape_224 + Transpose_225 reformatted input 0 (665) from Half(1,80,4800:2,81600) to Half(1,80,4800,158400) [03/13/2022-08:32:24] [V] [TRT] Adding reformat layer: Reshape_449 + Transpose_450 reformatted input 0 (896) from Half(1,40,1200:2,2400) to Float(1,40,1200,3600) [03/13/2022-08:32:24] [V] [TRT] Adding reformat layer: Reshape_290 + Transpose_291 reformatted input 0 (733) from Half(1,40,1200:2,20400) to Half(1,40,1200,39600) [03/13/2022-08:32:24] [V] [TRT] Adding reformat layer: Reshape_419 + Transpose_420 reformatted input 0 (866) from Half(1,20,300:2,600) to Float(1,20,300,900) [03/13/2022-08:32:24] [V] [TRT] Adding reformat layer: Reshape_356 + Transpose_357 reformatted input 0 (801) from Half(1,20,300:2,5100) to Float(1,20,300,9900) [03/13/2022-08:32:24] [V] [TRT] For layer Reshape_479 + Transpose_480 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer Mul_260 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer (Unnamed Layer* 435) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer Mul_482 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer Reshape_484 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer (Unnamed Layer* 232) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer (Unnamed Layer* 241) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 238) [Constant] + (Unnamed Layer* 239) [Shuffle], PWN(PWN((Unnamed Layer* 235) [Constant] + (Unnamed Layer* 236) [Shuffle], Mul_246), Pow_247)), Mul_249) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer (Unnamed Layer* 246) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer PWN(PWN(PWN((Unnamed Layer* 229) [Constant] + (Unnamed Layer* 230) [Shuffle], PWN(PWN((Unnamed Layer* 226) [Constant] + (Unnamed Layer* 227) [Shuffle], Mul_235), Sub_237)), Add_239), Mul_262) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer Reshape_449 + Transpose_450 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer Mul_326 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer (Unnamed Layer* 407) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer Mul_452 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer Reshape_454 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer (Unnamed Layer* 294) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 291) [Constant] + (Unnamed Layer* 292) [Shuffle], PWN(PWN((Unnamed Layer* 288) [Constant] + (Unnamed Layer* 289) [Shuffle], Mul_312), Pow_313)), Mul_315) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer Reshape_419 + Transpose_420 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer Reshape_356 + Transpose_357 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer Reshape_359 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer Sigmoid_360 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer Mul_392 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer (Unnamed Layer* 379) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer Mul_422 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer Reshape_424 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer (Unnamed Layer* 347) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] For layer PWN(PWN((Unnamed Layer* 344) [Constant] + (Unnamed Layer* 345) [Shuffle], PWN(PWN((Unnamed Layer* 341) [Constant] + (Unnamed Layer* 342) [Shuffle], Mul_378), Pow_379)), Mul_381) a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [03/13/2022-08:32:24] [V] [TRT] Formats and tactics selection completed in 268.056 seconds. [03/13/2022-08:32:24] [V] [TRT] After reformat layers: 249 layers [03/13/2022-08:32:24] [V] [TRT] Block size 16777216 [03/13/2022-08:32:24] [V] [TRT] Block size 6144000 [03/13/2022-08:32:24] [V] [TRT] Block size 6144000 [03/13/2022-08:32:24] [V] [TRT] Block size 3072000 [03/13/2022-08:32:24] [V] [TRT] Block size 1536000 [03/13/2022-08:32:24] [V] [TRT] Block size 1536000 [03/13/2022-08:32:24] [V] [TRT] Block size 768000 [03/13/2022-08:32:24] [V] [TRT] Block size 384000 [03/13/2022-08:32:24] [V] [TRT] Block size 345600 [03/13/2022-08:32:24] [V] [TRT] Block size 192000 [03/13/2022-08:32:24] [V] [TRT] Block size 115200 [03/13/2022-08:32:24] [V] [TRT] Block size 115200 [03/13/2022-08:32:24] [V] [TRT] Block size 57856 [03/13/2022-08:32:24] [V] [TRT] Block size 29184 [03/13/2022-08:32:24] [V] [TRT] Block size 14848 [03/13/2022-08:32:24] [V] [TRT] Block size 1 [03/13/2022-08:32:24] [V] [TRT] Block size 1 [03/13/2022-08:32:24] [V] [TRT] Total Activation Memory: 37231106 [03/13/2022-08:32:24] [I] [TRT] Detected 1 inputs and 11 output network tensors. [03/13/2022-08:32:24] [V] [TRT] Conv_17 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_21 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_37 || Conv_24 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_28 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_32 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_42 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_46 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_80 || Conv_49 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_53 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_57 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_62 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_66 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_71 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_75 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_85 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_89 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_123 || Conv_92 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_96 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_100 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_105 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_109 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_114 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_118 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_128 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_132 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_155 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_186 || Conv_174 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_178 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_182 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_191 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_195 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_468 || Conv_456 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_213 || Conv_201 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_205 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_460 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_464 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_209 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_218 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_473 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_477 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_263 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_222 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_438 || Conv_426 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_279 || Conv_267 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_271 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_430 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_434 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_275 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_284 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_443 (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_288 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_404 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:32:24] [V] [TRT] Conv_341 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [03/13/2022-08:32:24] [V] [TRT] Layer: (Unnamed Layer* 0) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: (Unnamed Layer* 4) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: (Unnamed Layer* 8) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: (Unnamed Layer* 12) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Gather_13 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Gather_9 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Gather_5 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Gather_1 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: (Unnamed Layer* 2) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: (Unnamed Layer* 6) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: (Unnamed Layer* 10) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: (Unnamed Layer* 14) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Gather_15 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Gather_11 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Gather_7 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Gather_3 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_17 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_17 Weights: 0 HostPersistent: 1664 DevicePersistent: 464384 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_19, Mul_20) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_21 Weights: 0 HostPersistent: 1664 DevicePersistent: 173568 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_22, Mul_23) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_37 || Conv_24 Weights: 0 HostPersistent: 3200 DevicePersistent: 128512 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_26, Mul_27) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_28 Weights: 0 HostPersistent: 1664 DevicePersistent: 118784 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_30, Mul_31) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_32 Weights: 0 HostPersistent: 1664 DevicePersistent: 144384 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(PWN(Sigmoid_34, Mul_35), Add_36) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_39, Mul_40) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_42 Weights: 0 HostPersistent: 3200 DevicePersistent: 128512 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_44, Mul_45) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_46 Weights: 0 HostPersistent: 1664 DevicePersistent: 260096 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_47, Mul_48) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_80 || Conv_49 Weights: 0 HostPersistent: 3200 DevicePersistent: 80896 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_51, Mul_52) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_53 Weights: 0 HostPersistent: 3200 DevicePersistent: 41984 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_55, Mul_56) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_57 Weights: 0 HostPersistent: 512 DevicePersistent: 361472 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(PWN(Sigmoid_59, Mul_60), Add_61) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_62 Weights: 0 HostPersistent: 3200 DevicePersistent: 41984 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_64, Mul_65) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_66 Weights: 0 HostPersistent: 512 DevicePersistent: 361472 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(PWN(Sigmoid_68, Mul_69), Add_70) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_71 Weights: 0 HostPersistent: 3200 DevicePersistent: 41984 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_73, Mul_74) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_75 Weights: 0 HostPersistent: 512 DevicePersistent: 361472 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(PWN(Sigmoid_77, Mul_78), Add_79) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_82, Mul_83) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_85 Weights: 0 HostPersistent: 3200 DevicePersistent: 80896 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_87, Mul_88) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_89 Weights: 0 HostPersistent: 1664 DevicePersistent: 929792 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_90, Mul_91) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_123 || Conv_92 Weights: 0 HostPersistent: 1664 DevicePersistent: 212992 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_94, Mul_95) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_96 Weights: 0 HostPersistent: 3200 DevicePersistent: 58880 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_98, Mul_99) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_100 Weights: 0 HostPersistent: 512 DevicePersistent: 1280512 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(PWN(Sigmoid_102, Mul_103), Add_104) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_105 Weights: 0 HostPersistent: 3200 DevicePersistent: 58880 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_107, Mul_108) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_109 Weights: 0 HostPersistent: 512 DevicePersistent: 1280512 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(PWN(Sigmoid_111, Mul_112), Add_113) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_114 Weights: 0 HostPersistent: 3200 DevicePersistent: 58880 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_116, Mul_117) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_118 Weights: 0 HostPersistent: 512 DevicePersistent: 1280512 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(PWN(Sigmoid_120, Mul_121), Add_122) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_125, Mul_126) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_128 Weights: 0 HostPersistent: 1664 DevicePersistent: 212992 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_130, Mul_131) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_132 Weights: 0 HostPersistent: 1664 DevicePersistent: 3689984 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_133, Mul_134) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_135 Weights: 409600 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_137, Mul_138) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: MaxPool_141 Weights: 0 HostPersistent: 16 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: MaxPool_140 Weights: 0 HostPersistent: 16 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: MaxPool_139 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 565 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_143 Weights: 1638400 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_145, Mul_146) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_159 || Conv_147 Weights: 819200 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_149, Mul_150) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_151 Weights: 204800 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_153, Mul_154) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_155 Weights: 0 HostPersistent: 512 DevicePersistent: 5121024 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_157, Mul_158) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_161, Mul_162) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_164 Weights: 819200 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_166, Mul_167) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_168 Weights: 409600 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_169, Mul_170) input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_169, Mul_170) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Resize_172 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 607 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_186 || Conv_174 Weights: 0 HostPersistent: 1664 DevicePersistent: 417792 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_176, Mul_177) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_178 Weights: 0 HostPersistent: 3200 DevicePersistent: 58880 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_180, Mul_181) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_182 Weights: 0 HostPersistent: 512 DevicePersistent: 1280512 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_184, Mul_185) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_188, Mul_189) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_191 Weights: 0 HostPersistent: 1664 DevicePersistent: 212992 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_193, Mul_194) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_195 Weights: 0 HostPersistent: 3200 DevicePersistent: 110080 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_196, Mul_197) input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_196, Mul_197) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Resize_199 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 642 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 642 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 515 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_468 || Conv_456 Weights: 0 HostPersistent: 3200 DevicePersistent: 132096 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_213 || Conv_201 Weights: 0 HostPersistent: 3200 DevicePersistent: 132096 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_458, Mul_459) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_203, Mul_204) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_205 Weights: 0 HostPersistent: 3200 DevicePersistent: 41984 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_460 Weights: 0 HostPersistent: 3200 DevicePersistent: 41984 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_207, Mul_208) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_462, Mul_463) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_464 Weights: 0 HostPersistent: 512 DevicePersistent: 361472 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_209 Weights: 0 HostPersistent: 512 DevicePersistent: 361472 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_466, Mul_467) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_470, Mul_471) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_211, Mul_212) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_215, Mul_216) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_218 Weights: 0 HostPersistent: 3200 DevicePersistent: 80896 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_473 Weights: 0 HostPersistent: 3200 DevicePersistent: 80896 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_220, Mul_221) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_475, Mul_476) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_477 Weights: 0 HostPersistent: 3200 DevicePersistent: 30720 [03/13/2022-08:32:24] [V] [TRT] Layer: Reshape_479 + Transpose_480 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_263 Weights: 0 HostPersistent: 1664 DevicePersistent: 468480 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_222 Weights: 0 HostPersistent: 3200 DevicePersistent: 39936 [03/13/2022-08:32:24] [V] [TRT] Layer: Reshape_224 + Transpose_225 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Reshape_224 + Transpose_225 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Sigmoid_228 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Slice_259 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Slice_254 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Mul_260 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Slice_244 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Slice_233 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: (Unnamed Layer* 435) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_264, Mul_265) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 632 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 710 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 632 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_438 || Conv_426 Weights: 0 HostPersistent: 1664 DevicePersistent: 212992 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_279 || Conv_267 Weights: 0 HostPersistent: 1664 DevicePersistent: 212992 [03/13/2022-08:32:24] [V] [TRT] Layer: Mul_482 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_428, Mul_429) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_269, Mul_270) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_271 Weights: 0 HostPersistent: 3200 DevicePersistent: 58880 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_430 Weights: 0 HostPersistent: 3200 DevicePersistent: 58880 [03/13/2022-08:32:24] [V] [TRT] Layer: (Unnamed Layer* 232) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: (Unnamed Layer* 241) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_273, Mul_274) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_432, Mul_433) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_434 Weights: 0 HostPersistent: 512 DevicePersistent: 1280512 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_275 Weights: 0 HostPersistent: 512 DevicePersistent: 1280512 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(PWN((Unnamed Layer* 238) [Constant] + (Unnamed Layer* 239) [Shuffle], PWN(PWN((Unnamed Layer* 235) [Constant] + (Unnamed Layer* 236) [Shuffle], Mul_246), Pow_247)), Mul_249) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: (Unnamed Layer* 246) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_436, Mul_437) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_440, Mul_441) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_277, Mul_278) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_281, Mul_282) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_284 Weights: 0 HostPersistent: 1664 DevicePersistent: 212992 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_443 Weights: 0 HostPersistent: 1664 DevicePersistent: 212992 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(PWN(PWN((Unnamed Layer* 229) [Constant] + (Unnamed Layer* 230) [Shuffle], PWN(PWN((Unnamed Layer* 226) [Constant] + (Unnamed Layer* 227) [Shuffle], Mul_235), Sub_237)), Add_239), Mul_262) Weights: 0 HostPersistent: 468 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_286, Mul_287) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_445, Mul_446) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_447 Weights: 1920 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Reshape_449 + Transpose_450 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_329 Weights: 1843200 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_288 Weights: 0 HostPersistent: 3200 DevicePersistent: 29184 [03/13/2022-08:32:24] [V] [TRT] Layer: Reshape_290 + Transpose_291 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Reshape_290 + Transpose_291 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Sigmoid_294 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Slice_325 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Slice_320 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Mul_326 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Slice_310 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Slice_299 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: (Unnamed Layer* 407) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_330, Mul_331) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 597 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 778 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 597 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_408 || Conv_396 Weights: 819200 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_345 || Conv_333 Weights: 819200 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Mul_452 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_398, Mul_399) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_335, Mul_336) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_337 Weights: 204800 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_400 Weights: 204800 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: (Unnamed Layer* 285) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: (Unnamed Layer* 294) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_339, Mul_340) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_402, Mul_403) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_404 Weights: 0 HostPersistent: 512 DevicePersistent: 5121024 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_341 Weights: 0 HostPersistent: 512 DevicePersistent: 5121024 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(PWN((Unnamed Layer* 291) [Constant] + (Unnamed Layer* 292) [Shuffle], PWN(PWN((Unnamed Layer* 288) [Constant] + (Unnamed Layer* 289) [Shuffle], Mul_312), Pow_313)), Mul_315) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: (Unnamed Layer* 299) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_406, Mul_407) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_410, Mul_411) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_343, Mul_344) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_347, Mul_348) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_350 Weights: 819200 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_413 Weights: 819200 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(PWN(PWN((Unnamed Layer* 282) [Constant] + (Unnamed Layer* 283) [Shuffle], PWN(PWN((Unnamed Layer* 279) [Constant] + (Unnamed Layer* 280) [Shuffle], Mul_301), Sub_303)), Add_305), Mul_328) Weights: 0 HostPersistent: 468 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_352, Mul_353) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(Sigmoid_415, Mul_416) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_417 Weights: 3840 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Reshape_419 + Transpose_420 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Conv_354 Weights: 42240 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Reshape_356 + Transpose_357 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Reshape_356 + Transpose_357 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Sigmoid_360 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Slice_391 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Slice_386 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Mul_392 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 705 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 773 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 841 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Slice_376 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Slice_365 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: (Unnamed Layer* 379) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: Mul_422 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 933 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 903 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 873 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: (Unnamed Layer* 338) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: (Unnamed Layer* 347) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(PWN((Unnamed Layer* 344) [Constant] + (Unnamed Layer* 345) [Shuffle], PWN(PWN((Unnamed Layer* 341) [Constant] + (Unnamed Layer* 342) [Shuffle], Mul_378), Pow_379)), Mul_381) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 694 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 762 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 830 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: (Unnamed Layer* 352) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: PWN(PWN(PWN((Unnamed Layer* 335) [Constant] + (Unnamed Layer* 336) [Shuffle], PWN(PWN((Unnamed Layer* 332) [Constant] + (Unnamed Layer* 333) [Shuffle], Mul_367), Sub_369)), Add_371), Mul_394) Weights: 0 HostPersistent: 468 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 707 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 775 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 843 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 935 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Layer: 936 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [03/13/2022-08:32:24] [V] [TRT] Total Host Persistent Memory: 131040 [03/13/2022-08:32:24] [V] [TRT] Total Device Persistent Memory: 34629632 [03/13/2022-08:32:24] [V] [TRT] Total Weight Memory: 9878400 [03/13/2022-08:32:24] [V] [TRT] Builder timing cache: created 1029 entries, 3391 hit(s) [03/13/2022-08:32:24] [V] [TRT] Engine generation completed in 275.498 seconds. [03/13/2022-08:32:24] [V] [TRT] Engine Layer Information: [03/13/2022-08:32:24] [V] [TRT] Layer(Constant): (Unnamed Layer* 0) [Constant], Tactic: 0, -> (Unnamed Layer* 0) [Constant]_output[Int32()] [03/13/2022-08:32:24] [V] [TRT] Layer(Constant): (Unnamed Layer* 4) [Constant], Tactic: 0, -> (Unnamed Layer* 4) [Constant]_output[Int32()] [03/13/2022-08:32:24] [V] [TRT] Layer(Constant): (Unnamed Layer* 8) [Constant], Tactic: 0, -> (Unnamed Layer* 8) [Constant]_output[Int32()] [03/13/2022-08:32:24] [V] [TRT] Layer(Constant): (Unnamed Layer* 12) [Constant], Tactic: 0, -> (Unnamed Layer* 12) [Constant]_output[Int32()] [03/13/2022-08:32:24] [V] [TRT] Layer(Gather): Gather_13, Tactic: 6, images[Float(1,480,640)], (Unnamed Layer* 12) [Constant]_output[Int32()] -> 440[Float(1,240,640)] [03/13/2022-08:32:24] [V] [TRT] Layer(Gather): Gather_9, Tactic: 6, images[Float(1,480,640)], (Unnamed Layer* 8) [Constant]_output[Int32()] -> 436[Float(1,240,640)] [03/13/2022-08:32:24] [V] [TRT] Layer(Gather): Gather_5, Tactic: 6, images[Float(1,480,640)], (Unnamed Layer* 4) [Constant]_output[Int32()] -> 432[Float(1,240,640)] [03/13/2022-08:32:24] [V] [TRT] Layer(Gather): Gather_1, Tactic: 6, images[Float(1,480,640)], (Unnamed Layer* 0) [Constant]_output[Int32()] -> 428[Float(1,240,640)] [03/13/2022-08:32:24] [V] [TRT] Layer(Constant): (Unnamed Layer* 2) [Constant], Tactic: 0, -> (Unnamed Layer* 2) [Constant]_output[Int32()] [03/13/2022-08:32:24] [V] [TRT] Layer(Constant): (Unnamed Layer* 6) [Constant], Tactic: 0, -> (Unnamed Layer* 6) [Constant]_output[Int32()] [03/13/2022-08:32:24] [V] [TRT] Layer(Constant): (Unnamed Layer* 10) [Constant], Tactic: 0, -> (Unnamed Layer* 10) [Constant]_output[Int32()] [03/13/2022-08:32:24] [V] [TRT] Layer(Constant): (Unnamed Layer* 14) [Constant], Tactic: 0, -> (Unnamed Layer* 14) [Constant]_output[Int32()] [03/13/2022-08:32:24] [V] [TRT] Layer(Gather): Gather_15, Tactic: 6, 440[Float(1,240,640)], (Unnamed Layer* 14) [Constant]_output[Int32()] -> 443[Float(1,240,320)] [03/13/2022-08:32:24] [V] [TRT] Layer(Gather): Gather_11, Tactic: 6, 436[Float(1,240,640)], (Unnamed Layer* 10) [Constant]_output[Int32()] -> 443[Float(1,240,320)] [03/13/2022-08:32:24] [V] [TRT] Layer(Gather): Gather_7, Tactic: 6, 432[Float(1,240,640)], (Unnamed Layer* 6) [Constant]_output[Int32()] -> 443[Float(1,240,320)] [03/13/2022-08:32:24] [V] [TRT] Layer(Gather): Gather_3, Tactic: 6, 428[Float(1,240,640)], (Unnamed Layer* 2) [Constant]_output[Int32()] -> 443[Float(1,240,320)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): Conv_17 input reformatter 0, Tactic: 0, 443[Float(4,240,320)] -> Conv_17 reformatted input 0[Half(4,240,320)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_17, Tactic: 8401509141903434922, Conv_17 reformatted input 0[Half(4,240,320)] -> 445[Half(40,240,320)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_19, Mul_20), Tactic: 18, 445[Half(40,240,320)] -> 447[Half(40,240,320)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_21, Tactic: -6004726995029373073, 447[Half(40,240,320)] -> 448[Half(80,120,160)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_22, Mul_23), Tactic: 19, 448[Half(80,120,160)] -> 450[Half(80,120,160)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_37 || Conv_24, Tactic: -2640575123064142123, 450[Half(80,120,160)] -> Conv_37 || Conv_24[Half(80,120,160)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_26, Mul_27), Tactic: 19, Conv_37 || Conv_24[Half(40,120,160)] -> 454[Half(40,120,160)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_28, Tactic: 4318470497547290900, 454[Half(40,120,160)] -> 456[Half(40,120,160)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_30, Mul_31), Tactic: 19, 456[Half(40,120,160)] -> 458[Half(40,120,160)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_32, Tactic: 8401509141903434922, 458[Half(40,120,160)] -> 460[Half(40,120,160)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Sigmoid_34, Mul_35), Add_36), Tactic: 19, 460[Half(40,120,160)], 454[Half(40,120,160)] -> 468[Half(40,120,160)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_39, Mul_40), Tactic: 19, Conv_37 || Conv_24[Half(40,120,160)] -> 468[Half(40,120,160)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_42, Tactic: -2640575123064142123, 468[Half(80,120,160)] -> 470[Half(80,120,160)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_44, Mul_45), Tactic: 19, 470[Half(80,120,160)] -> 472[Half(80,120,160)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_46, Tactic: -6004726995029373073, 472[Half(80,120,160)] -> 473[Half(160,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_47, Mul_48), Tactic: 19, 473[Half(160,60,80)] -> 475[Half(160,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_80 || Conv_49, Tactic: -7516584506774355935, 475[Half(160,60,80)] -> Conv_80 || Conv_49[Half(160,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_51, Mul_52), Tactic: 19, Conv_80 || Conv_49[Half(80,60,80)] -> 479[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_53, Tactic: -7516584506774355935, 479[Half(80,60,80)] -> 481[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_55, Mul_56), Tactic: 19, 481[Half(80,60,80)] -> 483[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn_winograd): Conv_57, Tactic: -3140347171730126532, 483[Half(80,60,80)] -> 485[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Sigmoid_59, Mul_60), Add_61), Tactic: 18, 485[Half(80,60,80)], 479[Half(80,60,80)] -> 488[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_62, Tactic: -7516584506774355935, 488[Half(80,60,80)] -> 490[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_64, Mul_65), Tactic: 18, 490[Half(80,60,80)] -> 492[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn_winograd): Conv_66, Tactic: -3140347171730126532, 492[Half(80,60,80)] -> 494[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Sigmoid_68, Mul_69), Add_70), Tactic: 19, 494[Half(80,60,80)], 488[Half(80,60,80)] -> 497[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_71, Tactic: -7516584506774355935, 497[Half(80,60,80)] -> 499[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_73, Mul_74), Tactic: 18, 499[Half(80,60,80)] -> 501[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn_winograd): Conv_75, Tactic: -3140347171730126532, 501[Half(80,60,80)] -> 503[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Sigmoid_77, Mul_78), Add_79), Tactic: 19, 503[Half(80,60,80)], 497[Half(80,60,80)] -> 511[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_82, Mul_83), Tactic: 19, Conv_80 || Conv_49[Half(80,60,80)] -> 511[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_85, Tactic: -7516584506774355935, 511[Half(160,60,80)] -> 513[Half(160,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_87, Mul_88), Tactic: 18, 513[Half(160,60,80)] -> 643[Half(160,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_89, Tactic: 8401509141903434922, 643[Half(160,60,80)] -> 516[Half(320,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_90, Mul_91), Tactic: 18, 516[Half(320,30,40)] -> 518[Half(320,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_123 || Conv_92, Tactic: 4318470497547290900, 518[Half(320,30,40)] -> Conv_123 || Conv_92[Half(320,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_94, Mul_95), Tactic: 18, Conv_123 || Conv_92[Half(160,30,40)] -> 522[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_96, Tactic: -4097850214384059472, 522[Half(160,30,40)] -> 524[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_98, Mul_99), Tactic: 18, 524[Half(160,30,40)] -> 526[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn_winograd): Conv_100, Tactic: -3140347171730126532, 526[Half(160,30,40)] -> 528[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Sigmoid_102, Mul_103), Add_104), Tactic: 18, 528[Half(160,30,40)], 522[Half(160,30,40)] -> 531[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_105, Tactic: -4097850214384059472, 531[Half(160,30,40)] -> 533[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_107, Mul_108), Tactic: 18, 533[Half(160,30,40)] -> 535[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn_winograd): Conv_109, Tactic: -3140347171730126532, 535[Half(160,30,40)] -> 537[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Sigmoid_111, Mul_112), Add_113), Tactic: 19, 537[Half(160,30,40)], 531[Half(160,30,40)] -> 540[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_114, Tactic: -4097850214384059472, 540[Half(160,30,40)] -> 542[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_116, Mul_117), Tactic: 6, 542[Half(160,30,40)] -> 544[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn_winograd): Conv_118, Tactic: -3140347171730126532, 544[Half(160,30,40)] -> 546[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Sigmoid_120, Mul_121), Add_122), Tactic: 19, 546[Half(160,30,40)], 540[Half(160,30,40)] -> 554[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_125, Mul_126), Tactic: 18, Conv_123 || Conv_92[Half(160,30,40)] -> 554[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_128, Tactic: 4318470497547290900, 554[Half(320,30,40)] -> 556[Half(320,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_130, Mul_131), Tactic: 19, 556[Half(320,30,40)] -> 608[Half(320,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_132, Tactic: 8401509141903434922, 608[Half(320,30,40)] -> 559[Half(640,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_133, Mul_134), Tactic: 18, 559[Half(640,15,20)] -> 561[Half(640,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(FusedConvActDirect): Conv_135, Tactic: 2359295, 561[Half(640,15,20)] -> 563[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_137, Mul_138), Tactic: 18, 563[Half(320,15,20)] -> 565[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(Pooling): MaxPool_141, Tactic: -3, 565[Half(320,15,20)] -> 569[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(Pooling): MaxPool_140, Tactic: -3, 565[Half(320,15,20)] -> 569[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(PoolingTiled): MaxPool_139, Tactic: 7735316, 565[Half(320,15,20)] -> 569[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 565 copy, Tactic: 0, 565[Half(320,15,20)] -> 569[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(FusedConvActDirect): Conv_143, Tactic: 2359295, 569[Half(1280,15,20)] -> 571[Half(640,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_145, Mul_146), Tactic: 18, 571[Half(640,15,20)] -> 573[Half(640,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(FusedConvActDirect): Conv_159 || Conv_147, Tactic: 2359295, 573[Half(640,15,20)] -> Conv_159 || Conv_147[Half(640,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_149, Mul_150), Tactic: 19, Conv_159 || Conv_147[Half(320,15,20)] -> 577[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(FusedConvActDirect): Conv_151, Tactic: 2359295, 577[Half(320,15,20)] -> 579[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_153, Mul_154), Tactic: 4, 579[Half(320,15,20)] -> 581[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn_winograd): Conv_155, Tactic: -3140347171730126532, 581[Half(320,15,20)] -> 583[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_157, Mul_158), Tactic: 4, 583[Half(320,15,20)] -> 590[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_161, Mul_162), Tactic: 4, Conv_159 || Conv_147[Half(320,15,20)] -> 590[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(FusedConvActDirect): Conv_164, Tactic: 2359295, 590[Half(640,15,20)] -> 592[Half(640,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_166, Mul_167), Tactic: 17, 592[Half(640,15,20)] -> 594[Half(640,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(FusedConvActDirect): Conv_168, Tactic: 2359295, 594[Half(640,15,20)] -> 595[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): PWN(Sigmoid_169, Mul_170) input reformatter 0, Tactic: 0, 595[Half(320,15,20)] -> PWN(Sigmoid_169, Mul_170) reformatted input 0[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_169, Mul_170), Tactic: 8, PWN(Sigmoid_169, Mul_170) reformatted input 0[Half(320,15,20)] -> 597[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(Resize): Resize_172, Tactic: 0, 597[Half(320,15,20)] -> 607[Half(320,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 607 copy, Tactic: 0, 607[Half(320,30,40)] -> 608[Half(320,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_186 || Conv_174, Tactic: 8401509141903434922, 608[Half(640,30,40)] -> Conv_186 || Conv_174[Half(320,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_176, Mul_177), Tactic: 18, Conv_186 || Conv_174[Half(160,30,40)] -> 612[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_178, Tactic: -4097850214384059472, 612[Half(160,30,40)] -> 614[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_180, Mul_181), Tactic: 6, 614[Half(160,30,40)] -> 616[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn_winograd): Conv_182, Tactic: -3140347171730126532, 616[Half(160,30,40)] -> 618[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_184, Mul_185), Tactic: 18, 618[Half(160,30,40)] -> 625[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_188, Mul_189), Tactic: 18, Conv_186 || Conv_174[Half(160,30,40)] -> 625[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_191, Tactic: 4318470497547290900, 625[Half(320,30,40)] -> 627[Half(320,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_193, Mul_194), Tactic: 18, 627[Half(320,30,40)] -> 629[Half(320,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_195, Tactic: -4097850214384059472, 629[Half(320,30,40)] -> 630[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): PWN(Sigmoid_196, Mul_197) input reformatter 0, Tactic: 0, 630[Half(160,30,40)] -> PWN(Sigmoid_196, Mul_197) reformatted input 0[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_196, Mul_197), Tactic: 9, PWN(Sigmoid_196, Mul_197) reformatted input 0[Half(160,30,40)] -> 632[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(Resize): Resize_199, Tactic: 0, 632[Half(160,30,40)] -> 642[Half(160,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 642 copy, Tactic: 0, 642[Half(160,60,80)] -> 643[Half(160,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 642 copy, Tactic: 0, 642[Half(160,60,80)] -> 904[Half(160,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 515 copy, Tactic: 0, 643[Half(160,60,80)] -> 904[Half(160,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_468 || Conv_456, Tactic: -7516584506774355935, 904[Half(320,60,80)] -> Conv_468 || Conv_456[Half(160,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_213 || Conv_201, Tactic: -7516584506774355935, 643[Half(320,60,80)] -> Conv_213 || Conv_201[Half(160,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_458, Mul_459), Tactic: 19, Conv_468 || Conv_456[Half(80,60,80)] -> 908[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_203, Mul_204), Tactic: 19, Conv_213 || Conv_201[Half(80,60,80)] -> 647[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_205, Tactic: -7516584506774355935, 647[Half(80,60,80)] -> 649[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_460, Tactic: -7516584506774355935, 908[Half(80,60,80)] -> 910[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_207, Mul_208), Tactic: 18, 649[Half(80,60,80)] -> 651[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_462, Mul_463), Tactic: 18, 910[Half(80,60,80)] -> 912[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn_winograd): Conv_464, Tactic: -3140347171730126532, 912[Half(80,60,80)] -> 914[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn_winograd): Conv_209, Tactic: -3140347171730126532, 651[Half(80,60,80)] -> 653[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_466, Mul_467), Tactic: 18, 914[Half(80,60,80)] -> 921[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_470, Mul_471), Tactic: 18, Conv_468 || Conv_456[Half(80,60,80)] -> 921[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_211, Mul_212), Tactic: 18, 653[Half(80,60,80)] -> 660[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_215, Mul_216), Tactic: 18, Conv_213 || Conv_201[Half(80,60,80)] -> 660[Half(80,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_218, Tactic: -7516584506774355935, 660[Half(160,60,80)] -> 662[Half(160,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_473, Tactic: -7516584506774355935, 921[Half(160,60,80)] -> 923[Half(160,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_220, Mul_221), Tactic: 18, 662[Half(160,60,80)] -> 664[Half(160,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_475, Mul_476), Tactic: 18, 923[Half(160,60,80)] -> 925[Half(160,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_477, Tactic: -4097850214384059472, 925[Half(160,60,80)] -> 926[Half(3,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): Reshape_479 + Transpose_480 input reformatter 0, Tactic: 0, 926[Half(3,60,80)] -> Reshape_479 + Transpose_480 reformatted input 0[Float(3,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_263, Tactic: -6004726995029373073, 664[Half(160,60,80)] -> 708[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_222, Tactic: -3717489476759089008, 664[Half(160,60,80)] -> 665[Half(33,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): Reshape_224 + Transpose_225 input reformatter 0, Tactic: 0, 665[Half(33,60,80)] -> Reshape_224 + Transpose_225 reformatted input 0[Half(33,60,80)] [03/13/2022-08:32:24] [V] [TRT] Layer(Shuffle): Reshape_224 + Transpose_225, Tactic: 0, Reshape_224 + Transpose_225 reformatted input 0[Half(33,60,80)] -> 668[Half(3,60,80,11)] [03/13/2022-08:32:24] [V] [TRT] Layer(Activation): Sigmoid_228, Tactic: 0, 670[Half(11)] -> 671[Half(11)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): Slice_259, Tactic: 0, 671[Half(1)] -> 704[Float(1)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): Slice_254, Tactic: 0, 671[Half(6)] -> 699[Float(6)] [03/13/2022-08:32:24] [V] [TRT] Layer(ElementWise): Mul_260, Tactic: 1, 699[Float(6)], 704[Float(1)] -> 705[Float(6)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): Slice_244, Tactic: 0, 671[Half(2)] -> 687[Float(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): Slice_233, Tactic: 0, 671[Half(2)] -> 676[Float(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(Constant): (Unnamed Layer* 435) [Constant], Tactic: 0, -> (Unnamed Layer* 435) [Constant]_output[Float(3,1,1,1)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_264, Mul_265), Tactic: 18, 708[Half(160,30,40)] -> 711[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 632 copy, Tactic: 0, 632[Half(160,30,40)] -> 711[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 710 copy, Tactic: 0, 711[Half(160,30,40)] -> 874[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 632 copy, Tactic: 0, 632[Half(160,30,40)] -> 874[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_438 || Conv_426, Tactic: 4318470497547290900, 874[Half(320,30,40)] -> Conv_438 || Conv_426[Half(320,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_279 || Conv_267, Tactic: 4318470497547290900, 711[Half(320,30,40)] -> Conv_279 || Conv_267[Half(320,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(ElementWise): Mul_482, Tactic: 1, 929[Float(3,60,80,1)], (Unnamed Layer* 435) [Constant]_output[Float(3,1,1,1)] -> 931[Float(3,60,80,1)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_428, Mul_429), Tactic: 18, Conv_438 || Conv_426[Half(160,30,40)] -> 878[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_269, Mul_270), Tactic: 18, Conv_279 || Conv_267[Half(160,30,40)] -> 715[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_271, Tactic: -4097850214384059472, 715[Half(160,30,40)] -> 717[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_430, Tactic: -4097850214384059472, 878[Half(160,30,40)] -> 880[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(Constant): (Unnamed Layer* 232) [Constant], Tactic: 0, -> (Unnamed Layer* 232) [Constant]_output[Float(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(Constant): (Unnamed Layer* 241) [Constant], Tactic: 0, -> (Unnamed Layer* 241) [Constant]_output[Float(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_273, Mul_274), Tactic: 6, 717[Half(160,30,40)] -> 719[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_432, Mul_433), Tactic: 17, 880[Half(160,30,40)] -> 882[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn_winograd): Conv_434, Tactic: -3140347171730126532, 882[Half(160,30,40)] -> 884[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn_winograd): Conv_275, Tactic: -3140347171730126532, 719[Half(160,30,40)] -> 721[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(PWN((Unnamed Layer* 238) [Constant] + (Unnamed Layer* 239) [Shuffle], PWN(PWN((Unnamed Layer* 235) [Constant] + (Unnamed Layer* 236) [Shuffle], Mul_246), Pow_247)), Mul_249), Tactic: 3, 687[Float(2)], (Unnamed Layer* 241) [Constant]_output[Float(2)] -> 694[Float(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(Constant): (Unnamed Layer* 246) [Constant], Tactic: 0, -> (Unnamed Layer* 246) [Constant]_output[Float(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_436, Mul_437), Tactic: 18, 884[Half(160,30,40)] -> 891[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_440, Mul_441), Tactic: 18, Conv_438 || Conv_426[Half(160,30,40)] -> 891[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_277, Mul_278), Tactic: 18, 721[Half(160,30,40)] -> 728[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_281, Mul_282), Tactic: 18, Conv_279 || Conv_267[Half(160,30,40)] -> 728[Half(160,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_284, Tactic: 4318470497547290900, 728[Half(320,30,40)] -> 730[Half(320,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_443, Tactic: 4318470497547290900, 891[Half(320,30,40)] -> 893[Half(320,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN((Unnamed Layer* 229) [Constant] + (Unnamed Layer* 230) [Shuffle], PWN(PWN((Unnamed Layer* 226) [Constant] + (Unnamed Layer* 227) [Shuffle], Mul_235), Sub_237)), Add_239), Mul_262), Tactic: 5, 676[Float(2)], (Unnamed Layer* 232) [Constant]_output[Float(2)], (Unnamed Layer* 246) [Constant]_output[Float(2)] -> 707[Float(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_286, Mul_287), Tactic: 18, 730[Half(320,30,40)] -> 732[Half(320,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_445, Mul_446), Tactic: 18, 893[Half(320,30,40)] -> 895[Half(320,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(FusedConvActDirect): Conv_447, Tactic: 4325375, 895[Half(320,30,40)] -> 896[Half(3,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): Reshape_449 + Transpose_450 input reformatter 0, Tactic: 0, 896[Half(3,30,40)] -> Reshape_449 + Transpose_450 reformatted input 0[Float(3,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(FusedConvActDirect): Conv_329, Tactic: 458751, 732[Half(320,30,40)] -> 776[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn): Conv_288, Tactic: -7140760933967189247, 732[Half(320,30,40)] -> 733[Half(33,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): Reshape_290 + Transpose_291 input reformatter 0, Tactic: 0, 733[Half(33,30,40)] -> Reshape_290 + Transpose_291 reformatted input 0[Half(33,30,40)] [03/13/2022-08:32:24] [V] [TRT] Layer(Shuffle): Reshape_290 + Transpose_291, Tactic: 0, Reshape_290 + Transpose_291 reformatted input 0[Half(33,30,40)] -> 736[Half(3,30,40,11)] [03/13/2022-08:32:24] [V] [TRT] Layer(Activation): Sigmoid_294, Tactic: 0, 738[Half(11)] -> 739[Half(11)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): Slice_325, Tactic: 0, 739[Half(1)] -> 772[Float(1)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): Slice_320, Tactic: 0, 739[Half(6)] -> 767[Float(6)] [03/13/2022-08:32:24] [V] [TRT] Layer(ElementWise): Mul_326, Tactic: 1, 767[Float(6)], 772[Float(1)] -> 773[Float(6)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): Slice_310, Tactic: 0, 739[Half(2)] -> 755[Float(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): Slice_299, Tactic: 0, 739[Half(2)] -> 744[Half(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(Constant): (Unnamed Layer* 407) [Constant], Tactic: 0, -> (Unnamed Layer* 407) [Constant]_output[Float(3,1,1,1)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_330, Mul_331), Tactic: 14, 776[Half(320,15,20)] -> 779[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 597 copy, Tactic: 0, 597[Half(320,15,20)] -> 779[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 778 copy, Tactic: 0, 779[Half(320,15,20)] -> 844[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 597 copy, Tactic: 0, 597[Half(320,15,20)] -> 844[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(FusedConvActDirect): Conv_408 || Conv_396, Tactic: 2359295, 844[Half(640,15,20)] -> Conv_408 || Conv_396[Half(640,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(FusedConvActDirect): Conv_345 || Conv_333, Tactic: 2359295, 779[Half(640,15,20)] -> Conv_345 || Conv_333[Half(640,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(ElementWise): Mul_452, Tactic: 1, 899[Float(3,30,40,1)], (Unnamed Layer* 407) [Constant]_output[Float(3,1,1,1)] -> 901[Float(3,30,40,1)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_398, Mul_399), Tactic: 18, Conv_408 || Conv_396[Half(320,15,20)] -> 848[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_335, Mul_336), Tactic: 18, Conv_345 || Conv_333[Half(320,15,20)] -> 783[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(FusedConvActDirect): Conv_337, Tactic: 2359295, 783[Half(320,15,20)] -> 785[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(FusedConvActDirect): Conv_400, Tactic: 2359295, 848[Half(320,15,20)] -> 850[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(Constant): (Unnamed Layer* 285) [Constant], Tactic: 0, -> (Unnamed Layer* 285) [Constant]_output[Half(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(Constant): (Unnamed Layer* 294) [Constant], Tactic: 0, -> (Unnamed Layer* 294) [Constant]_output[Float(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_339, Mul_340), Tactic: 18, 785[Half(320,15,20)] -> 787[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_402, Mul_403), Tactic: 4, 850[Half(320,15,20)] -> 852[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn_winograd): Conv_404, Tactic: -3140347171730126532, 852[Half(320,15,20)] -> 854[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(hcudnn_winograd): Conv_341, Tactic: -3140347171730126532, 787[Half(320,15,20)] -> 789[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(PWN((Unnamed Layer* 291) [Constant] + (Unnamed Layer* 292) [Shuffle], PWN(PWN((Unnamed Layer* 288) [Constant] + (Unnamed Layer* 289) [Shuffle], Mul_312), Pow_313)), Mul_315), Tactic: 2, 755[Float(2)], (Unnamed Layer* 294) [Constant]_output[Float(2)] -> 762[Float(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(Constant): (Unnamed Layer* 299) [Constant], Tactic: 0, -> (Unnamed Layer* 299) [Constant]_output[Half(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_406, Mul_407), Tactic: 18, 854[Half(320,15,20)] -> 861[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_410, Mul_411), Tactic: 18, Conv_408 || Conv_396[Half(320,15,20)] -> 861[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_343, Mul_344), Tactic: 18, 789[Half(320,15,20)] -> 796[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_347, Mul_348), Tactic: 3, Conv_345 || Conv_333[Half(320,15,20)] -> 796[Half(320,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(FusedConvActDirect): Conv_350, Tactic: 2359295, 796[Half(640,15,20)] -> 798[Half(640,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(FusedConvActDirect): Conv_413, Tactic: 2359295, 861[Half(640,15,20)] -> 863[Half(640,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN((Unnamed Layer* 282) [Constant] + (Unnamed Layer* 283) [Shuffle], PWN(PWN((Unnamed Layer* 279) [Constant] + (Unnamed Layer* 280) [Shuffle], Mul_301), Sub_303)), Add_305), Mul_328), Tactic: 1, 744[Half(2)], (Unnamed Layer* 285) [Constant]_output[Half(2)], (Unnamed Layer* 299) [Constant]_output[Half(2)] -> 775[Half(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_352, Mul_353), Tactic: 18, 798[Half(640,15,20)] -> 800[Half(640,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_415, Mul_416), Tactic: 18, 863[Half(640,15,20)] -> 865[Half(640,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(FusedConvActDirect): Conv_417, Tactic: 10354687, 865[Half(640,15,20)] -> 866[Half(3,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): Reshape_419 + Transpose_420 input reformatter 0, Tactic: 0, 866[Half(3,15,20)] -> Reshape_419 + Transpose_420 reformatted input 0[Float(3,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(FusedConvActDirect): Conv_354, Tactic: 4325375, 800[Half(640,15,20)] -> 801[Half(33,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): Reshape_356 + Transpose_357 input reformatter 0, Tactic: 0, 801[Half(33,15,20)] -> Reshape_356 + Transpose_357 reformatted input 0[Float(33,15,20)] [03/13/2022-08:32:24] [V] [TRT] Layer(Shuffle): Reshape_356 + Transpose_357, Tactic: 0, Reshape_356 + Transpose_357 reformatted input 0[Float(33,15,20)] -> 804[Float(3,15,20,11)] [03/13/2022-08:32:24] [V] [TRT] Layer(Activation): Sigmoid_360, Tactic: 0, 806[Float(11)] -> 807[Float(11)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): Slice_391, Tactic: 0, 807[Float(1)] -> 840[Float(1)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): Slice_386, Tactic: 0, 807[Float(6)] -> 835[Float(6)] [03/13/2022-08:32:24] [V] [TRT] Layer(ElementWise): Mul_392, Tactic: 1, 835[Float(6)], 840[Float(1)] -> 841[Float(6)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 705 copy, Tactic: 0, 705[Float(6)] -> classes[Float(6)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 773 copy, Tactic: 0, 773[Float(6)] -> classes[Float(6)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 841 copy, Tactic: 0, 841[Float(6)] -> classes[Float(6)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): Slice_376, Tactic: 0, 807[Float(2)] -> 823[Float(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): Slice_365, Tactic: 0, 807[Float(2)] -> 812[Half(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(Constant): (Unnamed Layer* 379) [Constant], Tactic: 0, -> (Unnamed Layer* 379) [Constant]_output[Float(3,1,1,1)] [03/13/2022-08:32:24] [V] [TRT] Layer(ElementWise): Mul_422, Tactic: 1, 869[Float(3,15,20,1)], (Unnamed Layer* 379) [Constant]_output[Float(3,1,1,1)] -> 871[Float(3,15,20,1)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 933 copy, Tactic: 0, 933[Float(1)] -> ranges[Float(1)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 903 copy, Tactic: 0, 903[Float(1)] -> ranges[Float(1)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 873 copy, Tactic: 0, 873[Float(1)] -> ranges[Float(1)] [03/13/2022-08:32:24] [V] [TRT] Layer(Constant): (Unnamed Layer* 338) [Constant], Tactic: 0, -> (Unnamed Layer* 338) [Constant]_output[Half(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(Constant): (Unnamed Layer* 347) [Constant], Tactic: 0, -> (Unnamed Layer* 347) [Constant]_output[Float(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(PWN((Unnamed Layer* 344) [Constant] + (Unnamed Layer* 345) [Shuffle], PWN(PWN((Unnamed Layer* 341) [Constant] + (Unnamed Layer* 342) [Shuffle], Mul_378), Pow_379)), Mul_381), Tactic: 28, 823[Float(2)], (Unnamed Layer* 347) [Constant]_output[Float(2)] -> 830[Float(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 694 copy, Tactic: 0, 694[Float(2)] -> 936[Float(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 762 copy, Tactic: 0, 762[Float(2)] -> 936[Float(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 830 copy, Tactic: 0, 830[Float(2)] -> 936[Float(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(Constant): (Unnamed Layer* 352) [Constant], Tactic: 0, -> (Unnamed Layer* 352) [Constant]_output[Half(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN((Unnamed Layer* 335) [Constant] + (Unnamed Layer* 336) [Shuffle], PWN(PWN((Unnamed Layer* 332) [Constant] + (Unnamed Layer* 333) [Shuffle], Mul_367), Sub_369)), Add_371), Mul_394), Tactic: 0, 812[Half(2)], (Unnamed Layer* 338) [Constant]_output[Half(2)], (Unnamed Layer* 352) [Constant]_output[Half(2)] -> 843[Half(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 707 copy, Tactic: 0, 707[Float(2)] -> 935[Float(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 775 copy, Tactic: 0, 775[Half(2)] -> 935[Float(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 843 copy, Tactic: 0, 843[Half(2)] -> 935[Float(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 935 copy, Tactic: 0, 935[Float(2)] -> boxes[Float(2)] [03/13/2022-08:32:24] [V] [TRT] Layer(Reformat): 936 copy, Tactic: 0, 936[Float(2)] -> boxes[Float(2)] [03/13/2022-08:32:25] [I] Starting inference threads [03/13/2022-08:32:28] [I] Warmup completed 18 queries over 200 ms [03/13/2022-08:32:28] [I] Timing trace has 298 queries over 3.03189 s [03/13/2022-08:32:28] [I] Trace averages of 10 runs: [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.838 ms - Host latency: 11.0475 ms (end to end 21.743 ms, enqueue 0.510503 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 9.833 ms - Host latency: 10.0511 ms (end to end 19.518 ms, enqueue 0.545096 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.2505 ms - Host latency: 10.4373 ms (end to end 20.4402 ms, enqueue 0.432492 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.1875 ms - Host latency: 10.4415 ms (end to end 20.2257 ms, enqueue 0.534323 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.2344 ms - Host latency: 10.4932 ms (end to end 20.3137 ms, enqueue 0.578394 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 9.73084 ms - Host latency: 9.98274 ms (end to end 19.2686 ms, enqueue 0.595074 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 9.9701 ms - Host latency: 10.2116 ms (end to end 19.8629 ms, enqueue 0.579175 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.0641 ms - Host latency: 10.3192 ms (end to end 19.9224 ms, enqueue 0.575073 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.1543 ms - Host latency: 10.4086 ms (end to end 20.2018 ms, enqueue 0.532495 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 9.84061 ms - Host latency: 10.0831 ms (end to end 19.4756 ms, enqueue 0.597021 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.0387 ms - Host latency: 10.2921 ms (end to end 19.9851 ms, enqueue 0.600024 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.0692 ms - Host latency: 10.3073 ms (end to end 19.9135 ms, enqueue 0.554944 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.2491 ms - Host latency: 10.5055 ms (end to end 20.2783 ms, enqueue 0.554639 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 9.78859 ms - Host latency: 10.0261 ms (end to end 19.4536 ms, enqueue 0.592932 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 9.65203 ms - Host latency: 9.87452 ms (end to end 19.2788 ms, enqueue 0.60448 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.1972 ms - Host latency: 10.4527 ms (end to end 20.1634 ms, enqueue 0.624219 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.2181 ms - Host latency: 10.4739 ms (end to end 20.2314 ms, enqueue 0.526855 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.2492 ms - Host latency: 10.5044 ms (end to end 20.3421 ms, enqueue 0.536255 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.253 ms - Host latency: 10.5068 ms (end to end 20.3294 ms, enqueue 0.527246 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.2389 ms - Host latency: 10.4845 ms (end to end 20.3077 ms, enqueue 0.535815 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.0391 ms - Host latency: 10.2934 ms (end to end 20.0007 ms, enqueue 0.609912 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.0405 ms - Host latency: 10.2909 ms (end to end 19.8088 ms, enqueue 0.634448 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.2655 ms - Host latency: 10.5349 ms (end to end 20.3998 ms, enqueue 0.731665 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.1808 ms - Host latency: 10.4344 ms (end to end 20.259 ms, enqueue 0.664233 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.1936 ms - Host latency: 10.4515 ms (end to end 20.1914 ms, enqueue 0.555591 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.1895 ms - Host latency: 10.4366 ms (end to end 20.2242 ms, enqueue 0.53147 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.233 ms - Host latency: 10.4836 ms (end to end 20.2729 ms, enqueue 0.546899 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.2582 ms - Host latency: 10.5161 ms (end to end 20.3751 ms, enqueue 0.546362 ms) [03/13/2022-08:32:28] [I] Average on 10 runs - GPU latency: 10.1859 ms - Host latency: 10.4444 ms (end to end 20.1991 ms, enqueue 0.546606 ms) [03/13/2022-08:32:28] [I] Host Latency [03/13/2022-08:32:28] [I] min: 9.62048 ms (end to end 18.6476 ms) [03/13/2022-08:32:28] [I] max: 11.5185 ms (end to end 23.115 ms) [03/13/2022-08:32:28] [I] mean: 10.3776 ms (end to end 20.1116 ms) [03/13/2022-08:32:28] [I] median: 10.4668 ms (end to end 20.2606 ms) [03/13/2022-08:32:28] [I] percentile: 11.4503 ms at 99% (end to end 22.398 ms at 99%) [03/13/2022-08:32:28] [I] throughput: 98.2885 qps [03/13/2022-08:32:28] [I] walltime: 3.03189 s [03/13/2022-08:32:28] [I] Enqueue Time [03/13/2022-08:32:28] [I] min: 0.409409 ms [03/13/2022-08:32:28] [I] max: 1.18115 ms [03/13/2022-08:32:28] [I] median: 0.54541 ms [03/13/2022-08:32:28] [I] GPU Compute [03/13/2022-08:32:28] [I] min: 9.38635 ms [03/13/2022-08:32:28] [I] max: 11.3303 ms [03/13/2022-08:32:28] [I] mean: 10.1311 ms [03/13/2022-08:32:28] [I] median: 10.2164 ms [03/13/2022-08:32:28] [I] percentile: 11.2354 ms at 99% [03/13/2022-08:32:28] [I] total compute time: 3.01906 s &&&& PASSED TensorRT.trtexec # trtexec --onnx=/path/to/model.onnx --saveEngine=/path/to/engine_TRT-7-1-3_CCC-7-5.trt --fp16 --verbose --iterations=10 comparing 46365057[b] to 46365072[b] Encryption/Decryption PASSED