---------------------------------------------------------------- Input filename: model/onnx/net_566.onnx ONNX IR version: 0.0.4 Opset version: 11 Producer name: pytorch Producer version: 1.3 Domain: Model version: 0 Doc string: ---------------------------------------------------------------- [09/29/2020-17:41:39] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [09/29/2020-17:41:39] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [09/29/2020-17:41:39] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [09/29/2020-17:41:39] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [09/29/2020-17:41:39] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1 [09/29/2020-17:41:39] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [09/29/2020-17:41:39] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [09/29/2020-17:41:39] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [09/29/2020-17:41:39] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [09/29/2020-17:41:39] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [09/29/2020-17:41:39] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [09/29/2020-17:41:39] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [09/29/2020-17:41:39] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [09/29/2020-17:41:39] [V] [TRT] Registered plugin creator - ::Proposal version 1 [09/29/2020-17:41:39] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [09/29/2020-17:41:39] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [09/29/2020-17:41:39] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [09/29/2020-17:41:39] [V] [TRT] Registered plugin creator - ::Split version 1 [09/29/2020-17:41:39] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [09/29/2020-17:41:39] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:206: Adding network input: input.1 with dtype: float32, dimensions: (1, 3, 512, 512) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: input.1 for ONNX tensor: input.1 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.base_layer.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.base_layer.1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.base_layer.1.num_batches_tracked [09/29/2020-17:41:39] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.base_layer.1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.base_layer.1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.base_layer.1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.fc.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.fc.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level0.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level0.1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level0.1.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level0.1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level0.1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level0.1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level1.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level1.1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level1.1.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level1.1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level1.1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level1.1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.project.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.project.1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.project.1.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.project.1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.project.1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.project.1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.root.bn.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.root.bn.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.root.bn.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.root.bn.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.root.bn.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.root.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree1.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree1.bn1.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree1.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree1.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree1.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree1.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree1.bn2.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree1.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree1.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree1.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree1.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree1.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree2.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree2.bn1.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree2.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree2.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree2.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree2.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree2.bn2.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree2.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree2.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree2.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree2.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level2.tree2.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.project.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.project.1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.project.1.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.project.1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.project.1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.project.1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.project.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.project.1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.project.1.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.project.1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.project.1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.project.1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.root.bn.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.root.bn.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.root.bn.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.root.bn.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.root.bn.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.root.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree1.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree1.bn1.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree1.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree1.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree1.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree1.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree1.bn2.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree1.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree1.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree1.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree1.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree1.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree2.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree2.bn1.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree2.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree2.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree2.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree2.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree2.bn2.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree2.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree2.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree2.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree2.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree1.tree2.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.root.bn.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.root.bn.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.root.bn.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.root.bn.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.root.bn.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.root.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree1.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree1.bn1.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree1.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree1.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree1.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree1.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree1.bn2.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree1.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree1.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree1.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree1.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree1.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree2.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree2.bn1.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree2.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree2.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree2.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree2.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree2.bn2.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree2.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree2.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree2.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree2.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level3.tree2.tree2.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.project.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.project.1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.project.1.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.project.1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.project.1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.project.1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.project.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.project.1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.project.1.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.project.1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.project.1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.project.1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.root.bn.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.root.bn.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.root.bn.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.root.bn.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.root.bn.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.root.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree1.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree1.bn1.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree1.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree1.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree1.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree1.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree1.bn2.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree1.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree1.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree1.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree1.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree1.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree2.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree2.bn1.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree2.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree2.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree2.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree2.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree2.bn2.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree2.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree2.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree2.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree2.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree1.tree2.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.root.bn.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.root.bn.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.root.bn.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.root.bn.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.root.bn.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.root.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree1.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree1.bn1.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree1.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree1.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree1.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree1.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree1.bn2.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree1.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree1.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree1.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree1.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree1.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree2.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree2.bn1.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree2.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree2.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree2.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree2.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree2.bn2.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree2.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree2.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree2.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree2.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level4.tree2.tree2.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.project.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.project.1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.project.1.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.project.1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.project.1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.project.1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.root.bn.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.root.bn.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.root.bn.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.root.bn.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.root.bn.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.root.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree1.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree1.bn1.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree1.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree1.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree1.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree1.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree1.bn2.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree1.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree1.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree1.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree1.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree1.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree2.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree2.bn1.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree2.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree2.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree2.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree2.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree2.bn2.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree2.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree2.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree2.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree2.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: base.level5.tree2.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_0.node_1.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_0.node_1.actf.0.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_0.node_1.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_0.node_1.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_0.node_1.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_0.node_1.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_0.node_1.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_0.node_1.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_0.node_1.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_0.proj_1.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_0.proj_1.actf.0.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_0.proj_1.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_0.proj_1.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_0.proj_1.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_0.proj_1.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_0.proj_1.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_0.proj_1.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_0.proj_1.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_0.up_1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.node_1.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.node_1.actf.0.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.node_1.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.node_1.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.node_1.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.node_1.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.node_1.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.node_1.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.node_1.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.node_2.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.node_2.actf.0.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.node_2.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.node_2.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.node_2.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.node_2.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.node_2.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.node_2.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.node_2.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.proj_1.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.proj_1.actf.0.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.proj_1.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.proj_1.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.proj_1.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.proj_1.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.proj_1.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.proj_1.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.proj_1.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.proj_2.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.proj_2.actf.0.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.proj_2.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.proj_2.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.proj_2.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.proj_2.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.proj_2.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.proj_2.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.proj_2.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.up_1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_1.up_2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_1.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_1.actf.0.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_1.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_1.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_1.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_1.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_1.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_1.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_1.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_2.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_2.actf.0.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_2.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_2.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_2.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_2.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_2.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_2.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_2.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_3.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_3.actf.0.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_3.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_3.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_3.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_3.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_3.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_3.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.node_3.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_1.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_1.actf.0.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_1.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_1.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_1.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_1.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_1.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_1.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_1.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_2.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_2.actf.0.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_2.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_2.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_2.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_2.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_2.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_2.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_2.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_3.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_3.actf.0.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_3.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_3.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_3.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_3.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_3.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_3.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.proj_3.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.up_1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.up_2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: dla_up.ida_2.up_3.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: hm.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: hm.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: hm.2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: hm.2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.node_1.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.node_1.actf.0.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.node_1.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.node_1.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.node_1.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.node_1.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.node_1.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.node_1.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.node_1.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.node_2.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.node_2.actf.0.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.node_2.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.node_2.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.node_2.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.node_2.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.node_2.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.node_2.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.node_2.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.proj_1.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.proj_1.actf.0.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.proj_1.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.proj_1.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.proj_1.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.proj_1.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.proj_1.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.proj_1.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.proj_1.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.proj_2.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.proj_2.actf.0.num_batches_tracked [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.proj_2.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.proj_2.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.proj_2.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.proj_2.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.proj_2.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.proj_2.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.proj_2.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.up_1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: ida_up.up_2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: reg.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: reg.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: reg.2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: reg.2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: wh.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: wh.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: wh.2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:90: Importing initializer: wh.2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: input.1 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.base_layer.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [input.1 -> (1, 3, 512, 512)], [base.base_layer.0.weight -> (16, 3, 7, 7)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 3, 512, 512) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 0) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (7, 7), strides: (1, 1), prepadding: (3, 3), postpadding: (3, 3), dilations: (1, 1), numOutputs: 16 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 16, 512, 512) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 401 for ONNX tensor: 401 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [401 -> (1, 16, 512, 512)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 401 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.base_layer.1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.base_layer.1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.base_layer.1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.base_layer.1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [401 -> (1, 16, 512, 512)], [base.base_layer.1.weight -> (16)], [base.base_layer.1.bias -> (16)], [base.base_layer.1.running_mean -> (16)], [base.base_layer.1.running_var -> (16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 1) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 402 for ONNX tensor: 402 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [402 -> (1, 16, 512, 512)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 402 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [402 -> (1, 16, 512, 512)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 2) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 403 for ONNX tensor: 403 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [403 -> (1, 16, 512, 512)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 403 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level0.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [403 -> (1, 16, 512, 512)], [base.level0.0.weight -> (16, 16, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 16, 512, 512) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 3) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 16 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 16, 512, 512) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 404 for ONNX tensor: 404 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [404 -> (1, 16, 512, 512)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 404 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level0.1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level0.1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level0.1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level0.1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [404 -> (1, 16, 512, 512)], [base.level0.1.weight -> (16)], [base.level0.1.bias -> (16)], [base.level0.1.running_mean -> (16)], [base.level0.1.running_var -> (16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 4) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 405 for ONNX tensor: 405 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [405 -> (1, 16, 512, 512)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 405 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [405 -> (1, 16, 512, 512)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 5) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 406 for ONNX tensor: 406 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [406 -> (1, 16, 512, 512)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 406 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level1.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [406 -> (1, 16, 512, 512)], [base.level1.0.weight -> (32, 16, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 16, 512, 512) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 6) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 32, 256, 256) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 407 for ONNX tensor: 407 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [407 -> (1, 32, 256, 256)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 407 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level1.1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level1.1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level1.1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level1.1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [407 -> (1, 32, 256, 256)], [base.level1.1.weight -> (32)], [base.level1.1.bias -> (32)], [base.level1.1.running_mean -> (32)], [base.level1.1.running_var -> (32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 7) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 408 for ONNX tensor: 408 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [408 -> (1, 32, 256, 256)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 408 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [408 -> (1, 32, 256, 256)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 8) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 409 for ONNX tensor: 409 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [409 -> (1, 32, 256, 256)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [MaxPool] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 409 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [MaxPool] inputs: [409 -> (1, 32, 256, 256)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 9) [Pooling] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 410 for ONNX tensor: 410 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [MaxPool] outputs: [410 -> (1, 32, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 410 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.project.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [410 -> (1, 32, 128, 128)], [base.level2.project.0.weight -> (64, 32, 1, 1)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 32, 128, 128) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 10) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 64, 128, 128) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 411 for ONNX tensor: 411 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [411 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 411 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.project.1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.project.1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.project.1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.project.1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [411 -> (1, 64, 128, 128)], [base.level2.project.1.weight -> (64)], [base.level2.project.1.bias -> (64)], [base.level2.project.1.running_mean -> (64)], [base.level2.project.1.running_var -> (64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 11) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 412 for ONNX tensor: 412 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [412 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 409 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.tree1.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [409 -> (1, 32, 256, 256)], [base.level2.tree1.conv1.weight -> (64, 32, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 32, 256, 256) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 12) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 64, 128, 128) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 413 for ONNX tensor: 413 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [413 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 413 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.tree1.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.tree1.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.tree1.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.tree1.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [413 -> (1, 64, 128, 128)], [base.level2.tree1.bn1.weight -> (64)], [base.level2.tree1.bn1.bias -> (64)], [base.level2.tree1.bn1.running_mean -> (64)], [base.level2.tree1.bn1.running_var -> (64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 13) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 414 for ONNX tensor: 414 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [414 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 414 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [414 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 14) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 415 for ONNX tensor: 415 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [415 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 415 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.tree1.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [415 -> (1, 64, 128, 128)], [base.level2.tree1.conv2.weight -> (64, 64, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 64, 128, 128) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 15) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 64, 128, 128) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 416 for ONNX tensor: 416 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [416 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 416 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.tree1.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.tree1.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.tree1.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.tree1.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [416 -> (1, 64, 128, 128)], [base.level2.tree1.bn2.weight -> (64)], [base.level2.tree1.bn2.bias -> (64)], [base.level2.tree1.bn2.running_mean -> (64)], [base.level2.tree1.bn2.running_var -> (64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 16) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 417 for ONNX tensor: 417 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [417 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Add] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 417 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 412 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Add] inputs: [417 -> (1, 64, 128, 128)], [412 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 17) [ElementWise] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 418 for ONNX tensor: 418 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Add] outputs: [418 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 418 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [418 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 18) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 419 for ONNX tensor: 419 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [419 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 419 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.tree2.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [419 -> (1, 64, 128, 128)], [base.level2.tree2.conv1.weight -> (64, 64, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 64, 128, 128) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 19) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 64, 128, 128) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 420 for ONNX tensor: 420 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [420 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 420 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.tree2.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.tree2.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.tree2.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.tree2.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [420 -> (1, 64, 128, 128)], [base.level2.tree2.bn1.weight -> (64)], [base.level2.tree2.bn1.bias -> (64)], [base.level2.tree2.bn1.running_mean -> (64)], [base.level2.tree2.bn1.running_var -> (64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 20) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 421 for ONNX tensor: 421 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [421 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 421 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [421 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 21) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 422 for ONNX tensor: 422 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [422 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 422 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.tree2.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [422 -> (1, 64, 128, 128)], [base.level2.tree2.conv2.weight -> (64, 64, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 64, 128, 128) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 22) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 64, 128, 128) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 423 for ONNX tensor: 423 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [423 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 423 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.tree2.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.tree2.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.tree2.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.tree2.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [423 -> (1, 64, 128, 128)], [base.level2.tree2.bn2.weight -> (64)], [base.level2.tree2.bn2.bias -> (64)], [base.level2.tree2.bn2.running_mean -> (64)], [base.level2.tree2.bn2.running_var -> (64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 23) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 424 for ONNX tensor: 424 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [424 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Add] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 424 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 419 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Add] inputs: [424 -> (1, 64, 128, 128)], [419 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 24) [ElementWise] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 425 for ONNX tensor: 425 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Add] outputs: [425 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 425 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [425 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 25) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 426 for ONNX tensor: 426 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [426 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Concat] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 426 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 419 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Concat] inputs: [426 -> (1, 64, 128, 128)], [419 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 26) [Concatenation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 427 for ONNX tensor: 427 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Concat] outputs: [427 -> (1, 128, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 427 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.root.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [427 -> (1, 128, 128, 128)], [base.level2.root.conv.weight -> (64, 128, 1, 1)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 128, 128, 128) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 27) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 64, 128, 128) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 428 for ONNX tensor: 428 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [428 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 428 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.root.bn.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.root.bn.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.root.bn.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level2.root.bn.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [428 -> (1, 64, 128, 128)], [base.level2.root.bn.weight -> (64)], [base.level2.root.bn.bias -> (64)], [base.level2.root.bn.running_mean -> (64)], [base.level2.root.bn.running_var -> (64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 28) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 429 for ONNX tensor: 429 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [429 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 429 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [429 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 29) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 430 for ONNX tensor: 430 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [430 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [MaxPool] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 430 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [MaxPool] inputs: [430 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 30) [Pooling] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 431 for ONNX tensor: 431 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [MaxPool] outputs: [431 -> (1, 64, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [MaxPool] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 430 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [MaxPool] inputs: [430 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 31) [Pooling] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 432 for ONNX tensor: 432 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [MaxPool] outputs: [432 -> (1, 64, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 432 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.project.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [432 -> (1, 64, 64, 64)], [base.level3.tree1.project.0.weight -> (128, 64, 1, 1)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 64, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 32) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 433 for ONNX tensor: 433 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [433 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 433 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.project.1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.project.1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.project.1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.project.1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [433 -> (1, 128, 64, 64)], [base.level3.tree1.project.1.weight -> (128)], [base.level3.tree1.project.1.bias -> (128)], [base.level3.tree1.project.1.running_mean -> (128)], [base.level3.tree1.project.1.running_var -> (128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 33) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 434 for ONNX tensor: 434 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [434 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 430 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.tree1.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [430 -> (1, 64, 128, 128)], [base.level3.tree1.tree1.conv1.weight -> (128, 64, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 64, 128, 128) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 34) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 435 for ONNX tensor: 435 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [435 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 435 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.tree1.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.tree1.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.tree1.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.tree1.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [435 -> (1, 128, 64, 64)], [base.level3.tree1.tree1.bn1.weight -> (128)], [base.level3.tree1.tree1.bn1.bias -> (128)], [base.level3.tree1.tree1.bn1.running_mean -> (128)], [base.level3.tree1.tree1.bn1.running_var -> (128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 35) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 436 for ONNX tensor: 436 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [436 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 436 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [436 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 36) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 437 for ONNX tensor: 437 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [437 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 437 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.tree1.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [437 -> (1, 128, 64, 64)], [base.level3.tree1.tree1.conv2.weight -> (128, 128, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 37) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 438 for ONNX tensor: 438 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [438 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 438 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.tree1.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.tree1.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.tree1.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.tree1.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [438 -> (1, 128, 64, 64)], [base.level3.tree1.tree1.bn2.weight -> (128)], [base.level3.tree1.tree1.bn2.bias -> (128)], [base.level3.tree1.tree1.bn2.running_mean -> (128)], [base.level3.tree1.tree1.bn2.running_var -> (128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 38) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 439 for ONNX tensor: 439 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [439 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Add] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 439 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 434 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Add] inputs: [439 -> (1, 128, 64, 64)], [434 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 39) [ElementWise] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 440 for ONNX tensor: 440 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Add] outputs: [440 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 440 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [440 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 40) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 441 for ONNX tensor: 441 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [441 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 441 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.tree2.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [441 -> (1, 128, 64, 64)], [base.level3.tree1.tree2.conv1.weight -> (128, 128, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 41) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 442 for ONNX tensor: 442 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [442 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 442 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.tree2.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.tree2.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.tree2.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.tree2.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [442 -> (1, 128, 64, 64)], [base.level3.tree1.tree2.bn1.weight -> (128)], [base.level3.tree1.tree2.bn1.bias -> (128)], [base.level3.tree1.tree2.bn1.running_mean -> (128)], [base.level3.tree1.tree2.bn1.running_var -> (128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 42) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 443 for ONNX tensor: 443 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [443 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 443 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [443 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 43) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 444 for ONNX tensor: 444 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [444 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 444 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.tree2.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [444 -> (1, 128, 64, 64)], [base.level3.tree1.tree2.conv2.weight -> (128, 128, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 44) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 445 for ONNX tensor: 445 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [445 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 445 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.tree2.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.tree2.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.tree2.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.tree2.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [445 -> (1, 128, 64, 64)], [base.level3.tree1.tree2.bn2.weight -> (128)], [base.level3.tree1.tree2.bn2.bias -> (128)], [base.level3.tree1.tree2.bn2.running_mean -> (128)], [base.level3.tree1.tree2.bn2.running_var -> (128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 45) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 446 for ONNX tensor: 446 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [446 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Add] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 446 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 441 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Add] inputs: [446 -> (1, 128, 64, 64)], [441 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 46) [ElementWise] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 447 for ONNX tensor: 447 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Add] outputs: [447 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 447 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [447 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 47) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 448 for ONNX tensor: 448 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [448 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Concat] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 448 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 441 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Concat] inputs: [448 -> (1, 128, 64, 64)], [441 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 48) [Concatenation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 449 for ONNX tensor: 449 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Concat] outputs: [449 -> (1, 256, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 449 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.root.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [449 -> (1, 256, 64, 64)], [base.level3.tree1.root.conv.weight -> (128, 256, 1, 1)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 256, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 49) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 450 for ONNX tensor: 450 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [450 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 450 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.root.bn.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.root.bn.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.root.bn.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree1.root.bn.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [450 -> (1, 128, 64, 64)], [base.level3.tree1.root.bn.weight -> (128)], [base.level3.tree1.root.bn.bias -> (128)], [base.level3.tree1.root.bn.running_mean -> (128)], [base.level3.tree1.root.bn.running_var -> (128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 50) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 451 for ONNX tensor: 451 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [451 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 451 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [451 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 51) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 452 for ONNX tensor: 452 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [452 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 452 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.tree1.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [452 -> (1, 128, 64, 64)], [base.level3.tree2.tree1.conv1.weight -> (128, 128, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 52) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 453 for ONNX tensor: 453 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [453 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 453 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.tree1.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.tree1.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.tree1.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.tree1.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [453 -> (1, 128, 64, 64)], [base.level3.tree2.tree1.bn1.weight -> (128)], [base.level3.tree2.tree1.bn1.bias -> (128)], [base.level3.tree2.tree1.bn1.running_mean -> (128)], [base.level3.tree2.tree1.bn1.running_var -> (128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 53) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 454 for ONNX tensor: 454 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [454 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 454 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [454 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 54) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 455 for ONNX tensor: 455 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [455 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 455 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.tree1.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [455 -> (1, 128, 64, 64)], [base.level3.tree2.tree1.conv2.weight -> (128, 128, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 55) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 456 for ONNX tensor: 456 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [456 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 456 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.tree1.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.tree1.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.tree1.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.tree1.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [456 -> (1, 128, 64, 64)], [base.level3.tree2.tree1.bn2.weight -> (128)], [base.level3.tree2.tree1.bn2.bias -> (128)], [base.level3.tree2.tree1.bn2.running_mean -> (128)], [base.level3.tree2.tree1.bn2.running_var -> (128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 56) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 457 for ONNX tensor: 457 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [457 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Add] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 457 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 452 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Add] inputs: [457 -> (1, 128, 64, 64)], [452 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 57) [ElementWise] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 458 for ONNX tensor: 458 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Add] outputs: [458 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 458 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [458 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 58) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 459 for ONNX tensor: 459 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [459 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 459 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.tree2.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [459 -> (1, 128, 64, 64)], [base.level3.tree2.tree2.conv1.weight -> (128, 128, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 59) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 460 for ONNX tensor: 460 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [460 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 460 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.tree2.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.tree2.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.tree2.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.tree2.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [460 -> (1, 128, 64, 64)], [base.level3.tree2.tree2.bn1.weight -> (128)], [base.level3.tree2.tree2.bn1.bias -> (128)], [base.level3.tree2.tree2.bn1.running_mean -> (128)], [base.level3.tree2.tree2.bn1.running_var -> (128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 60) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 461 for ONNX tensor: 461 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [461 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 461 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [461 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 61) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 462 for ONNX tensor: 462 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [462 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 462 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.tree2.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [462 -> (1, 128, 64, 64)], [base.level3.tree2.tree2.conv2.weight -> (128, 128, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 62) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 463 for ONNX tensor: 463 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [463 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 463 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.tree2.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.tree2.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.tree2.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.tree2.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [463 -> (1, 128, 64, 64)], [base.level3.tree2.tree2.bn2.weight -> (128)], [base.level3.tree2.tree2.bn2.bias -> (128)], [base.level3.tree2.tree2.bn2.running_mean -> (128)], [base.level3.tree2.tree2.bn2.running_var -> (128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 63) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 464 for ONNX tensor: 464 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [464 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Add] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 464 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 459 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Add] inputs: [464 -> (1, 128, 64, 64)], [459 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 64) [ElementWise] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 465 for ONNX tensor: 465 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Add] outputs: [465 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 465 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [465 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 65) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 466 for ONNX tensor: 466 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [466 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Concat] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 466 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 459 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 431 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 452 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Concat] inputs: [466 -> (1, 128, 64, 64)], [459 -> (1, 128, 64, 64)], [431 -> (1, 64, 64, 64)], [452 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 66) [Concatenation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 467 for ONNX tensor: 467 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Concat] outputs: [467 -> (1, 448, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 467 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.root.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [467 -> (1, 448, 64, 64)], [base.level3.tree2.root.conv.weight -> (128, 448, 1, 1)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 448, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 67) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 468 for ONNX tensor: 468 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [468 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 468 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.root.bn.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.root.bn.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.root.bn.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level3.tree2.root.bn.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [468 -> (1, 128, 64, 64)], [base.level3.tree2.root.bn.weight -> (128)], [base.level3.tree2.root.bn.bias -> (128)], [base.level3.tree2.root.bn.running_mean -> (128)], [base.level3.tree2.root.bn.running_var -> (128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 68) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 469 for ONNX tensor: 469 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [469 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 469 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [469 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 69) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 470 for ONNX tensor: 470 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [470 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [MaxPool] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 470 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [MaxPool] inputs: [470 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 70) [Pooling] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 471 for ONNX tensor: 471 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [MaxPool] outputs: [471 -> (1, 128, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [MaxPool] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 470 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [MaxPool] inputs: [470 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 71) [Pooling] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 472 for ONNX tensor: 472 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [MaxPool] outputs: [472 -> (1, 128, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 472 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.project.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [472 -> (1, 128, 32, 32)], [base.level4.tree1.project.0.weight -> (256, 128, 1, 1)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 128, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 72) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 473 for ONNX tensor: 473 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [473 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 473 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.project.1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.project.1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.project.1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.project.1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [473 -> (1, 256, 32, 32)], [base.level4.tree1.project.1.weight -> (256)], [base.level4.tree1.project.1.bias -> (256)], [base.level4.tree1.project.1.running_mean -> (256)], [base.level4.tree1.project.1.running_var -> (256)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 73) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 474 for ONNX tensor: 474 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [474 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 470 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.tree1.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [470 -> (1, 128, 64, 64)], [base.level4.tree1.tree1.conv1.weight -> (256, 128, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 74) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 475 for ONNX tensor: 475 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [475 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 475 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.tree1.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.tree1.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.tree1.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.tree1.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [475 -> (1, 256, 32, 32)], [base.level4.tree1.tree1.bn1.weight -> (256)], [base.level4.tree1.tree1.bn1.bias -> (256)], [base.level4.tree1.tree1.bn1.running_mean -> (256)], [base.level4.tree1.tree1.bn1.running_var -> (256)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 75) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 476 for ONNX tensor: 476 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [476 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 476 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [476 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 76) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 477 for ONNX tensor: 477 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [477 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 477 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.tree1.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [477 -> (1, 256, 32, 32)], [base.level4.tree1.tree1.conv2.weight -> (256, 256, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 77) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 478 for ONNX tensor: 478 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [478 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 478 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.tree1.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.tree1.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.tree1.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.tree1.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [478 -> (1, 256, 32, 32)], [base.level4.tree1.tree1.bn2.weight -> (256)], [base.level4.tree1.tree1.bn2.bias -> (256)], [base.level4.tree1.tree1.bn2.running_mean -> (256)], [base.level4.tree1.tree1.bn2.running_var -> (256)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 78) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 479 for ONNX tensor: 479 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [479 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Add] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 479 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 474 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Add] inputs: [479 -> (1, 256, 32, 32)], [474 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 79) [ElementWise] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 480 for ONNX tensor: 480 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Add] outputs: [480 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 480 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [480 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 80) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 481 for ONNX tensor: 481 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [481 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 481 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.tree2.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [481 -> (1, 256, 32, 32)], [base.level4.tree1.tree2.conv1.weight -> (256, 256, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 81) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 482 for ONNX tensor: 482 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [482 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 482 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.tree2.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.tree2.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.tree2.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.tree2.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [482 -> (1, 256, 32, 32)], [base.level4.tree1.tree2.bn1.weight -> (256)], [base.level4.tree1.tree2.bn1.bias -> (256)], [base.level4.tree1.tree2.bn1.running_mean -> (256)], [base.level4.tree1.tree2.bn1.running_var -> (256)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 82) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 483 for ONNX tensor: 483 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [483 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 483 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [483 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 83) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 484 for ONNX tensor: 484 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [484 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 484 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.tree2.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [484 -> (1, 256, 32, 32)], [base.level4.tree1.tree2.conv2.weight -> (256, 256, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 84) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 485 for ONNX tensor: 485 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [485 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 485 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.tree2.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.tree2.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.tree2.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.tree2.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [485 -> (1, 256, 32, 32)], [base.level4.tree1.tree2.bn2.weight -> (256)], [base.level4.tree1.tree2.bn2.bias -> (256)], [base.level4.tree1.tree2.bn2.running_mean -> (256)], [base.level4.tree1.tree2.bn2.running_var -> (256)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 85) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 486 for ONNX tensor: 486 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [486 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Add] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 486 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 481 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Add] inputs: [486 -> (1, 256, 32, 32)], [481 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 86) [ElementWise] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 487 for ONNX tensor: 487 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Add] outputs: [487 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 487 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [487 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 87) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 488 for ONNX tensor: 488 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [488 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Concat] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 488 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 481 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Concat] inputs: [488 -> (1, 256, 32, 32)], [481 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 88) [Concatenation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 489 for ONNX tensor: 489 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Concat] outputs: [489 -> (1, 512, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 489 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.root.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [489 -> (1, 512, 32, 32)], [base.level4.tree1.root.conv.weight -> (256, 512, 1, 1)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 512, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 89) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 490 for ONNX tensor: 490 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [490 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 490 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.root.bn.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.root.bn.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.root.bn.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree1.root.bn.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [490 -> (1, 256, 32, 32)], [base.level4.tree1.root.bn.weight -> (256)], [base.level4.tree1.root.bn.bias -> (256)], [base.level4.tree1.root.bn.running_mean -> (256)], [base.level4.tree1.root.bn.running_var -> (256)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 90) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 491 for ONNX tensor: 491 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [491 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 491 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [491 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 91) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 492 for ONNX tensor: 492 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [492 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 492 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.tree1.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [492 -> (1, 256, 32, 32)], [base.level4.tree2.tree1.conv1.weight -> (256, 256, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 92) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 493 for ONNX tensor: 493 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [493 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 493 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.tree1.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.tree1.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.tree1.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.tree1.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [493 -> (1, 256, 32, 32)], [base.level4.tree2.tree1.bn1.weight -> (256)], [base.level4.tree2.tree1.bn1.bias -> (256)], [base.level4.tree2.tree1.bn1.running_mean -> (256)], [base.level4.tree2.tree1.bn1.running_var -> (256)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 93) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 494 for ONNX tensor: 494 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [494 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 494 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [494 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 94) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 495 for ONNX tensor: 495 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [495 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 495 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.tree1.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [495 -> (1, 256, 32, 32)], [base.level4.tree2.tree1.conv2.weight -> (256, 256, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 95) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 496 for ONNX tensor: 496 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [496 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 496 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.tree1.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.tree1.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.tree1.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.tree1.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [496 -> (1, 256, 32, 32)], [base.level4.tree2.tree1.bn2.weight -> (256)], [base.level4.tree2.tree1.bn2.bias -> (256)], [base.level4.tree2.tree1.bn2.running_mean -> (256)], [base.level4.tree2.tree1.bn2.running_var -> (256)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 96) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 497 for ONNX tensor: 497 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [497 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Add] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 497 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 492 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Add] inputs: [497 -> (1, 256, 32, 32)], [492 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 97) [ElementWise] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 498 for ONNX tensor: 498 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Add] outputs: [498 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 498 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [498 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 98) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 499 for ONNX tensor: 499 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [499 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 499 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.tree2.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [499 -> (1, 256, 32, 32)], [base.level4.tree2.tree2.conv1.weight -> (256, 256, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 99) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 500 for ONNX tensor: 500 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [500 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 500 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.tree2.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.tree2.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.tree2.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.tree2.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [500 -> (1, 256, 32, 32)], [base.level4.tree2.tree2.bn1.weight -> (256)], [base.level4.tree2.tree2.bn1.bias -> (256)], [base.level4.tree2.tree2.bn1.running_mean -> (256)], [base.level4.tree2.tree2.bn1.running_var -> (256)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 100) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 501 for ONNX tensor: 501 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [501 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 501 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [501 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 101) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 502 for ONNX tensor: 502 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [502 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 502 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.tree2.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [502 -> (1, 256, 32, 32)], [base.level4.tree2.tree2.conv2.weight -> (256, 256, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 102) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 503 for ONNX tensor: 503 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [503 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 503 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.tree2.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.tree2.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.tree2.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.tree2.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [503 -> (1, 256, 32, 32)], [base.level4.tree2.tree2.bn2.weight -> (256)], [base.level4.tree2.tree2.bn2.bias -> (256)], [base.level4.tree2.tree2.bn2.running_mean -> (256)], [base.level4.tree2.tree2.bn2.running_var -> (256)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 103) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 504 for ONNX tensor: 504 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [504 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Add] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 504 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 499 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Add] inputs: [504 -> (1, 256, 32, 32)], [499 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 104) [ElementWise] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 505 for ONNX tensor: 505 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Add] outputs: [505 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 505 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [505 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 105) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 506 for ONNX tensor: 506 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [506 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Concat] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 506 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 499 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 471 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 492 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Concat] inputs: [506 -> (1, 256, 32, 32)], [499 -> (1, 256, 32, 32)], [471 -> (1, 128, 32, 32)], [492 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 106) [Concatenation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 507 for ONNX tensor: 507 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Concat] outputs: [507 -> (1, 896, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 507 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.root.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [507 -> (1, 896, 32, 32)], [base.level4.tree2.root.conv.weight -> (256, 896, 1, 1)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 896, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 107) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 508 for ONNX tensor: 508 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [508 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 508 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.root.bn.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.root.bn.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.root.bn.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level4.tree2.root.bn.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [508 -> (1, 256, 32, 32)], [base.level4.tree2.root.bn.weight -> (256)], [base.level4.tree2.root.bn.bias -> (256)], [base.level4.tree2.root.bn.running_mean -> (256)], [base.level4.tree2.root.bn.running_var -> (256)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 108) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 509 for ONNX tensor: 509 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [509 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 509 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [509 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 109) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 510 for ONNX tensor: 510 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [510 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [MaxPool] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 510 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [MaxPool] inputs: [510 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 110) [Pooling] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 511 for ONNX tensor: 511 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [MaxPool] outputs: [511 -> (1, 256, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 511 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.project.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [511 -> (1, 256, 16, 16)], [base.level5.project.0.weight -> (512, 256, 1, 1)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 256, 16, 16) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 111) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 512, 16, 16) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 512 for ONNX tensor: 512 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [512 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 512 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.project.1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.project.1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.project.1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.project.1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [512 -> (1, 512, 16, 16)], [base.level5.project.1.weight -> (512)], [base.level5.project.1.bias -> (512)], [base.level5.project.1.running_mean -> (512)], [base.level5.project.1.running_var -> (512)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 112) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 513 for ONNX tensor: 513 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [513 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 510 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.tree1.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [510 -> (1, 256, 32, 32)], [base.level5.tree1.conv1.weight -> (512, 256, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 113) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 512, 16, 16) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 514 for ONNX tensor: 514 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [514 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 514 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.tree1.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.tree1.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.tree1.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.tree1.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [514 -> (1, 512, 16, 16)], [base.level5.tree1.bn1.weight -> (512)], [base.level5.tree1.bn1.bias -> (512)], [base.level5.tree1.bn1.running_mean -> (512)], [base.level5.tree1.bn1.running_var -> (512)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 114) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 515 for ONNX tensor: 515 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [515 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 515 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [515 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 115) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 516 for ONNX tensor: 516 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [516 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 516 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.tree1.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [516 -> (1, 512, 16, 16)], [base.level5.tree1.conv2.weight -> (512, 512, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 512, 16, 16) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 116) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 512, 16, 16) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 517 for ONNX tensor: 517 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [517 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 517 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.tree1.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.tree1.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.tree1.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.tree1.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [517 -> (1, 512, 16, 16)], [base.level5.tree1.bn2.weight -> (512)], [base.level5.tree1.bn2.bias -> (512)], [base.level5.tree1.bn2.running_mean -> (512)], [base.level5.tree1.bn2.running_var -> (512)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 117) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 518 for ONNX tensor: 518 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [518 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Add] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 518 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 513 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Add] inputs: [518 -> (1, 512, 16, 16)], [513 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 118) [ElementWise] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 519 for ONNX tensor: 519 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Add] outputs: [519 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 519 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [519 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 119) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 520 for ONNX tensor: 520 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [520 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 520 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.tree2.conv1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [520 -> (1, 512, 16, 16)], [base.level5.tree2.conv1.weight -> (512, 512, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 512, 16, 16) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 120) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 512, 16, 16) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 521 for ONNX tensor: 521 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [521 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 521 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.tree2.bn1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.tree2.bn1.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.tree2.bn1.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.tree2.bn1.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [521 -> (1, 512, 16, 16)], [base.level5.tree2.bn1.weight -> (512)], [base.level5.tree2.bn1.bias -> (512)], [base.level5.tree2.bn1.running_mean -> (512)], [base.level5.tree2.bn1.running_var -> (512)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 121) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 522 for ONNX tensor: 522 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [522 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 522 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [522 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 122) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 523 for ONNX tensor: 523 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [523 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 523 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.tree2.conv2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [523 -> (1, 512, 16, 16)], [base.level5.tree2.conv2.weight -> (512, 512, 3, 3)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 512, 16, 16) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 123) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 512, 16, 16) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 524 for ONNX tensor: 524 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [524 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 524 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.tree2.bn2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.tree2.bn2.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.tree2.bn2.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.tree2.bn2.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [524 -> (1, 512, 16, 16)], [base.level5.tree2.bn2.weight -> (512)], [base.level5.tree2.bn2.bias -> (512)], [base.level5.tree2.bn2.running_mean -> (512)], [base.level5.tree2.bn2.running_var -> (512)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 124) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 525 for ONNX tensor: 525 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [525 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Add] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 525 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 520 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Add] inputs: [525 -> (1, 512, 16, 16)], [520 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 125) [ElementWise] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 526 for ONNX tensor: 526 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Add] outputs: [526 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 526 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [526 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 126) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 527 for ONNX tensor: 527 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [527 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Concat] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 527 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 520 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 511 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Concat] inputs: [527 -> (1, 512, 16, 16)], [520 -> (1, 512, 16, 16)], [511 -> (1, 256, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 127) [Concatenation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 528 for ONNX tensor: 528 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Concat] outputs: [528 -> (1, 1280, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 528 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.root.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [528 -> (1, 1280, 16, 16)], [base.level5.root.conv.weight -> (512, 1280, 1, 1)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 1280, 16, 16) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 128) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 512, 16, 16) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 529 for ONNX tensor: 529 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [529 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 529 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.root.bn.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.root.bn.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.root.bn.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: base.level5.root.bn.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [529 -> (1, 512, 16, 16)], [base.level5.root.bn.weight -> (512)], [base.level5.root.bn.bias -> (512)], [base.level5.root.bn.running_mean -> (512)], [base.level5.root.bn.running_var -> (512)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 129) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 530 for ONNX tensor: 530 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [530 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 530 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [530 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 130) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 531_1 for ONNX tensor: 531 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [531 -> (1, 512, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 531 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_0.proj_1.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_0.proj_1.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [531 -> (1, 512, 16, 16)], [dla_up.ida_0.proj_1.conv.conv_offset_mask.weight -> (27, 512, 3, 3)], [dla_up.ida_0.proj_1.conv.conv_offset_mask.bias -> (27)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 512, 16, 16) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 131) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 27 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 27, 16, 16) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 532 for ONNX tensor: 532 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [532 -> (1, 27, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [DCNv2] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 531 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 532 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_0.proj_1.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_0.proj_1.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [DCNv2] inputs: [531 -> (1, 512, 16, 16)], [532 -> (1, 27, 16, 16)], [dla_up.ida_0.proj_1.conv.weight -> (256, 512, 3, 3)], [dla_up.ida_0.proj_1.conv.bias -> (256)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 4 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 4 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 4 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 1 [09/29/2020-17:41:39] [I] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3805: Searching for plugin: DCNv2, plugin_version: 1, plugin_namespace: [09/29/2020-17:41:39] [I] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3827: Successfully created plugin: DCNv2 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 134) [PluginV2Ext] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 533 for ONNX tensor: 533 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [DCNv2] outputs: [533 -> (1, 256, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 533 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_0.proj_1.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_0.proj_1.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_0.proj_1.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_0.proj_1.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [533 -> (1, 256, 16, 16)], [dla_up.ida_0.proj_1.actf.0.weight -> (256)], [dla_up.ida_0.proj_1.actf.0.bias -> (256)], [dla_up.ida_0.proj_1.actf.0.running_mean -> (256)], [dla_up.ida_0.proj_1.actf.0.running_var -> (256)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 135) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 534 for ONNX tensor: 534 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [534 -> (1, 256, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 534 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [534 -> (1, 256, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 136) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 535 for ONNX tensor: 535 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [535 -> (1, 256, 16, 16)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [ConvTranspose] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 535 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_0.up_1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [ConvTranspose] inputs: [535 -> (1, 256, 16, 16)], [dla_up.ida_0.up_1.weight -> (256, 1, 4, 4)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:729: Running deconvolution with: Padding mode: NOTSET Pre-padding: (1, 1) Post-padding: (1, 1) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 137) [Deconvolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 536 for ONNX tensor: 536 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [ConvTranspose] outputs: [536 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Add] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 536 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 510 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Add] inputs: [536 -> (1, 256, 32, 32)], [510 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 138) [ElementWise] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 537 for ONNX tensor: 537 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Add] outputs: [537 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 537 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_0.node_1.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_0.node_1.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [537 -> (1, 256, 32, 32)], [dla_up.ida_0.node_1.conv.conv_offset_mask.weight -> (27, 256, 3, 3)], [dla_up.ida_0.node_1.conv.conv_offset_mask.bias -> (27)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 139) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 27 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 27, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 538 for ONNX tensor: 538 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [538 -> (1, 27, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [DCNv2] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 537 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 538 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_0.node_1.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_0.node_1.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [DCNv2] inputs: [537 -> (1, 256, 32, 32)], [538 -> (1, 27, 32, 32)], [dla_up.ida_0.node_1.conv.weight -> (256, 256, 3, 3)], [dla_up.ida_0.node_1.conv.bias -> (256)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 4 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 4 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 4 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 1 [09/29/2020-17:41:39] [I] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3805: Searching for plugin: DCNv2, plugin_version: 1, plugin_namespace: [09/29/2020-17:41:39] [I] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3827: Successfully created plugin: DCNv2 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 142) [PluginV2Ext] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 539 for ONNX tensor: 539 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [DCNv2] outputs: [539 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 539 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_0.node_1.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_0.node_1.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_0.node_1.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_0.node_1.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [539 -> (1, 256, 32, 32)], [dla_up.ida_0.node_1.actf.0.weight -> (256)], [dla_up.ida_0.node_1.actf.0.bias -> (256)], [dla_up.ida_0.node_1.actf.0.running_mean -> (256)], [dla_up.ida_0.node_1.actf.0.running_var -> (256)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 143) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 540 for ONNX tensor: 540 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [540 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 540 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [540 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 144) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 541_1 for ONNX tensor: 541 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [541 -> (1, 256, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 510 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.proj_1.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.proj_1.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [510 -> (1, 256, 32, 32)], [dla_up.ida_1.proj_1.conv.conv_offset_mask.weight -> (27, 256, 3, 3)], [dla_up.ida_1.proj_1.conv.conv_offset_mask.bias -> (27)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 145) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 27 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 27, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 542 for ONNX tensor: 542 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [542 -> (1, 27, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [DCNv2] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 510 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 542 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.proj_1.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.proj_1.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [DCNv2] inputs: [510 -> (1, 256, 32, 32)], [542 -> (1, 27, 32, 32)], [dla_up.ida_1.proj_1.conv.weight -> (128, 256, 3, 3)], [dla_up.ida_1.proj_1.conv.bias -> (128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 4 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 4 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 4 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 1 [09/29/2020-17:41:39] [I] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3805: Searching for plugin: DCNv2, plugin_version: 1, plugin_namespace: [09/29/2020-17:41:39] [I] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3827: Successfully created plugin: DCNv2 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 148) [PluginV2Ext] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 543 for ONNX tensor: 543 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [DCNv2] outputs: [543 -> (1, 128, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 543 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.proj_1.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.proj_1.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.proj_1.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.proj_1.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [543 -> (1, 128, 32, 32)], [dla_up.ida_1.proj_1.actf.0.weight -> (128)], [dla_up.ida_1.proj_1.actf.0.bias -> (128)], [dla_up.ida_1.proj_1.actf.0.running_mean -> (128)], [dla_up.ida_1.proj_1.actf.0.running_var -> (128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 149) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 544 for ONNX tensor: 544 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [544 -> (1, 128, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 544 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [544 -> (1, 128, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 150) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 545 for ONNX tensor: 545 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [545 -> (1, 128, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [ConvTranspose] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 545 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.up_1.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [ConvTranspose] inputs: [545 -> (1, 128, 32, 32)], [dla_up.ida_1.up_1.weight -> (128, 1, 4, 4)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:729: Running deconvolution with: Padding mode: NOTSET Pre-padding: (1, 1) Post-padding: (1, 1) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 151) [Deconvolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 546 for ONNX tensor: 546 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [ConvTranspose] outputs: [546 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Add] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 546 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 470 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Add] inputs: [546 -> (1, 128, 64, 64)], [470 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 152) [ElementWise] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 547 for ONNX tensor: 547 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Add] outputs: [547 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 547 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.node_1.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.node_1.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [547 -> (1, 128, 64, 64)], [dla_up.ida_1.node_1.conv.conv_offset_mask.weight -> (27, 128, 3, 3)], [dla_up.ida_1.node_1.conv.conv_offset_mask.bias -> (27)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 153) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 27 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 27, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 548 for ONNX tensor: 548 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [548 -> (1, 27, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [DCNv2] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 547 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 548 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.node_1.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.node_1.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [DCNv2] inputs: [547 -> (1, 128, 64, 64)], [548 -> (1, 27, 64, 64)], [dla_up.ida_1.node_1.conv.weight -> (128, 128, 3, 3)], [dla_up.ida_1.node_1.conv.bias -> (128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 4 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 4 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 4 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 1 [09/29/2020-17:41:39] [I] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3805: Searching for plugin: DCNv2, plugin_version: 1, plugin_namespace: [09/29/2020-17:41:39] [I] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3827: Successfully created plugin: DCNv2 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 156) [PluginV2Ext] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 549 for ONNX tensor: 549 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [DCNv2] outputs: [549 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 549 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.node_1.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.node_1.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.node_1.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.node_1.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [549 -> (1, 128, 64, 64)], [dla_up.ida_1.node_1.actf.0.weight -> (128)], [dla_up.ida_1.node_1.actf.0.bias -> (128)], [dla_up.ida_1.node_1.actf.0.running_mean -> (128)], [dla_up.ida_1.node_1.actf.0.running_var -> (128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 157) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 550 for ONNX tensor: 550 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [550 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 550 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [550 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 158) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 551 for ONNX tensor: 551 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [551 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 541 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.proj_2.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.proj_2.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [541 -> (1, 256, 32, 32)], [dla_up.ida_1.proj_2.conv.conv_offset_mask.weight -> (27, 256, 3, 3)], [dla_up.ida_1.proj_2.conv.conv_offset_mask.bias -> (27)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 256, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 159) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 27 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 27, 32, 32) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 552 for ONNX tensor: 552 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [552 -> (1, 27, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [DCNv2] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 541 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 552 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.proj_2.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.proj_2.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [DCNv2] inputs: [541 -> (1, 256, 32, 32)], [552 -> (1, 27, 32, 32)], [dla_up.ida_1.proj_2.conv.weight -> (128, 256, 3, 3)], [dla_up.ida_1.proj_2.conv.bias -> (128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 4 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 4 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 4 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 1 [09/29/2020-17:41:39] [I] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3805: Searching for plugin: DCNv2, plugin_version: 1, plugin_namespace: [09/29/2020-17:41:39] [I] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3827: Successfully created plugin: DCNv2 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 162) [PluginV2Ext] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 553 for ONNX tensor: 553 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [DCNv2] outputs: [553 -> (1, 128, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 553 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.proj_2.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.proj_2.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.proj_2.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.proj_2.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [553 -> (1, 128, 32, 32)], [dla_up.ida_1.proj_2.actf.0.weight -> (128)], [dla_up.ida_1.proj_2.actf.0.bias -> (128)], [dla_up.ida_1.proj_2.actf.0.running_mean -> (128)], [dla_up.ida_1.proj_2.actf.0.running_var -> (128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 163) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 554 for ONNX tensor: 554 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [554 -> (1, 128, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 554 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [554 -> (1, 128, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 164) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 555 for ONNX tensor: 555 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [555 -> (1, 128, 32, 32)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [ConvTranspose] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 555 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.up_2.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [ConvTranspose] inputs: [555 -> (1, 128, 32, 32)], [dla_up.ida_1.up_2.weight -> (128, 1, 4, 4)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:729: Running deconvolution with: Padding mode: NOTSET Pre-padding: (1, 1) Post-padding: (1, 1) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 165) [Deconvolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 556 for ONNX tensor: 556 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [ConvTranspose] outputs: [556 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Add] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 556 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 551 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Add] inputs: [556 -> (1, 128, 64, 64)], [551 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 166) [ElementWise] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 557 for ONNX tensor: 557 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Add] outputs: [557 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 557 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.node_2.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.node_2.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [557 -> (1, 128, 64, 64)], [dla_up.ida_1.node_2.conv.conv_offset_mask.weight -> (27, 128, 3, 3)], [dla_up.ida_1.node_2.conv.conv_offset_mask.bias -> (27)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 167) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 27 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 27, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 558 for ONNX tensor: 558 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [558 -> (1, 27, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [DCNv2] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 557 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 558 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.node_2.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.node_2.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [DCNv2] inputs: [557 -> (1, 128, 64, 64)], [558 -> (1, 27, 64, 64)], [dla_up.ida_1.node_2.conv.weight -> (128, 128, 3, 3)], [dla_up.ida_1.node_2.conv.bias -> (128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 4 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 4 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 4 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 1 [09/29/2020-17:41:39] [I] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3805: Searching for plugin: DCNv2, plugin_version: 1, plugin_namespace: [09/29/2020-17:41:39] [I] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3827: Successfully created plugin: DCNv2 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 170) [PluginV2Ext] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 559 for ONNX tensor: 559 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [DCNv2] outputs: [559 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 559 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.node_2.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.node_2.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.node_2.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_1.node_2.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [559 -> (1, 128, 64, 64)], [dla_up.ida_1.node_2.actf.0.weight -> (128)], [dla_up.ida_1.node_2.actf.0.bias -> (128)], [dla_up.ida_1.node_2.actf.0.running_mean -> (128)], [dla_up.ida_1.node_2.actf.0.running_var -> (128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 171) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 560 for ONNX tensor: 560 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [560 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 560 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [560 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 172) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 561_1 for ONNX tensor: 561 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [561 -> (1, 128, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Conv] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 561 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_2.proj_3.conv.conv_offset_mask.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_2.proj_3.conv.conv_offset_mask.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Conv] inputs: [561 -> (1, 128, 64, 64)], [dla_up.ida_2.proj_3.conv.conv_offset_mask.weight -> (27, 128, 3, 3)], [dla_up.ida_2.proj_3.conv.conv_offset_mask.bias -> (27)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:482: Convolution input dimensions: (1, 128, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 173) [Convolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:565: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 27 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:566: Convolution output dimensions: (1, 27, 64, 64) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 562 for ONNX tensor: 562 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Conv] outputs: [562 -> (1, 27, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [DCNv2] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 561 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 562 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_2.proj_3.conv.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_2.proj_3.conv.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [DCNv2] inputs: [561 -> (1, 128, 64, 64)], [562 -> (1, 27, 64, 64)], [dla_up.ida_2.proj_3.conv.weight -> (64, 128, 3, 3)], [dla_up.ida_2.proj_3.conv.bias -> (64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 4 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 4 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 4 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3780: Convolution input dimensions: 1 [09/29/2020-17:41:39] [I] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3805: Searching for plugin: DCNv2, plugin_version: 1, plugin_namespace: [09/29/2020-17:41:39] [I] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:3827: Successfully created plugin: DCNv2 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 176) [PluginV2Ext] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 563 for ONNX tensor: 563 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [DCNv2] outputs: [563 -> (1, 64, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [BatchNormalization] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 563 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_2.proj_3.actf.0.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_2.proj_3.actf.0.bias [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_2.proj_3.actf.0.running_mean [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_2.proj_3.actf.0.running_var [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [BatchNormalization] inputs: [563 -> (1, 64, 64, 64)], [dla_up.ida_2.proj_3.actf.0.weight -> (64)], [dla_up.ida_2.proj_3.actf.0.bias -> (64)], [dla_up.ida_2.proj_3.actf.0.running_mean -> (64)], [dla_up.ida_2.proj_3.actf.0.running_var -> (64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 177) [Scale] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 564 for ONNX tensor: 564 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [BatchNormalization] outputs: [564 -> (1, 64, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [Relu] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 564 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [Relu] inputs: [564 -> (1, 64, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 178) [Activation] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 565 for ONNX tensor: 565 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [Relu] outputs: [565 -> (1, 64, 64, 64)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:107: Parsing node: [ConvTranspose] [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: 565 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:123: Searching for input: dla_up.ida_2.up_3.weight [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:129: [ConvTranspose] inputs: [565 -> (1, 64, 64, 64)], [dla_up.ida_2.up_3.weight -> (64, 1, 4, 4)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/builtin_op_importers.cpp:729: Running deconvolution with: Padding mode: NOTSET Pre-padding: (1, 1) Post-padding: (1, 1) [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 179) [Deconvolution] for ONNX node: [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ImporterContext.hpp:116: Registering tensor: 566_1 for ONNX tensor: 566 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:183: [ConvTranspose] outputs: [566 -> (1, 64, 128, 128)], [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:535: Marking 566_1 as output: 566 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:554: out_put type: 0 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:535: Marking 561_1 as output: 561 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:554: out_put type: 0 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:535: Marking 541_1 as output: 541 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:554: out_put type: 0 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:535: Marking 531_1 as output: 531 [09/29/2020-17:41:39] [V] [TRT] /data/software/onnx-tensorrt-7.1/ModelImporter.cpp:554: out_put type: 0 buildEngineWithConfig. [09/29/2020-17:41:39] [V] [TRT] Applying generic optimizations to the graph for inference. [09/29/2020-17:41:39] [V] [TRT] Original: 180 layers [09/29/2020-17:41:39] [V] [TRT] After dead-layer removal: 180 layers [09/29/2020-17:41:39] [V] [TRT] After Myelin optimization: 180 layers [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 0) [Convolution] with scale (Unnamed Layer* 1) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 3) [Convolution] with scale (Unnamed Layer* 4) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 6) [Convolution] with scale (Unnamed Layer* 7) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 12) [Convolution] with scale (Unnamed Layer* 13) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 10) [Convolution] with scale (Unnamed Layer* 11) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 15) [Convolution] with scale (Unnamed Layer* 16) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 19) [Convolution] with scale (Unnamed Layer* 20) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 22) [Convolution] with scale (Unnamed Layer* 23) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 27) [Convolution] with scale (Unnamed Layer* 28) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 34) [Convolution] with scale (Unnamed Layer* 35) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 32) [Convolution] with scale (Unnamed Layer* 33) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 37) [Convolution] with scale (Unnamed Layer* 38) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 41) [Convolution] with scale (Unnamed Layer* 42) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 44) [Convolution] with scale (Unnamed Layer* 45) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 49) [Convolution] with scale (Unnamed Layer* 50) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 52) [Convolution] with scale (Unnamed Layer* 53) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 55) [Convolution] with scale (Unnamed Layer* 56) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 59) [Convolution] with scale (Unnamed Layer* 60) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 62) [Convolution] with scale (Unnamed Layer* 63) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 67) [Convolution] with scale (Unnamed Layer* 68) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 74) [Convolution] with scale (Unnamed Layer* 75) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 72) [Convolution] with scale (Unnamed Layer* 73) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 77) [Convolution] with scale (Unnamed Layer* 78) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 81) [Convolution] with scale (Unnamed Layer* 82) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 84) [Convolution] with scale (Unnamed Layer* 85) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 89) [Convolution] with scale (Unnamed Layer* 90) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 92) [Convolution] with scale (Unnamed Layer* 93) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 95) [Convolution] with scale (Unnamed Layer* 96) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 99) [Convolution] with scale (Unnamed Layer* 100) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 102) [Convolution] with scale (Unnamed Layer* 103) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 107) [Convolution] with scale (Unnamed Layer* 108) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 113) [Convolution] with scale (Unnamed Layer* 114) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 111) [Convolution] with scale (Unnamed Layer* 112) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 116) [Convolution] with scale (Unnamed Layer* 117) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 120) [Convolution] with scale (Unnamed Layer* 121) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 123) [Convolution] with scale (Unnamed Layer* 124) [Scale] [09/29/2020-17:41:39] [V] [TRT] Fusing convolution weights from (Unnamed Layer* 128) [Convolution] with scale (Unnamed Layer* 129) [Scale] [09/29/2020-17:41:39] [V] [TRT] After scale fusion: 143 layers [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 0) [Convolution] with (Unnamed Layer* 2) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 3) [Convolution] with (Unnamed Layer* 5) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 6) [Convolution] with (Unnamed Layer* 8) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 12) [Convolution] with (Unnamed Layer* 14) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 10) [Convolution] with (Unnamed Layer* 17) [ElementWise] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] with (Unnamed Layer* 18) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 19) [Convolution] with (Unnamed Layer* 21) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 22) [Convolution] with (Unnamed Layer* 24) [ElementWise] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] with (Unnamed Layer* 25) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 27) [Convolution] with (Unnamed Layer* 29) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 34) [Convolution] with (Unnamed Layer* 36) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 32) [Convolution] with (Unnamed Layer* 39) [ElementWise] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] with (Unnamed Layer* 40) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 41) [Convolution] with (Unnamed Layer* 43) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 44) [Convolution] with (Unnamed Layer* 46) [ElementWise] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] with (Unnamed Layer* 47) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 49) [Convolution] with (Unnamed Layer* 51) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 52) [Convolution] with (Unnamed Layer* 54) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 55) [Convolution] with (Unnamed Layer* 57) [ElementWise] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 55) [Convolution] + (Unnamed Layer* 57) [ElementWise] with (Unnamed Layer* 58) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 59) [Convolution] with (Unnamed Layer* 61) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 62) [Convolution] with (Unnamed Layer* 64) [ElementWise] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 62) [Convolution] + (Unnamed Layer* 64) [ElementWise] with (Unnamed Layer* 65) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 67) [Convolution] with (Unnamed Layer* 69) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 74) [Convolution] with (Unnamed Layer* 76) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 72) [Convolution] with (Unnamed Layer* 79) [ElementWise] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] with (Unnamed Layer* 80) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 81) [Convolution] with (Unnamed Layer* 83) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 84) [Convolution] with (Unnamed Layer* 86) [ElementWise] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] with (Unnamed Layer* 87) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 89) [Convolution] with (Unnamed Layer* 91) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 92) [Convolution] with (Unnamed Layer* 94) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 95) [Convolution] with (Unnamed Layer* 97) [ElementWise] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 95) [Convolution] + (Unnamed Layer* 97) [ElementWise] with (Unnamed Layer* 98) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 99) [Convolution] with (Unnamed Layer* 101) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 102) [Convolution] with (Unnamed Layer* 104) [ElementWise] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 102) [Convolution] + (Unnamed Layer* 104) [ElementWise] with (Unnamed Layer* 105) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 107) [Convolution] with (Unnamed Layer* 109) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 113) [Convolution] with (Unnamed Layer* 115) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 111) [Convolution] with (Unnamed Layer* 118) [ElementWise] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] with (Unnamed Layer* 119) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 149) [Scale] with (Unnamed Layer* 150) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 120) [Convolution] with (Unnamed Layer* 122) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 123) [Convolution] with (Unnamed Layer* 125) [ElementWise] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] with (Unnamed Layer* 126) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 128) [Convolution] with (Unnamed Layer* 130) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 135) [Scale] with (Unnamed Layer* 136) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 143) [Scale] with (Unnamed Layer* 144) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 163) [Scale] with (Unnamed Layer* 164) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 157) [Scale] with (Unnamed Layer* 158) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 171) [Scale] with (Unnamed Layer* 172) [Activation] [09/29/2020-17:41:39] [V] [TRT] Fusing (Unnamed Layer* 177) [Scale] with (Unnamed Layer* 178) [Activation] [09/29/2020-17:41:39] [V] [TRT] After vertical fusions: 91 layers [09/29/2020-17:41:39] [V] [TRT] After final dead-layer removal: 91 layers [09/29/2020-17:41:39] [V] [TRT] After tensor merging: 91 layers [09/29/2020-17:41:39] [V] [TRT] Eliminating concatenation (Unnamed Layer* 26) [Concatenation] [09/29/2020-17:41:39] [V] [TRT] Generating copy for 426 to 427 [09/29/2020-17:41:39] [V] [TRT] Generating copy for 419 to 427 [09/29/2020-17:41:39] [V] [TRT] Eliminating concatenation (Unnamed Layer* 48) [Concatenation] [09/29/2020-17:41:39] [V] [TRT] Generating copy for 448 to 449 [09/29/2020-17:41:39] [V] [TRT] Generating copy for 441 to 449 [09/29/2020-17:41:39] [V] [TRT] Eliminating concatenation (Unnamed Layer* 66) [Concatenation] [09/29/2020-17:41:39] [V] [TRT] Generating copy for 466 to 467 [09/29/2020-17:41:39] [V] [TRT] Generating copy for 459 to 467 [09/29/2020-17:41:39] [V] [TRT] Retargeting 431 to 467 [09/29/2020-17:41:39] [V] [TRT] Generating copy for 452 to 467 [09/29/2020-17:41:39] [V] [TRT] Eliminating concatenation (Unnamed Layer* 88) [Concatenation] [09/29/2020-17:41:39] [V] [TRT] Generating copy for 488 to 489 [09/29/2020-17:41:39] [V] [TRT] Generating copy for 481 to 489 [09/29/2020-17:41:39] [V] [TRT] Eliminating concatenation (Unnamed Layer* 106) [Concatenation] [09/29/2020-17:41:39] [V] [TRT] Generating copy for 506 to 507 [09/29/2020-17:41:39] [V] [TRT] Generating copy for 499 to 507 [09/29/2020-17:41:39] [V] [TRT] Retargeting 471 to 507 [09/29/2020-17:41:39] [V] [TRT] Generating copy for 492 to 507 [09/29/2020-17:41:39] [V] [TRT] Eliminating concatenation (Unnamed Layer* 127) [Concatenation] [09/29/2020-17:41:39] [V] [TRT] Generating copy for 527 to 528 [09/29/2020-17:41:39] [V] [TRT] Generating copy for 520 to 528 [09/29/2020-17:41:39] [V] [TRT] Generating copy for 511 to 528 [09/29/2020-17:41:39] [V] [TRT] After concat removal: 100 layers [09/29/2020-17:41:39] [V] [TRT] Graph construction and optimization completed in 0.0903652 seconds. [09/29/2020-17:41:39] [V] [TRT] Constructing optimization profile number 0 [1/1]. [09/29/2020-17:41:39] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:39] [V] [TRT] Tactic: 1002 time 0.020608 [09/29/2020-17:41:39] [V] [TRT] Tactic: 0 time 0.022528 [09/29/2020-17:41:39] [V] [TRT] Fastest Tactic: 1002 Time: 0.020608 [09/29/2020-17:41:39] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:39] [V] [TRT] Tactic: 1002 time 0.192512 [09/29/2020-17:41:39] [V] [TRT] Tactic: 0 time 0.02224 [09/29/2020-17:41:39] [V] [TRT] Fastest Tactic: 0 Time: 0.02224 [09/29/2020-17:41:39] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:39] [V] [TRT] Tactic: 1002 time 0.233376 [09/29/2020-17:41:39] [V] [TRT] Tactic: 0 time 0.02176 [09/29/2020-17:41:39] [V] [TRT] Fastest Tactic: 0 Time: 0.02176 [09/29/2020-17:41:39] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:39] [V] [TRT] Tactic: 1002 time 0.233472 [09/29/2020-17:41:39] [V] [TRT] Tactic: 0 time 0.02352 [09/29/2020-17:41:39] [V] [TRT] Fastest Tactic: 0 Time: 0.02352 [09/29/2020-17:41:39] [V] [TRT] *************** Autotuning format combination: Float(1,512,262144,786432) -> Float(1,512,262144,4194304) *************** [09/29/2020-17:41:39] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:39] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:39] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:39] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:39] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:40] [V] [TRT] Tactic: 196607 time 0.432832 [09/29/2020-17:41:40] [V] [TRT] Fastest Tactic: 196607 Time: 0.432832 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (CaskConvolution) [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: 1825138533642645384 time 1.19264 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: 2842488832350522458 time 0.6144 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: 6448355332020552203 time 1.39674 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: -8060443123034038864 time 0.62464 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: -4420849921117327522 time 0.370688 [09/29/2020-17:41:40] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.370688 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (CudaConvolution) [09/29/2020-17:41:40] [V] [TRT] Tactic: 0 time 0.811904 [09/29/2020-17:41:40] [V] [TRT] Tactic: 2 time 1.27251 [09/29/2020-17:41:40] [V] [TRT] Tactic: 5 time 5.37206 [09/29/2020-17:41:40] [V] [TRT] Tactic: 57 time 0.812992 [09/29/2020-17:41:40] [V] [TRT] Fastest Tactic: 0 Time: 0.811904 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4420849921117327522 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] *************** Autotuning format combination: Half(1,512,262144,786432) -> Half(1,512,262144,4194304) *************** [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (CaskConvolution) [09/29/2020-17:41:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (CudaConvolution) [09/29/2020-17:41:40] [V] [TRT] Tactic: 0 time 0.741376 [09/29/2020-17:41:40] [V] [TRT] Tactic: 1 time 0.741376 [09/29/2020-17:41:40] [V] [TRT] Tactic: 2 time 0.95584 [09/29/2020-17:41:40] [V] [TRT] Tactic: 5 time 5.30848 [09/29/2020-17:41:40] [V] [TRT] Fastest Tactic: 0 Time: 0.741376 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0 [09/29/2020-17:41:40] [V] [TRT] [09/29/2020-17:41:40] [V] [TRT] *************** Autotuning format combination: Half(1,512,262144:2,524288) -> Half(1,512,262144:2,2097152) *************** [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (CaskConvolution) [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: 1145226902788474763 time 0.436128 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: 1651411198763708804 time 0.43568 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: 2418518597804310654 time 0.438272 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: 4653005425971292725 time 0.437504 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: 4930470141256631146 time 0.251232 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: 8292881859266835088 time 0.251904 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: -7448936905981214224 time 0.253952 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: -3754890472406891741 time 0.982912 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: -3689982367035295496 time 0.958144 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: -2894005464278291378 time 0.253408 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: -1968398013367819764 time 0.96272 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: -245090590808296743 time 0.977312 [09/29/2020-17:41:40] [V] [TRT] Fastest Tactic: 4930470141256631146 Time: 0.251232 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (CudaConvolution) [09/29/2020-17:41:40] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4930470141256631146 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] *************** Autotuning format combination: Half(1,512,1:4,262144) -> Half(2,1024,1:8,524288) *************** [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (CaskConvolution) [09/29/2020-17:41:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (CudaConvolution) [09/29/2020-17:41:40] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:40] [V] [TRT] *************** Autotuning format combination: Half(1,512,1:8,262144) -> Float(1,512,262144,4194304) *************** [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (CaskConvolution) [09/29/2020-17:41:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (CudaConvolution) [09/29/2020-17:41:40] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:40] [V] [TRT] *************** Autotuning format combination: Half(1,512,1:8,262144) -> Half(2,1024,1:8,524288) *************** [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (CaskConvolution) [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:40] [V] [TRT] Tactic: 130343752241278875 time 1.77152 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: 3823144360994712832 time 1.95248 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: 5635311898703673455 time 3.24198 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: 5925270497649423688 time 3.0032 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: 6680916730816870145 time 3.27066 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: 7158029511300006471 time 1.66256 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: 8283847742354150423 time 3.45232 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: -8992262742606384444 time 0.97968 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: -8682550625095202832 time 0.980992 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:40] [V] [TRT] Tactic: -6352769237623756264 time 2.30195 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: -6273232454637933930 time 1.93741 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: -4954692664176521434 time 3.29114 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: -2586046817576862066 time 3.12131 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] Tactic: -229563042944049199 time 2.7903 [09/29/2020-17:41:40] [V] [TRT] Fastest Tactic: -8992262742606384444 Time: 0.97968 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (CudaConvolution) [09/29/2020-17:41:40] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8992262742606384444 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:40] [V] [TRT] Tactic: 1002 time 0.079872 [09/29/2020-17:41:40] [V] [TRT] Tactic: 0 time 0.071712 [09/29/2020-17:41:40] [V] [TRT] Fastest Tactic: 0 Time: 0.071712 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:40] [V] [TRT] Tactic: 1002 time 0.186368 [09/29/2020-17:41:40] [V] [TRT] Tactic: 0 time 0.069504 [09/29/2020-17:41:40] [V] [TRT] Fastest Tactic: 0 Time: 0.069504 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:40] [V] [TRT] Tactic: 1002 time 0.184576 [09/29/2020-17:41:40] [V] [TRT] Tactic: 0 time 0.065536 [09/29/2020-17:41:40] [V] [TRT] Fastest Tactic: 0 Time: 0.065536 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:40] [V] [TRT] Tactic: 1002 time 0.085024 [09/29/2020-17:41:40] [V] [TRT] Tactic: 0 time 0.069888 [09/29/2020-17:41:40] [V] [TRT] Fastest Tactic: 0 Time: 0.069888 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:40] [V] [TRT] Tactic: 1002 time 0.186624 [09/29/2020-17:41:40] [V] [TRT] Tactic: 0 time 0.06144 [09/29/2020-17:41:40] [V] [TRT] Fastest Tactic: 0 Time: 0.06144 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:40] [V] [TRT] Tactic: 1002 time 0.185216 [09/29/2020-17:41:40] [V] [TRT] Tactic: 0 time 0.048256 [09/29/2020-17:41:40] [V] [TRT] Fastest Tactic: 0 Time: 0.048256 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:40] [V] [TRT] Tactic: 1002 time 0.161408 [09/29/2020-17:41:40] [V] [TRT] Tactic: 0 time 0.067584 [09/29/2020-17:41:40] [V] [TRT] Fastest Tactic: 0 Time: 0.067584 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:40] [V] [TRT] Tactic: 1002 time 0.15904 [09/29/2020-17:41:40] [V] [TRT] Tactic: 0 time 0.053248 [09/29/2020-17:41:40] [V] [TRT] Fastest Tactic: 0 Time: 0.053248 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:40] [V] [TRT] Tactic: 1002 time 0.184576 [09/29/2020-17:41:40] [V] [TRT] Tactic: 0 time 0.044288 [09/29/2020-17:41:40] [V] [TRT] Fastest Tactic: 0 Time: 0.044288 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:40] [V] [TRT] Tactic: 1002 time 0.248096 [09/29/2020-17:41:40] [V] [TRT] Tactic: 0 time 0.07168 [09/29/2020-17:41:40] [V] [TRT] Fastest Tactic: 0 Time: 0.07168 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:40] [V] [TRT] Tactic: 1002 time 0.245888 [09/29/2020-17:41:40] [V] [TRT] Tactic: 0 time 0.045056 [09/29/2020-17:41:40] [V] [TRT] Fastest Tactic: 0 Time: 0.045056 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:40] [V] [TRT] Tactic: 1002 time 0.178432 [09/29/2020-17:41:40] [V] [TRT] Tactic: 0 time 0.043968 [09/29/2020-17:41:40] [V] [TRT] Fastest Tactic: 0 Time: 0.043968 [09/29/2020-17:41:40] [V] [TRT] *************** Autotuning format combination: Float(1,512,262144,4194304) -> Float(1,512,262144,4194304) *************** [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:40] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:40] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:41] [V] [TRT] Tactic: 524287 time 0.340256 [09/29/2020-17:41:41] [V] [TRT] Tactic: 720895 time 0.516032 [09/29/2020-17:41:41] [V] [TRT] Tactic: 983039 time 0.526336 [09/29/2020-17:41:41] [V] [TRT] Tactic: 1048575 time 0.301344 [09/29/2020-17:41:41] [V] [TRT] Tactic: 1703935 time 0.320448 [09/29/2020-17:41:41] [V] [TRT] Tactic: 1769471 time 0.862208 [09/29/2020-17:41:41] [V] [TRT] Tactic: 1966079 time 0.503968 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2031615 time 0.520736 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2228223 time 0.300448 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2424831 time 0.411648 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2621439 time 0.43344 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2752511 time 0.516096 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2818047 time 1.08774 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2883583 time 0.970752 [09/29/2020-17:41:41] [V] [TRT] Tactic: 3014655 time 0.3072 [09/29/2020-17:41:41] [V] [TRT] Tactic: 3145727 time 0.51904 [09/29/2020-17:41:41] [V] [TRT] Tactic: 3473407 time 1.01376 [09/29/2020-17:41:41] [V] [TRT] Tactic: 3604479 time 0.303264 [09/29/2020-17:41:41] [V] [TRT] Tactic: 3735551 time 0.99328 [09/29/2020-17:41:41] [V] [TRT] Tactic: 4390911 time 0.526592 [09/29/2020-17:41:41] [V] [TRT] Tactic: 5046271 time 0.300896 [09/29/2020-17:41:41] [V] [TRT] Tactic: 5963775 time 0.516096 [09/29/2020-17:41:41] [V] [TRT] Tactic: 6160383 time 0.310688 [09/29/2020-17:41:41] [V] [TRT] Tactic: 6488063 time 0.300256 [09/29/2020-17:41:41] [V] [TRT] Tactic: 6881279 time 0.526592 [09/29/2020-17:41:41] [V] [TRT] Tactic: 7274495 time 0.655264 [09/29/2020-17:41:41] [V] [TRT] Tactic: 7864319 time 0.385952 [09/29/2020-17:41:41] [V] [TRT] Tactic: 7995391 time 0.499968 [09/29/2020-17:41:41] [V] [TRT] Tactic: 8585215 time 0.318752 [09/29/2020-17:41:41] [V] [TRT] Tactic: 8847359 time 0.6208 [09/29/2020-17:41:41] [V] [TRT] Tactic: 8978431 time 0.516256 [09/29/2020-17:41:41] [V] [TRT] Tactic: 9043967 time 0.319392 [09/29/2020-17:41:41] [V] [TRT] Tactic: 9175039 time 0.303104 [09/29/2020-17:41:41] [V] [TRT] Tactic: 9502719 time 0.518112 [09/29/2020-17:41:41] [V] [TRT] Tactic: 9830399 time 0.991232 [09/29/2020-17:41:41] [V] [TRT] Tactic: 9961471 time 0.56048 [09/29/2020-17:41:41] [V] [TRT] Tactic: 10027007 time 0.290816 [09/29/2020-17:41:41] [V] [TRT] Tactic: 10092543 time 0.530016 [09/29/2020-17:41:41] [V] [TRT] Tactic: 10289151 time 0.506144 [09/29/2020-17:41:41] [V] [TRT] Tactic: 10485759 time 0.306944 [09/29/2020-17:41:41] [V] [TRT] Tactic: 10682367 time 0.374784 [09/29/2020-17:41:41] [V] [TRT] Tactic: 10813439 time 0.507904 [09/29/2020-17:41:41] [V] [TRT] Fastest Tactic: 10027007 Time: 0.290816 [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (CaskConvolution) [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 1825138533642645384 time 0.962848 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2775507031594384867 time 0.31424 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2842488832350522458 time 0.495872 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 3915320020053085238 time 0.962272 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 6448355332020552203 time 1.1369 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 6808617066150061604 time 0.499456 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -8060443123034038864 time 0.504064 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -4420849921117327522 time 0.319744 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -3946921629105938337 time 0.28416 [09/29/2020-17:41:41] [V] [TRT] Fastest Tactic: -3946921629105938337 Time: 0.28416 [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (CudaConvolution) [09/29/2020-17:41:41] [V] [TRT] Tactic: 0 time 0.684032 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2 time 1.21958 [09/29/2020-17:41:41] [V] [TRT] Tactic: 5 time 6.0319 [09/29/2020-17:41:41] [V] [TRT] Tactic: 6 time 0.4928 [09/29/2020-17:41:41] [V] [TRT] Tactic: 57 time 0.68608 [09/29/2020-17:41:41] [V] [TRT] Fastest Tactic: 6 Time: 0.4928 [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3946921629105938337 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] *************** Autotuning format combination: Half(1,512,262144,4194304) -> Half(1,512,262144,4194304) *************** [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (CaskConvolution) [09/29/2020-17:41:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (CudaConvolution) [09/29/2020-17:41:41] [V] [TRT] Tactic: 0 time 0.60176 [09/29/2020-17:41:41] [V] [TRT] Tactic: 1 time 0.405504 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2 time 0.85776 [09/29/2020-17:41:41] [V] [TRT] Tactic: 5 time 5.95661 [09/29/2020-17:41:41] [V] [TRT] Tactic: 6 time 0.56752 [09/29/2020-17:41:41] [V] [TRT] Fastest Tactic: 1 Time: 0.405504 [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [09/29/2020-17:41:41] [V] [TRT] [09/29/2020-17:41:41] [V] [TRT] *************** Autotuning format combination: Half(1,512,262144:2,2097152) -> Half(1,512,262144:2,2097152) *************** [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:41] [V] [TRT] Tactic: 524287 time 0.166144 [09/29/2020-17:41:41] [V] [TRT] Tactic: 720895 time 0.307232 [09/29/2020-17:41:41] [V] [TRT] Tactic: 983039 time 0.340192 [09/29/2020-17:41:41] [V] [TRT] Tactic: 1048575 time 0.178432 [09/29/2020-17:41:41] [V] [TRT] Tactic: 1703935 time 0.1976 [09/29/2020-17:41:41] [V] [TRT] Tactic: 1769471 time 0.588032 [09/29/2020-17:41:41] [V] [TRT] Tactic: 1966079 time 0.272672 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2031615 time 0.272384 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2228223 time 0.185696 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2621439 time 0.303104 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2752511 time 0.309504 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2818047 time 0.593376 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2883583 time 0.52224 [09/29/2020-17:41:41] [V] [TRT] Tactic: 3014655 time 0.198912 [09/29/2020-17:41:41] [V] [TRT] Tactic: 3145727 time 0.325888 [09/29/2020-17:41:41] [V] [TRT] Tactic: 3473407 time 0.546816 [09/29/2020-17:41:41] [V] [TRT] Tactic: 3604479 time 0.196608 [09/29/2020-17:41:41] [V] [TRT] Tactic: 3735551 time 0.53072 [09/29/2020-17:41:41] [V] [TRT] Tactic: 4390911 time 0.279072 [09/29/2020-17:41:41] [V] [TRT] Tactic: 5046271 time 0.202848 [09/29/2020-17:41:41] [V] [TRT] Tactic: 5963775 time 0.284352 [09/29/2020-17:41:41] [V] [TRT] Tactic: 6160383 time 0.183168 [09/29/2020-17:41:41] [V] [TRT] Tactic: 6488063 time 0.18048 [09/29/2020-17:41:41] [V] [TRT] Tactic: 6881279 time 0.276416 [09/29/2020-17:41:41] [V] [TRT] Tactic: 7274495 time 0.441632 [09/29/2020-17:41:41] [V] [TRT] Tactic: 7864319 time 0.303104 [09/29/2020-17:41:41] [V] [TRT] Tactic: 7995391 time 0.29904 [09/29/2020-17:41:41] [V] [TRT] Tactic: 8585215 time 0.164128 [09/29/2020-17:41:41] [V] [TRT] Tactic: 8847359 time 0.435936 [09/29/2020-17:41:41] [V] [TRT] Tactic: 8978431 time 0.278528 [09/29/2020-17:41:41] [V] [TRT] Tactic: 9043967 time 0.209152 [09/29/2020-17:41:41] [V] [TRT] Tactic: 9175039 time 0.19616 [09/29/2020-17:41:41] [V] [TRT] Tactic: 9502719 time 0.278368 [09/29/2020-17:41:41] [V] [TRT] Tactic: 9830399 time 0.534432 [09/29/2020-17:41:41] [V] [TRT] Tactic: 10027007 time 0.176128 [09/29/2020-17:41:41] [V] [TRT] Tactic: 10092543 time 0.278816 [09/29/2020-17:41:41] [V] [TRT] Tactic: 10289151 time 0.272384 [09/29/2020-17:41:41] [V] [TRT] Tactic: 10485759 time 0.196544 [09/29/2020-17:41:41] [V] [TRT] Tactic: 10682367 time 0.29376 [09/29/2020-17:41:41] [V] [TRT] Tactic: 10813439 time 0.311296 [09/29/2020-17:41:41] [V] [TRT] Fastest Tactic: 8585215 Time: 0.164128 [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (CaskConvolution) [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 1145226902788474763 time 0.267776 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 1651411198763708804 time 0.266496 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2418518597804310654 time 0.268256 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 4318470497547290900 time 0.265824 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 4653005425971292725 time 0.268288 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 4930470141256631146 time 0.16 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 8292881859266835088 time 0.159328 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 8401509141903434922 time 0.263456 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -8654297089785671176 time 0.615296 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -7448936905981214224 time 0.164032 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -6004726995029373073 time 0.157696 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -5719726816705110014 time 0.617056 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -3754890472406891741 time 0.630208 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -3689982367035295496 time 0.616448 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -3140347171730126532 time 0.197248 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -2894005464278291378 time 0.1632 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -2027588946874785071 time 0.157248 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -1968398013367819764 time 0.619456 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -245090590808296743 time 0.626624 [09/29/2020-17:41:41] [V] [TRT] Fastest Tactic: -2027588946874785071 Time: 0.157248 [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (CudaConvolution) [09/29/2020-17:41:41] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2027588946874785071 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] *************** Autotuning format combination: Half(2,1024,1:8,524288) -> Float(1,512,262144,4194304) *************** [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (CaskConvolution) [09/29/2020-17:41:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (CudaConvolution) [09/29/2020-17:41:41] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:41] [V] [TRT] *************** Autotuning format combination: Half(2,1024,1:8,524288) -> Half(2,1024,1:8,524288) *************** [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (CaskConvolution) [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:41] [V] [TRT] Tactic: 130343752241278875 time 0.323584 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2148106709480872763 time 0.194848 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2410442691266548717 time 0.602368 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:41] [V] [TRT] Tactic: 2921824978225832523 time 0.288768 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:41] [V] [TRT] Tactic: 3030711443478140260 time 0.379488 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 3754069740140581927 time 0.658848 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 3823144360994712832 time 0.401408 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 5635311898703673455 time 0.591104 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 5925270497649423688 time 0.5552 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 6680916730816870145 time 0.597888 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 7158029511300006471 time 0.336576 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 7859952145590271433 time 0.588032 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 8283847742354150423 time 0.661792 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -8992262742606384444 time 0.200704 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -8682550625095202832 time 0.200832 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:41] [V] [TRT] Tactic: -8379842433586149932 time 0.379168 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:41] [V] [TRT] Tactic: -6352769237623756264 time 0.410528 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -6273232454637933930 time 0.397568 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -5818527483287834165 time 0.389376 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -4954692664176521434 time 0.614464 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:41] [V] [TRT] Tactic: -4953888146171240997 time 0.288768 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -4534876761957424274 time 0.55248 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -3237051169894153788 time 0.331232 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -3136088851200285532 time 0.581184 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -2586046817576862066 time 0.61248 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -229563042944049199 time 0.589376 [09/29/2020-17:41:41] [V] [TRT] Fastest Tactic: 2148106709480872763 Time: 0.194848 [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (CudaConvolution) [09/29/2020-17:41:41] [V] [TRT] Tactic: 0 time 0.820896 [09/29/2020-17:41:41] [V] [TRT] Tactic: 1 time 0.637408 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2 time 1.00742 [09/29/2020-17:41:41] [V] [TRT] Tactic: 6 time 0.568192 [09/29/2020-17:41:41] [V] [TRT] Fastest Tactic: 6 Time: 0.568192 [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2148106709480872763 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:41] [V] [TRT] *************** Autotuning format combination: Float(1,512,262144,4194304) -> Float(1,256,65536,2097152) *************** [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:41] [V] [TRT] Tactic: 458751 time 0.17616 [09/29/2020-17:41:41] [V] [TRT] Fastest Tactic: 458751 Time: 0.17616 [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (CaskConvolution) [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 1825138533642645384 time 0.265056 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2842488832350522458 time 0.14336 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 3915320020053085238 time 0.26432 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 6448355332020552203 time 0.30736 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: 6808617066150061604 time 0.143616 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -8060443123034038864 time 0.145664 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -4420849921117327522 time 0.102688 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] Tactic: -3946921629105938337 time 0.096 [09/29/2020-17:41:41] [V] [TRT] Fastest Tactic: -3946921629105938337 Time: 0.096 [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (CudaConvolution) [09/29/2020-17:41:41] [V] [TRT] Tactic: 0 time 0.239872 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2 time 0.423648 [09/29/2020-17:41:41] [V] [TRT] Tactic: 5 time 5.47226 [09/29/2020-17:41:41] [V] [TRT] Tactic: 57 time 0.241248 [09/29/2020-17:41:41] [V] [TRT] Fastest Tactic: 0 Time: 0.239872 [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3946921629105938337 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:41] [V] [TRT] *************** Autotuning format combination: Half(1,512,262144,4194304) -> Half(1,256,65536,2097152) *************** [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (CaskConvolution) [09/29/2020-17:41:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (CudaConvolution) [09/29/2020-17:41:41] [V] [TRT] Tactic: 0 time 0.18256 [09/29/2020-17:41:41] [V] [TRT] Tactic: 1 time 0.183712 [09/29/2020-17:41:41] [V] [TRT] Tactic: 2 time 0.280832 [09/29/2020-17:41:42] [V] [TRT] Tactic: 5 time 5.02739 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.18256 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0 [09/29/2020-17:41:42] [V] [TRT] [09/29/2020-17:41:42] [V] [TRT] *************** Autotuning format combination: Half(1,512,262144:2,2097152) -> Half(1,256,65536:2,1048576) *************** [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:42] [V] [TRT] Tactic: 458751 time 0.088352 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 458751 Time: 0.088352 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (CaskConvolution) [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 1145226902788474763 time 0.079616 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 1651411198763708804 time 0.07808 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 2418518597804310654 time 0.079648 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 4318470497547290900 time 0.0792 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 4653005425971292725 time 0.079296 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 4930470141256631146 time 0.055584 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 8292881859266835088 time 0.0512 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 8401509141903434922 time 0.07776 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -8654297089785671176 time 0.168192 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -7448936905981214224 time 0.05104 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -6004726995029373073 time 0.055296 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -5719726816705110014 time 0.168864 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -3754890472406891741 time 0.172 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -3689982367035295496 time 0.168192 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -2894005464278291378 time 0.05664 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -2027588946874785071 time 0.054144 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -1968398013367819764 time 0.16928 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -245090590808296743 time 0.171488 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: -7448936905981214224 Time: 0.05104 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (CudaConvolution) [09/29/2020-17:41:42] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7448936905981214224 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] *************** Autotuning format combination: Half(2,1024,1:8,524288) -> Float(1,256,65536,2097152) *************** [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:42] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (CaskConvolution) [09/29/2020-17:41:42] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (CudaConvolution) [09/29/2020-17:41:42] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:42] [V] [TRT] *************** Autotuning format combination: Half(2,1024,1:8,524288) -> Half(4,1024,1:8,262144) *************** [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:42] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (CaskConvolution) [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:42] [V] [TRT] Tactic: 130343752241278875 time 0.094208 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 2148106709480872763 time 0.065792 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 2410442691266548717 time 0.168416 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:42] [V] [TRT] Tactic: 2921824978225832523 time 0.084224 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:42] [V] [TRT] Tactic: 3030711443478140260 time 0.108928 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 3754069740140581927 time 0.178432 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 3823144360994712832 time 0.118784 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 5635311898703673455 time 0.167648 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 5925270497649423688 time 0.151552 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 6680916730816870145 time 0.162656 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 7158029511300006471 time 0.094496 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 7859952145590271433 time 0.160864 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 8283847742354150423 time 0.178176 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -8992262742606384444 time 0.067712 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -8682550625095202832 time 0.067104 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:42] [V] [TRT] Tactic: -8379842433586149932 time 0.108544 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:42] [V] [TRT] Tactic: -6352769237623756264 time 0.116736 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -6273232454637933930 time 0.118432 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -5818527483287834165 time 0.114944 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -4954692664176521434 time 0.171616 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:42] [V] [TRT] Tactic: -4953888146171240997 time 0.084256 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -4534876761957424274 time 0.150368 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -3237051169894153788 time 0.093856 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -3136088851200285532 time 0.16384 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -2586046817576862066 time 0.169984 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -229563042944049199 time 0.167712 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 2148106709480872763 Time: 0.065792 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (CudaConvolution) [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.299008 [09/29/2020-17:41:42] [V] [TRT] Tactic: 1 time 0.299264 [09/29/2020-17:41:42] [V] [TRT] Tactic: 2 time 0.587136 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.299008 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2148106709480872763 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.041248 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.039168 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.039168 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.07168 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.037152 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.037152 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.057184 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.036608 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.036608 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.043008 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.03712 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.03712 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.071808 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.033152 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.033152 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.054688 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.026624 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.026624 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.080128 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.036416 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.036416 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.080128 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.0296 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.0296 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.053312 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.026624 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.026624 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.05536 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.03824 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.03824 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.053376 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.025888 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.025888 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.073728 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.02592 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.02592 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.041216 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.038912 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.038912 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.07152 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.036736 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.036736 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.057344 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.034816 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.034816 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.043264 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.037024 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.037024 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.07168 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.033056 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.033056 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.054624 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.02752 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.02752 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.081344 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.036512 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.036512 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.079872 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.029056 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.029056 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.053536 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.025472 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.025472 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.055584 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.038432 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.038432 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.053504 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.026304 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.026304 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:42] [V] [TRT] Tactic: 1002 time 0.073344 [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.026368 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.026368 [09/29/2020-17:41:42] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,2097152) -> Float(1,128,16384,1048576) *************** [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:42] [V] [TRT] Tactic: 458751 time 0.145408 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 458751 Time: 0.145408 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (CaskConvolution) [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 1825138533642645384 time 0.133568 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 2842488832350522458 time 0.077248 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 3915320020053085238 time 0.131936 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 6448355332020552203 time 0.1416 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 6808617066150061604 time 0.079872 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -8060443123034038864 time 0.081408 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -4420849921117327522 time 0.105344 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -3946921629105938337 time 0.10864 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 2842488832350522458 Time: 0.077248 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (CudaConvolution) [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.19072 [09/29/2020-17:41:42] [V] [TRT] Tactic: 2 time 0.268288 [09/29/2020-17:41:42] [V] [TRT] Tactic: 5 time 2.98333 [09/29/2020-17:41:42] [V] [TRT] Tactic: 57 time 0.13952 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 57 Time: 0.13952 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2842488832350522458 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,2097152) -> Half(1,128,16384,1048576) *************** [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:42] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (CaskConvolution) [09/29/2020-17:41:42] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (CudaConvolution) [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.167968 [09/29/2020-17:41:42] [V] [TRT] Tactic: 1 time 0.096032 [09/29/2020-17:41:42] [V] [TRT] Tactic: 2 time 0.218016 [09/29/2020-17:41:42] [V] [TRT] Tactic: 5 time 2.96003 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 1 Time: 0.096032 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [09/29/2020-17:41:42] [V] [TRT] [09/29/2020-17:41:42] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,1048576) -> Half(1,128,16384:2,524288) *************** [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:42] [V] [TRT] Tactic: 458751 time 0.073728 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 458751 Time: 0.073728 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (CaskConvolution) [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 1145226902788474763 time 0.043008 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 1651411198763708804 time 0.043008 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 2418518597804310654 time 0.043296 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 4318470497547290900 time 0.041856 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 4653005425971292725 time 0.043264 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 4930470141256631146 time 0.061696 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 8292881859266835088 time 0.05712 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 8401509141903434922 time 0.042656 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -8654297089785671176 time 0.076032 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -7448936905981214224 time 0.063296 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -6004726995029373073 time 0.055296 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -5719726816705110014 time 0.077056 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -3754890472406891741 time 0.07808 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -3689982367035295496 time 0.077824 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -2894005464278291378 time 0.059328 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -2027588946874785071 time 0.05968 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -1968398013367819764 time 0.077568 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -245090590808296743 time 0.078112 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 4318470497547290900 Time: 0.041856 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (CudaConvolution) [09/29/2020-17:41:42] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4318470497547290900 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:42] [V] [TRT] *************** Autotuning format combination: Half(4,1024,1:8,262144) -> Float(1,128,16384,1048576) *************** [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:42] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (CaskConvolution) [09/29/2020-17:41:42] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (CudaConvolution) [09/29/2020-17:41:42] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:42] [V] [TRT] *************** Autotuning format combination: Half(4,1024,1:8,262144) -> Half(8,1024,1:8,131072) *************** [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:42] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (CaskConvolution) [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:42] [V] [TRT] Tactic: 130343752241278875 time 0.053024 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 2148106709480872763 time 0.03056 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 2410442691266548717 time 0.067584 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:42] [V] [TRT] Tactic: 2921824978225832523 time 0.048032 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:42] [V] [TRT] Tactic: 3030711443478140260 time 0.06112 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 3754069740140581927 time 0.051072 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 3823144360994712832 time 0.04944 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 5635311898703673455 time 0.053504 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 5925270497649423688 time 0.056928 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 6680916730816870145 time 0.059808 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 7158029511300006471 time 0.04 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 7859952145590271433 time 0.059392 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: 8283847742354150423 time 0.050784 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -8992262742606384444 time 0.032768 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -8682550625095202832 time 0.033536 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:42] [V] [TRT] Tactic: -8379842433586149932 time 0.060288 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:42] [V] [TRT] Tactic: -6352769237623756264 time 0.064832 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -6273232454637933930 time 0.049024 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -5818527483287834165 time 0.05056 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -4954692664176521434 time 0.067584 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:42] [V] [TRT] Tactic: -4953888146171240997 time 0.048608 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -4534876761957424274 time 0.056832 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -3237051169894153788 time 0.0392 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -3136088851200285532 time 0.05312 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -2586046817576862066 time 0.067008 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] Tactic: -229563042944049199 time 0.053504 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 2148106709480872763 Time: 0.03056 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (CudaConvolution) [09/29/2020-17:41:42] [V] [TRT] Tactic: 0 time 0.408224 [09/29/2020-17:41:42] [V] [TRT] Tactic: 1 time 0.252128 [09/29/2020-17:41:42] [V] [TRT] Tactic: 2 time 0.374784 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: 1 Time: 0.252128 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2148106709480872763 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:42] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,2097152) -> Float(1,128,16384,524288) *************** [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 9) [Pooling] (Pooling) [09/29/2020-17:41:42] [V] [TRT] Tactic: -1 time 0.031616 [09/29/2020-17:41:42] [V] [TRT] Fastest Tactic: -1 Time: 0.031616 [09/29/2020-17:41:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 9) [Pooling] (TiledPooling) [09/29/2020-17:41:42] [V] [TRT] Tactic: 5505281 time 0.036928 [09/29/2020-17:41:42] [V] [TRT] Tactic: 5570817 time 0.031648 [09/29/2020-17:41:42] [V] [TRT] Tactic: 5636353 time 0.032032 [09/29/2020-17:41:42] [V] [TRT] Tactic: 5701889 time 0.030976 [09/29/2020-17:41:42] [V] [TRT] Tactic: 5767425 time 0.030976 [09/29/2020-17:41:42] [V] [TRT] Tactic: 5832961 time 0.028672 [09/29/2020-17:41:42] [V] [TRT] Tactic: 5898497 time 0.031968 [09/29/2020-17:41:42] [V] [TRT] Tactic: 5964033 time 0.031008 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6029569 time 0.041248 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6095105 time 0.032608 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6160641 time 0.032352 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6226177 time 0.028672 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6291713 time 0.032416 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6357249 time 0.032544 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6422785 time 0.03072 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6488321 time 0.033664 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 5832961 Time: 0.028672 [09/29/2020-17:41:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 5832961 [09/29/2020-17:41:43] [V] [TRT] [09/29/2020-17:41:43] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,2097152) -> Half(1,128,16384,524288) *************** [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 9) [Pooling] (Pooling) [09/29/2020-17:41:43] [V] [TRT] Tactic: -1 time 0.019648 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: -1 Time: 0.019648 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 9) [Pooling] (TiledPooling) [09/29/2020-17:41:43] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [09/29/2020-17:41:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -1 [09/29/2020-17:41:43] [V] [TRT] [09/29/2020-17:41:43] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,1048576) -> Half(1,128,16384:2,262144) *************** [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 9) [Pooling] (Pooling) [09/29/2020-17:41:43] [V] [TRT] Tactic: -3 time 0.01664 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: -3 Time: 0.01664 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 9) [Pooling] (TiledPooling) [09/29/2020-17:41:43] [V] [TRT] Tactic: 5505281 time 0.02048 [09/29/2020-17:41:43] [V] [TRT] Tactic: 5570817 time 0.02048 [09/29/2020-17:41:43] [V] [TRT] Tactic: 5636353 time 0.018336 [09/29/2020-17:41:43] [V] [TRT] Tactic: 5701889 time 0.0184 [09/29/2020-17:41:43] [V] [TRT] Tactic: 5767425 time 0.018624 [09/29/2020-17:41:43] [V] [TRT] Tactic: 5832961 time 0.019456 [09/29/2020-17:41:43] [V] [TRT] Tactic: 5898497 time 0.018336 [09/29/2020-17:41:43] [V] [TRT] Tactic: 5964033 time 0.019488 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6029569 time 0.020736 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6095105 time 0.020736 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6160641 time 0.018336 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6226177 time 0.017504 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6291713 time 0.018464 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6357249 time 0.014624 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6422785 time 0.018752 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6488321 time 0.020416 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 6357249 Time: 0.014624 [09/29/2020-17:41:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 6357249 [09/29/2020-17:41:43] [V] [TRT] [09/29/2020-17:41:43] [V] [TRT] *************** Autotuning format combination: Half(4,1024,1:8,262144) -> Half(4,512,1:8,65536) *************** [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 9) [Pooling] (Pooling) [09/29/2020-17:41:43] [V] [TRT] Tactic: -2 time 0.019872 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: -2 Time: 0.019872 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 9) [Pooling] (TiledPooling) [09/29/2020-17:41:43] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [09/29/2020-17:41:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -2 [09/29/2020-17:41:43] [V] [TRT] [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:43] [V] [TRT] Tactic: 1002 time 0.022816 [09/29/2020-17:41:43] [V] [TRT] Tactic: 0 time 0.023872 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 1002 Time: 0.022816 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:43] [V] [TRT] Tactic: 1002 time 0.039392 [09/29/2020-17:41:43] [V] [TRT] Tactic: 0 time 0.020032 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.020032 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:43] [V] [TRT] Tactic: 1002 time 0.03072 [09/29/2020-17:41:43] [V] [TRT] Tactic: 0 time 0.020736 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.020736 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:43] [V] [TRT] Tactic: 1002 time 0.024384 [09/29/2020-17:41:43] [V] [TRT] Tactic: 0 time 0.019264 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.019264 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:43] [V] [TRT] Tactic: 1002 time 0.037152 [09/29/2020-17:41:43] [V] [TRT] Tactic: 0 time 0.014624 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.014624 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:43] [V] [TRT] Tactic: 1002 time 0.027488 [09/29/2020-17:41:43] [V] [TRT] Tactic: 0 time 0.015712 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.015712 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:43] [V] [TRT] Tactic: 1002 time 0.043264 [09/29/2020-17:41:43] [V] [TRT] Tactic: 0 time 0.017088 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.017088 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:43] [V] [TRT] Tactic: 1002 time 0.043008 [09/29/2020-17:41:43] [V] [TRT] Tactic: 0 time 0.014368 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.014368 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:43] [V] [TRT] Tactic: 1002 time 0.027488 [09/29/2020-17:41:43] [V] [TRT] Tactic: 0 time 0.010496 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.010496 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:43] [V] [TRT] Tactic: 1002 time 0.030304 [09/29/2020-17:41:43] [V] [TRT] Tactic: 0 time 0.021344 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.021344 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:43] [V] [TRT] Tactic: 1002 time 0.027488 [09/29/2020-17:41:43] [V] [TRT] Tactic: 0 time 0.01024 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:43] [V] [TRT] Tactic: 1002 time 0.051072 [09/29/2020-17:41:43] [V] [TRT] Tactic: 0 time 0.01008 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.01008 [09/29/2020-17:41:43] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,1048576) -> Float(1,128,16384,1048576) *************** [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 15) [Convolution] (FusedConvActConvolution) [09/29/2020-17:41:43] [V] [TRT] Tactic: 524287 time 0.18592 [09/29/2020-17:41:43] [V] [TRT] Tactic: 720895 time 0.165888 [09/29/2020-17:41:43] [V] [TRT] Tactic: 983039 time 0.155648 [09/29/2020-17:41:43] [V] [TRT] Tactic: 1048575 time 0.159104 [09/29/2020-17:41:43] [V] [TRT] Tactic: 1703935 time 0.149504 [09/29/2020-17:41:43] [V] [TRT] Tactic: 1769471 time 0.186368 [09/29/2020-17:41:43] [V] [TRT] Tactic: 1966079 time 0.183168 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2031615 time 0.18864 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2228223 time 0.157696 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2424831 time 0.16384 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2621439 time 0.165984 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2752511 time 0.168192 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2818047 time 0.27824 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2883583 time 0.311264 [09/29/2020-17:41:43] [V] [TRT] Tactic: 3014655 time 0.153568 [09/29/2020-17:41:43] [V] [TRT] Tactic: 3145727 time 0.151552 [09/29/2020-17:41:43] [V] [TRT] Tactic: 3473407 time 0.275616 [09/29/2020-17:41:43] [V] [TRT] Tactic: 3604479 time 0.149792 [09/29/2020-17:41:43] [V] [TRT] Tactic: 3735551 time 0.267744 [09/29/2020-17:41:43] [V] [TRT] Tactic: 4390911 time 0.19456 [09/29/2020-17:41:43] [V] [TRT] Tactic: 5046271 time 0.155328 [09/29/2020-17:41:43] [V] [TRT] Tactic: 5963775 time 0.200704 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6160383 time 0.184256 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6488063 time 0.16 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6881279 time 0.200512 [09/29/2020-17:41:43] [V] [TRT] Tactic: 7274495 time 0.166752 [09/29/2020-17:41:43] [V] [TRT] Tactic: 7864319 time 0.165792 [09/29/2020-17:41:43] [V] [TRT] Tactic: 7995391 time 0.15792 [09/29/2020-17:41:43] [V] [TRT] Tactic: 8585215 time 0.192768 [09/29/2020-17:41:43] [V] [TRT] Tactic: 8847359 time 0.208544 [09/29/2020-17:41:43] [V] [TRT] Tactic: 8978431 time 0.2016 [09/29/2020-17:41:43] [V] [TRT] Tactic: 9043967 time 0.153536 [09/29/2020-17:41:43] [V] [TRT] Tactic: 9175039 time 0.14976 [09/29/2020-17:41:43] [V] [TRT] Tactic: 9502719 time 0.192768 [09/29/2020-17:41:43] [V] [TRT] Tactic: 9830399 time 0.271232 [09/29/2020-17:41:43] [V] [TRT] Tactic: 9961471 time 0.19072 [09/29/2020-17:41:43] [V] [TRT] Tactic: 10027007 time 0.151936 [09/29/2020-17:41:43] [V] [TRT] Tactic: 10092543 time 0.194016 [09/29/2020-17:41:43] [V] [TRT] Tactic: 10289151 time 0.183712 [09/29/2020-17:41:43] [V] [TRT] Tactic: 10485759 time 0.148192 [09/29/2020-17:41:43] [V] [TRT] Tactic: 10682367 time 0.157696 [09/29/2020-17:41:43] [V] [TRT] Tactic: 10813439 time 0.149504 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 10485759 Time: 0.148192 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 15) [Convolution] (CaskConvolution) [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 1825138533642645384 time 0.25168 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2775507031594384867 time 0.102656 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2842488832350522458 time 0.137216 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 3915320020053085238 time 0.249536 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6448355332020552203 time 0.261312 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6808617066150061604 time 0.141568 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -8060443123034038864 time 0.145408 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -4420849921117327522 time 0.17616 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -3946921629105938337 time 0.190752 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.102656 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 15) [Convolution] (CudaConvolution) [09/29/2020-17:41:43] [V] [TRT] Tactic: 0 time 0.312128 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2 time 0.46976 [09/29/2020-17:41:43] [V] [TRT] Tactic: 5 time 1.55686 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6 time 0.124992 [09/29/2020-17:41:43] [V] [TRT] Tactic: 57 time 0.15568 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 6 Time: 0.124992 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 15) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:41:43] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:43] [V] [TRT] [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:43] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,1048576) -> Half(1,128,16384,1048576) *************** [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 15) [Convolution] (FusedConvActConvolution) [09/29/2020-17:41:43] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 15) [Convolution] (CaskConvolution) [09/29/2020-17:41:43] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 15) [Convolution] (CudaConvolution) [09/29/2020-17:41:43] [V] [TRT] Tactic: 0 time 0.308224 [09/29/2020-17:41:43] [V] [TRT] Tactic: 1 time 0.153152 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2 time 0.3864 [09/29/2020-17:41:43] [V] [TRT] Tactic: 4 time 21.0631 [09/29/2020-17:41:43] [V] [TRT] Tactic: 5 time 1.52986 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6 time 0.167904 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 1 Time: 0.153152 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 15) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:41:43] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [09/29/2020-17:41:43] [V] [TRT] [09/29/2020-17:41:43] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,524288) -> Half(1,128,16384:2,524288) *************** [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 15) [Convolution] (FusedConvActConvolution) [09/29/2020-17:41:43] [V] [TRT] Tactic: 524287 time 0.095776 [09/29/2020-17:41:43] [V] [TRT] Tactic: 720895 time 0.084224 [09/29/2020-17:41:43] [V] [TRT] Tactic: 983039 time 0.079072 [09/29/2020-17:41:43] [V] [TRT] Tactic: 1048575 time 0.082048 [09/29/2020-17:41:43] [V] [TRT] Tactic: 1703935 time 0.079872 [09/29/2020-17:41:43] [V] [TRT] Tactic: 1769471 time 0.110848 [09/29/2020-17:41:43] [V] [TRT] Tactic: 1966079 time 0.093888 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2031615 time 0.095072 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2228223 time 0.079712 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2424831 time 0.090112 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2621439 time 0.0904 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2752511 time 0.086272 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2818047 time 0.142752 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2883583 time 0.155648 [09/29/2020-17:41:43] [V] [TRT] Tactic: 3014655 time 0.079872 [09/29/2020-17:41:43] [V] [TRT] Tactic: 3145727 time 0.07808 [09/29/2020-17:41:43] [V] [TRT] Tactic: 3473407 time 0.1416 [09/29/2020-17:41:43] [V] [TRT] Tactic: 3604479 time 0.078528 [09/29/2020-17:41:43] [V] [TRT] Tactic: 3735551 time 0.137184 [09/29/2020-17:41:43] [V] [TRT] Tactic: 4390911 time 0.09856 [09/29/2020-17:41:43] [V] [TRT] Tactic: 5046271 time 0.084256 [09/29/2020-17:41:43] [V] [TRT] Tactic: 5963775 time 0.105632 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6160383 time 0.094208 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6488063 time 0.082176 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6881279 time 0.100352 [09/29/2020-17:41:43] [V] [TRT] Tactic: 7274495 time 0.086272 [09/29/2020-17:41:43] [V] [TRT] Tactic: 7864319 time 0.096032 [09/29/2020-17:41:43] [V] [TRT] Tactic: 7995391 time 0.081888 [09/29/2020-17:41:43] [V] [TRT] Tactic: 8585215 time 0.099744 [09/29/2020-17:41:43] [V] [TRT] Tactic: 8847359 time 0.11872 [09/29/2020-17:41:43] [V] [TRT] Tactic: 8978431 time 0.104736 [09/29/2020-17:41:43] [V] [TRT] Tactic: 9043967 time 0.080128 [09/29/2020-17:41:43] [V] [TRT] Tactic: 9175039 time 0.07984 [09/29/2020-17:41:43] [V] [TRT] Tactic: 9502719 time 0.09856 [09/29/2020-17:41:43] [V] [TRT] Tactic: 9830399 time 0.140608 [09/29/2020-17:41:43] [V] [TRT] Tactic: 9961471 time 0.114944 [09/29/2020-17:41:43] [V] [TRT] Tactic: 10027007 time 0.084192 [09/29/2020-17:41:43] [V] [TRT] Tactic: 10092543 time 0.09856 [09/29/2020-17:41:43] [V] [TRT] Tactic: 10289151 time 0.094208 [09/29/2020-17:41:43] [V] [TRT] Tactic: 10485759 time 0.07808 [09/29/2020-17:41:43] [V] [TRT] Tactic: 10682367 time 0.090368 [09/29/2020-17:41:43] [V] [TRT] Tactic: 10813439 time 0.077728 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 10813439 Time: 0.077728 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 15) [Convolution] (CaskConvolution) [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 1145226902788474763 time 0.074048 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 1651411198763708804 time 0.073984 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2418518597804310654 time 0.074016 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 4318470497547290900 time 0.072192 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 4653005425971292725 time 0.074624 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 4930470141256631146 time 0.100608 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 8292881859266835088 time 0.100352 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 8401509141903434922 time 0.073632 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -8654297089785671176 time 0.135424 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -7448936905981214224 time 0.108832 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -6004726995029373073 time 0.077312 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -5719726816705110014 time 0.135424 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -3754890472406891741 time 0.139264 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -3689982367035295496 time 0.135424 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -3140347171730126532 time 0.057344 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -2894005464278291378 time 0.10048 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -2027588946874785071 time 0.096096 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -1968398013367819764 time 0.136576 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -245090590808296743 time 0.139264 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.057344 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 15) [Convolution] (CudaConvolution) [09/29/2020-17:41:43] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 15) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:41:43] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:43] [V] [TRT] [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:43] [V] [TRT] *************** Autotuning format combination: Half(8,1024,1:8,131072) -> Float(1,128,16384,1048576) *************** [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 15) [Convolution] (FusedConvActConvolution) [09/29/2020-17:41:43] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 15) [Convolution] (CaskConvolution) [09/29/2020-17:41:43] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 15) [Convolution] (CudaConvolution) [09/29/2020-17:41:43] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 15) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:41:43] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:43] [V] [TRT] *************** Autotuning format combination: Half(8,1024,1:8,131072) -> Half(8,1024,1:8,131072) *************** [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 15) [Convolution] (FusedConvActConvolution) [09/29/2020-17:41:43] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 15) [Convolution] (CaskConvolution) [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:43] [V] [TRT] Tactic: 130343752241278875 time 0.053248 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2148106709480872763 time 0.036928 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2410442691266548717 time 0.057408 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:43] [V] [TRT] Tactic: 2921824978225832523 time 0.050016 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:43] [V] [TRT] Tactic: 3030711443478140260 time 0.06144 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 3754069740140581927 time 0.082176 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 3823144360994712832 time 0.038912 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 5635311898703673455 time 0.047392 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 5925270497649423688 time 0.093504 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6680916730816870145 time 0.057632 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 7158029511300006471 time 0.056608 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 7859952145590271433 time 0.057632 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: 8283847742354150423 time 0.083936 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -8992262742606384444 time 0.036864 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -8682550625095202832 time 0.03712 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:43] [V] [TRT] Tactic: -8379842433586149932 time 0.06144 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:43] [V] [TRT] Tactic: -6352769237623756264 time 0.065504 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -6273232454637933930 time 0.03824 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -5818527483287834165 time 0.03888 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -4954692664176521434 time 0.0576 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:43] [V] [TRT] Tactic: -4953888146171240997 time 0.050592 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -4534876761957424274 time 0.093504 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -3237051169894153788 time 0.056512 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -3136088851200285532 time 0.046432 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -2586046817576862066 time 0.057664 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] Tactic: -229563042944049199 time 0.04704 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: -8992262742606384444 Time: 0.036864 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 15) [Convolution] (CudaConvolution) [09/29/2020-17:41:43] [V] [TRT] Tactic: 0 time 0.755712 [09/29/2020-17:41:43] [V] [TRT] Tactic: 1 time 0.176128 [09/29/2020-17:41:43] [V] [TRT] Tactic: 2 time 0.579584 [09/29/2020-17:41:43] [V] [TRT] Tactic: 6 time 0.163872 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 6 Time: 0.163872 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 15) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:41:43] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8992262742606384444 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:43] [V] [TRT] Tactic: 1002 time 0.009056 [09/29/2020-17:41:43] [V] [TRT] Tactic: 0 time 0.012544 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 1002 Time: 0.009056 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:43] [V] [TRT] Tactic: 1002 time 0.021376 [09/29/2020-17:41:43] [V] [TRT] Tactic: 0 time 0.009632 [09/29/2020-17:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.009632 [09/29/2020-17:41:43] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.016128 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.008448 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.012288 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.008448 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.021216 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.016384 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.022528 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.010656 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 0 Time: 0.010656 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.0232 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.00848 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 0 Time: 0.00848 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.016224 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.015232 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.01632 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.022688 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:41:44] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,524288), Float(1,128,16384,1048576) -> Float(1,128,16384,1048576) *************** [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (CaskConvolution) [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 1754569683116234317 time 0.03792 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 1825138533642645384 time 0.035488 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 2733356012094739613 time 0.034816 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 3915320020053085238 time 0.037152 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 6808617066150061604 time 0.033632 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 9091006216302412844 time 0.034304 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -8060443123034038864 time 0.034432 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -4420849921117327522 time 0.03872 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -3946921629105938337 time 0.035008 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.033632 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (CudaConvolution) [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.102624 [09/29/2020-17:41:44] [V] [TRT] Tactic: 2 time 0.12112 [09/29/2020-17:41:44] [V] [TRT] Tactic: 5 time 0.160256 [09/29/2020-17:41:44] [V] [TRT] Tactic: 57 time 0.094208 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 57 Time: 0.094208 [09/29/2020-17:41:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6808617066150061604 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,524288), Half(1,128,16384,1048576) -> Half(1,128,16384,1048576) *************** [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (CaskConvolution) [09/29/2020-17:41:44] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (CudaConvolution) [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.065536 [09/29/2020-17:41:44] [V] [TRT] Tactic: 1 time 0.051936 [09/29/2020-17:41:44] [V] [TRT] Tactic: 2 time 0.07376 [09/29/2020-17:41:44] [V] [TRT] Tactic: 4 time 2.48397 [09/29/2020-17:41:44] [V] [TRT] Tactic: 5 time 0.121376 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 1 Time: 0.051936 [09/29/2020-17:41:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [09/29/2020-17:41:44] [V] [TRT] [09/29/2020-17:41:44] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,262144), Half(1,128,16384:2,524288) -> Half(1,128,16384:2,524288) *************** [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (CaskConvolution) [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 1651411198763708804 time 0.018432 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 2418518597804310654 time 0.01824 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 4318470497547290900 time 0.0168 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 4930470141256631146 time 0.022528 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 8292881859266835088 time 0.022528 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 8401509141903434922 time 0.01728 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -8654297089785671176 time 0.024608 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -7516584506774355935 time 0.017248 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -7140760933967189247 time 0.017248 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -6004726995029373073 time 0.022784 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -5719726816705110014 time 0.024864 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -4097850214384059472 time 0.018336 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -3717489476759089008 time 0.01664 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -3689982367035295496 time 0.02448 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -2640575123064142123 time 0.02256 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -2534402059426524406 time 0.022528 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -2027588946874785071 time 0.022528 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -1968398013367819764 time 0.024576 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: -3717489476759089008 Time: 0.01664 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (CudaConvolution) [09/29/2020-17:41:44] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3717489476759089008 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:44] [V] [TRT] *************** Autotuning format combination: Half(4,512,1:8,65536), Float(1,128,16384,1048576) -> Float(1,128,16384,1048576) *************** [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (CaskConvolution) [09/29/2020-17:41:44] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (CudaConvolution) [09/29/2020-17:41:44] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:44] [V] [TRT] *************** Autotuning format combination: Half(4,512,1:8,65536), Half(8,1024,1:8,131072) -> Half(8,1024,1:8,131072) *************** [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (CaskConvolution) [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:44] [V] [TRT] Tactic: 9576651994278528 time 0.02048 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 1179757074518529353 time 0.02048 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 2105695814191699972 time 0.022464 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 2148106709480872763 time 0.018432 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 2410442691266548717 time 0.024736 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 3041642431972138763 time 0.020736 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 3754069740140581927 time 0.024576 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 4555462412611657028 time 0.014624 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 5666160310350604399 time 0.022528 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:44] [V] [TRT] Tactic: 5876997871499382316 time 0.022816 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 5925270497649423688 time 0.022336 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 6680916730816870145 time 0.025856 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 7158029511300006471 time 0.02048 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 7859952145590271433 time 0.024544 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 8283847742354150423 time 0.024576 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -8992262742606384444 time 0.015776 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -8391760416076885205 time 0.022816 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -6273232454637933930 time 0.022784 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:44] [V] [TRT] Tactic: -5925110308892264213 time 0.021952 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -5818527483287834165 time 0.020736 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:44] [V] [TRT] Tactic: -4908848143422991657 time 0.020928 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -4534876761957424274 time 0.021408 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -3237051169894153788 time 0.02224 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -3136088851200285532 time 0.022528 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -2586046817576862066 time 0.025952 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -2422160065350346448 time 0.024576 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -1216445540764179377 time 0.024736 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -229563042944049199 time 0.02224 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 4555462412611657028 Time: 0.014624 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (CudaConvolution) [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.071968 [09/29/2020-17:41:44] [V] [TRT] Tactic: 1 time 0.069184 [09/29/2020-17:41:44] [V] [TRT] Tactic: 2 time 0.07808 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 1 Time: 0.069184 [09/29/2020-17:41:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4555462412611657028 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.022784 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.022592 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 0 Time: 0.022592 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.038912 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.02048 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 0 Time: 0.02048 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.030688 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.02048 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 0 Time: 0.02048 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.023296 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.01984 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 0 Time: 0.01984 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.03712 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.014432 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 0 Time: 0.014432 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.02832 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.013952 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 0 Time: 0.013952 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.044704 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.019296 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 0 Time: 0.019296 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.043008 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.013856 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 0 Time: 0.013856 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.02752 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.010496 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 0 Time: 0.010496 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.03072 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.020768 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 0 Time: 0.020768 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.02688 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.010496 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 0 Time: 0.010496 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:44] [V] [TRT] Tactic: 1002 time 0.0512 [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.01008 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 0 Time: 0.01008 [09/29/2020-17:41:44] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,1048576) -> Float(1,128,16384,1048576) *************** [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:44] [V] [TRT] Tactic: 524287 time 0.184576 [09/29/2020-17:41:44] [V] [TRT] Tactic: 720895 time 0.165888 [09/29/2020-17:41:44] [V] [TRT] Tactic: 983039 time 0.155648 [09/29/2020-17:41:44] [V] [TRT] Tactic: 1048575 time 0.159616 [09/29/2020-17:41:44] [V] [TRT] Tactic: 1703935 time 0.148352 [09/29/2020-17:41:44] [V] [TRT] Tactic: 1769471 time 0.186624 [09/29/2020-17:41:44] [V] [TRT] Tactic: 1966079 time 0.1824 [09/29/2020-17:41:44] [V] [TRT] Tactic: 2031615 time 0.188416 [09/29/2020-17:41:44] [V] [TRT] Tactic: 2228223 time 0.157664 [09/29/2020-17:41:44] [V] [TRT] Tactic: 2424831 time 0.16384 [09/29/2020-17:41:44] [V] [TRT] Tactic: 2621439 time 0.166752 [09/29/2020-17:41:44] [V] [TRT] Tactic: 2752511 time 0.17088 [09/29/2020-17:41:44] [V] [TRT] Tactic: 2818047 time 0.27776 [09/29/2020-17:41:44] [V] [TRT] Tactic: 2883583 time 0.309536 [09/29/2020-17:41:44] [V] [TRT] Tactic: 3014655 time 0.152416 [09/29/2020-17:41:44] [V] [TRT] Tactic: 3145727 time 0.151232 [09/29/2020-17:41:44] [V] [TRT] Tactic: 3473407 time 0.274432 [09/29/2020-17:41:44] [V] [TRT] Tactic: 3604479 time 0.14976 [09/29/2020-17:41:44] [V] [TRT] Tactic: 3735551 time 0.266496 [09/29/2020-17:41:44] [V] [TRT] Tactic: 4390911 time 0.192512 [09/29/2020-17:41:44] [V] [TRT] Tactic: 5046271 time 0.155648 [09/29/2020-17:41:44] [V] [TRT] Tactic: 5963775 time 0.20096 [09/29/2020-17:41:44] [V] [TRT] Tactic: 6160383 time 0.182528 [09/29/2020-17:41:44] [V] [TRT] Tactic: 6488063 time 0.160032 [09/29/2020-17:41:44] [V] [TRT] Tactic: 6881279 time 0.198656 [09/29/2020-17:41:44] [V] [TRT] Tactic: 7274495 time 0.167744 [09/29/2020-17:41:44] [V] [TRT] Tactic: 7864319 time 0.165888 [09/29/2020-17:41:44] [V] [TRT] Tactic: 7995391 time 0.157696 [09/29/2020-17:41:44] [V] [TRT] Tactic: 8585215 time 0.192768 [09/29/2020-17:41:44] [V] [TRT] Tactic: 8847359 time 0.206848 [09/29/2020-17:41:44] [V] [TRT] Tactic: 8978431 time 0.20096 [09/29/2020-17:41:44] [V] [TRT] Tactic: 9043967 time 0.153056 [09/29/2020-17:41:44] [V] [TRT] Tactic: 9175039 time 0.14976 [09/29/2020-17:41:44] [V] [TRT] Tactic: 9502719 time 0.1928 [09/29/2020-17:41:44] [V] [TRT] Tactic: 9830399 time 0.272032 [09/29/2020-17:41:44] [V] [TRT] Tactic: 9961471 time 0.19072 [09/29/2020-17:41:44] [V] [TRT] Tactic: 10027007 time 0.15184 [09/29/2020-17:41:44] [V] [TRT] Tactic: 10092543 time 0.194624 [09/29/2020-17:41:44] [V] [TRT] Tactic: 10289151 time 0.182336 [09/29/2020-17:41:44] [V] [TRT] Tactic: 10485759 time 0.1488 [09/29/2020-17:41:44] [V] [TRT] Tactic: 10682367 time 0.157696 [09/29/2020-17:41:44] [V] [TRT] Tactic: 10813439 time 0.149504 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 1703935 Time: 0.148352 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (CaskConvolution) [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 1825138533642645384 time 0.250144 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 2775507031594384867 time 0.103808 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 2842488832350522458 time 0.137216 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 3915320020053085238 time 0.249728 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 6448355332020552203 time 0.262144 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: 6808617066150061604 time 0.141568 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -8060443123034038864 time 0.145408 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -4420849921117327522 time 0.176384 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] Tactic: -3946921629105938337 time 0.192096 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.103808 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (CudaConvolution) [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.325632 [09/29/2020-17:41:44] [V] [TRT] Tactic: 2 time 0.47872 [09/29/2020-17:41:44] [V] [TRT] Tactic: 5 time 1.57491 [09/29/2020-17:41:44] [V] [TRT] Tactic: 6 time 0.137504 [09/29/2020-17:41:44] [V] [TRT] Tactic: 57 time 0.17024 [09/29/2020-17:41:44] [V] [TRT] Fastest Tactic: 6 Time: 0.137504 [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:44] [V] [TRT] [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:44] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:44] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,1048576) -> Half(1,128,16384,1048576) *************** [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:44] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (CaskConvolution) [09/29/2020-17:41:44] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:44] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (CudaConvolution) [09/29/2020-17:41:44] [V] [TRT] Tactic: 0 time 0.315392 [09/29/2020-17:41:44] [V] [TRT] Tactic: 1 time 0.447872 [09/29/2020-17:41:44] [V] [TRT] Tactic: 2 time 0.393216 [09/29/2020-17:41:45] [V] [TRT] Tactic: 4 time 19.7113 [09/29/2020-17:41:45] [V] [TRT] Tactic: 5 time 1.54954 [09/29/2020-17:41:45] [V] [TRT] Tactic: 6 time 0.17568 [09/29/2020-17:41:45] [V] [TRT] Fastest Tactic: 6 Time: 0.17568 [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [09/29/2020-17:41:45] [V] [TRT] [09/29/2020-17:41:45] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,524288) -> Half(1,128,16384:2,524288) *************** [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:45] [V] [TRT] Tactic: 524287 time 0.09616 [09/29/2020-17:41:45] [V] [TRT] Tactic: 720895 time 0.084224 [09/29/2020-17:41:45] [V] [TRT] Tactic: 983039 time 0.07968 [09/29/2020-17:41:45] [V] [TRT] Tactic: 1048575 time 0.08192 [09/29/2020-17:41:45] [V] [TRT] Tactic: 1703935 time 0.07808 [09/29/2020-17:41:45] [V] [TRT] Tactic: 1769471 time 0.110848 [09/29/2020-17:41:45] [V] [TRT] Tactic: 1966079 time 0.093856 [09/29/2020-17:41:45] [V] [TRT] Tactic: 2031615 time 0.095104 [09/29/2020-17:41:45] [V] [TRT] Tactic: 2228223 time 0.080128 [09/29/2020-17:41:45] [V] [TRT] Tactic: 2424831 time 0.088928 [09/29/2020-17:41:45] [V] [TRT] Tactic: 2621439 time 0.090976 [09/29/2020-17:41:45] [V] [TRT] Tactic: 2752511 time 0.086016 [09/29/2020-17:41:45] [V] [TRT] Tactic: 2818047 time 0.142176 [09/29/2020-17:41:45] [V] [TRT] Tactic: 2883583 time 0.153856 [09/29/2020-17:41:45] [V] [TRT] Tactic: 3014655 time 0.079872 [09/29/2020-17:41:45] [V] [TRT] Tactic: 3145727 time 0.078848 [09/29/2020-17:41:45] [V] [TRT] Tactic: 3473407 time 0.142816 [09/29/2020-17:41:45] [V] [TRT] Tactic: 3604479 time 0.079328 [09/29/2020-17:41:45] [V] [TRT] Tactic: 3735551 time 0.13712 [09/29/2020-17:41:45] [V] [TRT] Tactic: 4390911 time 0.09856 [09/29/2020-17:41:45] [V] [TRT] Tactic: 5046271 time 0.084864 [09/29/2020-17:41:45] [V] [TRT] Tactic: 5963775 time 0.105312 [09/29/2020-17:41:45] [V] [TRT] Tactic: 6160383 time 0.09392 [09/29/2020-17:41:45] [V] [TRT] Tactic: 6488063 time 0.08192 [09/29/2020-17:41:45] [V] [TRT] Tactic: 6881279 time 0.101664 [09/29/2020-17:41:45] [V] [TRT] Tactic: 7274495 time 0.087168 [09/29/2020-17:41:45] [V] [TRT] Tactic: 7864319 time 0.096128 [09/29/2020-17:41:45] [V] [TRT] Tactic: 7995391 time 0.08192 [09/29/2020-17:41:45] [V] [TRT] Tactic: 8585215 time 0.0992 [09/29/2020-17:41:45] [V] [TRT] Tactic: 8847359 time 0.118784 [09/29/2020-17:41:45] [V] [TRT] Tactic: 8978431 time 0.104704 [09/29/2020-17:41:45] [V] [TRT] Tactic: 9043967 time 0.080128 [09/29/2020-17:41:45] [V] [TRT] Tactic: 9175039 time 0.07872 [09/29/2020-17:41:45] [V] [TRT] Tactic: 9502719 time 0.09856 [09/29/2020-17:41:45] [V] [TRT] Tactic: 9830399 time 0.140128 [09/29/2020-17:41:45] [V] [TRT] Tactic: 9961471 time 0.114976 [09/29/2020-17:41:45] [V] [TRT] Tactic: 10027007 time 0.079456 [09/29/2020-17:41:45] [V] [TRT] Tactic: 10092543 time 0.098304 [09/29/2020-17:41:45] [V] [TRT] Tactic: 10289151 time 0.094016 [09/29/2020-17:41:45] [V] [TRT] Tactic: 10485759 time 0.07888 [09/29/2020-17:41:45] [V] [TRT] Tactic: 10682367 time 0.090368 [09/29/2020-17:41:45] [V] [TRT] Tactic: 10813439 time 0.077632 [09/29/2020-17:41:45] [V] [TRT] Fastest Tactic: 10813439 Time: 0.077632 [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (CaskConvolution) [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 1145226902788474763 time 0.073856 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 1651411198763708804 time 0.073984 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 2418518597804310654 time 0.074016 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 4318470497547290900 time 0.073728 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 4653005425971292725 time 0.075712 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 4930470141256631146 time 0.098464 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 8292881859266835088 time 0.100352 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 8401509141903434922 time 0.072416 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -8654297089785671176 time 0.135456 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -7448936905981214224 time 0.108384 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -6004726995029373073 time 0.09824 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -5719726816705110014 time 0.135456 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -3754890472406891741 time 0.139552 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -3689982367035295496 time 0.1368 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -3140347171730126532 time 0.05712 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -2894005464278291378 time 0.080736 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -2027588946874785071 time 0.100864 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -1968398013367819764 time 0.136288 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -245090590808296743 time 0.139264 [09/29/2020-17:41:45] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.05712 [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (CudaConvolution) [09/29/2020-17:41:45] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:45] [V] [TRT] [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:45] [V] [TRT] *************** Autotuning format combination: Half(8,1024,1:8,131072) -> Float(1,128,16384,1048576) *************** [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:45] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (CaskConvolution) [09/29/2020-17:41:45] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (CudaConvolution) [09/29/2020-17:41:45] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:45] [V] [TRT] *************** Autotuning format combination: Half(8,1024,1:8,131072) -> Half(8,1024,1:8,131072) *************** [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:45] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (CaskConvolution) [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:45] [V] [TRT] Tactic: 130343752241278875 time 0.053504 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 2148106709480872763 time 0.036768 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 2410442691266548717 time 0.057088 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:45] [V] [TRT] Tactic: 2921824978225832523 time 0.051168 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:45] [V] [TRT] Tactic: 3030711443478140260 time 0.061632 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 3754069740140581927 time 0.082208 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 3823144360994712832 time 0.039808 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 5635311898703673455 time 0.047392 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 5925270497649423688 time 0.094112 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 6680916730816870145 time 0.057984 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 7158029511300006471 time 0.056704 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 7859952145590271433 time 0.057824 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 8283847742354150423 time 0.083904 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -8992262742606384444 time 0.037632 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -8682550625095202832 time 0.037152 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:45] [V] [TRT] Tactic: -8379842433586149932 time 0.061536 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:45] [V] [TRT] Tactic: -6352769237623756264 time 0.06544 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -6273232454637933930 time 0.038912 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -5818527483287834165 time 0.038912 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -4954692664176521434 time 0.057344 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:45] [V] [TRT] Tactic: -4953888146171240997 time 0.05024 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -4534876761957424274 time 0.092416 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -3237051169894153788 time 0.05552 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -3136088851200285532 time 0.04608 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -2586046817576862066 time 0.057632 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -229563042944049199 time 0.047104 [09/29/2020-17:41:45] [V] [TRT] Fastest Tactic: 2148106709480872763 Time: 0.036768 [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (CudaConvolution) [09/29/2020-17:41:45] [V] [TRT] Tactic: 0 time 0.763712 [09/29/2020-17:41:45] [V] [TRT] Tactic: 1 time 0.182816 [09/29/2020-17:41:45] [V] [TRT] Tactic: 2 time 0.587776 [09/29/2020-17:41:45] [V] [TRT] Tactic: 6 time 0.170272 [09/29/2020-17:41:45] [V] [TRT] Fastest Tactic: 6 Time: 0.170272 [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2148106709480872763 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,1048576), Float(1,128,16384,1048576) -> Float(1,128,16384,1048576) *************** [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (CaskConvolution) [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 1825138533642645384 time 0.253856 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 2775507031594384867 time 0.108544 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 2842488832350522458 time 0.140128 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 3915320020053085238 time 0.251072 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 6448355332020552203 time 0.266528 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 6808617066150061604 time 0.145408 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -8060443123034038864 time 0.147712 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -4420849921117327522 time 0.180224 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -3946921629105938337 time 0.19456 [09/29/2020-17:41:45] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.108544 [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (CudaConvolution) [09/29/2020-17:41:45] [V] [TRT] Tactic: 0 time 0.368896 [09/29/2020-17:41:45] [V] [TRT] Tactic: 2 time 0.520448 [09/29/2020-17:41:45] [V] [TRT] Tactic: 5 time 1.63322 [09/29/2020-17:41:45] [V] [TRT] Tactic: 6 time 0.18112 [09/29/2020-17:41:45] [V] [TRT] Tactic: 57 time 0.212544 [09/29/2020-17:41:45] [V] [TRT] Fastest Tactic: 6 Time: 0.18112 [09/29/2020-17:41:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:45] [V] [TRT] [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:45] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,1048576), Half(1,128,16384,1048576) -> Half(1,128,16384,1048576) *************** [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (CaskConvolution) [09/29/2020-17:41:45] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (CudaConvolution) [09/29/2020-17:41:45] [V] [TRT] Tactic: 0 time 0.330944 [09/29/2020-17:41:45] [V] [TRT] Tactic: 1 time 0.174368 [09/29/2020-17:41:45] [V] [TRT] Tactic: 2 time 0.409472 [09/29/2020-17:41:45] [V] [TRT] Tactic: 4 time 21.1743 [09/29/2020-17:41:45] [V] [TRT] Tactic: 5 time 1.56301 [09/29/2020-17:41:45] [V] [TRT] Tactic: 6 time 0.188672 [09/29/2020-17:41:45] [V] [TRT] Fastest Tactic: 1 Time: 0.174368 [09/29/2020-17:41:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [09/29/2020-17:41:45] [V] [TRT] [09/29/2020-17:41:45] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,524288), Half(1,128,16384:2,524288) -> Half(1,128,16384:2,524288) *************** [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (CaskConvolution) [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 1145226902788474763 time 0.076064 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 1651411198763708804 time 0.076032 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 2418518597804310654 time 0.07696 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 4318470497547290900 time 0.07568 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 4653005425971292725 time 0.077568 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 4930470141256631146 time 0.099808 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 8292881859266835088 time 0.110784 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 8401509141903434922 time 0.074688 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -8654297089785671176 time 0.137472 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -7448936905981214224 time 0.106208 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -6004726995029373073 time 0.09856 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -5719726816705110014 time 0.137472 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -3754890472406891741 time 0.141568 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -3689982367035295496 time 0.139168 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -3140347171730126532 time 0.059648 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -2894005464278291378 time 0.103904 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -2027588946874785071 time 0.104448 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -1968398013367819764 time 0.138784 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -245090590808296743 time 0.141312 [09/29/2020-17:41:45] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.059648 [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (CudaConvolution) [09/29/2020-17:41:45] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:45] [V] [TRT] [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:45] [V] [TRT] *************** Autotuning format combination: Half(8,1024,1:8,131072), Float(1,128,16384,1048576) -> Float(1,128,16384,1048576) *************** [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (CaskConvolution) [09/29/2020-17:41:45] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (CudaConvolution) [09/29/2020-17:41:45] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:45] [V] [TRT] *************** Autotuning format combination: Half(8,1024,1:8,131072), Half(8,1024,1:8,131072) -> Half(8,1024,1:8,131072) *************** [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (CaskConvolution) [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:45] [V] [TRT] Tactic: 130343752241278875 time 0.0576 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 2148106709480872763 time 0.042272 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 2410442691266548717 time 0.065792 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:45] [V] [TRT] Tactic: 2921824978225832523 time 0.053248 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:45] [V] [TRT] Tactic: 3030711443478140260 time 0.063744 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 3754069740140581927 time 0.088352 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 3823144360994712832 time 0.046304 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 5635311898703673455 time 0.051456 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 5925270497649423688 time 0.10064 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 6680916730816870145 time 0.067584 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 7158029511300006471 time 0.06416 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 7859952145590271433 time 0.067584 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: 8283847742354150423 time 0.089536 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -8992262742606384444 time 0.043008 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -8682550625095202832 time 0.043264 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:45] [V] [TRT] Tactic: -8379842433586149932 time 0.065152 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:45] [V] [TRT] Tactic: -6352769237623756264 time 0.067872 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -6273232454637933930 time 0.04672 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -5818527483287834165 time 0.04736 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -4954692664176521434 time 0.06736 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:45] [V] [TRT] Tactic: -4953888146171240997 time 0.052064 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -4534876761957424274 time 0.100352 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -3237051169894153788 time 0.063744 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -3136088851200285532 time 0.051392 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -2586046817576862066 time 0.06704 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] Tactic: -229563042944049199 time 0.052096 [09/29/2020-17:41:45] [V] [TRT] Fastest Tactic: 2148106709480872763 Time: 0.042272 [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (CudaConvolution) [09/29/2020-17:41:45] [V] [TRT] Tactic: 0 time 0.765824 [09/29/2020-17:41:45] [V] [TRT] Tactic: 1 time 0.196736 [09/29/2020-17:41:45] [V] [TRT] Tactic: 2 time 0.60416 [09/29/2020-17:41:45] [V] [TRT] Tactic: 6 time 0.186592 [09/29/2020-17:41:45] [V] [TRT] Fastest Tactic: 6 Time: 0.186592 [09/29/2020-17:41:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2148106709480872763 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: 426 copy (Reformat) [09/29/2020-17:41:45] [V] [TRT] Tactic: 1002 time 0.028288 [09/29/2020-17:41:45] [V] [TRT] Tactic: 0 time 0.026624 [09/29/2020-17:41:45] [V] [TRT] Fastest Tactic: 0 Time: 0.026624 [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: 426 copy (Reformat) [09/29/2020-17:41:45] [V] [TRT] Tactic: 1002 time 0.024576 [09/29/2020-17:41:45] [V] [TRT] Tactic: 0 time 0.022784 [09/29/2020-17:41:45] [V] [TRT] Fastest Tactic: 0 Time: 0.022784 [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: 426 copy (Reformat) [09/29/2020-17:41:45] [V] [TRT] Tactic: 1002 time 0.037856 [09/29/2020-17:41:45] [V] [TRT] Tactic: 0 time 0.020416 [09/29/2020-17:41:45] [V] [TRT] Fastest Tactic: 0 Time: 0.020416 [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: 426 copy (Reformat) [09/29/2020-17:41:45] [V] [TRT] Tactic: 1002 time 0.03072 [09/29/2020-17:41:45] [V] [TRT] Tactic: 0 time 0.02064 [09/29/2020-17:41:45] [V] [TRT] Fastest Tactic: 0 Time: 0.02064 [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: 426 copy (Reformat) [09/29/2020-17:41:45] [V] [TRT] Tactic: 1002 time 0.024896 [09/29/2020-17:41:45] [V] [TRT] Tactic: 0 time 0.022816 [09/29/2020-17:41:45] [V] [TRT] Fastest Tactic: 0 Time: 0.022816 [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: 426 copy (Reformat) [09/29/2020-17:41:45] [V] [TRT] Tactic: 1002 time 0.01856 [09/29/2020-17:41:45] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:41:45] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [09/29/2020-17:41:45] [V] [TRT] --------------- Timing Runner: 426 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.036608 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.014336 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 426 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.02752 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.014592 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.014592 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 426 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.043008 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.022784 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.022784 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 426 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.040736 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.01872 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.01872 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 426 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.036384 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.008096 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.008096 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 426 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.028384 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.010496 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.010496 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 426 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.029472 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.034336 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 1002 Time: 0.029472 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 426 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.02688 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.032544 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 1002 Time: 0.02688 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 426 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.0512 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.01024 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 426 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.081248 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.014336 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 419 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.028608 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.020736 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.020736 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 419 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.020544 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.022816 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 1002 Time: 0.020544 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 419 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.038464 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.019968 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.019968 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 419 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.03072 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.02048 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.02048 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 419 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.024576 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.022784 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.022784 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 419 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.018432 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.007776 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.007776 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 419 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.03712 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.014624 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.014624 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 419 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.028128 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.014336 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 419 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.04288 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.02384 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.02384 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 419 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.04096 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.019904 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.019904 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 419 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.0368 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 419 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.02752 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.011136 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.011136 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 419 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.03072 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.034304 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 1002 Time: 0.03072 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 419 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.02752 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.032768 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 1002 Time: 0.02752 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 419 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.0512 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.010176 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.010176 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: 419 copy (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.081216 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.013216 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.013216 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.042688 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.038912 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.038912 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.071648 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.036992 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.036992 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.055968 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.036864 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.036864 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.042912 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.03712 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.03712 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.071616 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.034304 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.034304 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.054592 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.028544 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.028544 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.08016 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.032704 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.032704 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.079872 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.030272 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.030272 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.053504 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.024832 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.024832 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.055424 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.04096 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.04096 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.053504 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.026272 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.026272 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:46] [V] [TRT] Tactic: 1002 time 0.092864 [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.022816 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 0 Time: 0.022816 [09/29/2020-17:41:46] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,2097152) -> Float(1,128,16384,1048576) *************** [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:46] [V] [TRT] Tactic: 589823 time 0.160032 [09/29/2020-17:41:46] [V] [TRT] Tactic: 655359 time 0.11424 [09/29/2020-17:41:46] [V] [TRT] Tactic: 786431 time 0.124928 [09/29/2020-17:41:46] [V] [TRT] Tactic: 851967 time 0.130848 [09/29/2020-17:41:46] [V] [TRT] Tactic: 1179647 time 0.09856 [09/29/2020-17:41:46] [V] [TRT] Tactic: 1310719 time 0.118784 [09/29/2020-17:41:46] [V] [TRT] Tactic: 1376255 time 0.094816 [09/29/2020-17:41:46] [V] [TRT] Tactic: 1441791 time 0.126976 [09/29/2020-17:41:46] [V] [TRT] Tactic: 1507327 time 0.116192 [09/29/2020-17:41:46] [V] [TRT] Tactic: 1638399 time 0.116736 [09/29/2020-17:41:46] [V] [TRT] Tactic: 1835007 time 0.134048 [09/29/2020-17:41:46] [V] [TRT] Tactic: 1900543 time 0.133984 [09/29/2020-17:41:46] [V] [TRT] Tactic: 2097151 time 0.124544 [09/29/2020-17:41:46] [V] [TRT] Tactic: 2162687 time 0.09856 [09/29/2020-17:41:46] [V] [TRT] Tactic: 2293759 time 0.116288 [09/29/2020-17:41:46] [V] [TRT] Tactic: 2359295 time 0.09328 [09/29/2020-17:41:46] [V] [TRT] Tactic: 2686975 time 0.117632 [09/29/2020-17:41:46] [V] [TRT] Tactic: 3080191 time 0.114432 [09/29/2020-17:41:46] [V] [TRT] Tactic: 3342335 time 0.118784 [09/29/2020-17:41:46] [V] [TRT] Tactic: 3407871 time 0.097888 [09/29/2020-17:41:46] [V] [TRT] Tactic: 3538943 time 0.092096 [09/29/2020-17:41:46] [V] [TRT] Tactic: 3670015 time 0.12288 [09/29/2020-17:41:46] [V] [TRT] Tactic: 3932159 time 0.121088 [09/29/2020-17:41:46] [V] [TRT] Tactic: 3997695 time 0.125216 [09/29/2020-17:41:46] [V] [TRT] Tactic: 4063231 time 0.127488 [09/29/2020-17:41:46] [V] [TRT] Tactic: 4194303 time 0.116032 [09/29/2020-17:41:46] [V] [TRT] Tactic: 4259839 time 0.11408 [09/29/2020-17:41:46] [V] [TRT] Tactic: 4325375 time 0.108544 [09/29/2020-17:41:46] [V] [TRT] Tactic: 4521983 time 0.124576 [09/29/2020-17:41:46] [V] [TRT] Tactic: 4587519 time 0.112544 [09/29/2020-17:41:46] [V] [TRT] Tactic: 4653055 time 0.09216 [09/29/2020-17:41:46] [V] [TRT] Tactic: 4915199 time 0.114336 [09/29/2020-17:41:46] [V] [TRT] Tactic: 4980735 time 0.10944 [09/29/2020-17:41:46] [V] [TRT] Tactic: 5177343 time 0.110592 [09/29/2020-17:41:46] [V] [TRT] Tactic: 5242879 time 0.098144 [09/29/2020-17:41:46] [V] [TRT] Tactic: 5373951 time 0.135424 [09/29/2020-17:41:46] [V] [TRT] Tactic: 5439487 time 0.2104 [09/29/2020-17:41:46] [V] [TRT] Tactic: 5570559 time 0.118944 [09/29/2020-17:41:46] [V] [TRT] Tactic: 5636095 time 0.127264 [09/29/2020-17:41:46] [V] [TRT] Tactic: 5701631 time 0.120224 [09/29/2020-17:41:46] [V] [TRT] Tactic: 5767167 time 0.505856 [09/29/2020-17:41:46] [V] [TRT] Tactic: 5832703 time 0.092544 [09/29/2020-17:41:46] [V] [TRT] Tactic: 5898239 time 0.096256 [09/29/2020-17:41:46] [V] [TRT] Tactic: 6029311 time 0.118624 [09/29/2020-17:41:46] [V] [TRT] Tactic: 6225919 time 0.096096 [09/29/2020-17:41:46] [V] [TRT] Tactic: 6291455 time 0.098592 [09/29/2020-17:41:46] [V] [TRT] Tactic: 6422527 time 0.117024 [09/29/2020-17:41:46] [V] [TRT] Tactic: 6750207 time 0.139264 [09/29/2020-17:41:46] [V] [TRT] Tactic: 6815743 time 0.131328 [09/29/2020-17:41:46] [V] [TRT] Tactic: 6946815 time 0.192512 [09/29/2020-17:41:46] [V] [TRT] Tactic: 7012351 time 0.123776 [09/29/2020-17:41:46] [V] [TRT] Tactic: 7077887 time 0.089568 [09/29/2020-17:41:46] [V] [TRT] Tactic: 7143423 time 0.196448 [09/29/2020-17:41:46] [V] [TRT] Tactic: 7208959 time 0.1024 [09/29/2020-17:41:46] [V] [TRT] Tactic: 7340031 time 0.100608 [09/29/2020-17:41:46] [V] [TRT] Tactic: 7405567 time 0.10064 [09/29/2020-17:41:46] [V] [TRT] Tactic: 7536639 time 0.153856 [09/29/2020-17:41:46] [V] [TRT] Tactic: 7602175 time 0.123168 [09/29/2020-17:41:46] [V] [TRT] Tactic: 7733247 time 0.09216 [09/29/2020-17:41:46] [V] [TRT] Tactic: 7798783 time 0.125216 [09/29/2020-17:41:46] [V] [TRT] Tactic: 8191999 time 0.151808 [09/29/2020-17:41:46] [V] [TRT] Tactic: 8257535 time 0.123136 [09/29/2020-17:41:46] [V] [TRT] Tactic: 8323071 time 0.139168 [09/29/2020-17:41:46] [V] [TRT] Tactic: 8650751 time 0.145216 [09/29/2020-17:41:46] [V] [TRT] Tactic: 8716287 time 0.131072 [09/29/2020-17:41:46] [V] [TRT] Tactic: 9109503 time 0.13248 [09/29/2020-17:41:46] [V] [TRT] Tactic: 9568255 time 0.1144 [09/29/2020-17:41:46] [V] [TRT] Tactic: 9895935 time 0.114944 [09/29/2020-17:41:46] [V] [TRT] Tactic: 10223615 time 0.117632 [09/29/2020-17:41:46] [V] [TRT] Tactic: 10354687 time 0.114432 [09/29/2020-17:41:46] [V] [TRT] Tactic: 10551295 time 0.139264 [09/29/2020-17:41:46] [V] [TRT] Tactic: 10747903 time 0.088064 [09/29/2020-17:41:46] [V] [TRT] Tactic: 10944511 time 0.110304 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 10747903 Time: 0.088064 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (CaskConvolution) [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:41:46] [V] [TRT] Tactic: 1754569683116234317 time 0.06592 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:46] [V] [TRT] Tactic: 1825138533642645384 time 0.067392 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:41:46] [V] [TRT] Tactic: 2733356012094739613 time 0.05264 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:46] [V] [TRT] Tactic: 3915320020053085238 time 0.067584 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:46] [V] [TRT] Tactic: 6808617066150061604 time 0.043008 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:46] [V] [TRT] Tactic: 9091006216302412844 time 0.041216 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:46] [V] [TRT] Tactic: -8060443123034038864 time 0.043616 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:46] [V] [TRT] Tactic: -4420849921117327522 time 0.05856 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:46] [V] [TRT] Tactic: -3946921629105938337 time 0.055296 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.041216 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (CudaConvolution) [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.13072 [09/29/2020-17:41:46] [V] [TRT] Tactic: 2 time 0.196576 [09/29/2020-17:41:46] [V] [TRT] Tactic: 5 time 0.200704 [09/29/2020-17:41:46] [V] [TRT] Tactic: 57 time 0.07168 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 57 Time: 0.07168 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:46] [V] [TRT] [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:46] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,2097152) -> Half(1,128,16384,1048576) *************** [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:46] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (CaskConvolution) [09/29/2020-17:41:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (CudaConvolution) [09/29/2020-17:41:46] [V] [TRT] Tactic: 0 time 0.09792 [09/29/2020-17:41:46] [V] [TRT] Tactic: 1 time 0.097888 [09/29/2020-17:41:46] [V] [TRT] Tactic: 2 time 0.223232 [09/29/2020-17:41:46] [V] [TRT] Tactic: 4 time 9.48806 [09/29/2020-17:41:46] [V] [TRT] Tactic: 5 time 0.182016 [09/29/2020-17:41:46] [V] [TRT] Fastest Tactic: 1 Time: 0.097888 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [09/29/2020-17:41:46] [V] [TRT] [09/29/2020-17:41:46] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,1048576) -> Half(1,128,16384,1048576) *************** [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:46] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (CaskConvolution) [09/29/2020-17:41:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (CudaConvolution) [09/29/2020-17:41:46] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:46] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,1048576) -> Half(1,128,16384:2,524288) *************** [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:46] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:46] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:46] [V] [TRT] Tactic: 589823 time 0.08096 [09/29/2020-17:41:46] [V] [TRT] Tactic: 655359 time 0.060672 [09/29/2020-17:41:46] [V] [TRT] Tactic: 786431 time 0.069888 [09/29/2020-17:41:46] [V] [TRT] Tactic: 851967 time 0.077696 [09/29/2020-17:41:46] [V] [TRT] Tactic: 1179647 time 0.057344 [09/29/2020-17:41:46] [V] [TRT] Tactic: 1310719 time 0.061536 [09/29/2020-17:41:46] [V] [TRT] Tactic: 1376255 time 0.05024 [09/29/2020-17:41:46] [V] [TRT] Tactic: 1441791 time 0.070496 [09/29/2020-17:41:46] [V] [TRT] Tactic: 1507327 time 0.063776 [09/29/2020-17:41:46] [V] [TRT] Tactic: 1638399 time 0.067872 [09/29/2020-17:41:46] [V] [TRT] Tactic: 1835007 time 0.071936 [09/29/2020-17:41:46] [V] [TRT] Tactic: 1900543 time 0.071936 [09/29/2020-17:41:46] [V] [TRT] Tactic: 2097151 time 0.077536 [09/29/2020-17:41:46] [V] [TRT] Tactic: 2162687 time 0.0512 [09/29/2020-17:41:46] [V] [TRT] Tactic: 2293759 time 0.061056 [09/29/2020-17:41:46] [V] [TRT] Tactic: 2359295 time 0.0488 [09/29/2020-17:41:46] [V] [TRT] Tactic: 2686975 time 0.061408 [09/29/2020-17:41:46] [V] [TRT] Tactic: 3080191 time 0.061728 [09/29/2020-17:41:46] [V] [TRT] Tactic: 3342335 time 0.065792 [09/29/2020-17:41:46] [V] [TRT] Tactic: 3407871 time 0.051456 [09/29/2020-17:41:46] [V] [TRT] Tactic: 3538943 time 0.049408 [09/29/2020-17:41:46] [V] [TRT] Tactic: 3670015 time 0.063776 [09/29/2020-17:41:46] [V] [TRT] Tactic: 3932159 time 0.064992 [09/29/2020-17:41:46] [V] [TRT] Tactic: 3997695 time 0.071936 [09/29/2020-17:41:46] [V] [TRT] Tactic: 4063231 time 0.075904 [09/29/2020-17:41:46] [V] [TRT] Tactic: 4194303 time 0.065504 [09/29/2020-17:41:46] [V] [TRT] Tactic: 4259839 time 0.069152 [09/29/2020-17:41:46] [V] [TRT] Tactic: 4325375 time 0.06128 [09/29/2020-17:41:46] [V] [TRT] Tactic: 4521983 time 0.063552 [09/29/2020-17:41:46] [V] [TRT] Tactic: 4587519 time 0.064928 [09/29/2020-17:41:46] [V] [TRT] Tactic: 4653055 time 0.056992 [09/29/2020-17:41:46] [V] [TRT] Tactic: 4915199 time 0.065664 [09/29/2020-17:41:46] [V] [TRT] Tactic: 4980735 time 0.060864 [09/29/2020-17:41:46] [V] [TRT] Tactic: 5177343 time 0.06368 [09/29/2020-17:41:46] [V] [TRT] Tactic: 5242879 time 0.052768 [09/29/2020-17:41:46] [V] [TRT] Tactic: 5373951 time 0.076032 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5439487 time 0.11008 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5570559 time 0.064896 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5636095 time 0.075648 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5701631 time 0.061728 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5767167 time 0.257824 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5832703 time 0.049312 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5898239 time 0.057056 [09/29/2020-17:41:47] [V] [TRT] Tactic: 6029311 time 0.059392 [09/29/2020-17:41:47] [V] [TRT] Tactic: 6225919 time 0.053088 [09/29/2020-17:41:47] [V] [TRT] Tactic: 6291455 time 0.057632 [09/29/2020-17:41:47] [V] [TRT] Tactic: 6422527 time 0.063744 [09/29/2020-17:41:47] [V] [TRT] Tactic: 6750207 time 0.075776 [09/29/2020-17:41:47] [V] [TRT] Tactic: 6815743 time 0.07104 [09/29/2020-17:41:47] [V] [TRT] Tactic: 6946815 time 0.1024 [09/29/2020-17:41:47] [V] [TRT] Tactic: 7012351 time 0.076768 [09/29/2020-17:41:47] [V] [TRT] Tactic: 7077887 time 0.048928 [09/29/2020-17:41:47] [V] [TRT] Tactic: 7143423 time 0.101344 [09/29/2020-17:41:47] [V] [TRT] Tactic: 7208959 time 0.053504 [09/29/2020-17:41:47] [V] [TRT] Tactic: 7340031 time 0.059136 [09/29/2020-17:41:47] [V] [TRT] Tactic: 7405567 time 0.058208 [09/29/2020-17:41:47] [V] [TRT] Tactic: 7536639 time 0.08144 [09/29/2020-17:41:47] [V] [TRT] Tactic: 7602175 time 0.067552 [09/29/2020-17:41:47] [V] [TRT] Tactic: 7733247 time 0.050144 [09/29/2020-17:41:47] [V] [TRT] Tactic: 7798783 time 0.06928 [09/29/2020-17:41:47] [V] [TRT] Tactic: 8191999 time 0.08192 [09/29/2020-17:41:47] [V] [TRT] Tactic: 8257535 time 0.069888 [09/29/2020-17:41:47] [V] [TRT] Tactic: 8323071 time 0.073984 [09/29/2020-17:41:47] [V] [TRT] Tactic: 8650751 time 0.07808 [09/29/2020-17:41:47] [V] [TRT] Tactic: 8716287 time 0.07168 [09/29/2020-17:41:47] [V] [TRT] Tactic: 9109503 time 0.08192 [09/29/2020-17:41:47] [V] [TRT] Tactic: 9568255 time 0.065536 [09/29/2020-17:41:47] [V] [TRT] Tactic: 9895935 time 0.065088 [09/29/2020-17:41:47] [V] [TRT] Tactic: 10223615 time 0.06144 [09/29/2020-17:41:47] [V] [TRT] Tactic: 10354687 time 0.065792 [09/29/2020-17:41:47] [V] [TRT] Tactic: 10551295 time 0.071936 [09/29/2020-17:41:47] [V] [TRT] Tactic: 10747903 time 0.047712 [09/29/2020-17:41:47] [V] [TRT] Tactic: 10944511 time 0.060288 [09/29/2020-17:41:47] [V] [TRT] Fastest Tactic: 10747903 Time: 0.047712 [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (CaskConvolution) [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 1651411198763708804 time 0.025472 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 2418518597804310654 time 0.025248 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 4318470497547290900 time 0.024576 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 4930470141256631146 time 0.036224 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 8292881859266835088 time 0.02688 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 8401509141903434922 time 0.024864 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -8654297089785671176 time 0.043264 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -7516584506774355935 time 0.029696 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -7140760933967189247 time 0.024832 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -6004726995029373073 time 0.03552 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -5719726816705110014 time 0.04368 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -4097850214384059472 time 0.02896 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -3717489476759089008 time 0.025024 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -3689982367035295496 time 0.043264 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -2640575123064142123 time 0.037632 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -2534402059426524406 time 0.037856 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -2027588946874785071 time 0.035072 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -1968398013367819764 time 0.043296 [09/29/2020-17:41:47] [V] [TRT] Fastest Tactic: 4318470497547290900 Time: 0.024576 [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (CudaConvolution) [09/29/2020-17:41:47] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:47] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4318470497547290900 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] *************** Autotuning format combination: Half(16,2048,1:8,262144) -> Float(1,128,16384,1048576) *************** [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:47] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (CaskConvolution) [09/29/2020-17:41:47] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (CudaConvolution) [09/29/2020-17:41:47] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:47] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:47] [V] [TRT] *************** Autotuning format combination: Half(16,2048,1:8,262144) -> Half(8,1024,1:8,131072) *************** [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:47] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (CaskConvolution) [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:47] [V] [TRT] Tactic: 9576651994278528 time 0.024864 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 1179757074518529353 time 0.026624 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 2105695814191699972 time 0.028672 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 2148106709480872763 time 0.023872 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 2410442691266548717 time 0.031008 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 3041642431972138763 time 0.026112 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 3754069740140581927 time 0.032512 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 4555462412611657028 time 0.024576 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5666160310350604399 time 0.031904 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:47] [V] [TRT] Tactic: 5876997871499382316 time 0.028512 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5925270497649423688 time 0.034976 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 6680916730816870145 time 0.03088 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 7158029511300006471 time 0.028608 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 7859952145590271433 time 0.030976 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 8283847742354150423 time 0.032224 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -8992262742606384444 time 0.023232 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -8391760416076885205 time 0.034528 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -6273232454637933930 time 0.028288 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:47] [V] [TRT] Tactic: -5925110308892264213 time 0.028064 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -5818527483287834165 time 0.026912 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:47] [V] [TRT] Tactic: -4908848143422991657 time 0.026624 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -4534876761957424274 time 0.033664 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -3237051169894153788 time 0.028768 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -3136088851200285532 time 0.026624 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -2586046817576862066 time 0.031168 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -2422160065350346448 time 0.030912 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -1216445540764179377 time 0.030976 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -229563042944049199 time 0.028672 [09/29/2020-17:41:47] [V] [TRT] Fastest Tactic: -8992262742606384444 Time: 0.023232 [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (CudaConvolution) [09/29/2020-17:41:47] [V] [TRT] Tactic: 0 time 0.2048 [09/29/2020-17:41:47] [V] [TRT] Tactic: 1 time 0.120288 [09/29/2020-17:41:47] [V] [TRT] Tactic: 2 time 0.25136 [09/29/2020-17:41:47] [V] [TRT] Fastest Tactic: 1 Time: 0.120288 [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:47] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8992262742606384444 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,1048576) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:47] [V] [TRT] Tactic: 458751 time 0.139296 [09/29/2020-17:41:47] [V] [TRT] Fastest Tactic: 458751 Time: 0.139296 [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (CaskConvolution) [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 1825138533642645384 time 0.091296 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 2842488832350522458 time 0.094208 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 3915320020053085238 time 0.090112 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 6448355332020552203 time 0.090112 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 6808617066150061604 time 0.097984 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -8060443123034038864 time 0.100608 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -4420849921117327522 time 0.09856 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -3946921629105938337 time 0.1104 [09/29/2020-17:41:47] [V] [TRT] Fastest Tactic: 3915320020053085238 Time: 0.090112 [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (CudaConvolution) [09/29/2020-17:41:47] [V] [TRT] Tactic: 0 time 0.170272 [09/29/2020-17:41:47] [V] [TRT] Tactic: 2 time 0.215296 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5 time 2.69523 [09/29/2020-17:41:47] [V] [TRT] Tactic: 57 time 0.10736 [09/29/2020-17:41:47] [V] [TRT] Fastest Tactic: 57 Time: 0.10736 [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:47] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3915320020053085238 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,1048576) -> Half(1,64,4096,524288) *************** [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:47] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (CaskConvolution) [09/29/2020-17:41:47] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (CudaConvolution) [09/29/2020-17:41:47] [V] [TRT] Tactic: 0 time 0.166208 [09/29/2020-17:41:47] [V] [TRT] Tactic: 1 time 0.1088 [09/29/2020-17:41:47] [V] [TRT] Tactic: 2 time 0.212992 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5 time 2.70381 [09/29/2020-17:41:47] [V] [TRT] Fastest Tactic: 1 Time: 0.1088 [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:47] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [09/29/2020-17:41:47] [V] [TRT] [09/29/2020-17:41:47] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,524288) -> Half(1,64,4096:2,262144) *************** [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:47] [V] [TRT] Tactic: 458751 time 0.07136 [09/29/2020-17:41:47] [V] [TRT] Fastest Tactic: 458751 Time: 0.07136 [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (CaskConvolution) [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 1145226902788474763 time 0.051456 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 1651411198763708804 time 0.0512 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 2418518597804310654 time 0.0512 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 4318470497547290900 time 0.050048 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 4653005425971292725 time 0.051456 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 4930470141256631146 time 0.054848 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 8292881859266835088 time 0.053536 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 8401509141903434922 time 0.049408 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -8654297089785671176 time 0.047872 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -7448936905981214224 time 0.055552 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -6004726995029373073 time 0.05296 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -5719726816705110014 time 0.048384 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -3754890472406891741 time 0.049408 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -3689982367035295496 time 0.0488 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -2894005464278291378 time 0.055296 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -2027588946874785071 time 0.053248 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -1968398013367819764 time 0.049152 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -245090590808296743 time 0.05072 [09/29/2020-17:41:47] [V] [TRT] Fastest Tactic: -8654297089785671176 Time: 0.047872 [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (CudaConvolution) [09/29/2020-17:41:47] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:47] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8654297089785671176 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:47] [V] [TRT] *************** Autotuning format combination: Half(8,1024,1:8,131072) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:47] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (CaskConvolution) [09/29/2020-17:41:47] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (CudaConvolution) [09/29/2020-17:41:47] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:47] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:47] [V] [TRT] *************** Autotuning format combination: Half(8,1024,1:8,131072) -> Half(16,1024,1:8,65536) *************** [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:47] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (CaskConvolution) [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:47] [V] [TRT] Tactic: 130343752241278875 time 0.03216 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 2148106709480872763 time 0.024224 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 2410442691266548717 time 0.028928 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:47] [V] [TRT] Tactic: 2921824978225832523 time 0.031136 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:47] [V] [TRT] Tactic: 3030711443478140260 time 0.03872 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 3754069740140581927 time 0.030976 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 3823144360994712832 time 0.022528 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5635311898703673455 time 0.020736 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5925270497649423688 time 0.048384 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 6680916730816870145 time 0.030976 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 7158029511300006471 time 0.03056 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 7859952145590271433 time 0.030816 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: 8283847742354150423 time 0.031456 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -8992262742606384444 time 0.024832 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -8682550625095202832 time 0.024832 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:47] [V] [TRT] Tactic: -8379842433586149932 time 0.038176 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:47] [V] [TRT] Tactic: -6352769237623756264 time 0.040032 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -6273232454637933930 time 0.022528 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -5818527483287834165 time 0.021344 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -4954692664176521434 time 0.030272 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:47] [V] [TRT] Tactic: -4953888146171240997 time 0.03232 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -4534876761957424274 time 0.047392 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -3237051169894153788 time 0.030368 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -3136088851200285532 time 0.020448 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -2586046817576862066 time 0.028928 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] Tactic: -229563042944049199 time 0.021344 [09/29/2020-17:41:47] [V] [TRT] Fastest Tactic: -3136088851200285532 Time: 0.020448 [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (CudaConvolution) [09/29/2020-17:41:47] [V] [TRT] Tactic: 0 time 0.392672 [09/29/2020-17:41:47] [V] [TRT] Tactic: 1 time 0.12864 [09/29/2020-17:41:47] [V] [TRT] Tactic: 2 time 0.286976 [09/29/2020-17:41:47] [V] [TRT] Fastest Tactic: 1 Time: 0.12864 [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:47] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3136088851200285532 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:47] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,1048576) -> Float(1,64,4096,262144) *************** [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 31) [Pooling] (Pooling) [09/29/2020-17:41:47] [V] [TRT] Tactic: -1 time 0.020032 [09/29/2020-17:41:47] [V] [TRT] Fastest Tactic: -1 Time: 0.020032 [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 31) [Pooling] (TiledPooling) [09/29/2020-17:41:47] [V] [TRT] Tactic: 5505281 time 0.020736 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5570817 time 0.018304 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5636353 time 0.018208 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5701889 time 0.018304 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5767425 time 0.018432 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5832961 time 0.017472 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5898497 time 0.01856 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5964033 time 0.018432 [09/29/2020-17:41:47] [V] [TRT] Tactic: 6029569 time 0.019904 [09/29/2020-17:41:47] [V] [TRT] Tactic: 6095105 time 0.01664 [09/29/2020-17:41:47] [V] [TRT] Tactic: 6160641 time 0.018048 [09/29/2020-17:41:47] [V] [TRT] Tactic: 6226177 time 0.0176 [09/29/2020-17:41:47] [V] [TRT] Tactic: 6291713 time 0.017248 [09/29/2020-17:41:47] [V] [TRT] Tactic: 6357249 time 0.017792 [09/29/2020-17:41:47] [V] [TRT] Tactic: 6422785 time 0.018112 [09/29/2020-17:41:47] [V] [TRT] Tactic: 6488321 time 0.01792 [09/29/2020-17:41:47] [V] [TRT] Fastest Tactic: 6095105 Time: 0.01664 [09/29/2020-17:41:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 6095105 [09/29/2020-17:41:47] [V] [TRT] [09/29/2020-17:41:47] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,1048576) -> Half(1,64,4096,262144) *************** [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 31) [Pooling] (Pooling) [09/29/2020-17:41:47] [V] [TRT] Tactic: -1 time 0.009792 [09/29/2020-17:41:47] [V] [TRT] Fastest Tactic: -1 Time: 0.009792 [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 31) [Pooling] (TiledPooling) [09/29/2020-17:41:47] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [09/29/2020-17:41:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -1 [09/29/2020-17:41:47] [V] [TRT] [09/29/2020-17:41:47] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,524288) -> Half(1,64,4096:2,131072) *************** [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 31) [Pooling] (Pooling) [09/29/2020-17:41:47] [V] [TRT] Tactic: -3 time 0.008032 [09/29/2020-17:41:47] [V] [TRT] Fastest Tactic: -3 Time: 0.008032 [09/29/2020-17:41:47] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 31) [Pooling] (TiledPooling) [09/29/2020-17:41:47] [V] [TRT] Tactic: 5505281 time 0.010496 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5570817 time 0.012288 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5636353 time 0.007872 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5701889 time 0.007552 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5767425 time 0.007808 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5832961 time 0.007872 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5898497 time 0.007584 [09/29/2020-17:41:47] [V] [TRT] Tactic: 5964033 time 0.007456 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6029569 time 0.010272 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6095105 time 0.008448 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6160641 time 0.007008 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6226177 time 0.0064 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6291713 time 0.00704 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6357249 time 0.00704 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6422785 time 0.0064 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6488321 time 0.006464 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 6226177 Time: 0.0064 [09/29/2020-17:41:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 6226177 [09/29/2020-17:41:48] [V] [TRT] [09/29/2020-17:41:48] [V] [TRT] *************** Autotuning format combination: Half(8,1024,1:8,131072) -> Half(8,512,1:8,32768) *************** [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 31) [Pooling] (Pooling) [09/29/2020-17:41:48] [V] [TRT] Tactic: -2 time 0.007616 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: -2 Time: 0.007616 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 31) [Pooling] (TiledPooling) [09/29/2020-17:41:48] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [09/29/2020-17:41:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -2 [09/29/2020-17:41:48] [V] [TRT] [09/29/2020-17:41:48] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,1048576) -> Float(1,64,4096,1835008) *************** [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 30) [Pooling] (Pooling) [09/29/2020-17:41:48] [V] [TRT] Tactic: -1 time 0.018432 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: -1 Time: 0.018432 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 30) [Pooling] (TiledPooling) [09/29/2020-17:41:48] [V] [TRT] Tactic: 5505281 time 0.020704 [09/29/2020-17:41:48] [V] [TRT] Tactic: 5570817 time 0.01664 [09/29/2020-17:41:48] [V] [TRT] Tactic: 5636353 time 0.018016 [09/29/2020-17:41:48] [V] [TRT] Tactic: 5701889 time 0.01904 [09/29/2020-17:41:48] [V] [TRT] Tactic: 5767425 time 0.018208 [09/29/2020-17:41:48] [V] [TRT] Tactic: 5832961 time 0.018432 [09/29/2020-17:41:48] [V] [TRT] Tactic: 5898497 time 0.017984 [09/29/2020-17:41:48] [V] [TRT] Tactic: 5964033 time 0.018432 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6029569 time 0.018688 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6095105 time 0.016384 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6160641 time 0.016672 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6226177 time 0.016672 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6291713 time 0.016672 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6357249 time 0.01808 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6422785 time 0.018432 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6488321 time 0.017856 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 6095105 Time: 0.016384 [09/29/2020-17:41:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 6095105 [09/29/2020-17:41:48] [V] [TRT] [09/29/2020-17:41:48] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,1048576) -> Half(1,64,4096,1835008) *************** [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 30) [Pooling] (Pooling) [09/29/2020-17:41:48] [V] [TRT] Tactic: -1 time 0.009696 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: -1 Time: 0.009696 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 30) [Pooling] (TiledPooling) [09/29/2020-17:41:48] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [09/29/2020-17:41:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -1 [09/29/2020-17:41:48] [V] [TRT] [09/29/2020-17:41:48] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,524288) -> Half(1,64,4096:2,917504) *************** [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 30) [Pooling] (Pooling) [09/29/2020-17:41:48] [V] [TRT] Tactic: -3 time 0.008096 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: -3 Time: 0.008096 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 30) [Pooling] (TiledPooling) [09/29/2020-17:41:48] [V] [TRT] Tactic: 5505281 time 0.010528 [09/29/2020-17:41:48] [V] [TRT] Tactic: 5570817 time 0.008448 [09/29/2020-17:41:48] [V] [TRT] Tactic: 5636353 time 0.008192 [09/29/2020-17:41:48] [V] [TRT] Tactic: 5701889 time 0.007616 [09/29/2020-17:41:48] [V] [TRT] Tactic: 5767425 time 0.007072 [09/29/2020-17:41:48] [V] [TRT] Tactic: 5832961 time 0.00704 [09/29/2020-17:41:48] [V] [TRT] Tactic: 5898497 time 0.007616 [09/29/2020-17:41:48] [V] [TRT] Tactic: 5964033 time 0.007552 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6029569 time 0.010528 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6095105 time 0.00848 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6160641 time 0.007648 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6226177 time 0.007584 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6291713 time 0.007648 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6357249 time 0.0064 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6422785 time 0.006432 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6488321 time 0.0064 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 6357249 Time: 0.0064 [09/29/2020-17:41:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 6357249 [09/29/2020-17:41:48] [V] [TRT] [09/29/2020-17:41:48] [V] [TRT] *************** Autotuning format combination: Half(8,1024,1:8,131072) -> Half(56,3584,1:8,229376) *************** [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 30) [Pooling] (Pooling) [09/29/2020-17:41:48] [V] [TRT] Tactic: -2 time 0.0064 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: -2 Time: 0.0064 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 30) [Pooling] (TiledPooling) [09/29/2020-17:41:48] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [09/29/2020-17:41:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -2 [09/29/2020-17:41:48] [V] [TRT] [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.007104 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.007104 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.014336 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.006432 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.006432 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.006656 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.006656 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.008032 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.008032 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.014624 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.010272 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.014496 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.014176 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.010528 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.0104 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.012288 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.0104 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.01216 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.01024 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.018432 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.005888 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.005888 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.00848 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.012544 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.00848 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.020736 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.009504 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.009504 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.015264 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.008448 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.012288 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.008448 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.0224 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.016288 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.008352 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.008352 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.022528 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.00848 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.00848 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.022784 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.016224 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.006432 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.006432 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.01616 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.007968 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.007968 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.016384 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.007456 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.007456 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:48] [V] [TRT] Tactic: 1002 time 0.02848 [09/29/2020-17:41:48] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:48] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:48] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:48] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:48] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:48] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:48] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:48] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:48] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:48] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:48] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 37) [Convolution] (FusedConvActConvolution) [09/29/2020-17:41:48] [V] [TRT] Tactic: 524287 time 0.189792 [09/29/2020-17:41:48] [V] [TRT] Tactic: 720895 time 0.182432 [09/29/2020-17:41:48] [V] [TRT] Tactic: 983039 time 0.151552 [09/29/2020-17:41:48] [V] [TRT] Tactic: 1048575 time 0.161536 [09/29/2020-17:41:48] [V] [TRT] Tactic: 1703935 time 0.150944 [09/29/2020-17:41:48] [V] [TRT] Tactic: 1769471 time 0.17024 [09/29/2020-17:41:48] [V] [TRT] Tactic: 1966079 time 0.208384 [09/29/2020-17:41:48] [V] [TRT] Tactic: 2031615 time 0.184576 [09/29/2020-17:41:48] [V] [TRT] Tactic: 2228223 time 0.154336 [09/29/2020-17:41:48] [V] [TRT] Tactic: 2424831 time 0.148992 [09/29/2020-17:41:48] [V] [TRT] Tactic: 2621439 time 0.157696 [09/29/2020-17:41:48] [V] [TRT] Tactic: 2752511 time 0.205088 [09/29/2020-17:41:48] [V] [TRT] Tactic: 2818047 time 0.169504 [09/29/2020-17:41:48] [V] [TRT] Tactic: 2883583 time 0.254208 [09/29/2020-17:41:48] [V] [TRT] Tactic: 3014655 time 0.149504 [09/29/2020-17:41:48] [V] [TRT] Tactic: 3145727 time 0.15728 [09/29/2020-17:41:48] [V] [TRT] Tactic: 3473407 time 0.182208 [09/29/2020-17:41:48] [V] [TRT] Tactic: 3604479 time 0.147456 [09/29/2020-17:41:48] [V] [TRT] Tactic: 3735551 time 0.16384 [09/29/2020-17:41:48] [V] [TRT] Tactic: 4390911 time 0.229664 [09/29/2020-17:41:48] [V] [TRT] Tactic: 5046271 time 0.17408 [09/29/2020-17:41:48] [V] [TRT] Tactic: 5963775 time 0.194816 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6160383 time 0.185952 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6488063 time 0.185792 [09/29/2020-17:41:48] [V] [TRT] Tactic: 6881279 time 0.211296 [09/29/2020-17:41:48] [V] [TRT] Tactic: 7274495 time 0.161792 [09/29/2020-17:41:48] [V] [TRT] Tactic: 7864319 time 0.162816 [09/29/2020-17:41:48] [V] [TRT] Tactic: 7995391 time 0.18992 [09/29/2020-17:41:48] [V] [TRT] Tactic: 8585215 time 0.181824 [09/29/2020-17:41:48] [V] [TRT] Tactic: 8847359 time 0.189888 [09/29/2020-17:41:48] [V] [TRT] Tactic: 8978431 time 0.194592 [09/29/2020-17:41:48] [V] [TRT] Tactic: 9043967 time 0.163808 [09/29/2020-17:41:48] [V] [TRT] Tactic: 9175039 time 0.147744 [09/29/2020-17:41:48] [V] [TRT] Tactic: 9502719 time 0.230688 [09/29/2020-17:41:48] [V] [TRT] Tactic: 9830399 time 0.174304 [09/29/2020-17:41:48] [V] [TRT] Tactic: 9961471 time 0.163872 [09/29/2020-17:41:48] [V] [TRT] Tactic: 10027007 time 0.165344 [09/29/2020-17:41:48] [V] [TRT] Tactic: 10092543 time 0.229632 [09/29/2020-17:41:48] [V] [TRT] Tactic: 10289151 time 0.20832 [09/29/2020-17:41:48] [V] [TRT] Tactic: 10485759 time 0.155904 [09/29/2020-17:41:48] [V] [TRT] Tactic: 10682367 time 0.153856 [09/29/2020-17:41:48] [V] [TRT] Tactic: 10813439 time 0.145664 [09/29/2020-17:41:48] [V] [TRT] Fastest Tactic: 10813439 Time: 0.145664 [09/29/2020-17:41:48] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 37) [Convolution] (CaskConvolution) [09/29/2020-17:41:48] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 1825138533642645384 time 0.17008 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2775507031594384867 time 0.0904 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2842488832350522458 time 0.176128 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 3915320020053085238 time 0.166752 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 6448355332020552203 time 0.170944 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 6808617066150061604 time 0.182528 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -8060443123034038864 time 0.188672 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -4420849921117327522 time 0.176 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -3946921629105938337 time 0.20096 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.0904 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 37) [Convolution] (CudaConvolution) [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.272384 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2 time 0.317696 [09/29/2020-17:41:49] [V] [TRT] Tactic: 5 time 1.96682 [09/29/2020-17:41:49] [V] [TRT] Tactic: 6 time 0.104096 [09/29/2020-17:41:49] [V] [TRT] Tactic: 57 time 0.31872 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 6 Time: 0.104096 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 37) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:41:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:49] [V] [TRT] [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:49] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,524288) -> Half(1,64,4096,524288) *************** [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 37) [Convolution] (FusedConvActConvolution) [09/29/2020-17:41:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 37) [Convolution] (CaskConvolution) [09/29/2020-17:41:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 37) [Convolution] (CudaConvolution) [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.272064 [09/29/2020-17:41:49] [V] [TRT] Tactic: 1 time 0.347904 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2 time 0.289056 [09/29/2020-17:41:49] [V] [TRT] Tactic: 4 time 19.1345 [09/29/2020-17:41:49] [V] [TRT] Tactic: 5 time 1.94378 [09/29/2020-17:41:49] [V] [TRT] Tactic: 6 time 0.140704 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 6 Time: 0.140704 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 37) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:41:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [09/29/2020-17:41:49] [V] [TRT] [09/29/2020-17:41:49] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,262144) -> Half(1,64,4096:2,262144) *************** [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 37) [Convolution] (FusedConvActConvolution) [09/29/2020-17:41:49] [V] [TRT] Tactic: 524287 time 0.0976 [09/29/2020-17:41:49] [V] [TRT] Tactic: 720895 time 0.092224 [09/29/2020-17:41:49] [V] [TRT] Tactic: 983039 time 0.077824 [09/29/2020-17:41:49] [V] [TRT] Tactic: 1048575 time 0.081216 [09/29/2020-17:41:49] [V] [TRT] Tactic: 1703935 time 0.078112 [09/29/2020-17:41:49] [V] [TRT] Tactic: 1769471 time 0.095936 [09/29/2020-17:41:49] [V] [TRT] Tactic: 1966079 time 0.10992 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2031615 time 0.0888 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2228223 time 0.078592 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2424831 time 0.080128 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2621439 time 0.083296 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2752511 time 0.104448 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2818047 time 0.086016 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2883583 time 0.127232 [09/29/2020-17:41:49] [V] [TRT] Tactic: 3014655 time 0.07792 [09/29/2020-17:41:49] [V] [TRT] Tactic: 3145727 time 0.081376 [09/29/2020-17:41:49] [V] [TRT] Tactic: 3473407 time 0.092448 [09/29/2020-17:41:49] [V] [TRT] Tactic: 3604479 time 0.077824 [09/29/2020-17:41:49] [V] [TRT] Tactic: 3735551 time 0.082816 [09/29/2020-17:41:49] [V] [TRT] Tactic: 4390911 time 0.114048 [09/29/2020-17:41:49] [V] [TRT] Tactic: 5046271 time 0.091584 [09/29/2020-17:41:49] [V] [TRT] Tactic: 5963775 time 0.098016 [09/29/2020-17:41:49] [V] [TRT] Tactic: 6160383 time 0.096256 [09/29/2020-17:41:49] [V] [TRT] Tactic: 6488063 time 0.096256 [09/29/2020-17:41:49] [V] [TRT] Tactic: 6881279 time 0.104704 [09/29/2020-17:41:49] [V] [TRT] Tactic: 7274495 time 0.084224 [09/29/2020-17:41:49] [V] [TRT] Tactic: 7864319 time 0.089952 [09/29/2020-17:41:49] [V] [TRT] Tactic: 7995391 time 0.096512 [09/29/2020-17:41:49] [V] [TRT] Tactic: 8585215 time 0.093056 [09/29/2020-17:41:49] [V] [TRT] Tactic: 8847359 time 0.102496 [09/29/2020-17:41:49] [V] [TRT] Tactic: 8978431 time 0.098304 [09/29/2020-17:41:49] [V] [TRT] Tactic: 9043967 time 0.08544 [09/29/2020-17:41:49] [V] [TRT] Tactic: 9175039 time 0.077824 [09/29/2020-17:41:49] [V] [TRT] Tactic: 9502719 time 0.114208 [09/29/2020-17:41:49] [V] [TRT] Tactic: 9830399 time 0.08832 [09/29/2020-17:41:49] [V] [TRT] Tactic: 9961471 time 0.092416 [09/29/2020-17:41:49] [V] [TRT] Tactic: 10027007 time 0.083968 [09/29/2020-17:41:49] [V] [TRT] Tactic: 10092543 time 0.114368 [09/29/2020-17:41:49] [V] [TRT] Tactic: 10289151 time 0.1088 [09/29/2020-17:41:49] [V] [TRT] Tactic: 10485759 time 0.08192 [09/29/2020-17:41:49] [V] [TRT] Tactic: 10682367 time 0.083872 [09/29/2020-17:41:49] [V] [TRT] Tactic: 10813439 time 0.075264 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 10813439 Time: 0.075264 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 37) [Convolution] (CaskConvolution) [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 1145226902788474763 time 0.095552 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 1651411198763708804 time 0.094464 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2418518597804310654 time 0.094464 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 4318470497547290900 time 0.092416 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 4653005425971292725 time 0.095168 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 4930470141256631146 time 0.098592 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 8292881859266835088 time 0.09856 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 8401509141903434922 time 0.09216 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -8654297089785671176 time 0.088064 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -7448936905981214224 time 0.10176 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -6004726995029373073 time 0.096032 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -5719726816705110014 time 0.08928 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -3754890472406891741 time 0.090432 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -3689982367035295496 time 0.08832 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -3140347171730126532 time 0.049152 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -2894005464278291378 time 0.100352 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -2027588946874785071 time 0.096064 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -1968398013367819764 time 0.089568 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -245090590808296743 time 0.090368 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.049152 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 37) [Convolution] (CudaConvolution) [09/29/2020-17:41:49] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 37) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:41:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:49] [V] [TRT] [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:49] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 37) [Convolution] (FusedConvActConvolution) [09/29/2020-17:41:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 37) [Convolution] (CaskConvolution) [09/29/2020-17:41:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 37) [Convolution] (CudaConvolution) [09/29/2020-17:41:49] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 37) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:41:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:49] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536) -> Half(16,1024,1:8,65536) *************** [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 37) [Convolution] (FusedConvActConvolution) [09/29/2020-17:41:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 37) [Convolution] (CaskConvolution) [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:49] [V] [TRT] Tactic: 130343752241278875 time 0.051008 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2148106709480872763 time 0.038912 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2410442691266548717 time 0.04944 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:49] [V] [TRT] Tactic: 2921824978225832523 time 0.052448 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:49] [V] [TRT] Tactic: 3030711443478140260 time 0.06512 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 3754069740140581927 time 0.053504 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 3823144360994712832 time 0.034816 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 5635311898703673455 time 0.033024 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 5925270497649423688 time 0.086464 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 6680916730816870145 time 0.053184 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 7158029511300006471 time 0.051456 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 7859952145590271433 time 0.053248 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 8283847742354150423 time 0.055136 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -8992262742606384444 time 0.040576 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -8682550625095202832 time 0.040544 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:49] [V] [TRT] Tactic: -8379842433586149932 time 0.065408 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:49] [V] [TRT] Tactic: -6352769237623756264 time 0.068288 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -6273232454637933930 time 0.03456 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -5818527483287834165 time 0.033024 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -4954692664176521434 time 0.050912 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:49] [V] [TRT] Tactic: -4953888146171240997 time 0.052896 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -4534876761957424274 time 0.086272 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -3237051169894153788 time 0.0512 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -3136088851200285532 time 0.032032 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -2586046817576862066 time 0.05072 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -229563042944049199 time 0.033024 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: -3136088851200285532 Time: 0.032032 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 37) [Convolution] (CudaConvolution) [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.35776 [09/29/2020-17:41:49] [V] [TRT] Tactic: 1 time 0.192 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2 time 0.397696 [09/29/2020-17:41:49] [V] [TRT] Tactic: 6 time 0.125216 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 6 Time: 0.125216 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 37) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:41:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3136088851200285532 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:49] [V] [TRT] Tactic: 1002 time 0.007008 [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.008992 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.007008 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:49] [V] [TRT] Tactic: 1002 time 0.014336 [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:49] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.007488 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.007488 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:49] [V] [TRT] Tactic: 1002 time 0.007488 [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.007488 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:49] [V] [TRT] Tactic: 1002 time 0.015008 [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:49] [V] [TRT] Tactic: 1002 time 0.010848 [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.007456 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.007456 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:49] [V] [TRT] Tactic: 1002 time 0.014336 [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:49] [V] [TRT] Tactic: 1002 time 0.014592 [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.007712 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.007712 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:49] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:49] [V] [TRT] Tactic: 1002 time 0.010528 [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:49] [V] [TRT] Tactic: 1002 time 0.010528 [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:49] [V] [TRT] Tactic: 1002 time 0.018432 [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.00624 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00624 [09/29/2020-17:41:49] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,262144), Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (CaskConvolution) [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 1754569683116234317 time 0.022816 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 1825138533642645384 time 0.023072 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2733356012094739613 time 0.024864 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 3915320020053085238 time 0.024096 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 6808617066150061604 time 0.022528 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 9091006216302412844 time 0.022048 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -8060443123034038864 time 0.02144 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -4420849921117327522 time 0.022816 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -3946921629105938337 time 0.02432 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: -8060443123034038864 Time: 0.02144 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (CudaConvolution) [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.045344 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2 time 0.075776 [09/29/2020-17:41:49] [V] [TRT] Tactic: 5 time 0.076256 [09/29/2020-17:41:49] [V] [TRT] Tactic: 57 time 0.04096 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 57 Time: 0.04096 [09/29/2020-17:41:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8060443123034038864 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,262144), Half(1,64,4096,524288) -> Half(1,64,4096,524288) *************** [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (CaskConvolution) [09/29/2020-17:41:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (CudaConvolution) [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.0392 [09/29/2020-17:41:49] [V] [TRT] Tactic: 1 time 0.0352 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2 time 0.054816 [09/29/2020-17:41:49] [V] [TRT] Tactic: 4 time 1.5416 [09/29/2020-17:41:49] [V] [TRT] Tactic: 5 time 0.073888 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 1 Time: 0.0352 [09/29/2020-17:41:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [09/29/2020-17:41:49] [V] [TRT] [09/29/2020-17:41:49] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,131072), Half(1,64,4096:2,262144) -> Half(1,64,4096:2,262144) *************** [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (CaskConvolution) [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 1651411198763708804 time 0.013312 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2418518597804310654 time 0.013184 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 4318470497547290900 time 0.013152 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 4930470141256631146 time 0.013888 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 8292881859266835088 time 0.013184 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 8401509141903434922 time 0.013696 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -8654297089785671176 time 0.012576 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -7516584506774355935 time 0.013184 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -7140760933967189247 time 0.012896 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -6004726995029373073 time 0.014304 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -5719726816705110014 time 0.012576 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -4097850214384059472 time 0.013568 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -3717489476759089008 time 0.013152 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -3689982367035295496 time 0.012544 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -2640575123064142123 time 0.012288 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -2534402059426524406 time 0.012576 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -2027588946874785071 time 0.013184 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -1968398013367819764 time 0.012576 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: -2640575123064142123 Time: 0.012288 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (CudaConvolution) [09/29/2020-17:41:49] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2640575123064142123 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:49] [V] [TRT] *************** Autotuning format combination: Half(8,512,1:8,32768), Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (CaskConvolution) [09/29/2020-17:41:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (CudaConvolution) [09/29/2020-17:41:49] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:49] [V] [TRT] *************** Autotuning format combination: Half(8,512,1:8,32768), Half(16,1024,1:8,65536) -> Half(16,1024,1:8,65536) *************** [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (CaskConvolution) [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:49] [V] [TRT] Tactic: 9576651994278528 time 0.012032 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 1179757074518529353 time 0.011712 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2105695814191699972 time 0.011936 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2148106709480872763 time 0.010496 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2410442691266548717 time 0.012544 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 3041642431972138763 time 0.011456 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 3754069740140581927 time 0.010976 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 4555462412611657028 time 0.010528 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 5666160310350604399 time 0.01168 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:49] [V] [TRT] Tactic: 5876997871499382316 time 0.013632 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 5925270497649423688 time 0.014368 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 6680916730816870145 time 0.012544 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 7158029511300006471 time 0.011904 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 7859952145590271433 time 0.012576 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: 8283847742354150423 time 0.011968 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -8992262742606384444 time 0.010528 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -8391760416076885205 time 0.014016 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -6273232454637933930 time 0.011776 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:49] [V] [TRT] Tactic: -5925110308892264213 time 0.012576 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -5818527483287834165 time 0.011136 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:49] [V] [TRT] Tactic: -4908848143422991657 time 0.013184 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -4534876761957424274 time 0.013152 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -3237051169894153788 time 0.012256 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -3136088851200285532 time 0.010528 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -2586046817576862066 time 0.014016 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -2422160065350346448 time 0.012384 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -1216445540764179377 time 0.012544 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] Tactic: -229563042944049199 time 0.010528 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 2148106709480872763 Time: 0.010496 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (CudaConvolution) [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.04464 [09/29/2020-17:41:49] [V] [TRT] Tactic: 1 time 0.046848 [09/29/2020-17:41:49] [V] [TRT] Tactic: 2 time 0.065216 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.04464 [09/29/2020-17:41:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2148106709480872763 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:49] [V] [TRT] Tactic: 1002 time 0.008448 [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.012544 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.008448 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:49] [V] [TRT] Tactic: 1002 time 0.022016 [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.009088 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.009088 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:49] [V] [TRT] Tactic: 1002 time 0.016192 [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.00864 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00864 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:49] [V] [TRT] Tactic: 1002 time 0.008448 [09/29/2020-17:41:49] [V] [TRT] Tactic: 0 time 0.012224 [09/29/2020-17:41:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.008448 [09/29/2020-17:41:49] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:50] [V] [TRT] Tactic: 1002 time 0.021696 [09/29/2020-17:41:50] [V] [TRT] Tactic: 0 time 0.0088 [09/29/2020-17:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.0088 [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:50] [V] [TRT] Tactic: 1002 time 0.016352 [09/29/2020-17:41:50] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:50] [V] [TRT] Tactic: 1002 time 0.022784 [09/29/2020-17:41:50] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:50] [V] [TRT] Tactic: 1002 time 0.022784 [09/29/2020-17:41:50] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:50] [V] [TRT] Tactic: 1002 time 0.016192 [09/29/2020-17:41:50] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:50] [V] [TRT] Tactic: 1002 time 0.0152 [09/29/2020-17:41:50] [V] [TRT] Tactic: 0 time 0.008 [09/29/2020-17:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.008 [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:50] [V] [TRT] Tactic: 1002 time 0.016288 [09/29/2020-17:41:50] [V] [TRT] Tactic: 0 time 0.007488 [09/29/2020-17:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.007488 [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:50] [V] [TRT] Tactic: 1002 time 0.028672 [09/29/2020-17:41:50] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:50] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:50] [V] [TRT] Tactic: 524287 time 0.188416 [09/29/2020-17:41:50] [V] [TRT] Tactic: 720895 time 0.180512 [09/29/2020-17:41:50] [V] [TRT] Tactic: 983039 time 0.151424 [09/29/2020-17:41:50] [V] [TRT] Tactic: 1048575 time 0.16 [09/29/2020-17:41:50] [V] [TRT] Tactic: 1703935 time 0.150368 [09/29/2020-17:41:50] [V] [TRT] Tactic: 1769471 time 0.169728 [09/29/2020-17:41:50] [V] [TRT] Tactic: 1966079 time 0.208896 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2031615 time 0.18432 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2228223 time 0.153856 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2424831 time 0.148992 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2621439 time 0.157408 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2752511 time 0.205056 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2818047 time 0.169984 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2883583 time 0.25424 [09/29/2020-17:41:50] [V] [TRT] Tactic: 3014655 time 0.149536 [09/29/2020-17:41:50] [V] [TRT] Tactic: 3145727 time 0.157408 [09/29/2020-17:41:50] [V] [TRT] Tactic: 3473407 time 0.18432 [09/29/2020-17:41:50] [V] [TRT] Tactic: 3604479 time 0.147456 [09/29/2020-17:41:50] [V] [TRT] Tactic: 3735551 time 0.163072 [09/29/2020-17:41:50] [V] [TRT] Tactic: 4390911 time 0.229664 [09/29/2020-17:41:50] [V] [TRT] Tactic: 5046271 time 0.172928 [09/29/2020-17:41:50] [V] [TRT] Tactic: 5963775 time 0.196608 [09/29/2020-17:41:50] [V] [TRT] Tactic: 6160383 time 0.184608 [09/29/2020-17:41:50] [V] [TRT] Tactic: 6488063 time 0.186368 [09/29/2020-17:41:50] [V] [TRT] Tactic: 6881279 time 0.212416 [09/29/2020-17:41:50] [V] [TRT] Tactic: 7274495 time 0.16208 [09/29/2020-17:41:50] [V] [TRT] Tactic: 7864319 time 0.16384 [09/29/2020-17:41:50] [V] [TRT] Tactic: 7995391 time 0.187872 [09/29/2020-17:41:50] [V] [TRT] Tactic: 8585215 time 0.181888 [09/29/2020-17:41:50] [V] [TRT] Tactic: 8847359 time 0.190464 [09/29/2020-17:41:50] [V] [TRT] Tactic: 8978431 time 0.19456 [09/29/2020-17:41:50] [V] [TRT] Tactic: 9043967 time 0.16384 [09/29/2020-17:41:50] [V] [TRT] Tactic: 9175039 time 0.14752 [09/29/2020-17:41:50] [V] [TRT] Tactic: 9502719 time 0.229376 [09/29/2020-17:41:50] [V] [TRT] Tactic: 9830399 time 0.17408 [09/29/2020-17:41:50] [V] [TRT] Tactic: 9961471 time 0.16384 [09/29/2020-17:41:50] [V] [TRT] Tactic: 10027007 time 0.164128 [09/29/2020-17:41:50] [V] [TRT] Tactic: 10092543 time 0.2288 [09/29/2020-17:41:50] [V] [TRT] Tactic: 10289151 time 0.208896 [09/29/2020-17:41:50] [V] [TRT] Tactic: 10485759 time 0.156544 [09/29/2020-17:41:50] [V] [TRT] Tactic: 10682367 time 0.153568 [09/29/2020-17:41:50] [V] [TRT] Tactic: 10813439 time 0.145664 [09/29/2020-17:41:50] [V] [TRT] Fastest Tactic: 10813439 Time: 0.145664 [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (CaskConvolution) [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 1825138533642645384 time 0.169984 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2775507031594384867 time 0.09104 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2842488832350522458 time 0.176384 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 3915320020053085238 time 0.167808 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 6448355332020552203 time 0.170848 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 6808617066150061604 time 0.182528 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -8060443123034038864 time 0.189248 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -4420849921117327522 time 0.175616 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -3946921629105938337 time 0.20096 [09/29/2020-17:41:50] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.09104 [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (CudaConvolution) [09/29/2020-17:41:50] [V] [TRT] Tactic: 0 time 0.276224 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2 time 0.322944 [09/29/2020-17:41:50] [V] [TRT] Tactic: 5 time 1.95837 [09/29/2020-17:41:50] [V] [TRT] Tactic: 6 time 0.10832 [09/29/2020-17:41:50] [V] [TRT] Tactic: 57 time 0.183648 [09/29/2020-17:41:50] [V] [TRT] Fastest Tactic: 6 Time: 0.10832 [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:50] [V] [TRT] [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:50] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,524288) -> Half(1,64,4096,524288) *************** [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:50] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (CaskConvolution) [09/29/2020-17:41:50] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (CudaConvolution) [09/29/2020-17:41:50] [V] [TRT] Tactic: 0 time 0.276 [09/29/2020-17:41:50] [V] [TRT] Tactic: 1 time 0.412768 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2 time 0.294912 [09/29/2020-17:41:50] [V] [TRT] Tactic: 4 time 19.175 [09/29/2020-17:41:50] [V] [TRT] Tactic: 5 time 1.94576 [09/29/2020-17:41:50] [V] [TRT] Tactic: 6 time 0.143296 [09/29/2020-17:41:50] [V] [TRT] Fastest Tactic: 6 Time: 0.143296 [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [09/29/2020-17:41:50] [V] [TRT] [09/29/2020-17:41:50] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,262144) -> Half(1,64,4096:2,262144) *************** [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:50] [V] [TRT] Tactic: 524287 time 0.09776 [09/29/2020-17:41:50] [V] [TRT] Tactic: 720895 time 0.09216 [09/29/2020-17:41:50] [V] [TRT] Tactic: 983039 time 0.07744 [09/29/2020-17:41:50] [V] [TRT] Tactic: 1048575 time 0.080128 [09/29/2020-17:41:50] [V] [TRT] Tactic: 1703935 time 0.07808 [09/29/2020-17:41:50] [V] [TRT] Tactic: 1769471 time 0.095968 [09/29/2020-17:41:50] [V] [TRT] Tactic: 1966079 time 0.1088 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2031615 time 0.08896 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2228223 time 0.078112 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2424831 time 0.079872 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2621439 time 0.084224 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2752511 time 0.084672 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2818047 time 0.08528 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2883583 time 0.126976 [09/29/2020-17:41:50] [V] [TRT] Tactic: 3014655 time 0.07808 [09/29/2020-17:41:50] [V] [TRT] Tactic: 3145727 time 0.081184 [09/29/2020-17:41:50] [V] [TRT] Tactic: 3473407 time 0.092416 [09/29/2020-17:41:50] [V] [TRT] Tactic: 3604479 time 0.07728 [09/29/2020-17:41:50] [V] [TRT] Tactic: 3735551 time 0.082176 [09/29/2020-17:41:50] [V] [TRT] Tactic: 4390911 time 0.114688 [09/29/2020-17:41:50] [V] [TRT] Tactic: 5046271 time 0.09056 [09/29/2020-17:41:50] [V] [TRT] Tactic: 5963775 time 0.09792 [09/29/2020-17:41:50] [V] [TRT] Tactic: 6160383 time 0.096256 [09/29/2020-17:41:50] [V] [TRT] Tactic: 6488063 time 0.096128 [09/29/2020-17:41:50] [V] [TRT] Tactic: 6881279 time 0.104704 [09/29/2020-17:41:50] [V] [TRT] Tactic: 7274495 time 0.084224 [09/29/2020-17:41:50] [V] [TRT] Tactic: 7864319 time 0.090112 [09/29/2020-17:41:50] [V] [TRT] Tactic: 7995391 time 0.09648 [09/29/2020-17:41:50] [V] [TRT] Tactic: 8585215 time 0.093632 [09/29/2020-17:41:50] [V] [TRT] Tactic: 8847359 time 0.102112 [09/29/2020-17:41:50] [V] [TRT] Tactic: 8978431 time 0.098304 [09/29/2020-17:41:50] [V] [TRT] Tactic: 9043967 time 0.085664 [09/29/2020-17:41:50] [V] [TRT] Tactic: 9175039 time 0.077408 [09/29/2020-17:41:50] [V] [TRT] Tactic: 9502719 time 0.113664 [09/29/2020-17:41:50] [V] [TRT] Tactic: 9830399 time 0.089696 [09/29/2020-17:41:50] [V] [TRT] Tactic: 9961471 time 0.092416 [09/29/2020-17:41:50] [V] [TRT] Tactic: 10027007 time 0.094464 [09/29/2020-17:41:50] [V] [TRT] Tactic: 10092543 time 0.114592 [09/29/2020-17:41:50] [V] [TRT] Tactic: 10289151 time 0.108832 [09/29/2020-17:41:50] [V] [TRT] Tactic: 10485759 time 0.08192 [09/29/2020-17:41:50] [V] [TRT] Tactic: 10682367 time 0.083776 [09/29/2020-17:41:50] [V] [TRT] Tactic: 10813439 time 0.075232 [09/29/2020-17:41:50] [V] [TRT] Fastest Tactic: 10813439 Time: 0.075232 [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (CaskConvolution) [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 1145226902788474763 time 0.095584 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 1651411198763708804 time 0.094208 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2418518597804310654 time 0.094496 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 4318470497547290900 time 0.092416 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 4653005425971292725 time 0.09552 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 4930470141256631146 time 0.09856 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 8292881859266835088 time 0.098208 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 8401509141903434922 time 0.09216 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -8654297089785671176 time 0.088064 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -7448936905981214224 time 0.1024 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -6004726995029373073 time 0.096 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -5719726816705110014 time 0.08832 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -3754890472406891741 time 0.090496 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -3689982367035295496 time 0.088704 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -3140347171730126532 time 0.04736 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -2894005464278291378 time 0.100608 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -2027588946874785071 time 0.096032 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -1968398013367819764 time 0.08944 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -245090590808296743 time 0.090368 [09/29/2020-17:41:50] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.04736 [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (CudaConvolution) [09/29/2020-17:41:50] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:50] [V] [TRT] [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:50] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:50] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (CaskConvolution) [09/29/2020-17:41:50] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (CudaConvolution) [09/29/2020-17:41:50] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:50] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536) -> Half(16,1024,1:8,65536) *************** [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:50] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (CaskConvolution) [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:50] [V] [TRT] Tactic: 130343752241278875 time 0.050048 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2148106709480872763 time 0.038912 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2410442691266548717 time 0.049408 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:50] [V] [TRT] Tactic: 2921824978225832523 time 0.0512 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:50] [V] [TRT] Tactic: 3030711443478140260 time 0.0576 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 3754069740140581927 time 0.053248 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 3823144360994712832 time 0.0344 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 5635311898703673455 time 0.033024 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 5925270497649423688 time 0.088064 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 6680916730816870145 time 0.053248 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 7158029511300006471 time 0.052608 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 7859952145590271433 time 0.052608 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: 8283847742354150423 time 0.054592 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -8992262742606384444 time 0.04096 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -8682550625095202832 time 0.039264 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:50] [V] [TRT] Tactic: -8379842433586149932 time 0.0576 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:50] [V] [TRT] Tactic: -6352769237623756264 time 0.068896 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -6273232454637933930 time 0.03584 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -5818527483287834165 time 0.034336 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -4954692664176521434 time 0.05104 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:50] [V] [TRT] Tactic: -4953888146171240997 time 0.052768 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -4534876761957424274 time 0.086272 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -3237051169894153788 time 0.0512 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -3136088851200285532 time 0.031424 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -2586046817576862066 time 0.050528 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] Tactic: -229563042944049199 time 0.033792 [09/29/2020-17:41:50] [V] [TRT] Fastest Tactic: -3136088851200285532 Time: 0.031424 [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (CudaConvolution) [09/29/2020-17:41:50] [V] [TRT] Tactic: 0 time 0.360704 [09/29/2020-17:41:50] [V] [TRT] Tactic: 1 time 0.196224 [09/29/2020-17:41:50] [V] [TRT] Tactic: 2 time 0.401632 [09/29/2020-17:41:50] [V] [TRT] Tactic: 6 time 0.129312 [09/29/2020-17:41:50] [V] [TRT] Fastest Tactic: 6 Time: 0.129312 [09/29/2020-17:41:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3136088851200285532 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:50] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288), Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (CaskConvolution) [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 1825138533642645384 time 0.175424 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 2775507031594384867 time 0.094208 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 2842488832350522458 time 0.179808 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 3915320020053085238 time 0.172288 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 6448355332020552203 time 0.175616 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 6808617066150061604 time 0.185824 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -8060443123034038864 time 0.192128 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -4420849921117327522 time 0.176768 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -3946921629105938337 time 0.208864 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.094208 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (CudaConvolution) [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.290656 [09/29/2020-17:41:51] [V] [TRT] Tactic: 2 time 0.335968 [09/29/2020-17:41:51] [V] [TRT] Tactic: 5 time 1.97642 [09/29/2020-17:41:51] [V] [TRT] Tactic: 6 time 0.1208 [09/29/2020-17:41:51] [V] [TRT] Tactic: 57 time 0.193344 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 6 Time: 0.1208 [09/29/2020-17:41:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:51] [V] [TRT] [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:51] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,524288), Half(1,64,4096,524288) -> Half(1,64,4096,524288) *************** [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (CaskConvolution) [09/29/2020-17:41:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (CudaConvolution) [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.283232 [09/29/2020-17:41:51] [V] [TRT] Tactic: 1 time 0.27648 [09/29/2020-17:41:51] [V] [TRT] Tactic: 2 time 0.305024 [09/29/2020-17:41:51] [V] [TRT] Tactic: 4 time 19.2107 [09/29/2020-17:41:51] [V] [TRT] Tactic: 5 time 1.95923 [09/29/2020-17:41:51] [V] [TRT] Tactic: 6 time 0.151904 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 6 Time: 0.151904 [09/29/2020-17:41:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [09/29/2020-17:41:51] [V] [TRT] [09/29/2020-17:41:51] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,262144), Half(1,64,4096:2,262144) -> Half(1,64,4096:2,262144) *************** [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (CaskConvolution) [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 1145226902788474763 time 0.096256 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 1651411198763708804 time 0.096064 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 2418518597804310654 time 0.096192 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 4318470497547290900 time 0.09408 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 4653005425971292725 time 0.096512 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 4930470141256631146 time 0.100608 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 8292881859266835088 time 0.100608 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 8401509141903434922 time 0.094176 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -8654297089785671176 time 0.09008 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -7448936905981214224 time 0.103296 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -6004726995029373073 time 0.097696 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -5719726816705110014 time 0.090112 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -3754890472406891741 time 0.092416 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -3689982367035295496 time 0.090368 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -3140347171730126532 time 0.049152 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -2894005464278291378 time 0.102272 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -2027588946874785071 time 0.096384 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -1968398013367819764 time 0.090208 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -245090590808296743 time 0.092416 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.049152 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (CudaConvolution) [09/29/2020-17:41:51] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:51] [V] [TRT] [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:51] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536), Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (CaskConvolution) [09/29/2020-17:41:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (CudaConvolution) [09/29/2020-17:41:51] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:51] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536), Half(16,1024,1:8,65536) -> Half(16,1024,1:8,65536) *************** [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (CaskConvolution) [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:51] [V] [TRT] Tactic: 130343752241278875 time 0.052928 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 2148106709480872763 time 0.040512 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 2410442691266548717 time 0.051328 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:51] [V] [TRT] Tactic: 2921824978225832523 time 0.053504 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:51] [V] [TRT] Tactic: 3030711443478140260 time 0.06704 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 3754069740140581927 time 0.055584 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 3823144360994712832 time 0.035296 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 5635311898703673455 time 0.034944 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 5925270497649423688 time 0.09008 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 6680916730816870145 time 0.055296 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 7158029511300006471 time 0.054624 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 7859952145590271433 time 0.054112 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: 8283847742354150423 time 0.055552 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -8992262742606384444 time 0.041984 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -8682550625095202832 time 0.041216 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:51] [V] [TRT] Tactic: -8379842433586149932 time 0.063776 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:51] [V] [TRT] Tactic: -6352769237623756264 time 0.069888 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -6273232454637933930 time 0.035072 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -5818527483287834165 time 0.03488 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -4954692664176521434 time 0.053088 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:51] [V] [TRT] Tactic: -4953888146171240997 time 0.051616 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -4534876761957424274 time 0.089696 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -3237051169894153788 time 0.05328 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -3136088851200285532 time 0.033024 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -2586046817576862066 time 0.053248 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] Tactic: -229563042944049199 time 0.034912 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: -3136088851200285532 Time: 0.033024 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (CudaConvolution) [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.370688 [09/29/2020-17:41:51] [V] [TRT] Tactic: 1 time 0.206336 [09/29/2020-17:41:51] [V] [TRT] Tactic: 2 time 0.414432 [09/29/2020-17:41:51] [V] [TRT] Tactic: 6 time 0.137472 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 6 Time: 0.137472 [09/29/2020-17:41:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3136088851200285532 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 448 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.012544 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 448 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.011104 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 1002 Time: 0.01024 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 448 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.0208 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.009568 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.009568 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 448 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.016256 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.009728 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.009728 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 448 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.011104 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 1002 Time: 0.01024 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 448 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.0104 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.005888 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.005888 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 448 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.022528 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 448 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.016704 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 448 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.022784 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.012544 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.012544 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 448 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.022976 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.012288 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 448 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.020768 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 448 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.016384 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.007008 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.007008 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 448 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.016384 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.019296 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 1002 Time: 0.016384 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 448 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.016448 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.01872 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 1002 Time: 0.016448 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 448 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.028672 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.006432 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.006432 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 448 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.028512 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 441 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.012544 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 441 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.010272 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.010784 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 1002 Time: 0.010272 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 441 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.021984 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.008608 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.008608 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 441 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.016384 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 441 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.011936 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 1002 Time: 0.01024 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 441 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.011424 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 441 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.021792 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 441 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.016384 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 441 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.022816 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.012288 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 441 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.022816 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.012128 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.012128 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 441 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.020864 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.005888 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.005888 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 441 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.015872 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 441 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.016384 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.020224 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 1002 Time: 0.016384 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 441 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.01648 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.018432 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 1002 Time: 0.01648 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 441 copy (Reformat) [09/29/2020-17:41:51] [V] [TRT] Tactic: 1002 time 0.028608 [09/29/2020-17:41:51] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:51] [V] [TRT] --------------- Timing Runner: 441 copy (Reformat) [09/29/2020-17:41:52] [V] [TRT] Tactic: 1002 time 0.027968 [09/29/2020-17:41:52] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:52] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:52] [V] [TRT] Tactic: 1002 time 0.022816 [09/29/2020-17:41:52] [V] [TRT] Tactic: 0 time 0.022528 [09/29/2020-17:41:52] [V] [TRT] Fastest Tactic: 0 Time: 0.022528 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:52] [V] [TRT] Tactic: 1002 time 0.040224 [09/29/2020-17:41:52] [V] [TRT] Tactic: 0 time 0.018688 [09/29/2020-17:41:52] [V] [TRT] Fastest Tactic: 0 Time: 0.018688 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:52] [V] [TRT] Tactic: 1002 time 0.030976 [09/29/2020-17:41:52] [V] [TRT] Tactic: 0 time 0.019808 [09/29/2020-17:41:52] [V] [TRT] Fastest Tactic: 0 Time: 0.019808 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:52] [V] [TRT] Tactic: 1002 time 0.024 [09/29/2020-17:41:52] [V] [TRT] Tactic: 0 time 0.020512 [09/29/2020-17:41:52] [V] [TRT] Fastest Tactic: 0 Time: 0.020512 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:52] [V] [TRT] Tactic: 1002 time 0.03712 [09/29/2020-17:41:52] [V] [TRT] Tactic: 0 time 0.014528 [09/29/2020-17:41:52] [V] [TRT] Fastest Tactic: 0 Time: 0.014528 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:52] [V] [TRT] Tactic: 1002 time 0.02816 [09/29/2020-17:41:52] [V] [TRT] Tactic: 0 time 0.014176 [09/29/2020-17:41:52] [V] [TRT] Fastest Tactic: 0 Time: 0.014176 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:52] [V] [TRT] Tactic: 1002 time 0.043264 [09/29/2020-17:41:52] [V] [TRT] Tactic: 0 time 0.020736 [09/29/2020-17:41:52] [V] [TRT] Fastest Tactic: 0 Time: 0.020736 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:52] [V] [TRT] Tactic: 1002 time 0.042752 [09/29/2020-17:41:52] [V] [TRT] Tactic: 0 time 0.014592 [09/29/2020-17:41:52] [V] [TRT] Fastest Tactic: 0 Time: 0.014592 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:52] [V] [TRT] Tactic: 1002 time 0.028672 [09/29/2020-17:41:52] [V] [TRT] Tactic: 0 time 0.010848 [09/29/2020-17:41:52] [V] [TRT] Fastest Tactic: 0 Time: 0.010848 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:52] [V] [TRT] Tactic: 1002 time 0.030976 [09/29/2020-17:41:52] [V] [TRT] Tactic: 0 time 0.01872 [09/29/2020-17:41:52] [V] [TRT] Fastest Tactic: 0 Time: 0.01872 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:52] [V] [TRT] Tactic: 1002 time 0.03072 [09/29/2020-17:41:52] [V] [TRT] Tactic: 0 time 0.010528 [09/29/2020-17:41:52] [V] [TRT] Fastest Tactic: 0 Time: 0.010528 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:52] [V] [TRT] Tactic: 1002 time 0.051168 [09/29/2020-17:41:52] [V] [TRT] Tactic: 0 time 0.010208 [09/29/2020-17:41:52] [V] [TRT] Fastest Tactic: 0 Time: 0.010208 [09/29/2020-17:41:52] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:52] [V] [TRT] Tactic: 589823 time 0.131072 [09/29/2020-17:41:52] [V] [TRT] Tactic: 655359 time 0.091936 [09/29/2020-17:41:52] [V] [TRT] Tactic: 786431 time 0.11312 [09/29/2020-17:41:52] [V] [TRT] Tactic: 851967 time 0.079392 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1179647 time 0.079456 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1310719 time 0.096256 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1376255 time 0.094432 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1441791 time 0.099712 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1507327 time 0.088064 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1638399 time 0.104704 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1835007 time 0.123712 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1900543 time 0.09632 [09/29/2020-17:41:52] [V] [TRT] Tactic: 2097151 time 0.106368 [09/29/2020-17:41:52] [V] [TRT] Tactic: 2162687 time 0.094592 [09/29/2020-17:41:52] [V] [TRT] Tactic: 2293759 time 0.092128 [09/29/2020-17:41:52] [V] [TRT] Tactic: 2359295 time 0.076064 [09/29/2020-17:41:52] [V] [TRT] Tactic: 2686975 time 0.094464 [09/29/2020-17:41:52] [V] [TRT] Tactic: 3080191 time 0.083712 [09/29/2020-17:41:52] [V] [TRT] Tactic: 3342335 time 0.086016 [09/29/2020-17:41:52] [V] [TRT] Tactic: 3407871 time 0.08688 [09/29/2020-17:41:52] [V] [TRT] Tactic: 3538943 time 0.076512 [09/29/2020-17:41:52] [V] [TRT] Tactic: 3670015 time 0.139712 [09/29/2020-17:41:52] [V] [TRT] Tactic: 3932159 time 0.087424 [09/29/2020-17:41:52] [V] [TRT] Tactic: 3997695 time 0.1088 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4063231 time 0.077824 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4194303 time 0.10736 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4259839 time 0.096256 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4325375 time 0.102176 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4521983 time 0.108544 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4587519 time 0.104448 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4653055 time 0.075232 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4915199 time 0.102272 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4980735 time 0.102656 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5177343 time 0.090368 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5242879 time 0.088064 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5373951 time 0.11264 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5439487 time 0.196288 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5570559 time 0.08832 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5636095 time 0.077824 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5701631 time 0.092128 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5767167 time 0.464896 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5832703 time 0.073216 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5898239 time 0.075776 [09/29/2020-17:41:52] [V] [TRT] Tactic: 6029311 time 0.090368 [09/29/2020-17:41:52] [V] [TRT] Tactic: 6225919 time 0.080288 [09/29/2020-17:41:52] [V] [TRT] Tactic: 6291455 time 0.078272 [09/29/2020-17:41:52] [V] [TRT] Tactic: 6422527 time 0.082176 [09/29/2020-17:41:52] [V] [TRT] Tactic: 6750207 time 0.128544 [09/29/2020-17:41:52] [V] [TRT] Tactic: 6815743 time 0.11904 [09/29/2020-17:41:52] [V] [TRT] Tactic: 6946815 time 0.184576 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7012351 time 0.106496 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7077887 time 0.072416 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7143423 time 0.19456 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7208959 time 0.083296 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7340031 time 0.079872 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7405567 time 0.083264 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7536639 time 0.132384 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7602175 time 0.110592 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7733247 time 0.073984 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7798783 time 0.112896 [09/29/2020-17:41:52] [V] [TRT] Tactic: 8191999 time 0.13952 [09/29/2020-17:41:52] [V] [TRT] Tactic: 8257535 time 0.112576 [09/29/2020-17:41:52] [V] [TRT] Tactic: 8323071 time 0.133824 [09/29/2020-17:41:52] [V] [TRT] Tactic: 8650751 time 0.132896 [09/29/2020-17:41:52] [V] [TRT] Tactic: 8716287 time 0.114944 [09/29/2020-17:41:52] [V] [TRT] Tactic: 9109503 time 0.114944 [09/29/2020-17:41:52] [V] [TRT] Tactic: 9568255 time 0.102688 [09/29/2020-17:41:52] [V] [TRT] Tactic: 9895935 time 0.107744 [09/29/2020-17:41:52] [V] [TRT] Tactic: 10223615 time 0.094208 [09/29/2020-17:41:52] [V] [TRT] Tactic: 10354687 time 0.096352 [09/29/2020-17:41:52] [V] [TRT] Tactic: 10551295 time 0.128672 [09/29/2020-17:41:52] [V] [TRT] Tactic: 10747903 time 0.069888 [09/29/2020-17:41:52] [V] [TRT] Tactic: 10944511 time 0.10592 [09/29/2020-17:41:52] [V] [TRT] Fastest Tactic: 10747903 Time: 0.069888 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (CaskConvolution) [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1754569683116234317 time 0.046592 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1825138533642645384 time 0.047008 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 2733356012094739613 time 0.05488 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 3915320020053085238 time 0.046944 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 6808617066150061604 time 0.050016 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 9091006216302412844 time 0.04704 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -8060443123034038864 time 0.0512 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -4420849921117327522 time 0.049152 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -3946921629105938337 time 0.055296 [09/29/2020-17:41:52] [V] [TRT] Fastest Tactic: 1754569683116234317 Time: 0.046592 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (CudaConvolution) [09/29/2020-17:41:52] [V] [TRT] Tactic: 0 time 0.083904 [09/29/2020-17:41:52] [V] [TRT] Tactic: 2 time 0.184256 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5 time 0.155776 [09/29/2020-17:41:52] [V] [TRT] Tactic: 57 time 0.060704 [09/29/2020-17:41:52] [V] [TRT] Fastest Tactic: 57 Time: 0.060704 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1754569683116234317 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576) -> Half(1,64,4096,524288) *************** [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:52] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (CaskConvolution) [09/29/2020-17:41:52] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (CudaConvolution) [09/29/2020-17:41:52] [V] [TRT] Tactic: 0 time 0.076672 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1 time 0.059328 [09/29/2020-17:41:52] [V] [TRT] Tactic: 2 time 0.159744 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4 time 5.99245 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5 time 0.15568 [09/29/2020-17:41:52] [V] [TRT] Fastest Tactic: 1 Time: 0.059328 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [09/29/2020-17:41:52] [V] [TRT] [09/29/2020-17:41:52] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288) -> Half(1,64,4096,524288) *************** [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:52] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (CaskConvolution) [09/29/2020-17:41:52] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (CudaConvolution) [09/29/2020-17:41:52] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:52] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288) -> Half(1,64,4096:2,262144) *************** [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:52] [V] [TRT] Tactic: 589823 time 0.06368 [09/29/2020-17:41:52] [V] [TRT] Tactic: 655359 time 0.038656 [09/29/2020-17:41:52] [V] [TRT] Tactic: 786431 time 0.061408 [09/29/2020-17:41:52] [V] [TRT] Tactic: 851967 time 0.042432 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1179647 time 0.044128 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1310719 time 0.049152 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1376255 time 0.040608 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1441791 time 0.047104 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1507327 time 0.043008 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1638399 time 0.05952 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1835007 time 0.063488 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1900543 time 0.042848 [09/29/2020-17:41:52] [V] [TRT] Tactic: 2097151 time 0.061056 [09/29/2020-17:41:52] [V] [TRT] Tactic: 2162687 time 0.041216 [09/29/2020-17:41:52] [V] [TRT] Tactic: 2293759 time 0.04096 [09/29/2020-17:41:52] [V] [TRT] Tactic: 2359295 time 0.036576 [09/29/2020-17:41:52] [V] [TRT] Tactic: 2686975 time 0.043008 [09/29/2020-17:41:52] [V] [TRT] Tactic: 3080191 time 0.039168 [09/29/2020-17:41:52] [V] [TRT] Tactic: 3342335 time 0.039776 [09/29/2020-17:41:52] [V] [TRT] Tactic: 3407871 time 0.041408 [09/29/2020-17:41:52] [V] [TRT] Tactic: 3538943 time 0.040896 [09/29/2020-17:41:52] [V] [TRT] Tactic: 3670015 time 0.057216 [09/29/2020-17:41:52] [V] [TRT] Tactic: 3932159 time 0.041216 [09/29/2020-17:41:52] [V] [TRT] Tactic: 3997695 time 0.059392 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4063231 time 0.041216 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4194303 time 0.059072 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4259839 time 0.054752 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4325375 time 0.055552 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4521983 time 0.057056 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4587519 time 0.0576 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4653055 time 0.043136 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4915199 time 0.05616 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4980735 time 0.055168 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5177343 time 0.049504 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5242879 time 0.046368 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5373951 time 0.0616 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5439487 time 0.101024 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5570559 time 0.043264 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5636095 time 0.041216 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5701631 time 0.045312 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5767167 time 0.23552 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5832703 time 0.03712 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5898239 time 0.041216 [09/29/2020-17:41:52] [V] [TRT] Tactic: 6029311 time 0.0448 [09/29/2020-17:41:52] [V] [TRT] Tactic: 6225919 time 0.043392 [09/29/2020-17:41:52] [V] [TRT] Tactic: 6291455 time 0.043008 [09/29/2020-17:41:52] [V] [TRT] Tactic: 6422527 time 0.039584 [09/29/2020-17:41:52] [V] [TRT] Tactic: 6750207 time 0.068448 [09/29/2020-17:41:52] [V] [TRT] Tactic: 6815743 time 0.062752 [09/29/2020-17:41:52] [V] [TRT] Tactic: 6946815 time 0.094464 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7012351 time 0.061152 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7077887 time 0.03776 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7143423 time 0.098048 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7208959 time 0.044384 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7340031 time 0.043232 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7405567 time 0.045344 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7536639 time 0.059392 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7602175 time 0.05904 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7733247 time 0.039168 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7798783 time 0.06144 [09/29/2020-17:41:52] [V] [TRT] Tactic: 8191999 time 0.073984 [09/29/2020-17:41:52] [V] [TRT] Tactic: 8257535 time 0.060768 [09/29/2020-17:41:52] [V] [TRT] Tactic: 8323071 time 0.068832 [09/29/2020-17:41:52] [V] [TRT] Tactic: 8650751 time 0.069888 [09/29/2020-17:41:52] [V] [TRT] Tactic: 8716287 time 0.06144 [09/29/2020-17:41:52] [V] [TRT] Tactic: 9109503 time 0.06544 [09/29/2020-17:41:52] [V] [TRT] Tactic: 9568255 time 0.055968 [09/29/2020-17:41:52] [V] [TRT] Tactic: 9895935 time 0.058592 [09/29/2020-17:41:52] [V] [TRT] Tactic: 10223615 time 0.042688 [09/29/2020-17:41:52] [V] [TRT] Tactic: 10354687 time 0.0536 [09/29/2020-17:41:52] [V] [TRT] Tactic: 10551295 time 0.065792 [09/29/2020-17:41:52] [V] [TRT] Tactic: 10747903 time 0.03712 [09/29/2020-17:41:52] [V] [TRT] Tactic: 10944511 time 0.055232 [09/29/2020-17:41:52] [V] [TRT] Fastest Tactic: 2359295 Time: 0.036576 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (CaskConvolution) [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1651411198763708804 time 0.02688 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 2418518597804310654 time 0.028288 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4318470497547290900 time 0.026912 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4930470141256631146 time 0.028928 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 8292881859266835088 time 0.028352 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 8401509141903434922 time 0.02688 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -8654297089785671176 time 0.024832 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -7516584506774355935 time 0.027968 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -7140760933967189247 time 0.026624 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -6004726995029373073 time 0.028512 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -5719726816705110014 time 0.02688 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -4097850214384059472 time 0.02688 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -3717489476759089008 time 0.02688 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -3689982367035295496 time 0.026624 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -2640575123064142123 time 0.026624 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -2534402059426524406 time 0.025216 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -2027588946874785071 time 0.027904 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -1968398013367819764 time 0.026624 [09/29/2020-17:41:52] [V] [TRT] Fastest Tactic: -8654297089785671176 Time: 0.024832 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (CudaConvolution) [09/29/2020-17:41:52] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8654297089785671176 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:52] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:52] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (CaskConvolution) [09/29/2020-17:41:52] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (CudaConvolution) [09/29/2020-17:41:52] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:52] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Half(16,1024,1:8,65536) *************** [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:52] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (CaskConvolution) [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:52] [V] [TRT] Tactic: 9576651994278528 time 0.018688 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1179757074518529353 time 0.015232 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 2105695814191699972 time 0.01792 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 2148106709480872763 time 0.014336 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 2410442691266548717 time 0.018432 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 3041642431972138763 time 0.014272 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 3754069740140581927 time 0.018272 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 4555462412611657028 time 0.014592 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5666160310350604399 time 0.01968 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:52] [V] [TRT] Tactic: 5876997871499382316 time 0.022784 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 5925270497649423688 time 0.026624 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 6680916730816870145 time 0.019744 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7158029511300006471 time 0.018272 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 7859952145590271433 time 0.018848 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: 8283847742354150423 time 0.018688 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -8992262742606384444 time 0.0152 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -8391760416076885205 time 0.0256 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -6273232454637933930 time 0.016384 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:52] [V] [TRT] Tactic: -5925110308892264213 time 0.022784 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -5818527483287834165 time 0.0152 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:52] [V] [TRT] Tactic: -4908848143422991657 time 0.01952 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -4534876761957424274 time 0.02656 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -3237051169894153788 time 0.018464 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -3136088851200285532 time 0.014336 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -2586046817576862066 time 0.018688 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -2422160065350346448 time 0.018688 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -1216445540764179377 time 0.018432 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] Tactic: -229563042944049199 time 0.014336 [09/29/2020-17:41:52] [V] [TRT] Fastest Tactic: 3041642431972138763 Time: 0.014272 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (CudaConvolution) [09/29/2020-17:41:52] [V] [TRT] Tactic: 0 time 0.09648 [09/29/2020-17:41:52] [V] [TRT] Tactic: 1 time 0.074464 [09/29/2020-17:41:52] [V] [TRT] Tactic: 2 time 0.178112 [09/29/2020-17:41:52] [V] [TRT] Fastest Tactic: 1 Time: 0.074464 [09/29/2020-17:41:52] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3041642431972138763 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:52] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:53] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:53] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,524288) -> Half(1,64,4096,524288) *************** [09/29/2020-17:41:53] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,262144) -> Half(1,64,4096:2,262144) *************** [09/29/2020-17:41:53] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:53] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 52) [Convolution] + (Unnamed Layer* 54) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:53] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:53] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 52) [Convolution] + (Unnamed Layer* 54) [Activation] (CaskConvolution) [09/29/2020-17:41:53] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:53] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 52) [Convolution] + (Unnamed Layer* 54) [Activation] (CudaConvolution) [09/29/2020-17:41:53] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:53] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 52) [Convolution] + (Unnamed Layer* 54) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:53] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536) -> Half(16,1024,1:8,65536) *************** [09/29/2020-17:41:53] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288), Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:53] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,524288), Half(1,64,4096,524288) -> Half(1,64,4096,524288) *************** [09/29/2020-17:41:53] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,262144), Half(1,64,4096:2,262144) -> Half(1,64,4096:2,262144) *************** [09/29/2020-17:41:53] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536), Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:53] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 55) [Convolution] + (Unnamed Layer* 57) [ElementWise] + (Unnamed Layer* 58) [Activation] (CaskConvolution) [09/29/2020-17:41:53] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:53] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 55) [Convolution] + (Unnamed Layer* 57) [ElementWise] + (Unnamed Layer* 58) [Activation] (CudaConvolution) [09/29/2020-17:41:53] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:53] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536), Half(16,1024,1:8,65536) -> Half(16,1024,1:8,65536) *************** [09/29/2020-17:41:53] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:53] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,524288) -> Half(1,64,4096,524288) *************** [09/29/2020-17:41:53] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,262144) -> Half(1,64,4096:2,262144) *************** [09/29/2020-17:41:53] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:53] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 59) [Convolution] + (Unnamed Layer* 61) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:53] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:53] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 59) [Convolution] + (Unnamed Layer* 61) [Activation] (CaskConvolution) [09/29/2020-17:41:53] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:53] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 59) [Convolution] + (Unnamed Layer* 61) [Activation] (CudaConvolution) [09/29/2020-17:41:53] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:53] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 59) [Convolution] + (Unnamed Layer* 61) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:53] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536) -> Half(16,1024,1:8,65536) *************** [09/29/2020-17:41:54] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288), Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:54] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,524288), Half(1,64,4096,524288) -> Half(1,64,4096,524288) *************** [09/29/2020-17:41:54] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,262144), Half(1,64,4096:2,262144) -> Half(1,64,4096:2,262144) *************** [09/29/2020-17:41:54] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536), Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 62) [Convolution] + (Unnamed Layer* 64) [ElementWise] + (Unnamed Layer* 65) [Activation] (CaskConvolution) [09/29/2020-17:41:54] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 62) [Convolution] + (Unnamed Layer* 64) [ElementWise] + (Unnamed Layer* 65) [Activation] (CudaConvolution) [09/29/2020-17:41:54] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:54] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536), Half(16,1024,1:8,65536) -> Half(16,1024,1:8,65536) *************** [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 466 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.012544 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 466 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.011712 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.01024 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 466 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.020736 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.009056 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.009056 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 466 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.016352 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 466 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.011744 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.01024 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 466 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.006112 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.006112 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 466 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.021792 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.009504 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.009504 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 466 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.016416 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 466 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.023904 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.012288 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 466 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.022784 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.012192 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.012192 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 466 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.021312 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.005888 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.005888 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 466 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.016384 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.00784 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.00784 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 466 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.016384 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.019744 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.016384 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 466 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.016384 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.019872 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.016384 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 466 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.028672 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 466 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.028928 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.007776 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.007776 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 459 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.012544 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 459 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.011072 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.01024 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 459 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.021792 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.009568 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.009568 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 459 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.016256 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 459 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.01168 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.010496 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 459 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.0104 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 459 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.020736 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 459 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.016384 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 459 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.022784 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.012544 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.012544 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 459 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.022784 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.012032 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.012032 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 459 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.022368 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.00592 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.00592 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 459 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.015776 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.008096 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.008096 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 459 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.016384 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.018688 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.016384 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 459 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.016032 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.018592 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.016032 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 459 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.028928 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 459 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.028864 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 452 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.012544 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 452 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.011104 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.010496 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 452 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.021952 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.009568 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.009568 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 452 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.016384 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.008512 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.008512 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 452 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.010272 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.012288 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.010272 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 452 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.010528 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.005888 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.005888 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 452 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.020736 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 452 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.016384 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 452 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.022816 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.012544 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.012544 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 452 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.02448 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.012032 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.012032 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 452 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.021984 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.00624 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.00624 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 452 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.016352 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.006432 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.006432 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 452 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.01632 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.019712 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.01632 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 452 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.016384 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.018432 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.016384 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 452 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.028672 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: 452 copy (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.028736 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:54] [V] [TRT] Tactic: 1002 time 0.03712 [09/29/2020-17:41:54] [V] [TRT] Tactic: 0 time 0.034816 [09/29/2020-17:41:54] [V] [TRT] Fastest Tactic: 0 Time: 0.034816 [09/29/2020-17:41:54] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:55] [V] [TRT] Tactic: 1002 time 0.06304 [09/29/2020-17:41:55] [V] [TRT] Tactic: 0 time 0.032768 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: 0 Time: 0.032768 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:55] [V] [TRT] Tactic: 1002 time 0.049056 [09/29/2020-17:41:55] [V] [TRT] Tactic: 0 time 0.032512 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: 0 Time: 0.032512 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:55] [V] [TRT] Tactic: 1002 time 0.038912 [09/29/2020-17:41:55] [V] [TRT] Tactic: 0 time 0.032288 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: 0 Time: 0.032288 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:55] [V] [TRT] Tactic: 1002 time 0.062592 [09/29/2020-17:41:55] [V] [TRT] Tactic: 0 time 0.03072 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: 0 Time: 0.03072 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:55] [V] [TRT] Tactic: 1002 time 0.048384 [09/29/2020-17:41:55] [V] [TRT] Tactic: 0 time 0.024576 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: 0 Time: 0.024576 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:55] [V] [TRT] Tactic: 1002 time 0.073184 [09/29/2020-17:41:55] [V] [TRT] Tactic: 0 time 0.033024 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: 0 Time: 0.033024 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:55] [V] [TRT] Tactic: 1002 time 0.07216 [09/29/2020-17:41:55] [V] [TRT] Tactic: 0 time 0.029568 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: 0 Time: 0.029568 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:55] [V] [TRT] Tactic: 1002 time 0.047104 [09/29/2020-17:41:55] [V] [TRT] Tactic: 0 time 0.020704 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: 0 Time: 0.020704 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:55] [V] [TRT] Tactic: 1002 time 0.053504 [09/29/2020-17:41:55] [V] [TRT] Tactic: 0 time 0.03568 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: 0 Time: 0.03568 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:55] [V] [TRT] Tactic: 1002 time 0.050912 [09/29/2020-17:41:55] [V] [TRT] Tactic: 0 time 0.024576 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: 0 Time: 0.024576 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:55] [V] [TRT] Tactic: 1002 time 0.08352 [09/29/2020-17:41:55] [V] [TRT] Tactic: 0 time 0.02048 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: 0 Time: 0.02048 [09/29/2020-17:41:55] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1835008) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:55] [V] [TRT] Tactic: 589823 time 0.1984 [09/29/2020-17:41:55] [V] [TRT] Tactic: 655359 time 0.132736 [09/29/2020-17:41:55] [V] [TRT] Tactic: 786431 time 0.176992 [09/29/2020-17:41:55] [V] [TRT] Tactic: 851967 time 0.112896 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1179647 time 0.114688 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1310719 time 0.14752 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1376255 time 0.139008 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1441791 time 0.147392 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1507327 time 0.128672 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1638399 time 0.162048 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1835007 time 0.195424 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1900543 time 0.14336 [09/29/2020-17:41:55] [V] [TRT] Tactic: 2097151 time 0.163808 [09/29/2020-17:41:55] [V] [TRT] Tactic: 2162687 time 0.139136 [09/29/2020-17:41:55] [V] [TRT] Tactic: 2293759 time 0.133376 [09/29/2020-17:41:55] [V] [TRT] Tactic: 2359295 time 0.107968 [09/29/2020-17:41:55] [V] [TRT] Tactic: 2686975 time 0.137216 [09/29/2020-17:41:55] [V] [TRT] Tactic: 3080191 time 0.123136 [09/29/2020-17:41:55] [V] [TRT] Tactic: 3342335 time 0.129024 [09/29/2020-17:41:55] [V] [TRT] Tactic: 3407871 time 0.131232 [09/29/2020-17:41:55] [V] [TRT] Tactic: 3538943 time 0.114976 [09/29/2020-17:41:55] [V] [TRT] Tactic: 3670015 time 0.217088 [09/29/2020-17:41:55] [V] [TRT] Tactic: 3932159 time 0.124352 [09/29/2020-17:41:55] [V] [TRT] Tactic: 3997695 time 0.172288 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4063231 time 0.110592 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4194303 time 0.168416 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4259839 time 0.147104 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4325375 time 0.159744 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4521983 time 0.17024 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4587519 time 0.164736 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4653055 time 0.108064 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4915199 time 0.16 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4980735 time 0.164096 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5177343 time 0.134976 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5242879 time 0.135008 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5373951 time 0.174144 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5439487 time 0.32384 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5570559 time 0.12608 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5636095 time 0.110144 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5701631 time 0.13824 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5767167 time 0.794656 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5832703 time 0.10784 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5898239 time 0.108544 [09/29/2020-17:41:55] [V] [TRT] Tactic: 6029311 time 0.134848 [09/29/2020-17:41:55] [V] [TRT] Tactic: 6225919 time 0.120832 [09/29/2020-17:41:55] [V] [TRT] Tactic: 6291455 time 0.114688 [09/29/2020-17:41:55] [V] [TRT] Tactic: 6422527 time 0.118688 [09/29/2020-17:41:55] [V] [TRT] Tactic: 6750207 time 0.205024 [09/29/2020-17:41:55] [V] [TRT] Tactic: 6815743 time 0.1856 [09/29/2020-17:41:55] [V] [TRT] Tactic: 6946815 time 0.307232 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7012351 time 0.16384 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7077887 time 0.106752 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7143423 time 0.315648 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7208959 time 0.12688 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7340031 time 0.114944 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7405567 time 0.119904 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7536639 time 0.206848 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7602175 time 0.174336 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7733247 time 0.1088 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7798783 time 0.176992 [09/29/2020-17:41:55] [V] [TRT] Tactic: 8191999 time 0.22528 [09/29/2020-17:41:55] [V] [TRT] Tactic: 8257535 time 0.176384 [09/29/2020-17:41:55] [V] [TRT] Tactic: 8323071 time 0.213824 [09/29/2020-17:41:55] [V] [TRT] Tactic: 8650751 time 0.213376 [09/29/2020-17:41:55] [V] [TRT] Tactic: 8716287 time 0.18176 [09/29/2020-17:41:55] [V] [TRT] Tactic: 9109503 time 0.179872 [09/29/2020-17:41:55] [V] [TRT] Tactic: 9568255 time 0.160608 [09/29/2020-17:41:55] [V] [TRT] Tactic: 9895935 time 0.169824 [09/29/2020-17:41:55] [V] [TRT] Tactic: 10223615 time 0.135296 [09/29/2020-17:41:55] [V] [TRT] Tactic: 10354687 time 0.147712 [09/29/2020-17:41:55] [V] [TRT] Tactic: 10551295 time 0.206272 [09/29/2020-17:41:55] [V] [TRT] Tactic: 10747903 time 0.1024 [09/29/2020-17:41:55] [V] [TRT] Tactic: 10944511 time 0.164096 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: 10747903 Time: 0.1024 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (CaskConvolution) [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1754569683116234317 time 0.072416 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1825138533642645384 time 0.073696 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 2733356012094739613 time 0.085664 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 3915320020053085238 time 0.071936 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 6808617066150061604 time 0.080128 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 9091006216302412844 time 0.075776 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -8060443123034038864 time 0.081824 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -4420849921117327522 time 0.077312 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -3946921629105938337 time 0.089696 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: 3915320020053085238 Time: 0.071936 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (CudaConvolution) [09/29/2020-17:41:55] [V] [TRT] Tactic: 0 time 0.128512 [09/29/2020-17:41:55] [V] [TRT] Tactic: 2 time 0.230976 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5 time 0.247808 [09/29/2020-17:41:55] [V] [TRT] Tactic: 57 time 0.089408 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: 57 Time: 0.089408 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3915320020053085238 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1835008) -> Half(1,64,4096,524288) *************** [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:55] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (CaskConvolution) [09/29/2020-17:41:55] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (CudaConvolution) [09/29/2020-17:41:55] [V] [TRT] Tactic: 0 time 0.137216 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1 time 0.13952 [09/29/2020-17:41:55] [V] [TRT] Tactic: 2 time 0.219136 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4 time 10.3481 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5 time 0.243232 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: 0 Time: 0.137216 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0 [09/29/2020-17:41:55] [V] [TRT] [09/29/2020-17:41:55] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,917504) -> Half(1,64,4096,524288) *************** [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:55] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (CaskConvolution) [09/29/2020-17:41:55] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (CudaConvolution) [09/29/2020-17:41:55] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:55] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,917504) -> Half(1,64,4096:2,262144) *************** [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:55] [V] [TRT] Tactic: 589823 time 0.104704 [09/29/2020-17:41:55] [V] [TRT] Tactic: 655359 time 0.07104 [09/29/2020-17:41:55] [V] [TRT] Tactic: 786431 time 0.095776 [09/29/2020-17:41:55] [V] [TRT] Tactic: 851967 time 0.061696 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1179647 time 0.063264 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1310719 time 0.07664 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1376255 time 0.071648 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1441791 time 0.073728 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1507327 time 0.059648 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1638399 time 0.089792 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1835007 time 0.100224 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1900543 time 0.073728 [09/29/2020-17:41:55] [V] [TRT] Tactic: 2097151 time 0.091488 [09/29/2020-17:41:55] [V] [TRT] Tactic: 2162687 time 0.071936 [09/29/2020-17:41:55] [V] [TRT] Tactic: 2293759 time 0.069632 [09/29/2020-17:41:55] [V] [TRT] Tactic: 2359295 time 0.056704 [09/29/2020-17:41:55] [V] [TRT] Tactic: 2686975 time 0.070784 [09/29/2020-17:41:55] [V] [TRT] Tactic: 3080191 time 0.065536 [09/29/2020-17:41:55] [V] [TRT] Tactic: 3342335 time 0.064512 [09/29/2020-17:41:55] [V] [TRT] Tactic: 3407871 time 0.068448 [09/29/2020-17:41:55] [V] [TRT] Tactic: 3538943 time 0.061088 [09/29/2020-17:41:55] [V] [TRT] Tactic: 3670015 time 0.11264 [09/29/2020-17:41:55] [V] [TRT] Tactic: 3932159 time 0.065536 [09/29/2020-17:41:55] [V] [TRT] Tactic: 3997695 time 0.092416 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4063231 time 0.06144 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4194303 time 0.090368 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4259839 time 0.080032 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4325375 time 0.0856 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4521983 time 0.089376 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4587519 time 0.089888 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4653055 time 0.062752 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4915199 time 0.086272 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4980735 time 0.084224 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5177343 time 0.073696 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5242879 time 0.069856 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5373951 time 0.092416 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5439487 time 0.165888 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5570559 time 0.065376 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5636095 time 0.061408 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5701631 time 0.069632 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5767167 time 0.39936 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5832703 time 0.055552 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5898239 time 0.059104 [09/29/2020-17:41:55] [V] [TRT] Tactic: 6029311 time 0.069568 [09/29/2020-17:41:55] [V] [TRT] Tactic: 6225919 time 0.063744 [09/29/2020-17:41:55] [V] [TRT] Tactic: 6291455 time 0.061728 [09/29/2020-17:41:55] [V] [TRT] Tactic: 6422527 time 0.063488 [09/29/2020-17:41:55] [V] [TRT] Tactic: 6750207 time 0.106752 [09/29/2020-17:41:55] [V] [TRT] Tactic: 6815743 time 0.09952 [09/29/2020-17:41:55] [V] [TRT] Tactic: 6946815 time 0.153632 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7012351 time 0.090368 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7077887 time 0.056512 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7143423 time 0.159744 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7208959 time 0.065632 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7340031 time 0.06144 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7405567 time 0.06736 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7536639 time 0.10576 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7602175 time 0.09216 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7733247 time 0.05776 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7798783 time 0.094464 [09/29/2020-17:41:55] [V] [TRT] Tactic: 8191999 time 0.117024 [09/29/2020-17:41:55] [V] [TRT] Tactic: 8257535 time 0.094208 [09/29/2020-17:41:55] [V] [TRT] Tactic: 8323071 time 0.110592 [09/29/2020-17:41:55] [V] [TRT] Tactic: 8650751 time 0.111808 [09/29/2020-17:41:55] [V] [TRT] Tactic: 8716287 time 0.094464 [09/29/2020-17:41:55] [V] [TRT] Tactic: 9109503 time 0.09856 [09/29/2020-17:41:55] [V] [TRT] Tactic: 9568255 time 0.086272 [09/29/2020-17:41:55] [V] [TRT] Tactic: 9895935 time 0.092032 [09/29/2020-17:41:55] [V] [TRT] Tactic: 10223615 time 0.069888 [09/29/2020-17:41:55] [V] [TRT] Tactic: 10354687 time 0.081696 [09/29/2020-17:41:55] [V] [TRT] Tactic: 10551295 time 0.106496 [09/29/2020-17:41:55] [V] [TRT] Tactic: 10747903 time 0.054624 [09/29/2020-17:41:55] [V] [TRT] Tactic: 10944511 time 0.085888 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: 10747903 Time: 0.054624 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (CaskConvolution) [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1651411198763708804 time 0.041888 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 2418518597804310654 time 0.042592 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4318470497547290900 time 0.04096 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4930470141256631146 time 0.044768 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 8292881859266835088 time 0.04464 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 8401509141903434922 time 0.041568 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -8654297089785671176 time 0.040704 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -7516584506774355935 time 0.041376 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -7140760933967189247 time 0.041824 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -6004726995029373073 time 0.043264 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -5719726816705110014 time 0.039904 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -4097850214384059472 time 0.042752 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -3717489476759089008 time 0.041216 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -3689982367035295496 time 0.039776 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -2640575123064142123 time 0.039552 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -2534402059426524406 time 0.040288 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -2027588946874785071 time 0.043264 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -1968398013367819764 time 0.04096 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: -2640575123064142123 Time: 0.039552 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (CudaConvolution) [09/29/2020-17:41:55] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2640575123064142123 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:55] [V] [TRT] *************** Autotuning format combination: Half(56,3584,1:8,229376) -> Float(1,64,4096,524288) *************** [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:55] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (CaskConvolution) [09/29/2020-17:41:55] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (CudaConvolution) [09/29/2020-17:41:55] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:55] [V] [TRT] *************** Autotuning format combination: Half(56,3584,1:8,229376) -> Half(16,1024,1:8,65536) *************** [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:55] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (CaskConvolution) [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:55] [V] [TRT] Tactic: 9576651994278528 time 0.02544 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1179757074518529353 time 0.022784 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 2105695814191699972 time 0.029568 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 2148106709480872763 time 0.026336 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 2410442691266548717 time 0.028864 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 3041642431972138763 time 0.019936 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 3754069740140581927 time 0.0304 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 4555462412611657028 time 0.024576 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5666160310350604399 time 0.02896 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:55] [V] [TRT] Tactic: 5876997871499382316 time 0.034016 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 5925270497649423688 time 0.042816 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 6680916730816870145 time 0.02992 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7158029511300006471 time 0.03056 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 7859952145590271433 time 0.028928 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: 8283847742354150423 time 0.03072 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -8992262742606384444 time 0.026496 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -8391760416076885205 time 0.043008 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -6273232454637933930 time 0.023104 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:55] [V] [TRT] Tactic: -5925110308892264213 time 0.032768 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -5818527483287834165 time 0.023648 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:55] [V] [TRT] Tactic: -4908848143422991657 time 0.02688 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -4534876761957424274 time 0.043136 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -3237051169894153788 time 0.03024 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -3136088851200285532 time 0.02048 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -2586046817576862066 time 0.028672 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -2422160065350346448 time 0.028928 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -1216445540764179377 time 0.028672 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] Tactic: -229563042944049199 time 0.020736 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: 3041642431972138763 Time: 0.019936 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (CudaConvolution) [09/29/2020-17:41:55] [V] [TRT] Tactic: 0 time 0.155904 [09/29/2020-17:41:55] [V] [TRT] Tactic: 1 time 0.113888 [09/29/2020-17:41:55] [V] [TRT] Tactic: 2 time 0.212992 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: 1 Time: 0.113888 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3041642431972138763 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:55] [V] [TRT] Tactic: 1002 time 0.016384 [09/29/2020-17:41:55] [V] [TRT] Tactic: 0 time 0.030496 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.016384 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:55] [V] [TRT] Tactic: 1002 time 0.016288 [09/29/2020-17:41:55] [V] [TRT] Tactic: 0 time 0.030688 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.016288 [09/29/2020-17:41:55] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:55] [V] [TRT] Tactic: 1002 time 0.0152 [09/29/2020-17:41:55] [V] [TRT] Tactic: 0 time 0.030592 [09/29/2020-17:41:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.0152 [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:56] [V] [TRT] Tactic: 1002 time 0.020736 [09/29/2020-17:41:56] [V] [TRT] Tactic: 0 time 0.038752 [09/29/2020-17:41:56] [V] [TRT] Fastest Tactic: 1002 Time: 0.020736 [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:56] [V] [TRT] Tactic: 1002 time 0.02448 [09/29/2020-17:41:56] [V] [TRT] Tactic: 0 time 0.019296 [09/29/2020-17:41:56] [V] [TRT] Fastest Tactic: 0 Time: 0.019296 [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:56] [V] [TRT] Tactic: 1002 time 0.024576 [09/29/2020-17:41:56] [V] [TRT] Tactic: 0 time 0.018688 [09/29/2020-17:41:56] [V] [TRT] Fastest Tactic: 0 Time: 0.018688 [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:56] [V] [TRT] Tactic: 1002 time 0.028672 [09/29/2020-17:41:56] [V] [TRT] Tactic: 0 time 0.019872 [09/29/2020-17:41:56] [V] [TRT] Fastest Tactic: 0 Time: 0.019872 [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:56] [V] [TRT] Tactic: 1002 time 0.022272 [09/29/2020-17:41:56] [V] [TRT] Tactic: 0 time 0.014336 [09/29/2020-17:41:56] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [09/29/2020-17:41:56] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,32,1024,262144) *************** [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:56] [V] [TRT] Tactic: 458751 time 0.123136 [09/29/2020-17:41:56] [V] [TRT] Fastest Tactic: 458751 Time: 0.123136 [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (CaskConvolution) [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 1825138533642645384 time 0.169984 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 2842488832350522458 time 0.11264 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 3915320020053085238 time 0.167424 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 6448355332020552203 time 0.171808 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 6808617066150061604 time 0.104448 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -8060443123034038864 time 0.11328 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -4420849921117327522 time 0.127232 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -3946921629105938337 time 0.194016 [09/29/2020-17:41:56] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.104448 [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (CudaConvolution) [09/29/2020-17:41:56] [V] [TRT] Tactic: 0 time 0.17552 [09/29/2020-17:41:56] [V] [TRT] Tactic: 2 time 0.206272 [09/29/2020-17:41:56] [V] [TRT] Tactic: 5 time 3.74893 [09/29/2020-17:41:56] [V] [TRT] Tactic: 57 time 0.135264 [09/29/2020-17:41:56] [V] [TRT] Fastest Tactic: 57 Time: 0.135264 [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6808617066150061604 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,524288) -> Half(1,32,1024,262144) *************** [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:56] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (CaskConvolution) [09/29/2020-17:41:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (CudaConvolution) [09/29/2020-17:41:56] [V] [TRT] Tactic: 0 time 0.176384 [09/29/2020-17:41:56] [V] [TRT] Tactic: 1 time 0.124928 [09/29/2020-17:41:56] [V] [TRT] Tactic: 2 time 0.2024 [09/29/2020-17:41:56] [V] [TRT] Tactic: 5 time 3.73328 [09/29/2020-17:41:56] [V] [TRT] Fastest Tactic: 1 Time: 0.124928 [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [09/29/2020-17:41:56] [V] [TRT] [09/29/2020-17:41:56] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,262144) -> Half(1,32,1024:2,131072) *************** [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:56] [V] [TRT] Tactic: 458751 time 0.064672 [09/29/2020-17:41:56] [V] [TRT] Fastest Tactic: 458751 Time: 0.064672 [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (CaskConvolution) [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 1145226902788474763 time 0.061696 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 1651411198763708804 time 0.060256 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 2418518597804310654 time 0.059648 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 4318470497547290900 time 0.055584 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 4653005425971292725 time 0.061696 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 4930470141256631146 time 0.068448 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 8292881859266835088 time 0.069024 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 8401509141903434922 time 0.055552 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -8654297089785671176 time 0.088064 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -7448936905981214224 time 0.07376 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -6004726995029373073 time 0.063584 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -5719726816705110014 time 0.088064 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -3754890472406891741 time 0.090368 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -3689982367035295496 time 0.08832 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -2894005464278291378 time 0.073728 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -2027588946874785071 time 0.061696 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -1968398013367819764 time 0.08832 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -245090590808296743 time 0.090368 [09/29/2020-17:41:56] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 0.055552 [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (CudaConvolution) [09/29/2020-17:41:56] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8401509141903434922 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:56] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536) -> Float(1,32,1024,262144) *************** [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:56] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (CaskConvolution) [09/29/2020-17:41:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (CudaConvolution) [09/29/2020-17:41:56] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:56] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536) -> Half(32,1024,1:8,32768) *************** [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:56] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (CaskConvolution) [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:56] [V] [TRT] Tactic: 130343752241278875 time 0.030496 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 2148106709480872763 time 0.034208 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 2410442691266548717 time 0.04944 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:56] [V] [TRT] Tactic: 2921824978225832523 time 0.028 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:56] [V] [TRT] Tactic: 3030711443478140260 time 0.034528 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 3754069740140581927 time 0.0512 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 3823144360994712832 time 0.03104 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 5635311898703673455 time 0.030976 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 5925270497649423688 time 0.08688 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 6680916730816870145 time 0.049408 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 7158029511300006471 time 0.048 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 7859952145590271433 time 0.050688 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: 8283847742354150423 time 0.051584 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -8992262742606384444 time 0.035072 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -8682550625095202832 time 0.035104 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:56] [V] [TRT] Tactic: -8379842433586149932 time 0.0344 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:56] [V] [TRT] Tactic: -6352769237623756264 time 0.03616 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -6273232454637933930 time 0.030976 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -5818527483287834165 time 0.03072 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -4954692664176521434 time 0.050016 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:56] [V] [TRT] Tactic: -4953888146171240997 time 0.02688 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -4534876761957424274 time 0.087584 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -3237051169894153788 time 0.048416 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -3136088851200285532 time 0.028928 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -2586046817576862066 time 0.049408 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] Tactic: -229563042944049199 time 0.030912 [09/29/2020-17:41:56] [V] [TRT] Fastest Tactic: -4953888146171240997 Time: 0.02688 [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (CudaConvolution) [09/29/2020-17:41:56] [V] [TRT] Tactic: 0 time 0.238944 [09/29/2020-17:41:56] [V] [TRT] Tactic: 1 time 0.259328 [09/29/2020-17:41:56] [V] [TRT] Tactic: 2 time 0.263296 [09/29/2020-17:41:56] [V] [TRT] Fastest Tactic: 0 Time: 0.238944 [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4953888146171240997 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:56] [V] [TRT] [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:56] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:56] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,32,1024,131072) *************** [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 71) [Pooling] (Pooling) [09/29/2020-17:41:56] [V] [TRT] Tactic: -1 time 0.00784 [09/29/2020-17:41:56] [V] [TRT] Fastest Tactic: -1 Time: 0.00784 [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 71) [Pooling] (TiledPooling) [09/29/2020-17:41:56] [V] [TRT] Tactic: 5505281 time 0.01024 [09/29/2020-17:41:56] [V] [TRT] Tactic: 5570817 time 0.010272 [09/29/2020-17:41:56] [V] [TRT] Tactic: 5636353 time 0.007424 [09/29/2020-17:41:56] [V] [TRT] Tactic: 5701889 time 0.0064 [09/29/2020-17:41:56] [V] [TRT] Tactic: 5767425 time 0.0064 [09/29/2020-17:41:56] [V] [TRT] Tactic: 5832961 time 0.0064 [09/29/2020-17:41:56] [V] [TRT] Tactic: 5898497 time 0.0064 [09/29/2020-17:41:56] [V] [TRT] Tactic: 5964033 time 0.012256 [09/29/2020-17:41:56] [V] [TRT] Tactic: 6029569 time 0.01008 [09/29/2020-17:41:56] [V] [TRT] Tactic: 6095105 time 0.007968 [09/29/2020-17:41:56] [V] [TRT] Tactic: 6160641 time 0.0064 [09/29/2020-17:41:56] [V] [TRT] Tactic: 6226177 time 0.0064 [09/29/2020-17:41:56] [V] [TRT] Tactic: 6291713 time 0.0064 [09/29/2020-17:41:56] [V] [TRT] Tactic: 6357249 time 0.0064 [09/29/2020-17:41:56] [V] [TRT] Tactic: 6422785 time 0.007744 [09/29/2020-17:41:56] [V] [TRT] Tactic: 6488321 time 0.0064 [09/29/2020-17:41:56] [V] [TRT] Fastest Tactic: 5701889 Time: 0.0064 [09/29/2020-17:41:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 5701889 [09/29/2020-17:41:56] [V] [TRT] [09/29/2020-17:41:56] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,524288) -> Half(1,32,1024,131072) *************** [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 71) [Pooling] (Pooling) [09/29/2020-17:41:56] [V] [TRT] Tactic: -1 time 0.00752 [09/29/2020-17:41:56] [V] [TRT] Fastest Tactic: -1 Time: 0.00752 [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 71) [Pooling] (TiledPooling) [09/29/2020-17:41:56] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [09/29/2020-17:41:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -1 [09/29/2020-17:41:56] [V] [TRT] [09/29/2020-17:41:56] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,262144) -> Half(1,32,1024:2,65536) *************** [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 71) [Pooling] (Pooling) [09/29/2020-17:41:56] [V] [TRT] Tactic: -3 time 0.007008 [09/29/2020-17:41:56] [V] [TRT] Fastest Tactic: -3 Time: 0.007008 [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 71) [Pooling] (TiledPooling) [09/29/2020-17:41:56] [V] [TRT] Tactic: 5505281 time 0.007008 [09/29/2020-17:41:56] [V] [TRT] Tactic: 5570817 time 0.006144 [09/29/2020-17:41:56] [V] [TRT] Tactic: 5636353 time 0.006336 [09/29/2020-17:41:56] [V] [TRT] Tactic: 5701889 time 0.005408 [09/29/2020-17:41:56] [V] [TRT] Tactic: 5767425 time 0.006144 [09/29/2020-17:41:56] [V] [TRT] Tactic: 5832961 time 0.006144 [09/29/2020-17:41:56] [V] [TRT] Tactic: 5898497 time 0.006272 [09/29/2020-17:41:56] [V] [TRT] Tactic: 5964033 time 0.006048 [09/29/2020-17:41:56] [V] [TRT] Tactic: 6029569 time 0.008192 [09/29/2020-17:41:56] [V] [TRT] Tactic: 6095105 time 0.0064 [09/29/2020-17:41:56] [V] [TRT] Tactic: 6160641 time 0.006144 [09/29/2020-17:41:56] [V] [TRT] Tactic: 6226177 time 0.006144 [09/29/2020-17:41:56] [V] [TRT] Tactic: 6291713 time 0.006144 [09/29/2020-17:41:56] [V] [TRT] Tactic: 6357249 time 0.006144 [09/29/2020-17:41:56] [V] [TRT] Tactic: 6422785 time 0.00592 [09/29/2020-17:41:56] [V] [TRT] Tactic: 6488321 time 0.006016 [09/29/2020-17:41:56] [V] [TRT] Fastest Tactic: 5701889 Time: 0.005408 [09/29/2020-17:41:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 5701889 [09/29/2020-17:41:56] [V] [TRT] [09/29/2020-17:41:56] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536) -> Half(16,512,1:8,16384) *************** [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 71) [Pooling] (Pooling) [09/29/2020-17:41:56] [V] [TRT] Tactic: -2 time 0.004992 [09/29/2020-17:41:56] [V] [TRT] Fastest Tactic: -2 Time: 0.004992 [09/29/2020-17:41:56] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 71) [Pooling] (TiledPooling) [09/29/2020-17:41:56] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [09/29/2020-17:41:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -2 [09/29/2020-17:41:56] [V] [TRT] [09/29/2020-17:41:57] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,32,1024,917504) *************** [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 70) [Pooling] (Pooling) [09/29/2020-17:41:57] [V] [TRT] Tactic: -1 time 0.012256 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: -1 Time: 0.012256 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 70) [Pooling] (TiledPooling) [09/29/2020-17:41:57] [V] [TRT] Tactic: 5505281 time 0.012128 [09/29/2020-17:41:57] [V] [TRT] Tactic: 5570817 time 0.012608 [09/29/2020-17:41:57] [V] [TRT] Tactic: 5636353 time 0.01168 [09/29/2020-17:41:57] [V] [TRT] Tactic: 5701889 time 0.0064 [09/29/2020-17:41:57] [V] [TRT] Tactic: 5767425 time 0.0064 [09/29/2020-17:41:57] [V] [TRT] Tactic: 5832961 time 0.007872 [09/29/2020-17:41:57] [V] [TRT] Tactic: 5898497 time 0.0064 [09/29/2020-17:41:57] [V] [TRT] Tactic: 5964033 time 0.006432 [09/29/2020-17:41:57] [V] [TRT] Tactic: 6029569 time 0.009824 [09/29/2020-17:41:57] [V] [TRT] Tactic: 6095105 time 0.008 [09/29/2020-17:41:57] [V] [TRT] Tactic: 6160641 time 0.006432 [09/29/2020-17:41:57] [V] [TRT] Tactic: 6226177 time 0.0064 [09/29/2020-17:41:57] [V] [TRT] Tactic: 6291713 time 0.00784 [09/29/2020-17:41:57] [V] [TRT] Tactic: 6357249 time 0.0064 [09/29/2020-17:41:57] [V] [TRT] Tactic: 6422785 time 0.0064 [09/29/2020-17:41:57] [V] [TRT] Tactic: 6488321 time 0.0064 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 5701889 Time: 0.0064 [09/29/2020-17:41:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 5701889 [09/29/2020-17:41:57] [V] [TRT] [09/29/2020-17:41:57] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,524288) -> Half(1,32,1024,917504) *************** [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 70) [Pooling] (Pooling) [09/29/2020-17:41:57] [V] [TRT] Tactic: -1 time 0.00752 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: -1 Time: 0.00752 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 70) [Pooling] (TiledPooling) [09/29/2020-17:41:57] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [09/29/2020-17:41:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -1 [09/29/2020-17:41:57] [V] [TRT] [09/29/2020-17:41:57] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,262144) -> Half(1,32,1024:2,458752) *************** [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 70) [Pooling] (Pooling) [09/29/2020-17:41:57] [V] [TRT] Tactic: -3 time 0.0064 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: -3 Time: 0.0064 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 70) [Pooling] (TiledPooling) [09/29/2020-17:41:57] [V] [TRT] Tactic: 5505281 time 0.007776 [09/29/2020-17:41:57] [V] [TRT] Tactic: 5570817 time 0.0064 [09/29/2020-17:41:57] [V] [TRT] Tactic: 5636353 time 0.006144 [09/29/2020-17:41:57] [V] [TRT] Tactic: 5701889 time 0.0064 [09/29/2020-17:41:57] [V] [TRT] Tactic: 5767425 time 0.006432 [09/29/2020-17:41:57] [V] [TRT] Tactic: 5832961 time 0.006144 [09/29/2020-17:41:57] [V] [TRT] Tactic: 5898497 time 0.006144 [09/29/2020-17:41:57] [V] [TRT] Tactic: 5964033 time 0.006016 [09/29/2020-17:41:57] [V] [TRT] Tactic: 6029569 time 0.007008 [09/29/2020-17:41:57] [V] [TRT] Tactic: 6095105 time 0.0064 [09/29/2020-17:41:57] [V] [TRT] Tactic: 6160641 time 0.006144 [09/29/2020-17:41:57] [V] [TRT] Tactic: 6226177 time 0.006144 [09/29/2020-17:41:57] [V] [TRT] Tactic: 6291713 time 0.006144 [09/29/2020-17:41:57] [V] [TRT] Tactic: 6357249 time 0.006144 [09/29/2020-17:41:57] [V] [TRT] Tactic: 6422785 time 0.006144 [09/29/2020-17:41:57] [V] [TRT] Tactic: 6488321 time 0.006144 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 5964033 Time: 0.006016 [09/29/2020-17:41:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 5964033 [09/29/2020-17:41:57] [V] [TRT] [09/29/2020-17:41:57] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536) -> Half(112,3584,1:8,114688) *************** [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 70) [Pooling] (Pooling) [09/29/2020-17:41:57] [V] [TRT] Tactic: -2 time 0.005024 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: -2 Time: 0.005024 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 70) [Pooling] (TiledPooling) [09/29/2020-17:41:57] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [09/29/2020-17:41:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -2 [09/29/2020-17:41:57] [V] [TRT] [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.006976 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.006048 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 0 Time: 0.006048 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.008 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.006016 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 0 Time: 0.006016 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.007296 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.00624 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00624 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.006016 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 0 Time: 0.006016 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.008064 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.005888 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 0 Time: 0.005888 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.010336 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.010528 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.007072 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 0 Time: 0.007072 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.008192 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.004288 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004288 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.008192 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.008064 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 0 Time: 0.008064 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.008192 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.01264 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.005696 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 0 Time: 0.005696 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.0064 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.0064 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.013408 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.007104 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 0 Time: 0.007104 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.012544 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.007008 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 0 Time: 0.007008 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.007712 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.007712 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.014592 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.006272 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 0 Time: 0.006272 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.011776 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.014336 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.015456 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:57] [V] [TRT] Tactic: 1002 time 0.018208 [09/29/2020-17:41:57] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:41:57] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [09/29/2020-17:41:57] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:57] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:57] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:57] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:57] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:57] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:57] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:57] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:57] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 77) [Convolution] (FusedConvActConvolution) [09/29/2020-17:41:57] [V] [TRT] Tactic: 524287 time 0.196448 [09/29/2020-17:41:57] [V] [TRT] Tactic: 720895 time 0.19184 [09/29/2020-17:41:57] [V] [TRT] Tactic: 983039 time 0.169984 [09/29/2020-17:41:57] [V] [TRT] Tactic: 1048575 time 0.192512 [09/29/2020-17:41:57] [V] [TRT] Tactic: 1703935 time 0.155136 [09/29/2020-17:41:57] [V] [TRT] Tactic: 1769471 time 0.2048 [09/29/2020-17:41:57] [V] [TRT] Tactic: 1966079 time 0.262208 [09/29/2020-17:41:57] [V] [TRT] Tactic: 2031615 time 0.31696 [09/29/2020-17:41:57] [V] [TRT] Tactic: 2228223 time 0.2168 [09/29/2020-17:41:57] [V] [TRT] Tactic: 2424831 time 0.172032 [09/29/2020-17:41:57] [V] [TRT] Tactic: 2621439 time 0.15216 [09/29/2020-17:41:57] [V] [TRT] Tactic: 2752511 time 0.223488 [09/29/2020-17:41:57] [V] [TRT] Tactic: 2818047 time 0.209408 [09/29/2020-17:41:57] [V] [TRT] Tactic: 2883583 time 0.304832 [09/29/2020-17:41:57] [V] [TRT] Tactic: 3014655 time 0.168192 [09/29/2020-17:41:57] [V] [TRT] Tactic: 3145727 time 0.20224 [09/29/2020-17:41:57] [V] [TRT] Tactic: 3473407 time 0.243968 [09/29/2020-17:41:57] [V] [TRT] Tactic: 3604479 time 0.166144 [09/29/2020-17:41:57] [V] [TRT] Tactic: 3735551 time 0.195232 [09/29/2020-17:41:57] [V] [TRT] Tactic: 4390911 time 0.271808 [09/29/2020-17:41:57] [V] [TRT] Tactic: 5046271 time 0.184576 [09/29/2020-17:41:57] [V] [TRT] Tactic: 5963775 time 0.244544 [09/29/2020-17:41:57] [V] [TRT] Tactic: 6160383 time 0.20112 [09/29/2020-17:41:57] [V] [TRT] Tactic: 6488063 time 0.224128 [09/29/2020-17:41:57] [V] [TRT] Tactic: 6881279 time 0.279488 [09/29/2020-17:41:57] [V] [TRT] Tactic: 7274495 time 0.155936 [09/29/2020-17:41:57] [V] [TRT] Tactic: 7864319 time 0.186368 [09/29/2020-17:41:57] [V] [TRT] Tactic: 7995391 time 0.200896 [09/29/2020-17:41:57] [V] [TRT] Tactic: 8585215 time 0.239008 [09/29/2020-17:41:57] [V] [TRT] Tactic: 8847359 time 0.190176 [09/29/2020-17:41:57] [V] [TRT] Tactic: 8978431 time 0.237792 [09/29/2020-17:41:57] [V] [TRT] Tactic: 9043967 time 0.180224 [09/29/2020-17:41:57] [V] [TRT] Tactic: 9175039 time 0.166144 [09/29/2020-17:41:57] [V] [TRT] Tactic: 9502719 time 0.272384 [09/29/2020-17:41:57] [V] [TRT] Tactic: 9830399 time 0.184576 [09/29/2020-17:41:57] [V] [TRT] Tactic: 9961471 time 0.169984 [09/29/2020-17:41:57] [V] [TRT] Tactic: 10027007 time 0.214336 [09/29/2020-17:41:57] [V] [TRT] Tactic: 10092543 time 0.278784 [09/29/2020-17:41:57] [V] [TRT] Tactic: 10289151 time 0.255744 [09/29/2020-17:41:57] [V] [TRT] Tactic: 10485759 time 0.180256 [09/29/2020-17:41:57] [V] [TRT] Tactic: 10682367 time 0.151552 [09/29/2020-17:41:57] [V] [TRT] Tactic: 10813439 time 0.149312 [09/29/2020-17:41:57] [V] [TRT] Fastest Tactic: 10813439 Time: 0.149312 [09/29/2020-17:41:57] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 77) [Convolution] (CaskConvolution) [09/29/2020-17:41:57] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:57] [V] [TRT] Tactic: 1825138533642645384 time 0.333824 [09/29/2020-17:41:57] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:57] [V] [TRT] Tactic: 2775507031594384867 time 0.112224 [09/29/2020-17:41:57] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:57] [V] [TRT] Tactic: 2842488832350522458 time 0.216992 [09/29/2020-17:41:57] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:57] [V] [TRT] Tactic: 3915320020053085238 time 0.323264 [09/29/2020-17:41:57] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:57] [V] [TRT] Tactic: 6448355332020552203 time 0.33408 [09/29/2020-17:41:57] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:57] [V] [TRT] Tactic: 6808617066150061604 time 0.20096 [09/29/2020-17:41:57] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:57] [V] [TRT] Tactic: -8060443123034038864 time 0.225568 [09/29/2020-17:41:57] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:57] [V] [TRT] Tactic: -4420849921117327522 time 0.247424 [09/29/2020-17:41:57] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -3946921629105938337 time 0.375936 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.112224 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 77) [Convolution] (CudaConvolution) [09/29/2020-17:41:58] [V] [TRT] Tactic: 0 time 0.34592 [09/29/2020-17:41:58] [V] [TRT] Tactic: 2 time 0.33552 [09/29/2020-17:41:58] [V] [TRT] Tactic: 5 time 3.7073 [09/29/2020-17:41:58] [V] [TRT] Tactic: 6 time 0.131072 [09/29/2020-17:41:58] [V] [TRT] Tactic: 57 time 0.205568 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 6 Time: 0.131072 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 77) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:41:58] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:58] [V] [TRT] [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:58] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144) -> Half(1,32,1024,262144) *************** [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 77) [Convolution] (FusedConvActConvolution) [09/29/2020-17:41:58] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 77) [Convolution] (CaskConvolution) [09/29/2020-17:41:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 77) [Convolution] (CudaConvolution) [09/29/2020-17:41:58] [V] [TRT] Tactic: 0 time 0.359264 [09/29/2020-17:41:58] [V] [TRT] Tactic: 1 time 0.20496 [09/29/2020-17:41:58] [V] [TRT] Tactic: 2 time 0.33136 [09/29/2020-17:41:58] [V] [TRT] Tactic: 4 time 12.7222 [09/29/2020-17:41:58] [V] [TRT] Tactic: 5 time 3.66218 [09/29/2020-17:41:58] [V] [TRT] Tactic: 6 time 0.168448 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 6 Time: 0.168448 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 77) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:41:58] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [09/29/2020-17:41:58] [V] [TRT] [09/29/2020-17:41:58] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072) -> Half(1,32,1024:2,131072) *************** [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 77) [Convolution] (FusedConvActConvolution) [09/29/2020-17:41:58] [V] [TRT] Tactic: 524287 time 0.104448 [09/29/2020-17:41:58] [V] [TRT] Tactic: 720895 time 0.132768 [09/29/2020-17:41:58] [V] [TRT] Tactic: 983039 time 0.086272 [09/29/2020-17:41:58] [V] [TRT] Tactic: 1048575 time 0.096512 [09/29/2020-17:41:58] [V] [TRT] Tactic: 1703935 time 0.080128 [09/29/2020-17:41:58] [V] [TRT] Tactic: 1769471 time 0.109952 [09/29/2020-17:41:58] [V] [TRT] Tactic: 1966079 time 0.122112 [09/29/2020-17:41:58] [V] [TRT] Tactic: 2031615 time 0.158592 [09/29/2020-17:41:58] [V] [TRT] Tactic: 2228223 time 0.110272 [09/29/2020-17:41:58] [V] [TRT] Tactic: 2424831 time 0.091872 [09/29/2020-17:41:58] [V] [TRT] Tactic: 2621439 time 0.080128 [09/29/2020-17:41:58] [V] [TRT] Tactic: 2752511 time 0.11024 [09/29/2020-17:41:58] [V] [TRT] Tactic: 2818047 time 0.106336 [09/29/2020-17:41:58] [V] [TRT] Tactic: 2883583 time 0.140672 [09/29/2020-17:41:58] [V] [TRT] Tactic: 3014655 time 0.088064 [09/29/2020-17:41:58] [V] [TRT] Tactic: 3145727 time 0.102464 [09/29/2020-17:41:58] [V] [TRT] Tactic: 3473407 time 0.121088 [09/29/2020-17:41:58] [V] [TRT] Tactic: 3604479 time 0.086656 [09/29/2020-17:41:58] [V] [TRT] Tactic: 3735551 time 0.098144 [09/29/2020-17:41:58] [V] [TRT] Tactic: 4390911 time 0.126976 [09/29/2020-17:41:58] [V] [TRT] Tactic: 5046271 time 0.094464 [09/29/2020-17:41:58] [V] [TRT] Tactic: 5963775 time 0.1088 [09/29/2020-17:41:58] [V] [TRT] Tactic: 6160383 time 0.094208 [09/29/2020-17:41:58] [V] [TRT] Tactic: 6488063 time 0.115968 [09/29/2020-17:41:58] [V] [TRT] Tactic: 6881279 time 0.139264 [09/29/2020-17:41:58] [V] [TRT] Tactic: 7274495 time 0.081344 [09/29/2020-17:41:58] [V] [TRT] Tactic: 7864319 time 0.099008 [09/29/2020-17:41:58] [V] [TRT] Tactic: 7995391 time 0.102176 [09/29/2020-17:41:58] [V] [TRT] Tactic: 8585215 time 0.121088 [09/29/2020-17:41:58] [V] [TRT] Tactic: 8847359 time 0.102048 [09/29/2020-17:41:58] [V] [TRT] Tactic: 8978431 time 0.110592 [09/29/2020-17:41:58] [V] [TRT] Tactic: 9043967 time 0.094464 [09/29/2020-17:41:58] [V] [TRT] Tactic: 9175039 time 0.086912 [09/29/2020-17:41:58] [V] [TRT] Tactic: 9502719 time 0.1432 [09/29/2020-17:41:58] [V] [TRT] Tactic: 9830399 time 0.093728 [09/29/2020-17:41:58] [V] [TRT] Tactic: 9961471 time 0.09216 [09/29/2020-17:41:58] [V] [TRT] Tactic: 10027007 time 0.10912 [09/29/2020-17:41:58] [V] [TRT] Tactic: 10092543 time 0.127232 [09/29/2020-17:41:58] [V] [TRT] Tactic: 10289151 time 0.122112 [09/29/2020-17:41:58] [V] [TRT] Tactic: 10485759 time 0.094208 [09/29/2020-17:41:58] [V] [TRT] Tactic: 10682367 time 0.080128 [09/29/2020-17:41:58] [V] [TRT] Tactic: 10813439 time 0.076032 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 10813439 Time: 0.076032 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 77) [Convolution] (CaskConvolution) [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 1145226902788474763 time 0.12064 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 1651411198763708804 time 0.116992 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 2418518597804310654 time 0.116032 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 4318470497547290900 time 0.104704 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 4653005425971292725 time 0.11904 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 4930470141256631146 time 0.18432 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 8292881859266835088 time 0.13264 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 8401509141903434922 time 0.102656 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -8654297089785671176 time 0.167936 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -7448936905981214224 time 0.141568 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -6004726995029373073 time 0.116064 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -5719726816705110014 time 0.167936 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -3754890472406891741 time 0.174336 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -3689982367035295496 time 0.171584 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -3140347171730126532 time 0.057792 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -2894005464278291378 time 0.137792 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -2027588946874785071 time 0.114272 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -1968398013367819764 time 0.17024 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -245090590808296743 time 0.17408 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.057792 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 77) [Convolution] (CudaConvolution) [09/29/2020-17:41:58] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 77) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:41:58] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:58] [V] [TRT] [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:58] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Float(1,32,1024,262144) *************** [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 77) [Convolution] (FusedConvActConvolution) [09/29/2020-17:41:58] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 77) [Convolution] (CaskConvolution) [09/29/2020-17:41:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 77) [Convolution] (CudaConvolution) [09/29/2020-17:41:58] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 77) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:41:58] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:58] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Half(32,1024,1:8,32768) *************** [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 77) [Convolution] (FusedConvActConvolution) [09/29/2020-17:41:58] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 77) [Convolution] (CaskConvolution) [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:58] [V] [TRT] Tactic: 130343752241278875 time 0.049408 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 2148106709480872763 time 0.057536 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 2410442691266548717 time 0.090816 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:58] [V] [TRT] Tactic: 2921824978225832523 time 0.045408 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:58] [V] [TRT] Tactic: 3030711443478140260 time 0.059648 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 3754069740140581927 time 0.094208 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 3823144360994712832 time 0.054688 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 5635311898703673455 time 0.054784 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 5925270497649423688 time 0.166144 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 6680916730816870145 time 0.09216 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 7158029511300006471 time 0.088352 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 7859952145590271433 time 0.090368 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 8283847742354150423 time 0.093728 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -8992262742606384444 time 0.060704 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -8682550625095202832 time 0.060736 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:58] [V] [TRT] Tactic: -8379842433586149932 time 0.060256 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:58] [V] [TRT] Tactic: -6352769237623756264 time 0.063488 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -6273232454637933930 time 0.053504 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -5818527483287834165 time 0.051904 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -4954692664176521434 time 0.09216 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:58] [V] [TRT] Tactic: -4953888146171240997 time 0.045056 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -4534876761957424274 time 0.165504 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -3237051169894153788 time 0.088064 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -3136088851200285532 time 0.0512 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -2586046817576862066 time 0.09184 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -229563042944049199 time 0.054528 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: -4953888146171240997 Time: 0.045056 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 77) [Convolution] (CudaConvolution) [09/29/2020-17:41:58] [V] [TRT] Tactic: 0 time 0.44864 [09/29/2020-17:41:58] [V] [TRT] Tactic: 1 time 0.463104 [09/29/2020-17:41:58] [V] [TRT] Tactic: 2 time 0.432128 [09/29/2020-17:41:58] [V] [TRT] Tactic: 6 time 0.156992 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 6 Time: 0.156992 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 77) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:41:58] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4953888146171240997 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:58] [V] [TRT] [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 77) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:58] [V] [TRT] Tactic: 1002 time 0.006784 [09/29/2020-17:41:58] [V] [TRT] Tactic: 0 time 0.006432 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 0 Time: 0.006432 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:58] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:41:58] [V] [TRT] Tactic: 0 time 0.00608 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 0 Time: 0.00608 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:58] [V] [TRT] Tactic: 1002 time 0.007584 [09/29/2020-17:41:58] [V] [TRT] Tactic: 0 time 0.005984 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 0 Time: 0.005984 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:58] [V] [TRT] Tactic: 1002 time 0.006144 [09/29/2020-17:41:58] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:58] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:41:58] [V] [TRT] Tactic: 0 time 0.005888 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 0 Time: 0.005888 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:58] [V] [TRT] Tactic: 1002 time 0.008192 [09/29/2020-17:41:58] [V] [TRT] Tactic: 0 time 0.00496 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 0 Time: 0.00496 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:58] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:41:58] [V] [TRT] Tactic: 0 time 0.004992 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 0 Time: 0.004992 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:58] [V] [TRT] Tactic: 1002 time 0.011008 [09/29/2020-17:41:58] [V] [TRT] Tactic: 0 time 0.00592 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 0 Time: 0.00592 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:58] [V] [TRT] Tactic: 1002 time 0.008032 [09/29/2020-17:41:58] [V] [TRT] Tactic: 0 time 0.004928 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 0 Time: 0.004928 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:58] [V] [TRT] Tactic: 1002 time 0.008 [09/29/2020-17:41:58] [V] [TRT] Tactic: 0 time 0.005984 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 0 Time: 0.005984 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:58] [V] [TRT] Tactic: 1002 time 0.008096 [09/29/2020-17:41:58] [V] [TRT] Tactic: 0 time 0.005888 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 0 Time: 0.005888 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:58] [V] [TRT] Tactic: 1002 time 0.012512 [09/29/2020-17:41:58] [V] [TRT] Tactic: 0 time 0.004096 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [09/29/2020-17:41:58] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,131072), Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (CaskConvolution) [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 1754569683116234317 time 0.027968 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 1825138533642645384 time 0.028544 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 2733356012094739613 time 0.028736 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 3915320020053085238 time 0.02832 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 6808617066150061604 time 0.020448 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 9091006216302412844 time 0.018688 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -8060443123034038864 time 0.020736 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -4420849921117327522 time 0.020416 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -3946921629105938337 time 0.03072 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.018688 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (CudaConvolution) [09/29/2020-17:41:58] [V] [TRT] Tactic: 0 time 0.035072 [09/29/2020-17:41:58] [V] [TRT] Tactic: 2 time 0.06784 [09/29/2020-17:41:58] [V] [TRT] Tactic: 5 time 0.07808 [09/29/2020-17:41:58] [V] [TRT] Tactic: 57 time 0.032864 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 57 Time: 0.032864 [09/29/2020-17:41:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,131072), Half(1,32,1024,262144) -> Half(1,32,1024,262144) *************** [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (CaskConvolution) [09/29/2020-17:41:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (CudaConvolution) [09/29/2020-17:41:58] [V] [TRT] Tactic: 0 time 0.043264 [09/29/2020-17:41:58] [V] [TRT] Tactic: 1 time 0.039392 [09/29/2020-17:41:58] [V] [TRT] Tactic: 2 time 0.067584 [09/29/2020-17:41:58] [V] [TRT] Tactic: 4 time 0.770816 [09/29/2020-17:41:58] [V] [TRT] Tactic: 5 time 0.073728 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 1 Time: 0.039392 [09/29/2020-17:41:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [09/29/2020-17:41:58] [V] [TRT] [09/29/2020-17:41:58] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,65536), Half(1,32,1024:2,131072) -> Half(1,32,1024:2,131072) *************** [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (CaskConvolution) [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 1651411198763708804 time 0.014112 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 2418518597804310654 time 0.01408 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 4318470497547290900 time 0.013856 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 4930470141256631146 time 0.014592 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 8292881859266835088 time 0.014592 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 8401509141903434922 time 0.013728 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -8654297089785671176 time 0.01664 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -7516584506774355935 time 0.017824 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -7140760933967189247 time 0.01424 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -6004726995029373073 time 0.014592 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -5719726816705110014 time 0.017856 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -4097850214384059472 time 0.018432 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -3717489476759089008 time 0.012288 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -3689982367035295496 time 0.017952 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -2640575123064142123 time 0.016704 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -2534402059426524406 time 0.01664 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -2027588946874785071 time 0.014272 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -1968398013367819764 time 0.01664 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: -3717489476759089008 Time: 0.012288 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (CudaConvolution) [09/29/2020-17:41:58] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3717489476759089008 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:41:58] [V] [TRT] *************** Autotuning format combination: Half(16,512,1:8,16384), Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (CaskConvolution) [09/29/2020-17:41:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (CudaConvolution) [09/29/2020-17:41:58] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:58] [V] [TRT] *************** Autotuning format combination: Half(16,512,1:8,16384), Half(32,1024,1:8,32768) -> Half(32,1024,1:8,32768) *************** [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (CaskConvolution) [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:58] [V] [TRT] Tactic: 9576651994278528 time 0.01024 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 1179757074518529353 time 0.012288 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 2105695814191699972 time 0.012544 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 2148106709480872763 time 0.012288 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 2410442691266548717 time 0.014592 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 3041642431972138763 time 0.012288 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 3754069740140581927 time 0.0136 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 4555462412611657028 time 0.01184 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 5666160310350604399 time 0.012544 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:58] [V] [TRT] Tactic: 5876997871499382316 time 0.01024 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 5925270497649423688 time 0.0184 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 6680916730816870145 time 0.014336 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 7158029511300006471 time 0.01296 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 7859952145590271433 time 0.012928 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: 8283847742354150423 time 0.01392 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -8992262742606384444 time 0.011904 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -8391760416076885205 time 0.018304 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -6273232454637933930 time 0.011584 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:58] [V] [TRT] Tactic: -5925110308892264213 time 0.01136 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -5818527483287834165 time 0.012288 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:58] [V] [TRT] Tactic: -4908848143422991657 time 0.01024 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -4534876761957424274 time 0.018272 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -3237051169894153788 time 0.012544 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -3136088851200285532 time 0.011872 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -2586046817576862066 time 0.014592 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -2422160065350346448 time 0.014336 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -1216445540764179377 time 0.014496 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] Tactic: -229563042944049199 time 0.011552 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 9576651994278528 Time: 0.01024 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (CudaConvolution) [09/29/2020-17:41:58] [V] [TRT] Tactic: 0 time 0.047392 [09/29/2020-17:41:58] [V] [TRT] Tactic: 1 time 0.073728 [09/29/2020-17:41:58] [V] [TRT] Tactic: 2 time 0.082784 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 0 Time: 0.047392 [09/29/2020-17:41:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9576651994278528 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:58] [V] [TRT] [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:41:58] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:58] [V] [TRT] Tactic: 1002 time 0.008192 [09/29/2020-17:41:58] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:41:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [09/29/2020-17:41:58] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:59] [V] [TRT] Tactic: 1002 time 0.014624 [09/29/2020-17:41:59] [V] [TRT] Tactic: 0 time 0.007392 [09/29/2020-17:41:59] [V] [TRT] Fastest Tactic: 0 Time: 0.007392 [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:59] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:41:59] [V] [TRT] Tactic: 0 time 0.006848 [09/29/2020-17:41:59] [V] [TRT] Fastest Tactic: 0 Time: 0.006848 [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:59] [V] [TRT] Tactic: 1002 time 0.008192 [09/29/2020-17:41:59] [V] [TRT] Tactic: 0 time 0.008416 [09/29/2020-17:41:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:59] [V] [TRT] Tactic: 1002 time 0.014592 [09/29/2020-17:41:59] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:59] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:41:59] [V] [TRT] Tactic: 0 time 0.00752 [09/29/2020-17:41:59] [V] [TRT] Fastest Tactic: 0 Time: 0.00752 [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:59] [V] [TRT] Tactic: 1002 time 0.014368 [09/29/2020-17:41:59] [V] [TRT] Tactic: 0 time 0.007744 [09/29/2020-17:41:59] [V] [TRT] Fastest Tactic: 0 Time: 0.007744 [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:59] [V] [TRT] Tactic: 1002 time 0.014688 [09/29/2020-17:41:59] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:59] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:41:59] [V] [TRT] Tactic: 0 time 0.006336 [09/29/2020-17:41:59] [V] [TRT] Fastest Tactic: 0 Time: 0.006336 [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:59] [V] [TRT] Tactic: 1002 time 0.010528 [09/29/2020-17:41:59] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:41:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:59] [V] [TRT] Tactic: 1002 time 0.011008 [09/29/2020-17:41:59] [V] [TRT] Tactic: 0 time 0.006048 [09/29/2020-17:41:59] [V] [TRT] Fastest Tactic: 0 Time: 0.006048 [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:41:59] [V] [TRT] Tactic: 1002 time 0.018432 [09/29/2020-17:41:59] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:41:59] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:41:59] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:59] [V] [TRT] Tactic: 524287 time 0.194848 [09/29/2020-17:41:59] [V] [TRT] Tactic: 720895 time 0.192384 [09/29/2020-17:41:59] [V] [TRT] Tactic: 983039 time 0.169984 [09/29/2020-17:41:59] [V] [TRT] Tactic: 1048575 time 0.19072 [09/29/2020-17:41:59] [V] [TRT] Tactic: 1703935 time 0.154368 [09/29/2020-17:41:59] [V] [TRT] Tactic: 1769471 time 0.204544 [09/29/2020-17:41:59] [V] [TRT] Tactic: 1966079 time 0.254816 [09/29/2020-17:41:59] [V] [TRT] Tactic: 2031615 time 0.313344 [09/29/2020-17:41:59] [V] [TRT] Tactic: 2228223 time 0.21712 [09/29/2020-17:41:59] [V] [TRT] Tactic: 2424831 time 0.172256 [09/29/2020-17:41:59] [V] [TRT] Tactic: 2621439 time 0.1536 [09/29/2020-17:41:59] [V] [TRT] Tactic: 2752511 time 0.223136 [09/29/2020-17:41:59] [V] [TRT] Tactic: 2818047 time 0.2112 [09/29/2020-17:41:59] [V] [TRT] Tactic: 2883583 time 0.298464 [09/29/2020-17:41:59] [V] [TRT] Tactic: 3014655 time 0.168192 [09/29/2020-17:41:59] [V] [TRT] Tactic: 3145727 time 0.20096 [09/29/2020-17:41:59] [V] [TRT] Tactic: 3473407 time 0.246016 [09/29/2020-17:41:59] [V] [TRT] Tactic: 3604479 time 0.166144 [09/29/2020-17:41:59] [V] [TRT] Tactic: 3735551 time 0.192768 [09/29/2020-17:41:59] [V] [TRT] Tactic: 4390911 time 0.270976 [09/29/2020-17:41:59] [V] [TRT] Tactic: 5046271 time 0.186176 [09/29/2020-17:41:59] [V] [TRT] Tactic: 5963775 time 0.243936 [09/29/2020-17:41:59] [V] [TRT] Tactic: 6160383 time 0.196864 [09/29/2020-17:41:59] [V] [TRT] Tactic: 6488063 time 0.224672 [09/29/2020-17:41:59] [V] [TRT] Tactic: 6881279 time 0.280576 [09/29/2020-17:41:59] [V] [TRT] Tactic: 7274495 time 0.155904 [09/29/2020-17:41:59] [V] [TRT] Tactic: 7864319 time 0.184672 [09/29/2020-17:41:59] [V] [TRT] Tactic: 7995391 time 0.202496 [09/29/2020-17:41:59] [V] [TRT] Tactic: 8585215 time 0.239616 [09/29/2020-17:41:59] [V] [TRT] Tactic: 8847359 time 0.189536 [09/29/2020-17:41:59] [V] [TRT] Tactic: 8978431 time 0.243968 [09/29/2020-17:41:59] [V] [TRT] Tactic: 9043967 time 0.18144 [09/29/2020-17:41:59] [V] [TRT] Tactic: 9175039 time 0.166304 [09/29/2020-17:41:59] [V] [TRT] Tactic: 9502719 time 0.27264 [09/29/2020-17:41:59] [V] [TRT] Tactic: 9830399 time 0.182528 [09/29/2020-17:41:59] [V] [TRT] Tactic: 9961471 time 0.17024 [09/29/2020-17:41:59] [V] [TRT] Tactic: 10027007 time 0.213248 [09/29/2020-17:41:59] [V] [TRT] Tactic: 10092543 time 0.271584 [09/29/2020-17:41:59] [V] [TRT] Tactic: 10289151 time 0.255456 [09/29/2020-17:41:59] [V] [TRT] Tactic: 10485759 time 0.180416 [09/29/2020-17:41:59] [V] [TRT] Tactic: 10682367 time 0.151104 [09/29/2020-17:41:59] [V] [TRT] Tactic: 10813439 time 0.149504 [09/29/2020-17:41:59] [V] [TRT] Fastest Tactic: 10813439 Time: 0.149504 [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (CaskConvolution) [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: 1825138533642645384 time 0.333472 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: 2775507031594384867 time 0.112576 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: 2842488832350522458 time 0.215296 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: 3915320020053085238 time 0.325632 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: 6448355332020552203 time 0.33408 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: 6808617066150061604 time 0.198912 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: -8060443123034038864 time 0.225728 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: -4420849921117327522 time 0.246016 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: -3946921629105938337 time 0.37504 [09/29/2020-17:41:59] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.112576 [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (CudaConvolution) [09/29/2020-17:41:59] [V] [TRT] Tactic: 0 time 0.345088 [09/29/2020-17:41:59] [V] [TRT] Tactic: 2 time 0.338176 [09/29/2020-17:41:59] [V] [TRT] Tactic: 5 time 3.70688 [09/29/2020-17:41:59] [V] [TRT] Tactic: 6 time 0.132736 [09/29/2020-17:41:59] [V] [TRT] Tactic: 57 time 0.20992 [09/29/2020-17:41:59] [V] [TRT] Fastest Tactic: 6 Time: 0.132736 [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:59] [V] [TRT] [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:59] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144) -> Half(1,32,1024,262144) *************** [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (CaskConvolution) [09/29/2020-17:41:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (CudaConvolution) [09/29/2020-17:41:59] [V] [TRT] Tactic: 0 time 0.33952 [09/29/2020-17:41:59] [V] [TRT] Tactic: 1 time 0.734208 [09/29/2020-17:41:59] [V] [TRT] Tactic: 2 time 0.33408 [09/29/2020-17:41:59] [V] [TRT] Tactic: 4 time 11.9052 [09/29/2020-17:41:59] [V] [TRT] Tactic: 5 time 3.67286 [09/29/2020-17:41:59] [V] [TRT] Tactic: 6 time 0.172032 [09/29/2020-17:41:59] [V] [TRT] Fastest Tactic: 6 Time: 0.172032 [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [09/29/2020-17:41:59] [V] [TRT] [09/29/2020-17:41:59] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072) -> Half(1,32,1024:2,131072) *************** [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:59] [V] [TRT] Tactic: 524287 time 0.100032 [09/29/2020-17:41:59] [V] [TRT] Tactic: 720895 time 0.13312 [09/29/2020-17:41:59] [V] [TRT] Tactic: 983039 time 0.086304 [09/29/2020-17:41:59] [V] [TRT] Tactic: 1048575 time 0.096512 [09/29/2020-17:41:59] [V] [TRT] Tactic: 1703935 time 0.080608 [09/29/2020-17:41:59] [V] [TRT] Tactic: 1769471 time 0.108992 [09/29/2020-17:41:59] [V] [TRT] Tactic: 1966079 time 0.121088 [09/29/2020-17:41:59] [V] [TRT] Tactic: 2031615 time 0.158016 [09/29/2020-17:41:59] [V] [TRT] Tactic: 2228223 time 0.110592 [09/29/2020-17:41:59] [V] [TRT] Tactic: 2424831 time 0.091072 [09/29/2020-17:41:59] [V] [TRT] Tactic: 2621439 time 0.079936 [09/29/2020-17:41:59] [V] [TRT] Tactic: 2752511 time 0.109824 [09/29/2020-17:41:59] [V] [TRT] Tactic: 2818047 time 0.106048 [09/29/2020-17:41:59] [V] [TRT] Tactic: 2883583 time 0.1408 [09/29/2020-17:41:59] [V] [TRT] Tactic: 3014655 time 0.088032 [09/29/2020-17:41:59] [V] [TRT] Tactic: 3145727 time 0.102656 [09/29/2020-17:41:59] [V] [TRT] Tactic: 3473407 time 0.122656 [09/29/2020-17:41:59] [V] [TRT] Tactic: 3604479 time 0.086496 [09/29/2020-17:41:59] [V] [TRT] Tactic: 3735551 time 0.098304 [09/29/2020-17:41:59] [V] [TRT] Tactic: 4390911 time 0.127232 [09/29/2020-17:41:59] [V] [TRT] Tactic: 5046271 time 0.09424 [09/29/2020-17:41:59] [V] [TRT] Tactic: 5963775 time 0.1088 [09/29/2020-17:41:59] [V] [TRT] Tactic: 6160383 time 0.094464 [09/29/2020-17:41:59] [V] [TRT] Tactic: 6488063 time 0.114944 [09/29/2020-17:41:59] [V] [TRT] Tactic: 6881279 time 0.139072 [09/29/2020-17:41:59] [V] [TRT] Tactic: 7274495 time 0.080128 [09/29/2020-17:41:59] [V] [TRT] Tactic: 7864319 time 0.09856 [09/29/2020-17:41:59] [V] [TRT] Tactic: 7995391 time 0.1024 [09/29/2020-17:41:59] [V] [TRT] Tactic: 8585215 time 0.121088 [09/29/2020-17:41:59] [V] [TRT] Tactic: 8847359 time 0.101888 [09/29/2020-17:41:59] [V] [TRT] Tactic: 8978431 time 0.110592 [09/29/2020-17:41:59] [V] [TRT] Tactic: 9043967 time 0.094208 [09/29/2020-17:41:59] [V] [TRT] Tactic: 9175039 time 0.086912 [09/29/2020-17:41:59] [V] [TRT] Tactic: 9502719 time 0.126496 [09/29/2020-17:41:59] [V] [TRT] Tactic: 9830399 time 0.093632 [09/29/2020-17:41:59] [V] [TRT] Tactic: 9961471 time 0.09216 [09/29/2020-17:41:59] [V] [TRT] Tactic: 10027007 time 0.110048 [09/29/2020-17:41:59] [V] [TRT] Tactic: 10092543 time 0.126976 [09/29/2020-17:41:59] [V] [TRT] Tactic: 10289151 time 0.121088 [09/29/2020-17:41:59] [V] [TRT] Tactic: 10485759 time 0.092448 [09/29/2020-17:41:59] [V] [TRT] Tactic: 10682367 time 0.079872 [09/29/2020-17:41:59] [V] [TRT] Tactic: 10813439 time 0.076032 [09/29/2020-17:41:59] [V] [TRT] Fastest Tactic: 10813439 Time: 0.076032 [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (CaskConvolution) [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: 1145226902788474763 time 0.118848 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: 1651411198763708804 time 0.118464 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: 2418518597804310654 time 0.116256 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: 4318470497547290900 time 0.104704 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: 4653005425971292725 time 0.11904 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: 4930470141256631146 time 0.133376 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: 8292881859266835088 time 0.132256 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: 8401509141903434922 time 0.103264 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: -8654297089785671176 time 0.167936 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: -7448936905981214224 time 0.141728 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: -6004726995029373073 time 0.116576 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: -5719726816705110014 time 0.167936 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: -3754890472406891741 time 0.17408 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: -3689982367035295496 time 0.171392 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: -3140347171730126532 time 0.0576 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: -2894005464278291378 time 0.185184 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: -2027588946874785071 time 0.114688 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: -1968398013367819764 time 0.171328 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] Tactic: -245090590808296743 time 0.174336 [09/29/2020-17:41:59] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.0576 [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (CudaConvolution) [09/29/2020-17:41:59] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:59] [V] [TRT] [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:41:59] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:41:59] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Float(1,32,1024,262144) *************** [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (FusedConvActConvolution) [09/29/2020-17:41:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (CaskConvolution) [09/29/2020-17:41:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (CudaConvolution) [09/29/2020-17:41:59] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:41:59] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:41:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:00] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Half(32,1024,1:8,32768) *************** [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (CaskConvolution) [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] Tactic: 130343752241278875 time 0.049408 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 2148106709480872763 time 0.057344 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 2410442691266548717 time 0.091776 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] Tactic: 2921824978225832523 time 0.046496 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:00] [V] [TRT] Tactic: 3030711443478140260 time 0.059648 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 3754069740140581927 time 0.094016 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 3823144360994712832 time 0.053504 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 5635311898703673455 time 0.05504 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 5925270497649423688 time 0.166144 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 6680916730816870145 time 0.09216 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 7158029511300006471 time 0.088928 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 7859952145590271433 time 0.090368 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 8283847742354150423 time 0.093536 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -8992262742606384444 time 0.06144 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -8682550625095202832 time 0.06064 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:00] [V] [TRT] Tactic: -8379842433586149932 time 0.059648 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:00] [V] [TRT] Tactic: -6352769237623756264 time 0.063456 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -6273232454637933930 time 0.05408 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -5818527483287834165 time 0.051456 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -4954692664176521434 time 0.092032 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] Tactic: -4953888146171240997 time 0.045312 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -4534876761957424274 time 0.165888 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -3237051169894153788 time 0.087584 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -3136088851200285532 time 0.0512 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -2586046817576862066 time 0.091488 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -229563042944049199 time 0.053504 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: -4953888146171240997 Time: 0.045312 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (CudaConvolution) [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.45056 [09/29/2020-17:42:00] [V] [TRT] Tactic: 1 time 0.466944 [09/29/2020-17:42:00] [V] [TRT] Tactic: 2 time 0.436224 [09/29/2020-17:42:00] [V] [TRT] Tactic: 6 time 0.15952 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 6 Time: 0.15952 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4953888146171240997 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144), Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (CaskConvolution) [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 1825138533642645384 time 0.33408 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 2775507031594384867 time 0.113984 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 2842488832350522458 time 0.218528 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 3915320020053085238 time 0.325632 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 6448355332020552203 time 0.336064 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 6808617066150061604 time 0.201344 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -8060443123034038864 time 0.227584 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -4420849921117327522 time 0.247712 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -3946921629105938337 time 0.383232 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.113984 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (CudaConvolution) [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.33408 [09/29/2020-17:42:00] [V] [TRT] Tactic: 2 time 0.343776 [09/29/2020-17:42:00] [V] [TRT] Tactic: 5 time 3.71661 [09/29/2020-17:42:00] [V] [TRT] Tactic: 6 time 0.141312 [09/29/2020-17:42:00] [V] [TRT] Tactic: 57 time 0.21328 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 6 Time: 0.141312 [09/29/2020-17:42:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:00] [V] [TRT] [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:00] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144), Half(1,32,1024,262144) -> Half(1,32,1024,262144) *************** [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (CaskConvolution) [09/29/2020-17:42:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (CudaConvolution) [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.343616 [09/29/2020-17:42:00] [V] [TRT] Tactic: 1 time 0.2112 [09/29/2020-17:42:00] [V] [TRT] Tactic: 2 time 0.338464 [09/29/2020-17:42:00] [V] [TRT] Tactic: 4 time 11.8807 [09/29/2020-17:42:00] [V] [TRT] Tactic: 5 time 3.66819 [09/29/2020-17:42:00] [V] [TRT] Tactic: 6 time 0.176 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 6 Time: 0.176 [09/29/2020-17:42:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [09/29/2020-17:42:00] [V] [TRT] [09/29/2020-17:42:00] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072), Half(1,32,1024:2,131072) -> Half(1,32,1024:2,131072) *************** [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (CaskConvolution) [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 1145226902788474763 time 0.120832 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 1651411198763708804 time 0.11808 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 2418518597804310654 time 0.117024 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 4318470497547290900 time 0.105312 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 4653005425971292725 time 0.120768 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 4930470141256631146 time 0.134592 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 8292881859266835088 time 0.13296 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 8401509141903434922 time 0.104576 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -8654297089785671176 time 0.168576 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -7448936905981214224 time 0.14304 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -6004726995029373073 time 0.116992 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -5719726816705110014 time 0.167936 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -3754890472406891741 time 0.174336 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -3689982367035295496 time 0.171744 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -3140347171730126532 time 0.057344 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -2894005464278291378 time 0.137216 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -2027588946874785071 time 0.114592 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -1968398013367819764 time 0.171648 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -245090590808296743 time 0.175488 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.057344 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (CudaConvolution) [09/29/2020-17:42:00] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:00] [V] [TRT] [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:00] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768), Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (CaskConvolution) [09/29/2020-17:42:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (CudaConvolution) [09/29/2020-17:42:00] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:00] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768), Half(32,1024,1:8,32768) -> Half(32,1024,1:8,32768) *************** [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (CaskConvolution) [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] Tactic: 130343752241278875 time 0.05104 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 2148106709480872763 time 0.060576 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 2410442691266548717 time 0.092096 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] Tactic: 2921824978225832523 time 0.045312 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:00] [V] [TRT] Tactic: 3030711443478140260 time 0.059808 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 3754069740140581927 time 0.09568 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 3823144360994712832 time 0.053504 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 5635311898703673455 time 0.055296 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 5925270497649423688 time 0.16768 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 6680916730816870145 time 0.092416 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 7158029511300006471 time 0.090112 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 7859952145590271433 time 0.091872 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: 8283847742354150423 time 0.094464 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -8992262742606384444 time 0.061696 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -8682550625095202832 time 0.061312 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:00] [V] [TRT] Tactic: -8379842433586149932 time 0.060896 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:00] [V] [TRT] Tactic: -6352769237623756264 time 0.065536 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -6273232454637933930 time 0.055136 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -5818527483287834165 time 0.053056 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -4954692664176521434 time 0.094112 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] Tactic: -4953888146171240997 time 0.04736 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -4534876761957424274 time 0.166144 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -3237051169894153788 time 0.08832 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -3136088851200285532 time 0.052544 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -2586046817576862066 time 0.09216 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] Tactic: -229563042944049199 time 0.055232 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 2921824978225832523 Time: 0.045312 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (CudaConvolution) [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.456704 [09/29/2020-17:42:00] [V] [TRT] Tactic: 1 time 0.468992 [09/29/2020-17:42:00] [V] [TRT] Tactic: 2 time 0.438528 [09/29/2020-17:42:00] [V] [TRT] Tactic: 6 time 0.163488 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 6 Time: 0.163488 [09/29/2020-17:42:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2921824978225832523 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:00] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: 488 copy (Reformat) [09/29/2020-17:42:00] [V] [TRT] Tactic: 1002 time 0.007808 [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: 488 copy (Reformat) [09/29/2020-17:42:00] [V] [TRT] Tactic: 1002 time 0.008032 [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.008032 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: 488 copy (Reformat) [09/29/2020-17:42:00] [V] [TRT] Tactic: 1002 time 0.014336 [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: 488 copy (Reformat) [09/29/2020-17:42:00] [V] [TRT] Tactic: 1002 time 0.010528 [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.006784 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 0 Time: 0.006784 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: 488 copy (Reformat) [09/29/2020-17:42:00] [V] [TRT] Tactic: 1002 time 0.008032 [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.008384 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.008032 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: 488 copy (Reformat) [09/29/2020-17:42:00] [V] [TRT] Tactic: 1002 time 0.008096 [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.005984 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 0 Time: 0.005984 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: 488 copy (Reformat) [09/29/2020-17:42:00] [V] [TRT] Tactic: 1002 time 0.01456 [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: 488 copy (Reformat) [09/29/2020-17:42:00] [V] [TRT] Tactic: 1002 time 0.011712 [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: 488 copy (Reformat) [09/29/2020-17:42:00] [V] [TRT] Tactic: 1002 time 0.014464 [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: 488 copy (Reformat) [09/29/2020-17:42:00] [V] [TRT] Tactic: 1002 time 0.014336 [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: 488 copy (Reformat) [09/29/2020-17:42:00] [V] [TRT] Tactic: 1002 time 0.014592 [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.005824 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 0 Time: 0.005824 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: 488 copy (Reformat) [09/29/2020-17:42:00] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: 488 copy (Reformat) [09/29/2020-17:42:00] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.012512 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.01024 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: 488 copy (Reformat) [09/29/2020-17:42:00] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.012288 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.010496 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: 488 copy (Reformat) [09/29/2020-17:42:00] [V] [TRT] Tactic: 1002 time 0.018336 [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.006048 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 0 Time: 0.006048 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: 488 copy (Reformat) [09/29/2020-17:42:00] [V] [TRT] Tactic: 1002 time 0.013568 [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: 481 copy (Reformat) [09/29/2020-17:42:00] [V] [TRT] Tactic: 1002 time 0.008064 [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: 481 copy (Reformat) [09/29/2020-17:42:00] [V] [TRT] Tactic: 1002 time 0.008032 [09/29/2020-17:42:00] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:42:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.008032 [09/29/2020-17:42:00] [V] [TRT] --------------- Timing Runner: 481 copy (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.014304 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.006432 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.006432 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: 481 copy (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: 481 copy (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.008064 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.008064 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: 481 copy (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.008192 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.004992 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.004992 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: 481 copy (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.014336 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.006432 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.006432 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: 481 copy (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.007488 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.007488 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: 481 copy (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.014528 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: 481 copy (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.014336 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: 481 copy (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.01552 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.005824 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.005824 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: 481 copy (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.01168 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: 481 copy (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.012512 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.01024 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: 481 copy (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.012256 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.010496 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: 481 copy (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.018432 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.006176 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.006176 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: 481 copy (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.013568 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.006656 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.006656 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.00848 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.013824 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.00848 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.020832 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.01024 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.016192 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.009056 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.009056 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.008448 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.012576 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.008448 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.021824 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.00848 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00848 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.016352 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.022784 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.009472 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.009472 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.02352 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.016384 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.016384 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.008064 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.008064 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.016384 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.007008 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.007008 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:01] [V] [TRT] Tactic: 1002 time 0.028672 [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.006432 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.006432 [09/29/2020-17:42:01] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,262144) *************** [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:01] [V] [TRT] Tactic: 589823 time 0.132576 [09/29/2020-17:42:01] [V] [TRT] Tactic: 655359 time 0.09216 [09/29/2020-17:42:01] [V] [TRT] Tactic: 786431 time 0.129024 [09/29/2020-17:42:01] [V] [TRT] Tactic: 851967 time 0.06784 [09/29/2020-17:42:01] [V] [TRT] Tactic: 1179647 time 0.065792 [09/29/2020-17:42:01] [V] [TRT] Tactic: 1310719 time 0.09392 [09/29/2020-17:42:01] [V] [TRT] Tactic: 1376255 time 0.100352 [09/29/2020-17:42:01] [V] [TRT] Tactic: 1441791 time 0.082176 [09/29/2020-17:42:01] [V] [TRT] Tactic: 1507327 time 0.065536 [09/29/2020-17:42:01] [V] [TRT] Tactic: 1638399 time 0.106368 [09/29/2020-17:42:01] [V] [TRT] Tactic: 1835007 time 0.128416 [09/29/2020-17:42:01] [V] [TRT] Tactic: 1900543 time 0.11024 [09/29/2020-17:42:01] [V] [TRT] Tactic: 2097151 time 0.094176 [09/29/2020-17:42:01] [V] [TRT] Tactic: 2162687 time 0.106752 [09/29/2020-17:42:01] [V] [TRT] Tactic: 2293759 time 0.093664 [09/29/2020-17:42:01] [V] [TRT] Tactic: 2359295 time 0.067072 [09/29/2020-17:42:01] [V] [TRT] Tactic: 2686975 time 0.097984 [09/29/2020-17:42:01] [V] [TRT] Tactic: 3080191 time 0.069888 [09/29/2020-17:42:01] [V] [TRT] Tactic: 3342335 time 0.063136 [09/29/2020-17:42:01] [V] [TRT] Tactic: 3407871 time 0.076032 [09/29/2020-17:42:01] [V] [TRT] Tactic: 3538943 time 0.069024 [09/29/2020-17:42:01] [V] [TRT] Tactic: 3670015 time 0.169792 [09/29/2020-17:42:01] [V] [TRT] Tactic: 3932159 time 0.090368 [09/29/2020-17:42:01] [V] [TRT] Tactic: 3997695 time 0.115552 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4063231 time 0.06704 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4194303 time 0.102304 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4259839 time 0.086272 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4325375 time 0.104448 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4521983 time 0.106752 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4587519 time 0.096544 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4653055 time 0.062528 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4915199 time 0.094016 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4980735 time 0.106464 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5177343 time 0.078688 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5242879 time 0.076032 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5373951 time 0.098656 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5439487 time 0.188416 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5570559 time 0.059648 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5636095 time 0.06608 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5701631 time 0.095904 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5767167 time 0.382976 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5832703 time 0.07296 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5898239 time 0.066048 [09/29/2020-17:42:01] [V] [TRT] Tactic: 6029311 time 0.087328 [09/29/2020-17:42:01] [V] [TRT] Tactic: 6225919 time 0.069856 [09/29/2020-17:42:01] [V] [TRT] Tactic: 6291455 time 0.066976 [09/29/2020-17:42:01] [V] [TRT] Tactic: 6422527 time 0.064352 [09/29/2020-17:42:01] [V] [TRT] Tactic: 6750207 time 0.118464 [09/29/2020-17:42:01] [V] [TRT] Tactic: 6815743 time 0.108544 [09/29/2020-17:42:01] [V] [TRT] Tactic: 6946815 time 0.172288 [09/29/2020-17:42:01] [V] [TRT] Tactic: 7012351 time 0.094208 [09/29/2020-17:42:01] [V] [TRT] Tactic: 7077887 time 0.061728 [09/29/2020-17:42:01] [V] [TRT] Tactic: 7143423 time 0.177632 [09/29/2020-17:42:01] [V] [TRT] Tactic: 7208959 time 0.076192 [09/29/2020-17:42:01] [V] [TRT] Tactic: 7340031 time 0.071328 [09/29/2020-17:42:01] [V] [TRT] Tactic: 7405567 time 0.071712 [09/29/2020-17:42:01] [V] [TRT] Tactic: 7536639 time 0.096256 [09/29/2020-17:42:01] [V] [TRT] Tactic: 7602175 time 0.108032 [09/29/2020-17:42:01] [V] [TRT] Tactic: 7733247 time 0.06544 [09/29/2020-17:42:01] [V] [TRT] Tactic: 7798783 time 0.129024 [09/29/2020-17:42:01] [V] [TRT] Tactic: 8191999 time 0.135424 [09/29/2020-17:42:01] [V] [TRT] Tactic: 8257535 time 0.10256 [09/29/2020-17:42:01] [V] [TRT] Tactic: 8323071 time 0.127264 [09/29/2020-17:42:01] [V] [TRT] Tactic: 8650751 time 0.128992 [09/29/2020-17:42:01] [V] [TRT] Tactic: 8716287 time 0.105312 [09/29/2020-17:42:01] [V] [TRT] Tactic: 9109503 time 0.102656 [09/29/2020-17:42:01] [V] [TRT] Tactic: 9568255 time 0.092928 [09/29/2020-17:42:01] [V] [TRT] Tactic: 9895935 time 0.101088 [09/29/2020-17:42:01] [V] [TRT] Tactic: 10223615 time 0.098176 [09/29/2020-17:42:01] [V] [TRT] Tactic: 10354687 time 0.086272 [09/29/2020-17:42:01] [V] [TRT] Tactic: 10551295 time 0.121088 [09/29/2020-17:42:01] [V] [TRT] Tactic: 10747903 time 0.060928 [09/29/2020-17:42:01] [V] [TRT] Tactic: 10944511 time 0.106144 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 5570559 Time: 0.059648 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (CaskConvolution) [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 1754569683116234317 time 0.079392 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 1825138533642645384 time 0.080128 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 2733356012094739613 time 0.083648 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 3915320020053085238 time 0.079808 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 6808617066150061604 time 0.0512 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 9091006216302412844 time 0.04736 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: -8060443123034038864 time 0.052064 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: -4420849921117327522 time 0.057024 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: -3946921629105938337 time 0.092352 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.04736 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (CudaConvolution) [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.112096 [09/29/2020-17:42:01] [V] [TRT] Tactic: 2 time 0.21024 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5 time 0.189248 [09/29/2020-17:42:01] [V] [TRT] Tactic: 57 time 0.088352 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 57 Time: 0.088352 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,524288) -> Half(1,32,1024,262144) *************** [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (CaskConvolution) [09/29/2020-17:42:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (CudaConvolution) [09/29/2020-17:42:01] [V] [TRT] Tactic: 0 time 0.110624 [09/29/2020-17:42:01] [V] [TRT] Tactic: 1 time 0.091616 [09/29/2020-17:42:01] [V] [TRT] Tactic: 2 time 0.169568 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4 time 3.21024 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5 time 0.190304 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 1 Time: 0.091616 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [09/29/2020-17:42:01] [V] [TRT] [09/29/2020-17:42:01] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,262144) -> Half(1,32,1024,262144) *************** [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (CaskConvolution) [09/29/2020-17:42:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (CudaConvolution) [09/29/2020-17:42:01] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:01] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,262144) -> Half(1,32,1024:2,131072) *************** [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:01] [V] [TRT] Tactic: 589823 time 0.06912 [09/29/2020-17:42:01] [V] [TRT] Tactic: 655359 time 0.05072 [09/29/2020-17:42:01] [V] [TRT] Tactic: 786431 time 0.069888 [09/29/2020-17:42:01] [V] [TRT] Tactic: 851967 time 0.039168 [09/29/2020-17:42:01] [V] [TRT] Tactic: 1179647 time 0.03712 [09/29/2020-17:42:01] [V] [TRT] Tactic: 1310719 time 0.050656 [09/29/2020-17:42:01] [V] [TRT] Tactic: 1376255 time 0.053504 [09/29/2020-17:42:01] [V] [TRT] Tactic: 1441791 time 0.042848 [09/29/2020-17:42:01] [V] [TRT] Tactic: 1507327 time 0.034784 [09/29/2020-17:42:01] [V] [TRT] Tactic: 1638399 time 0.059392 [09/29/2020-17:42:01] [V] [TRT] Tactic: 1835007 time 0.069504 [09/29/2020-17:42:01] [V] [TRT] Tactic: 1900543 time 0.055232 [09/29/2020-17:42:01] [V] [TRT] Tactic: 2097151 time 0.05328 [09/29/2020-17:42:01] [V] [TRT] Tactic: 2162687 time 0.057344 [09/29/2020-17:42:01] [V] [TRT] Tactic: 2293759 time 0.048576 [09/29/2020-17:42:01] [V] [TRT] Tactic: 2359295 time 0.035296 [09/29/2020-17:42:01] [V] [TRT] Tactic: 2686975 time 0.051456 [09/29/2020-17:42:01] [V] [TRT] Tactic: 3080191 time 0.037344 [09/29/2020-17:42:01] [V] [TRT] Tactic: 3342335 time 0.033024 [09/29/2020-17:42:01] [V] [TRT] Tactic: 3407871 time 0.04032 [09/29/2020-17:42:01] [V] [TRT] Tactic: 3538943 time 0.03712 [09/29/2020-17:42:01] [V] [TRT] Tactic: 3670015 time 0.08832 [09/29/2020-17:42:01] [V] [TRT] Tactic: 3932159 time 0.04688 [09/29/2020-17:42:01] [V] [TRT] Tactic: 3997695 time 0.063744 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4063231 time 0.038528 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4194303 time 0.0512 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4259839 time 0.04736 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4325375 time 0.056576 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4521983 time 0.05792 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4587519 time 0.053248 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4653055 time 0.035072 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4915199 time 0.05088 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4980735 time 0.060736 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5177343 time 0.043008 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5242879 time 0.040992 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5373951 time 0.053504 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5439487 time 0.097504 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5570559 time 0.032768 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5636095 time 0.038688 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5701631 time 0.048864 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5767167 time 0.1928 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5832703 time 0.03712 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5898239 time 0.036864 [09/29/2020-17:42:01] [V] [TRT] Tactic: 6029311 time 0.045344 [09/29/2020-17:42:01] [V] [TRT] Tactic: 6225919 time 0.0384 [09/29/2020-17:42:01] [V] [TRT] Tactic: 6291455 time 0.03712 [09/29/2020-17:42:01] [V] [TRT] Tactic: 6422527 time 0.034368 [09/29/2020-17:42:01] [V] [TRT] Tactic: 6750207 time 0.061696 [09/29/2020-17:42:01] [V] [TRT] Tactic: 6815743 time 0.058848 [09/29/2020-17:42:01] [V] [TRT] Tactic: 6946815 time 0.090112 [09/29/2020-17:42:01] [V] [TRT] Tactic: 7012351 time 0.05328 [09/29/2020-17:42:01] [V] [TRT] Tactic: 7077887 time 0.034528 [09/29/2020-17:42:01] [V] [TRT] Tactic: 7143423 time 0.090368 [09/29/2020-17:42:01] [V] [TRT] Tactic: 7208959 time 0.042912 [09/29/2020-17:42:01] [V] [TRT] Tactic: 7340031 time 0.038912 [09/29/2020-17:42:01] [V] [TRT] Tactic: 7405567 time 0.040512 [09/29/2020-17:42:01] [V] [TRT] Tactic: 7536639 time 0.0512 [09/29/2020-17:42:01] [V] [TRT] Tactic: 7602175 time 0.05888 [09/29/2020-17:42:01] [V] [TRT] Tactic: 7733247 time 0.03568 [09/29/2020-17:42:01] [V] [TRT] Tactic: 7798783 time 0.069888 [09/29/2020-17:42:01] [V] [TRT] Tactic: 8191999 time 0.071936 [09/29/2020-17:42:01] [V] [TRT] Tactic: 8257535 time 0.055296 [09/29/2020-17:42:01] [V] [TRT] Tactic: 8323071 time 0.06576 [09/29/2020-17:42:01] [V] [TRT] Tactic: 8650751 time 0.067968 [09/29/2020-17:42:01] [V] [TRT] Tactic: 8716287 time 0.055552 [09/29/2020-17:42:01] [V] [TRT] Tactic: 9109503 time 0.057344 [09/29/2020-17:42:01] [V] [TRT] Tactic: 9568255 time 0.050912 [09/29/2020-17:42:01] [V] [TRT] Tactic: 9895935 time 0.051456 [09/29/2020-17:42:01] [V] [TRT] Tactic: 10223615 time 0.051296 [09/29/2020-17:42:01] [V] [TRT] Tactic: 10354687 time 0.048448 [09/29/2020-17:42:01] [V] [TRT] Tactic: 10551295 time 0.063584 [09/29/2020-17:42:01] [V] [TRT] Tactic: 10747903 time 0.03376 [09/29/2020-17:42:01] [V] [TRT] Tactic: 10944511 time 0.063296 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: 5570559 Time: 0.032768 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (CaskConvolution) [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 1651411198763708804 time 0.030016 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 2418518597804310654 time 0.0304 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4318470497547290900 time 0.02896 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4930470141256631146 time 0.047104 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 8292881859266835088 time 0.034816 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 8401509141903434922 time 0.028928 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: -8654297089785671176 time 0.043008 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: -7516584506774355935 time 0.044864 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: -7140760933967189247 time 0.02704 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: -6004726995029373073 time 0.032768 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: -5719726816705110014 time 0.043264 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: -4097850214384059472 time 0.045024 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: -3717489476759089008 time 0.028672 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: -3689982367035295496 time 0.043776 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: -2640575123064142123 time 0.043296 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: -2534402059426524406 time 0.043232 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: -2027588946874785071 time 0.045312 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: -1968398013367819764 time 0.043264 [09/29/2020-17:42:01] [V] [TRT] Fastest Tactic: -7140760933967189247 Time: 0.02704 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (CudaConvolution) [09/29/2020-17:42:01] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7140760933967189247 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:01] [V] [TRT] *************** Autotuning format combination: Half(64,2048,1:8,65536) -> Float(1,32,1024,262144) *************** [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (CaskConvolution) [09/29/2020-17:42:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (CudaConvolution) [09/29/2020-17:42:01] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:01] [V] [TRT] *************** Autotuning format combination: Half(64,2048,1:8,65536) -> Half(32,1024,1:8,32768) *************** [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:01] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (CaskConvolution) [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:01] [V] [TRT] Tactic: 9576651994278528 time 0.016352 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 1179757074518529353 time 0.0184 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 2105695814191699972 time 0.026208 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 2148106709480872763 time 0.018688 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 2410442691266548717 time 0.02688 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 3041642431972138763 time 0.016384 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 3754069740140581927 time 0.026624 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 4555462412611657028 time 0.018688 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5666160310350604399 time 0.026624 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:01] [V] [TRT] Tactic: 5876997871499382316 time 0.019808 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 5925270497649423688 time 0.043264 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:01] [V] [TRT] Tactic: 6680916730816870145 time 0.02688 [09/29/2020-17:42:01] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] Tactic: 7158029511300006471 time 0.025984 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] Tactic: 7859952145590271433 time 0.026624 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] Tactic: 8283847742354150423 time 0.02688 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] Tactic: -8992262742606384444 time 0.020352 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] Tactic: -8391760416076885205 time 0.043008 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] Tactic: -6273232454637933930 time 0.018688 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:02] [V] [TRT] Tactic: -5925110308892264213 time 0.01872 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] Tactic: -5818527483287834165 time 0.018432 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:02] [V] [TRT] Tactic: -4908848143422991657 time 0.016384 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] Tactic: -4534876761957424274 time 0.043392 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] Tactic: -3237051169894153788 time 0.025888 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] Tactic: -3136088851200285532 time 0.017248 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] Tactic: -2586046817576862066 time 0.026912 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] Tactic: -2422160065350346448 time 0.02688 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] Tactic: -1216445540764179377 time 0.02688 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] Tactic: -229563042944049199 time 0.018528 [09/29/2020-17:42:02] [V] [TRT] Fastest Tactic: 9576651994278528 Time: 0.016352 [09/29/2020-17:42:02] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (CudaConvolution) [09/29/2020-17:42:02] [V] [TRT] Tactic: 0 time 0.125984 [09/29/2020-17:42:02] [V] [TRT] Tactic: 1 time 0.097952 [09/29/2020-17:42:02] [V] [TRT] Tactic: 2 time 0.204896 [09/29/2020-17:42:02] [V] [TRT] Fastest Tactic: 1 Time: 0.097952 [09/29/2020-17:42:02] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9576651994278528 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:02] [V] [TRT] [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:02] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:02] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [09/29/2020-17:42:02] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144) -> Half(1,32,1024,262144) *************** [09/29/2020-17:42:02] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072) -> Half(1,32,1024:2,131072) *************** [09/29/2020-17:42:02] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Float(1,32,1024,262144) *************** [09/29/2020-17:42:02] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 92) [Convolution] + (Unnamed Layer* 94) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:02] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 92) [Convolution] + (Unnamed Layer* 94) [Activation] (CaskConvolution) [09/29/2020-17:42:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:02] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 92) [Convolution] + (Unnamed Layer* 94) [Activation] (CudaConvolution) [09/29/2020-17:42:02] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:02] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 92) [Convolution] + (Unnamed Layer* 94) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:02] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Half(32,1024,1:8,32768) *************** [09/29/2020-17:42:02] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144), Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [09/29/2020-17:42:02] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144), Half(1,32,1024,262144) -> Half(1,32,1024,262144) *************** [09/29/2020-17:42:02] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072), Half(1,32,1024:2,131072) -> Half(1,32,1024:2,131072) *************** [09/29/2020-17:42:02] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768), Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [09/29/2020-17:42:02] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 95) [Convolution] + (Unnamed Layer* 97) [ElementWise] + (Unnamed Layer* 98) [Activation] (CaskConvolution) [09/29/2020-17:42:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:02] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 95) [Convolution] + (Unnamed Layer* 97) [ElementWise] + (Unnamed Layer* 98) [Activation] (CudaConvolution) [09/29/2020-17:42:02] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:02] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768), Half(32,1024,1:8,32768) -> Half(32,1024,1:8,32768) *************** [09/29/2020-17:42:02] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [09/29/2020-17:42:02] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144) -> Half(1,32,1024,262144) *************** [09/29/2020-17:42:02] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072) -> Half(1,32,1024:2,131072) *************** [09/29/2020-17:42:03] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Float(1,32,1024,262144) *************** [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 99) [Convolution] + (Unnamed Layer* 101) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 99) [Convolution] + (Unnamed Layer* 101) [Activation] (CaskConvolution) [09/29/2020-17:42:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 99) [Convolution] + (Unnamed Layer* 101) [Activation] (CudaConvolution) [09/29/2020-17:42:03] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 99) [Convolution] + (Unnamed Layer* 101) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:03] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Half(32,1024,1:8,32768) *************** [09/29/2020-17:42:03] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144), Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [09/29/2020-17:42:03] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144), Half(1,32,1024,262144) -> Half(1,32,1024,262144) *************** [09/29/2020-17:42:03] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072), Half(1,32,1024:2,131072) -> Half(1,32,1024:2,131072) *************** [09/29/2020-17:42:03] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768), Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 102) [Convolution] + (Unnamed Layer* 104) [ElementWise] + (Unnamed Layer* 105) [Activation] (CaskConvolution) [09/29/2020-17:42:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 102) [Convolution] + (Unnamed Layer* 104) [ElementWise] + (Unnamed Layer* 105) [Activation] (CudaConvolution) [09/29/2020-17:42:03] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:03] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768), Half(32,1024,1:8,32768) -> Half(32,1024,1:8,32768) *************** [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 506 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.007872 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.006112 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.006112 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 506 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.008064 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.00832 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.008064 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 506 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.014496 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 506 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.010528 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.00752 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.00752 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 506 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.008032 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.008032 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 506 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.007776 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.004992 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.004992 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 506 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.014592 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 506 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.006432 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.006432 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 506 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.014592 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 506 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.014592 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 506 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.014592 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.005824 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.005824 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 506 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.011648 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 506 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.012544 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.010496 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 506 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.012224 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.010496 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 506 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.018208 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 506 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.012544 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 499 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.008032 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.006112 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.006112 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 499 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.008192 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 499 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.014592 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.007968 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.007968 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 499 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.010528 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.007488 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.007488 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 499 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.008064 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.008064 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 499 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.008096 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.005824 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.005824 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 499 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.014592 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 499 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 499 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.014592 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 499 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.014496 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 499 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.014592 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.004928 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.004928 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 499 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.006368 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.006368 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 499 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.01168 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.012544 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.01168 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 499 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.012288 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.010496 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 499 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.018432 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.006016 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.006016 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 499 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.013152 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.006432 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.006432 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 492 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.008032 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 492 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.008064 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.007968 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.007968 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 492 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.014336 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 492 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.011648 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.007008 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.007008 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 492 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.008096 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.008224 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.008096 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 492 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.008096 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.005824 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.005824 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 492 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.01488 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.007872 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.007872 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 492 copy (Reformat) [09/29/2020-17:42:03] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:42:03] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:03] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:03] [V] [TRT] --------------- Timing Runner: 492 copy (Reformat) [09/29/2020-17:42:04] [V] [TRT] Tactic: 1002 time 0.012928 [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.009696 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 0 Time: 0.009696 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: 492 copy (Reformat) [09/29/2020-17:42:04] [V] [TRT] Tactic: 1002 time 0.014336 [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: 492 copy (Reformat) [09/29/2020-17:42:04] [V] [TRT] Tactic: 1002 time 0.014592 [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.005856 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 0 Time: 0.005856 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: 492 copy (Reformat) [09/29/2020-17:42:04] [V] [TRT] Tactic: 1002 time 0.010944 [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: 492 copy (Reformat) [09/29/2020-17:42:04] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.012288 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.01024 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: 492 copy (Reformat) [09/29/2020-17:42:04] [V] [TRT] Tactic: 1002 time 0.010656 [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.011104 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.010656 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: 492 copy (Reformat) [09/29/2020-17:42:04] [V] [TRT] Tactic: 1002 time 0.017312 [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.00592 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 0 Time: 0.00592 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: 492 copy (Reformat) [09/29/2020-17:42:04] [V] [TRT] Tactic: 1002 time 0.012576 [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.007424 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 0 Time: 0.007424 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:04] [V] [TRT] Tactic: 1002 time 0.02048 [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.020736 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.02048 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:04] [V] [TRT] Tactic: 1002 time 0.035104 [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.017888 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 0 Time: 0.017888 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:04] [V] [TRT] Tactic: 1002 time 0.026912 [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.015552 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 0 Time: 0.015552 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:04] [V] [TRT] Tactic: 1002 time 0.021824 [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.018432 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 0 Time: 0.018432 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:04] [V] [TRT] Tactic: 1002 time 0.032288 [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.012288 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:04] [V] [TRT] Tactic: 1002 time 0.024096 [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.011936 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 0 Time: 0.011936 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:04] [V] [TRT] Tactic: 1002 time 0.03856 [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.018688 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 0 Time: 0.018688 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:04] [V] [TRT] Tactic: 1002 time 0.036864 [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.012288 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:04] [V] [TRT] Tactic: 1002 time 0.023904 [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:04] [V] [TRT] Tactic: 1002 time 0.028928 [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.017056 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 0 Time: 0.017056 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:04] [V] [TRT] Tactic: 1002 time 0.023392 [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.00848 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 0 Time: 0.00848 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:04] [V] [TRT] Tactic: 1002 time 0.045056 [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [09/29/2020-17:42:04] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,917504) -> Float(1,32,1024,262144) *************** [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:04] [V] [TRT] Tactic: 589823 time 0.322592 [09/29/2020-17:42:04] [V] [TRT] Tactic: 655359 time 0.203008 [09/29/2020-17:42:04] [V] [TRT] Tactic: 786431 time 0.215296 [09/29/2020-17:42:04] [V] [TRT] Tactic: 851967 time 0.116736 [09/29/2020-17:42:04] [V] [TRT] Tactic: 1179647 time 0.106496 [09/29/2020-17:42:04] [V] [TRT] Tactic: 1310719 time 0.155808 [09/29/2020-17:42:04] [V] [TRT] Tactic: 1376255 time 0.220192 [09/29/2020-17:42:04] [V] [TRT] Tactic: 1441791 time 0.14464 [09/29/2020-17:42:04] [V] [TRT] Tactic: 1507327 time 0.120832 [09/29/2020-17:42:04] [V] [TRT] Tactic: 1638399 time 0.17392 [09/29/2020-17:42:04] [V] [TRT] Tactic: 1835007 time 0.217376 [09/29/2020-17:42:04] [V] [TRT] Tactic: 1900543 time 0.217056 [09/29/2020-17:42:04] [V] [TRT] Tactic: 2097151 time 0.151808 [09/29/2020-17:42:04] [V] [TRT] Tactic: 2162687 time 0.231424 [09/29/2020-17:42:04] [V] [TRT] Tactic: 2293759 time 0.2048 [09/29/2020-17:42:04] [V] [TRT] Tactic: 2359295 time 0.129024 [09/29/2020-17:42:04] [V] [TRT] Tactic: 2686975 time 0.213376 [09/29/2020-17:42:04] [V] [TRT] Tactic: 3080191 time 0.116704 [09/29/2020-17:42:04] [V] [TRT] Tactic: 3342335 time 0.122368 [09/29/2020-17:42:04] [V] [TRT] Tactic: 3407871 time 0.127872 [09/29/2020-17:42:04] [V] [TRT] Tactic: 3538943 time 0.120224 [09/29/2020-17:42:04] [V] [TRT] Tactic: 3670015 time 0.382784 [09/29/2020-17:42:04] [V] [TRT] Tactic: 3932159 time 0.178304 [09/29/2020-17:42:04] [V] [TRT] Tactic: 3997695 time 0.192768 [09/29/2020-17:42:04] [V] [TRT] Tactic: 4063231 time 0.116992 [09/29/2020-17:42:04] [V] [TRT] Tactic: 4194303 time 0.167392 [09/29/2020-17:42:04] [V] [TRT] Tactic: 4259839 time 0.139552 [09/29/2020-17:42:04] [V] [TRT] Tactic: 4325375 time 0.172128 [09/29/2020-17:42:04] [V] [TRT] Tactic: 4521983 time 0.217024 [09/29/2020-17:42:04] [V] [TRT] Tactic: 4587519 time 0.159936 [09/29/2020-17:42:04] [V] [TRT] Tactic: 4653055 time 0.100352 [09/29/2020-17:42:04] [V] [TRT] Tactic: 4915199 time 0.151808 [09/29/2020-17:42:04] [V] [TRT] Tactic: 4980735 time 0.175008 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5177343 time 0.124928 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5242879 time 0.123968 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5373951 time 0.160864 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5439487 time 0.313344 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5570559 time 0.118784 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5636095 time 0.116352 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5701631 time 0.2048 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5767167 time 0.659712 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5832703 time 0.126144 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5898239 time 0.104448 [09/29/2020-17:42:04] [V] [TRT] Tactic: 6029311 time 0.191648 [09/29/2020-17:42:04] [V] [TRT] Tactic: 6225919 time 0.112256 [09/29/2020-17:42:04] [V] [TRT] Tactic: 6291455 time 0.105376 [09/29/2020-17:42:04] [V] [TRT] Tactic: 6422527 time 0.110464 [09/29/2020-17:42:04] [V] [TRT] Tactic: 6750207 time 0.196 [09/29/2020-17:42:04] [V] [TRT] Tactic: 6815743 time 0.174144 [09/29/2020-17:42:04] [V] [TRT] Tactic: 6946815 time 0.290816 [09/29/2020-17:42:04] [V] [TRT] Tactic: 7012351 time 0.151808 [09/29/2020-17:42:04] [V] [TRT] Tactic: 7077887 time 0.10016 [09/29/2020-17:42:04] [V] [TRT] Tactic: 7143423 time 0.315264 [09/29/2020-17:42:04] [V] [TRT] Tactic: 7208959 time 0.132704 [09/29/2020-17:42:04] [V] [TRT] Tactic: 7340031 time 0.110848 [09/29/2020-17:42:04] [V] [TRT] Tactic: 7405567 time 0.121696 [09/29/2020-17:42:04] [V] [TRT] Tactic: 7536639 time 0.19072 [09/29/2020-17:42:04] [V] [TRT] Tactic: 7602175 time 0.18432 [09/29/2020-17:42:04] [V] [TRT] Tactic: 7733247 time 0.10528 [09/29/2020-17:42:04] [V] [TRT] Tactic: 7798783 time 0.215296 [09/29/2020-17:42:04] [V] [TRT] Tactic: 8191999 time 0.223616 [09/29/2020-17:42:04] [V] [TRT] Tactic: 8257535 time 0.168672 [09/29/2020-17:42:04] [V] [TRT] Tactic: 8323071 time 0.212544 [09/29/2020-17:42:04] [V] [TRT] Tactic: 8650751 time 0.21696 [09/29/2020-17:42:04] [V] [TRT] Tactic: 8716287 time 0.172288 [09/29/2020-17:42:04] [V] [TRT] Tactic: 9109503 time 0.168832 [09/29/2020-17:42:04] [V] [TRT] Tactic: 9568255 time 0.151808 [09/29/2020-17:42:04] [V] [TRT] Tactic: 9895935 time 0.166752 [09/29/2020-17:42:04] [V] [TRT] Tactic: 10223615 time 0.212928 [09/29/2020-17:42:04] [V] [TRT] Tactic: 10354687 time 0.140576 [09/29/2020-17:42:04] [V] [TRT] Tactic: 10551295 time 0.204704 [09/29/2020-17:42:04] [V] [TRT] Tactic: 10747903 time 0.100608 [09/29/2020-17:42:04] [V] [TRT] Tactic: 10944511 time 0.174336 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 7077887 Time: 0.10016 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (CaskConvolution) [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:42:04] [V] [TRT] Tactic: 1754569683116234317 time 0.132928 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:04] [V] [TRT] Tactic: 1825138533642645384 time 0.133376 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:42:04] [V] [TRT] Tactic: 2733356012094739613 time 0.139264 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:04] [V] [TRT] Tactic: 3915320020053085238 time 0.132832 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:04] [V] [TRT] Tactic: 6808617066150061604 time 0.087232 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:42:04] [V] [TRT] Tactic: 9091006216302412844 time 0.082176 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:04] [V] [TRT] Tactic: -8060443123034038864 time 0.090368 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:04] [V] [TRT] Tactic: -4420849921117327522 time 0.114688 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:04] [V] [TRT] Tactic: -3946921629105938337 time 0.157952 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.082176 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (CudaConvolution) [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.18048 [09/29/2020-17:42:04] [V] [TRT] Tactic: 2 time 0.284032 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5 time 0.327872 [09/29/2020-17:42:04] [V] [TRT] Tactic: 57 time 0.142848 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 57 Time: 0.142848 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:42:04] [V] [TRT] [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:42:04] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,917504) -> Half(1,32,1024,262144) *************** [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:04] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (CaskConvolution) [09/29/2020-17:42:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (CudaConvolution) [09/29/2020-17:42:04] [V] [TRT] Tactic: 0 time 0.204032 [09/29/2020-17:42:04] [V] [TRT] Tactic: 1 time 0.14368 [09/29/2020-17:42:04] [V] [TRT] Tactic: 2 time 0.253216 [09/29/2020-17:42:04] [V] [TRT] Tactic: 4 time 5.95821 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5 time 0.313344 [09/29/2020-17:42:04] [V] [TRT] Fastest Tactic: 1 Time: 0.14368 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [09/29/2020-17:42:04] [V] [TRT] [09/29/2020-17:42:04] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,458752) -> Half(1,32,1024,262144) *************** [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:04] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (CaskConvolution) [09/29/2020-17:42:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (CudaConvolution) [09/29/2020-17:42:04] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:04] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,458752) -> Half(1,32,1024:2,131072) *************** [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:04] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:04] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:04] [V] [TRT] Tactic: 589823 time 0.169568 [09/29/2020-17:42:04] [V] [TRT] Tactic: 655359 time 0.107872 [09/29/2020-17:42:04] [V] [TRT] Tactic: 786431 time 0.114944 [09/29/2020-17:42:04] [V] [TRT] Tactic: 851967 time 0.05728 [09/29/2020-17:42:04] [V] [TRT] Tactic: 1179647 time 0.055296 [09/29/2020-17:42:04] [V] [TRT] Tactic: 1310719 time 0.080128 [09/29/2020-17:42:04] [V] [TRT] Tactic: 1376255 time 0.084992 [09/29/2020-17:42:04] [V] [TRT] Tactic: 1441791 time 0.062304 [09/29/2020-17:42:04] [V] [TRT] Tactic: 1507327 time 0.049408 [09/29/2020-17:42:04] [V] [TRT] Tactic: 1638399 time 0.09216 [09/29/2020-17:42:04] [V] [TRT] Tactic: 1835007 time 0.112256 [09/29/2020-17:42:04] [V] [TRT] Tactic: 1900543 time 0.086016 [09/29/2020-17:42:04] [V] [TRT] Tactic: 2097151 time 0.082208 [09/29/2020-17:42:04] [V] [TRT] Tactic: 2162687 time 0.090112 [09/29/2020-17:42:04] [V] [TRT] Tactic: 2293759 time 0.076032 [09/29/2020-17:42:04] [V] [TRT] Tactic: 2359295 time 0.052608 [09/29/2020-17:42:04] [V] [TRT] Tactic: 2686975 time 0.080128 [09/29/2020-17:42:04] [V] [TRT] Tactic: 3080191 time 0.05776 [09/29/2020-17:42:04] [V] [TRT] Tactic: 3342335 time 0.051456 [09/29/2020-17:42:04] [V] [TRT] Tactic: 3407871 time 0.0552 [09/29/2020-17:42:04] [V] [TRT] Tactic: 3538943 time 0.057344 [09/29/2020-17:42:04] [V] [TRT] Tactic: 3670015 time 0.14528 [09/29/2020-17:42:04] [V] [TRT] Tactic: 3932159 time 0.071968 [09/29/2020-17:42:04] [V] [TRT] Tactic: 3997695 time 0.10272 [09/29/2020-17:42:04] [V] [TRT] Tactic: 4063231 time 0.055776 [09/29/2020-17:42:04] [V] [TRT] Tactic: 4194303 time 0.08272 [09/29/2020-17:42:04] [V] [TRT] Tactic: 4259839 time 0.073984 [09/29/2020-17:42:04] [V] [TRT] Tactic: 4325375 time 0.090368 [09/29/2020-17:42:04] [V] [TRT] Tactic: 4521983 time 0.092128 [09/29/2020-17:42:04] [V] [TRT] Tactic: 4587519 time 0.085408 [09/29/2020-17:42:04] [V] [TRT] Tactic: 4653055 time 0.0512 [09/29/2020-17:42:04] [V] [TRT] Tactic: 4915199 time 0.080128 [09/29/2020-17:42:04] [V] [TRT] Tactic: 4980735 time 0.102432 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5177343 time 0.065536 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5242879 time 0.063744 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5373951 time 0.083968 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5439487 time 0.160608 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5570559 time 0.04736 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5636095 time 0.055936 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5701631 time 0.075808 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5767167 time 0.33008 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5832703 time 0.059104 [09/29/2020-17:42:04] [V] [TRT] Tactic: 5898239 time 0.054368 [09/29/2020-17:42:04] [V] [TRT] Tactic: 6029311 time 0.07168 [09/29/2020-17:42:04] [V] [TRT] Tactic: 6225919 time 0.058208 [09/29/2020-17:42:04] [V] [TRT] Tactic: 6291455 time 0.055296 [09/29/2020-17:42:04] [V] [TRT] Tactic: 6422527 time 0.051456 [09/29/2020-17:42:04] [V] [TRT] Tactic: 6750207 time 0.100352 [09/29/2020-17:42:04] [V] [TRT] Tactic: 6815743 time 0.093664 [09/29/2020-17:42:04] [V] [TRT] Tactic: 6946815 time 0.147456 [09/29/2020-17:42:04] [V] [TRT] Tactic: 7012351 time 0.083232 [09/29/2020-17:42:04] [V] [TRT] Tactic: 7077887 time 0.0512 [09/29/2020-17:42:04] [V] [TRT] Tactic: 7143423 time 0.157952 [09/29/2020-17:42:04] [V] [TRT] Tactic: 7208959 time 0.065632 [09/29/2020-17:42:04] [V] [TRT] Tactic: 7340031 time 0.056736 [09/29/2020-17:42:04] [V] [TRT] Tactic: 7405567 time 0.059648 [09/29/2020-17:42:04] [V] [TRT] Tactic: 7536639 time 0.08048 [09/29/2020-17:42:04] [V] [TRT] Tactic: 7602175 time 0.095232 [09/29/2020-17:42:04] [V] [TRT] Tactic: 7733247 time 0.055296 [09/29/2020-17:42:04] [V] [TRT] Tactic: 7798783 time 0.114688 [09/29/2020-17:42:04] [V] [TRT] Tactic: 8191999 time 0.118304 [09/29/2020-17:42:05] [V] [TRT] Tactic: 8257535 time 0.08832 [09/29/2020-17:42:05] [V] [TRT] Tactic: 8323071 time 0.108544 [09/29/2020-17:42:05] [V] [TRT] Tactic: 8650751 time 0.110592 [09/29/2020-17:42:05] [V] [TRT] Tactic: 8716287 time 0.090176 [09/29/2020-17:42:05] [V] [TRT] Tactic: 9109503 time 0.090368 [09/29/2020-17:42:05] [V] [TRT] Tactic: 9568255 time 0.079872 [09/29/2020-17:42:05] [V] [TRT] Tactic: 9895935 time 0.083072 [09/29/2020-17:42:05] [V] [TRT] Tactic: 10223615 time 0.079872 [09/29/2020-17:42:05] [V] [TRT] Tactic: 10354687 time 0.073984 [09/29/2020-17:42:05] [V] [TRT] Tactic: 10551295 time 0.104448 [09/29/2020-17:42:05] [V] [TRT] Tactic: 10747903 time 0.051456 [09/29/2020-17:42:05] [V] [TRT] Tactic: 10944511 time 0.102432 [09/29/2020-17:42:05] [V] [TRT] Fastest Tactic: 5570559 Time: 0.04736 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (CaskConvolution) [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 1651411198763708804 time 0.046944 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 2418518597804310654 time 0.046624 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 4318470497547290900 time 0.045312 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 4930470141256631146 time 0.07664 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 8292881859266835088 time 0.0528 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 8401509141903434922 time 0.044928 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -8654297089785671176 time 0.069888 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -7516584506774355935 time 0.073184 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -7140760933967189247 time 0.043136 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -6004726995029373073 time 0.05136 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -5719726816705110014 time 0.069888 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -4097850214384059472 time 0.072352 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -3717489476759089008 time 0.042496 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -3689982367035295496 time 0.070432 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -2640575123064142123 time 0.069856 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -2534402059426524406 time 0.069632 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -2027588946874785071 time 0.049408 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -1968398013367819764 time 0.071072 [09/29/2020-17:42:05] [V] [TRT] Fastest Tactic: -3717489476759089008 Time: 0.042496 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (CudaConvolution) [09/29/2020-17:42:05] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3717489476759089008 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:05] [V] [TRT] [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:05] [V] [TRT] *************** Autotuning format combination: Half(112,3584,1:8,114688) -> Float(1,32,1024,262144) *************** [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (CaskConvolution) [09/29/2020-17:42:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (CudaConvolution) [09/29/2020-17:42:05] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:05] [V] [TRT] *************** Autotuning format combination: Half(112,3584,1:8,114688) -> Half(32,1024,1:8,32768) *************** [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (CaskConvolution) [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:05] [V] [TRT] Tactic: 9576651994278528 time 0.02352 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 1179757074518529353 time 0.026624 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 2105695814191699972 time 0.039488 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 2148106709480872763 time 0.02752 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 2410442691266548717 time 0.041216 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 3041642431972138763 time 0.024576 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 3754069740140581927 time 0.041248 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 4555462412611657028 time 0.02816 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 5666160310350604399 time 0.041216 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:05] [V] [TRT] Tactic: 5876997871499382316 time 0.028416 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 5925270497649423688 time 0.069856 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 6680916730816870145 time 0.041216 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 7158029511300006471 time 0.039168 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 7859952145590271433 time 0.041152 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 8283847742354150423 time 0.041216 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -8992262742606384444 time 0.028672 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -8391760416076885205 time 0.069856 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -6273232454637933930 time 0.025344 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:05] [V] [TRT] Tactic: -5925110308892264213 time 0.028576 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -5818527483287834165 time 0.026176 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:05] [V] [TRT] Tactic: -4908848143422991657 time 0.023712 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -4534876761957424274 time 0.069632 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -3237051169894153788 time 0.038912 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -3136088851200285532 time 0.024832 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -2586046817576862066 time 0.04096 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -2422160065350346448 time 0.042464 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -1216445540764179377 time 0.040608 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -229563042944049199 time 0.02544 [09/29/2020-17:42:05] [V] [TRT] Fastest Tactic: 9576651994278528 Time: 0.02352 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (CudaConvolution) [09/29/2020-17:42:05] [V] [TRT] Tactic: 0 time 0.2104 [09/29/2020-17:42:05] [V] [TRT] Tactic: 1 time 0.155072 [09/29/2020-17:42:05] [V] [TRT] Tactic: 2 time 0.271744 [09/29/2020-17:42:05] [V] [TRT] Fastest Tactic: 1 Time: 0.155072 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9576651994278528 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:05] [V] [TRT] [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:05] [V] [TRT] Tactic: 1002 time 0.010944 [09/29/2020-17:42:05] [V] [TRT] Tactic: 0 time 0.01792 [09/29/2020-17:42:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.010944 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:05] [V] [TRT] Tactic: 1002 time 0.012544 [09/29/2020-17:42:05] [V] [TRT] Tactic: 0 time 0.017824 [09/29/2020-17:42:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.012544 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:05] [V] [TRT] Tactic: 1002 time 0.010336 [09/29/2020-17:42:05] [V] [TRT] Tactic: 0 time 0.017984 [09/29/2020-17:42:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.010336 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:05] [V] [TRT] Tactic: 1002 time 0.014208 [09/29/2020-17:42:05] [V] [TRT] Tactic: 0 time 0.022432 [09/29/2020-17:42:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.014208 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:05] [V] [TRT] Tactic: 1002 time 0.014592 [09/29/2020-17:42:05] [V] [TRT] Tactic: 0 time 0.012416 [09/29/2020-17:42:05] [V] [TRT] Fastest Tactic: 0 Time: 0.012416 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:05] [V] [TRT] Tactic: 1002 time 0.014592 [09/29/2020-17:42:05] [V] [TRT] Tactic: 0 time 0.01216 [09/29/2020-17:42:05] [V] [TRT] Fastest Tactic: 0 Time: 0.01216 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:05] [V] [TRT] Tactic: 1002 time 0.018144 [09/29/2020-17:42:05] [V] [TRT] Tactic: 0 time 0.012288 [09/29/2020-17:42:05] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:05] [V] [TRT] Tactic: 1002 time 0.014592 [09/29/2020-17:42:05] [V] [TRT] Tactic: 0 time 0.009088 [09/29/2020-17:42:05] [V] [TRT] Fastest Tactic: 0 Time: 0.009088 [09/29/2020-17:42:05] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,27648) *************** [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 145) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:05] [V] [TRT] Tactic: 524287 time 0.126112 [09/29/2020-17:42:05] [V] [TRT] Tactic: 1048575 time 0.08544 [09/29/2020-17:42:05] [V] [TRT] Tactic: 1703935 time 0.044896 [09/29/2020-17:42:05] [V] [TRT] Tactic: 2228223 time 0.092832 [09/29/2020-17:42:05] [V] [TRT] Tactic: 2424831 time 0.039904 [09/29/2020-17:42:05] [V] [TRT] Tactic: 2621439 time 0.03824 [09/29/2020-17:42:05] [V] [TRT] Tactic: 3014655 time 0.054752 [09/29/2020-17:42:05] [V] [TRT] Tactic: 3604479 time 0.055296 [09/29/2020-17:42:05] [V] [TRT] Tactic: 5046271 time 0.068864 [09/29/2020-17:42:05] [V] [TRT] Tactic: 6160383 time 0.11088 [09/29/2020-17:42:05] [V] [TRT] Tactic: 6488063 time 0.094464 [09/29/2020-17:42:05] [V] [TRT] Tactic: 7864319 time 0.03904 [09/29/2020-17:42:05] [V] [TRT] Tactic: 8585215 time 0.14832 [09/29/2020-17:42:05] [V] [TRT] Tactic: 8847359 time 0.041216 [09/29/2020-17:42:05] [V] [TRT] Tactic: 9043967 time 0.05104 [09/29/2020-17:42:05] [V] [TRT] Tactic: 9175039 time 0.055296 [09/29/2020-17:42:05] [V] [TRT] Tactic: 9961471 time 0.045056 [09/29/2020-17:42:05] [V] [TRT] Tactic: 10027007 time 0.075776 [09/29/2020-17:42:05] [V] [TRT] Tactic: 10485759 time 0.042336 [09/29/2020-17:42:05] [V] [TRT] Tactic: 10682367 time 0.03728 [09/29/2020-17:42:05] [V] [TRT] Fastest Tactic: 10682367 Time: 0.03728 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 145) [Convolution] (CaskConvolution) [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 1825138533642645384 time 0.333216 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 2775507031594384867 time 0.050624 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 2842488832350522458 time 0.207104 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 3915320020053085238 time 0.323328 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 6448355332020552203 time 0.33408 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 6808617066150061604 time 0.193408 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -8060443123034038864 time 0.219392 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -4420849921117327522 time 0.194816 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -3946921629105938337 time 0.230688 [09/29/2020-17:42:05] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.050624 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 145) [Convolution] (CudaConvolution) [09/29/2020-17:42:05] [V] [TRT] Tactic: 0 time 0.08992 [09/29/2020-17:42:05] [V] [TRT] Tactic: 2 time 0.171456 [09/29/2020-17:42:05] [V] [TRT] Tactic: 5 time 0.475776 [09/29/2020-17:42:05] [V] [TRT] Tactic: 6 time 0.053504 [09/29/2020-17:42:05] [V] [TRT] Tactic: 57 time 0.089056 [09/29/2020-17:42:05] [V] [TRT] Fastest Tactic: 6 Time: 0.053504 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 145) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10682367 [09/29/2020-17:42:05] [V] [TRT] [09/29/2020-17:42:05] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144) -> Half(1,32,1024,27648) *************** [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 145) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 145) [Convolution] (CaskConvolution) [09/29/2020-17:42:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 145) [Convolution] (CudaConvolution) [09/29/2020-17:42:05] [V] [TRT] Tactic: 0 time 0.125184 [09/29/2020-17:42:05] [V] [TRT] Tactic: 1 time 0.126976 [09/29/2020-17:42:05] [V] [TRT] Tactic: 2 time 0.151168 [09/29/2020-17:42:05] [V] [TRT] Tactic: 4 time 1.32006 [09/29/2020-17:42:05] [V] [TRT] Tactic: 5 time 0.469952 [09/29/2020-17:42:05] [V] [TRT] Tactic: 6 time 0.08192 [09/29/2020-17:42:05] [V] [TRT] Fastest Tactic: 6 Time: 0.08192 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 145) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [09/29/2020-17:42:05] [V] [TRT] [09/29/2020-17:42:05] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072) -> Half(1,32,1024:2,14336) *************** [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 145) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:05] [V] [TRT] Tactic: 524287 time 0.067872 [09/29/2020-17:42:05] [V] [TRT] Tactic: 1048575 time 0.04656 [09/29/2020-17:42:05] [V] [TRT] Tactic: 1703935 time 0.02688 [09/29/2020-17:42:05] [V] [TRT] Tactic: 2228223 time 0.049408 [09/29/2020-17:42:05] [V] [TRT] Tactic: 2424831 time 0.024576 [09/29/2020-17:42:05] [V] [TRT] Tactic: 2621439 time 0.022368 [09/29/2020-17:42:05] [V] [TRT] Tactic: 3014655 time 0.032736 [09/29/2020-17:42:05] [V] [TRT] Tactic: 3604479 time 0.032768 [09/29/2020-17:42:05] [V] [TRT] Tactic: 5046271 time 0.040352 [09/29/2020-17:42:05] [V] [TRT] Tactic: 6160383 time 0.061344 [09/29/2020-17:42:05] [V] [TRT] Tactic: 6488063 time 0.05312 [09/29/2020-17:42:05] [V] [TRT] Tactic: 7864319 time 0.022784 [09/29/2020-17:42:05] [V] [TRT] Tactic: 8585215 time 0.081824 [09/29/2020-17:42:05] [V] [TRT] Tactic: 8847359 time 0.024832 [09/29/2020-17:42:05] [V] [TRT] Tactic: 9043967 time 0.029728 [09/29/2020-17:42:05] [V] [TRT] Tactic: 9175039 time 0.032768 [09/29/2020-17:42:05] [V] [TRT] Tactic: 9961471 time 0.026592 [09/29/2020-17:42:05] [V] [TRT] Tactic: 10027007 time 0.043264 [09/29/2020-17:42:05] [V] [TRT] Tactic: 10485759 time 0.024832 [09/29/2020-17:42:05] [V] [TRT] Tactic: 10682367 time 0.021824 [09/29/2020-17:42:05] [V] [TRT] Fastest Tactic: 10682367 Time: 0.021824 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 145) [Convolution] (CaskConvolution) [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 1145226902788474763 time 0.119072 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 1651411198763708804 time 0.116128 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 2418518597804310654 time 0.114464 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 4318470497547290900 time 0.1024 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 4653005425971292725 time 0.117312 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 4930470141256631146 time 0.120576 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 8292881859266835088 time 0.121088 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 8401509141903434922 time 0.100352 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -8654297089785671176 time 0.167552 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -7448936905981214224 time 0.134752 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -6004726995029373073 time 0.102656 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -5719726816705110014 time 0.166912 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -3754890472406891741 time 0.173632 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -3689982367035295496 time 0.169984 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -3140347171730126532 time 0.026976 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -2894005464278291378 time 0.127232 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -2027588946874785071 time 0.098304 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -1968398013367819764 time 0.17024 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -245090590808296743 time 0.173984 [09/29/2020-17:42:05] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.026976 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 145) [Convolution] (CudaConvolution) [09/29/2020-17:42:05] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 145) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10682367 [09/29/2020-17:42:05] [V] [TRT] [09/29/2020-17:42:05] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Float(1,32,1024,27648) *************** [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 145) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 145) [Convolution] (CaskConvolution) [09/29/2020-17:42:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 145) [Convolution] (CudaConvolution) [09/29/2020-17:42:05] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 145) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:05] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Half(4,128,1:8,4096) *************** [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 145) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 145) [Convolution] (CaskConvolution) [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:05] [V] [TRT] Tactic: 130343752241278875 time 0.026144 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 2148106709480872763 time 0.05504 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 2410442691266548717 time 0.090112 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:05] [V] [TRT] Tactic: 2921824978225832523 time 0.024576 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:05] [V] [TRT] Tactic: 3030711443478140260 time 0.030976 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 3754069740140581927 time 0.092416 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 3823144360994712832 time 0.053536 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 5635311898703673455 time 0.053536 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 5925270497649423688 time 0.165888 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 6680916730816870145 time 0.091008 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 7158029511300006471 time 0.089344 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 7859952145590271433 time 0.090112 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: 8283847742354150423 time 0.092416 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -8992262742606384444 time 0.059648 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -8682550625095202832 time 0.059392 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:05] [V] [TRT] Tactic: -8379842433586149932 time 0.032224 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:05] [V] [TRT] Tactic: -6352769237623756264 time 0.033024 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -6273232454637933930 time 0.053248 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -5818527483287834165 time 0.052352 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -4954692664176521434 time 0.091712 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:05] [V] [TRT] Tactic: -4953888146171240997 time 0.022528 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -4534876761957424274 time 0.164864 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -3237051169894153788 time 0.087424 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -3136088851200285532 time 0.051168 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -2586046817576862066 time 0.090976 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] Tactic: -229563042944049199 time 0.053536 [09/29/2020-17:42:05] [V] [TRT] Fastest Tactic: -4953888146171240997 Time: 0.022528 [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 145) [Convolution] (CudaConvolution) [09/29/2020-17:42:05] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:05] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 145) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4953888146171240997 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:05] [V] [TRT] [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:05] [V] [TRT] (Unnamed Layer* 145) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:06] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,16,256,131072) *************** [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:06] [V] [TRT] Tactic: 458751 time 0.212576 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: 458751 Time: 0.212576 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (CaskConvolution) [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 1825138533642645384 time 0.330048 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 2842488832350522458 time 0.215328 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 3915320020053085238 time 0.325312 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 6448355332020552203 time 0.33376 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 6808617066150061604 time 0.200704 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -8060443123034038864 time 0.22144 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -4420849921117327522 time 0.266496 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -3946921629105938337 time 0.30336 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.200704 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (CudaConvolution) [09/29/2020-17:42:06] [V] [TRT] Tactic: 0 time 0.436288 [09/29/2020-17:42:06] [V] [TRT] Tactic: 2 time 0.456128 [09/29/2020-17:42:06] [V] [TRT] Tactic: 5 time 7.32838 [09/29/2020-17:42:06] [V] [TRT] Tactic: 57 time 0.142944 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: 57 Time: 0.142944 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 57 [09/29/2020-17:42:06] [V] [TRT] [09/29/2020-17:42:06] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144) -> Half(1,16,256,131072) *************** [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (CaskConvolution) [09/29/2020-17:42:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (CudaConvolution) [09/29/2020-17:42:06] [V] [TRT] Tactic: 0 time 0.47744 [09/29/2020-17:42:06] [V] [TRT] Tactic: 1 time 0.339904 [09/29/2020-17:42:06] [V] [TRT] Tactic: 2 time 0.458208 [09/29/2020-17:42:06] [V] [TRT] Tactic: 5 time 7.23338 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: 1 Time: 0.339904 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [09/29/2020-17:42:06] [V] [TRT] [09/29/2020-17:42:06] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072) -> Half(1,16,256:2,65536) *************** [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:06] [V] [TRT] Tactic: 458751 time 0.106752 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: 458751 Time: 0.106752 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (CaskConvolution) [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 1145226902788474763 time 0.116224 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 1651411198763708804 time 0.114688 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 2418518597804310654 time 0.113504 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 4318470497547290900 time 0.10272 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 4653005425971292725 time 0.116992 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 4930470141256631146 time 0.12288 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 8292881859266835088 time 0.12512 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 8401509141903434922 time 0.101216 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -8654297089785671176 time 0.167936 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -7448936905981214224 time 0.13504 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -6004726995029373073 time 0.11264 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -5719726816705110014 time 0.167392 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -3754890472406891741 time 0.173664 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -3689982367035295496 time 0.169568 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -2894005464278291378 time 0.13296 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -2027588946874785071 time 0.107936 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -1968398013367819764 time 0.16944 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -245090590808296743 time 0.172896 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 0.101216 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (CudaConvolution) [09/29/2020-17:42:06] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8401509141903434922 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:06] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Float(1,16,256,131072) *************** [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (CaskConvolution) [09/29/2020-17:42:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (CudaConvolution) [09/29/2020-17:42:06] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:06] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Half(64,1024,1:8,16384) *************** [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (CaskConvolution) [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:06] [V] [TRT] Tactic: 130343752241278875 time 0.035776 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 2148106709480872763 time 0.057344 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 2410442691266548717 time 0.090048 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:06] [V] [TRT] Tactic: 2921824978225832523 time 0.032768 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:06] [V] [TRT] Tactic: 3030711443478140260 time 0.051424 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 3754069740140581927 time 0.094208 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 3823144360994712832 time 0.053536 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 5635311898703673455 time 0.053536 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 5925270497649423688 time 0.166144 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 6680916730816870145 time 0.091648 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 7158029511300006471 time 0.08832 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 7859952145590271433 time 0.090368 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: 8283847742354150423 time 0.092416 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -8992262742606384444 time 0.061984 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -8682550625095202832 time 0.060896 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:06] [V] [TRT] Tactic: -8379842433586149932 time 0.0512 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:06] [V] [TRT] Tactic: -6352769237623756264 time 0.053504 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -6273232454637933930 time 0.053504 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -5818527483287834165 time 0.051648 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -4954692664176521434 time 0.09168 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:06] [V] [TRT] Tactic: -4953888146171240997 time 0.032704 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -4534876761957424274 time 0.165792 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -3237051169894153788 time 0.087392 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -3136088851200285532 time 0.05056 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -2586046817576862066 time 0.090976 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] Tactic: -229563042944049199 time 0.053504 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: -4953888146171240997 Time: 0.032704 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (CudaConvolution) [09/29/2020-17:42:06] [V] [TRT] Tactic: 0 time 0.505568 [09/29/2020-17:42:06] [V] [TRT] Tactic: 1 time 1.00586 [09/29/2020-17:42:06] [V] [TRT] Tactic: 2 time 0.473376 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: 2 Time: 0.473376 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4953888146171240997 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:06] [V] [TRT] [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:06] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:06] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,16,256,65536) *************** [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 110) [Pooling] (Pooling) [09/29/2020-17:42:06] [V] [TRT] Tactic: -1 time 0.006272 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: -1 Time: 0.006272 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 110) [Pooling] (TiledPooling) [09/29/2020-17:42:06] [V] [TRT] Tactic: 5505281 time 0.010176 [09/29/2020-17:42:06] [V] [TRT] Tactic: 5570817 time 0.008192 [09/29/2020-17:42:06] [V] [TRT] Tactic: 5636353 time 0.0064 [09/29/2020-17:42:06] [V] [TRT] Tactic: 5701889 time 0.007232 [09/29/2020-17:42:06] [V] [TRT] Tactic: 5767425 time 0.0064 [09/29/2020-17:42:06] [V] [TRT] Tactic: 5832961 time 0.0064 [09/29/2020-17:42:06] [V] [TRT] Tactic: 5898497 time 0.0064 [09/29/2020-17:42:06] [V] [TRT] Tactic: 5964033 time 0.006144 [09/29/2020-17:42:06] [V] [TRT] Tactic: 6029569 time 0.006688 [09/29/2020-17:42:06] [V] [TRT] Tactic: 6095105 time 0.0064 [09/29/2020-17:42:06] [V] [TRT] Tactic: 6160641 time 0.004992 [09/29/2020-17:42:06] [V] [TRT] Tactic: 6226177 time 0.006048 [09/29/2020-17:42:06] [V] [TRT] Tactic: 6291713 time 0.00608 [09/29/2020-17:42:06] [V] [TRT] Tactic: 6357249 time 0.005856 [09/29/2020-17:42:06] [V] [TRT] Tactic: 6422785 time 0.005888 [09/29/2020-17:42:06] [V] [TRT] Tactic: 6488321 time 0.006144 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: 6160641 Time: 0.004992 [09/29/2020-17:42:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 6160641 [09/29/2020-17:42:06] [V] [TRT] [09/29/2020-17:42:06] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144) -> Half(1,16,256,65536) *************** [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 110) [Pooling] (Pooling) [09/29/2020-17:42:06] [V] [TRT] Tactic: -1 time 0.005888 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: -1 Time: 0.005888 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 110) [Pooling] (TiledPooling) [09/29/2020-17:42:06] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [09/29/2020-17:42:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -1 [09/29/2020-17:42:06] [V] [TRT] [09/29/2020-17:42:06] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072) -> Half(1,16,256:2,32768) *************** [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 110) [Pooling] (Pooling) [09/29/2020-17:42:06] [V] [TRT] Tactic: -3 time 0.005984 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: -3 Time: 0.005984 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 110) [Pooling] (TiledPooling) [09/29/2020-17:42:06] [V] [TRT] Tactic: 5505281 time 0.007008 [09/29/2020-17:42:06] [V] [TRT] Tactic: 5570817 time 0.006432 [09/29/2020-17:42:06] [V] [TRT] Tactic: 5636353 time 0.006144 [09/29/2020-17:42:06] [V] [TRT] Tactic: 5701889 time 0.006144 [09/29/2020-17:42:06] [V] [TRT] Tactic: 5767425 time 0.006144 [09/29/2020-17:42:06] [V] [TRT] Tactic: 5832961 time 0.006016 [09/29/2020-17:42:06] [V] [TRT] Tactic: 5898497 time 0.006176 [09/29/2020-17:42:06] [V] [TRT] Tactic: 5964033 time 0.006112 [09/29/2020-17:42:06] [V] [TRT] Tactic: 6029569 time 0.006144 [09/29/2020-17:42:06] [V] [TRT] Tactic: 6095105 time 0.004992 [09/29/2020-17:42:06] [V] [TRT] Tactic: 6160641 time 0.006144 [09/29/2020-17:42:06] [V] [TRT] Tactic: 6226177 time 0.005984 [09/29/2020-17:42:06] [V] [TRT] Tactic: 6291713 time 0.005984 [09/29/2020-17:42:06] [V] [TRT] Tactic: 6357249 time 0.005856 [09/29/2020-17:42:06] [V] [TRT] Tactic: 6422785 time 0.005824 [09/29/2020-17:42:06] [V] [TRT] Tactic: 6488321 time 0.005856 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: 6095105 Time: 0.004992 [09/29/2020-17:42:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 6095105 [09/29/2020-17:42:06] [V] [TRT] [09/29/2020-17:42:06] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Half(32,512,1:8,8192) *************** [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 110) [Pooling] (Pooling) [09/29/2020-17:42:06] [V] [TRT] Tactic: -2 time 0.00496 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: -2 Time: 0.00496 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 110) [Pooling] (TiledPooling) [09/29/2020-17:42:06] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [09/29/2020-17:42:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -2 [09/29/2020-17:42:06] [V] [TRT] [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:06] [V] [TRT] Tactic: 1002 time 0.004992 [09/29/2020-17:42:06] [V] [TRT] Tactic: 0 time 0.005952 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.004992 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:06] [V] [TRT] Tactic: 1002 time 0.008192 [09/29/2020-17:42:06] [V] [TRT] Tactic: 0 time 0.005824 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: 0 Time: 0.005824 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:06] [V] [TRT] Tactic: 1002 time 0.0064 [09/29/2020-17:42:06] [V] [TRT] Tactic: 0 time 0.005952 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: 0 Time: 0.005952 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:06] [V] [TRT] Tactic: 1002 time 0.005824 [09/29/2020-17:42:06] [V] [TRT] Tactic: 0 time 0.00496 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: 0 Time: 0.00496 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:06] [V] [TRT] Tactic: 1002 time 0.008192 [09/29/2020-17:42:06] [V] [TRT] Tactic: 0 time 0.005312 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: 0 Time: 0.005312 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:06] [V] [TRT] Tactic: 1002 time 0.0064 [09/29/2020-17:42:06] [V] [TRT] Tactic: 0 time 0.005856 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: 0 Time: 0.005856 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:06] [V] [TRT] Tactic: 1002 time 0.008192 [09/29/2020-17:42:06] [V] [TRT] Tactic: 0 time 0.004096 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:06] [V] [TRT] Tactic: 1002 time 0.008288 [09/29/2020-17:42:06] [V] [TRT] Tactic: 0 time 0.004928 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: 0 Time: 0.004928 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:06] [V] [TRT] Tactic: 1002 time 0.007872 [09/29/2020-17:42:06] [V] [TRT] Tactic: 0 time 0.004352 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:06] [V] [TRT] Tactic: 1002 time 0.006432 [09/29/2020-17:42:06] [V] [TRT] Tactic: 0 time 0.004384 [09/29/2020-17:42:06] [V] [TRT] Fastest Tactic: 0 Time: 0.004384 [09/29/2020-17:42:06] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:07] [V] [TRT] Tactic: 1002 time 0.007456 [09/29/2020-17:42:07] [V] [TRT] Tactic: 0 time 0.00432 [09/29/2020-17:42:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00432 [09/29/2020-17:42:07] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:07] [V] [TRT] Tactic: 1002 time 0.008448 [09/29/2020-17:42:07] [V] [TRT] Tactic: 0 time 0.004384 [09/29/2020-17:42:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004384 [09/29/2020-17:42:07] [V] [TRT] *************** Autotuning format combination: -> Float(1,3,9,2304) *************** [09/29/2020-17:42:07] [V] [TRT] *************** Autotuning format combination: -> Half(1,3,9,2304) *************** [09/29/2020-17:42:07] [V] [TRT] *************** Autotuning format combination: -> Float(1) *************** [09/29/2020-17:42:07] [V] [TRT] *************** Autotuning format combination: -> Half(1) *************** [09/29/2020-17:42:07] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:07] [V] [TRT] Tactic: 1002 time 0.006144 [09/29/2020-17:42:07] [V] [TRT] Tactic: 0 time 0.00624 [09/29/2020-17:42:07] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144 [09/29/2020-17:42:07] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:07] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:42:07] [V] [TRT] Tactic: 0 time 0.00592 [09/29/2020-17:42:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00592 [09/29/2020-17:42:07] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:07] [V] [TRT] Tactic: 1002 time 0.00704 [09/29/2020-17:42:07] [V] [TRT] Tactic: 0 time 0.006016 [09/29/2020-17:42:07] [V] [TRT] Fastest Tactic: 0 Time: 0.006016 [09/29/2020-17:42:07] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:07] [V] [TRT] Tactic: 1002 time 0.006144 [09/29/2020-17:42:07] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:07] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144 [09/29/2020-17:42:07] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:07] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:42:07] [V] [TRT] Tactic: 0 time 0.005984 [09/29/2020-17:42:07] [V] [TRT] Fastest Tactic: 0 Time: 0.005984 [09/29/2020-17:42:07] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:07] [V] [TRT] Tactic: 1002 time 0.008064 [09/29/2020-17:42:07] [V] [TRT] Tactic: 0 time 0.00592 [09/29/2020-17:42:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00592 [09/29/2020-17:42:07] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:07] [V] [TRT] Tactic: 1002 time 0.011552 [09/29/2020-17:42:07] [V] [TRT] Tactic: 0 time 0.00496 [09/29/2020-17:42:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00496 [09/29/2020-17:42:07] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:07] [V] [TRT] Tactic: 1002 time 0.010272 [09/29/2020-17:42:07] [V] [TRT] Tactic: 0 time 0.004992 [09/29/2020-17:42:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004992 [09/29/2020-17:42:07] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:07] [V] [TRT] Tactic: 1002 time 0.008064 [09/29/2020-17:42:07] [V] [TRT] Tactic: 0 time 0.004352 [09/29/2020-17:42:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [09/29/2020-17:42:07] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:07] [V] [TRT] Tactic: 1002 time 0.00816 [09/29/2020-17:42:07] [V] [TRT] Tactic: 0 time 0.005984 [09/29/2020-17:42:07] [V] [TRT] Fastest Tactic: 0 Time: 0.005984 [09/29/2020-17:42:07] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:07] [V] [TRT] Tactic: 1002 time 0.008064 [09/29/2020-17:42:07] [V] [TRT] Tactic: 0 time 0.00496 [09/29/2020-17:42:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00496 [09/29/2020-17:42:07] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:07] [V] [TRT] Tactic: 1002 time 0.012544 [09/29/2020-17:42:07] [V] [TRT] Tactic: 0 time 0.005696 [09/29/2020-17:42:07] [V] [TRT] Fastest Tactic: 0 Time: 0.005696 [09/29/2020-17:42:07] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [09/29/2020-17:42:07] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:07] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:07] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:42:07] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:07] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:42:07] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:07] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:07] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:07] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:07] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 116) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:07] [V] [TRT] Tactic: 524287 time 0.364768 [09/29/2020-17:42:07] [V] [TRT] Tactic: 720895 time 0.366592 [09/29/2020-17:42:07] [V] [TRT] Tactic: 983039 time 0.256 [09/29/2020-17:42:07] [V] [TRT] Tactic: 1048575 time 0.290816 [09/29/2020-17:42:07] [V] [TRT] Tactic: 1703935 time 0.200736 [09/29/2020-17:42:07] [V] [TRT] Tactic: 1769471 time 0.297984 [09/29/2020-17:42:07] [V] [TRT] Tactic: 1966079 time 0.495616 [09/29/2020-17:42:07] [V] [TRT] Tactic: 2031615 time 0.428896 [09/29/2020-17:42:07] [V] [TRT] Tactic: 2228223 time 0.295776 [09/29/2020-17:42:07] [V] [TRT] Tactic: 2424831 time 0.202048 [09/29/2020-17:42:07] [V] [TRT] Tactic: 2621439 time 0.184576 [09/29/2020-17:42:07] [V] [TRT] Tactic: 2752511 time 0.436224 [09/29/2020-17:42:07] [V] [TRT] Tactic: 2818047 time 0.403424 [09/29/2020-17:42:07] [V] [TRT] Tactic: 2883583 time 0.58368 [09/29/2020-17:42:07] [V] [TRT] Tactic: 3014655 time 0.25616 [09/29/2020-17:42:07] [V] [TRT] Tactic: 3145727 time 0.309248 [09/29/2020-17:42:07] [V] [TRT] Tactic: 3473407 time 0.303072 [09/29/2020-17:42:07] [V] [TRT] Tactic: 3604479 time 0.253376 [09/29/2020-17:42:07] [V] [TRT] Tactic: 3735551 time 0.293056 [09/29/2020-17:42:07] [V] [TRT] Tactic: 4390911 time 0.528384 [09/29/2020-17:42:07] [V] [TRT] Tactic: 5046271 time 0.295936 [09/29/2020-17:42:07] [V] [TRT] Tactic: 5963775 time 0.458752 [09/29/2020-17:42:07] [V] [TRT] Tactic: 6160383 time 0.372032 [09/29/2020-17:42:07] [V] [TRT] Tactic: 6488063 time 0.327936 [09/29/2020-17:42:07] [V] [TRT] Tactic: 6881279 time 0.389152 [09/29/2020-17:42:07] [V] [TRT] Tactic: 7274495 time 0.243968 [09/29/2020-17:42:07] [V] [TRT] Tactic: 7864319 time 0.249152 [09/29/2020-17:42:07] [V] [TRT] Tactic: 7995391 time 0.387072 [09/29/2020-17:42:07] [V] [TRT] Tactic: 8585215 time 0.476224 [09/29/2020-17:42:07] [V] [TRT] Tactic: 8847359 time 0.294912 [09/29/2020-17:42:07] [V] [TRT] Tactic: 8978431 time 0.458752 [09/29/2020-17:42:07] [V] [TRT] Tactic: 9043967 time 0.292864 [09/29/2020-17:42:07] [V] [TRT] Tactic: 9175039 time 0.253408 [09/29/2020-17:42:07] [V] [TRT] Tactic: 9502719 time 0.528384 [09/29/2020-17:42:07] [V] [TRT] Tactic: 9830399 time 0.358976 [09/29/2020-17:42:07] [V] [TRT] Tactic: 9961471 time 0.239424 [09/29/2020-17:42:07] [V] [TRT] Tactic: 10027007 time 0.335232 [09/29/2020-17:42:07] [V] [TRT] Tactic: 10092543 time 0.528544 [09/29/2020-17:42:07] [V] [TRT] Tactic: 10289151 time 0.495456 [09/29/2020-17:42:07] [V] [TRT] Tactic: 10485759 time 0.266496 [09/29/2020-17:42:07] [V] [TRT] Tactic: 10682367 time 0.182272 [09/29/2020-17:42:07] [V] [TRT] Tactic: 10813439 time 0.202592 [09/29/2020-17:42:07] [V] [TRT] Fastest Tactic: 10682367 Time: 0.182272 [09/29/2020-17:42:07] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 116) [Convolution] (CaskConvolution) [09/29/2020-17:42:07] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:07] [V] [TRT] Tactic: 1825138533642645384 time 0.663808 [09/29/2020-17:42:07] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:07] [V] [TRT] Tactic: 2775507031594384867 time 0.106752 [09/29/2020-17:42:07] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:42:07] [V] [TRT] Tactic: 2842488832350522458 time 0.444672 [09/29/2020-17:42:07] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:07] [V] [TRT] Tactic: 3915320020053085238 time 0.638656 [09/29/2020-17:42:07] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:42:07] [V] [TRT] Tactic: 6448355332020552203 time 0.667648 [09/29/2020-17:42:07] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:07] [V] [TRT] Tactic: 6808617066150061604 time 0.391424 [09/29/2020-17:42:07] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:07] [V] [TRT] Tactic: -8060443123034038864 time 0.464832 [09/29/2020-17:42:07] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:07] [V] [TRT] Tactic: -4420849921117327522 time 0.49152 [09/29/2020-17:42:07] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:07] [V] [TRT] Tactic: -3946921629105938337 time 0.533888 [09/29/2020-17:42:07] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.106752 [09/29/2020-17:42:07] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 116) [Convolution] (CudaConvolution) [09/29/2020-17:42:07] [V] [TRT] Tactic: 0 time 0.335872 [09/29/2020-17:42:07] [V] [TRT] Tactic: 2 time 0.354176 [09/29/2020-17:42:07] [V] [TRT] Tactic: 5 time 6.15584 [09/29/2020-17:42:07] [V] [TRT] Tactic: 6 time 0.189504 [09/29/2020-17:42:08] [V] [TRT] Tactic: 57 time 0.585696 [09/29/2020-17:42:08] [V] [TRT] Fastest Tactic: 6 Time: 0.189504 [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 116) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:08] [V] [TRT] [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:08] [V] [TRT] *************** Autotuning format combination: Half(1,16,256,131072) -> Half(1,16,256,131072) *************** [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 116) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 116) [Convolution] (CaskConvolution) [09/29/2020-17:42:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 116) [Convolution] (CudaConvolution) [09/29/2020-17:42:08] [V] [TRT] Tactic: 0 time 0.374784 [09/29/2020-17:42:08] [V] [TRT] Tactic: 1 time 0.376192 [09/29/2020-17:42:08] [V] [TRT] Tactic: 2 time 0.37072 [09/29/2020-17:42:08] [V] [TRT] Tactic: 4 time 5.93146 [09/29/2020-17:42:08] [V] [TRT] Tactic: 5 time 5.92691 [09/29/2020-17:42:08] [V] [TRT] Tactic: 6 time 0.24576 [09/29/2020-17:42:08] [V] [TRT] Fastest Tactic: 6 Time: 0.24576 [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 116) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [09/29/2020-17:42:08] [V] [TRT] [09/29/2020-17:42:08] [V] [TRT] *************** Autotuning format combination: Half(1,16,256:2,65536) -> Half(1,16,256:2,65536) *************** [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 116) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:08] [V] [TRT] Tactic: 524287 time 0.172032 [09/29/2020-17:42:08] [V] [TRT] Tactic: 720895 time 0.179072 [09/29/2020-17:42:08] [V] [TRT] Tactic: 983039 time 0.125184 [09/29/2020-17:42:08] [V] [TRT] Tactic: 1048575 time 0.139584 [09/29/2020-17:42:08] [V] [TRT] Tactic: 1703935 time 0.098304 [09/29/2020-17:42:08] [V] [TRT] Tactic: 1769471 time 0.155552 [09/29/2020-17:42:08] [V] [TRT] Tactic: 1966079 time 0.2712 [09/29/2020-17:42:08] [V] [TRT] Tactic: 2031615 time 0.217344 [09/29/2020-17:42:08] [V] [TRT] Tactic: 2228223 time 0.146912 [09/29/2020-17:42:08] [V] [TRT] Tactic: 2424831 time 0.104448 [09/29/2020-17:42:08] [V] [TRT] Tactic: 2621439 time 0.095776 [09/29/2020-17:42:08] [V] [TRT] Tactic: 2752511 time 0.209024 [09/29/2020-17:42:08] [V] [TRT] Tactic: 2818047 time 0.200288 [09/29/2020-17:42:08] [V] [TRT] Tactic: 2883583 time 0.298688 [09/29/2020-17:42:08] [V] [TRT] Tactic: 3014655 time 0.128672 [09/29/2020-17:42:08] [V] [TRT] Tactic: 3145727 time 0.153504 [09/29/2020-17:42:08] [V] [TRT] Tactic: 3473407 time 0.155904 [09/29/2020-17:42:08] [V] [TRT] Tactic: 3604479 time 0.127232 [09/29/2020-17:42:08] [V] [TRT] Tactic: 3735551 time 0.147456 [09/29/2020-17:42:08] [V] [TRT] Tactic: 4390911 time 0.271808 [09/29/2020-17:42:08] [V] [TRT] Tactic: 5046271 time 0.141568 [09/29/2020-17:42:08] [V] [TRT] Tactic: 5963775 time 0.232352 [09/29/2020-17:42:08] [V] [TRT] Tactic: 6160383 time 0.181952 [09/29/2020-17:42:08] [V] [TRT] Tactic: 6488063 time 0.159104 [09/29/2020-17:42:08] [V] [TRT] Tactic: 6881279 time 0.196864 [09/29/2020-17:42:08] [V] [TRT] Tactic: 7274495 time 0.121088 [09/29/2020-17:42:08] [V] [TRT] Tactic: 7864319 time 0.126976 [09/29/2020-17:42:08] [V] [TRT] Tactic: 7995391 time 0.14688 [09/29/2020-17:42:08] [V] [TRT] Tactic: 8585215 time 0.225536 [09/29/2020-17:42:08] [V] [TRT] Tactic: 8847359 time 0.151808 [09/29/2020-17:42:08] [V] [TRT] Tactic: 8978431 time 0.237568 [09/29/2020-17:42:08] [V] [TRT] Tactic: 9043967 time 0.147328 [09/29/2020-17:42:08] [V] [TRT] Tactic: 9175039 time 0.127232 [09/29/2020-17:42:08] [V] [TRT] Tactic: 9502719 time 0.268192 [09/29/2020-17:42:08] [V] [TRT] Tactic: 9830399 time 0.172896 [09/29/2020-17:42:08] [V] [TRT] Tactic: 9961471 time 0.123136 [09/29/2020-17:42:08] [V] [TRT] Tactic: 10027007 time 0.163296 [09/29/2020-17:42:08] [V] [TRT] Tactic: 10092543 time 0.27168 [09/29/2020-17:42:08] [V] [TRT] Tactic: 10289151 time 0.272064 [09/29/2020-17:42:08] [V] [TRT] Tactic: 10485759 time 0.133376 [09/29/2020-17:42:08] [V] [TRT] Tactic: 10682367 time 0.094464 [09/29/2020-17:42:08] [V] [TRT] Tactic: 10813439 time 0.104704 [09/29/2020-17:42:08] [V] [TRT] Fastest Tactic: 10682367 Time: 0.094464 [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 116) [Convolution] (CaskConvolution) [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: 1145226902788474763 time 0.243968 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: 1651411198763708804 time 0.23552 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: 2418518597804310654 time 0.237568 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: 4318470497547290900 time 0.200128 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: 4653005425971292725 time 0.240928 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: 4930470141256631146 time 0.262144 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: 8292881859266835088 time 0.271936 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: 8401509141903434922 time 0.200192 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: -8654297089785671176 time 0.327936 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: -7448936905981214224 time 0.299008 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: -6004726995029373073 time 0.217344 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: -5719726816705110014 time 0.32768 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: -3754890472406891741 time 0.345984 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: -3689982367035295496 time 0.339328 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: -3140347171730126532 time 0.055296 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: -2894005464278291378 time 0.276064 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: -2027588946874785071 time 0.213952 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: -1968398013367819764 time 0.339648 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: -245090590808296743 time 0.344928 [09/29/2020-17:42:08] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.055296 [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 116) [Convolution] (CudaConvolution) [09/29/2020-17:42:08] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 116) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:08] [V] [TRT] [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:08] [V] [TRT] *************** Autotuning format combination: Half(64,1024,1:8,16384) -> Float(1,16,256,131072) *************** [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 116) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 116) [Convolution] (CaskConvolution) [09/29/2020-17:42:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 116) [Convolution] (CudaConvolution) [09/29/2020-17:42:08] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 116) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:08] [V] [TRT] *************** Autotuning format combination: Half(64,1024,1:8,16384) -> Half(64,1024,1:8,16384) *************** [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 116) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 116) [Convolution] (CaskConvolution) [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:08] [V] [TRT] Tactic: 130343752241278875 time 0.06144 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: 2148106709480872763 time 0.113504 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: 2410442691266548717 time 0.171264 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:08] [V] [TRT] Tactic: 2921824978225832523 time 0.055584 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:08] [V] [TRT] Tactic: 3030711443478140260 time 0.095072 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: 3754069740140581927 time 0.18112 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: 3823144360994712832 time 0.099168 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: 5635311898703673455 time 0.102272 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: 5925270497649423688 time 0.325632 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: 6680916730816870145 time 0.174944 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: 7158029511300006471 time 0.1736 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: 7859952145590271433 time 0.17232 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: 8283847742354150423 time 0.181824 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: -8992262742606384444 time 0.12304 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: -8682550625095202832 time 0.12144 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:08] [V] [TRT] Tactic: -8379842433586149932 time 0.094208 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:08] [V] [TRT] Tactic: -6352769237623756264 time 0.09856 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: -6273232454637933930 time 0.0992 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: -5818527483287834165 time 0.096128 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: -4954692664176521434 time 0.174336 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:08] [V] [TRT] Tactic: -4953888146171240997 time 0.055296 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: -4534876761957424274 time 0.323488 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: -3237051169894153788 time 0.170272 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: -3136088851200285532 time 0.094496 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: -2586046817576862066 time 0.177824 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] Tactic: -229563042944049199 time 0.100608 [09/29/2020-17:42:08] [V] [TRT] Fastest Tactic: -4953888146171240997 Time: 0.055296 [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 116) [Convolution] (CudaConvolution) [09/29/2020-17:42:08] [V] [TRT] Tactic: 0 time 0.75296 [09/29/2020-17:42:08] [V] [TRT] Tactic: 1 time 0.751584 [09/29/2020-17:42:08] [V] [TRT] Tactic: 2 time 0.379136 [09/29/2020-17:42:08] [V] [TRT] Tactic: 6 time 0.233472 [09/29/2020-17:42:08] [V] [TRT] Fastest Tactic: 6 Time: 0.233472 [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 116) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4953888146171240997 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:08] [V] [TRT] [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:08] [V] [TRT] (Unnamed Layer* 116) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:08] [V] [TRT] Tactic: 1002 time 0.005984 [09/29/2020-17:42:08] [V] [TRT] Tactic: 0 time 0.005824 [09/29/2020-17:42:08] [V] [TRT] Fastest Tactic: 0 Time: 0.005824 [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:08] [V] [TRT] Tactic: 1002 time 0.005632 [09/29/2020-17:42:08] [V] [TRT] Tactic: 0 time 0.004352 [09/29/2020-17:42:08] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:08] [V] [TRT] Tactic: 1002 time 0.007616 [09/29/2020-17:42:08] [V] [TRT] Tactic: 0 time 0.004096 [09/29/2020-17:42:08] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:08] [V] [TRT] Tactic: 1002 time 0.007616 [09/29/2020-17:42:08] [V] [TRT] Tactic: 0 time 0.004096 [09/29/2020-17:42:08] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:08] [V] [TRT] Tactic: 1002 time 0.00704 [09/29/2020-17:42:08] [V] [TRT] Tactic: 0 time 0.004096 [09/29/2020-17:42:08] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:08] [V] [TRT] Tactic: 1002 time 0.007648 [09/29/2020-17:42:08] [V] [TRT] Tactic: 0 time 0.004352 [09/29/2020-17:42:08] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:08] [V] [TRT] Tactic: 1002 time 0.007552 [09/29/2020-17:42:08] [V] [TRT] Tactic: 0 time 0.009568 [09/29/2020-17:42:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.007552 [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:08] [V] [TRT] Tactic: 1002 time 0.007584 [09/29/2020-17:42:08] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:42:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.007584 [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:08] [V] [TRT] Tactic: 1002 time 0.005856 [09/29/2020-17:42:08] [V] [TRT] Tactic: 0 time 0.004352 [09/29/2020-17:42:08] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:08] [V] [TRT] Tactic: 1002 time 0.005888 [09/29/2020-17:42:08] [V] [TRT] Tactic: 0 time 0.004384 [09/29/2020-17:42:08] [V] [TRT] Fastest Tactic: 0 Time: 0.004384 [09/29/2020-17:42:08] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144), Float(1,32,1024,27648), Float(1,3,9,2304), Float(1) -> Float(1,32,1024,131072) *************** [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 148) [PluginV2Ext] (PluginV2) 256 32 32 1 256 32 32 1 256 32 32 1 [09/29/2020-17:42:08] [V] [TRT] Tactic: 0 time 2.12198 [09/29/2020-17:42:08] [V] [TRT] Fastest Tactic: 0 Time: 2.12198 [09/29/2020-17:42:08] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144), Half(1,32,1024,27648), Half(1,3,9,2304), Half(1) -> Half(1,32,1024,131072) *************** [09/29/2020-17:42:08] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 148) [PluginV2Ext] (PluginV2) 256 32 32 1 half. 256 32 32 1 half. 256 32 32 1 half. [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 1.17146 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 1.17146 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.004992 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.00592 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.004992 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.00768 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.006912 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.005952 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005952 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.005856 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.005824 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005824 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.00832 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.005824 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005824 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.007424 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.005856 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005856 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.008192 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.004608 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004608 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.00784 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.004352 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.007424 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.004384 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004384 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.00656 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.005792 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005792 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.007456 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.004352 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.008448 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.004096 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [09/29/2020-17:42:09] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,65536), Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (CaskConvolution) [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 1754569683116234317 time 0.04512 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 1825138533642645384 time 0.045312 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 2733356012094739613 time 0.034816 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 3915320020053085238 time 0.045312 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 6808617066150061604 time 0.030656 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 9091006216302412844 time 0.028672 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -8060443123034038864 time 0.031584 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -4420849921117327522 time 0.027488 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -3946921629105938337 time 0.035328 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.027488 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (CudaConvolution) [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.033024 [09/29/2020-17:42:09] [V] [TRT] Tactic: 2 time 0.092416 [09/29/2020-17:42:09] [V] [TRT] Tactic: 5 time 0.194208 [09/29/2020-17:42:09] [V] [TRT] Tactic: 57 time 0.032768 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 57 Time: 0.032768 [09/29/2020-17:42:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4420849921117327522 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] *************** Autotuning format combination: Half(1,16,256,65536), Half(1,16,256,131072) -> Half(1,16,256,131072) *************** [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (CaskConvolution) [09/29/2020-17:42:09] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (CudaConvolution) [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.2656 [09/29/2020-17:42:09] [V] [TRT] Tactic: 1 time 0.039168 [09/29/2020-17:42:09] [V] [TRT] Tactic: 2 time 0.092416 [09/29/2020-17:42:09] [V] [TRT] Tactic: 4 time 0.870112 [09/29/2020-17:42:09] [V] [TRT] Tactic: 5 time 0.178176 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 1 Time: 0.039168 [09/29/2020-17:42:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [09/29/2020-17:42:09] [V] [TRT] [09/29/2020-17:42:09] [V] [TRT] *************** Autotuning format combination: Half(1,16,256:2,32768), Half(1,16,256:2,65536) -> Half(1,16,256:2,65536) *************** [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (CaskConvolution) [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 1651411198763708804 time 0.018688 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 2418518597804310654 time 0.019936 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 4318470497547290900 time 0.0184 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 4930470141256631146 time 0.02048 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 8292881859266835088 time 0.02048 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 8401509141903434922 time 0.018304 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -8654297089785671176 time 0.026624 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -7516584506774355935 time 0.017952 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -7140760933967189247 time 0.018048 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -6004726995029373073 time 0.018688 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -5719726816705110014 time 0.02544 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -4097850214384059472 time 0.017952 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -3717489476759089008 time 0.018432 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -3689982367035295496 time 0.026432 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -2640575123064142123 time 0.026176 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -2534402059426524406 time 0.026144 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -2027588946874785071 time 0.01872 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -1968398013367819764 time 0.026016 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: -7516584506774355935 Time: 0.017952 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (CudaConvolution) [09/29/2020-17:42:09] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7516584506774355935 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:09] [V] [TRT] *************** Autotuning format combination: Half(32,512,1:8,8192), Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (CaskConvolution) [09/29/2020-17:42:09] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (CudaConvolution) [09/29/2020-17:42:09] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:09] [V] [TRT] *************** Autotuning format combination: Half(32,512,1:8,8192), Half(64,1024,1:8,16384) -> Half(64,1024,1:8,16384) *************** [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (CaskConvolution) [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:09] [V] [TRT] Tactic: 9576651994278528 time 0.01024 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 1179757074518529353 time 0.01408 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 2105695814191699972 time 0.0176 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 2148106709480872763 time 0.014592 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 2410442691266548717 time 0.018432 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 3041642431972138763 time 0.01376 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 3754069740140581927 time 0.018176 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 4555462412611657028 time 0.01424 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 5666160310350604399 time 0.017472 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:09] [V] [TRT] Tactic: 5876997871499382316 time 0.012096 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 5925270497649423688 time 0.02688 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 6680916730816870145 time 0.018432 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 7158029511300006471 time 0.017664 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 7859952145590271433 time 0.018432 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: 8283847742354150423 time 0.018272 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -8992262742606384444 time 0.014592 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -8391760416076885205 time 0.02688 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -6273232454637933930 time 0.014592 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:09] [V] [TRT] Tactic: -5925110308892264213 time 0.012128 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -5818527483287834165 time 0.014336 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:09] [V] [TRT] Tactic: -4908848143422991657 time 0.010496 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -4534876761957424274 time 0.02688 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -3237051169894153788 time 0.017984 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -3136088851200285532 time 0.013184 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -2586046817576862066 time 0.019328 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -2422160065350346448 time 0.018432 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -1216445540764179377 time 0.018432 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] Tactic: -229563042944049199 time 0.014304 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 9576651994278528 Time: 0.01024 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (CudaConvolution) [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.891136 [09/29/2020-17:42:09] [V] [TRT] Tactic: 1 time 0.043296 [09/29/2020-17:42:09] [V] [TRT] Tactic: 2 time 0.081888 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 1 Time: 0.043296 [09/29/2020-17:42:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9576651994278528 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:09] [V] [TRT] [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:09] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.007264 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.006112 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.006112 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.008192 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.005984 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005984 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.00608 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.00608 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.005856 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005856 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.00768 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.005984 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005984 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.011424 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.004992 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004992 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.008032 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.004352 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.008192 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.005984 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005984 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.008096 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.005984 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005984 [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:09] [V] [TRT] Tactic: 1002 time 0.012544 [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.004928 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004928 [09/29/2020-17:42:09] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,131072) -> Float(1,32,1024,131072) *************** [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 149) [Scale] + (Unnamed Layer* 150) [Activation] (Scale) [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:42:09] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,131072) -> Half(1,32,1024,131072) *************** [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 149) [Scale] + (Unnamed Layer* 150) [Activation] (Scale) [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.00608 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00608 [09/29/2020-17:42:09] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,65536) -> Half(1,32,1024:2,65536) *************** [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 149) [Scale] + (Unnamed Layer* 150) [Activation] (Scale) [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.005888 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005888 [09/29/2020-17:42:09] [V] [TRT] *************** Autotuning format combination: Half(16,512,1:8,16384) -> Half(16,512,1:8,16384) *************** [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 149) [Scale] + (Unnamed Layer* 150) [Activation] (Scale) [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:42:09] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,131072) -> Float(1,64,4096,524288) *************** [09/29/2020-17:42:09] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 151) [Deconvolution] (CudnnDeconvolution) [09/29/2020-17:42:09] [V] [TRT] Tactic: 0 time 0.045312 [09/29/2020-17:42:09] [V] [TRT] Tactic: 1 time 0.045216 [09/29/2020-17:42:10] [V] [TRT] Tactic: 3 time 14.7141 [09/29/2020-17:42:10] [V] [TRT] Tactic: 24 time 3.00646 [09/29/2020-17:42:10] [V] [TRT] Tactic: 25 time 1.99648 [09/29/2020-17:42:10] [V] [TRT] Tactic: 27 time 12.9966 [09/29/2020-17:42:10] [V] [TRT] Fastest Tactic: 1 Time: 0.045216 [09/29/2020-17:42:10] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 151) [Deconvolution] (CaskDeconvolution) [09/29/2020-17:42:10] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [09/29/2020-17:42:10] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 151) [Deconvolution] (GemmDeconvolution) [09/29/2020-17:42:10] [V] [TRT] Tactic: 0 time 0.815104 [09/29/2020-17:42:10] [V] [TRT] Fastest Tactic: 0 Time: 0.815104 [09/29/2020-17:42:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 1 [09/29/2020-17:42:10] [V] [TRT] [09/29/2020-17:42:10] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,131072) -> Half(1,64,4096,524288) *************** [09/29/2020-17:42:10] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 151) [Deconvolution] (CudnnDeconvolution) [09/29/2020-17:42:10] [V] [TRT] Tactic: 0 time 0.047104 [09/29/2020-17:42:10] [V] [TRT] Tactic: 1 time 0.047168 [09/29/2020-17:42:10] [V] [TRT] Tactic: 3 time 14.9202 [09/29/2020-17:42:10] [V] [TRT] Tactic: 24 time 0.624544 [09/29/2020-17:42:10] [V] [TRT] Tactic: 25 time 0.623392 [09/29/2020-17:42:10] [V] [TRT] Tactic: 27 time 13.2709 [09/29/2020-17:42:10] [V] [TRT] Fastest Tactic: 0 Time: 0.047104 [09/29/2020-17:42:10] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 151) [Deconvolution] (CaskDeconvolution) [09/29/2020-17:42:10] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [09/29/2020-17:42:10] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 151) [Deconvolution] (GemmDeconvolution) [09/29/2020-17:42:10] [V] [TRT] Tactic: 0 time 0.811936 [09/29/2020-17:42:10] [V] [TRT] Fastest Tactic: 0 Time: 0.811936 [09/29/2020-17:42:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 0 [09/29/2020-17:42:10] [V] [TRT] [09/29/2020-17:42:10] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,65536) -> Half(1,64,4096:2,262144) *************** [09/29/2020-17:42:10] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 151) [Deconvolution] (CudnnDeconvolution) [09/29/2020-17:42:10] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [09/29/2020-17:42:10] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 151) [Deconvolution] (CaskDeconvolution) [09/29/2020-17:42:10] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [09/29/2020-17:42:10] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 151) [Deconvolution] (GemmDeconvolution) [09/29/2020-17:42:10] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping [09/29/2020-17:42:10] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [09/29/2020-17:42:10] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:10] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:10] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:42:10] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:10] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:42:10] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:10] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:10] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:10] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:10] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:10] [V] [TRT] Tactic: 524287 time 0.364544 [09/29/2020-17:42:10] [V] [TRT] Tactic: 720895 time 0.364832 [09/29/2020-17:42:10] [V] [TRT] Tactic: 983039 time 0.256 [09/29/2020-17:42:10] [V] [TRT] Tactic: 1048575 time 0.291072 [09/29/2020-17:42:10] [V] [TRT] Tactic: 1703935 time 0.20096 [09/29/2020-17:42:10] [V] [TRT] Tactic: 1769471 time 0.298848 [09/29/2020-17:42:10] [V] [TRT] Tactic: 1966079 time 0.495296 [09/29/2020-17:42:10] [V] [TRT] Tactic: 2031615 time 0.428352 [09/29/2020-17:42:10] [V] [TRT] Tactic: 2228223 time 0.299264 [09/29/2020-17:42:10] [V] [TRT] Tactic: 2424831 time 0.199328 [09/29/2020-17:42:10] [V] [TRT] Tactic: 2621439 time 0.183968 [09/29/2020-17:42:10] [V] [TRT] Tactic: 2752511 time 0.434432 [09/29/2020-17:42:10] [V] [TRT] Tactic: 2818047 time 0.402912 [09/29/2020-17:42:10] [V] [TRT] Tactic: 2883583 time 0.583296 [09/29/2020-17:42:10] [V] [TRT] Tactic: 3014655 time 0.256 [09/29/2020-17:42:10] [V] [TRT] Tactic: 3145727 time 0.310336 [09/29/2020-17:42:10] [V] [TRT] Tactic: 3473407 time 0.475136 [09/29/2020-17:42:10] [V] [TRT] Tactic: 3604479 time 0.25392 [09/29/2020-17:42:10] [V] [TRT] Tactic: 3735551 time 0.29312 [09/29/2020-17:42:10] [V] [TRT] Tactic: 4390911 time 0.527968 [09/29/2020-17:42:10] [V] [TRT] Tactic: 5046271 time 0.29312 [09/29/2020-17:42:10] [V] [TRT] Tactic: 5963775 time 0.458752 [09/29/2020-17:42:10] [V] [TRT] Tactic: 6160383 time 0.370944 [09/29/2020-17:42:10] [V] [TRT] Tactic: 6488063 time 0.329728 [09/29/2020-17:42:10] [V] [TRT] Tactic: 6881279 time 0.389984 [09/29/2020-17:42:10] [V] [TRT] Tactic: 7274495 time 0.243968 [09/29/2020-17:42:10] [V] [TRT] Tactic: 7864319 time 0.248032 [09/29/2020-17:42:10] [V] [TRT] Tactic: 7995391 time 0.385024 [09/29/2020-17:42:10] [V] [TRT] Tactic: 8585215 time 0.473088 [09/29/2020-17:42:10] [V] [TRT] Tactic: 8847359 time 0.295168 [09/29/2020-17:42:10] [V] [TRT] Tactic: 8978431 time 0.459008 [09/29/2020-17:42:10] [V] [TRT] Tactic: 9043967 time 0.292864 [09/29/2020-17:42:10] [V] [TRT] Tactic: 9175039 time 0.251904 [09/29/2020-17:42:10] [V] [TRT] Tactic: 9502719 time 0.528384 [09/29/2020-17:42:10] [V] [TRT] Tactic: 9830399 time 0.360704 [09/29/2020-17:42:10] [V] [TRT] Tactic: 9961471 time 0.238848 [09/29/2020-17:42:10] [V] [TRT] Tactic: 10027007 time 0.332064 [09/29/2020-17:42:10] [V] [TRT] Tactic: 10092543 time 0.528384 [09/29/2020-17:42:10] [V] [TRT] Tactic: 10289151 time 0.495616 [09/29/2020-17:42:10] [V] [TRT] Tactic: 10485759 time 0.267712 [09/29/2020-17:42:10] [V] [TRT] Tactic: 10682367 time 0.182272 [09/29/2020-17:42:10] [V] [TRT] Tactic: 10813439 time 0.20128 [09/29/2020-17:42:10] [V] [TRT] Fastest Tactic: 10682367 Time: 0.182272 [09/29/2020-17:42:10] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (CaskConvolution) [09/29/2020-17:42:10] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:10] [V] [TRT] Tactic: 1825138533642645384 time 0.665376 [09/29/2020-17:42:10] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:10] [V] [TRT] Tactic: 2775507031594384867 time 0.106752 [09/29/2020-17:42:10] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:42:10] [V] [TRT] Tactic: 2842488832350522458 time 0.44672 [09/29/2020-17:42:10] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:10] [V] [TRT] Tactic: 3915320020053085238 time 0.638592 [09/29/2020-17:42:10] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:42:10] [V] [TRT] Tactic: 6448355332020552203 time 0.667648 [09/29/2020-17:42:10] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: 6808617066150061604 time 0.391424 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -8060443123034038864 time 0.464896 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -4420849921117327522 time 0.49168 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -3946921629105938337 time 0.536128 [09/29/2020-17:42:11] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.106752 [09/29/2020-17:42:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (CudaConvolution) [09/29/2020-17:42:11] [V] [TRT] Tactic: 0 time 0.33792 [09/29/2020-17:42:11] [V] [TRT] Tactic: 2 time 0.356608 [09/29/2020-17:42:11] [V] [TRT] Tactic: 5 time 6.15747 [09/29/2020-17:42:11] [V] [TRT] Tactic: 6 time 0.19072 [09/29/2020-17:42:11] [V] [TRT] Tactic: 57 time 0.25584 [09/29/2020-17:42:11] [V] [TRT] Fastest Tactic: 6 Time: 0.19072 [09/29/2020-17:42:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:11] [V] [TRT] [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:11] [V] [TRT] *************** Autotuning format combination: Half(1,16,256,131072) -> Half(1,16,256,131072) *************** [09/29/2020-17:42:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (CaskConvolution) [09/29/2020-17:42:11] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (CudaConvolution) [09/29/2020-17:42:11] [V] [TRT] Tactic: 0 time 0.379136 [09/29/2020-17:42:11] [V] [TRT] Tactic: 1 time 0.377376 [09/29/2020-17:42:11] [V] [TRT] Tactic: 2 time 0.374624 [09/29/2020-17:42:11] [V] [TRT] Tactic: 4 time 5.94458 [09/29/2020-17:42:11] [V] [TRT] Tactic: 5 time 5.93363 [09/29/2020-17:42:11] [V] [TRT] Tactic: 6 time 0.249856 [09/29/2020-17:42:11] [V] [TRT] Fastest Tactic: 6 Time: 0.249856 [09/29/2020-17:42:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [09/29/2020-17:42:11] [V] [TRT] [09/29/2020-17:42:11] [V] [TRT] *************** Autotuning format combination: Half(1,16,256:2,65536) -> Half(1,16,256:2,65536) *************** [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:11] [V] [TRT] Tactic: 524287 time 0.174592 [09/29/2020-17:42:11] [V] [TRT] Tactic: 720895 time 0.179072 [09/29/2020-17:42:11] [V] [TRT] Tactic: 983039 time 0.125184 [09/29/2020-17:42:11] [V] [TRT] Tactic: 1048575 time 0.139264 [09/29/2020-17:42:11] [V] [TRT] Tactic: 1703935 time 0.098304 [09/29/2020-17:42:11] [V] [TRT] Tactic: 1769471 time 0.155648 [09/29/2020-17:42:11] [V] [TRT] Tactic: 1966079 time 0.272384 [09/29/2020-17:42:11] [V] [TRT] Tactic: 2031615 time 0.217088 [09/29/2020-17:42:11] [V] [TRT] Tactic: 2228223 time 0.146272 [09/29/2020-17:42:11] [V] [TRT] Tactic: 2424831 time 0.105312 [09/29/2020-17:42:11] [V] [TRT] Tactic: 2621439 time 0.096064 [09/29/2020-17:42:11] [V] [TRT] Tactic: 2752511 time 0.208224 [09/29/2020-17:42:11] [V] [TRT] Tactic: 2818047 time 0.200096 [09/29/2020-17:42:11] [V] [TRT] Tactic: 2883583 time 0.29696 [09/29/2020-17:42:11] [V] [TRT] Tactic: 3014655 time 0.127872 [09/29/2020-17:42:11] [V] [TRT] Tactic: 3145727 time 0.1536 [09/29/2020-17:42:11] [V] [TRT] Tactic: 3473407 time 0.155648 [09/29/2020-17:42:11] [V] [TRT] Tactic: 3604479 time 0.127232 [09/29/2020-17:42:11] [V] [TRT] Tactic: 3735551 time 0.147712 [09/29/2020-17:42:11] [V] [TRT] Tactic: 4390911 time 0.271712 [09/29/2020-17:42:11] [V] [TRT] Tactic: 5046271 time 0.141088 [09/29/2020-17:42:11] [V] [TRT] Tactic: 5963775 time 0.23232 [09/29/2020-17:42:11] [V] [TRT] Tactic: 6160383 time 0.1824 [09/29/2020-17:42:11] [V] [TRT] Tactic: 6488063 time 0.16 [09/29/2020-17:42:11] [V] [TRT] Tactic: 6881279 time 0.196608 [09/29/2020-17:42:11] [V] [TRT] Tactic: 7274495 time 0.121088 [09/29/2020-17:42:11] [V] [TRT] Tactic: 7864319 time 0.12704 [09/29/2020-17:42:11] [V] [TRT] Tactic: 7995391 time 0.147232 [09/29/2020-17:42:11] [V] [TRT] Tactic: 8585215 time 0.224128 [09/29/2020-17:42:11] [V] [TRT] Tactic: 8847359 time 0.152224 [09/29/2020-17:42:11] [V] [TRT] Tactic: 8978431 time 0.237568 [09/29/2020-17:42:11] [V] [TRT] Tactic: 9043967 time 0.146816 [09/29/2020-17:42:11] [V] [TRT] Tactic: 9175039 time 0.127232 [09/29/2020-17:42:11] [V] [TRT] Tactic: 9502719 time 0.268288 [09/29/2020-17:42:11] [V] [TRT] Tactic: 9830399 time 0.172288 [09/29/2020-17:42:11] [V] [TRT] Tactic: 9961471 time 0.124928 [09/29/2020-17:42:11] [V] [TRT] Tactic: 10027007 time 0.163264 [09/29/2020-17:42:11] [V] [TRT] Tactic: 10092543 time 0.272192 [09/29/2020-17:42:11] [V] [TRT] Tactic: 10289151 time 0.271872 [09/29/2020-17:42:11] [V] [TRT] Tactic: 10485759 time 0.133376 [09/29/2020-17:42:11] [V] [TRT] Tactic: 10682367 time 0.094208 [09/29/2020-17:42:11] [V] [TRT] Tactic: 10813439 time 0.104704 [09/29/2020-17:42:11] [V] [TRT] Fastest Tactic: 10682367 Time: 0.094208 [09/29/2020-17:42:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (CaskConvolution) [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: 1145226902788474763 time 0.245376 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: 1651411198763708804 time 0.235552 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: 2418518597804310654 time 0.237568 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: 4318470497547290900 time 0.200256 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: 4653005425971292725 time 0.241632 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: 4930470141256631146 time 0.262048 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: 8292881859266835088 time 0.27264 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: 8401509141903434922 time 0.198912 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -8654297089785671176 time 0.327936 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -7448936905981214224 time 0.29696 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -6004726995029373073 time 0.217344 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -5719726816705110014 time 0.326304 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -3754890472406891741 time 0.34432 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -3689982367035295496 time 0.339264 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -3140347171730126532 time 0.055552 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -2894005464278291378 time 0.276384 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -2027588946874785071 time 0.216736 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -1968398013367819764 time 0.338176 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -245090590808296743 time 0.34432 [09/29/2020-17:42:11] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.055552 [09/29/2020-17:42:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (CudaConvolution) [09/29/2020-17:42:11] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:11] [V] [TRT] [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:11] [V] [TRT] *************** Autotuning format combination: Half(64,1024,1:8,16384) -> Float(1,16,256,131072) *************** [09/29/2020-17:42:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (CaskConvolution) [09/29/2020-17:42:11] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (CudaConvolution) [09/29/2020-17:42:11] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:11] [V] [TRT] *************** Autotuning format combination: Half(64,1024,1:8,16384) -> Half(64,1024,1:8,16384) *************** [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (CaskConvolution) [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:11] [V] [TRT] Tactic: 130343752241278875 time 0.061376 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: 2148106709480872763 time 0.114272 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: 2410442691266548717 time 0.172288 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:11] [V] [TRT] Tactic: 2921824978225832523 time 0.055296 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:11] [V] [TRT] Tactic: 3030711443478140260 time 0.095712 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: 3754069740140581927 time 0.181632 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: 3823144360994712832 time 0.09856 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: 5635311898703673455 time 0.101984 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: 5925270497649423688 time 0.32528 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: 6680916730816870145 time 0.176128 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: 7158029511300006471 time 0.173632 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: 7859952145590271433 time 0.172384 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: 8283847742354150423 time 0.181984 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -8992262742606384444 time 0.12288 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -8682550625095202832 time 0.121152 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:11] [V] [TRT] Tactic: -8379842433586149932 time 0.094208 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:11] [V] [TRT] Tactic: -6352769237623756264 time 0.099968 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -6273232454637933930 time 0.098688 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -5818527483287834165 time 0.096544 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -4954692664176521434 time 0.175616 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:11] [V] [TRT] Tactic: -4953888146171240997 time 0.054848 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -4534876761957424274 time 0.32384 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -3237051169894153788 time 0.169984 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -3136088851200285532 time 0.094464 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -2586046817576862066 time 0.176128 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] Tactic: -229563042944049199 time 0.100672 [09/29/2020-17:42:11] [V] [TRT] Fastest Tactic: -4953888146171240997 Time: 0.054848 [09/29/2020-17:42:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (CudaConvolution) [09/29/2020-17:42:11] [V] [TRT] Tactic: 0 time 0.753952 [09/29/2020-17:42:11] [V] [TRT] Tactic: 1 time 0.990432 [09/29/2020-17:42:11] [V] [TRT] Tactic: 2 time 0.382976 [09/29/2020-17:42:11] [V] [TRT] Tactic: 6 time 0.235776 [09/29/2020-17:42:11] [V] [TRT] Fastest Tactic: 6 Time: 0.235776 [09/29/2020-17:42:11] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4953888146171240997 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:11] [V] [TRT] [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:11] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:11] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:11] [V] [TRT] Tactic: 1002 time 0.017504 [09/29/2020-17:42:11] [V] [TRT] Tactic: 0 time 0.030656 [09/29/2020-17:42:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.017504 [09/29/2020-17:42:11] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:11] [V] [TRT] Tactic: 1002 time 0.016288 [09/29/2020-17:42:11] [V] [TRT] Tactic: 0 time 0.03072 [09/29/2020-17:42:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.016288 [09/29/2020-17:42:11] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:11] [V] [TRT] Tactic: 1002 time 0.01616 [09/29/2020-17:42:11] [V] [TRT] Tactic: 0 time 0.03072 [09/29/2020-17:42:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.01616 [09/29/2020-17:42:12] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:12] [V] [TRT] Tactic: 1002 time 0.020736 [09/29/2020-17:42:12] [V] [TRT] Tactic: 0 time 0.038816 [09/29/2020-17:42:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.020736 [09/29/2020-17:42:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288), Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [09/29/2020-17:42:12] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 152) [ElementWise] (ElementWise) [09/29/2020-17:42:12] [V] [TRT] Tactic: 1 time 0.020448 [09/29/2020-17:42:12] [V] [TRT] Tactic: 2 time 0.022208 [09/29/2020-17:42:12] [V] [TRT] Fastest Tactic: 1 Time: 0.020448 [09/29/2020-17:42:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384), Float(1,64,4096:32,16384) -> Float(1,64,4096:32,16384) *************** [09/29/2020-17:42:12] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 152) [ElementWise] (ElementWise) [09/29/2020-17:42:12] [V] [TRT] Tactic: 1 time 0.016384 [09/29/2020-17:42:12] [V] [TRT] Tactic: 2 time 0.02176 [09/29/2020-17:42:12] [V] [TRT] Fastest Tactic: 1 Time: 0.016384 [09/29/2020-17:42:12] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,524288), Half(1,64,4096,524288) -> Half(1,64,4096,524288) *************** [09/29/2020-17:42:12] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 152) [ElementWise] (ElementWise) [09/29/2020-17:42:12] [V] [TRT] Tactic: 1 time 0.006912 [09/29/2020-17:42:12] [V] [TRT] Tactic: 2 time 0.008064 [09/29/2020-17:42:12] [V] [TRT] Fastest Tactic: 1 Time: 0.006912 [09/29/2020-17:42:12] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,262144), Half(1,64,4096:2,262144) -> Half(1,64,4096:2,262144) *************** [09/29/2020-17:42:12] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 152) [ElementWise] (ElementWise) [09/29/2020-17:42:12] [V] [TRT] Tactic: 1 time 0.007904 [09/29/2020-17:42:12] [V] [TRT] Tactic: 2 time 0.008192 [09/29/2020-17:42:12] [V] [TRT] Fastest Tactic: 1 Time: 0.007904 [09/29/2020-17:42:12] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536), Half(16,1024,1:8,65536) -> Half(16,1024,1:8,65536) *************** [09/29/2020-17:42:12] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 152) [ElementWise] (ElementWise) [09/29/2020-17:42:12] [V] [TRT] Tactic: 1 time 0.006432 [09/29/2020-17:42:12] [V] [TRT] Tactic: 2 time 0.008192 [09/29/2020-17:42:12] [V] [TRT] Fastest Tactic: 1 Time: 0.006432 [09/29/2020-17:42:12] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:12] [V] [TRT] Tactic: 1002 time 0.024128 [09/29/2020-17:42:12] [V] [TRT] Tactic: 0 time 0.020064 [09/29/2020-17:42:12] [V] [TRT] Fastest Tactic: 0 Time: 0.020064 [09/29/2020-17:42:12] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:12] [V] [TRT] Tactic: 1002 time 0.024576 [09/29/2020-17:42:12] [V] [TRT] Tactic: 0 time 0.018688 [09/29/2020-17:42:12] [V] [TRT] Fastest Tactic: 0 Time: 0.018688 [09/29/2020-17:42:12] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:12] [V] [TRT] Tactic: 1002 time 0.02848 [09/29/2020-17:42:12] [V] [TRT] Tactic: 0 time 0.019936 [09/29/2020-17:42:12] [V] [TRT] Fastest Tactic: 0 Time: 0.019936 [09/29/2020-17:42:12] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:12] [V] [TRT] Tactic: 1002 time 0.021824 [09/29/2020-17:42:12] [V] [TRT] Tactic: 0 time 0.01424 [09/29/2020-17:42:12] [V] [TRT] Fastest Tactic: 0 Time: 0.01424 [09/29/2020-17:42:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,110592) *************** [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:12] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 153) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:12] [V] [TRT] Tactic: 524287 time 0.070144 [09/29/2020-17:42:12] [V] [TRT] Tactic: 1048575 time 0.07296 [09/29/2020-17:42:12] [V] [TRT] Tactic: 1703935 time 0.053248 [09/29/2020-17:42:12] [V] [TRT] Tactic: 2228223 time 0.07808 [09/29/2020-17:42:12] [V] [TRT] Tactic: 2424831 time 0.042688 [09/29/2020-17:42:12] [V] [TRT] Tactic: 2621439 time 0.051456 [09/29/2020-17:42:12] [V] [TRT] Tactic: 3014655 time 0.05104 [09/29/2020-17:42:12] [V] [TRT] Tactic: 3604479 time 0.050624 [09/29/2020-17:42:12] [V] [TRT] Tactic: 5046271 time 0.057344 [09/29/2020-17:42:12] [V] [TRT] Tactic: 6160383 time 0.063392 [09/29/2020-17:42:12] [V] [TRT] Tactic: 6488063 time 0.083456 [09/29/2020-17:42:12] [V] [TRT] Tactic: 7864319 time 0.053248 [09/29/2020-17:42:12] [V] [TRT] Tactic: 8585215 time 0.081504 [09/29/2020-17:42:12] [V] [TRT] Tactic: 8847359 time 0.063904 [09/29/2020-17:42:12] [V] [TRT] Tactic: 9043967 time 0.06144 [09/29/2020-17:42:12] [V] [TRT] Tactic: 9175039 time 0.05088 [09/29/2020-17:42:12] [V] [TRT] Tactic: 9961471 time 0.049408 [09/29/2020-17:42:12] [V] [TRT] Tactic: 10027007 time 0.06288 [09/29/2020-17:42:12] [V] [TRT] Tactic: 10485759 time 0.04736 [09/29/2020-17:42:12] [V] [TRT] Tactic: 10682367 time 0.050816 [09/29/2020-17:42:12] [V] [TRT] Fastest Tactic: 2424831 Time: 0.042688 [09/29/2020-17:42:12] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 153) [Convolution] (CaskConvolution) [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: 1825138533642645384 time 0.17024 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: 2775507031594384867 time 0.032768 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: 2842488832350522458 time 0.108032 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: 3915320020053085238 time 0.167936 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: 6448355332020552203 time 0.172032 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: 6808617066150061604 time 0.102656 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: -8060443123034038864 time 0.111456 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: -4420849921117327522 time 0.09712 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: -3946921629105938337 time 0.12064 [09/29/2020-17:42:12] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.032768 [09/29/2020-17:42:12] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 153) [Convolution] (CudaConvolution) [09/29/2020-17:42:12] [V] [TRT] Tactic: 0 time 0.08704 [09/29/2020-17:42:12] [V] [TRT] Tactic: 2 time 0.153504 [09/29/2020-17:42:12] [V] [TRT] Tactic: 5 time 0.537984 [09/29/2020-17:42:12] [V] [TRT] Tactic: 6 time 0.03712 [09/29/2020-17:42:12] [V] [TRT] Tactic: 57 time 0.108256 [09/29/2020-17:42:12] [V] [TRT] Fastest Tactic: 6 Time: 0.03712 [09/29/2020-17:42:12] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 153) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:12] [V] [TRT] [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:12] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,524288) -> Half(1,64,4096,110592) *************** [09/29/2020-17:42:12] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 153) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:12] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:12] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 153) [Convolution] (CaskConvolution) [09/29/2020-17:42:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:12] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 153) [Convolution] (CudaConvolution) [09/29/2020-17:42:12] [V] [TRT] Tactic: 0 time 0.1024 [09/29/2020-17:42:12] [V] [TRT] Tactic: 1 time 0.108384 [09/29/2020-17:42:12] [V] [TRT] Tactic: 2 time 0.140896 [09/29/2020-17:42:12] [V] [TRT] Tactic: 4 time 4.10742 [09/29/2020-17:42:12] [V] [TRT] Tactic: 5 time 0.534624 [09/29/2020-17:42:12] [V] [TRT] Tactic: 6 time 0.068992 [09/29/2020-17:42:12] [V] [TRT] Fastest Tactic: 6 Time: 0.068992 [09/29/2020-17:42:12] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 153) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [09/29/2020-17:42:12] [V] [TRT] [09/29/2020-17:42:12] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,262144) -> Half(1,64,4096:2,57344) *************** [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:12] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 153) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:12] [V] [TRT] Tactic: 524287 time 0.039776 [09/29/2020-17:42:12] [V] [TRT] Tactic: 1048575 time 0.04096 [09/29/2020-17:42:12] [V] [TRT] Tactic: 1703935 time 0.02928 [09/29/2020-17:42:12] [V] [TRT] Tactic: 2228223 time 0.043264 [09/29/2020-17:42:12] [V] [TRT] Tactic: 2424831 time 0.026496 [09/29/2020-17:42:12] [V] [TRT] Tactic: 2621439 time 0.030976 [09/29/2020-17:42:12] [V] [TRT] Tactic: 3014655 time 0.030976 [09/29/2020-17:42:12] [V] [TRT] Tactic: 3604479 time 0.031136 [09/29/2020-17:42:12] [V] [TRT] Tactic: 5046271 time 0.033024 [09/29/2020-17:42:12] [V] [TRT] Tactic: 6160383 time 0.035744 [09/29/2020-17:42:12] [V] [TRT] Tactic: 6488063 time 0.047168 [09/29/2020-17:42:12] [V] [TRT] Tactic: 7864319 time 0.032672 [09/29/2020-17:42:12] [V] [TRT] Tactic: 8585215 time 0.04672 [09/29/2020-17:42:12] [V] [TRT] Tactic: 8847359 time 0.039168 [09/29/2020-17:42:12] [V] [TRT] Tactic: 9043967 time 0.035072 [09/29/2020-17:42:12] [V] [TRT] Tactic: 9175039 time 0.03072 [09/29/2020-17:42:12] [V] [TRT] Tactic: 9961471 time 0.031104 [09/29/2020-17:42:12] [V] [TRT] Tactic: 10027007 time 0.036864 [09/29/2020-17:42:12] [V] [TRT] Tactic: 10485759 time 0.028672 [09/29/2020-17:42:12] [V] [TRT] Tactic: 10682367 time 0.03072 [09/29/2020-17:42:12] [V] [TRT] Fastest Tactic: 2424831 Time: 0.026496 [09/29/2020-17:42:12] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 153) [Convolution] (CaskConvolution) [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: 1145226902788474763 time 0.061664 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: 1651411198763708804 time 0.059648 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: 2418518597804310654 time 0.059552 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: 4318470497547290900 time 0.056192 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: 4653005425971292725 time 0.061632 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: 4930470141256631146 time 0.064992 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: 8292881859266835088 time 0.065184 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: 8401509141903434922 time 0.055552 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: -8654297089785671176 time 0.08832 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: -7448936905981214224 time 0.071264 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: -6004726995029373073 time 0.059392 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: -5719726816705110014 time 0.089568 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: -3754890472406891741 time 0.091712 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:12] [V] [TRT] Tactic: -3689982367035295496 time 0.08976 [09/29/2020-17:42:12] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -3140347171730126532 time 0.018688 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -2894005464278291378 time 0.069344 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -2027588946874785071 time 0.057344 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -1968398013367819764 time 0.090112 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -245090590808296743 time 0.091424 [09/29/2020-17:42:13] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.018688 [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 153) [Convolution] (CudaConvolution) [09/29/2020-17:42:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 153) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:13] [V] [TRT] [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:13] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536) -> Float(1,64,4096,110592) *************** [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 153) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 153) [Convolution] (CaskConvolution) [09/29/2020-17:42:13] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 153) [Convolution] (CudaConvolution) [09/29/2020-17:42:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 153) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:13] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536) -> Half(4,256,1:8,16384) *************** [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 153) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 153) [Convolution] (CaskConvolution) [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] Tactic: 130343752241278875 time 0.020768 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 2148106709480872763 time 0.031712 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 2410442691266548717 time 0.049408 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] Tactic: 2921824978225832523 time 0.019872 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:13] [V] [TRT] Tactic: 3030711443478140260 time 0.029568 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 3754069740140581927 time 0.053504 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 3823144360994712832 time 0.031008 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 5635311898703673455 time 0.032992 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 5925270497649423688 time 0.087424 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 6680916730816870145 time 0.049408 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 7158029511300006471 time 0.048544 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 7859952145590271433 time 0.049408 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 8283847742354150423 time 0.05424 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -8992262742606384444 time 0.034048 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -8682550625095202832 time 0.034816 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:13] [V] [TRT] Tactic: -8379842433586149932 time 0.029184 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:13] [V] [TRT] Tactic: -6352769237623756264 time 0.03072 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -6273232454637933930 time 0.03072 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -5818527483287834165 time 0.03072 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -4954692664176521434 time 0.04976 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] Tactic: -4953888146171240997 time 0.02048 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -4534876761957424274 time 0.086272 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -3237051169894153788 time 0.04736 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -3136088851200285532 time 0.032128 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -2586046817576862066 time 0.04944 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -229563042944049199 time 0.033024 [09/29/2020-17:42:13] [V] [TRT] Fastest Tactic: 2921824978225832523 Time: 0.019872 [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 153) [Convolution] (CudaConvolution) [09/29/2020-17:42:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 153) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2921824978225832523 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 153) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] *************** Autotuning format combination: -> Float(1,3,9,1152) *************** [09/29/2020-17:42:13] [V] [TRT] *************** Autotuning format combination: -> Half(1,3,9,1152) *************** [09/29/2020-17:42:13] [V] [TRT] *************** Autotuning format combination: -> Float(1) *************** [09/29/2020-17:42:13] [V] [TRT] *************** Autotuning format combination: -> Half(1) *************** [09/29/2020-17:42:13] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072), Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (CaskConvolution) [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 1825138533642645384 time 0.665536 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 2775507031594384867 time 0.10736 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 2842488832350522458 time 0.450304 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 3915320020053085238 time 0.639232 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 6448355332020552203 time 0.667904 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 6808617066150061604 time 0.392448 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -8060443123034038864 time 0.465152 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -4420849921117327522 time 0.492192 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -3946921629105938337 time 0.53648 [09/29/2020-17:42:13] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.10736 [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (CudaConvolution) [09/29/2020-17:42:13] [V] [TRT] Tactic: 0 time 0.340256 [09/29/2020-17:42:13] [V] [TRT] Tactic: 2 time 0.36224 [09/29/2020-17:42:13] [V] [TRT] Tactic: 5 time 6.1399 [09/29/2020-17:42:13] [V] [TRT] Tactic: 6 time 0.190464 [09/29/2020-17:42:13] [V] [TRT] Tactic: 57 time 0.262144 [09/29/2020-17:42:13] [V] [TRT] Fastest Tactic: 6 Time: 0.190464 [09/29/2020-17:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:13] [V] [TRT] [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:13] [V] [TRT] *************** Autotuning format combination: Half(1,16,256,131072), Half(1,16,256,131072) -> Half(1,16,256,131072) *************** [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (CaskConvolution) [09/29/2020-17:42:13] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (CudaConvolution) [09/29/2020-17:42:13] [V] [TRT] Tactic: 0 time 0.386752 [09/29/2020-17:42:13] [V] [TRT] Tactic: 1 time 0.387072 [09/29/2020-17:42:13] [V] [TRT] Tactic: 2 time 0.376832 [09/29/2020-17:42:13] [V] [TRT] Tactic: 4 time 5.92877 [09/29/2020-17:42:13] [V] [TRT] Tactic: 5 time 5.94362 [09/29/2020-17:42:13] [V] [TRT] Tactic: 6 time 0.254464 [09/29/2020-17:42:13] [V] [TRT] Fastest Tactic: 6 Time: 0.254464 [09/29/2020-17:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [09/29/2020-17:42:13] [V] [TRT] [09/29/2020-17:42:13] [V] [TRT] *************** Autotuning format combination: Half(1,16,256:2,65536), Half(1,16,256:2,65536) -> Half(1,16,256:2,65536) *************** [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (CaskConvolution) [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 1145226902788474763 time 0.243968 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 1651411198763708804 time 0.23552 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 2418518597804310654 time 0.237568 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 4318470497547290900 time 0.20032 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 4653005425971292725 time 0.240512 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 4930470141256631146 time 0.263264 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 8292881859266835088 time 0.273184 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 8401509141903434922 time 0.200704 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -8654297089785671176 time 0.32768 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -7448936905981214224 time 0.299328 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -6004726995029373073 time 0.219136 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -5719726816705110014 time 0.32768 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -3754890472406891741 time 0.34432 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -3689982367035295496 time 0.338816 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -3140347171730126532 time 0.05552 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -2894005464278291378 time 0.276384 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -2027588946874785071 time 0.2112 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -1968398013367819764 time 0.338176 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -245090590808296743 time 0.34544 [09/29/2020-17:42:13] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.05552 [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (CudaConvolution) [09/29/2020-17:42:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:13] [V] [TRT] [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:13] [V] [TRT] *************** Autotuning format combination: Half(64,1024,1:8,16384), Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (CaskConvolution) [09/29/2020-17:42:13] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (CudaConvolution) [09/29/2020-17:42:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:13] [V] [TRT] *************** Autotuning format combination: Half(64,1024,1:8,16384), Half(64,1024,1:8,16384) -> Half(64,1024,1:8,16384) *************** [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (CaskConvolution) [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] Tactic: 130343752241278875 time 0.061696 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 2148106709480872763 time 0.114688 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 2410442691266548717 time 0.173664 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] Tactic: 2921824978225832523 time 0.057344 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:13] [V] [TRT] Tactic: 3030711443478140260 time 0.096256 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 3754069740140581927 time 0.182528 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 3823144360994712832 time 0.100352 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 5635311898703673455 time 0.103872 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 5925270497649423688 time 0.325888 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 6680916730816870145 time 0.177536 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 7158029511300006471 time 0.174336 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 7859952145590271433 time 0.17408 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: 8283847742354150423 time 0.183104 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -8992262742606384444 time 0.124256 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -8682550625095202832 time 0.123136 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:13] [V] [TRT] Tactic: -8379842433586149932 time 0.094464 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:13] [V] [TRT] Tactic: -6352769237623756264 time 0.100544 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -6273232454637933930 time 0.100352 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -5818527483287834165 time 0.096512 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -4954692664176521434 time 0.17648 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] Tactic: -4953888146171240997 time 0.055456 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -4534876761957424274 time 0.325248 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -3237051169894153788 time 0.172032 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -3136088851200285532 time 0.096544 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -2586046817576862066 time 0.178336 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] Tactic: -229563042944049199 time 0.102144 [09/29/2020-17:42:13] [V] [TRT] Fastest Tactic: -4953888146171240997 Time: 0.055456 [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (CudaConvolution) [09/29/2020-17:42:13] [V] [TRT] Tactic: 0 time 0.758016 [09/29/2020-17:42:13] [V] [TRT] Tactic: 1 time 0.755968 [09/29/2020-17:42:13] [V] [TRT] Tactic: 2 time 0.382976 [09/29/2020-17:42:13] [V] [TRT] Tactic: 6 time 0.239616 [09/29/2020-17:42:13] [V] [TRT] Fastest Tactic: 6 Time: 0.239616 [09/29/2020-17:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4953888146171240997 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:13] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: 527 copy (Reformat) [09/29/2020-17:42:13] [V] [TRT] Tactic: 1002 time 0.0064 [09/29/2020-17:42:13] [V] [TRT] Tactic: 0 time 0.005824 [09/29/2020-17:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.005824 [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: 527 copy (Reformat) [09/29/2020-17:42:13] [V] [TRT] Tactic: 1002 time 0.0064 [09/29/2020-17:42:13] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0064 [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: 527 copy (Reformat) [09/29/2020-17:42:13] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:42:13] [V] [TRT] Tactic: 0 time 0.005952 [09/29/2020-17:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.005952 [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: 527 copy (Reformat) [09/29/2020-17:42:13] [V] [TRT] Tactic: 1002 time 0.008032 [09/29/2020-17:42:13] [V] [TRT] Tactic: 0 time 0.005984 [09/29/2020-17:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.005984 [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: 527 copy (Reformat) [09/29/2020-17:42:13] [V] [TRT] Tactic: 1002 time 0.0064 [09/29/2020-17:42:13] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: 527 copy (Reformat) [09/29/2020-17:42:13] [V] [TRT] Tactic: 1002 time 0.0064 [09/29/2020-17:42:13] [V] [TRT] Tactic: 0 time 0.004384 [09/29/2020-17:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.004384 [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: 527 copy (Reformat) [09/29/2020-17:42:13] [V] [TRT] Tactic: 1002 time 0.01104 [09/29/2020-17:42:13] [V] [TRT] Tactic: 0 time 0.005888 [09/29/2020-17:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.005888 [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: 527 copy (Reformat) [09/29/2020-17:42:13] [V] [TRT] Tactic: 1002 time 0.008192 [09/29/2020-17:42:13] [V] [TRT] Tactic: 0 time 0.004576 [09/29/2020-17:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.004576 [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: 527 copy (Reformat) [09/29/2020-17:42:13] [V] [TRT] Tactic: 1002 time 0.010688 [09/29/2020-17:42:13] [V] [TRT] Tactic: 0 time 0.006976 [09/29/2020-17:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.006976 [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: 527 copy (Reformat) [09/29/2020-17:42:13] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:42:13] [V] [TRT] Tactic: 0 time 0.005856 [09/29/2020-17:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.005856 [09/29/2020-17:42:13] [V] [TRT] --------------- Timing Runner: 527 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.010272 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.005184 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.005184 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 527 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.007392 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.005856 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.005856 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 527 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.008192 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 527 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.008128 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.008128 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 527 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.011136 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.00432 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00432 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 527 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.010432 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.004096 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 520 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.004992 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.005536 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.004992 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 520 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.008 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 520 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.005984 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.005984 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 520 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.008192 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.006496 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.006496 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 520 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.006144 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.007936 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 520 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.006144 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.005856 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.005856 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 520 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.006112 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.006112 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 520 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.00768 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.005792 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.005792 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 520 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.010272 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 520 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 520 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.004352 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 520 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.008064 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.005792 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.005792 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 520 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.008 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.008 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 520 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.008064 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.008064 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 520 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.013408 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.005696 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.005696 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 520 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.005888 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.005888 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 511 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.006048 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.004352 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 511 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.006144 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.005856 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.005856 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 511 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.008064 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.005824 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.005824 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 511 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.007424 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.005024 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.005024 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 511 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.005888 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.005888 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 511 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.004864 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.004064 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.004064 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 511 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.009088 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 511 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.008192 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.0048 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.0048 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 511 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.008192 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.005728 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.005728 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 511 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.008192 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.005824 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.005824 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 511 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.008192 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.004064 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.004064 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 511 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.007712 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.004352 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 511 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.008 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.006304 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.006304 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 511 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.007008 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 511 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.008448 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.004096 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: 511 copy (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.007872 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.005824 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.005824 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.007584 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.009088 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.007584 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.016288 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.007008 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.007008 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.011744 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.007008 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.007008 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.007648 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.009056 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.007648 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.016256 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.007648 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.007648 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.010496 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.007552 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.007552 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.015232 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.007488 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.007488 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.015808 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.00752 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00752 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.011776 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.006304 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.006304 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.011136 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.011904 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:14] [V] [TRT] Tactic: 1002 time 0.020192 [09/29/2020-17:42:14] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:42:14] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,327680) -> Float(1,16,256,131072) *************** [09/29/2020-17:42:14] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:42:14] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:14] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:42:14] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:14] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:14] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:42:14] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:14] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:14] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:14] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:14] [V] [TRT] Tactic: 589823 time 0.43824 [09/29/2020-17:42:14] [V] [TRT] Tactic: 655359 time 0.27648 [09/29/2020-17:42:14] [V] [TRT] Tactic: 786431 time 0.16384 [09/29/2020-17:42:14] [V] [TRT] Tactic: 851967 time 0.092416 [09/29/2020-17:42:14] [V] [TRT] Tactic: 1179647 time 0.06784 [09/29/2020-17:42:14] [V] [TRT] Tactic: 1310719 time 0.192768 [09/29/2020-17:42:14] [V] [TRT] Tactic: 1376255 time 0.2888 [09/29/2020-17:42:14] [V] [TRT] Tactic: 1441791 time 0.128768 [09/29/2020-17:42:14] [V] [TRT] Tactic: 1507327 time 0.154912 [09/29/2020-17:42:14] [V] [TRT] Tactic: 1638399 time 0.135424 [09/29/2020-17:42:14] [V] [TRT] Tactic: 1835007 time 0.147712 [09/29/2020-17:42:14] [V] [TRT] Tactic: 1900543 time 0.291072 [09/29/2020-17:42:14] [V] [TRT] Tactic: 2097151 time 0.13312 [09/29/2020-17:42:14] [V] [TRT] Tactic: 2162687 time 0.299008 [09/29/2020-17:42:14] [V] [TRT] Tactic: 2293759 time 0.266592 [09/29/2020-17:42:14] [V] [TRT] Tactic: 2359295 time 0.16176 [09/29/2020-17:42:14] [V] [TRT] Tactic: 2686975 time 0.276576 [09/29/2020-17:42:14] [V] [TRT] Tactic: 3080191 time 0.138816 [09/29/2020-17:42:14] [V] [TRT] Tactic: 3342335 time 0.15536 [09/29/2020-17:42:14] [V] [TRT] Tactic: 3407871 time 0.137472 [09/29/2020-17:42:14] [V] [TRT] Tactic: 3538943 time 0.083264 [09/29/2020-17:42:14] [V] [TRT] Tactic: 3670015 time 0.534784 [09/29/2020-17:42:14] [V] [TRT] Tactic: 3932159 time 0.227328 [09/29/2020-17:42:14] [V] [TRT] Tactic: 3997695 time 0.153216 [09/29/2020-17:42:14] [V] [TRT] Tactic: 4063231 time 0.096448 [09/29/2020-17:42:14] [V] [TRT] Tactic: 4194303 time 0.147168 [09/29/2020-17:42:14] [V] [TRT] Tactic: 4259839 time 0.092128 [09/29/2020-17:42:14] [V] [TRT] Tactic: 4325375 time 0.133376 [09/29/2020-17:42:14] [V] [TRT] Tactic: 4521983 time 0.276736 [09/29/2020-17:42:14] [V] [TRT] Tactic: 4587519 time 0.121088 [09/29/2020-17:42:14] [V] [TRT] Tactic: 4653055 time 0.08832 [09/29/2020-17:42:14] [V] [TRT] Tactic: 4915199 time 0.129888 [09/29/2020-17:42:15] [V] [TRT] Tactic: 4980735 time 0.141568 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5177343 time 0.074528 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5242879 time 0.136448 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5373951 time 0.08576 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5439487 time 0.186624 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5570559 time 0.147328 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5636095 time 0.096064 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5701631 time 0.270304 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5767167 time 0.28576 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5832703 time 0.142848 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5898239 time 0.098304 [09/29/2020-17:42:15] [V] [TRT] Tactic: 6029311 time 0.25216 [09/29/2020-17:42:15] [V] [TRT] Tactic: 6225919 time 0.093952 [09/29/2020-17:42:15] [V] [TRT] Tactic: 6291455 time 0.06784 [09/29/2020-17:42:15] [V] [TRT] Tactic: 6422527 time 0.128736 [09/29/2020-17:42:15] [V] [TRT] Tactic: 6750207 time 0.14832 [09/29/2020-17:42:15] [V] [TRT] Tactic: 6815743 time 0.13952 [09/29/2020-17:42:15] [V] [TRT] Tactic: 6946815 time 0.159872 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7012351 time 0.129024 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7077887 time 0.080736 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7143423 time 0.243328 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7208959 time 0.141568 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7340031 time 0.1024 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7405567 time 0.100352 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7536639 time 0.227584 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7602175 time 0.11264 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7733247 time 0.100352 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7798783 time 0.162656 [09/29/2020-17:42:15] [V] [TRT] Tactic: 8191999 time 0.135168 [09/29/2020-17:42:15] [V] [TRT] Tactic: 8257535 time 0.134528 [09/29/2020-17:42:15] [V] [TRT] Tactic: 8323071 time 0.159712 [09/29/2020-17:42:15] [V] [TRT] Tactic: 8650751 time 0.129024 [09/29/2020-17:42:15] [V] [TRT] Tactic: 8716287 time 0.114912 [09/29/2020-17:42:15] [V] [TRT] Tactic: 9109503 time 0.130912 [09/29/2020-17:42:15] [V] [TRT] Tactic: 9568255 time 0.13104 [09/29/2020-17:42:15] [V] [TRT] Tactic: 9895935 time 0.14688 [09/29/2020-17:42:15] [V] [TRT] Tactic: 10223615 time 0.274432 [09/29/2020-17:42:15] [V] [TRT] Tactic: 10354687 time 0.092416 [09/29/2020-17:42:15] [V] [TRT] Tactic: 10551295 time 0.16608 [09/29/2020-17:42:15] [V] [TRT] Tactic: 10747903 time 0.09856 [09/29/2020-17:42:15] [V] [TRT] Tactic: 10944511 time 0.141056 [09/29/2020-17:42:15] [V] [TRT] Fastest Tactic: 1179647 Time: 0.06784 [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (CaskConvolution) [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 1754569683116234317 time 0.188416 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 1825138533642645384 time 0.191904 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 2733356012094739613 time 0.182432 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 3915320020053085238 time 0.18976 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 6808617066150061604 time 0.114944 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 9091006216302412844 time 0.109856 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -8060443123034038864 time 0.12288 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -4420849921117327522 time 0.154336 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -3946921629105938337 time 0.18192 [09/29/2020-17:42:15] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.109856 [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (CudaConvolution) [09/29/2020-17:42:15] [V] [TRT] Tactic: 0 time 0.100608 [09/29/2020-17:42:15] [V] [TRT] Tactic: 2 time 0.193824 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5 time 0.831328 [09/29/2020-17:42:15] [V] [TRT] Tactic: 57 time 0.100608 [09/29/2020-17:42:15] [V] [TRT] Fastest Tactic: 0 Time: 0.100608 [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 1179647 [09/29/2020-17:42:15] [V] [TRT] [09/29/2020-17:42:15] [V] [TRT] *************** Autotuning format combination: Half(1,16,256,327680) -> Half(1,16,256,131072) *************** [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (CaskConvolution) [09/29/2020-17:42:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (CudaConvolution) [09/29/2020-17:42:15] [V] [TRT] Tactic: 0 time 0.116896 [09/29/2020-17:42:15] [V] [TRT] Tactic: 1 time 0.114944 [09/29/2020-17:42:15] [V] [TRT] Tactic: 2 time 0.172896 [09/29/2020-17:42:15] [V] [TRT] Tactic: 4 time 4.58899 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5 time 0.776704 [09/29/2020-17:42:15] [V] [TRT] Fastest Tactic: 1 Time: 0.114944 [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [09/29/2020-17:42:15] [V] [TRT] [09/29/2020-17:42:15] [V] [TRT] *************** Autotuning format combination: Half(1,16,256:2,163840) -> Half(1,16,256,131072) *************** [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (CaskConvolution) [09/29/2020-17:42:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (CudaConvolution) [09/29/2020-17:42:15] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:15] [V] [TRT] *************** Autotuning format combination: Half(1,16,256:2,163840) -> Half(1,16,256:2,65536) *************** [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:15] [V] [TRT] Tactic: 589823 time 0.14976 [09/29/2020-17:42:15] [V] [TRT] Tactic: 655359 time 0.104736 [09/29/2020-17:42:15] [V] [TRT] Tactic: 786431 time 0.087584 [09/29/2020-17:42:15] [V] [TRT] Tactic: 851967 time 0.049152 [09/29/2020-17:42:15] [V] [TRT] Tactic: 1179647 time 0.036864 [09/29/2020-17:42:15] [V] [TRT] Tactic: 1310719 time 0.084256 [09/29/2020-17:42:15] [V] [TRT] Tactic: 1376255 time 0.111456 [09/29/2020-17:42:15] [V] [TRT] Tactic: 1441791 time 0.056864 [09/29/2020-17:42:15] [V] [TRT] Tactic: 1507327 time 0.059648 [09/29/2020-17:42:15] [V] [TRT] Tactic: 1638399 time 0.073728 [09/29/2020-17:42:15] [V] [TRT] Tactic: 1835007 time 0.072096 [09/29/2020-17:42:15] [V] [TRT] Tactic: 1900543 time 0.110304 [09/29/2020-17:42:15] [V] [TRT] Tactic: 2097151 time 0.072544 [09/29/2020-17:42:15] [V] [TRT] Tactic: 2162687 time 0.118848 [09/29/2020-17:42:15] [V] [TRT] Tactic: 2293759 time 0.09808 [09/29/2020-17:42:15] [V] [TRT] Tactic: 2359295 time 0.063456 [09/29/2020-17:42:15] [V] [TRT] Tactic: 2686975 time 0.102656 [09/29/2020-17:42:15] [V] [TRT] Tactic: 3080191 time 0.054976 [09/29/2020-17:42:15] [V] [TRT] Tactic: 3342335 time 0.061376 [09/29/2020-17:42:15] [V] [TRT] Tactic: 3407871 time 0.05264 [09/29/2020-17:42:15] [V] [TRT] Tactic: 3538943 time 0.03712 [09/29/2020-17:42:15] [V] [TRT] Tactic: 3670015 time 0.196608 [09/29/2020-17:42:15] [V] [TRT] Tactic: 3932159 time 0.081792 [09/29/2020-17:42:15] [V] [TRT] Tactic: 3997695 time 0.08192 [09/29/2020-17:42:15] [V] [TRT] Tactic: 4063231 time 0.049408 [09/29/2020-17:42:15] [V] [TRT] Tactic: 4194303 time 0.071744 [09/29/2020-17:42:15] [V] [TRT] Tactic: 4259839 time 0.049152 [09/29/2020-17:42:15] [V] [TRT] Tactic: 4325375 time 0.07104 [09/29/2020-17:42:15] [V] [TRT] Tactic: 4521983 time 0.102496 [09/29/2020-17:42:15] [V] [TRT] Tactic: 4587519 time 0.073184 [09/29/2020-17:42:15] [V] [TRT] Tactic: 4653055 time 0.04672 [09/29/2020-17:42:15] [V] [TRT] Tactic: 4915199 time 0.07744 [09/29/2020-17:42:15] [V] [TRT] Tactic: 4980735 time 0.075776 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5177343 time 0.040768 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5242879 time 0.055584 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5373951 time 0.046784 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5439487 time 0.09648 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5570559 time 0.0576 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5636095 time 0.049408 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5701631 time 0.094272 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5767167 time 0.143648 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5832703 time 0.053504 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5898239 time 0.049408 [09/29/2020-17:42:15] [V] [TRT] Tactic: 6029311 time 0.090848 [09/29/2020-17:42:15] [V] [TRT] Tactic: 6225919 time 0.048608 [09/29/2020-17:42:15] [V] [TRT] Tactic: 6291455 time 0.037056 [09/29/2020-17:42:15] [V] [TRT] Tactic: 6422527 time 0.053504 [09/29/2020-17:42:15] [V] [TRT] Tactic: 6750207 time 0.077056 [09/29/2020-17:42:15] [V] [TRT] Tactic: 6815743 time 0.063968 [09/29/2020-17:42:15] [V] [TRT] Tactic: 6946815 time 0.083968 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7012351 time 0.07168 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7077887 time 0.035072 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7143423 time 0.11904 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7208959 time 0.054944 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7340031 time 0.051456 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7405567 time 0.055296 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7536639 time 0.081504 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7602175 time 0.059616 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7733247 time 0.0512 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7798783 time 0.086528 [09/29/2020-17:42:15] [V] [TRT] Tactic: 8191999 time 0.069888 [09/29/2020-17:42:15] [V] [TRT] Tactic: 8257535 time 0.071424 [09/29/2020-17:42:15] [V] [TRT] Tactic: 8323071 time 0.081856 [09/29/2020-17:42:15] [V] [TRT] Tactic: 8650751 time 0.065536 [09/29/2020-17:42:15] [V] [TRT] Tactic: 8716287 time 0.060128 [09/29/2020-17:42:15] [V] [TRT] Tactic: 9109503 time 0.073216 [09/29/2020-17:42:15] [V] [TRT] Tactic: 9568255 time 0.077824 [09/29/2020-17:42:15] [V] [TRT] Tactic: 9895935 time 0.07168 [09/29/2020-17:42:15] [V] [TRT] Tactic: 10223615 time 0.102656 [09/29/2020-17:42:15] [V] [TRT] Tactic: 10354687 time 0.049408 [09/29/2020-17:42:15] [V] [TRT] Tactic: 10551295 time 0.084224 [09/29/2020-17:42:15] [V] [TRT] Tactic: 10747903 time 0.049408 [09/29/2020-17:42:15] [V] [TRT] Tactic: 10944511 time 0.07776 [09/29/2020-17:42:15] [V] [TRT] Fastest Tactic: 7077887 Time: 0.035072 [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (CaskConvolution) [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 1651411198763708804 time 0.06208 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 2418518597804310654 time 0.063328 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 4318470497547290900 time 0.059648 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 4930470141256631146 time 0.06784 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 8292881859266835088 time 0.06976 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 8401509141903434922 time 0.058848 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -8654297089785671176 time 0.096256 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -7516584506774355935 time 0.0576 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -7140760933967189247 time 0.05904 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -6004726995029373073 time 0.065792 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -5719726816705110014 time 0.096512 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -4097850214384059472 time 0.057344 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -3717489476759089008 time 0.057248 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -3689982367035295496 time 0.096256 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -2640575123064142123 time 0.096256 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -2534402059426524406 time 0.096256 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -2027588946874785071 time 0.062944 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -1968398013367819764 time 0.096512 [09/29/2020-17:42:15] [V] [TRT] Fastest Tactic: -3717489476759089008 Time: 0.057248 [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (CudaConvolution) [09/29/2020-17:42:15] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7077887 [09/29/2020-17:42:15] [V] [TRT] [09/29/2020-17:42:15] [V] [TRT] *************** Autotuning format combination: Half(160,2560,1:8,40960) -> Float(1,16,256,131072) *************** [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (CaskConvolution) [09/29/2020-17:42:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (CudaConvolution) [09/29/2020-17:42:15] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:15] [V] [TRT] *************** Autotuning format combination: Half(160,2560,1:8,40960) -> Half(64,1024,1:8,16384) *************** [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (FusedConvActConvolution) [09/29/2020-17:42:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (CaskConvolution) [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:15] [V] [TRT] Tactic: 9576651994278528 time 0.020736 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 1179757074518529353 time 0.032992 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 2105695814191699972 time 0.0576 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 2148106709480872763 time 0.036832 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 2410442691266548717 time 0.054944 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 3041642431972138763 time 0.03184 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 3754069740140581927 time 0.0576 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 4555462412611657028 time 0.04096 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5666160310350604399 time 0.058208 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:15] [V] [TRT] Tactic: 5876997871499382316 time 0.031008 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 5925270497649423688 time 0.096256 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 6680916730816870145 time 0.05456 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7158029511300006471 time 0.055296 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 7859952145590271433 time 0.053728 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: 8283847742354150423 time 0.0576 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -8992262742606384444 time 0.043008 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -8391760416076885205 time 0.096096 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -6273232454637933930 time 0.03328 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:15] [V] [TRT] Tactic: -5925110308892264213 time 0.030688 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -5818527483287834165 time 0.0328 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:15] [V] [TRT] Tactic: -4908848143422991657 time 0.020512 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -4534876761957424274 time 0.096256 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -3237051169894153788 time 0.054272 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -3136088851200285532 time 0.032256 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -2586046817576862066 time 0.055552 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -2422160065350346448 time 0.055296 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -1216445540764179377 time 0.054112 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] Tactic: -229563042944049199 time 0.034144 [09/29/2020-17:42:15] [V] [TRT] Fastest Tactic: -4908848143422991657 Time: 0.020512 [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (CudaConvolution) [09/29/2020-17:42:15] [V] [TRT] Tactic: 0 time 4.5079 [09/29/2020-17:42:15] [V] [TRT] Tactic: 1 time 0.360448 [09/29/2020-17:42:15] [V] [TRT] Tactic: 2 time 0.18048 [09/29/2020-17:42:15] [V] [TRT] Fastest Tactic: 2 Time: 0.18048 [09/29/2020-17:42:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (CudaDepthwiseConvolution) [09/29/2020-17:42:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4908848143422991657 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:15] [V] [TRT] [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:15] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:16] [V] [TRT] Tactic: 1002 time 0.005856 [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.005856 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:16] [V] [TRT] Tactic: 1002 time 0.005984 [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 0.006176 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.005984 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:16] [V] [TRT] Tactic: 1002 time 0.008448 [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 0.005824 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 0 Time: 0.005824 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:16] [V] [TRT] Tactic: 1002 time 0.008448 [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 0.005824 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 0 Time: 0.005824 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:16] [V] [TRT] Tactic: 1002 time 0.009664 [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 0.005696 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 0 Time: 0.005696 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:16] [V] [TRT] Tactic: 1002 time 0.009056 [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 0.005344 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 0 Time: 0.005344 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:16] [V] [TRT] Tactic: 1002 time 0.006144 [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 0.006848 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:16] [V] [TRT] Tactic: 1002 time 0.0064 [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0064 [09/29/2020-17:42:16] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288), Float(1,64,4096,110592), Float(1,3,9,1152), Float(1) -> Float(1,64,4096,524288) *************** [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 156) [PluginV2Ext] (PluginV2) 128 64 64 1 128 64 64 1 128 64 64 1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 1.57696 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 0 Time: 1.57696 [09/29/2020-17:42:16] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,524288), Half(1,64,4096,110592), Half(1,3,9,1152), Half(1) -> Half(1,64,4096,524288) *************** [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 156) [PluginV2Ext] (PluginV2) 128 64 64 1 half. 128 64 64 1 half. 128 64 64 1 half. [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 1.25158 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 0 Time: 1.25158 [09/29/2020-17:42:16] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,6912) *************** [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 131) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:16] [V] [TRT] Tactic: 524287 time 0.245792 [09/29/2020-17:42:16] [V] [TRT] Tactic: 1048575 time 0.161088 [09/29/2020-17:42:16] [V] [TRT] Tactic: 1703935 time 0.082784 [09/29/2020-17:42:16] [V] [TRT] Tactic: 2228223 time 0.177856 [09/29/2020-17:42:16] [V] [TRT] Tactic: 2424831 time 0.07168 [09/29/2020-17:42:16] [V] [TRT] Tactic: 2621439 time 0.065984 [09/29/2020-17:42:16] [V] [TRT] Tactic: 3014655 time 0.103712 [09/29/2020-17:42:16] [V] [TRT] Tactic: 3604479 time 0.102656 [09/29/2020-17:42:16] [V] [TRT] Tactic: 5046271 time 0.128416 [09/29/2020-17:42:16] [V] [TRT] Tactic: 6160383 time 0.215392 [09/29/2020-17:42:16] [V] [TRT] Tactic: 6488063 time 0.182272 [09/29/2020-17:42:16] [V] [TRT] Tactic: 7864319 time 0.069472 [09/29/2020-17:42:16] [V] [TRT] Tactic: 8585215 time 0.289024 [09/29/2020-17:42:16] [V] [TRT] Tactic: 8847359 time 0.073728 [09/29/2020-17:42:16] [V] [TRT] Tactic: 9043967 time 0.094208 [09/29/2020-17:42:16] [V] [TRT] Tactic: 9175039 time 0.102656 [09/29/2020-17:42:16] [V] [TRT] Tactic: 9961471 time 0.080128 [09/29/2020-17:42:16] [V] [TRT] Tactic: 10027007 time 0.145696 [09/29/2020-17:42:16] [V] [TRT] Tactic: 10485759 time 0.076032 [09/29/2020-17:42:16] [V] [TRT] Tactic: 10682367 time 0.065344 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 10682367 Time: 0.065344 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 131) [Convolution] (CaskConvolution) [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 1825138533642645384 time 0.663552 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 2775507031594384867 time 0.092416 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 2842488832350522458 time 0.424192 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 3915320020053085238 time 0.637184 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 6448355332020552203 time 0.665856 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 6808617066150061604 time 0.377728 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -8060443123034038864 time 0.454912 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -4420849921117327522 time 0.395264 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -3946921629105938337 time 0.450816 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.092416 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 131) [Convolution] (CudaConvolution) [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 0.170368 [09/29/2020-17:42:16] [V] [TRT] Tactic: 2 time 0.241952 [09/29/2020-17:42:16] [V] [TRT] Tactic: 5 time 0.387008 [09/29/2020-17:42:16] [V] [TRT] Tactic: 6 time 0.096512 [09/29/2020-17:42:16] [V] [TRT] Tactic: 57 time 0.170112 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 6 Time: 0.096512 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 131) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10682367 [09/29/2020-17:42:16] [V] [TRT] [09/29/2020-17:42:16] [V] [TRT] *************** Autotuning format combination: Half(1,16,256,131072) -> Half(1,16,256,6912) *************** [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 131) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:16] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 131) [Convolution] (CaskConvolution) [09/29/2020-17:42:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 131) [Convolution] (CudaConvolution) [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 0.23552 [09/29/2020-17:42:16] [V] [TRT] Tactic: 1 time 0.374016 [09/29/2020-17:42:16] [V] [TRT] Tactic: 2 time 0.181568 [09/29/2020-17:42:16] [V] [TRT] Tactic: 4 time 0.365312 [09/29/2020-17:42:16] [V] [TRT] Tactic: 5 time 0.37664 [09/29/2020-17:42:16] [V] [TRT] Tactic: 6 time 0.125088 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 6 Time: 0.125088 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 131) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [09/29/2020-17:42:16] [V] [TRT] [09/29/2020-17:42:16] [V] [TRT] *************** Autotuning format combination: Half(1,16,256:2,65536) -> Half(1,16,256:2,3584) *************** [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 131) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:16] [V] [TRT] Tactic: 524287 time 0.128768 [09/29/2020-17:42:16] [V] [TRT] Tactic: 1048575 time 0.083904 [09/29/2020-17:42:16] [V] [TRT] Tactic: 1703935 time 0.045184 [09/29/2020-17:42:16] [V] [TRT] Tactic: 2228223 time 0.090368 [09/29/2020-17:42:16] [V] [TRT] Tactic: 2424831 time 0.039168 [09/29/2020-17:42:16] [V] [TRT] Tactic: 2621439 time 0.036672 [09/29/2020-17:42:16] [V] [TRT] Tactic: 3014655 time 0.05632 [09/29/2020-17:42:16] [V] [TRT] Tactic: 3604479 time 0.056864 [09/29/2020-17:42:16] [V] [TRT] Tactic: 5046271 time 0.069888 [09/29/2020-17:42:16] [V] [TRT] Tactic: 6160383 time 0.11264 [09/29/2020-17:42:16] [V] [TRT] Tactic: 6488063 time 0.09632 [09/29/2020-17:42:16] [V] [TRT] Tactic: 7864319 time 0.036928 [09/29/2020-17:42:16] [V] [TRT] Tactic: 8585215 time 0.153248 [09/29/2020-17:42:16] [V] [TRT] Tactic: 8847359 time 0.041216 [09/29/2020-17:42:16] [V] [TRT] Tactic: 9043967 time 0.051456 [09/29/2020-17:42:16] [V] [TRT] Tactic: 9175039 time 0.056192 [09/29/2020-17:42:16] [V] [TRT] Tactic: 9961471 time 0.045056 [09/29/2020-17:42:16] [V] [TRT] Tactic: 10027007 time 0.076672 [09/29/2020-17:42:16] [V] [TRT] Tactic: 10485759 time 0.041824 [09/29/2020-17:42:16] [V] [TRT] Tactic: 10682367 time 0.035072 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 10682367 Time: 0.035072 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 131) [Convolution] (CaskConvolution) [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 1145226902788474763 time 0.239872 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 1651411198763708804 time 0.233472 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 2418518597804310654 time 0.233472 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 4318470497547290900 time 0.196864 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 4653005425971292725 time 0.239168 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 4930470141256631146 time 0.25344 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 8292881859266835088 time 0.255104 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 8401509141903434922 time 0.192768 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -8654297089785671176 time 0.325888 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -7448936905981214224 time 0.280576 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -6004726995029373073 time 0.198912 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -5719726816705110014 time 0.325888 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -3754890472406891741 time 0.344064 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -3689982367035295496 time 0.33792 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -3140347171730126532 time 0.04736 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -2894005464278291378 time 0.266496 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -2027588946874785071 time 0.190016 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -1968398013367819764 time 0.33776 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -245090590808296743 time 0.344192 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.04736 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 131) [Convolution] (CudaConvolution) [09/29/2020-17:42:16] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 131) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10682367 [09/29/2020-17:42:16] [V] [TRT] [09/29/2020-17:42:16] [V] [TRT] *************** Autotuning format combination: Half(64,1024,1:8,16384) -> Float(1,16,256,6912) *************** [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 131) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:16] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 131) [Convolution] (CaskConvolution) [09/29/2020-17:42:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 131) [Convolution] (CudaConvolution) [09/29/2020-17:42:16] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 131) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:16] [V] [TRT] *************** Autotuning format combination: Half(64,1024,1:8,16384) -> Half(4,64,1:8,1024) *************** [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 131) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:16] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 131) [Convolution] (CaskConvolution) [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:16] [V] [TRT] Tactic: 130343752241278875 time 0.044832 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 2148106709480872763 time 0.100608 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 2410442691266548717 time 0.171904 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:16] [V] [TRT] Tactic: 2921824978225832523 time 0.040608 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:16] [V] [TRT] Tactic: 3030711443478140260 time 0.055552 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 3754069740140581927 time 0.178176 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 3823144360994712832 time 0.096512 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 5635311898703673455 time 0.100352 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 5925270497649423688 time 0.323584 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 6680916730816870145 time 0.174336 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 7158029511300006471 time 0.169696 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 7859952145590271433 time 0.172032 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 8283847742354150423 time 0.178464 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -8992262742606384444 time 0.11264 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -8682550625095202832 time 0.110848 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:16] [V] [TRT] Tactic: -8379842433586149932 time 0.057248 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:16] [V] [TRT] Tactic: -6352769237623756264 time 0.06144 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -6273232454637933930 time 0.096256 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -5818527483287834165 time 0.094208 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -4954692664176521434 time 0.172288 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:16] [V] [TRT] Tactic: -4953888146171240997 time 0.038464 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -4534876761957424274 time 0.321792 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -3237051169894153788 time 0.166144 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -3136088851200285532 time 0.093728 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -2586046817576862066 time 0.173888 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] Tactic: -229563042944049199 time 0.100192 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: -4953888146171240997 Time: 0.038464 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 131) [Convolution] (CudaConvolution) [09/29/2020-17:42:16] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 131) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4953888146171240997 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:16] [V] [TRT] [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (undefined) Set Tactic Name: trt_volta_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_idx_64x32x64x1_8x8x4_1stages [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:16] [V] [TRT] (Unnamed Layer* 131) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:16] [V] [TRT] *************** Autotuning format combination: -> Float(1,3,9,4608) *************** [09/29/2020-17:42:16] [V] [TRT] *************** Autotuning format combination: -> Half(1,3,9,4608) *************** [09/29/2020-17:42:16] [V] [TRT] *************** Autotuning format combination: -> Float(1) *************** [09/29/2020-17:42:16] [V] [TRT] *************** Autotuning format combination: -> Half(1) *************** [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:16] [V] [TRT] Tactic: 1002 time 0.005856 [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 0.004352 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:16] [V] [TRT] Tactic: 1002 time 0.005824 [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 0.004096 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:16] [V] [TRT] Tactic: 1002 time 0.00816 [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 0.004352 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:16] [V] [TRT] Tactic: 1002 time 0.007456 [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 0.004352 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:16] [V] [TRT] Tactic: 1002 time 0.00704 [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 0.004352 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:16] [V] [TRT] Tactic: 1002 time 0.007648 [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 0.005408 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 0 Time: 0.005408 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:16] [V] [TRT] Tactic: 1002 time 0.02624 [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 0.024832 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 0 Time: 0.024832 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:16] [V] [TRT] Tactic: 1002 time 0.02656 [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 0.022528 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 0 Time: 0.022528 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:16] [V] [TRT] Tactic: 1002 time 0.00496 [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 0.004256 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 0 Time: 0.004256 [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:16] [V] [TRT] Tactic: 1002 time 0.00496 [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 0.004352 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [09/29/2020-17:42:16] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072), Float(1,16,256,6912), Float(1,3,9,4608), Float(1) -> Float(1,16,256,65536) *************** [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 134) [PluginV2Ext] (PluginV2) 512 16 16 1 512 16 16 1 512 16 16 1 [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 1.9497 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 0 Time: 1.9497 [09/29/2020-17:42:16] [V] [TRT] *************** Autotuning format combination: Half(1,16,256,131072), Half(1,16,256,6912), Half(1,3,9,4608), Half(1) -> Half(1,16,256,65536) *************** [09/29/2020-17:42:16] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 134) [PluginV2Ext] (PluginV2) 512 16 16 1 half. 512 16 16 1 half. 512 16 16 1 half. [09/29/2020-17:42:16] [V] [TRT] Tactic: 0 time 1.28394 [09/29/2020-17:42:16] [V] [TRT] Fastest Tactic: 0 Time: 1.28394 [09/29/2020-17:42:17] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,65536) -> Float(1,16,256,65536) *************** [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 135) [Scale] + (Unnamed Layer* 136) [Activation] (Scale) [09/29/2020-17:42:17] [V] [TRT] Tactic: 0 time 0.00592 [09/29/2020-17:42:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00592 [09/29/2020-17:42:17] [V] [TRT] *************** Autotuning format combination: Half(1,16,256,65536) -> Half(1,16,256,65536) *************** [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 135) [Scale] + (Unnamed Layer* 136) [Activation] (Scale) [09/29/2020-17:42:17] [V] [TRT] Tactic: 0 time 0.005984 [09/29/2020-17:42:17] [V] [TRT] Fastest Tactic: 0 Time: 0.005984 [09/29/2020-17:42:17] [V] [TRT] *************** Autotuning format combination: Half(1,16,256:2,32768) -> Half(1,16,256:2,32768) *************** [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 135) [Scale] + (Unnamed Layer* 136) [Activation] (Scale) [09/29/2020-17:42:17] [V] [TRT] Tactic: 0 time 0.005856 [09/29/2020-17:42:17] [V] [TRT] Fastest Tactic: 0 Time: 0.005856 [09/29/2020-17:42:17] [V] [TRT] *************** Autotuning format combination: Half(32,512,1:8,8192) -> Half(32,512,1:8,8192) *************** [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 135) [Scale] + (Unnamed Layer* 136) [Activation] (Scale) [09/29/2020-17:42:17] [V] [TRT] Tactic: 0 time 0.00496 [09/29/2020-17:42:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00496 [09/29/2020-17:42:17] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,65536) -> Float(1,32,1024,262144) *************** [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 137) [Deconvolution] (CudnnDeconvolution) [09/29/2020-17:42:17] [V] [TRT] Tactic: 0 time 0.024832 [09/29/2020-17:42:17] [V] [TRT] Tactic: 1 time 0.024576 [09/29/2020-17:42:17] [V] [TRT] Tactic: 3 time 13.947 [09/29/2020-17:42:17] [V] [TRT] Tactic: 24 time 1.35565 [09/29/2020-17:42:17] [V] [TRT] Tactic: 25 time 1.21856 [09/29/2020-17:42:17] [V] [TRT] Tactic: 27 time 11.4563 [09/29/2020-17:42:17] [V] [TRT] Fastest Tactic: 1 Time: 0.024576 [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 137) [Deconvolution] (CaskDeconvolution) [09/29/2020-17:42:17] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 137) [Deconvolution] (GemmDeconvolution) [09/29/2020-17:42:17] [V] [TRT] Tactic: 0 time 1.56672 [09/29/2020-17:42:17] [V] [TRT] Fastest Tactic: 0 Time: 1.56672 [09/29/2020-17:42:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 1 [09/29/2020-17:42:17] [V] [TRT] [09/29/2020-17:42:17] [V] [TRT] *************** Autotuning format combination: Half(1,16,256,65536) -> Half(1,32,1024,262144) *************** [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 137) [Deconvolution] (CudnnDeconvolution) [09/29/2020-17:42:17] [V] [TRT] Tactic: 0 time 0.02544 [09/29/2020-17:42:17] [V] [TRT] Tactic: 1 time 0.02544 [09/29/2020-17:42:17] [V] [TRT] Tactic: 3 time 13.4907 [09/29/2020-17:42:17] [V] [TRT] Tactic: 24 time 1.34349 [09/29/2020-17:42:17] [V] [TRT] Tactic: 25 time 1.24269 [09/29/2020-17:42:17] [V] [TRT] Tactic: 27 time 11.5528 [09/29/2020-17:42:17] [V] [TRT] Fastest Tactic: 0 Time: 0.02544 [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 137) [Deconvolution] (CaskDeconvolution) [09/29/2020-17:42:17] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 137) [Deconvolution] (GemmDeconvolution) [09/29/2020-17:42:17] [V] [TRT] Tactic: 0 time 1.61382 [09/29/2020-17:42:17] [V] [TRT] Fastest Tactic: 0 Time: 1.61382 [09/29/2020-17:42:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 0 [09/29/2020-17:42:17] [V] [TRT] [09/29/2020-17:42:17] [V] [TRT] *************** Autotuning format combination: Half(1,16,256:2,32768) -> Half(1,32,1024:2,131072) *************** [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 137) [Deconvolution] (CudnnDeconvolution) [09/29/2020-17:42:17] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 137) [Deconvolution] (CaskDeconvolution) [09/29/2020-17:42:17] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 137) [Deconvolution] (GemmDeconvolution) [09/29/2020-17:42:17] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:17] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:42:17] [V] [TRT] Tactic: 0 time 0.017952 [09/29/2020-17:42:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.01024 [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:17] [V] [TRT] Tactic: 1002 time 0.010528 [09/29/2020-17:42:17] [V] [TRT] Tactic: 0 time 0.017248 [09/29/2020-17:42:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.010528 [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:17] [V] [TRT] Tactic: 1002 time 0.01024 [09/29/2020-17:42:17] [V] [TRT] Tactic: 0 time 0.017088 [09/29/2020-17:42:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.01024 [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:17] [V] [TRT] Tactic: 1002 time 0.014048 [09/29/2020-17:42:17] [V] [TRT] Tactic: 0 time 0.022496 [09/29/2020-17:42:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.014048 [09/29/2020-17:42:17] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144), Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 138) [ElementWise] (ElementWise) [09/29/2020-17:42:17] [V] [TRT] Tactic: 1 time 0.006432 [09/29/2020-17:42:17] [V] [TRT] Tactic: 2 time 0.009952 [09/29/2020-17:42:17] [V] [TRT] Fastest Tactic: 1 Time: 0.006432 [09/29/2020-17:42:17] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192), Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 138) [ElementWise] (ElementWise) [09/29/2020-17:42:17] [V] [TRT] Tactic: 1 time 0.0064 [09/29/2020-17:42:17] [V] [TRT] Tactic: 2 time 0.009952 [09/29/2020-17:42:17] [V] [TRT] Fastest Tactic: 1 Time: 0.0064 [09/29/2020-17:42:17] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144), Half(1,32,1024,262144) -> Half(1,32,1024,262144) *************** [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 138) [ElementWise] (ElementWise) [09/29/2020-17:42:17] [V] [TRT] Tactic: 1 time 0.006144 [09/29/2020-17:42:17] [V] [TRT] Tactic: 2 time 0.007904 [09/29/2020-17:42:17] [V] [TRT] Fastest Tactic: 1 Time: 0.006144 [09/29/2020-17:42:17] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072), Half(1,32,1024:2,131072) -> Half(1,32,1024:2,131072) *************** [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 138) [ElementWise] (ElementWise) [09/29/2020-17:42:17] [V] [TRT] Tactic: 1 time 0.006144 [09/29/2020-17:42:17] [V] [TRT] Tactic: 2 time 0.008192 [09/29/2020-17:42:17] [V] [TRT] Fastest Tactic: 1 Time: 0.006144 [09/29/2020-17:42:17] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768), Half(32,1024,1:8,32768) -> Half(32,1024,1:8,32768) *************** [09/29/2020-17:42:17] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 138) [ElementWise] (ElementWise) [09/29/2020-17:42:17] [V] [TRT] Tactic: 1 time 0.006144 [09/29/2020-17:42:18] [V] [TRT] Tactic: 2 time 0.008096 [09/29/2020-17:42:18] [V] [TRT] Fastest Tactic: 1 Time: 0.006144 [09/29/2020-17:42:18] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:18] [V] [TRT] Tactic: 1002 time 0.0152 [09/29/2020-17:42:18] [V] [TRT] Tactic: 0 time 0.012288 [09/29/2020-17:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [09/29/2020-17:42:18] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:18] [V] [TRT] Tactic: 1002 time 0.014592 [09/29/2020-17:42:18] [V] [TRT] Tactic: 0 time 0.011776 [09/29/2020-17:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.011776 [09/29/2020-17:42:18] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:18] [V] [TRT] Tactic: 1002 time 0.018432 [09/29/2020-17:42:18] [V] [TRT] Tactic: 0 time 0.012288 [09/29/2020-17:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [09/29/2020-17:42:18] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:18] [V] [TRT] Tactic: 1002 time 0.014336 [09/29/2020-17:42:18] [V] [TRT] Tactic: 0 time 0.009632 [09/29/2020-17:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.009632 [09/29/2020-17:42:18] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,27648) *************** [09/29/2020-17:42:18] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144) -> Half(1,32,1024,27648) *************** [09/29/2020-17:42:18] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072) -> Half(1,32,1024:2,14336) *************** [09/29/2020-17:42:18] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Float(1,32,1024,27648) *************** [09/29/2020-17:42:18] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 139) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:18] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 139) [Convolution] (CaskConvolution) [09/29/2020-17:42:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:18] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 139) [Convolution] (CudaConvolution) [09/29/2020-17:42:18] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:18] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 139) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:18] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Half(4,128,1:8,4096) *************** [09/29/2020-17:42:18] [V] [TRT] *************** Autotuning format combination: -> Float(1,3,9,2304) *************** [09/29/2020-17:42:18] [V] [TRT] *************** Autotuning format combination: -> Half(1,3,9,2304) *************** [09/29/2020-17:42:18] [V] [TRT] *************** Autotuning format combination: -> Float(1) *************** [09/29/2020-17:42:18] [V] [TRT] *************** Autotuning format combination: -> Half(1) *************** [09/29/2020-17:42:18] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:18] [V] [TRT] Tactic: 1002 time 0.008864 [09/29/2020-17:42:18] [V] [TRT] Tactic: 0 time 0.014112 [09/29/2020-17:42:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.008864 [09/29/2020-17:42:18] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:18] [V] [TRT] Tactic: 1002 time 0.009856 [09/29/2020-17:42:18] [V] [TRT] Tactic: 0 time 0.01392 [09/29/2020-17:42:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.009856 [09/29/2020-17:42:18] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144), Float(1,32,1024,27648), Float(1,3,9,2304), Float(1) -> Float(1,32,1024,262144) *************** [09/29/2020-17:42:18] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 142) [PluginV2Ext] (PluginV2) 256 32 32 1 256 32 32 1 256 32 32 1 [09/29/2020-17:42:18] [V] [TRT] Tactic: 0 time 1.20842 [09/29/2020-17:42:18] [V] [TRT] Fastest Tactic: 0 Time: 1.20842 [09/29/2020-17:42:18] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144), Half(1,32,1024,27648), Half(1,3,9,2304), Half(1) -> Half(1,32,1024,262144) *************** [09/29/2020-17:42:18] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 142) [PluginV2Ext] (PluginV2) 256 32 32 1 half. 256 32 32 1 half. 256 32 32 1 half. [09/29/2020-17:42:18] [V] [TRT] Tactic: 0 time 0.921056 [09/29/2020-17:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.921056 [09/29/2020-17:42:18] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [09/29/2020-17:42:18] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 143) [Scale] + (Unnamed Layer* 144) [Activation] (Scale) [09/29/2020-17:42:18] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:18] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144) -> Half(1,32,1024,262144) *************** [09/29/2020-17:42:18] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 143) [Scale] + (Unnamed Layer* 144) [Activation] (Scale) [09/29/2020-17:42:18] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:18] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072) -> Half(1,32,1024:2,131072) *************** [09/29/2020-17:42:18] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 143) [Scale] + (Unnamed Layer* 144) [Activation] (Scale) [09/29/2020-17:42:18] [V] [TRT] Tactic: 0 time 0.008032 [09/29/2020-17:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.008032 [09/29/2020-17:42:18] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Half(32,1024,1:8,32768) *************** [09/29/2020-17:42:18] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 143) [Scale] + (Unnamed Layer* 144) [Activation] (Scale) [09/29/2020-17:42:18] [V] [TRT] Tactic: 0 time 0.007584 [09/29/2020-17:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.007584 [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,27648) *************** [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144) -> Half(1,32,1024,27648) *************** [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072) -> Half(1,32,1024:2,14336) *************** [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Float(1,32,1024,27648) *************** [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 159) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 159) [Convolution] (CaskConvolution) [09/29/2020-17:42:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 159) [Convolution] (CudaConvolution) [09/29/2020-17:42:19] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 159) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Half(4,128,1:8,4096) *************** [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: -> Float(1,3,9,2304) *************** [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: -> Half(1,3,9,2304) *************** [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: -> Float(1) *************** [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: -> Half(1) *************** [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144), Float(1,32,1024,27648), Float(1,3,9,2304), Float(1) -> Float(1,32,1024,131072) *************** [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 162) [PluginV2Ext] (PluginV2) 256 32 32 1 256 32 32 1 256 32 32 1 [09/29/2020-17:42:19] [V] [TRT] Tactic: 0 time 0.880896 [09/29/2020-17:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.880896 [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144), Half(1,32,1024,27648), Half(1,3,9,2304), Half(1) -> Half(1,32,1024,131072) *************** [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 162) [PluginV2Ext] (PluginV2) 256 32 32 1 half. 256 32 32 1 half. 256 32 32 1 half. [09/29/2020-17:42:19] [V] [TRT] Tactic: 0 time 0.807776 [09/29/2020-17:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.807776 [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,131072) -> Float(1,32,1024,131072) *************** [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 163) [Scale] + (Unnamed Layer* 164) [Activation] (Scale) [09/29/2020-17:42:19] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,131072) -> Half(1,32,1024,131072) *************** [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 163) [Scale] + (Unnamed Layer* 164) [Activation] (Scale) [09/29/2020-17:42:19] [V] [TRT] Tactic: 0 time 0.00592 [09/29/2020-17:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00592 [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,65536) -> Half(1,32,1024:2,65536) *************** [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 163) [Scale] + (Unnamed Layer* 164) [Activation] (Scale) [09/29/2020-17:42:19] [V] [TRT] Tactic: 0 time 0.005888 [09/29/2020-17:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.005888 [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: Half(16,512,1:8,16384) -> Half(16,512,1:8,16384) *************** [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 163) [Scale] + (Unnamed Layer* 164) [Activation] (Scale) [09/29/2020-17:42:19] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,131072) -> Float(1,64,4096,524288) *************** [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 165) [Deconvolution] (CudnnDeconvolution) [09/29/2020-17:42:19] [V] [TRT] Tactic: 0 time 0.046976 [09/29/2020-17:42:19] [V] [TRT] Tactic: 1 time 0.045696 [09/29/2020-17:42:19] [V] [TRT] Tactic: 3 time 16.6772 [09/29/2020-17:42:19] [V] [TRT] Tactic: 24 time 0.629056 [09/29/2020-17:42:19] [V] [TRT] Tactic: 25 time 0.622592 [09/29/2020-17:42:19] [V] [TRT] Tactic: 27 time 13.9354 [09/29/2020-17:42:19] [V] [TRT] Fastest Tactic: 1 Time: 0.045696 [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 165) [Deconvolution] (CaskDeconvolution) [09/29/2020-17:42:19] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 165) [Deconvolution] (GemmDeconvolution) [09/29/2020-17:42:19] [V] [TRT] Tactic: 0 time 0.831936 [09/29/2020-17:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.831936 [09/29/2020-17:42:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 1 [09/29/2020-17:42:19] [V] [TRT] [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,131072) -> Half(1,64,4096,524288) *************** [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 165) [Deconvolution] (CudnnDeconvolution) [09/29/2020-17:42:19] [V] [TRT] Tactic: 0 time 0.047104 [09/29/2020-17:42:19] [V] [TRT] Tactic: 1 time 0.047104 [09/29/2020-17:42:19] [V] [TRT] Tactic: 3 time 15.8403 [09/29/2020-17:42:19] [V] [TRT] Tactic: 24 time 0.633056 [09/29/2020-17:42:19] [V] [TRT] Tactic: 25 time 0.629504 [09/29/2020-17:42:19] [V] [TRT] Tactic: 27 time 14.2961 [09/29/2020-17:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.047104 [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 165) [Deconvolution] (CaskDeconvolution) [09/29/2020-17:42:19] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 165) [Deconvolution] (GemmDeconvolution) [09/29/2020-17:42:19] [V] [TRT] Tactic: 0 time 0.815456 [09/29/2020-17:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.815456 [09/29/2020-17:42:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 0 [09/29/2020-17:42:19] [V] [TRT] [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,65536) -> Half(1,64,4096:2,262144) *************** [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 165) [Deconvolution] (CudnnDeconvolution) [09/29/2020-17:42:19] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 165) [Deconvolution] (CaskDeconvolution) [09/29/2020-17:42:19] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 165) [Deconvolution] (GemmDeconvolution) [09/29/2020-17:42:19] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 157) [Scale] + (Unnamed Layer* 158) [Activation] (Scale) [09/29/2020-17:42:19] [V] [TRT] Tactic: 0 time 0.009056 [09/29/2020-17:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.009056 [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,524288) -> Half(1,64,4096,524288) *************** [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 157) [Scale] + (Unnamed Layer* 158) [Activation] (Scale) [09/29/2020-17:42:19] [V] [TRT] Tactic: 0 time 0.008192 [09/29/2020-17:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,262144) -> Half(1,64,4096:2,262144) *************** [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 157) [Scale] + (Unnamed Layer* 158) [Activation] (Scale) [09/29/2020-17:42:19] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:42:19] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536) -> Half(16,1024,1:8,65536) *************** [09/29/2020-17:42:19] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 157) [Scale] + (Unnamed Layer* 158) [Activation] (Scale) [09/29/2020-17:42:19] [V] [TRT] Tactic: 0 time 0.009664 [09/29/2020-17:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.009664 [09/29/2020-17:42:20] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288), Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [09/29/2020-17:42:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 166) [ElementWise] (ElementWise) [09/29/2020-17:42:20] [V] [TRT] Tactic: 1 time 0.019808 [09/29/2020-17:42:20] [V] [TRT] Tactic: 2 time 0.023264 [09/29/2020-17:42:20] [V] [TRT] Fastest Tactic: 1 Time: 0.019808 [09/29/2020-17:42:20] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384), Float(1,64,4096:32,16384) -> Float(1,64,4096:32,16384) *************** [09/29/2020-17:42:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 166) [ElementWise] (ElementWise) [09/29/2020-17:42:20] [V] [TRT] Tactic: 1 time 0.019296 [09/29/2020-17:42:20] [V] [TRT] Tactic: 2 time 0.020736 [09/29/2020-17:42:20] [V] [TRT] Fastest Tactic: 1 Time: 0.019296 [09/29/2020-17:42:20] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,524288), Half(1,64,4096,524288) -> Half(1,64,4096,524288) *************** [09/29/2020-17:42:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 166) [ElementWise] (ElementWise) [09/29/2020-17:42:20] [V] [TRT] Tactic: 1 time 0.006496 [09/29/2020-17:42:20] [V] [TRT] Tactic: 2 time 0.009344 [09/29/2020-17:42:20] [V] [TRT] Fastest Tactic: 1 Time: 0.006496 [09/29/2020-17:42:20] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,262144), Half(1,64,4096:2,262144) -> Half(1,64,4096:2,262144) *************** [09/29/2020-17:42:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 166) [ElementWise] (ElementWise) [09/29/2020-17:42:20] [V] [TRT] Tactic: 1 time 0.0064 [09/29/2020-17:42:20] [V] [TRT] Tactic: 2 time 0.008192 [09/29/2020-17:42:20] [V] [TRT] Fastest Tactic: 1 Time: 0.0064 [09/29/2020-17:42:20] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536), Half(16,1024,1:8,65536) -> Half(16,1024,1:8,65536) *************** [09/29/2020-17:42:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 166) [ElementWise] (ElementWise) [09/29/2020-17:42:20] [V] [TRT] Tactic: 1 time 0.0064 [09/29/2020-17:42:20] [V] [TRT] Tactic: 2 time 0.008192 [09/29/2020-17:42:20] [V] [TRT] Fastest Tactic: 1 Time: 0.0064 [09/29/2020-17:42:20] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,110592) *************** [09/29/2020-17:42:20] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,524288) -> Half(1,64,4096,110592) *************** [09/29/2020-17:42:20] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,262144) -> Half(1,64,4096:2,57344) *************** [09/29/2020-17:42:20] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536) -> Float(1,64,4096,110592) *************** [09/29/2020-17:42:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 167) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:20] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 167) [Convolution] (CaskConvolution) [09/29/2020-17:42:20] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 167) [Convolution] (CudaConvolution) [09/29/2020-17:42:20] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 167) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536) -> Half(4,256,1:8,16384) *************** [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: -> Float(1,3,9,1152) *************** [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: -> Half(1,3,9,1152) *************** [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: -> Float(1) *************** [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: -> Half(1) *************** [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288), Float(1,64,4096,110592), Float(1,3,9,1152), Float(1) -> Float(1,64,4096,524288) *************** [09/29/2020-17:42:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 170) [PluginV2Ext] (PluginV2) 128 64 64 1 128 64 64 1 128 64 64 1 [09/29/2020-17:42:21] [V] [TRT] Tactic: 0 time 1.18131 [09/29/2020-17:42:21] [V] [TRT] Fastest Tactic: 0 Time: 1.18131 [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,524288), Half(1,64,4096,110592), Half(1,3,9,1152), Half(1) -> Half(1,64,4096,524288) *************** [09/29/2020-17:42:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 170) [PluginV2Ext] (PluginV2) 128 64 64 1 half. 128 64 64 1 half. 128 64 64 1 half. [09/29/2020-17:42:21] [V] [TRT] Tactic: 0 time 1.16742 [09/29/2020-17:42:21] [V] [TRT] Fastest Tactic: 0 Time: 1.16742 [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [09/29/2020-17:42:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 171) [Scale] + (Unnamed Layer* 172) [Activation] (Scale) [09/29/2020-17:42:21] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:42:21] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,524288) -> Half(1,64,4096,524288) *************** [09/29/2020-17:42:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 171) [Scale] + (Unnamed Layer* 172) [Activation] (Scale) [09/29/2020-17:42:21] [V] [TRT] Tactic: 0 time 0.008448 [09/29/2020-17:42:21] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,262144) -> Half(1,64,4096:2,262144) *************** [09/29/2020-17:42:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 171) [Scale] + (Unnamed Layer* 172) [Activation] (Scale) [09/29/2020-17:42:21] [V] [TRT] Tactic: 0 time 0.009472 [09/29/2020-17:42:21] [V] [TRT] Fastest Tactic: 0 Time: 0.009472 [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536) -> Half(16,1024,1:8,65536) *************** [09/29/2020-17:42:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 171) [Scale] + (Unnamed Layer* 172) [Activation] (Scale) [09/29/2020-17:42:21] [V] [TRT] Tactic: 0 time 0.008832 [09/29/2020-17:42:21] [V] [TRT] Fastest Tactic: 0 Time: 0.008832 [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,110592) *************** [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,524288) -> Half(1,64,4096,110592) *************** [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,262144) -> Half(1,64,4096:2,57344) *************** [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536) -> Float(1,64,4096,110592) *************** [09/29/2020-17:42:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 173) [Convolution] (FusedConvActConvolution) [09/29/2020-17:42:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 173) [Convolution] (CaskConvolution) [09/29/2020-17:42:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 173) [Convolution] (CudaConvolution) [09/29/2020-17:42:21] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 173) [Convolution] (CudaDepthwiseConvolution) [09/29/2020-17:42:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: Half(16,1024,1:8,65536) -> Half(4,256,1:8,16384) *************** [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: -> Float(1,3,9,1152) *************** [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: -> Half(1,3,9,1152) *************** [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: -> Float(1) *************** [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: -> Half(1) *************** [09/29/2020-17:42:21] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:21] [V] [TRT] Tactic: 1002 time 0.005856 [09/29/2020-17:42:21] [V] [TRT] Tactic: 0 time 0.006144 [09/29/2020-17:42:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.005856 [09/29/2020-17:42:21] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:21] [V] [TRT] Tactic: 1002 time 0.005024 [09/29/2020-17:42:21] [V] [TRT] Tactic: 0 time 0.005856 [09/29/2020-17:42:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.005024 [09/29/2020-17:42:21] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:21] [V] [TRT] Tactic: 1002 time 0.004352 [09/29/2020-17:42:21] [V] [TRT] Tactic: 0 time 0.004352 [09/29/2020-17:42:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.004352 [09/29/2020-17:42:21] [V] [TRT] --------------- Timing Runner: (Reformat) [09/29/2020-17:42:21] [V] [TRT] Tactic: 1002 time 0.004352 [09/29/2020-17:42:21] [V] [TRT] Tactic: 0 time 0.004128 [09/29/2020-17:42:21] [V] [TRT] Fastest Tactic: 0 Time: 0.004128 [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288), Float(1,64,4096,110592), Float(1,3,9,1152), Float(1) -> Float(1,64,4096,262144) *************** [09/29/2020-17:42:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 176) [PluginV2Ext] (PluginV2) 128 64 64 1 128 64 64 1 128 64 64 1 [09/29/2020-17:42:21] [V] [TRT] Tactic: 0 time 1.16656 [09/29/2020-17:42:21] [V] [TRT] Fastest Tactic: 0 Time: 1.16656 [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,524288), Half(1,64,4096,110592), Half(1,3,9,1152), Half(1) -> Half(1,64,4096,262144) *************** [09/29/2020-17:42:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 176) [PluginV2Ext] (PluginV2) 128 64 64 1 half. 128 64 64 1 half. 128 64 64 1 half. [09/29/2020-17:42:21] [V] [TRT] Tactic: 0 time 1.22672 [09/29/2020-17:42:21] [V] [TRT] Fastest Tactic: 0 Time: 1.22672 [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,262144) -> Float(1,64,4096,262144) *************** [09/29/2020-17:42:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 177) [Scale] + (Unnamed Layer* 178) [Activation] (Scale) [09/29/2020-17:42:21] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:21] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,262144) -> Half(1,64,4096,262144) *************** [09/29/2020-17:42:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 177) [Scale] + (Unnamed Layer* 178) [Activation] (Scale) [09/29/2020-17:42:21] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:21] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,131072) -> Half(1,64,4096:2,131072) *************** [09/29/2020-17:42:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 177) [Scale] + (Unnamed Layer* 178) [Activation] (Scale) [09/29/2020-17:42:21] [V] [TRT] Tactic: 0 time 0.0064 [09/29/2020-17:42:21] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [09/29/2020-17:42:21] [V] [TRT] *************** Autotuning format combination: Half(8,512,1:8,32768) -> Half(8,512,1:8,32768) *************** [09/29/2020-17:42:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 177) [Scale] + (Unnamed Layer* 178) [Activation] (Scale) [09/29/2020-17:42:21] [V] [TRT] Tactic: 0 time 0.006464 [09/29/2020-17:42:21] [V] [TRT] Fastest Tactic: 0 Time: 0.006464 [09/29/2020-17:42:22] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,262144) -> Float(1,128,16384,1048576) *************** [09/29/2020-17:42:22] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 179) [Deconvolution] (CudnnDeconvolution) [09/29/2020-17:42:22] [V] [TRT] Tactic: 0 time 0.264736 [09/29/2020-17:42:22] [V] [TRT] Tactic: 1 time 0.083808 [09/29/2020-17:42:22] [V] [TRT] Tactic: 3 time 17.0739 [09/29/2020-17:42:22] [V] [TRT] Tactic: 24 time 0.411616 [09/29/2020-17:42:22] [V] [TRT] Tactic: 25 time 1.8208 [09/29/2020-17:42:22] [V] [TRT] Tactic: 27 time 17.2012 [09/29/2020-17:42:22] [V] [TRT] Fastest Tactic: 1 Time: 0.083808 [09/29/2020-17:42:22] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 179) [Deconvolution] (CaskDeconvolution) [09/29/2020-17:42:22] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [09/29/2020-17:42:22] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 179) [Deconvolution] (GemmDeconvolution) [09/29/2020-17:42:22] [V] [TRT] Tactic: 0 time 0.460544 [09/29/2020-17:42:22] [V] [TRT] Fastest Tactic: 0 Time: 0.460544 [09/29/2020-17:42:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 1 [09/29/2020-17:42:22] [V] [TRT] [09/29/2020-17:42:22] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,262144) -> Half(1,128,16384,1048576) *************** [09/29/2020-17:42:22] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 179) [Deconvolution] (CudnnDeconvolution) [09/29/2020-17:42:22] [V] [TRT] Tactic: 0 time 0.32256 [09/29/2020-17:42:22] [V] [TRT] Tactic: 1 time 0.486272 [09/29/2020-17:42:22] [V] [TRT] Tactic: 3 time 20.4119 [09/29/2020-17:42:22] [V] [TRT] Tactic: 24 time 0.928864 [09/29/2020-17:42:22] [V] [TRT] Tactic: 25 time 12.8573 [09/29/2020-17:42:22] [V] [TRT] Tactic: 27 time 17.3856 [09/29/2020-17:42:22] [V] [TRT] Fastest Tactic: 0 Time: 0.32256 [09/29/2020-17:42:22] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 179) [Deconvolution] (CaskDeconvolution) [09/29/2020-17:42:22] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [09/29/2020-17:42:22] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 179) [Deconvolution] (GemmDeconvolution) [09/29/2020-17:42:22] [V] [TRT] Tactic: 0 time 0.429024 [09/29/2020-17:42:22] [V] [TRT] Fastest Tactic: 0 Time: 0.429024 [09/29/2020-17:42:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 0 [09/29/2020-17:42:22] [V] [TRT] [09/29/2020-17:42:22] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,131072) -> Half(1,128,16384:2,524288) *************** [09/29/2020-17:42:22] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 179) [Deconvolution] (CudnnDeconvolution) [09/29/2020-17:42:22] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [09/29/2020-17:42:22] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 179) [Deconvolution] (CaskDeconvolution) [09/29/2020-17:42:22] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [09/29/2020-17:42:22] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 179) [Deconvolution] (GemmDeconvolution) [09/29/2020-17:42:22] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] reformatted input 0 (input.1) from Float(1,512,262144,786432) to Half(1,512,262144:2,524288) [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 15) [Convolution] reformatted input 0 (415) from Half(1,128,16384:2,524288) to Half(8,1024,1:8,131072) [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] reformatted input 0 (410) from Half(1,128,16384:2,262144) to Half(4,512,1:8,65536) [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 148) [PluginV2Ext] reformatted input 0 (510) from Half(32,1024,1:8,32768) to Half(1,32,1024,262144) [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 148) [PluginV2Ext] reformatted input 1 (542) from Half(4,128,1:8,4096) to Half(1,32,1024,27648) [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 152) [ElementWise] reformatted input 1 (470) from Half(16,1024,1:8,65536) to Half(1,64,4096,524288) [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 153) [Convolution] reformatted input 0 (547) from Half(1,64,4096,524288) to Half(1,64,4096:2,262144) [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] output to be reformatted 0 (531) from Float(1,16,256,131072) to Half(64,1024,1:8,16384) [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 156) [PluginV2Ext] reformatted input 1 (548) from Half(1,64,4096:2,57344) to Half(1,64,4096,110592) [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 131) [Convolution] reformatted input 0 (531) from Float(1,16,256,131072) to Half(1,16,256:2,65536) [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 134) [PluginV2Ext] reformatted input 0 (531) from Float(1,16,256,131072) to Half(1,16,256,131072) [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 134) [PluginV2Ext] reformatted input 1 (532) from Half(1,16,256:2,3584) to Half(1,16,256,6912) [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 138) [ElementWise] reformatted input 1 (510) from Half(32,1024,1:8,32768) to Half(1,32,1024,262144) [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 139) [Convolution] reformatted input 0 (537) from Half(1,32,1024,262144) to Half(1,32,1024:2,131072) [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 142) [PluginV2Ext] reformatted input 1 (538) from Half(1,32,1024:2,14336) to Half(1,32,1024,27648) [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 143) [Scale] + (Unnamed Layer* 144) [Activation] reformatted input 0 (539) from Half(1,32,1024,262144) to Float(1,32,1024,262144) [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 159) [Convolution] reformatted input 0 (541) from Float(1,32,1024,262144) to Half(1,32,1024:2,131072) [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 162) [PluginV2Ext] reformatted input 0 (541) from Float(1,32,1024,262144) to Half(1,32,1024,262144) [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 162) [PluginV2Ext] reformatted input 1 (552) from Half(1,32,1024:2,14336) to Half(1,32,1024,27648) [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 167) [Convolution] reformatted input 0 (557) from Half(1,64,4096,524288) to Half(1,64,4096:2,262144) [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 170) [PluginV2Ext] reformatted input 1 (558) from Half(1,64,4096:2,57344) to Half(1,64,4096,110592) [09/29/2020-17:42:22] [V] [TRT] Adding reformat layer: (Unnamed Layer* 171) [Scale] + (Unnamed Layer* 172) [Activation] reformatted input 0 (559) from Half(1,64,4096,524288) to Float(1,64,4096,524288) [09/29/2020-17:42:22] [V] [TRT] For layer (Unnamed Layer* 143) [Scale] + (Unnamed Layer* 144) [Activation] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [09/29/2020-17:42:22] [V] [TRT] For layer (Unnamed Layer* 171) [Scale] + (Unnamed Layer* 172) [Activation] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [09/29/2020-17:42:22] [V] [TRT] For layer (Unnamed Layer* 173) [Convolution] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [09/29/2020-17:42:22] [V] [TRT] For layer (Unnamed Layer* 174) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [09/29/2020-17:42:22] [V] [TRT] For layer (Unnamed Layer* 175) [Constant] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [09/29/2020-17:42:22] [V] [TRT] For layer (Unnamed Layer* 176) [PluginV2Ext] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [09/29/2020-17:42:22] [V] [TRT] For layer (Unnamed Layer* 177) [Scale] + (Unnamed Layer* 178) [Activation] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [09/29/2020-17:42:22] [V] [TRT] For layer (Unnamed Layer* 179) [Deconvolution] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [09/29/2020-17:42:22] [V] [TRT] Formats and tactics selection completed in 42.5294 seconds. [09/29/2020-17:42:22] [V] [TRT] After reformat layers: 122 layers [09/29/2020-17:42:22] [V] [TRT] Block size 4294967296 [09/29/2020-17:42:22] [V] [TRT] Block size 8388608 [09/29/2020-17:42:22] [V] [TRT] Block size 8388608 [09/29/2020-17:42:22] [V] [TRT] Block size 2097152 [09/29/2020-17:42:22] [V] [TRT] Block size 1048576 [09/29/2020-17:42:22] [V] [TRT] Block size 1048576 [09/29/2020-17:42:22] [V] [TRT] Block size 524288 [09/29/2020-17:42:22] [V] [TRT] Block size 229376 [09/29/2020-17:42:22] [V] [TRT] Block size 131072 [09/29/2020-17:42:22] [V] [TRT] Total Activation Memory: 4316823552 [09/29/2020-17:42:22] [I] [TRT] Detected 1 inputs and 4 output network tensors. [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] (hcudnn) Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 15) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 37) [Convolution] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 52) [Convolution] + (Unnamed Layer* 54) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 55) [Convolution] + (Unnamed Layer* 57) [ElementWise] + (Unnamed Layer* 58) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 59) [Convolution] + (Unnamed Layer* 61) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 62) [Convolution] + (Unnamed Layer* 64) [ElementWise] + (Unnamed Layer* 65) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] (h1688cudnn) Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 77) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 92) [Convolution] + (Unnamed Layer* 94) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 95) [Convolution] + (Unnamed Layer* 97) [ElementWise] + (Unnamed Layer* 98) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 99) [Convolution] + (Unnamed Layer* 101) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 102) [Convolution] + (Unnamed Layer* 104) [ElementWise] + (Unnamed Layer* 105) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 145) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 116) [Convolution] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_simple1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 153) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] (undefined) Set Tactic Name: trt_turing_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x1x1_64x32x64x1_16x8x8_1stages [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 167) [Convolution] (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:22] [V] [TRT] (Unnamed Layer* 173) [Convolution] (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] Weights: 0 HostPersistent: 2176 DevicePersistent: 1579520 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation] Weights: 0 HostPersistent: 1664 DevicePersistent: 1577984 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation] Weights: 0 HostPersistent: 4224 DevicePersistent: 402944 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation] Weights: 0 HostPersistent: 1664 DevicePersistent: 135680 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 9) [Pooling] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 15) [Convolution] input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 15) [Convolution] Weights: 0 HostPersistent: 2176 DevicePersistent: 172544 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] Weights: 0 HostPersistent: 3200 DevicePersistent: 102912 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation] Weights: 0 HostPersistent: 1664 DevicePersistent: 172544 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation] Weights: 0 HostPersistent: 1664 DevicePersistent: 172544 [09/29/2020-17:42:22] [V] [TRT] Layer: 426 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: 419 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation] Weights: 0 HostPersistent: 2176 DevicePersistent: 115200 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation] Weights: 0 HostPersistent: 1664 DevicePersistent: 172544 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 31) [Pooling] Weights: 0 HostPersistent: 16 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 30) [Pooling] Weights: 0 HostPersistent: 16 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 37) [Convolution] Weights: 0 HostPersistent: 1664 DevicePersistent: 320000 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation] Weights: 0 HostPersistent: 1664 DevicePersistent: 41472 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation] Weights: 0 HostPersistent: 1664 DevicePersistent: 320000 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation] Weights: 0 HostPersistent: 1664 DevicePersistent: 320000 [09/29/2020-17:42:22] [V] [TRT] Layer: 448 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: 441 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation] Weights: 0 HostPersistent: 3200 DevicePersistent: 90624 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 52) [Convolution] + (Unnamed Layer* 54) [Activation] Weights: 0 HostPersistent: 1664 DevicePersistent: 320000 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 55) [Convolution] + (Unnamed Layer* 57) [ElementWise] + (Unnamed Layer* 58) [Activation] Weights: 0 HostPersistent: 1664 DevicePersistent: 320000 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 59) [Convolution] + (Unnamed Layer* 61) [Activation] Weights: 0 HostPersistent: 1664 DevicePersistent: 320000 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 62) [Convolution] + (Unnamed Layer* 64) [ElementWise] + (Unnamed Layer* 65) [Activation] Weights: 0 HostPersistent: 1664 DevicePersistent: 320000 [09/29/2020-17:42:22] [V] [TRT] Layer: 466 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: 459 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: 452 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation] Weights: 0 HostPersistent: 3200 DevicePersistent: 139776 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation] Weights: 0 HostPersistent: 1712 DevicePersistent: 591360 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 71) [Pooling] Weights: 0 HostPersistent: 16 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 70) [Pooling] Weights: 0 HostPersistent: 16 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 77) [Convolution] Weights: 0 HostPersistent: 1712 DevicePersistent: 1181184 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation] Weights: 0 HostPersistent: 1712 DevicePersistent: 67072 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation] Weights: 0 HostPersistent: 1712 DevicePersistent: 1181184 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation] Weights: 0 HostPersistent: 1712 DevicePersistent: 1181184 [09/29/2020-17:42:22] [V] [TRT] Layer: 488 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: 481 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation] Weights: 0 HostPersistent: 1712 DevicePersistent: 263680 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 92) [Convolution] + (Unnamed Layer* 94) [Activation] Weights: 0 HostPersistent: 1712 DevicePersistent: 1181184 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 95) [Convolution] + (Unnamed Layer* 97) [ElementWise] + (Unnamed Layer* 98) [Activation] Weights: 0 HostPersistent: 1712 DevicePersistent: 1181184 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 99) [Convolution] + (Unnamed Layer* 101) [Activation] Weights: 0 HostPersistent: 1712 DevicePersistent: 1181184 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 102) [Convolution] + (Unnamed Layer* 104) [ElementWise] + (Unnamed Layer* 105) [Activation] Weights: 0 HostPersistent: 1712 DevicePersistent: 1181184 [09/29/2020-17:42:22] [V] [TRT] Layer: 506 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: 499 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: 492 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation] Weights: 0 HostPersistent: 1712 DevicePersistent: 460288 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 145) [Convolution] Weights: 0 HostPersistent: 1712 DevicePersistent: 147968 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation] Weights: 0 HostPersistent: 1712 DevicePersistent: 2362368 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 110) [Pooling] Weights: 0 HostPersistent: 16 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 146) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 147) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 116) [Convolution] Weights: 0 HostPersistent: 1712 DevicePersistent: 4721664 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 148) [PluginV2Ext] input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 148) [PluginV2Ext] input reformatter 1 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 148) [PluginV2Ext] Weights: 0 HostPersistent: 40 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation] Weights: 0 HostPersistent: 1712 DevicePersistent: 265216 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 149) [Scale] + (Unnamed Layer* 150) [Activation] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 151) [Deconvolution] Weights: 524288 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation] Weights: 0 HostPersistent: 1712 DevicePersistent: 4721664 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 152) [ElementWise] input reformatter 1 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 152) [ElementWise] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 153) [Convolution] input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 153) [Convolution] Weights: 0 HostPersistent: 512 DevicePersistent: 196096 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 154) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 155) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation] Weights: 0 HostPersistent: 1712 DevicePersistent: 4721664 [09/29/2020-17:42:22] [V] [TRT] Layer: 527 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: 520 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: 511 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] Weights: 0 HostPersistent: 1712 DevicePersistent: 1313792 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] output reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 156) [PluginV2Ext] input reformatter 1 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 156) [PluginV2Ext] Weights: 0 HostPersistent: 40 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 131) [Convolution] input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 131) [Convolution] Weights: 248832 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 132) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 133) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 134) [PluginV2Ext] input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 134) [PluginV2Ext] input reformatter 1 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 134) [PluginV2Ext] Weights: 0 HostPersistent: 40 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 135) [Scale] + (Unnamed Layer* 136) [Activation] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 137) [Deconvolution] Weights: 2097152 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 138) [ElementWise] input reformatter 1 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 138) [ElementWise] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 139) [Convolution] input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 139) [Convolution] Weights: 124416 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 140) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 141) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 142) [PluginV2Ext] input reformatter 1 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 142) [PluginV2Ext] Weights: 0 HostPersistent: 40 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 143) [Scale] + (Unnamed Layer* 144) [Activation] input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 143) [Scale] + (Unnamed Layer* 144) [Activation] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 159) [Convolution] input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 159) [Convolution] Weights: 124416 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 160) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 161) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 162) [PluginV2Ext] input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 162) [PluginV2Ext] input reformatter 1 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 162) [PluginV2Ext] Weights: 0 HostPersistent: 40 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 163) [Scale] + (Unnamed Layer* 164) [Activation] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 165) [Deconvolution] Weights: 524288 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 157) [Scale] + (Unnamed Layer* 158) [Activation] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 166) [ElementWise] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 167) [Convolution] input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 167) [Convolution] Weights: 0 HostPersistent: 512 DevicePersistent: 196096 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 168) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 169) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 170) [PluginV2Ext] input reformatter 1 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 170) [PluginV2Ext] Weights: 0 HostPersistent: 40 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 171) [Scale] + (Unnamed Layer* 172) [Activation] input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 171) [Scale] + (Unnamed Layer* 172) [Activation] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 173) [Convolution] Weights: 0 HostPersistent: 512 DevicePersistent: 387072 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 174) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 175) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 176) [PluginV2Ext] Weights: 0 HostPersistent: 40 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 177) [Scale] + (Unnamed Layer* 178) [Activation] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Layer: (Unnamed Layer* 179) [Deconvolution] Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [09/29/2020-17:42:22] [V] [TRT] Total Host Persistent Memory: 74696 [09/29/2020-17:42:22] [V] [TRT] Total Device Persistent Memory: 35800576 [09/29/2020-17:42:22] [V] [TRT] Total Weight Memory: 3905536 [09/29/2020-17:42:22] [V] [TRT] Builder timing cache: created 486 entries, 1039 hit(s) [09/29/2020-17:42:22] [V] [TRT] Engine generation completed in 42.975 seconds. [09/29/2020-17:42:22] [V] [TRT] Engine Layer Information: [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] input reformatter 0, Tactic: 0, input.1[Float(3,512,512)] -> (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] reformatted input 0[Half(3,512,512)] [09/29/2020-17:42:22] [V] [TRT] Layer(hcudnn): (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation], Tactic: 4930470141256631146, (Unnamed Layer* 0) [Convolution] + (Unnamed Layer* 2) [Activation] reformatted input 0[Half(3,512,512)] -> 403[Half(16,512,512)] [09/29/2020-17:42:22] [V] [TRT] Layer(hcudnn): (Unnamed Layer* 3) [Convolution] + (Unnamed Layer* 5) [Activation], Tactic: -2027588946874785071, 403[Half(16,512,512)] -> 406[Half(16,512,512)] [09/29/2020-17:42:22] [V] [TRT] Layer(hcudnn): (Unnamed Layer* 6) [Convolution] + (Unnamed Layer* 8) [Activation], Tactic: -7448936905981214224, 406[Half(16,512,512)] -> 409[Half(32,256,256)] [09/29/2020-17:42:22] [V] [TRT] Layer(hcudnn): (Unnamed Layer* 12) [Convolution] + (Unnamed Layer* 14) [Activation], Tactic: 4318470497547290900, 409[Half(32,256,256)] -> 415[Half(64,128,128)] [09/29/2020-17:42:22] [V] [TRT] Layer(PoolingTiled): (Unnamed Layer* 9) [Pooling], Tactic: 6357249, 409[Half(32,256,256)] -> 410[Half(32,128,128)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 15) [Convolution] input reformatter 0, Tactic: 0, 415[Half(64,128,128)] -> (Unnamed Layer* 15) [Convolution] reformatted input 0[Half(64,128,128)] [09/29/2020-17:42:22] [V] [TRT] Layer(h1688cudnn): (Unnamed Layer* 15) [Convolution], Tactic: -8992262742606384444, (Unnamed Layer* 15) [Convolution] reformatted input 0[Half(64,128,128)] -> 417[Half(64,128,128)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] input reformatter 0, Tactic: 0, 410[Half(32,128,128)] -> (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] reformatted input 0[Half(32,128,128)] [09/29/2020-17:42:22] [V] [TRT] Layer(h1688cudnn): (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation], Tactic: 4555462412611657028, (Unnamed Layer* 10) [Convolution] + (Unnamed Layer* 17) [ElementWise] + (Unnamed Layer* 18) [Activation] reformatted input 0[Half(32,128,128)], 417[Half(64,128,128)] -> 419[Half(64,128,128)] [09/29/2020-17:42:22] [V] [TRT] Layer(h1688cudnn): (Unnamed Layer* 19) [Convolution] + (Unnamed Layer* 21) [Activation], Tactic: 2148106709480872763, 419[Half(64,128,128)] -> 422[Half(64,128,128)] [09/29/2020-17:42:22] [V] [TRT] Layer(h1688cudnn): (Unnamed Layer* 22) [Convolution] + (Unnamed Layer* 24) [ElementWise] + (Unnamed Layer* 25) [Activation], Tactic: 2148106709480872763, 422[Half(64,128,128)], 419[Half(64,128,128)] -> 426[Half(64,128,128)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): 426 copy, Tactic: 0, 426[Half(64,128,128)] -> 427[Half(64,128,128)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): 419 copy, Tactic: 0, 419[Half(64,128,128)] -> 427[Half(64,128,128)] [09/29/2020-17:42:22] [V] [TRT] Layer(h1688cudnn): (Unnamed Layer* 27) [Convolution] + (Unnamed Layer* 29) [Activation], Tactic: -8992262742606384444, 427[Half(128,128,128)] -> 430[Half(64,128,128)] [09/29/2020-17:42:22] [V] [TRT] Layer(h1688cudnn): (Unnamed Layer* 34) [Convolution] + (Unnamed Layer* 36) [Activation], Tactic: -3136088851200285532, 430[Half(64,128,128)] -> 437[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(Pooling): (Unnamed Layer* 31) [Pooling], Tactic: -2, 430[Half(64,128,128)] -> 432[Half(64,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(Pooling): (Unnamed Layer* 30) [Pooling], Tactic: -2, 430[Half(64,128,128)] -> 467[Half(64,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(h1688cudnn): (Unnamed Layer* 37) [Convolution], Tactic: -3136088851200285532, 437[Half(128,64,64)] -> 439[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(h1688cudnn): (Unnamed Layer* 32) [Convolution] + (Unnamed Layer* 39) [ElementWise] + (Unnamed Layer* 40) [Activation], Tactic: 2148106709480872763, 432[Half(64,64,64)], 439[Half(128,64,64)] -> 441[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(h1688cudnn): (Unnamed Layer* 41) [Convolution] + (Unnamed Layer* 43) [Activation], Tactic: -3136088851200285532, 441[Half(128,64,64)] -> 444[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(h1688cudnn): (Unnamed Layer* 44) [Convolution] + (Unnamed Layer* 46) [ElementWise] + (Unnamed Layer* 47) [Activation], Tactic: -3136088851200285532, 444[Half(128,64,64)], 441[Half(128,64,64)] -> 448[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): 448 copy, Tactic: 0, 448[Half(128,64,64)] -> 449[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): 441 copy, Tactic: 0, 441[Half(128,64,64)] -> 449[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(h1688cudnn): (Unnamed Layer* 49) [Convolution] + (Unnamed Layer* 51) [Activation], Tactic: 3041642431972138763, 449[Half(256,64,64)] -> 452[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(h1688cudnn): (Unnamed Layer* 52) [Convolution] + (Unnamed Layer* 54) [Activation], Tactic: -3136088851200285532, 452[Half(128,64,64)] -> 455[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(h1688cudnn): (Unnamed Layer* 55) [Convolution] + (Unnamed Layer* 57) [ElementWise] + (Unnamed Layer* 58) [Activation], Tactic: -3136088851200285532, 455[Half(128,64,64)], 452[Half(128,64,64)] -> 459[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(h1688cudnn): (Unnamed Layer* 59) [Convolution] + (Unnamed Layer* 61) [Activation], Tactic: -3136088851200285532, 459[Half(128,64,64)] -> 462[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(h1688cudnn): (Unnamed Layer* 62) [Convolution] + (Unnamed Layer* 64) [ElementWise] + (Unnamed Layer* 65) [Activation], Tactic: -3136088851200285532, 462[Half(128,64,64)], 459[Half(128,64,64)] -> 466[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): 466 copy, Tactic: 0, 466[Half(128,64,64)] -> 467[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): 459 copy, Tactic: 0, 459[Half(128,64,64)] -> 467[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): 452 copy, Tactic: 0, 452[Half(128,64,64)] -> 467[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(h1688cudnn): (Unnamed Layer* 67) [Convolution] + (Unnamed Layer* 69) [Activation], Tactic: 3041642431972138763, 467[Half(448,64,64)] -> 470[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(undefined): (Unnamed Layer* 74) [Convolution] + (Unnamed Layer* 76) [Activation], Tactic: -4953888146171240997, 470[Half(128,64,64)] -> 477[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(Pooling): (Unnamed Layer* 71) [Pooling], Tactic: -2, 470[Half(128,64,64)] -> 472[Half(128,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(Pooling): (Unnamed Layer* 70) [Pooling], Tactic: -2, 470[Half(128,64,64)] -> 507[Half(128,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(undefined): (Unnamed Layer* 77) [Convolution], Tactic: -4953888146171240997, 477[Half(256,32,32)] -> 479[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(undefined): (Unnamed Layer* 72) [Convolution] + (Unnamed Layer* 79) [ElementWise] + (Unnamed Layer* 80) [Activation], Tactic: 9576651994278528, 472[Half(128,32,32)], 479[Half(256,32,32)] -> 481[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(undefined): (Unnamed Layer* 81) [Convolution] + (Unnamed Layer* 83) [Activation], Tactic: -4953888146171240997, 481[Half(256,32,32)] -> 484[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(undefined): (Unnamed Layer* 84) [Convolution] + (Unnamed Layer* 86) [ElementWise] + (Unnamed Layer* 87) [Activation], Tactic: 2921824978225832523, 484[Half(256,32,32)], 481[Half(256,32,32)] -> 488[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): 488 copy, Tactic: 0, 488[Half(256,32,32)] -> 489[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): 481 copy, Tactic: 0, 481[Half(256,32,32)] -> 489[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(undefined): (Unnamed Layer* 89) [Convolution] + (Unnamed Layer* 91) [Activation], Tactic: 9576651994278528, 489[Half(512,32,32)] -> 492[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(undefined): (Unnamed Layer* 92) [Convolution] + (Unnamed Layer* 94) [Activation], Tactic: -4953888146171240997, 492[Half(256,32,32)] -> 495[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(undefined): (Unnamed Layer* 95) [Convolution] + (Unnamed Layer* 97) [ElementWise] + (Unnamed Layer* 98) [Activation], Tactic: 2921824978225832523, 495[Half(256,32,32)], 492[Half(256,32,32)] -> 499[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(undefined): (Unnamed Layer* 99) [Convolution] + (Unnamed Layer* 101) [Activation], Tactic: -4953888146171240997, 499[Half(256,32,32)] -> 502[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(undefined): (Unnamed Layer* 102) [Convolution] + (Unnamed Layer* 104) [ElementWise] + (Unnamed Layer* 105) [Activation], Tactic: 2921824978225832523, 502[Half(256,32,32)], 499[Half(256,32,32)] -> 506[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): 506 copy, Tactic: 0, 506[Half(256,32,32)] -> 507[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): 499 copy, Tactic: 0, 499[Half(256,32,32)] -> 507[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): 492 copy, Tactic: 0, 492[Half(256,32,32)] -> 507[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(undefined): (Unnamed Layer* 107) [Convolution] + (Unnamed Layer* 109) [Activation], Tactic: 9576651994278528, 507[Half(896,32,32)] -> 510[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(undefined): (Unnamed Layer* 145) [Convolution], Tactic: -4953888146171240997, 510[Half(256,32,32)] -> 542[Half(27,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(undefined): (Unnamed Layer* 113) [Convolution] + (Unnamed Layer* 115) [Activation], Tactic: -4953888146171240997, 510[Half(256,32,32)] -> 516[Half(512,16,16)] [09/29/2020-17:42:22] [V] [TRT] Layer(Pooling): (Unnamed Layer* 110) [Pooling], Tactic: -2, 510[Half(256,32,32)] -> 511[Half(256,16,16)] [09/29/2020-17:42:22] [V] [TRT] Layer(Constant): (Unnamed Layer* 146) [Constant], Tactic: 0, -> (Unnamed Layer* 146) [Constant]_output[Half(256,3,3)] [09/29/2020-17:42:22] [V] [TRT] Layer(Constant): (Unnamed Layer* 147) [Constant], Tactic: 0, -> (Unnamed Layer* 147) [Constant]_output[Half()] [09/29/2020-17:42:22] [V] [TRT] Layer(undefined): (Unnamed Layer* 116) [Convolution], Tactic: -4953888146171240997, 516[Half(512,16,16)] -> 518[Half(512,16,16)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 148) [PluginV2Ext] input reformatter 0, Tactic: 0, 510[Half(256,32,32)] -> (Unnamed Layer* 148) [PluginV2Ext] reformatted input 0[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 148) [PluginV2Ext] input reformatter 1, Tactic: 0, 542[Half(27,32,32)] -> (Unnamed Layer* 148) [PluginV2Ext] reformatted input 1[Half(27,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(PluginV2): (Unnamed Layer* 148) [PluginV2Ext], Tactic: 0, (Unnamed Layer* 148) [PluginV2Ext] reformatted input 0[Half(256,32,32)], (Unnamed Layer* 148) [PluginV2Ext] reformatted input 1[Half(27,32,32)], (Unnamed Layer* 146) [Constant]_output[Half(256,3,3)], (Unnamed Layer* 147) [Constant]_output[Half()] -> 543[Half(128,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(undefined): (Unnamed Layer* 111) [Convolution] + (Unnamed Layer* 118) [ElementWise] + (Unnamed Layer* 119) [Activation], Tactic: 9576651994278528, 511[Half(256,16,16)], 518[Half(512,16,16)] -> 520[Half(512,16,16)] [09/29/2020-17:42:22] [V] [TRT] Layer(Scale): (Unnamed Layer* 149) [Scale] + (Unnamed Layer* 150) [Activation], Tactic: 0, 543[Half(128,32,32)] -> 545[Half(128,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(Deconvolution): (Unnamed Layer* 151) [Deconvolution], Tactic: 0, 545[Half(128,32,32)] -> 546[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(undefined): (Unnamed Layer* 120) [Convolution] + (Unnamed Layer* 122) [Activation], Tactic: -4953888146171240997, 520[Half(512,16,16)] -> 523[Half(512,16,16)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 152) [ElementWise] input reformatter 1, Tactic: 0, 470[Half(128,64,64)] -> (Unnamed Layer* 152) [ElementWise] reformatted input 1[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 152) [ElementWise], Tactic: 1, 546[Half(128,64,64)], (Unnamed Layer* 152) [ElementWise] reformatted input 1[Half(128,64,64)] -> 547[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 153) [Convolution] input reformatter 0, Tactic: 0, 547[Half(128,64,64)] -> (Unnamed Layer* 153) [Convolution] reformatted input 0[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(hcudnn_winograd): (Unnamed Layer* 153) [Convolution], Tactic: -3140347171730126532, (Unnamed Layer* 153) [Convolution] reformatted input 0[Half(128,64,64)] -> 548[Half(27,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(Constant): (Unnamed Layer* 154) [Constant], Tactic: 0, -> (Unnamed Layer* 154) [Constant]_output[Half(128,3,3)] [09/29/2020-17:42:22] [V] [TRT] Layer(Constant): (Unnamed Layer* 155) [Constant], Tactic: 0, -> (Unnamed Layer* 155) [Constant]_output[Half()] [09/29/2020-17:42:22] [V] [TRT] Layer(undefined): (Unnamed Layer* 123) [Convolution] + (Unnamed Layer* 125) [ElementWise] + (Unnamed Layer* 126) [Activation], Tactic: -4953888146171240997, 523[Half(512,16,16)], 520[Half(512,16,16)] -> 527[Half(512,16,16)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): 527 copy, Tactic: 0, 527[Half(512,16,16)] -> 528[Half(512,16,16)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): 520 copy, Tactic: 0, 520[Half(512,16,16)] -> 528[Half(512,16,16)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): 511 copy, Tactic: 0, 511[Half(256,16,16)] -> 528[Half(256,16,16)] [09/29/2020-17:42:22] [V] [TRT] Layer(undefined): (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation], Tactic: -4908848143422991657, 528[Half(1280,16,16)] -> (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] output to be reformatted 0[Half(512,16,16)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] output reformatter 0, Tactic: 0, (Unnamed Layer* 128) [Convolution] + (Unnamed Layer* 130) [Activation] output to be reformatted 0[Half(512,16,16)] -> 531[Float(512,16,16)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 156) [PluginV2Ext] input reformatter 1, Tactic: 0, 548[Half(27,64,64)] -> (Unnamed Layer* 156) [PluginV2Ext] reformatted input 1[Half(27,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(PluginV2): (Unnamed Layer* 156) [PluginV2Ext], Tactic: 0, 547[Half(128,64,64)], (Unnamed Layer* 156) [PluginV2Ext] reformatted input 1[Half(27,64,64)], (Unnamed Layer* 154) [Constant]_output[Half(128,3,3)], (Unnamed Layer* 155) [Constant]_output[Half()] -> 549[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 131) [Convolution] input reformatter 0, Tactic: 0, 531[Float(512,16,16)] -> (Unnamed Layer* 131) [Convolution] reformatted input 0[Half(512,16,16)] [09/29/2020-17:42:22] [V] [TRT] Layer(FusedConvActDirect): (Unnamed Layer* 131) [Convolution], Tactic: 10682367, (Unnamed Layer* 131) [Convolution] reformatted input 0[Half(512,16,16)] -> 532[Half(27,16,16)] [09/29/2020-17:42:22] [V] [TRT] Layer(Constant): (Unnamed Layer* 132) [Constant], Tactic: 0, -> (Unnamed Layer* 132) [Constant]_output[Half(512,3,3)] [09/29/2020-17:42:22] [V] [TRT] Layer(Constant): (Unnamed Layer* 133) [Constant], Tactic: 0, -> (Unnamed Layer* 133) [Constant]_output[Half()] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 134) [PluginV2Ext] input reformatter 0, Tactic: 1002, 531[Float(512,16,16)] -> (Unnamed Layer* 134) [PluginV2Ext] reformatted input 0[Half(512,16,16)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 134) [PluginV2Ext] input reformatter 1, Tactic: 0, 532[Half(27,16,16)] -> (Unnamed Layer* 134) [PluginV2Ext] reformatted input 1[Half(27,16,16)] [09/29/2020-17:42:22] [V] [TRT] Layer(PluginV2): (Unnamed Layer* 134) [PluginV2Ext], Tactic: 0, (Unnamed Layer* 134) [PluginV2Ext] reformatted input 0[Half(512,16,16)], (Unnamed Layer* 134) [PluginV2Ext] reformatted input 1[Half(27,16,16)], (Unnamed Layer* 132) [Constant]_output[Half(512,3,3)], (Unnamed Layer* 133) [Constant]_output[Half()] -> 533[Half(256,16,16)] [09/29/2020-17:42:22] [V] [TRT] Layer(Scale): (Unnamed Layer* 135) [Scale] + (Unnamed Layer* 136) [Activation], Tactic: 0, 533[Half(256,16,16)] -> 535[Half(256,16,16)] [09/29/2020-17:42:22] [V] [TRT] Layer(Deconvolution): (Unnamed Layer* 137) [Deconvolution], Tactic: 0, 535[Half(256,16,16)] -> 536[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 138) [ElementWise] input reformatter 1, Tactic: 0, 510[Half(256,32,32)] -> (Unnamed Layer* 138) [ElementWise] reformatted input 1[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 138) [ElementWise], Tactic: 1, 536[Half(256,32,32)], (Unnamed Layer* 138) [ElementWise] reformatted input 1[Half(256,32,32)] -> 537[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 139) [Convolution] input reformatter 0, Tactic: 0, 537[Half(256,32,32)] -> (Unnamed Layer* 139) [Convolution] reformatted input 0[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(FusedConvActDirect): (Unnamed Layer* 139) [Convolution], Tactic: 10682367, (Unnamed Layer* 139) [Convolution] reformatted input 0[Half(256,32,32)] -> 538[Half(27,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(Constant): (Unnamed Layer* 140) [Constant], Tactic: 0, -> (Unnamed Layer* 140) [Constant]_output[Half(256,3,3)] [09/29/2020-17:42:22] [V] [TRT] Layer(Constant): (Unnamed Layer* 141) [Constant], Tactic: 0, -> (Unnamed Layer* 141) [Constant]_output[Half()] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 142) [PluginV2Ext] input reformatter 1, Tactic: 0, 538[Half(27,32,32)] -> (Unnamed Layer* 142) [PluginV2Ext] reformatted input 1[Half(27,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(PluginV2): (Unnamed Layer* 142) [PluginV2Ext], Tactic: 0, 537[Half(256,32,32)], (Unnamed Layer* 142) [PluginV2Ext] reformatted input 1[Half(27,32,32)], (Unnamed Layer* 140) [Constant]_output[Half(256,3,3)], (Unnamed Layer* 141) [Constant]_output[Half()] -> 539[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 143) [Scale] + (Unnamed Layer* 144) [Activation] input reformatter 0, Tactic: 1002, 539[Half(256,32,32)] -> (Unnamed Layer* 143) [Scale] + (Unnamed Layer* 144) [Activation] reformatted input 0[Float(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(Scale): (Unnamed Layer* 143) [Scale] + (Unnamed Layer* 144) [Activation], Tactic: 0, (Unnamed Layer* 143) [Scale] + (Unnamed Layer* 144) [Activation] reformatted input 0[Float(256,32,32)] -> 541[Float(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 159) [Convolution] input reformatter 0, Tactic: 0, 541[Float(256,32,32)] -> (Unnamed Layer* 159) [Convolution] reformatted input 0[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(FusedConvActDirect): (Unnamed Layer* 159) [Convolution], Tactic: 10682367, (Unnamed Layer* 159) [Convolution] reformatted input 0[Half(256,32,32)] -> 552[Half(27,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(Constant): (Unnamed Layer* 160) [Constant], Tactic: 0, -> (Unnamed Layer* 160) [Constant]_output[Half(256,3,3)] [09/29/2020-17:42:22] [V] [TRT] Layer(Constant): (Unnamed Layer* 161) [Constant], Tactic: 0, -> (Unnamed Layer* 161) [Constant]_output[Half()] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 162) [PluginV2Ext] input reformatter 0, Tactic: 1002, 541[Float(256,32,32)] -> (Unnamed Layer* 162) [PluginV2Ext] reformatted input 0[Half(256,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 162) [PluginV2Ext] input reformatter 1, Tactic: 0, 552[Half(27,32,32)] -> (Unnamed Layer* 162) [PluginV2Ext] reformatted input 1[Half(27,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(PluginV2): (Unnamed Layer* 162) [PluginV2Ext], Tactic: 0, (Unnamed Layer* 162) [PluginV2Ext] reformatted input 0[Half(256,32,32)], (Unnamed Layer* 162) [PluginV2Ext] reformatted input 1[Half(27,32,32)], (Unnamed Layer* 160) [Constant]_output[Half(256,3,3)], (Unnamed Layer* 161) [Constant]_output[Half()] -> 553[Half(128,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(Scale): (Unnamed Layer* 163) [Scale] + (Unnamed Layer* 164) [Activation], Tactic: 0, 553[Half(128,32,32)] -> 555[Half(128,32,32)] [09/29/2020-17:42:22] [V] [TRT] Layer(Deconvolution): (Unnamed Layer* 165) [Deconvolution], Tactic: 0, 555[Half(128,32,32)] -> 556[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(Scale): (Unnamed Layer* 157) [Scale] + (Unnamed Layer* 158) [Activation], Tactic: 0, 549[Half(128,64,64)] -> 551[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 166) [ElementWise], Tactic: 1, 556[Half(128,64,64)], 551[Half(128,64,64)] -> 557[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 167) [Convolution] input reformatter 0, Tactic: 0, 557[Half(128,64,64)] -> (Unnamed Layer* 167) [Convolution] reformatted input 0[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(hcudnn_winograd): (Unnamed Layer* 167) [Convolution], Tactic: -3140347171730126532, (Unnamed Layer* 167) [Convolution] reformatted input 0[Half(128,64,64)] -> 558[Half(27,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(Constant): (Unnamed Layer* 168) [Constant], Tactic: 0, -> (Unnamed Layer* 168) [Constant]_output[Half(128,3,3)] [09/29/2020-17:42:22] [V] [TRT] Layer(Constant): (Unnamed Layer* 169) [Constant], Tactic: 0, -> (Unnamed Layer* 169) [Constant]_output[Half()] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 170) [PluginV2Ext] input reformatter 1, Tactic: 0, 558[Half(27,64,64)] -> (Unnamed Layer* 170) [PluginV2Ext] reformatted input 1[Half(27,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(PluginV2): (Unnamed Layer* 170) [PluginV2Ext], Tactic: 0, 557[Half(128,64,64)], (Unnamed Layer* 170) [PluginV2Ext] reformatted input 1[Half(27,64,64)], (Unnamed Layer* 168) [Constant]_output[Half(128,3,3)], (Unnamed Layer* 169) [Constant]_output[Half()] -> 559[Half(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(Reformat): (Unnamed Layer* 171) [Scale] + (Unnamed Layer* 172) [Activation] input reformatter 0, Tactic: 1002, 559[Half(128,64,64)] -> (Unnamed Layer* 171) [Scale] + (Unnamed Layer* 172) [Activation] reformatted input 0[Float(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(Scale): (Unnamed Layer* 171) [Scale] + (Unnamed Layer* 172) [Activation], Tactic: 0, (Unnamed Layer* 171) [Scale] + (Unnamed Layer* 172) [Activation] reformatted input 0[Float(128,64,64)] -> 561[Float(128,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(scudnn_winograd): (Unnamed Layer* 173) [Convolution], Tactic: 2775507031594384867, 561[Float(128,64,64)] -> 562[Float(27,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(Constant): (Unnamed Layer* 174) [Constant], Tactic: 0, -> (Unnamed Layer* 174) [Constant]_output[Float(128,3,3)] [09/29/2020-17:42:22] [V] [TRT] Layer(Constant): (Unnamed Layer* 175) [Constant], Tactic: 0, -> (Unnamed Layer* 175) [Constant]_output[Float()] [09/29/2020-17:42:22] [V] [TRT] Layer(PluginV2): (Unnamed Layer* 176) [PluginV2Ext], Tactic: 0, 561[Float(128,64,64)], 562[Float(27,64,64)], (Unnamed Layer* 174) [Constant]_output[Float(128,3,3)], (Unnamed Layer* 175) [Constant]_output[Float()] -> 563[Float(64,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(Scale): (Unnamed Layer* 177) [Scale] + (Unnamed Layer* 178) [Activation], Tactic: 0, 563[Float(64,64,64)] -> 565[Float(64,64,64)] [09/29/2020-17:42:22] [V] [TRT] Layer(Deconvolution): (Unnamed Layer* 179) [Deconvolution], Tactic: 1, 565[Float(64,64,64)] -> 566[Float(64,128,128)] save engine. TRT Engine file saved to: model/plan/net_566_half.plan InputBindingDimensions: 3 512 512 OutputBindingDimensions: 512 16 16 OutputBindingDimensions: 256 32 32 OutputBindingDimensions: 128 64 64 OutputBindingDimensions: 64 128 128 mBindings: 5 --------------------------------------- size: 131072 diff: 0.00862307 output: -0.00000000 -0.00000000 0.01428223 0.07220459 0.23706055 0.32373047 0.20776367 0.22460938 0.15356445 0.27416992 0.15881348 0.20532227 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 0.02151489 -0.00000000 -0.00000000 -0.00000000 -0.00000000 0.03411865 0.03521729 0.01251221 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 0.00634766 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 0.09313965 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 0.00421143 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 0.04046631 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 -0.00000000 output_true: 0.00000000 0.00000000 0.01714159 0.07266843 0.23683952 0.32160038 0.20577787 0.22454233 0.15468098 0.27179956 0.15807258 0.20568119 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.02611079 0.00000000 0.00000000 0.00000000 0.00000000 0.03631414 0.03636605 0.01460978 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.01316359 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.08996668 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00383128 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.04004622 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 size: 262144 diff: nan output: nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan output_true: 0.00000000 0.00000000 0.02472655 0.01839661 0.00000000 0.01245259 0.02933359 0.10684285 0.08875157 0.06613733 0.07629242 0.12410584 0.09659502 0.00000000 0.00000000 0.03297127 0.03874041 0.04074360 0.02888344 0.07169515 0.09463381 0.10702039 0.10824851 0.08952697 0.10725836 0.00000000 0.00000000 0.00000000 0.07119414 0.03232076 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.08071231 0.06751628 0.02241910 0.00796944 0.08617064 0.06648142 0.00313839 0.04454949 0.05787941 0.05323463 0.03006385 0.02201365 0.04869380 0.00861826 0.04055130 0.06075898 0.03988742 0.04008672 0.07787705 0.09547629 0.05702744 0.09835481 0.00000000 0.00000000 0.00000000 0.04253126 0.11874426 0.08302425 0.00000000 0.05574201 0.05694421 0.00000000 0.09312605 0.09300528 0.01647624 0.00000000 0.03804985 0.03258050 0.01087706 0.00000000 0.06099986 0.05249952 0.06107505 0.06377982 0.00000000 0.00000000 0.00000000 0.03221153 0.03995649 0.02493161 0.07013338 0.08300410 0.06094730 0.08669443 0.05691931 0.02055677 0.09381291 0.14477536 0.10725938 0.07849867 0.04039212 0.00000000 0.03936415 0.02433684 0.00421633 size: 524288 diff: nan output: nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan output_true: 0.00000000 0.00000000 0.00000000 0.02110112 0.16315623 0.03770891 0.00910097 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.01411562 0.00000000 0.00000000 0.21050821 0.10034582 0.05283674 0.01542202 0.00000000 0.00000000 0.00000000 0.00000000 0.07569035 0.00000000 0.00036414 0.06284294 0.06742347 0.11107833 0.09226753 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 size: 1048576 output: nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan nan output_true: 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 -0.00033867 0.03806663 0.04193160 0.05816917 0.05260986 0.05572586 0.04647925 0.10671705 0.10457682 0.14457871 0.13044374 0.16308269 0.14435266 0.10839099 0.08043204 0.02002707 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 cur avg readdata 0.26 0.26 infer 17.36 17.36 ------------------------------------------------------------------ Total time 17.62 17.62ms (1) [0.0]