Description
Hello
I’m trying to convert exported onnx model from pytorch to tensorrt int8 engine
onnx.checker.check_model() reported nothing, but I got error on ConvTranspose layer
&&&& RUNNING TensorRT.trtexec [TensorRT v8000] # trtexec --onnx=temp.onnx --saveEngine=temp.trt
&&&& RUNNING TensorRT.trtexec [TensorRT v8000] # trtexec --onnx=temp.onnx --verbose
[06/24/2021-10:58:27] [I] === Model Options ===
[06/24/2021-10:58:27] [I] Format: ONNX
[06/24/2021-10:58:27] [I] Model: temp.onnx
[06/24/2021-10:58:27] [I] Output:
[06/24/2021-10:58:27] [I] === Build Options ===
[06/24/2021-10:58:27] [I] Max batch: explicit
[06/24/2021-10:58:27] [I] Workspace: 16 MiB
[06/24/2021-10:58:27] [I] minTiming: 1
[06/24/2021-10:58:27] [I] avgTiming: 8
[06/24/2021-10:58:27] [I] Precision: FP32
[06/24/2021-10:58:27] [I] Calibration:
[06/24/2021-10:58:27] [I] Refit: Disabled
[06/24/2021-10:58:27] [I] Sparsity: Disabled
[06/24/2021-10:58:27] [I] Safe mode: Disabled
[06/24/2021-10:58:27] [I] Enable serialization: Disabled
[06/24/2021-10:58:27] [I] Save engine:
[06/24/2021-10:58:27] [I] Load engine:
[06/24/2021-10:58:27] [I] NVTX verbosity: 0
[06/24/2021-10:58:27] [I] Tactic sources: Using default tactic sources
[06/24/2021-10:58:27] [I] timingCacheMode: local
[06/24/2021-10:58:27] [I] timingCacheFile:
[06/24/2021-10:58:27] [I] Input(s)s format: fp32:CHW
[06/24/2021-10:58:27] [I] Output(s)s format: fp32:CHW
[06/24/2021-10:58:27] [I] Input build shapes: model
[06/24/2021-10:58:27] [I] Input calibration shapes: model
[06/24/2021-10:58:27] [I] === System Options ===
[06/24/2021-10:58:27] [I] Device: 0
[06/24/2021-10:58:27] [I] DLACore:
[06/24/2021-10:58:27] [I] Plugins:
[06/24/2021-10:58:27] [I] === Inference Options ===
[06/24/2021-10:58:27] [I] Batch: Explicit
[06/24/2021-10:58:27] [I] Input inference shapes: model
[06/24/2021-10:58:27] [I] Iterations: 10
[06/24/2021-10:58:27] [I] Duration: 3s (+ 200ms warm up)
[06/24/2021-10:58:27] [I] Sleep time: 0ms
[06/24/2021-10:58:27] [I] Streams: 1
[06/24/2021-10:58:27] [I] ExposeDMA: Disabled
[06/24/2021-10:58:27] [I] Data transfers: Enabled
[06/24/2021-10:58:27] [I] Spin-wait: Disabled
[06/24/2021-10:58:27] [I] Multithreading: Disabled
[06/24/2021-10:58:27] [I] CUDA Graph: Disabled
[06/24/2021-10:58:27] [I] Separate profiling: Disabled
[06/24/2021-10:58:27] [I] Time Deserialize: Disabled
[06/24/2021-10:58:27] [I] Time Refit: Disabled
[06/24/2021-10:58:27] [I] Skip inference: Disabled
[06/24/2021-10:58:27] [I] Inputs:
[06/24/2021-10:58:27] [I] === Reporting Options ===
[06/24/2021-10:58:27] [I] Verbose: Enabled
[06/24/2021-10:58:27] [I] Averages: 10 inferences
[06/24/2021-10:58:27] [I] Percentile: 99
[06/24/2021-10:58:27] [I] Dump refittable layers:Disabled
[06/24/2021-10:58:27] [I] Dump output: Disabled
[06/24/2021-10:58:27] [I] Profile: Disabled
[06/24/2021-10:58:27] [I] Export timing to JSON file:
[06/24/2021-10:58:27] [I] Export output to JSON file:
[06/24/2021-10:58:27] [I] Export profile to JSON file:
[06/24/2021-10:58:27] [I]
[06/24/2021-10:58:27] [I] === Device Information ===
[06/24/2021-10:58:27] [I] Selected Device: NVIDIA GeForce RTX 2080 Ti
[06/24/2021-10:58:27] [I] Compute Capability: 7.5
[06/24/2021-10:58:27] [I] SMs: 68
[06/24/2021-10:58:27] [I] Compute Clock Rate: 1.545 GHz
[06/24/2021-10:58:27] [I] Device Global Memory: 11016 MiB
[06/24/2021-10:58:27] [I] Shared Memory per SM: 64 KiB
[06/24/2021-10:58:27] [I] Memory Bus Width: 352 bits (ECC disabled)
[06/24/2021-10:58:27] [I] Memory Clock Rate: 7 GHz
[06/24/2021-10:58:27] [I]
[06/24/2021-10:58:27] [I] TensorRT version: 8000
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::Region_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::ScatterND version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::CropAndResize version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::Proposal version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::Split version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1
[06/24/2021-10:58:27] [I] [TRT] [MemUsageChange] Init CUDA: CPU +327, GPU +0, now: CPU 333, GPU 667 (MiB)
[06/24/2021-10:58:27] [I] [TRT] ----------------------------------------------------------------
[06/24/2021-10:58:27] [I] [TRT] Input filename: temp.onnx
[06/24/2021-10:58:27] [I] [TRT] ONNX IR version: 0.0.6
[06/24/2021-10:58:27] [I] [TRT] Opset version: 9
[06/24/2021-10:58:27] [I] [TRT] Producer name: pytorch
[06/24/2021-10:58:27] [I] [TRT] Producer version: 1.8
[06/24/2021-10:58:27] [I] [TRT] Domain:
[06/24/2021-10:58:27] [I] [TRT] Model version: 0
[06/24/2021-10:58:27] [I] [TRT] Doc string:
[06/24/2021-10:58:27] [I] [TRT] ----------------------------------------------------------------
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::ScatterND version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::Proposal version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::Split version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1
[06/24/2021-10:58:27] [V] [TRT] Adding network input: input with dtype: float32, dimensions: (1, 3, 720, 1280)
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: input for ONNX tensor: input
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.0.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.0.bias
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.1.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.1.bias
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.2.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.2.bias
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.3.body.0.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.3.body.0.bias
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.3.body.2.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.3.body.2.bias
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.4.body.0.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.4.body.0.bias
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.4.body.2.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.4.body.2.bias
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.5.body.0.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.5.body.0.bias
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.5.body.2.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.5.body.2.bias
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.6.body.0.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.6.body.0.bias
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.6.body.2.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.6.body.2.bias
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.7.body.0.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.7.body.0.bias
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.7.body.2.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.7.body.2.bias
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.8.body.0.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.8.body.0.bias
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.8.body.2.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.8.body.2.bias
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.9.body.0.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.9.body.0.bias
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.9.body.2.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.9.body.2.bias
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.10.body.0.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.10.body.0.bias
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.10.body.2.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.10.body.2.bias
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.11.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.11.bias
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.12.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.12.bias
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.13.weight
[06/24/2021-10:58:27] [V] [TRT] Importing initializer: body.13.bias
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Constant_0 [Constant]
[06/24/2021-10:58:27] [V] [TRT] Constant_0 [Constant] inputs:
[06/24/2021-10:58:27] [V] [TRT] Constant_0 [Constant] outputs: [45 -> ()],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Sub_1 [Sub]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: input
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 45
[06/24/2021-10:58:27] [V] [TRT] Sub_1 [Sub] inputs: [input -> (1, 3, 720, 1280)], [45 -> ()],
[06/24/2021-10:58:27] [V] [TRT] Registering layer: 45 for ONNX node: 45
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Sub_1 for ONNX node: Sub_1
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 46 for ONNX tensor: 46
[06/24/2021-10:58:27] [V] [TRT] Sub_1 [Sub] outputs: [46 -> (1, 3, 720, 1280)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Conv_2 [Conv]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 46
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.0.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.0.bias
[06/24/2021-10:58:27] [V] [TRT] Conv_2 [Conv] inputs: [46 -> (1, 3, 720, 1280)], [body.0.weight -> (64, 3, 5, 5)], [body.0.bias -> (64)],
[06/24/2021-10:58:27] [V] [TRT] Convolution input dimensions: (1, 3, 720, 1280)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Conv_2 for ONNX node: Conv_2
[06/24/2021-10:58:27] [V] [TRT] Using kernel: (5, 5), strides: (1, 1), prepadding: (2, 2), postpadding: (2, 2), dilations: (1, 1), numOutputs: 64
[06/24/2021-10:58:27] [V] [TRT] Convolution output dimensions: (1, 64, 720, 1280)
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 47 for ONNX tensor: 47
[06/24/2021-10:58:27] [V] [TRT] Conv_2 [Conv] outputs: [47 -> (1, 64, 720, 1280)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Conv_3 [Conv]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 47
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.1.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.1.bias
[06/24/2021-10:58:27] [V] [TRT] Conv_3 [Conv] inputs: [47 -> (1, 64, 720, 1280)], [body.1.weight -> (128, 64, 3, 3)], [body.1.bias -> (128)],
[06/24/2021-10:58:27] [V] [TRT] Convolution input dimensions: (1, 64, 720, 1280)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Conv_3 for ONNX node: Conv_3
[06/24/2021-10:58:27] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128
[06/24/2021-10:58:27] [V] [TRT] Convolution output dimensions: (1, 128, 360, 640)
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 48 for ONNX tensor: 48
[06/24/2021-10:58:27] [V] [TRT] Conv_3 [Conv] outputs: [48 -> (1, 128, 360, 640)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Conv_4 [Conv]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 48
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.2.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.2.bias
[06/24/2021-10:58:27] [V] [TRT] Conv_4 [Conv] inputs: [48 -> (1, 128, 360, 640)], [body.2.weight -> (192, 128, 3, 3)], [body.2.bias -> (192)],
[06/24/2021-10:58:27] [V] [TRT] Convolution input dimensions: (1, 128, 360, 640)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Conv_4 for ONNX node: Conv_4
[06/24/2021-10:58:27] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192
[06/24/2021-10:58:27] [V] [TRT] Convolution output dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 49 for ONNX tensor: 49
[06/24/2021-10:58:27] [V] [TRT] Conv_4 [Conv] outputs: [49 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Conv_5 [Conv]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 49
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.3.body.0.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.3.body.0.bias
[06/24/2021-10:58:27] [V] [TRT] Conv_5 [Conv] inputs: [49 -> (1, 192, 180, 320)], [body.3.body.0.weight -> (192, 192, 3, 3)], [body.3.body.0.bias -> (192)],
[06/24/2021-10:58:27] [V] [TRT] Convolution input dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Conv_5 for ONNX node: Conv_5
[06/24/2021-10:58:27] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192
[06/24/2021-10:58:27] [V] [TRT] Convolution output dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 50 for ONNX tensor: 50
[06/24/2021-10:58:27] [V] [TRT] Conv_5 [Conv] outputs: [50 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Relu_6 [Relu]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 50
[06/24/2021-10:58:27] [V] [TRT] Relu_6 [Relu] inputs: [50 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Relu_6 for ONNX node: Relu_6
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 51 for ONNX tensor: 51
[06/24/2021-10:58:27] [V] [TRT] Relu_6 [Relu] outputs: [51 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Conv_7 [Conv]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 51
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.3.body.2.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.3.body.2.bias
[06/24/2021-10:58:27] [V] [TRT] Conv_7 [Conv] inputs: [51 -> (1, 192, 180, 320)], [body.3.body.2.weight -> (192, 192, 3, 3)], [body.3.body.2.bias -> (192)],
[06/24/2021-10:58:27] [V] [TRT] Convolution input dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Conv_7 for ONNX node: Conv_7
[06/24/2021-10:58:27] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192
[06/24/2021-10:58:27] [V] [TRT] Convolution output dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 52 for ONNX tensor: 52
[06/24/2021-10:58:27] [V] [TRT] Conv_7 [Conv] outputs: [52 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Add_8 [Add]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 52
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 49
[06/24/2021-10:58:27] [V] [TRT] Add_8 [Add] inputs: [52 -> (1, 192, 180, 320)], [49 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Add_8 for ONNX node: Add_8
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 53 for ONNX tensor: 53
[06/24/2021-10:58:27] [V] [TRT] Add_8 [Add] outputs: [53 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Conv_9 [Conv]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 53
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.4.body.0.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.4.body.0.bias
[06/24/2021-10:58:27] [V] [TRT] Conv_9 [Conv] inputs: [53 -> (1, 192, 180, 320)], [body.4.body.0.weight -> (192, 192, 3, 3)], [body.4.body.0.bias -> (192)],
[06/24/2021-10:58:27] [V] [TRT] Convolution input dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Conv_9 for ONNX node: Conv_9
[06/24/2021-10:58:27] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192
[06/24/2021-10:58:27] [V] [TRT] Convolution output dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 54 for ONNX tensor: 54
[06/24/2021-10:58:27] [V] [TRT] Conv_9 [Conv] outputs: [54 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Relu_10 [Relu]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 54
[06/24/2021-10:58:27] [V] [TRT] Relu_10 [Relu] inputs: [54 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Relu_10 for ONNX node: Relu_10
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 55 for ONNX tensor: 55
[06/24/2021-10:58:27] [V] [TRT] Relu_10 [Relu] outputs: [55 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Conv_11 [Conv]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 55
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.4.body.2.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.4.body.2.bias
[06/24/2021-10:58:27] [V] [TRT] Conv_11 [Conv] inputs: [55 -> (1, 192, 180, 320)], [body.4.body.2.weight -> (192, 192, 3, 3)], [body.4.body.2.bias -> (192)],
[06/24/2021-10:58:27] [V] [TRT] Convolution input dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Conv_11 for ONNX node: Conv_11
[06/24/2021-10:58:27] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192
[06/24/2021-10:58:27] [V] [TRT] Convolution output dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 56 for ONNX tensor: 56
[06/24/2021-10:58:27] [V] [TRT] Conv_11 [Conv] outputs: [56 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Add_12 [Add]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 56
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 53
[06/24/2021-10:58:27] [V] [TRT] Add_12 [Add] inputs: [56 -> (1, 192, 180, 320)], [53 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Add_12 for ONNX node: Add_12
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 57 for ONNX tensor: 57
[06/24/2021-10:58:27] [V] [TRT] Add_12 [Add] outputs: [57 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Conv_13 [Conv]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 57
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.5.body.0.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.5.body.0.bias
[06/24/2021-10:58:27] [V] [TRT] Conv_13 [Conv] inputs: [57 -> (1, 192, 180, 320)], [body.5.body.0.weight -> (192, 192, 3, 3)], [body.5.body.0.bias -> (192)],
[06/24/2021-10:58:27] [V] [TRT] Convolution input dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Conv_13 for ONNX node: Conv_13
[06/24/2021-10:58:27] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192
[06/24/2021-10:58:27] [V] [TRT] Convolution output dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 58 for ONNX tensor: 58
[06/24/2021-10:58:27] [V] [TRT] Conv_13 [Conv] outputs: [58 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Relu_14 [Relu]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 58
[06/24/2021-10:58:27] [V] [TRT] Relu_14 [Relu] inputs: [58 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Relu_14 for ONNX node: Relu_14
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 59 for ONNX tensor: 59
[06/24/2021-10:58:27] [V] [TRT] Relu_14 [Relu] outputs: [59 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Conv_15 [Conv]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 59
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.5.body.2.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.5.body.2.bias
[06/24/2021-10:58:27] [V] [TRT] Conv_15 [Conv] inputs: [59 -> (1, 192, 180, 320)], [body.5.body.2.weight -> (192, 192, 3, 3)], [body.5.body.2.bias -> (192)],
[06/24/2021-10:58:27] [V] [TRT] Convolution input dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Conv_15 for ONNX node: Conv_15
[06/24/2021-10:58:27] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192
[06/24/2021-10:58:27] [V] [TRT] Convolution output dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 60 for ONNX tensor: 60
[06/24/2021-10:58:27] [V] [TRT] Conv_15 [Conv] outputs: [60 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Add_16 [Add]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 60
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 57
[06/24/2021-10:58:27] [V] [TRT] Add_16 [Add] inputs: [60 -> (1, 192, 180, 320)], [57 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Add_16 for ONNX node: Add_16
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 61 for ONNX tensor: 61
[06/24/2021-10:58:27] [V] [TRT] Add_16 [Add] outputs: [61 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Conv_17 [Conv]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 61
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.6.body.0.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.6.body.0.bias
[06/24/2021-10:58:27] [V] [TRT] Conv_17 [Conv] inputs: [61 -> (1, 192, 180, 320)], [body.6.body.0.weight -> (192, 192, 3, 3)], [body.6.body.0.bias -> (192)],
[06/24/2021-10:58:27] [V] [TRT] Convolution input dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Conv_17 for ONNX node: Conv_17
[06/24/2021-10:58:27] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192
[06/24/2021-10:58:27] [V] [TRT] Convolution output dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 62 for ONNX tensor: 62
[06/24/2021-10:58:27] [V] [TRT] Conv_17 [Conv] outputs: [62 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Relu_18 [Relu]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 62
[06/24/2021-10:58:27] [V] [TRT] Relu_18 [Relu] inputs: [62 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Relu_18 for ONNX node: Relu_18
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 63 for ONNX tensor: 63
[06/24/2021-10:58:27] [V] [TRT] Relu_18 [Relu] outputs: [63 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Conv_19 [Conv]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 63
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.6.body.2.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.6.body.2.bias
[06/24/2021-10:58:27] [V] [TRT] Conv_19 [Conv] inputs: [63 -> (1, 192, 180, 320)], [body.6.body.2.weight -> (192, 192, 3, 3)], [body.6.body.2.bias -> (192)],
[06/24/2021-10:58:27] [V] [TRT] Convolution input dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Conv_19 for ONNX node: Conv_19
[06/24/2021-10:58:27] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192
[06/24/2021-10:58:27] [V] [TRT] Convolution output dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 64 for ONNX tensor: 64
[06/24/2021-10:58:27] [V] [TRT] Conv_19 [Conv] outputs: [64 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Add_20 [Add]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 64
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 61
[06/24/2021-10:58:27] [V] [TRT] Add_20 [Add] inputs: [64 -> (1, 192, 180, 320)], [61 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Add_20 for ONNX node: Add_20
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 65 for ONNX tensor: 65
[06/24/2021-10:58:27] [V] [TRT] Add_20 [Add] outputs: [65 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Conv_21 [Conv]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 65
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.7.body.0.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.7.body.0.bias
[06/24/2021-10:58:27] [V] [TRT] Conv_21 [Conv] inputs: [65 -> (1, 192, 180, 320)], [body.7.body.0.weight -> (192, 192, 3, 3)], [body.7.body.0.bias -> (192)],
[06/24/2021-10:58:27] [V] [TRT] Convolution input dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Conv_21 for ONNX node: Conv_21
[06/24/2021-10:58:27] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192
[06/24/2021-10:58:27] [V] [TRT] Convolution output dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 66 for ONNX tensor: 66
[06/24/2021-10:58:27] [V] [TRT] Conv_21 [Conv] outputs: [66 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Relu_22 [Relu]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 66
[06/24/2021-10:58:27] [V] [TRT] Relu_22 [Relu] inputs: [66 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Relu_22 for ONNX node: Relu_22
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 67 for ONNX tensor: 67
[06/24/2021-10:58:27] [V] [TRT] Relu_22 [Relu] outputs: [67 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Conv_23 [Conv]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 67
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.7.body.2.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.7.body.2.bias
[06/24/2021-10:58:27] [V] [TRT] Conv_23 [Conv] inputs: [67 -> (1, 192, 180, 320)], [body.7.body.2.weight -> (192, 192, 3, 3)], [body.7.body.2.bias -> (192)],
[06/24/2021-10:58:27] [V] [TRT] Convolution input dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Conv_23 for ONNX node: Conv_23
[06/24/2021-10:58:27] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192
[06/24/2021-10:58:27] [V] [TRT] Convolution output dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 68 for ONNX tensor: 68
[06/24/2021-10:58:27] [V] [TRT] Conv_23 [Conv] outputs: [68 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Add_24 [Add]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 68
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 65
[06/24/2021-10:58:27] [V] [TRT] Add_24 [Add] inputs: [68 -> (1, 192, 180, 320)], [65 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Add_24 for ONNX node: Add_24
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 69 for ONNX tensor: 69
[06/24/2021-10:58:27] [V] [TRT] Add_24 [Add] outputs: [69 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Conv_25 [Conv]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 69
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.8.body.0.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.8.body.0.bias
[06/24/2021-10:58:27] [V] [TRT] Conv_25 [Conv] inputs: [69 -> (1, 192, 180, 320)], [body.8.body.0.weight -> (192, 192, 3, 3)], [body.8.body.0.bias -> (192)],
[06/24/2021-10:58:27] [V] [TRT] Convolution input dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Conv_25 for ONNX node: Conv_25
[06/24/2021-10:58:27] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192
[06/24/2021-10:58:27] [V] [TRT] Convolution output dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 70 for ONNX tensor: 70
[06/24/2021-10:58:27] [V] [TRT] Conv_25 [Conv] outputs: [70 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Relu_26 [Relu]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 70
[06/24/2021-10:58:27] [V] [TRT] Relu_26 [Relu] inputs: [70 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Relu_26 for ONNX node: Relu_26
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 71 for ONNX tensor: 71
[06/24/2021-10:58:27] [V] [TRT] Relu_26 [Relu] outputs: [71 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Conv_27 [Conv]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 71
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.8.body.2.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.8.body.2.bias
[06/24/2021-10:58:27] [V] [TRT] Conv_27 [Conv] inputs: [71 -> (1, 192, 180, 320)], [body.8.body.2.weight -> (192, 192, 3, 3)], [body.8.body.2.bias -> (192)],
[06/24/2021-10:58:27] [V] [TRT] Convolution input dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Conv_27 for ONNX node: Conv_27
[06/24/2021-10:58:27] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192
[06/24/2021-10:58:27] [V] [TRT] Convolution output dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 72 for ONNX tensor: 72
[06/24/2021-10:58:27] [V] [TRT] Conv_27 [Conv] outputs: [72 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Add_28 [Add]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 72
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 69
[06/24/2021-10:58:27] [V] [TRT] Add_28 [Add] inputs: [72 -> (1, 192, 180, 320)], [69 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Add_28 for ONNX node: Add_28
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 73 for ONNX tensor: 73
[06/24/2021-10:58:27] [V] [TRT] Add_28 [Add] outputs: [73 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Conv_29 [Conv]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 73
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.9.body.0.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.9.body.0.bias
[06/24/2021-10:58:27] [V] [TRT] Conv_29 [Conv] inputs: [73 -> (1, 192, 180, 320)], [body.9.body.0.weight -> (192, 192, 3, 3)], [body.9.body.0.bias -> (192)],
[06/24/2021-10:58:27] [V] [TRT] Convolution input dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Conv_29 for ONNX node: Conv_29
[06/24/2021-10:58:27] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192
[06/24/2021-10:58:27] [V] [TRT] Convolution output dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 74 for ONNX tensor: 74
[06/24/2021-10:58:27] [V] [TRT] Conv_29 [Conv] outputs: [74 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Relu_30 [Relu]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 74
[06/24/2021-10:58:27] [V] [TRT] Relu_30 [Relu] inputs: [74 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Relu_30 for ONNX node: Relu_30
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 75 for ONNX tensor: 75
[06/24/2021-10:58:27] [V] [TRT] Relu_30 [Relu] outputs: [75 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Conv_31 [Conv]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 75
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.9.body.2.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.9.body.2.bias
[06/24/2021-10:58:27] [V] [TRT] Conv_31 [Conv] inputs: [75 -> (1, 192, 180, 320)], [body.9.body.2.weight -> (192, 192, 3, 3)], [body.9.body.2.bias -> (192)],
[06/24/2021-10:58:27] [V] [TRT] Convolution input dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Conv_31 for ONNX node: Conv_31
[06/24/2021-10:58:27] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192
[06/24/2021-10:58:27] [V] [TRT] Convolution output dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 76 for ONNX tensor: 76
[06/24/2021-10:58:27] [V] [TRT] Conv_31 [Conv] outputs: [76 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Add_32 [Add]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 76
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 73
[06/24/2021-10:58:27] [V] [TRT] Add_32 [Add] inputs: [76 -> (1, 192, 180, 320)], [73 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Add_32 for ONNX node: Add_32
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 77 for ONNX tensor: 77
[06/24/2021-10:58:27] [V] [TRT] Add_32 [Add] outputs: [77 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Conv_33 [Conv]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 77
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.10.body.0.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.10.body.0.bias
[06/24/2021-10:58:27] [V] [TRT] Conv_33 [Conv] inputs: [77 -> (1, 192, 180, 320)], [body.10.body.0.weight -> (192, 192, 3, 3)], [body.10.body.0.bias -> (192)],
[06/24/2021-10:58:27] [V] [TRT] Convolution input dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Conv_33 for ONNX node: Conv_33
[06/24/2021-10:58:27] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192
[06/24/2021-10:58:27] [V] [TRT] Convolution output dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 78 for ONNX tensor: 78
[06/24/2021-10:58:27] [V] [TRT] Conv_33 [Conv] outputs: [78 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Relu_34 [Relu]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 78
[06/24/2021-10:58:27] [V] [TRT] Relu_34 [Relu] inputs: [78 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Relu_34 for ONNX node: Relu_34
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 79 for ONNX tensor: 79
[06/24/2021-10:58:27] [V] [TRT] Relu_34 [Relu] outputs: [79 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Conv_35 [Conv]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 79
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.10.body.2.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.10.body.2.bias
[06/24/2021-10:58:27] [V] [TRT] Conv_35 [Conv] inputs: [79 -> (1, 192, 180, 320)], [body.10.body.2.weight -> (192, 192, 3, 3)], [body.10.body.2.bias -> (192)],
[06/24/2021-10:58:27] [V] [TRT] Convolution input dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Conv_35 for ONNX node: Conv_35
[06/24/2021-10:58:27] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192
[06/24/2021-10:58:27] [V] [TRT] Convolution output dimensions: (1, 192, 180, 320)
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 80 for ONNX tensor: 80
[06/24/2021-10:58:27] [V] [TRT] Conv_35 [Conv] outputs: [80 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Add_36 [Add]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 80
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 77
[06/24/2021-10:58:27] [V] [TRT] Add_36 [Add] inputs: [80 -> (1, 192, 180, 320)], [77 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Add_36 for ONNX node: Add_36
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 81 for ONNX tensor: 81
[06/24/2021-10:58:27] [V] [TRT] Add_36 [Add] outputs: [81 -> (1, 192, 180, 320)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: ConvTranspose_37 [ConvTranspose]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 81
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.11.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.11.bias
[06/24/2021-10:58:27] [V] [TRT] ConvTranspose_37 [ConvTranspose] inputs: [81 -> (1, 192, 180, 320)], [body.11.weight -> (192, 128, 3, 3)], [body.11.bias -> (128)],
[06/24/2021-10:58:27] [V] [TRT] Running deconvolution with:
Padding mode: NOTSET
Pre-padding: (1, 1)
Post-padding: (0, 0)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: ConvTranspose_37 for ONNX node: ConvTranspose_37
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 82 for ONNX tensor: 82
[06/24/2021-10:58:27] [V] [TRT] ConvTranspose_37 [ConvTranspose] outputs: [82 -> (1, 128, 360, 640)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: ConvTranspose_38 [ConvTranspose]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 82
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.12.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.12.bias
[06/24/2021-10:58:27] [V] [TRT] ConvTranspose_38 [ConvTranspose] inputs: [82 -> (1, 128, 360, 640)], [body.12.weight -> (128, 64, 3, 3)], [body.12.bias -> (64)],
[06/24/2021-10:58:27] [V] [TRT] Running deconvolution with:
Padding mode: NOTSET
Pre-padding: (1, 1)
Post-padding: (0, 0)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: ConvTranspose_38 for ONNX node: ConvTranspose_38
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 83 for ONNX tensor: 83
[06/24/2021-10:58:27] [V] [TRT] ConvTranspose_38 [ConvTranspose] outputs: [83 -> (1, 64, 720, 1280)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Conv_39 [Conv]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 83
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.13.weight
[06/24/2021-10:58:27] [V] [TRT] Searching for input: body.13.bias
[06/24/2021-10:58:27] [V] [TRT] Conv_39 [Conv] inputs: [83 -> (1, 64, 720, 1280)], [body.13.weight -> (3, 64, 5, 5)], [body.13.bias -> (3)],
[06/24/2021-10:58:27] [V] [TRT] Convolution input dimensions: (1, 64, 720, 1280)
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Conv_39 for ONNX node: Conv_39
[06/24/2021-10:58:27] [V] [TRT] Using kernel: (5, 5), strides: (1, 1), prepadding: (2, 2), postpadding: (2, 2), dilations: (1, 1), numOutputs: 3
[06/24/2021-10:58:27] [V] [TRT] Convolution output dimensions: (1, 3, 720, 1280)
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: 84 for ONNX tensor: 84
[06/24/2021-10:58:27] [V] [TRT] Conv_39 [Conv] outputs: [84 -> (1, 3, 720, 1280)],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Constant_40 [Constant]
[06/24/2021-10:58:27] [V] [TRT] Constant_40 [Constant] inputs:
[06/24/2021-10:58:27] [V] [TRT] Constant_40 [Constant] outputs: [85 -> ()],
[06/24/2021-10:58:27] [V] [TRT] Parsing node: Add_41 [Add]
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 84
[06/24/2021-10:58:27] [V] [TRT] Searching for input: 85
[06/24/2021-10:58:27] [V] [TRT] Add_41 [Add] inputs: [84 -> (1, 3, 720, 1280)], [85 -> ()],
[06/24/2021-10:58:27] [V] [TRT] Registering layer: 85 for ONNX node: 85
[06/24/2021-10:58:27] [V] [TRT] Registering layer: Add_41 for ONNX node: Add_41
[06/24/2021-10:58:27] [V] [TRT] Registering tensor: output_0 for ONNX tensor: output
[06/24/2021-10:58:27] [V] [TRT] Add_41 [Add] outputs: [output -> (1, 3, 720, 1280)],
[06/24/2021-10:58:27] [V] [TRT] Marking output_0 as output: output
[06/24/2021-10:58:27] [I] [TRT] [MemUsageChange] Init CUDA: CPU +0, GPU +0, now: CPU 355, GPU 667 (MiB)
[06/24/2021-10:58:27] [I] [TRT] [MemUsageSnapshot] Builder begin: CPU 355 MiB, GPU 667 MiB
[06/24/2021-10:58:27] [V] [TRT] Applying generic optimizations to the graph for inference.
[06/24/2021-10:58:27] [V] [TRT] Original: 44 layers
[06/24/2021-10:58:27] [V] [TRT] After dead-layer removal: 44 layers
[06/24/2021-10:58:27] [V] [TRT] ConstShuffleFusion: Fusing 45 with (Unnamed Layer* 1) [Shuffle]
[06/24/2021-10:58:27] [V] [TRT] ConstShuffleFusion: Fusing 85 with (Unnamed Layer* 42) [Shuffle]
[06/24/2021-10:58:27] [V] [TRT] After Myelin optimization: 42 layers
[06/24/2021-10:58:27] [V] [TRT] ConstEltFusion: Fusing 85 + (Unnamed Layer* 42) [Shuffle] with Add_41
[06/24/2021-10:58:27] [V] [TRT] Fusing convolution weights from Conv_39 with scale 85 + (Unnamed Layer* 42) [Shuffle] + Add_41
[06/24/2021-10:58:27] [V] [TRT] After scale fusion: 40 layers
[06/24/2021-10:58:27] [V] [TRT] ConvReluFusion: Fusing Conv_5 with Relu_6
[06/24/2021-10:58:27] [V] [TRT] ConvEltwiseSumFusion: Fusing Conv_7 with Add_8
[06/24/2021-10:58:27] [V] [TRT] ConvReluFusion: Fusing Conv_9 with Relu_10
[06/24/2021-10:58:27] [V] [TRT] ConvEltwiseSumFusion: Fusing Conv_11 with Add_12
[06/24/2021-10:58:27] [V] [TRT] ConvReluFusion: Fusing Conv_13 with Relu_14
[06/24/2021-10:58:27] [V] [TRT] ConvEltwiseSumFusion: Fusing Conv_15 with Add_16
[06/24/2021-10:58:27] [V] [TRT] ConvReluFusion: Fusing Conv_17 with Relu_18
[06/24/2021-10:58:27] [V] [TRT] ConvEltwiseSumFusion: Fusing Conv_19 with Add_20
[06/24/2021-10:58:27] [V] [TRT] ConvReluFusion: Fusing Conv_21 with Relu_22
[06/24/2021-10:58:27] [V] [TRT] ConvEltwiseSumFusion: Fusing Conv_23 with Add_24
[06/24/2021-10:58:27] [V] [TRT] ConvReluFusion: Fusing Conv_25 with Relu_26
[06/24/2021-10:58:27] [V] [TRT] ConvEltwiseSumFusion: Fusing Conv_27 with Add_28
[06/24/2021-10:58:27] [V] [TRT] ConvReluFusion: Fusing Conv_29 with Relu_30
[06/24/2021-10:58:27] [V] [TRT] ConvEltwiseSumFusion: Fusing Conv_31 with Add_32
[06/24/2021-10:58:27] [V] [TRT] ConvReluFusion: Fusing Conv_33 with Relu_34
[06/24/2021-10:58:27] [V] [TRT] ConvEltwiseSumFusion: Fusing Conv_35 with Add_36
[06/24/2021-10:58:27] [V] [TRT] PointWiseFusion: Fusing 45 + (Unnamed Layer* 1) [Shuffle] with Sub_1
[06/24/2021-10:58:27] [V] [TRT] After vertical fusions: 23 layers
[06/24/2021-10:58:27] [V] [TRT] After dupe layer removal: 23 layers
[06/24/2021-10:58:27] [V] [TRT] After final dead-layer removal: 23 layers
[06/24/2021-10:58:27] [V] [TRT] After tensor merging: 23 layers
[06/24/2021-10:58:27] [V] [TRT] After concat removal: 23 layers
[06/24/2021-10:58:27] [V] [TRT] Graph construction and optimization completed in 0.0154604 seconds.
[06/24/2021-10:58:27] [V] [TRT] Using cublasLt a tactic source
[06/24/2021-10:58:27] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +481, GPU +206, now: CPU 837, GPU 873 (MiB)
[06/24/2021-10:58:27] [V] [TRT] Using cuDNN as a tactic source
[06/24/2021-10:58:28] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +394, GPU +172, now: CPU 1231, GPU 1045 (MiB)
[06/24/2021-10:58:28] [W] [TRT] Detected invalid timing cache, setup a local cache instead
[06/24/2021-10:58:28] [V] [TRT] Constructing optimization profile number 0 [1/1].
[06/24/2021-10:58:28] [V] [TRT] --------------- Timing Runner: reformat: Float(2764800,921600,1280,1) -> Float(2764800,1,3840,3) (Reformat)
[06/24/2021-10:58:28] [V] [TRT] Tactic: 1002 Time: 0.991748
[06/24/2021-10:58:28] [V] [TRT] Tactic: 0 Time: 0.053168
[06/24/2021-10:58:28] [V] [TRT] Fastest Tactic: 0 Time: 0.053168
[06/24/2021-10:58:28] [V] [TRT] --------------- Timing Runner: reformat: Float(2764800,921600,1280,1) -> Float(921600,921600:32,1280,1) (Reformat)
[06/24/2021-10:58:28] [V] [TRT] Tactic: 1002 Time: 0.853876
[06/24/2021-10:58:28] [V] [TRT] Tactic: 0 Time: 7.67333
[06/24/2021-10:58:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.853876
[06/24/2021-10:58:28] [V] [TRT] *************** Autotuning format combination: Float(2764800,921600,1280,1) -> Float(2764800,921600,1280,1) ***************
[06/24/2021-10:58:28] [V] [TRT] --------------- Timing Runner: PWN(45 + (Unnamed Layer* 1) [Shuffle], Sub_1) (PointWiseV2)
[06/24/2021-10:58:28] [V] [TRT] Tactic: 0 Time: 0.045628
[06/24/2021-10:58:28] [V] [TRT] Tactic: 1 Time: 0.045496
[06/24/2021-10:58:28] [V] [TRT] Tactic: 2 Time: 0.04524
[06/24/2021-10:58:28] [V] [TRT] Tactic: 3 Time: 0.045588
[06/24/2021-10:58:29] [V] [TRT] Tactic: 4 Time: 0.04576
[06/24/2021-10:58:29] [V] [TRT] Tactic: 5 Time: 0.045508
[06/24/2021-10:58:29] [V] [TRT] Tactic: 6 Time: 0.046172
[06/24/2021-10:58:29] [V] [TRT] Tactic: 7 Time: 0.045988
[06/24/2021-10:58:29] [V] [TRT] Tactic: 8 Time: 0.046992
[06/24/2021-10:58:29] [V] [TRT] Tactic: 9 Time: 0.046716
[06/24/2021-10:58:29] [V] [TRT] Tactic: 28 Time: 0.045872
[06/24/2021-10:58:29] [V] [TRT] Fastest Tactic: 2 Time: 0.04524
[06/24/2021-10:58:29] [V] [TRT] --------------- Timing Runner: PWN(45 + (Unnamed Layer* 1) [Shuffle], Sub_1) (PointWise)
[06/24/2021-10:58:29] [V] [TRT] Tactic: 128 Time: 0.047988
[06/24/2021-10:58:29] [V] [TRT] Tactic: 256 Time: 0.048412
[06/24/2021-10:58:29] [V] [TRT] Tactic: 512 Time: 0.0512
[06/24/2021-10:58:29] [V] [TRT] Fastest Tactic: 128 Time: 0.047988
[06/24/2021-10:58:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2
[06/24/2021-10:58:29] [V] [TRT] *************** Autotuning format combination: Float(2764800,1,3840,3) -> Float(2764800,1,3840,3) ***************
[06/24/2021-10:58:29] [V] [TRT] --------------- Timing Runner: PWN(45 + (Unnamed Layer* 1) [Shuffle], Sub_1) (PointWiseV2)
[06/24/2021-10:58:29] [V] [TRT] Tactic: 0 Time: 0.045684
[06/24/2021-10:58:29] [V] [TRT] Tactic: 1 Time: 0.04598
[06/24/2021-10:58:29] [V] [TRT] Tactic: 2 Time: 0.045352
[06/24/2021-10:58:29] [V] [TRT] Tactic: 3 Time: 0.04614
[06/24/2021-10:58:29] [V] [TRT] Tactic: 4 Time: 0.046064
[06/24/2021-10:58:29] [V] [TRT] Tactic: 5 Time: 0.04598
[06/24/2021-10:58:29] [V] [TRT] Tactic: 6 Time: 0.046364
[06/24/2021-10:58:29] [V] [TRT] Tactic: 7 Time: 0.046232
[06/24/2021-10:58:29] [V] [TRT] Tactic: 8 Time: 0.047368
[06/24/2021-10:58:29] [V] [TRT] Tactic: 9 Time: 0.046248
[06/24/2021-10:58:29] [V] [TRT] Tactic: 28 Time: 0.045836
[06/24/2021-10:58:29] [V] [TRT] Fastest Tactic: 2 Time: 0.045352
[06/24/2021-10:58:29] [V] [TRT] --------------- Timing Runner: PWN(45 + (Unnamed Layer* 1) [Shuffle], Sub_1) (PointWise)
[06/24/2021-10:58:29] [V] [TRT] Tactic: 128 Time: 0.048244
[06/24/2021-10:58:29] [V] [TRT] Tactic: 256 Time: 0.048228
[06/24/2021-10:58:29] [V] [TRT] Tactic: 512 Time: 0.051184
[06/24/2021-10:58:29] [V] [TRT] Fastest Tactic: 256 Time: 0.048228
[06/24/2021-10:58:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2
[06/24/2021-10:58:29] [V] [TRT] *************** Autotuning format combination: Float(921600,921600:32,1280,1) -> Float(921600,921600:32,1280,1) ***************
[06/24/2021-10:58:29] [V] [TRT] --------------- Timing Runner: PWN(45 + (Unnamed Layer* 1) [Shuffle], Sub_1) (PointWiseV2)
[06/24/2021-10:58:30] [V] [TRT] Tactic: 24 Time: 0.446464
[06/24/2021-10:58:30] [V] [TRT] Tactic: 25 Time: 0.448424
[06/24/2021-10:58:30] [V] [TRT] Tactic: 26 Time: 0.474192
[06/24/2021-10:58:30] [V] [TRT] Tactic: 27 Time: 0.472664
[06/24/2021-10:58:30] [V] [TRT] Tactic: 31 Time: 0.436792
[06/24/2021-10:58:30] [V] [TRT] Fastest Tactic: 31 Time: 0.436792
[06/24/2021-10:58:30] [V] [TRT] --------------- Timing Runner: PWN(45 + (Unnamed Layer* 1) [Shuffle], Sub_1) (PointWise)
[06/24/2021-10:58:30] [V] [TRT] Tactic: 128 Time: 0.583892
[06/24/2021-10:58:30] [V] [TRT] Tactic: 256 Time: 0.592756
[06/24/2021-10:58:30] [V] [TRT] Tactic: 512 Time: 0.638388
[06/24/2021-10:58:30] [V] [TRT] Fastest Tactic: 128 Time: 0.583892
[06/24/2021-10:58:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31
[06/24/2021-10:58:30] [V] [TRT] --------------- Timing Runner: reformat: Float(2764800,1,3840,3) -> Float(2764800,921600,1280,1) (Reformat)
[06/24/2021-10:58:30] [V] [TRT] Tactic: 1002 Time: 0.871
[06/24/2021-10:58:30] [V] [TRT] Tactic: 0 Time: 0.084468
[06/24/2021-10:58:30] [V] [TRT] Fastest Tactic: 0 Time: 0.084468
[06/24/2021-10:58:30] [V] [TRT] --------------- Timing Runner: reformat: Float(921600,921600:32,1280,1) -> Float(2764800,921600,1280,1) (Reformat)
[06/24/2021-10:58:30] [V] [TRT] Tactic: 1002 Time: 0.871176
[06/24/2021-10:58:30] [V] [TRT] Tactic: 0 Time: 0.353596
[06/24/2021-10:58:30] [V] [TRT] Fastest Tactic: 0 Time: 0.353596
[06/24/2021-10:58:30] [V] [TRT] --------------- Timing Runner: reformat: Float(921600,921600:32,1280,1) -> Float(2764800,1,3840,3) (Reformat)
[06/24/2021-10:58:30] [V] [TRT] Tactic: 1002 Time: 0.606072
[06/24/2021-10:58:30] [V] [TRT] Tactic: 0 Time: 0.135116
[06/24/2021-10:58:30] [V] [TRT] Fastest Tactic: 0 Time: 0.135116
[06/24/2021-10:58:30] [V] [TRT] *************** Autotuning format combination: Float(2764800,921600,1280,1) -> Float(58982400,921600,1280,1) ***************
[06/24/2021-10:58:30] [V] [TRT] --------------- Timing Runner: Conv_2 (CudaDepthwiseConvolution)
[06/24/2021-10:58:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/24/2021-10:58:30] [V] [TRT] --------------- Timing Runner: Conv_2 (FusedConvActConvolution)
[06/24/2021-10:58:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/24/2021-10:58:30] [V] [TRT] --------------- Timing Runner: Conv_2 (CudnnConvolution)
[06/24/2021-10:58:31] [V] [TRT] Tactic: 0 Time: 3.43202
[06/24/2021-10:58:31] [V] [TRT] Tactic: 1 Time: 1.83434
[06/24/2021-10:58:31] [V] [TRT] Tactic: 2 skipped. Scratch requested: 276480000, available: 16777216
[06/24/2021-10:58:31] [V] [TRT] Tactic: 5 Time: 17.9257
[06/24/2021-10:58:31] [V] [TRT] Tactic: 56 Time: 2.80046
[06/24/2021-10:58:31] [V] [TRT] Tactic: 57 Time: 1.61046
[06/24/2021-10:58:31] [V] [TRT] Tactic: 58 skipped. Scratch requested: 276480000, available: 16777216
[06/24/2021-10:58:31] [V] [TRT] Tactic: 61 Time: 17.7959
[06/24/2021-10:58:31] [I] [TRT] Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output.
[06/24/2021-10:58:31] [V] [TRT] Fastest Tactic: 57 Time: 1.61046
[06/24/2021-10:58:31] [V] [TRT] --------------- Timing Runner: Conv_2 (CaskConvolution)
[06/24/2021-10:58:31] [V] [TRT] Conv_2 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 1825138533642645384
[06/24/2021-10:58:31] [V] [TRT] Tactic: 1825138533642645384 Time: 1.39404
[06/24/2021-10:58:31] [V] [TRT] Conv_2 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 2842488832350522458
[06/24/2021-10:58:31] [V] [TRT] Tactic: 2842488832350522458 Time: 0.763512
[06/24/2021-10:58:31] [V] [TRT] Conv_2 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 3915320020053085238
[06/24/2021-10:58:31] [V] [TRT] Tactic: 3915320020053085238 Time: 1.5079
[06/24/2021-10:58:31] [V] [TRT] Conv_2 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6448355332020552203
[06/24/2021-10:58:32] [V] [TRT] Tactic: 6448355332020552203 Time: 1.92087
[06/24/2021-10:58:32] [V] [TRT] Conv_2 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 6808617066150061604
[06/24/2021-10:58:32] [V] [TRT] Tactic: 6808617066150061604 Time: 0.749292
[06/24/2021-10:58:32] [V] [TRT] Conv_2 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: -8060443123034038864
[06/24/2021-10:58:32] [V] [TRT] Tactic: -8060443123034038864 Time: 0.77194
[06/24/2021-10:58:32] [V] [TRT] Conv_2 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: -4420849921117327522
[06/24/2021-10:58:32] [V] [TRT] Tactic: -4420849921117327522 Time: 0.983396
[06/24/2021-10:58:32] [V] [TRT] Conv_2 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: -3946921629105938337
[06/24/2021-10:58:32] [V] [TRT] Tactic: -3946921629105938337 Time: 0.863116
[06/24/2021-10:58:32] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.749292
[06/24/2021-10:58:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6808617066150061604
[06/24/2021-10:58:32] [V] [TRT] *************** Autotuning format combination: Float(2764800,1,3840,3) -> Float(58982400,1,81920,64) ***************
[06/24/2021-10:58:32] [V] [TRT] --------------- Timing Runner: Conv_2 (CudnnConvolution)
[06/24/2021-10:58:32] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[06/24/2021-10:58:32] [V] [TRT] --------------- Timing Runner: Conv_2 (CaskConvolution)
[06/24/2021-10:58:32] [V] [TRT] Conv_2 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 861694390046228376
[06/24/2021-10:58:32] [V] [TRT] Tactic: 861694390046228376 Time: 3.31399
[06/24/2021-10:58:32] [V] [TRT] Conv_2 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5821621277990374316
[06/24/2021-10:58:32] [V] [TRT] Tactic: 5821621277990374316 Time: 3.2525
[06/24/2021-10:58:32] [V] [TRT] Conv_2 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3853827649136781465
[06/24/2021-10:58:32] [V] [TRT] Tactic: -3853827649136781465 Time: 3.26502
[06/24/2021-10:58:32] [V] [TRT] Fastest Tactic: 5821621277990374316 Time: 3.2525
[06/24/2021-10:58:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5821621277990374316
[06/24/2021-10:58:32] [V] [TRT] --------------- Timing Runner: reformat: Float(58982400,921600,1280,1) -> Float(58982400,1,81920,64) (Reformat)
[06/24/2021-10:58:32] [V] [TRT] Tactic: 1002 Time: 0.92274
[06/24/2021-10:58:32] [V] [TRT] Tactic: 0 Time: 2.31925
[06/24/2021-10:58:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.92274
[06/24/2021-10:58:32] [V] [TRT] --------------- Timing Runner: reformat: Float(58982400,1,81920,64) -> Float(58982400,921600,1280,1) (Reformat)
[06/24/2021-10:58:32] [V] [TRT] Tactic: 1002 Time: 0.895428
[06/24/2021-10:58:32] [V] [TRT] Tactic: 0 Time: 7.51364
[06/24/2021-10:58:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.895428
[06/24/2021-10:58:32] [V] [TRT] *************** Autotuning format combination: Float(58982400,921600,1280,1) -> Float(29491200,230400,640,1) ***************
[06/24/2021-10:58:32] [V] [TRT] --------------- Timing Runner: Conv_3 (CudaDepthwiseConvolution)
[06/24/2021-10:58:32] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/24/2021-10:58:32] [V] [TRT] --------------- Timing Runner: Conv_3 (FusedConvActConvolution)
[06/24/2021-10:58:32] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/24/2021-10:58:32] [V] [TRT] --------------- Timing Runner: Conv_3 (CudnnConvolution)
[06/24/2021-10:58:32] [V] [TRT] Tactic: 0 Time: 4.25663
[06/24/2021-10:58:32] [V] [TRT] Tactic: 1 Time: 3.02123
[06/24/2021-10:58:32] [V] [TRT] Tactic: 2 skipped. Scratch requested: 530841600, available: 16777216
[06/24/2021-10:58:32] [V] [TRT] Tactic: 5 skipped. Scratch requested: 37322752, available: 16777216
[06/24/2021-10:58:32] [V] [TRT] Tactic: 56 Time: 4.65454
[06/24/2021-10:58:32] [V] [TRT] Tactic: 57 Time: 2.99322
[06/24/2021-10:58:32] [V] [TRT] Tactic: 58 skipped. Scratch requested: 530841600, available: 16777216
[06/24/2021-10:58:32] [V] [TRT] Tactic: 61 skipped. Scratch requested: 37322752, available: 16777216
[06/24/2021-10:58:32] [V] [TRT] Fastest Tactic: 57 Time: 2.99322
[06/24/2021-10:58:32] [V] [TRT] --------------- Timing Runner: Conv_3 (CaskConvolution)
[06/24/2021-10:58:32] [V] [TRT] Conv_3 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 1825138533642645384
[06/24/2021-10:58:32] [V] [TRT] Tactic: 1825138533642645384 Time: 2.55867
[06/24/2021-10:58:32] [V] [TRT] Conv_3 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 2842488832350522458
[06/24/2021-10:58:32] [V] [TRT] Tactic: 2842488832350522458 Time: 2.68872
[06/24/2021-10:58:32] [V] [TRT] Conv_3 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 3915320020053085238
[06/24/2021-10:58:32] [V] [TRT] Tactic: 3915320020053085238 Time: 2.69803
[06/24/2021-10:58:32] [V] [TRT] Conv_3 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6448355332020552203
[06/24/2021-10:58:32] [V] [TRT] Tactic: 6448355332020552203 Time: 2.75262
[06/24/2021-10:58:32] [V] [TRT] Conv_3 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 6808617066150061604
[06/24/2021-10:58:32] [V] [TRT] Tactic: 6808617066150061604 Time: 2.75494
[06/24/2021-10:58:32] [V] [TRT] Conv_3 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: -8060443123034038864
[06/24/2021-10:58:33] [V] [TRT] Tactic: -8060443123034038864 Time: 2.87429
[06/24/2021-10:58:33] [V] [TRT] Conv_3 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: -4420849921117327522
[06/24/2021-10:58:33] [V] [TRT] Tactic: -4420849921117327522 Time: 3.86511
[06/24/2021-10:58:33] [V] [TRT] Conv_3 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: -3946921629105938337
[06/24/2021-10:58:33] [V] [TRT] Tactic: -3946921629105938337 Time: 3.40632
[06/24/2021-10:58:33] [V] [TRT] Fastest Tactic: 1825138533642645384 Time: 2.55867
[06/24/2021-10:58:33] [V] [TRT] Setting workspace to 37322752enables more tactics for profiling
[06/24/2021-10:58:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1825138533642645384
[06/24/2021-10:58:33] [V] [TRT] *************** Autotuning format combination: Float(58982400,1,81920,64) -> Float(29491200,1,81920,128) ***************
[06/24/2021-10:58:33] [V] [TRT] --------------- Timing Runner: Conv_3 (CudnnConvolution)
[06/24/2021-10:58:33] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[06/24/2021-10:58:33] [V] [TRT] --------------- Timing Runner: Conv_3 (CaskConvolution)
[06/24/2021-10:58:33] [V] [TRT] Conv_3 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 861694390046228376
[06/24/2021-10:58:33] [V] [TRT] Tactic: 861694390046228376 Time: 2.80079
[06/24/2021-10:58:33] [V] [TRT] Conv_3 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 1017870653102653567
[06/24/2021-10:58:33] [V] [TRT] Tactic: 1017870653102653567 Time: 2.73595
[06/24/2021-10:58:33] [V] [TRT] Conv_3 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 5258189349241541167
[06/24/2021-10:58:33] [V] [TRT] Tactic: 5258189349241541167 Time: 2.78705
[06/24/2021-10:58:33] [V] [TRT] Conv_3 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5821621277990374316
[06/24/2021-10:58:33] [V] [TRT] Tactic: 5821621277990374316 Time: 2.78137
[06/24/2021-10:58:33] [V] [TRT] Conv_3 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 5863767799113001648
[06/24/2021-10:58:33] [V] [TRT] Tactic: 5863767799113001648 Time: 3.38804
[06/24/2021-10:58:33] [V] [TRT] Conv_3 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -9147980667639709536
[06/24/2021-10:58:33] [V] [TRT] Tactic: -9147980667639709536 Time: 2.6662
[06/24/2021-10:58:33] [V] [TRT] Conv_3 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -8850904373104590857
[06/24/2021-10:58:33] [V] [TRT] Tactic: -8850904373104590857 Time: 2.75302
[06/24/2021-10:58:33] [V] [TRT] Conv_3 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7751035352149795660
[06/24/2021-10:58:33] [V] [TRT] Tactic: -7751035352149795660 Time: 2.71064
[06/24/2021-10:58:33] [V] [TRT] Conv_3 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3853827649136781465
[06/24/2021-10:58:33] [V] [TRT] Tactic: -3853827649136781465 Time: 2.7504
[06/24/2021-10:58:33] [V] [TRT] Conv_3 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -3263369460438823196
[06/24/2021-10:58:33] [V] [TRT] Tactic: -3263369460438823196 Time: 2.7634
[06/24/2021-10:58:33] [V] [TRT] Conv_3 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -423878181466897819
[06/24/2021-10:58:33] [V] [TRT] Tactic: -423878181466897819 Time: 3.32676
[06/24/2021-10:58:33] [V] [TRT] Fastest Tactic: -9147980667639709536 Time: 2.6662
[06/24/2021-10:58:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9147980667639709536
[06/24/2021-10:58:33] [V] [TRT] --------------- Timing Runner: reformat: Float(29491200,230400,640,1) -> Float(29491200,1,81920,128) (Reformat)
[06/24/2021-10:58:33] [V] [TRT] Tactic: 1002 Time: 0.4616
[06/24/2021-10:58:33] [V] [TRT] Tactic: 0 Time: 1.67388
[06/24/2021-10:58:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.4616
[06/24/2021-10:58:33] [V] [TRT] --------------- Timing Runner: reformat: Float(29491200,1,81920,128) -> Float(29491200,230400,640,1) (Reformat)
[06/24/2021-10:58:33] [V] [TRT] Tactic: 1002 Time: 0.45332
[06/24/2021-10:58:33] [V] [TRT] Tactic: 0 Time: 4.09706
[06/24/2021-10:58:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.45332
[06/24/2021-10:58:33] [V] [TRT] *************** Autotuning format combination: Float(29491200,230400,640,1) -> Float(11059200,57600,320,1) ***************
[06/24/2021-10:58:33] [V] [TRT] --------------- Timing Runner: Conv_4 (CudaDepthwiseConvolution)
[06/24/2021-10:58:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/24/2021-10:58:33] [V] [TRT] --------------- Timing Runner: Conv_4 (FusedConvActConvolution)
[06/24/2021-10:58:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/24/2021-10:58:33] [V] [TRT] --------------- Timing Runner: Conv_4 (CudnnConvolution)
[06/24/2021-10:58:33] [V] [TRT] Tactic: 0 Time: 3.8218
[06/24/2021-10:58:33] [V] [TRT] Tactic: 1 Time: 2.19002
[06/24/2021-10:58:33] [V] [TRT] Tactic: 2 skipped. Scratch requested: 265420800, available: 16777216
[06/24/2021-10:58:33] [V] [TRT] Tactic: 5 skipped. Scratch requested: 109740032, available: 16777216
[06/24/2021-10:58:34] [V] [TRT] Tactic: 56 Time: 4.19458
[06/24/2021-10:58:34] [V] [TRT] Tactic: 57 Time: 2.18371
[06/24/2021-10:58:34] [V] [TRT] Tactic: 58 skipped. Scratch requested: 265420800, available: 16777216
[06/24/2021-10:58:34] [V] [TRT] Tactic: 61 skipped. Scratch requested: 109740032, available: 16777216
[06/24/2021-10:58:34] [V] [TRT] Fastest Tactic: 57 Time: 2.18371
[06/24/2021-10:58:34] [V] [TRT] --------------- Timing Runner: Conv_4 (CaskConvolution)
[06/24/2021-10:58:34] [V] [TRT] Conv_4 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 1825138533642645384
[06/24/2021-10:58:34] [V] [TRT] Tactic: 1825138533642645384 Time: 2.61362
[06/24/2021-10:58:34] [V] [TRT] Conv_4 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 2842488832350522458
[06/24/2021-10:58:34] [V] [TRT] Tactic: 2842488832350522458 Time: 1.9294
[06/24/2021-10:58:34] [V] [TRT] Conv_4 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 3915320020053085238
[06/24/2021-10:58:34] [V] [TRT] Tactic: 3915320020053085238 Time: 2.6485
[06/24/2021-10:58:34] [V] [TRT] Conv_4 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6448355332020552203
[06/24/2021-10:58:34] [V] [TRT] Tactic: 6448355332020552203 Time: 2.63859
[06/24/2021-10:58:34] [V] [TRT] Conv_4 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 6808617066150061604
[06/24/2021-10:58:34] [V] [TRT] Tactic: 6808617066150061604 Time: 1.99256
[06/24/2021-10:58:34] [V] [TRT] Conv_4 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: -8060443123034038864
[06/24/2021-10:58:34] [V] [TRT] Tactic: -8060443123034038864 Time: 2.13214
[06/24/2021-10:58:34] [V] [TRT] Conv_4 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: -4420849921117327522
[06/24/2021-10:58:34] [V] [TRT] Tactic: -4420849921117327522 Time: 2.83384
[06/24/2021-10:58:34] [V] [TRT] Conv_4 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: -3946921629105938337
[06/24/2021-10:58:34] [V] [TRT] Tactic: -3946921629105938337 Time: 2.51688
[06/24/2021-10:58:34] [V] [TRT] Fastest Tactic: 2842488832350522458 Time: 1.9294
[06/24/2021-10:58:34] [V] [TRT] Setting workspace to 109740032enables more tactics for profiling
[06/24/2021-10:58:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2842488832350522458
[06/24/2021-10:58:34] [V] [TRT] *************** Autotuning format combination: Float(29491200,1,81920,128) -> Float(11059200,1,61440,192) ***************
[06/24/2021-10:58:34] [V] [TRT] --------------- Timing Runner: Conv_4 (CudnnConvolution)
[06/24/2021-10:58:34] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[06/24/2021-10:58:34] [V] [TRT] --------------- Timing Runner: Conv_4 (CaskConvolution)
[06/24/2021-10:58:34] [V] [TRT] Conv_4 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 861694390046228376
[06/24/2021-10:58:34] [V] [TRT] Tactic: 861694390046228376 Time: 2.64406
[06/24/2021-10:58:34] [V] [TRT] Conv_4 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 1017870653102653567
[06/24/2021-10:58:34] [V] [TRT] Tactic: 1017870653102653567 Time: 2.57769
[06/24/2021-10:58:34] [V] [TRT] Conv_4 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 5258189349241541167
[06/24/2021-10:58:34] [V] [TRT] Tactic: 5258189349241541167 Time: 1.94416
[06/24/2021-10:58:34] [V] [TRT] Conv_4 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5821621277990374316
[06/24/2021-10:58:34] [V] [TRT] Tactic: 5821621277990374316 Time: 2.62795
[06/24/2021-10:58:34] [V] [TRT] Conv_4 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 5863767799113001648
[06/24/2021-10:58:34] [V] [TRT] Tactic: 5863767799113001648 Time: 2.24792
[06/24/2021-10:58:34] [V] [TRT] Conv_4 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -9147980667639709536
[06/24/2021-10:58:34] [V] [TRT] Tactic: -9147980667639709536 Time: 2.58987
[06/24/2021-10:58:34] [V] [TRT] Conv_4 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -8850904373104590857
[06/24/2021-10:58:34] [V] [TRT] Tactic: -8850904373104590857 Time: 1.95421
[06/24/2021-10:58:34] [V] [TRT] Conv_4 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7751035352149795660
[06/24/2021-10:58:34] [V] [TRT] Tactic: -7751035352149795660 Time: 2.6224
[06/24/2021-10:58:34] [V] [TRT] Conv_4 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3853827649136781465
[06/24/2021-10:58:34] [V] [TRT] Tactic: -3853827649136781465 Time: 2.60067
[06/24/2021-10:58:34] [V] [TRT] Conv_4 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -3263369460438823196
[06/24/2021-10:58:34] [V] [TRT] Tactic: -3263369460438823196 Time: 1.93858
[06/24/2021-10:58:34] [V] [TRT] Conv_4 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -423878181466897819
[06/24/2021-10:58:34] [V] [TRT] Tactic: -423878181466897819 Time: 2.31536
[06/24/2021-10:58:34] [V] [TRT] Fastest Tactic: -3263369460438823196 Time: 1.93858
[06/24/2021-10:58:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3263369460438823196
[06/24/2021-10:58:34] [V] [TRT] --------------- Timing Runner: reformat: Float(11059200,57600,320,1) -> Float(11059200,1,61440,192) (Reformat)
[06/24/2021-10:58:34] [V] [TRT] Tactic: 1002 Time: 0.179052
[06/24/2021-10:58:34] [V] [TRT] Tactic: 0 Time: 0.306424
[06/24/2021-10:58:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.179052
[06/24/2021-10:58:34] [V] [TRT] --------------- Timing Runner: reformat: Float(11059200,1,61440,192) -> Float(11059200,57600,320,1) (Reformat)
[06/24/2021-10:58:34] [V] [TRT] Tactic: 1002 Time: 0.189484
[06/24/2021-10:58:34] [V] [TRT] Tactic: 0 Time: 1.74448
[06/24/2021-10:58:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.189484
[06/24/2021-10:58:34] [V] [TRT] --------------- Timing Runner: reformat: Float(11059200,57600,320,1) -> Float(11059200,1,61440,192) (Reformat)
[06/24/2021-10:58:34] [V] [TRT] Tactic: 1002 Time: 0.18014
[06/24/2021-10:58:34] [V] [TRT] Tactic: 0 Time: 0.279076
[06/24/2021-10:58:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.18014
[06/24/2021-10:58:34] [V] [TRT] --------------- Timing Runner: reformat: Float(11059200,1,61440,192) -> Float(11059200,57600,320,1) (Reformat)
[06/24/2021-10:58:34] [V] [TRT] Tactic: 1002 Time: 0.177892
[06/24/2021-10:58:34] [V] [TRT] Tactic: 0 Time: 1.74292
[06/24/2021-10:58:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.177892
[06/24/2021-10:58:34] [V] [TRT] *************** Autotuning format combination: Float(11059200,57600,320,1) -> Float(11059200,57600,320,1) ***************
[06/24/2021-10:58:34] [V] [TRT] --------------- Timing Runner: Conv_5 + Relu_6 (CudaDepthwiseConvolution)
[06/24/2021-10:58:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/24/2021-10:58:34] [V] [TRT] --------------- Timing Runner: Conv_5 + Relu_6 (FusedConvActConvolution)
[06/24/2021-10:58:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/24/2021-10:58:34] [V] [TRT] --------------- Timing Runner: Conv_5 + Relu_6 (CudnnConvolution)
[06/24/2021-10:58:35] [V] [TRT] Tactic: 0 Time: 5.73416
[06/24/2021-10:58:35] [V] [TRT] Tactic: 1 Time: 3.1137
[06/24/2021-10:58:35] [V] [TRT] Tactic: 2 skipped. Scratch requested: 398131200, available: 16777216
[06/24/2021-10:58:35] [V] [TRT] Tactic: 5 skipped. Scratch requested: 163774464, available: 16777216
[06/24/2021-10:58:35] [V] [TRT] Tactic: 6 Time: 2.30917
[06/24/2021-10:58:35] [V] [TRT] Tactic: 56 Time: 6.09
[06/24/2021-10:58:35] [V] [TRT] Tactic: 57 Time: 3.0908
[06/24/2021-10:58:35] [V] [TRT] Tactic: 58 skipped. Scratch requested: 398131200, available: 16777216
[06/24/2021-10:58:35] [V] [TRT] Tactic: 61 skipped. Scratch requested: 163774464, available: 16777216
[06/24/2021-10:58:35] [V] [TRT] Tactic: 62 Time: 2.33139
[06/24/2021-10:58:35] [V] [TRT] Fastest Tactic: 6 Time: 2.30917
[06/24/2021-10:58:35] [V] [TRT] --------------- Timing Runner: Conv_5 + Relu_6 (CaskConvolution)
[06/24/2021-10:58:35] [V] [TRT] Conv_5 + Relu_6 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 1825138533642645384
[06/24/2021-10:58:35] [V] [TRT] Tactic: 1825138533642645384 Time: 3.70637
[06/24/2021-10:58:35] [V] [TRT] Conv_5 + Relu_6 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 2775507031594384867
[06/24/2021-10:58:35] [V] [TRT] Tactic: 2775507031594384867 Time: 1.88484
[06/24/2021-10:58:35] [V] [TRT] Conv_5 + Relu_6 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 2842488832350522458
[06/24/2021-10:58:35] [V] [TRT] Tactic: 2842488832350522458 Time: 2.73002
[06/24/2021-10:58:35] [V] [TRT] Conv_5 + Relu_6 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 3915320020053085238
[06/24/2021-10:58:35] [V] [TRT] Tactic: 3915320020053085238 Time: 3.85679
[06/24/2021-10:58:35] [V] [TRT] Conv_5 + Relu_6 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6448355332020552203
[06/24/2021-10:58:35] [V] [TRT] Tactic: 6448355332020552203 Time: 3.84039
[06/24/2021-10:58:35] [V] [TRT] Conv_5 + Relu_6 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 6808617066150061604
[06/24/2021-10:58:35] [V] [TRT] Tactic: 6808617066150061604 Time: 2.81942
[06/24/2021-10:58:35] [V] [TRT] Conv_5 + Relu_6 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: -8060443123034038864
[06/24/2021-10:58:35] [V] [TRT] Tactic: -8060443123034038864 Time: 3.0941
[06/24/2021-10:58:35] [V] [TRT] Conv_5 + Relu_6 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: -4420849921117327522
[06/24/2021-10:58:35] [V] [TRT] Tactic: -4420849921117327522 Time: 3.88136
[06/24/2021-10:58:35] [V] [TRT] Conv_5 + Relu_6 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: -3946921629105938337
[06/24/2021-10:58:35] [V] [TRT] Tactic: -3946921629105938337 Time: 3.46636
[06/24/2021-10:58:35] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 1.88484
[06/24/2021-10:58:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867
[06/24/2021-10:58:35] [V] [TRT] *************** Autotuning format combination: Float(11059200,1,61440,192) -> Float(11059200,1,61440,192) ***************
[06/24/2021-10:58:35] [V] [TRT] --------------- Timing Runner: Conv_5 + Relu_6 (CudnnConvolution)
[06/24/2021-10:58:35] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[06/24/2021-10:58:35] [V] [TRT] --------------- Timing Runner: Conv_5 + Relu_6 (CaskConvolution)
[06/24/2021-10:58:35] [V] [TRT] Conv_5 + Relu_6 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 861694390046228376
[06/24/2021-10:58:35] [V] [TRT] Tactic: 861694390046228376 Time: 3.78136
[06/24/2021-10:58:35] [V] [TRT] Conv_5 + Relu_6 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 1017870653102653567
[06/24/2021-10:58:36] [V] [TRT] Tactic: 1017870653102653567 Time: 3.7606
[06/24/2021-10:58:36] [V] [TRT] Conv_5 + Relu_6 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 5258189349241541167
[06/24/2021-10:58:36] [V] [TRT] Tactic: 5258189349241541167 Time: 2.88383
[06/24/2021-10:58:36] [V] [TRT] Conv_5 + Relu_6 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5821621277990374316
[06/24/2021-10:58:36] [V] [TRT] Tactic: 5821621277990374316 Time: 3.8369
[06/24/2021-10:58:36] [V] [TRT] Conv_5 + Relu_6 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 5863767799113001648
[06/24/2021-10:58:36] [V] [TRT] Tactic: 5863767799113001648 Time: 3.2579
[06/24/2021-10:58:36] [V] [TRT] Conv_5 + Relu_6 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -9147980667639709536
[06/24/2021-10:58:36] [V] [TRT] Tactic: -9147980667639709536 Time: 3.75568
[06/24/2021-10:58:36] [V] [TRT] Conv_5 + Relu_6 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -8850904373104590857
[06/24/2021-10:58:36] [V] [TRT] Tactic: -8850904373104590857 Time: 2.89778
[06/24/2021-10:58:36] [V] [TRT] Conv_5 + Relu_6 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7751035352149795660
[06/24/2021-10:58:36] [V] [TRT] Tactic: -7751035352149795660 Time: 3.77583
[06/24/2021-10:58:36] [V] [TRT] Conv_5 + Relu_6 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3853827649136781465
[06/24/2021-10:58:36] [V] [TRT] Tactic: -3853827649136781465 Time: 3.79596
[06/24/2021-10:58:36] [V] [TRT] Conv_5 + Relu_6 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -3263369460438823196
[06/24/2021-10:58:36] [V] [TRT] Tactic: -3263369460438823196 Time: 2.85704
[06/24/2021-10:58:36] [V] [TRT] Conv_5 + Relu_6 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -423878181466897819
[06/24/2021-10:58:36] [V] [TRT] Tactic: -423878181466897819 Time: 3.32848
[06/24/2021-10:58:36] [V] [TRT] Fastest Tactic: -3263369460438823196 Time: 2.85704
[06/24/2021-10:58:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3263369460438823196
[06/24/2021-10:58:36] [V] [TRT] *************** Autotuning format combination: Float(11059200,57600,320,1), Float(11059200,57600,320,1) -> Float(11059200,57600,320,1) ***************
[06/24/2021-10:58:36] [V] [TRT] --------------- Timing Runner: Conv_7 + Add_8 (CudaDepthwiseConvolution)
[06/24/2021-10:58:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/24/2021-10:58:36] [V] [TRT] --------------- Timing Runner: Conv_7 + Add_8 (FusedConvActConvolution)
[06/24/2021-10:58:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/24/2021-10:58:36] [V] [TRT] --------------- Timing Runner: Conv_7 + Add_8 (CudnnConvolution)
[06/24/2021-10:58:36] [V] [TRT] Tactic: 0 Time: 6.21841
[06/24/2021-10:58:36] [V] [TRT] Tactic: 1 Time: 3.19799
[06/24/2021-10:58:36] [V] [TRT] Tactic: 2 skipped. Scratch requested: 398131200, available: 16777216
[06/24/2021-10:58:36] [V] [TRT] Tactic: 5 skipped. Scratch requested: 163774464, available: 16777216
[06/24/2021-10:58:36] [V] [TRT] Tactic: 6 Time: 2.38094
[06/24/2021-10:58:36] [V] [TRT] Tactic: 56 Time: 6.18947
[06/24/2021-10:58:36] [V] [TRT] Tactic: 57 Time: 3.16672
[06/24/2021-10:58:36] [V] [TRT] Tactic: 58 skipped. Scratch requested: 398131200, available: 16777216
[06/24/2021-10:58:36] [V] [TRT] Tactic: 61 skipped. Scratch requested: 163774464, available: 16777216
[06/24/2021-10:58:36] [V] [TRT] Tactic: 62 Time: 2.37419
[06/24/2021-10:58:36] [V] [TRT] Fastest Tactic: 62 Time: 2.37419
[06/24/2021-10:58:36] [V] [TRT] --------------- Timing Runner: Conv_7 + Add_8 (CaskConvolution)
[06/24/2021-10:58:36] [V] [TRT] Conv_7 + Add_8 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 1825138533642645384
[06/24/2021-10:58:37] [V] [TRT] Tactic: 1825138533642645384 Time: 3.74593
[06/24/2021-10:58:37] [V] [TRT] Conv_7 + Add_8 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 2775507031594384867
[06/24/2021-10:58:37] [V] [TRT] Tactic: 2775507031594384867 Time: 1.95604
[06/24/2021-10:58:37] [V] [TRT] Conv_7 + Add_8 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 2842488832350522458
[06/24/2021-10:58:37] [V] [TRT] Tactic: 2842488832350522458 Time: 2.77251
[06/24/2021-10:58:37] [V] [TRT] Conv_7 + Add_8 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 3915320020053085238
[06/24/2021-10:58:37] [V] [TRT] Tactic: 3915320020053085238 Time: 3.89247
[06/24/2021-10:58:37] [V] [TRT] Conv_7 + Add_8 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6448355332020552203
[06/24/2021-10:58:37] [V] [TRT] Tactic: 6448355332020552203 Time: 3.89797
[06/24/2021-10:58:37] [V] [TRT] Conv_7 + Add_8 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 6808617066150061604
[06/24/2021-10:58:37] [V] [TRT] Tactic: 6808617066150061604 Time: 2.87347
[06/24/2021-10:58:37] [V] [TRT] Conv_7 + Add_8 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: -8060443123034038864
[06/24/2021-10:58:37] [V] [TRT] Tactic: -8060443123034038864 Time: 3.10954
[06/24/2021-10:58:37] [V] [TRT] Conv_7 + Add_8 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: -4420849921117327522
[06/24/2021-10:58:37] [V] [TRT] Tactic: -4420849921117327522 Time: 3.90771
[06/24/2021-10:58:37] [V] [TRT] Conv_7 + Add_8 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: -3946921629105938337
[06/24/2021-10:58:37] [V] [TRT] Tactic: -3946921629105938337 Time: 3.47171
[06/24/2021-10:58:37] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 1.95604
[06/24/2021-10:58:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867
[06/24/2021-10:58:37] [V] [TRT] *************** Autotuning format combination: Float(11059200,1,61440,192), Float(11059200,1,61440,192) -> Float(11059200,1,61440,192) ***************
[06/24/2021-10:58:37] [V] [TRT] --------------- Timing Runner: Conv_7 + Add_8 (CudnnConvolution)
[06/24/2021-10:58:37] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[06/24/2021-10:58:37] [V] [TRT] --------------- Timing Runner: Conv_7 + Add_8 (CaskConvolution)
[06/24/2021-10:58:37] [V] [TRT] Conv_7 + Add_8 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 861694390046228376
[06/24/2021-10:58:37] [V] [TRT] Tactic: 861694390046228376 Time: 3.90727
[06/24/2021-10:58:37] [V] [TRT] Conv_7 + Add_8 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 1017870653102653567
[06/24/2021-10:58:37] [V] [TRT] Tactic: 1017870653102653567 Time: 3.77226
[06/24/2021-10:58:37] [V] [TRT] Conv_7 + Add_8 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 5258189349241541167
[06/24/2021-10:58:37] [V] [TRT] Tactic: 5258189349241541167 Time: 2.91002
[06/24/2021-10:58:37] [V] [TRT] Conv_7 + Add_8 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5821621277990374316
[06/24/2021-10:58:37] [V] [TRT] Tactic: 5821621277990374316 Time: 3.86698
[06/24/2021-10:58:37] [V] [TRT] Conv_7 + Add_8 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 5863767799113001648
[06/24/2021-10:58:37] [V] [TRT] Tactic: 5863767799113001648 Time: 3.38348
[06/24/2021-10:58:37] [V] [TRT] Conv_7 + Add_8 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -9147980667639709536
[06/24/2021-10:58:37] [V] [TRT] Tactic: -9147980667639709536 Time: 3.76846
[06/24/2021-10:58:37] [V] [TRT] Conv_7 + Add_8 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -8850904373104590857
[06/24/2021-10:58:37] [V] [TRT] Tactic: -8850904373104590857 Time: 2.9223
[06/24/2021-10:58:37] [V] [TRT] Conv_7 + Add_8 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7751035352149795660
[06/24/2021-10:58:37] [V] [TRT] Tactic: -7751035352149795660 Time: 3.82186
[06/24/2021-10:58:37] [V] [TRT] Conv_7 + Add_8 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3853827649136781465
[06/24/2021-10:58:38] [V] [TRT] Tactic: -3853827649136781465 Time: 3.79668
[06/24/2021-10:58:38] [V] [TRT] Conv_7 + Add_8 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -3263369460438823196
[06/24/2021-10:58:38] [V] [TRT] Tactic: -3263369460438823196 Time: 2.85202
[06/24/2021-10:58:38] [V] [TRT] Conv_7 + Add_8 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -423878181466897819
[06/24/2021-10:58:38] [V] [TRT] Tactic: -423878181466897819 Time: 3.44077
[06/24/2021-10:58:38] [V] [TRT] Fastest Tactic: -3263369460438823196 Time: 2.85202
[06/24/2021-10:58:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3263369460438823196
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,57600,320,1) -> Float(11059200,57600,320,1) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,1,61440,192) -> Float(11059200,1,61440,192) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,57600,320,1), Float(11059200,57600,320,1) -> Float(11059200,57600,320,1) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,1,61440,192), Float(11059200,1,61440,192) -> Float(11059200,1,61440,192) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,57600,320,1) -> Float(11059200,57600,320,1) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,1,61440,192) -> Float(11059200,1,61440,192) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,57600,320,1), Float(11059200,57600,320,1) -> Float(11059200,57600,320,1) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,1,61440,192), Float(11059200,1,61440,192) -> Float(11059200,1,61440,192) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,57600,320,1) -> Float(11059200,57600,320,1) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,1,61440,192) -> Float(11059200,1,61440,192) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,57600,320,1), Float(11059200,57600,320,1) -> Float(11059200,57600,320,1) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,1,61440,192), Float(11059200,1,61440,192) -> Float(11059200,1,61440,192) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,57600,320,1) -> Float(11059200,57600,320,1) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,1,61440,192) -> Float(11059200,1,61440,192) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,57600,320,1), Float(11059200,57600,320,1) -> Float(11059200,57600,320,1) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,1,61440,192), Float(11059200,1,61440,192) -> Float(11059200,1,61440,192) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,57600,320,1) -> Float(11059200,57600,320,1) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,1,61440,192) -> Float(11059200,1,61440,192) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,57600,320,1), Float(11059200,57600,320,1) -> Float(11059200,57600,320,1) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,1,61440,192), Float(11059200,1,61440,192) -> Float(11059200,1,61440,192) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,57600,320,1) -> Float(11059200,57600,320,1) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,1,61440,192) -> Float(11059200,1,61440,192) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,57600,320,1), Float(11059200,57600,320,1) -> Float(11059200,57600,320,1) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,1,61440,192), Float(11059200,1,61440,192) -> Float(11059200,1,61440,192) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,57600,320,1) -> Float(11059200,57600,320,1) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,1,61440,192) -> Float(11059200,1,61440,192) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,57600,320,1), Float(11059200,57600,320,1) -> Float(11059200,57600,320,1) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,1,61440,192), Float(11059200,1,61440,192) -> Float(11059200,1,61440,192) ***************
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,57600,320,1) -> Float(29491200,230400,640,1) ***************
[06/24/2021-10:58:38] [V] [TRT] --------------- Timing Runner: ConvTranspose_37 (CudnnDeconvolution)
[06/24/2021-10:58:38] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[06/24/2021-10:58:38] [V] [TRT] --------------- Timing Runner: ConvTranspose_37 (GemmDeconvolution)
[06/24/2021-10:58:38] [V] [TRT] Tactic: 0 skipped. Scratch requested: 297477120, available: 16777216
[06/24/2021-10:58:38] [V] [TRT] Fastest Tactic: -3360065831133338131 Time: 3.40282e+38
[06/24/2021-10:58:38] [V] [TRT] --------------- Timing Runner: ConvTranspose_37 (CaskDeconvolution)
[06/24/2021-10:58:38] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[06/24/2021-10:58:38] [V] [TRT] *************** Autotuning format combination: Float(11059200,1,61440,192) -> Float(29491200,1,81920,128) ***************
[06/24/2021-10:58:38] [V] [TRT] --------------- Timing Runner: ConvTranspose_37 (CudnnDeconvolution)
[06/24/2021-10:58:38] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[06/24/2021-10:58:38] [V] [TRT] --------------- Timing Runner: ConvTranspose_37 (GemmDeconvolution)
[06/24/2021-10:58:38] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[06/24/2021-10:58:38] [V] [TRT] --------------- Timing Runner: ConvTranspose_37 (CaskDeconvolution)
[06/24/2021-10:58:38] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[06/24/2021-10:58:38] [V] [TRT] Deleting timing cache: 26 entries, 91 hits
[06/24/2021-10:58:38] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 1630, GPU 1187 (MiB)
[06/24/2021-10:58:38] [E] Error[10]: [optimizer.cpp::computeCosts::1853] Error Code 10: Internal Error (Could not find any implementation for node ConvTranspose_37.)
[06/24/2021-10:58:38] [E] Engine creation failed
[06/24/2021-10:58:38] [E] Engine creation failed
[06/24/2021-10:58:38] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec [TensorRT v8000] # trtexec --onnx=temp.onnx --verbose
Environment
TensorRT Version: 8.0.0.3
GPU Type: NVIDIA RTX 2080ti
Nvidia Driver Version: 465.19.01
CUDA Version: 11.3
CUDNN Version: 8.2.1
Operating System + Version: Ubuntu 20.04.2 LTS
Python Version (if applicable): Python 3.8.8
TensorFlow Version (if applicable):
PyTorch Version (if applicable): 1.8.1
Baremetal or Container (if container which image + tag):
Relevant Files
onnx file: https://drive.google.com/file/d/1xSQyYK4vQtusy2G6YsYMTNi58iia7Uvs/view?usp=sharing
Steps To Reproduce
trtexec --onnx=temp.onnx --saveEngine=temp.trt --verbose