Issues with running UFFSSD on DLA with Jetson Xavier

Robotics & Edge Computing Jetson & Embedded Systems Jetson AGX Xavier
, ,
1

Hey guys,

I am running an application on the Jetson that is running 2 NNs concurrently.
At the moment I am running inference on the GPU and the CPU ( as running both on the GPU is too much and they get too much in the way of each other).
Recently I tried to turn over to the DLA engine on the Jetson. My idea was to try to run both NNs on the DLAs if possible. So I started , since one of the NNs I am using is the UFF based SSD that comes with the NVidia TRT Samples So as a starting point I compiled the Samples for TRT 6.0.1 (I am using Jetpack 4.3) and ran the model with this command:
./trtexec --uff=“sample_ssd_relu6.uff” --uffInput=“Input”,3,300,300 --output=“NMS” --fp16
And all was well.

Then i tried to switch to the DLA engine like so:

./trtexec --uff=“sample_ssd_relu6.uff” --uffInput=“Input”,3,300,300 --output=“NMS” --useDLACore=0 --allowGPUFallback --fp16

and I got this output :

Summary

&&&& RUNNING TensorRT.trtexec # ./trtexec --uff=sample_ssd_relu6.uff --uffInput=Input,3,300,300 --output=NMS --useDLACore=0 --allowGPUFallback --fp16 --workspace=1000
[07/09/2020-20:46:37] [I] === Model Options ===
[07/09/2020-20:46:37] [I] Format: UFF
[07/09/2020-20:46:37] [I] Model: sample_ssd_relu6.uff
[07/09/2020-20:46:37] [I] Uff Inputs Layout: NCHW
[07/09/2020-20:46:37] [I] Input: Input,3,300,300
[07/09/2020-20:46:37] [I] Output: NMS
[07/09/2020-20:46:37] [I] === Build Options ===
[07/09/2020-20:46:37] [I] Max batch: 1
[07/09/2020-20:46:37] [I] Workspace: 1000 MB
[07/09/2020-20:46:37] [I] minTiming: 1
[07/09/2020-20:46:37] [I] avgTiming: 8
[07/09/2020-20:46:37] [I] Precision: FP16
[07/09/2020-20:46:37] [I] Calibration:
[07/09/2020-20:46:37] [I] Safe mode: Disabled
[07/09/2020-20:46:37] [I] Save engine:
[07/09/2020-20:46:37] [I] Load engine:
[07/09/2020-20:46:37] [I] Inputs format: fp32:CHW
[07/09/2020-20:46:37] [I] Outputs format: fp32:CHW
[07/09/2020-20:46:37] [I] Input build shapes: model
[07/09/2020-20:46:37] [I] === System Options ===
[07/09/2020-20:46:37] [I] Device: 0
[07/09/2020-20:46:37] [I] DLACore: 0(With GPU fallback)
[07/09/2020-20:46:37] [I] Plugins:
[07/09/2020-20:46:37] [I] === Inference Options ===
[07/09/2020-20:46:37] [I] Batch: 1
[07/09/2020-20:46:37] [I] Iterations: 10 (200 ms warm up)
[07/09/2020-20:46:37] [I] Duration: 10s
[07/09/2020-20:46:37] [I] Sleep time: 0ms
[07/09/2020-20:46:37] [I] Streams: 1
[07/09/2020-20:46:37] [I] Spin-wait: Disabled
[07/09/2020-20:46:37] [I] Multithreading: Enabled
[07/09/2020-20:46:37] [I] CUDA Graph: Disabled
[07/09/2020-20:46:37] [I] Skip inference: Disabled
[07/09/2020-20:46:37] [I] Input inference shapes: model
[07/09/2020-20:46:37] [I] === Reporting Options ===
[07/09/2020-20:46:37] [I] Verbose: Disabled
[07/09/2020-20:46:37] [I] Averages: 10 inferences
[07/09/2020-20:46:37] [I] Percentile: 99
[07/09/2020-20:46:37] [I] Dump output: Disabled
[07/09/2020-20:46:37] [I] Profile: Disabled
[07/09/2020-20:46:37] [I] Export timing to JSON file:
[07/09/2020-20:46:37] [I] Export profile to JSON file:
[07/09/2020-20:46:37] [I]
[07/09/2020-20:46:38] [I] [TRT] UFFParser: Did not find plugin field entry scoreConverter in the Registered Creator for layer NMS
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Conv2d_1a_7x7/depthwise_weights/read/_95__cf__98 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Conv2d_1a_7x7/pointwise_weights/read/_94__cf__97 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Conv2d_1a_7x7/separable_conv2d_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Conv2d_2b_1x1/weights/read/_89__cf__92 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Conv2d_2c_3x3/weights/read/_84__cf__87 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/weights/read/_125__cf__128 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/weights/read/_120__cf__123 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/weights/read/_115__cf__118 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/weights/read/_110__cf__113 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/weights/read/_105__cf__108 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/weights/read/_100__cf__103 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/weights/read/_79__cf__82 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/weights/read/_155__cf__158 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/weights/read/_150__cf__153 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/weights/read/_145__cf__148 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/weights/read/_140__cf__143 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/weights/read/_135__cf__138 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/weights/read/_130__cf__133 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/weights/read/_74__cf__77 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/weights/read/_180__cf__183 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/weights/read/_175__cf__178 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/weights/read/_170__cf__173 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/weights/read/_165__cf__168 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/weights/read/_160__cf__163 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/weights/read/_210__cf__213 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/weights/read/_205__cf__208 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/weights/read/_200__cf__203 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/weights/read/_195__cf__198 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/weights/read/_190__cf__193 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/weights/read/_185__cf__188 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/weights/read/_69__cf__72 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/weights/read/_240__cf__243 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/weights/read/_235__cf__238 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/weights/read/_230__cf__233 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/weights/read/_225__cf__228 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/weights/read/_220__cf__223 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/weights/read/_215__cf__218 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/weights/read/_64__cf__67 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/BoxEncodingPredictor/weights/read/_401__cf__404 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/BoxEncodingPredictor/biases/read/_400__cf__403 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/strided_slice/stack is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/strided_slice/stack_1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/strided_slice/stack_2 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/stack/1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/stack/2 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/stack/3 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 204) [Shuffle] is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer Squeeze is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/weights/read/_270__cf__273 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/weights/read/_265__cf__268 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/weights/read/_260__cf__263 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/weights/read/_255__cf__258 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/weights/read/_250__cf__253 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/weights/read/_245__cf__248 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/weights/read/_59__cf__62 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/weights/read/_300__cf__303 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/weights/read/_295__cf__298 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/weights/read/_290__cf__293 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/weights/read/_285__cf__288 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/weights/read/_280__cf__283 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/weights/read/_275__cf__278 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/weights/read/_54__cf__57 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/weights/read/_325__cf__328 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/weights/read/_320__cf__323 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/weights/read/_315__cf__318 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/weights/read/_310__cf__313 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/weights/read/_305__cf__308 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:38] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/weights/read/_355__cf__358 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/weights/read/_350__cf__353 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/weights/read/_345__cf__348 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/weights/read/_340__cf__343 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/weights/read/_335__cf__338 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/weights/read/_330__cf__333 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/weights/read/_49__cf__52 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/weights/read/_385__cf__388 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/weights/read/_380__cf__383 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/weights/read/_375__cf__378 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/weights/read/_370__cf__373 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/weights/read/_365__cf__368 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/weights/read/_360__cf__363 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/weights/read/_44__cf__47 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/BoxEncodingPredictor/weights/read/_399__cf__402 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/BoxEncodingPredictor/biases/read/_398__cf__401 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/strided_slice/stack is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/strided_slice/stack_1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/strided_slice/stack_2 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/stack/1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/stack/2 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/stack/3 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 391) [Shuffle] is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer Squeeze_1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_2_1x1_256/weights/read/_39__cf__42 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_2_1x1_256/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_2_3x3_s2_512/weights/read/_34__cf__37 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_2_3x3_s2_512/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/BoxEncodingPredictor/weights/read/_393__cf__396 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/BoxEncodingPredictor/biases/read/_392__cf__395 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/strided_slice/stack is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/strided_slice/stack_1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/strided_slice/stack_2 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/stack/1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/stack/2 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/stack/3 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 413) [Shuffle] is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer Squeeze_2 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_3_1x1_128/weights/read/_29__cf__32 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_3_1x1_128/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_3_3x3_s2_256/weights/read/_24__cf__27 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_3_3x3_s2_256/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/BoxEncodingPredictor/weights/read/_391__cf__394 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/BoxEncodingPredictor/biases/read/_390__cf__393 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/strided_slice/stack is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/strided_slice/stack_1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/strided_slice/stack_2 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/stack/1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/stack/2 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/stack/3 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 435) [Shuffle] is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer Squeeze_3 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_4_1x1_128/weights/read/_19__cf__22 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_4_1x1_128/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_4_3x3_s2_256/weights/read/_14__cf__17 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_4_3x3_s2_256/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/BoxEncodingPredictor/weights/read/_389__cf__392 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/BoxEncodingPredictor/biases/read/_388__cf__391 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/strided_slice/stack is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/strided_slice/stack_1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/strided_slice/stack_2 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/stack/1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/stack/2 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/stack/3 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 457) [Shuffle] is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer Squeeze_4 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_5_1x1_64/weights/read/_9__cf__12 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_5_1x1_64/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_5_3x3_s2_128/weights/read/_4__cf__7 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_5_3x3_s2_128/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/BoxEncodingPredictor/weights/read/_387__cf__390 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/BoxEncodingPredictor/biases/read/_386__cf__389 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/strided_slice/stack is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/strided_slice/stack_1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/strided_slice/stack_2 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/stack/1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/stack/2 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/stack/3 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 479) [Shuffle] is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer Squeeze_5 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer concat_box_loc is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer strided_slice_6/stack is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer strided_slice_6/stack_1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer strided_slice_6/stack_2 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer strided_slice_7/stack is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer strided_slice_7/stack_1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer strided_slice_7/stack_2 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer GridAnchor is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] concat_priorbox: DLA only supports concatenation on the C dimension.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer concat_priorbox is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/ClassPredictor/weights/read/_458__cf__461 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/ClassPredictor/biases/read/_457__cf__460 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/stack_1/1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/stack_1/2 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 496) [Shuffle] is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/Reshape_1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/ClassPredictor/weights is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/ClassPredictor/biases/read/_456__cf__459 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/stack_1/1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/stack_1/2 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 504) [Shuffle] is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/Reshape_1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/ClassPredictor/weights/read/_455__cf__458 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/ClassPredictor/biases/read/_454__cf__457 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/stack_1/1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/stack_1/2 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 512) [Shuffle] is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/Reshape_1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/ClassPredictor/weights/read/_453__cf__456 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/ClassPredictor/biases/read/_452__cf__455 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/stack_1/1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/stack_1/2 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 520) [Shuffle] is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/Reshape_1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/ClassPredictor/weights/read/_451__cf__454 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/ClassPredictor/biases/read/_450__cf__453 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/stack_1/1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/stack_1/2 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 528) [Shuffle] is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/Reshape_1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/ClassPredictor/weights/read/_449__cf__452 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/ClassPredictor/biases/read/_448__cf__451 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/stack_1/1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/stack_1/2 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 536) [Shuffle] is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/Reshape_1 is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer concat_box_conf is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [W] [TRT] Default DLA is enabled but layer NMS is not supported on DLA, falling back to GPU.
[07/09/2020-20:46:39] [I] [TRT]
[07/09/2020-20:46:39] [I] [TRT] --------------- Layers running on DLA:
[07/09/2020-20:46:39] [I] [TRT] {FeatureExtractor/InceptionV2/InceptionV2/Conv2d_1a_7x7/separable_conv2d/depthwise,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_1a_7x7/separable_conv2d,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_1a_7x7/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_1a_7x7/Relu6,FeatureExtractor/InceptionV2/InceptionV2/MaxPool_2a_3x3/MaxPool,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/MaxPool_3a_3x3/MaxPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_2/MaxPool_1a_3x3/MaxPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/concat,BoxPredictor_0/BoxEncodingPredictor/Conv2D,BoxPredictor_0/BoxEncodingPredictor/BiasAdd,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_2/MaxPool_1a_3x3/MaxPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_3/MaxPool_0a_3x3/MaxPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/concat,BoxPredictor_1/BoxEncodingPredictor/Conv2D,BoxPredictor_1/BoxEncodingPredictor/BiasAdd,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_2_1x1_256/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_2_1x1_256/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_2_1x1_256/Relu6,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_2_3x3_s2_512/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_2_3x3_s2_512/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_2_3x3_s2_512/Relu6,BoxPredictor_2/BoxEncodingPredictor/Conv2D,BoxPredictor_2/BoxEncodingPredictor/BiasAdd,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_3_1x1_128/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_3_1x1_128/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_3_1x1_128/Relu6,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_3_3x3_s2_256/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_3_3x3_s2_256/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_3_3x3_s2_256/Relu6,BoxPredictor_3/BoxEncodingPredictor/Conv2D,BoxPredictor_3/BoxEncodingPredictor/BiasAdd,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_4_1x1_128/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_4_1x1_128/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_4_1x1_128/Relu6,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_4_3x3_s2_256/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_4_3x3_s2_256/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_4_3x3_s2_256/Relu6,BoxPredictor_4/BoxEncodingPredictor/Conv2D,BoxPredictor_4/BoxEncodingPredictor/BiasAdd,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_5_1x1_64/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_5_1x1_64/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_5_1x1_64/Relu6,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_5_3x3_s2_128/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_5_3x3_s2_128/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_5_3x3_s2_128/Relu6,BoxPredictor_5/BoxEncodingPredictor/Conv2D,BoxPredictor_5/BoxEncodingPredictor/BiasAdd,BoxPredictor_0/ClassPredictor/Conv2D,BoxPredictor_0/ClassPredictor/BiasAdd,BoxPredictor_1/ClassPredictor/Conv2D,BoxPredictor_1/ClassPredictor/BiasAdd,BoxPredictor_2/ClassPredictor/Conv2D,BoxPredictor_2/ClassPredictor/BiasAdd,BoxPredictor_3/ClassPredictor/Conv2D,BoxPredictor_3/ClassPredictor/BiasAdd,BoxPredictor_4/ClassPredictor/Conv2D,BoxPredictor_4/ClassPredictor/BiasAdd,BoxPredictor_5/ClassPredictor/Conv2D,BoxPredictor_5/ClassPredictor/BiasAdd},
[07/09/2020-20:46:39] [I] [TRT] --------------- Layers running on GPU:
[07/09/2020-20:46:39] [I] [TRT] (Unnamed Layer* 204) [Shuffle] + Squeeze, (Unnamed Layer* 391) [Shuffle] + Squeeze_1, (Unnamed Layer* 413) [Shuffle] + Squeeze_2, (Unnamed Layer* 435) [Shuffle] + Squeeze_3, (Unnamed Layer* 457) [Shuffle] + Squeeze_4, (Unnamed Layer* 479) [Shuffle] + Squeeze_5, concat_box_loc, GridAnchor, GridAnchor copy, GridAnchor_1 copy, GridAnchor_2 copy, GridAnchor_3 copy, GridAnchor_4 copy, GridAnchor_5 copy, (Unnamed Layer* 496) [Shuffle] + BoxPredictor_0/Reshape_1, (Unnamed Layer* 504) [Shuffle] + BoxPredictor_1/Reshape_1, (Unnamed Layer* 512) [Shuffle] + BoxPredictor_2/Reshape_1, (Unnamed Layer* 520) [Shuffle] + BoxPredictor_3/Reshape_1, (Unnamed Layer* 528) [Shuffle] + BoxPredictor_4/Reshape_1, (Unnamed Layer* 536) [Shuffle] + BoxPredictor_5/Reshape_1, concat_box_conf, NMS,
[07/09/2020-20:46:43] [W] [TRT] DLA Node compilation Failed.
[07/09/2020-20:46:43] [E] [TRT] Internal error: could not find any implementation for node {FeatureExtractor/InceptionV2/InceptionV2/Conv2d_1a_7x7/separable_conv2d/depthwise,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_1a_7x7/separable_conv2d,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_1a_7x7/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_1a_7x7/Relu6,FeatureExtractor/InceptionV2/InceptionV2/MaxPool_2a_3x3/MaxPool,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/MaxPool_3a_3x3/MaxPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_2/MaxPool_1a_3x3/MaxPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/concat,BoxPredictor_0/BoxEncodingPredictor/Conv2D,BoxPredictor_0/BoxEncodingPredictor/BiasAdd,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_2/MaxPool_1a_3x3/MaxPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_3/MaxPool_0a_3x3/MaxPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/concat,BoxPredictor_1/BoxEncodingPredictor/Conv2D,BoxPredictor_1/BoxEncodingPredictor/BiasAdd,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_2_1x1_256/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_2_1x1_256/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_2_1x1_256/Relu6,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_2_3x3_s2_512/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_2_3x3_s2_512/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_2_3x3_s2_512/Relu6,BoxPredictor_2/BoxEncodingPredictor/Conv2D,BoxPredictor_2/BoxEncodingPredictor/BiasAdd,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_3_1x1_128/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_3_1x1_128/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_3_1x1_128/Relu6,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_3_3x3_s2_256/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_3_3x3_s2_256/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_3_3x3_s2_256/Relu6,BoxPredictor_3/BoxEncodingPredictor/Conv2D,BoxPredictor_3/BoxEncodingPredictor/BiasAdd,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_4_1x1_128/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_4_1x1_128/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_4_1x1_128/Relu6,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_4_3x3_s2_256/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_4_3x3_s2_256/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_4_3x3_s2_256/Relu6,BoxPredictor_4/BoxEncodingPredictor/Conv2D,BoxPredictor_4/BoxEncodingPredictor/BiasAdd,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_5_1x1_64/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_5_1x1_64/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_5_1x1_64/Relu6,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_5_3x3_s2_128/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_5_3x3_s2_128/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_5_3x3_s2_128/Relu6,BoxPredictor_5/BoxEncodingPredictor/Conv2D,BoxPredictor_5/BoxEncodingPredictor/BiasAdd,BoxPredictor_0/ClassPredictor/Conv2D,BoxPredictor_0/ClassPredictor/BiasAdd,BoxPredictor_1/ClassPredictor/Conv2D,BoxPredictor_1/ClassPredictor/BiasAdd,BoxPredictor_2/ClassPredictor/Conv2D,BoxPredictor_2/ClassPredictor/BiasAdd,BoxPredictor_3/ClassPredictor/Conv2D,BoxPredictor_3/ClassPredictor/BiasAdd,BoxPredictor_4/ClassPredictor/Conv2D,BoxPredictor_4/ClassPredictor/BiasAdd,BoxPredictor_5/ClassPredictor/Conv2D,BoxPredictor_5/ClassPredictor/BiasAdd}, try increasing the workspace size with IBuilder::setMaxWorkspaceSize()
[07/09/2020-20:46:43] [E] [TRT] …/builder/tacticOptimizer.cpp (1461) - OutOfMemory Error in computeCosts: 0
[07/09/2020-20:46:43] [E] Engine could not be created
&&&& FAILED TensorRT.trtexec # ./trtexec --uff=sample_ssd_relu6.uff --uffInput=Input,3,300,300 --output=NMS --useDLACore=0 --allowGPUFallback --fp16 --workspace=1000

So after a warning DLA Node compilation Failed. it tells me
Internal error: could not find any implementation for node
Then gives me a list of all DLA-enabled layers and then it tells me
try increasing the workspace size with IBuilder::setMaxWorkspaceSize()

I tried to increase the workspace size. The example provided here uses 1GB , but I tried all kinds of numbers all the way up to 16GB and I still get the same error.
So I am wondering am I doing something wrong here, or is there an internal bug, preventing me from using the DLA?

I was expecting with this setup that all the 278 DLA enabled layers would actually run on the DLA (which is about half the network) and the rest would fall back to GPU.

1 Like
3

Hi,

Do you have any application running at the same time?
The error is out of memory which indicates that there are not enough GPU memory on your environment.

We try the same command on a 8GB Xavier device and it can work without error.

$ /usr/src/tensorrt/bin/trtexec --uff=./sample_ssd_relu6.uff --uffInput=Input,3,300,300. --output=NMS --fp16 --useDLACore=0 --allowGPUFallback

&&&& RUNNING TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --uff=./sample_ssd_relu6.uff --uffInput=Input,3,300,300. --output=NMS --fp16 --useDLACore=0 --allowGPUFallback
[08/10/2020-12:13:07] [I] === Model Options ===
[08/10/2020-12:13:07] [I] Format: UFF
[08/10/2020-12:13:07] [I] Model: ./sample_ssd_relu6.uff
[08/10/2020-12:13:07] [I] Uff Inputs Layout: NCHW
[08/10/2020-12:13:07] [I] Input: Input,3,300,300
[08/10/2020-12:13:07] [I] Output: NMS
[08/10/2020-12:13:07] [I] === Build Options ===
[08/10/2020-12:13:07] [I] Max batch: 1
[08/10/2020-12:13:07] [I] Workspace: 16 MB
[08/10/2020-12:13:07] [I] minTiming: 1
[08/10/2020-12:13:07] [I] avgTiming: 8
[08/10/2020-12:13:07] [I] Precision: FP32+FP16
[08/10/2020-12:13:07] [I] Calibration: 
[08/10/2020-12:13:07] [I] Safe mode: Disabled
[08/10/2020-12:13:07] [I] Save engine: 
[08/10/2020-12:13:07] [I] Load engine: 
[08/10/2020-12:13:07] [I] Builder Cache: Enabled
[08/10/2020-12:13:07] [I] NVTX verbosity: 0
[08/10/2020-12:13:07] [I] Inputs format: fp32:CHW
[08/10/2020-12:13:07] [I] Outputs format: fp32:CHW
[08/10/2020-12:13:07] [I] Input build shapes: model
[08/10/2020-12:13:07] [I] Input calibration shapes: model
[08/10/2020-12:13:07] [I] === System Options ===
[08/10/2020-12:13:07] [I] Device: 0
[08/10/2020-12:13:07] [I] DLACore: 0(With GPU fallback)
[08/10/2020-12:13:07] [I] Plugins:
[08/10/2020-12:13:07] [I] === Inference Options ===
[08/10/2020-12:13:07] [I] Batch: 1
[08/10/2020-12:13:07] [I] Input inference shapes: model
[08/10/2020-12:13:07] [I] Iterations: 10
[08/10/2020-12:13:07] [I] Duration: 3s (+ 200ms warm up)
[08/10/2020-12:13:07] [I] Sleep time: 0ms
[08/10/2020-12:13:07] [I] Streams: 1
[08/10/2020-12:13:07] [I] ExposeDMA: Disabled
[08/10/2020-12:13:07] [I] Spin-wait: Disabled
[08/10/2020-12:13:07] [I] Multithreading: Disabled
[08/10/2020-12:13:07] [I] CUDA Graph: Disabled
[08/10/2020-12:13:07] [I] Skip inference: Disabled
[08/10/2020-12:13:07] [I] Inputs:
[08/10/2020-12:13:07] [I] === Reporting Options ===
[08/10/2020-12:13:07] [I] Verbose: Disabled
[08/10/2020-12:13:07] [I] Averages: 10 inferences
[08/10/2020-12:13:07] [I] Percentile: 99
[08/10/2020-12:13:07] [I] Dump output: Disabled
[08/10/2020-12:13:07] [I] Profile: Disabled
[08/10/2020-12:13:07] [I] Export timing to JSON file: 
[08/10/2020-12:13:07] [I] Export output to JSON file: 
[08/10/2020-12:13:07] [I] Export profile to JSON file: 
[08/10/2020-12:13:07] [I] 
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Conv2d_1a_7x7/depthwise_weights/read/_95__cf__98 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Conv2d_1a_7x7/pointwise_weights/read/_94__cf__97 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Conv2d_1a_7x7/separable_conv2d_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Conv2d_2b_1x1/weights/read/_89__cf__92 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Conv2d_2c_3x3/weights/read/_84__cf__87 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/weights/read/_125__cf__128 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/weights/read/_120__cf__123 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/weights/read/_115__cf__118 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/weights/read/_110__cf__113 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/weights/read/_105__cf__108 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/weights/read/_100__cf__103 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/weights/read/_79__cf__82 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/weights/read/_155__cf__158 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/weights/read/_150__cf__153 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/weights/read/_145__cf__148 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/weights/read/_140__cf__143 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/weights/read/_135__cf__138 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/weights/read/_130__cf__133 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/weights/read/_74__cf__77 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/weights/read/_180__cf__183 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/weights/read/_175__cf__178 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/weights/read/_170__cf__173 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/weights/read/_165__cf__168 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/weights/read/_160__cf__163 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/weights/read/_210__cf__213 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/weights/read/_205__cf__208 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/weights/read/_200__cf__203 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/weights/read/_195__cf__198 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/weights/read/_190__cf__193 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/weights/read/_185__cf__188 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/weights/read/_69__cf__72 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/weights/read/_240__cf__243 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/weights/read/_235__cf__238 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/weights/read/_230__cf__233 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/weights/read/_225__cf__228 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/weights/read/_220__cf__223 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/weights/read/_215__cf__218 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/weights/read/_64__cf__67 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/BoxEncodingPredictor/weights/read/_401__cf__404 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/BoxEncodingPredictor/biases/read/_400__cf__403 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/strided_slice/stack is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/strided_slice/stack_1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/strided_slice/stack_2 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/stack/1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/stack/2 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/stack/3 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 204) [Shuffle] is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer Squeeze is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/weights/read/_270__cf__273 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/weights/read/_265__cf__268 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/weights/read/_260__cf__263 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/weights/read/_255__cf__258 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/weights/read/_250__cf__253 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/weights/read/_245__cf__248 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/weights/read/_59__cf__62 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/weights/read/_300__cf__303 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/weights/read/_295__cf__298 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/weights/read/_290__cf__293 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/weights/read/_285__cf__288 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/weights/read/_280__cf__283 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/weights/read/_275__cf__278 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/weights/read/_54__cf__57 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/weights/read/_325__cf__328 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/weights/read/_320__cf__323 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/weights/read/_315__cf__318 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/weights/read/_310__cf__313 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/weights/read/_305__cf__308 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/weights/read/_355__cf__358 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/weights/read/_350__cf__353 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/weights/read/_345__cf__348 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/weights/read/_340__cf__343 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/weights/read/_335__cf__338 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/weights/read/_330__cf__333 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/weights/read/_49__cf__52 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/weights/read/_385__cf__388 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/weights/read/_380__cf__383 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/weights/read/_375__cf__378 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/weights/read/_370__cf__373 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/weights/read/_365__cf__368 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/weights/read/_360__cf__363 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/weights/read/_44__cf__47 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/BoxEncodingPredictor/weights/read/_399__cf__402 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/BoxEncodingPredictor/biases/read/_398__cf__401 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/strided_slice/stack is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/strided_slice/stack_1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/strided_slice/stack_2 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/stack/1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/stack/2 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/stack/3 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 391) [Shuffle] is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer Squeeze_1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_2_1x1_256/weights/read/_39__cf__42 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_2_1x1_256/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_2_3x3_s2_512/weights/read/_34__cf__37 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_2_3x3_s2_512/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/BoxEncodingPredictor/weights/read/_393__cf__396 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/BoxEncodingPredictor/biases/read/_392__cf__395 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/strided_slice/stack is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/strided_slice/stack_1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/strided_slice/stack_2 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/stack/1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/stack/2 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/stack/3 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 413) [Shuffle] is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer Squeeze_2 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_3_1x1_128/weights/read/_29__cf__32 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_3_1x1_128/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_3_3x3_s2_256/weights/read/_24__cf__27 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_3_3x3_s2_256/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/BoxEncodingPredictor/weights/read/_391__cf__394 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/BoxEncodingPredictor/biases/read/_390__cf__393 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/strided_slice/stack is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/strided_slice/stack_1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/strided_slice/stack_2 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/stack/1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/stack/2 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/stack/3 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 435) [Shuffle] is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer Squeeze_3 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_4_1x1_128/weights/read/_19__cf__22 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_4_1x1_128/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_4_3x3_s2_256/weights/read/_14__cf__17 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_4_3x3_s2_256/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/BoxEncodingPredictor/weights/read/_389__cf__392 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/BoxEncodingPredictor/biases/read/_388__cf__391 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/strided_slice/stack is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/strided_slice/stack_1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/strided_slice/stack_2 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/stack/1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/stack/2 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/stack/3 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 457) [Shuffle] is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer Squeeze_4 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_5_1x1_64/weights/read/_9__cf__12 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_5_1x1_64/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_5_3x3_s2_128/weights/read/_4__cf__7 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_5_3x3_s2_128/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/BoxEncodingPredictor/weights/read/_387__cf__390 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/BoxEncodingPredictor/biases/read/_386__cf__389 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/strided_slice/stack is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/strided_slice/stack_1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/strided_slice/stack_2 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/stack/1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/stack/2 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/stack/3 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 479) [Shuffle] is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer Squeeze_5 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer concat_box_loc is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer strided_slice_6/stack is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer strided_slice_6/stack_1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer strided_slice_6/stack_2 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer strided_slice_7/stack is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer strided_slice_7/stack_1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer strided_slice_7/stack_2 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer GridAnchor is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] concat_priorbox: DLA only supports concatenation on the C dimension.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer concat_priorbox is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/ClassPredictor/weights/read/_458__cf__461 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/ClassPredictor/biases/read/_457__cf__460 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/stack_1/1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/stack_1/2 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 496) [Shuffle] is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/Reshape_1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/ClassPredictor/weights is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/ClassPredictor/biases/read/_456__cf__459 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/stack_1/1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/stack_1/2 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 504) [Shuffle] is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/Reshape_1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/ClassPredictor/weights/read/_455__cf__458 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/ClassPredictor/biases/read/_454__cf__457 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/stack_1/1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/stack_1/2 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 512) [Shuffle] is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/Reshape_1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/ClassPredictor/weights/read/_453__cf__456 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/ClassPredictor/biases/read/_452__cf__455 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/stack_1/1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/stack_1/2 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 520) [Shuffle] is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/Reshape_1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/ClassPredictor/weights/read/_451__cf__454 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/ClassPredictor/biases/read/_450__cf__453 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/stack_1/1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/stack_1/2 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 528) [Shuffle] is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/Reshape_1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/ClassPredictor/weights/read/_449__cf__452 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/ClassPredictor/biases/read/_448__cf__451 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/stack_1/1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/stack_1/2 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 536) [Shuffle] is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/Reshape_1 is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer concat_box_conf is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:09] [W] [TRT] Default DLA is enabled but layer NMS is not supported on DLA, falling back to GPU.
[08/10/2020-12:13:11] [I] [TRT] 
[08/10/2020-12:13:11] [I] [TRT] --------------- Layers running on DLA: 
[08/10/2020-12:13:11] [I] [TRT] {FeatureExtractor/InceptionV2/InceptionV2/Conv2d_1a_7x7/separable_conv2d/depthwise,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_1a_7x7/separable_conv2d,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_1a_7x7/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_1a_7x7/Relu6,FeatureExtractor/InceptionV2/InceptionV2/MaxPool_2a_3x3/MaxPool,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/MaxPool_3a_3x3/MaxPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_2/MaxPool_1a_3x3/MaxPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/concat,BoxPredictor_0/BoxEncodingPredictor/Conv2D,BoxPredictor_0/BoxEncodingPredictor/BiasAdd,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_2/MaxPool_1a_3x3/MaxPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_3/MaxPool_0a_3x3/MaxPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/concat,BoxPredictor_1/BoxEncodingPredictor/Conv2D,BoxPredictor_1/BoxEncodingPredictor/BiasAdd,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_2_1x1_256/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_2_1x1_256/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_2_1x1_256/Relu6,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_2_3x3_s2_512/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_2_3x3_s2_512/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_2_3x3_s2_512/Relu6,BoxPredictor_2/BoxEncodingPredictor/Conv2D,BoxPredictor_2/BoxEncodingPredictor/BiasAdd,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_3_1x1_128/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_3_1x1_128/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_3_1x1_128/Relu6,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_3_3x3_s2_256/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_3_3x3_s2_256/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_3_3x3_s2_256/Relu6,BoxPredictor_3/BoxEncodingPredictor/Conv2D,BoxPredictor_3/BoxEncodingPredictor/BiasAdd,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_4_1x1_128/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_4_1x1_128/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_4_1x1_128/Relu6,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_4_3x3_s2_256/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_4_3x3_s2_256/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_4_3x3_s2_256/Relu6,BoxPredictor_4/BoxEncodingPredictor/Conv2D,BoxPredictor_4/BoxEncodingPredictor/BiasAdd,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_5_1x1_64/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_5_1x1_64/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_5_1x1_64/Relu6,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_5_3x3_s2_128/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_5_3x3_s2_128/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_5_3x3_s2_128/Relu6,BoxPredictor_5/BoxEncodingPredictor/Conv2D,BoxPredictor_5/BoxEncodingPredictor/BiasAdd,BoxPredictor_0/ClassPredictor/Conv2D,BoxPredictor_0/ClassPredictor/BiasAdd,BoxPredictor_1/ClassPredictor/Conv2D,BoxPredictor_1/ClassPredictor/BiasAdd,BoxPredictor_2/ClassPredictor/Conv2D,BoxPredictor_2/ClassPredictor/BiasAdd,BoxPredictor_3/ClassPredictor/Conv2D,BoxPredictor_3/ClassPredictor/BiasAdd,BoxPredictor_4/ClassPredictor/Conv2D,BoxPredictor_4/ClassPredictor/BiasAdd,BoxPredictor_5/ClassPredictor/Conv2D,BoxPredictor_5/ClassPredictor/BiasAdd}, 
[08/10/2020-12:13:11] [I] [TRT] --------------- Layers running on GPU: 
[08/10/2020-12:13:11] [I] [TRT] GridAnchor, GridAnchor copy, GridAnchor_1 copy, GridAnchor_2 copy, GridAnchor_3 copy, GridAnchor_4 copy, GridAnchor_5 copy, (Unnamed Layer* 204) [Shuffle] + Squeeze, (Unnamed Layer* 391) [Shuffle] + Squeeze_1, (Unnamed Layer* 413) [Shuffle] + Squeeze_2, (Unnamed Layer* 435) [Shuffle] + Squeeze_3, (Unnamed Layer* 457) [Shuffle] + Squeeze_4, (Unnamed Layer* 479) [Shuffle] + Squeeze_5, concat_box_loc, (Unnamed Layer* 496) [Shuffle] + BoxPredictor_0/Reshape_1, (Unnamed Layer* 504) [Shuffle] + BoxPredictor_1/Reshape_1, (Unnamed Layer* 512) [Shuffle] + BoxPredictor_2/Reshape_1, (Unnamed Layer* 520) [Shuffle] + BoxPredictor_3/Reshape_1, (Unnamed Layer* 528) [Shuffle] + BoxPredictor_4/Reshape_1, (Unnamed Layer* 536) [Shuffle] + BoxPredictor_5/Reshape_1, concat_box_conf, NMS, 
[08/10/2020-12:13:12] [W] [TRT] No implementation of layer GridAnchor obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation.
[08/10/2020-12:13:24] [W] [TRT] No implementation of layer concat_box_loc obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation.
[08/10/2020-12:13:27] [W] [TRT] No implementation of layer concat_box_conf obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation.
[08/10/2020-12:13:27] [W] [TRT] No implementation of layer NMS obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation.
[08/10/2020-12:13:27] [I] [TRT] Detected 1 inputs and 2 output network tensors.
[08/10/2020-12:13:34] [I] Starting inference threads
[08/10/2020-12:13:37] [I] Warmup completed 11 queries over 200 ms
[08/10/2020-12:13:37] [I] Timing trace has 168 queries over 3.03315 s
[08/10/2020-12:13:37] [I] Trace averages of 10 runs:
[08/10/2020-12:13:37] [I] Average on 10 runs - GPU latency: 17.9826 ms - Host latency: 18.0347 ms (end to end 18.0482 ms, enqueue 2.86307 ms)
[08/10/2020-12:13:37] [I] Average on 10 runs - GPU latency: 17.9871 ms - Host latency: 18.0398 ms (end to end 18.0526 ms, enqueue 2.6404 ms)
[08/10/2020-12:13:37] [I] Average on 10 runs - GPU latency: 18.0047 ms - Host latency: 18.057 ms (end to end 18.0681 ms, enqueue 2.60429 ms)
[08/10/2020-12:13:37] [I] Average on 10 runs - GPU latency: 17.9983 ms - Host latency: 18.0509 ms (end to end 18.0615 ms, enqueue 2.62774 ms)
[08/10/2020-12:13:37] [I] Average on 10 runs - GPU latency: 17.9867 ms - Host latency: 18.0387 ms (end to end 18.0518 ms, enqueue 2.67863 ms)
[08/10/2020-12:13:37] [I] Average on 10 runs - GPU latency: 17.9942 ms - Host latency: 18.0465 ms (end to end 18.0593 ms, enqueue 2.67223 ms)
[08/10/2020-12:13:37] [I] Average on 10 runs - GPU latency: 17.9936 ms - Host latency: 18.0458 ms (end to end 18.0584 ms, enqueue 2.55098 ms)
[08/10/2020-12:13:37] [I] Average on 10 runs - GPU latency: 17.9964 ms - Host latency: 18.0485 ms (end to end 18.0602 ms, enqueue 2.50374 ms)
[08/10/2020-12:13:37] [I] Average on 10 runs - GPU latency: 17.9829 ms - Host latency: 18.0348 ms (end to end 18.0444 ms, enqueue 2.41749 ms)
[08/10/2020-12:13:37] [I] Average on 10 runs - GPU latency: 17.9892 ms - Host latency: 18.0415 ms (end to end 18.0538 ms, enqueue 2.45913 ms)
[08/10/2020-12:13:37] [I] Average on 10 runs - GPU latency: 17.9924 ms - Host latency: 18.0449 ms (end to end 18.057 ms, enqueue 2.44789 ms)
[08/10/2020-12:13:37] [I] Average on 10 runs - GPU latency: 17.9819 ms - Host latency: 18.0344 ms (end to end 18.0478 ms, enqueue 2.51262 ms)
[08/10/2020-12:13:37] [I] Average on 10 runs - GPU latency: 17.9809 ms - Host latency: 18.0336 ms (end to end 18.0467 ms, enqueue 2.42668 ms)
[08/10/2020-12:13:37] [I] Average on 10 runs - GPU latency: 17.9858 ms - Host latency: 18.0383 ms (end to end 18.051 ms, enqueue 2.29438 ms)
[08/10/2020-12:13:37] [I] Average on 10 runs - GPU latency: 17.9992 ms - Host latency: 18.0515 ms (end to end 18.0637 ms, enqueue 2.33005 ms)
[08/10/2020-12:13:37] [I] Average on 10 runs - GPU latency: 17.9829 ms - Host latency: 18.035 ms (end to end 18.0468 ms, enqueue 2.30034 ms)
[08/10/2020-12:13:37] [I] Host Latency
[08/10/2020-12:13:37] [I] min: 17.9941 ms (end to end 18.0088 ms)
[08/10/2020-12:13:37] [I] max: 18.1143 ms (end to end 18.1292 ms)
[08/10/2020-12:13:37] [I] mean: 18.0423 ms (end to end 18.0544 ms)
[08/10/2020-12:13:37] [I] median: 18.0382 ms (end to end 18.05 ms)
[08/10/2020-12:13:37] [I] percentile: 18.1071 ms at 99% (end to end 18.1149 ms at 99%)
[08/10/2020-12:13:37] [I] throughput: 55.3879 qps
[08/10/2020-12:13:37] [I] walltime: 3.03315 s
[08/10/2020-12:13:37] [I] Enqueue Time
[08/10/2020-12:13:37] [I] min: 2.15747 ms
[08/10/2020-12:13:37] [I] max: 3.47192 ms
[08/10/2020-12:13:37] [I] median: 2.49084 ms
[08/10/2020-12:13:37] [I] GPU Compute
[08/10/2020-12:13:37] [I] min: 17.9426 ms
[08/10/2020-12:13:37] [I] max: 18.0603 ms
[08/10/2020-12:13:37] [I] mean: 17.9899 ms
[08/10/2020-12:13:37] [I] median: 17.9861 ms
[08/10/2020-12:13:37] [I] percentile: 18.0541 ms at 99%
[08/10/2020-12:13:37] [I] total compute time: 3.02231 s
&&&& PASSED TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --uff=./sample_ssd_relu6.uff --uffInput=Input,3,300,300. --output=NMS --fp16 --useDLACore=0 --allowGPUFallback

Thanks.

4

Hi,
I have the same issue with one of our internal networks.
How do you run one of the networks on the CPU?
BTW I currently see that the GPU and DLA interfere with each other as well on my test case.
DLA and GPU running at the same time - performance question

thanks
Eyal

5

Hi AastaLLL,

Thank you for the reply and sorry for coming back so late,
It’s very odd how it works on your end. Even with the default worksize of 16mb.
There is nothing else running on the Jetson when I try it.
What version of Jetpack did you run it on? I am using 4.3

Also could the result I am having somehow be related to the way I generated my uff file? Could you share a link to the uff you were using so I can compare for differences with the one I generated?

Thank you!

6

Meanwhile since I have no idea where else to look, I decided to regenerate my uff file.
Since the one I was using was generated probably an year ago.
So I am using python 3.7.8 to generate the UFF file.

I downloaded the ssd_inception_v2_coco_2017_11_17 frozen inference graph protobuf from the link in the NVidia documentation here
I have CUDA 10 installed (as TF was complaining that it needs cudart64_100.dll)
And I have installed

tensorflow 1.15.0
tensorflow-gpu 1.15.0
uff 0.6.9
graphsurgeon 0.4.5

I am using TensorRT 7.1.3.4 and using the config.py located in samples\sampleUffSSD

When I run

convert-to-uff --input-file “frozen_inference_graph.pb” -O NMS -p “config.py”

This is what I get:

 2020-08-15 17:55:23.222294: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_100.dll
Loading C:\Users\Admin\Desktop\ssd_inception_v2_coco_2017_11_17.tar\ssd_inception_v2_coco_2017_11_17\frozen_inference_graph.pb
WARNING:tensorflow:From d:\code\python\pvenv_37\lib\site-packages\uff\converters\tensorflow\conversion_helpers.py:274: The name tf.gfile.GFile is deprecated. Please use tf.io.gfile.GFile instead.

<class 'graphsurgeon.DynamicGraph.DynamicGraph'>
UFF Version 0.6.9
=== Automatically deduced input nodes ===
[name: "Input"
op: "Placeholder"
attr {
  key: "dtype"
  value {
    type: DT_FLOAT
  }
}
attr {
  key: "shape"
  value {
    shape {
      dim {
        size: 1
      }
      dim {
        size: 3
      }
      dim {
        size: 300
      }
      dim {
        size: 300
      }
    }
  }
}
]
=========================================

Using output node NMS
Converting to UFF graph
Warning: No conversion function registered for layer: NMS_TRT yet.
Converting NMS as custom op: NMS_TRT
WARNING:tensorflow:From d:\code\python\pvenv_37\lib\site-packages\uff\converters\tensorflow\converter.py:226: The name tf.AttrValue is deprecated. Please use tf.compat.v1.AttrValue instead.

Warning: No conversion function registered for layer: FlattenConcat_TRT yet.
Converting concat_box_conf as custom op: FlattenConcat_TRT
Traceback (most recent call last):
  File "C:\Users\Admin\AppData\Local\Programs\Python\Python37\lib\runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "C:\Users\Admin\AppData\Local\Programs\Python\Python37\lib\runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "D:\code\Python\pvenv_37\Scripts\convert-to-uff.exe\__main__.py", line 7, in <module>
  File "d:\code\python\pvenv_37\lib\site-packages\uff\bin\convert_to_uff.py", line 139, in main
    debug_mode=args.debug
  File "d:\code\python\pvenv_37\lib\site-packages\uff\converters\tensorflow\conversion_helpers.py", line 276, in from_tensorflow_frozen_model
    return from_tensorflow(graphdef, output_nodes, preprocessor, **kwargs)
  File "d:\code\python\pvenv_37\lib\site-packages\uff\converters\tensorflow\conversion_helpers.py", line 225, in from_tensorflow
    debug_mode=debug_mode)
  File "d:\code\python\pvenv_37\lib\site-packages\uff\converters\tensorflow\converter.py", line 141, in convert_tf2uff_graph
    uff_graph, input_replacements, debug_mode=debug_mode)
  File "d:\code\python\pvenv_37\lib\site-packages\uff\converters\tensorflow\converter.py", line 126, in convert_tf2uff_node
    op, name, tf_node, inputs, uff_graph, tf_nodes=tf_nodes, debug_mode=debug_mode)
  File "d:\code\python\pvenv_37\lib\site-packages\uff\converters\tensorflow\converter.py", line 94, in convert_layer
    return cls.registry_[op](name, tf_node, inputs, uff_graph, **kwargs)
  File "d:\code\python\pvenv_37\lib\site-packages\uff\converters\tensorflow\converter_functions.py", line 455, in convert_depthwise_conv2d_native
    return _conv2d_helper(name, tf_node, inputs, uff_graph, func="depthwise", **kwargs)
  File "d:\code\python\pvenv_37\lib\site-packages\uff\converters\tensorflow\converter_functions.py", line 480, in _conv2d_helper
    number_groups = int(wt.attr['value'].tensor.tensor_shape.dim[2].size)
IndexError: list index (2) out of range

What am I doing wrong here?

7

@AastaLLL I would appreciate it if you could help me get to the bottom of this.

8

So I did some digging today and I found that the crash is related to a depthwise node in the graph.
The node in particular can be found in
FeatureExtractor/InceptionV2/InceptionV2/Conv2d_1a_7x7/separable_conv2d/depthwise

I tried to modify uff\converters\tensorflow\converter_functions.py so that it doesn’t crash. I just tried using number_groups= 1, 3 or None, what made most sense for me that this node should be setting, but no matter what I set it to I always get this error upon running:
[TRT] UffParser: Parser Error: FeatureExtractor/InceptionV2/InceptionV2/Conv2d_1a_7x7/separable_conv2d/depthwise: Order size is not matching the number dimensions of TRT

9

A bit of light at the end of the tunnel.
So far I have been trying to generate an UFF file on my Windows machine using TRT 7.1.3 (sadly I either got errors or I was able to generate a UFF file that eventually didn’t run)

Then I switched over to the Jetson where I am running JP4.3 with TRT 6.0.1 with CUDA10 and tried the process there
I installed tensorflow 1.15.2 / graphsurgeon 0.6.1 / uff 0.6.5 and lo and behold, the uff file was generated immediately.
This leads me to believe that there is something broken with regard to the latest versions of TRT and the UFF/Graphsurgeon wheels provided with it.

While this is somewhat good news, it still doesn’t fix my problem, as after all this effort I am back to square one, where I have a UFF file that runs fine with CUDA but fails to run on the DLA core with out-of-mem error.

@AastaLLL, or anyone that has managed to generate a UFF file for SSD that an run on the DLA cores, PLEASE, let me know what versions of the tools required did you use to make it all work?

10

Hi,

Sorry for the late reply.

The original issue might be related to some compatibility problem from the package of Windows.
It will be good to use the same uff parser version for generating .uff and .trt.

The following OOM error looks weird to us.
Do you inference the model with trtexec?
Would you mind to share the model you used for us checking?

Thanks.

11

Hi @AastaLLL

Here is a link to my UFF file
https://drive.google.com/file/d/1bmc1gFf7q0HRo-q-iJzBuyDWgPPvu7Ak/view?usp=sharing

When I run
./trtexec --uff=/home/alex/Downloads/ssd_inception_v2_coco_2017_11_17/frozen_inference_graph.uff --uffInput=Input,3,300,300 --output=NMS --fp16

I get &&&& PASSED TensorRT.trtexec

But when I try
./trtexec --uff=/home/alex/Downloads/ssd_inception_v2_coco_2017_11_17/frozen_inference_graph.uff --uffInput=Input,3,300,300 --output=NMS --fp16 --useDLACore=1

I get
[07/29/2020-18:06:59] [E] [TRT] …/builder/tacticOptimizer.cpp (1461) - OutOfMemory Error in computeCosts: 0
[07/29/2020-18:06:59] [E] Engine could not be created
&&&& FAILED TensorRT.trtexec # ./trtexec --uff=/home/alex/Downloads/ssd_inception_v2_coco_2017_11_17/frozen_inference_graph.uff --uffInput=Input,3,300,300 --output=NMS --fp16 --allowGPUFallback --useDLACore=1

Please let me know if you need any additional information
This uff file was generated on the Xavier with the tool provided with TRT and Jetpack 4.3
I can check exact version a little later if you need them, let me know.

Best,
Alex

12

@AastaLLL did you manage to try the uff file I sent? Can you figure what’s the problem from it?

13

Another ping here. This is really a problem i need to understand. Is there another more reliable form of communication that I can use?

14

Hi,

We have confirmed that your model can be run with JetPack4.4 on Xavier without issue.
Please help to check it again.

$ /usr/src/tensorrt/bin/trtexec --uff=frozen_inference_graph_nvidia.uff --uffInput=Input,3,300,300 --output=NMS --fp16 --useDLACore=1 --allowGPUFallback

$ /usr/src/tensorrt/bin/trtexec --uff=frozen_inference_graph_nvidia.uff --uffInput=Input,3,300,300 --output=NMS --fp16 --useDLACore=1 --allowGPUFallback
&&&& RUNNING TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --uff=frozen_inference_graph_nvidia.uff --uffInput=Input,3,300,300 --output=NMS --fp16 --useDLACore=1 --allowGPUFallback
[09/11/2020-14:43:47] [I] === Model Options ===
[09/11/2020-14:43:47] [I] Format: UFF
[09/11/2020-14:43:47] [I] Model: frozen_inference_graph_nvidia.uff
[09/11/2020-14:43:47] [I] Uff Inputs Layout: NCHW
[09/11/2020-14:43:47] [I] Input: Input,3,300,300
[09/11/2020-14:43:47] [I] Output: NMS
[09/11/2020-14:43:47] [I] === Build Options ===
[09/11/2020-14:43:47] [I] Max batch: 1
[09/11/2020-14:43:47] [I] Workspace: 16 MB
[09/11/2020-14:43:47] [I] minTiming: 1
[09/11/2020-14:43:47] [I] avgTiming: 8
[09/11/2020-14:43:47] [I] Precision: FP32+FP16
[09/11/2020-14:43:47] [I] Calibration: 
[09/11/2020-14:43:47] [I] Safe mode: Disabled
[09/11/2020-14:43:47] [I] Save engine: 
[09/11/2020-14:43:47] [I] Load engine: 
[09/11/2020-14:43:47] [I] Builder Cache: Enabled
[09/11/2020-14:43:47] [I] NVTX verbosity: 0
[09/11/2020-14:43:47] [I] Inputs format: fp32:CHW
[09/11/2020-14:43:47] [I] Outputs format: fp32:CHW
[09/11/2020-14:43:47] [I] Input build shapes: model
[09/11/2020-14:43:47] [I] Input calibration shapes: model
[09/11/2020-14:43:47] [I] === System Options ===
[09/11/2020-14:43:47] [I] Device: 0
[09/11/2020-14:43:47] [I] DLACore: 1(With GPU fallback)
[09/11/2020-14:43:47] [I] Plugins:
[09/11/2020-14:43:47] [I] === Inference Options ===
[09/11/2020-14:43:47] [I] Batch: 1
[09/11/2020-14:43:47] [I] Input inference shapes: model
[09/11/2020-14:43:47] [I] Iterations: 10
[09/11/2020-14:43:47] [I] Duration: 3s (+ 200ms warm up)
[09/11/2020-14:43:47] [I] Sleep time: 0ms
[09/11/2020-14:43:47] [I] Streams: 1
[09/11/2020-14:43:47] [I] ExposeDMA: Disabled
[09/11/2020-14:43:47] [I] Spin-wait: Disabled
[09/11/2020-14:43:47] [I] Multithreading: Disabled
[09/11/2020-14:43:47] [I] CUDA Graph: Disabled
[09/11/2020-14:43:47] [I] Skip inference: Disabled
[09/11/2020-14:43:47] [I] Inputs:
[09/11/2020-14:43:47] [I] === Reporting Options ===
[09/11/2020-14:43:47] [I] Verbose: Disabled
[09/11/2020-14:43:47] [I] Averages: 10 inferences
[09/11/2020-14:43:47] [I] Percentile: 99
[09/11/2020-14:43:47] [I] Dump output: Disabled
[09/11/2020-14:43:47] [I] Profile: Disabled
[09/11/2020-14:43:47] [I] Export timing to JSON file: 
[09/11/2020-14:43:47] [I] Export output to JSON file: 
[09/11/2020-14:43:47] [I] Export profile to JSON file: 
[09/11/2020-14:43:47] [I] 
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Conv2d_1a_7x7/depthwise_weights/read/_95__cf__98 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Conv2d_1a_7x7/pointwise_weights/read/_94__cf__97 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Conv2d_1a_7x7/separable_conv2d_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Conv2d_2b_1x1/weights/read/_89__cf__92 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Conv2d_2c_3x3/weights/read/_84__cf__87 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/weights/read/_125__cf__128 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/weights/read/_120__cf__123 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/weights/read/_115__cf__118 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/weights/read/_110__cf__113 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/weights/read/_105__cf__108 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/weights/read/_100__cf__103 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/weights/read/_79__cf__82 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/weights/read/_155__cf__158 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/weights/read/_150__cf__153 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/weights/read/_145__cf__148 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/weights/read/_140__cf__143 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/weights/read/_135__cf__138 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/weights/read/_130__cf__133 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/weights/read/_74__cf__77 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/weights/read/_180__cf__183 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/weights/read/_175__cf__178 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/weights/read/_170__cf__173 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/weights/read/_165__cf__168 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/weights/read/_160__cf__163 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/weights/read/_210__cf__213 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/weights/read/_205__cf__208 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/weights/read/_200__cf__203 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/weights/read/_195__cf__198 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/weights/read/_190__cf__193 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/weights/read/_185__cf__188 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/weights/read/_69__cf__72 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/weights/read/_240__cf__243 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/weights/read/_235__cf__238 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/weights/read/_230__cf__233 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/weights/read/_225__cf__228 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/weights/read/_220__cf__223 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/weights/read/_215__cf__218 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/weights/read/_64__cf__67 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/BoxEncodingPredictor/weights/read/_401__cf__404 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/BoxEncodingPredictor/biases/read/_400__cf__403 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/strided_slice/stack is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/strided_slice/stack_1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/strided_slice/stack_2 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/stack/1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/stack/2 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/stack/3 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 204) [Shuffle] is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer Squeeze is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/weights/read/_270__cf__273 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/weights/read/_265__cf__268 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/weights/read/_260__cf__263 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/weights/read/_255__cf__258 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/weights/read/_250__cf__253 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/weights/read/_245__cf__248 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/weights/read/_59__cf__62 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/weights/read/_300__cf__303 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/weights/read/_295__cf__298 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/weights/read/_290__cf__293 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/weights/read/_285__cf__288 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/weights/read/_280__cf__283 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/weights/read/_275__cf__278 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/weights/read/_54__cf__57 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/weights/read/_325__cf__328 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/weights/read/_320__cf__323 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/weights/read/_315__cf__318 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/weights/read/_310__cf__313 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/weights/read/_305__cf__308 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/weights/read/_355__cf__358 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/weights/read/_350__cf__353 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/weights/read/_345__cf__348 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/weights/read/_340__cf__343 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/weights/read/_335__cf__338 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/weights/read/_330__cf__333 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/weights/read/_49__cf__52 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/weights/read/_385__cf__388 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/weights/read/_380__cf__383 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/weights/read/_375__cf__378 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/weights/read/_370__cf__373 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/weights/read/_365__cf__368 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/weights/read/_360__cf__363 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/weights/read/_44__cf__47 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/BoxEncodingPredictor/weights/read/_399__cf__402 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/BoxEncodingPredictor/biases/read/_398__cf__401 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/strided_slice/stack is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/strided_slice/stack_1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/strided_slice/stack_2 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/stack/1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/stack/2 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/stack/3 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 391) [Shuffle] is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer Squeeze_1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_2_1x1_256/weights/read/_39__cf__42 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_2_1x1_256/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_2_3x3_s2_512/weights/read/_34__cf__37 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_2_3x3_s2_512/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/BoxEncodingPredictor/weights/read/_393__cf__396 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/BoxEncodingPredictor/biases/read/_392__cf__395 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/strided_slice/stack is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/strided_slice/stack_1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/strided_slice/stack_2 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/stack/1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/stack/2 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/stack/3 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 413) [Shuffle] is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer Squeeze_2 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_3_1x1_128/weights/read/_29__cf__32 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_3_1x1_128/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_3_3x3_s2_256/weights/read/_24__cf__27 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_3_3x3_s2_256/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/BoxEncodingPredictor/weights/read/_391__cf__394 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/BoxEncodingPredictor/biases/read/_390__cf__393 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/strided_slice/stack is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/strided_slice/stack_1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/strided_slice/stack_2 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/stack/1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/stack/2 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/stack/3 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 435) [Shuffle] is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer Squeeze_3 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_4_1x1_128/weights/read/_19__cf__22 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_4_1x1_128/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_4_3x3_s2_256/weights/read/_14__cf__17 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_4_3x3_s2_256/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/BoxEncodingPredictor/weights/read/_389__cf__392 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/BoxEncodingPredictor/biases/read/_388__cf__391 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/strided_slice/stack is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/strided_slice/stack_1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/strided_slice/stack_2 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/stack/1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/stack/2 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/stack/3 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 457) [Shuffle] is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer Squeeze_4 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_5_1x1_64/weights/read/_9__cf__12 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_5_1x1_64/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_5_3x3_s2_128/weights/read/_4__cf__7 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_5_3x3_s2_128/Conv2D_bn_offset is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/BoxEncodingPredictor/weights/read/_387__cf__390 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/BoxEncodingPredictor/biases/read/_386__cf__389 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/strided_slice/stack is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/strided_slice/stack_1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/strided_slice/stack_2 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/stack/1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/stack/2 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/stack/3 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 479) [Shuffle] is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer Squeeze_5 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer concat_box_loc is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer strided_slice_6/stack is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer strided_slice_6/stack_1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer strided_slice_6/stack_2 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer strided_slice_7/stack is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer strided_slice_7/stack_1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer strided_slice_7/stack_2 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer GridAnchor is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] concat_priorbox: DLA only supports concatenation on the C dimension.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer concat_priorbox is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/ClassPredictor/weights/read/_458__cf__461 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/ClassPredictor/biases/read/_457__cf__460 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/stack_1/1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/stack_1/2 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 496) [Shuffle] is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_0/Reshape_1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/ClassPredictor/weights is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/ClassPredictor/biases/read/_456__cf__459 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/stack_1/1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/stack_1/2 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 504) [Shuffle] is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_1/Reshape_1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/ClassPredictor/weights/read/_455__cf__458 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/ClassPredictor/biases/read/_454__cf__457 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/stack_1/1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/stack_1/2 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 512) [Shuffle] is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_2/Reshape_1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/ClassPredictor/weights/read/_453__cf__456 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/ClassPredictor/biases/read/_452__cf__455 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/stack_1/1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/stack_1/2 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 520) [Shuffle] is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_3/Reshape_1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/ClassPredictor/weights/read/_451__cf__454 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/ClassPredictor/biases/read/_450__cf__453 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/stack_1/1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/stack_1/2 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 528) [Shuffle] is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_4/Reshape_1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/ClassPredictor/weights/read/_449__cf__452 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/ClassPredictor/biases/read/_448__cf__451 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/stack_1/1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/stack_1/2 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer (Unnamed Layer* 536) [Shuffle] is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer BoxPredictor_5/Reshape_1 is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer concat_box_conf is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:50] [W] [TRT] Default DLA is enabled but layer NMS is not supported on DLA, falling back to GPU.
[09/11/2020-14:43:51] [I] [TRT] 
[09/11/2020-14:43:51] [I] [TRT] --------------- Layers running on DLA: 
[09/11/2020-14:43:51] [I] [TRT] {FeatureExtractor/InceptionV2/InceptionV2/Conv2d_1a_7x7/separable_conv2d/depthwise,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_1a_7x7/separable_conv2d,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_1a_7x7/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_1a_7x7/Relu6,FeatureExtractor/InceptionV2/InceptionV2/MaxPool_2a_3x3/MaxPool,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Conv2d_2c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/MaxPool_3a_3x3/MaxPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3b/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_3c/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/Branch_2/MaxPool_1a_3x3/MaxPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4a/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4b/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4c/concat,BoxPredictor_0/BoxEncodingPredictor/Conv2D,BoxPredictor_0/BoxEncodingPredictor/BiasAdd,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4d/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_4e/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/Branch_2/MaxPool_1a_3x3/MaxPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5a/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_3/AvgPool_0a_3x3/AvgPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5b/concat,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_3/MaxPool_0a_3x3/MaxPool,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/Conv2D,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/Relu6,FeatureExtractor/InceptionV2/InceptionV2/Mixed_5c/concat,BoxPredictor_1/BoxEncodingPredictor/Conv2D,BoxPredictor_1/BoxEncodingPredictor/BiasAdd,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_2_1x1_256/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_2_1x1_256/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_2_1x1_256/Relu6,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_2_3x3_s2_512/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_2_3x3_s2_512/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_2_3x3_s2_512/Relu6,BoxPredictor_2/BoxEncodingPredictor/Conv2D,BoxPredictor_2/BoxEncodingPredictor/BiasAdd,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_3_1x1_128/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_3_1x1_128/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_3_1x1_128/Relu6,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_3_3x3_s2_256/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_3_3x3_s2_256/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_3_3x3_s2_256/Relu6,BoxPredictor_3/BoxEncodingPredictor/Conv2D,BoxPredictor_3/BoxEncodingPredictor/BiasAdd,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_4_1x1_128/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_4_1x1_128/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_4_1x1_128/Relu6,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_4_3x3_s2_256/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_4_3x3_s2_256/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_4_3x3_s2_256/Relu6,BoxPredictor_4/BoxEncodingPredictor/Conv2D,BoxPredictor_4/BoxEncodingPredictor/BiasAdd,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_5_1x1_64/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_5_1x1_64/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_1_Conv2d_5_1x1_64/Relu6,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_5_3x3_s2_128/Conv2D,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_5_3x3_s2_128/BatchNorm/FusedBatchNorm,FeatureExtractor/InceptionV2/Mixed_5c_2_Conv2d_5_3x3_s2_128/Relu6,BoxPredictor_5/BoxEncodingPredictor/Conv2D,BoxPredictor_5/BoxEncodingPredictor/BiasAdd,BoxPredictor_0/ClassPredictor/Conv2D,BoxPredictor_0/ClassPredictor/BiasAdd,BoxPredictor_1/ClassPredictor/Conv2D,BoxPredictor_1/ClassPredictor/BiasAdd,BoxPredictor_2/ClassPredictor/Conv2D,BoxPredictor_2/ClassPredictor/BiasAdd,BoxPredictor_3/ClassPredictor/Conv2D,BoxPredictor_3/ClassPredictor/BiasAdd,BoxPredictor_4/ClassPredictor/Conv2D,BoxPredictor_4/ClassPredictor/BiasAdd,BoxPredictor_5/ClassPredictor/Conv2D,BoxPredictor_5/ClassPredictor/BiasAdd}, 
[09/11/2020-14:43:51] [I] [TRT] --------------- Layers running on GPU: 
[09/11/2020-14:43:51] [I] [TRT] GridAnchor, GridAnchor copy, GridAnchor_1 copy, GridAnchor_2 copy, GridAnchor_3 copy, GridAnchor_4 copy, GridAnchor_5 copy, (Unnamed Layer* 204) [Shuffle] + Squeeze, (Unnamed Layer* 391) [Shuffle] + Squeeze_1, (Unnamed Layer* 413) [Shuffle] + Squeeze_2, (Unnamed Layer* 435) [Shuffle] + Squeeze_3, (Unnamed Layer* 457) [Shuffle] + Squeeze_4, (Unnamed Layer* 479) [Shuffle] + Squeeze_5, concat_box_loc, (Unnamed Layer* 496) [Shuffle] + BoxPredictor_0/Reshape_1, (Unnamed Layer* 504) [Shuffle] + BoxPredictor_1/Reshape_1, (Unnamed Layer* 512) [Shuffle] + BoxPredictor_2/Reshape_1, (Unnamed Layer* 520) [Shuffle] + BoxPredictor_3/Reshape_1, (Unnamed Layer* 528) [Shuffle] + BoxPredictor_4/Reshape_1, (Unnamed Layer* 536) [Shuffle] + BoxPredictor_5/Reshape_1, concat_box_conf, NMS, 
[09/11/2020-14:43:53] [W] [TRT] No implementation of layer GridAnchor obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation.
[09/11/2020-14:44:06] [W] [TRT] No implementation of layer concat_box_loc obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation.
[09/11/2020-14:44:09] [W] [TRT] No implementation of layer concat_box_conf obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation.
[09/11/2020-14:44:09] [W] [TRT] No implementation of layer NMS obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation.
[09/11/2020-14:44:09] [I] [TRT] Detected 1 inputs and 2 output network tensors.
[09/11/2020-14:44:16] [I] Starting inference threads
[09/11/2020-14:44:20] [I] Warmup completed 11 queries over 200 ms
[09/11/2020-14:44:20] [I] Timing trace has 169 queries over 3.02787 s
[09/11/2020-14:44:20] [I] Trace averages of 10 runs:
[09/11/2020-14:44:20] [I] Average on 10 runs - GPU latency: 17.8438 ms - Host latency: 17.8963 ms (end to end 17.9057 ms, enqueue 3.10132 ms)
[09/11/2020-14:44:20] [I] Average on 10 runs - GPU latency: 17.8418 ms - Host latency: 17.8944 ms (end to end 17.9066 ms, enqueue 2.86821 ms)
[09/11/2020-14:44:20] [I] Average on 10 runs - GPU latency: 17.8453 ms - Host latency: 17.8981 ms (end to end 17.9093 ms, enqueue 2.80328 ms)
[09/11/2020-14:44:20] [I] Average on 10 runs - GPU latency: 17.853 ms - Host latency: 17.9053 ms (end to end 17.918 ms, enqueue 2.70852 ms)
[09/11/2020-14:44:20] [I] Average on 10 runs - GPU latency: 17.8633 ms - Host latency: 17.9155 ms (end to end 17.9274 ms, enqueue 2.74827 ms)
[09/11/2020-14:44:20] [I] Average on 10 runs - GPU latency: 17.8425 ms - Host latency: 17.8949 ms (end to end 17.909 ms, enqueue 2.74106 ms)
[09/11/2020-14:44:20] [I] Average on 10 runs - GPU latency: 17.8559 ms - Host latency: 17.9081 ms (end to end 17.9217 ms, enqueue 2.44882 ms)
[09/11/2020-14:44:20] [I] Average on 10 runs - GPU latency: 17.8498 ms - Host latency: 17.9022 ms (end to end 17.914 ms, enqueue 2.5308 ms)
[09/11/2020-14:44:20] [I] Average on 10 runs - GPU latency: 17.8581 ms - Host latency: 17.9101 ms (end to end 17.9213 ms, enqueue 2.37307 ms)
[09/11/2020-14:44:20] [I] Average on 10 runs - GPU latency: 17.8506 ms - Host latency: 17.903 ms (end to end 17.9134 ms, enqueue 2.36094 ms)
[09/11/2020-14:44:20] [I] Average on 10 runs - GPU latency: 17.8448 ms - Host latency: 17.8968 ms (end to end 17.9095 ms, enqueue 2.34935 ms)
[09/11/2020-14:44:20] [I] Average on 10 runs - GPU latency: 17.847 ms - Host latency: 17.8994 ms (end to end 17.9103 ms, enqueue 2.18044 ms)
[09/11/2020-14:44:20] [I] Average on 10 runs - GPU latency: 17.8774 ms - Host latency: 17.9297 ms (end to end 17.943 ms, enqueue 2.40823 ms)
[09/11/2020-14:44:20] [I] Average on 10 runs - GPU latency: 17.8677 ms - Host latency: 17.92 ms (end to end 17.9293 ms, enqueue 2.61089 ms)
[09/11/2020-14:44:20] [I] Average on 10 runs - GPU latency: 17.8542 ms - Host latency: 17.9067 ms (end to end 17.9184 ms, enqueue 2.26467 ms)
[09/11/2020-14:44:20] [I] Average on 10 runs - GPU latency: 17.8479 ms - Host latency: 17.8999 ms (end to end 17.9132 ms, enqueue 2.32632 ms)
[09/11/2020-14:44:20] [I] Host Latency
[09/11/2020-14:44:20] [I] min: 17.8597 ms (end to end 17.8745 ms)
[09/11/2020-14:44:20] [I] max: 18.0901 ms (end to end 18.1018 ms)
[09/11/2020-14:44:20] [I] mean: 17.9043 ms (end to end 17.9163 ms)
[09/11/2020-14:44:20] [I] median: 17.8986 ms (end to end 17.9099 ms)
[09/11/2020-14:44:20] [I] percentile: 18.0701 ms at 99% (end to end 18.0859 ms at 99%)
[09/11/2020-14:44:20] [I] throughput: 55.8148 qps
[09/11/2020-14:44:20] [I] walltime: 3.02787 s
[09/11/2020-14:44:20] [I] Enqueue Time
[09/11/2020-14:44:20] [I] min: 2.01758 ms
[09/11/2020-14:44:20] [I] max: 3.698 ms
[09/11/2020-14:44:20] [I] median: 2.46155 ms
[09/11/2020-14:44:20] [I] GPU Compute
[09/11/2020-14:44:20] [I] min: 17.8064 ms
[09/11/2020-14:44:20] [I] max: 18.0386 ms
[09/11/2020-14:44:20] [I] mean: 17.852 ms
[09/11/2020-14:44:20] [I] median: 17.8463 ms
[09/11/2020-14:44:20] [I] percentile: 18.0173 ms at 99%
[09/11/2020-14:44:20] [I] total compute time: 3.01699 s
&&&& PASSED TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --uff=frozen_inference_graph_nvidia.uff --uffInput=Input,3,300,300 --output=NMS --fp16 --useDLACore=1 --allowGPUFallback

Thanks.

15

Hi @AastaLLL thanks for confirming. I am unfortunately currently running a JP 4.3 system. Is there a known bug on JP 4.3 that’s preventing me from using the DLA?
It’s gonna take a significant effort to migrate to JP 4.4, so if I can , I prefer staying on JP 4.3

16

Hi,

We are going to check this on JetPack 4.3.
Will share more information with you later.

Thanks.

17

Hi,

This issue can be reproduced in our environment with JetPack4.3.

We are checking if there is a way to fix this in JetPack4.3 with our internal team.
This might take some time but we will keep you updated.

Thanks.

19

Hi,

Thanks for your patience.

Due to limited resource, the fix won’t back-port to JetPack4.3.
Please upgrade your device into JetPack4.4 directly.

Sorry for any inconvenience.

20

I see, thank you for your time. Will try to migrate to jp 4.4 then.