Unable to use DLA cores in nvinfer

marmikshah · December 31, 2020, 6:05am

Hi,
I have trained an Object Detector using TLT. I have used DetectNetV2 with Resnet10 backbone.
The model works well when run on GPU, but when I try to use DLA, there are no detections at all. I have tried a MobileNet backbone as well.
When the engine is created, I can also see that the layers are being assigned to DLA instead of GPU.
Is there any other config I need to set? I have tried use-dla-core 0 and 1 as well.
I noticed that in the documentation, it is mentioned that the enable-dla feature is still under development. Is it related?
This is my config file:

[property]
gpu-id=0
gie-unique-id=1

workspace-size=1024
tlt-model-key=0
tlt-encoded-model=resnet10_detector.etlt
labelfile-path=labels.txt


uff-input-blob-name=input_1
output-blob-names=output_cov/Sigmoid;output_bbox/BiasAdd
parse-bbox-func-name=parse_bbox_custom_detectnet



uff-input-order=0
infer-dims=3;360;640


model-color-format=0
scaling-compute-hw=2
maintain-aspect-ratio=1
net-scale-factor=0.0039215697906911373


interval=0
cluster-mode=1

num-detected-classes=1
force-implicit-batch-dim=1

batch-size=2
network-mode=2
network-type=0
process-mode=1

enable-dla=1

[class-attrs-all]
pre-cluster-threshold=0.2


# If value is set to 0, it disables the prop
roi-top-offset=0
roi-bottom-offset=0
detected-min-h=0
detected-min-w=0
detected-max-h=0
detected-max-w=0

# Clustering algorithm Config
minBoxes=3
eps=0.7
dbscan-min-score=0.0500000007451
group-threshold=1

Hardware Platform (Jetson / GPU): Jetson NX
DeepStream Version: 5.0.1
JetPack Version (valid for Jetson only): 4.4
TensorRT Version: 7.1.3.0

Thanks.

AastaLLL · January 4, 2021, 2:46am

Hi,

Please check if you have added the following configuration to enable DLA.

[property]
...
enable-dla=1
use-dla-core=0

Please noted that if there is an engine file generated from the previous configuration (ex. GPU).
Deepstream won’t generate the engine again, and it may cause a problem since the setting doesn’t align.

So please delete any pre-generated engine and try the pipeline again.
If the issue goes on, please share a complete source, configure and model with us for further investigation.

Thanks.

marmikshah · January 11, 2021, 8:27am

Hey,
Thanks for your reply.
Yes, I had ensured the engine file was always being created (by deleting any existing engine files).

I ran it using the pre-trained models and they worked. So the problem was in my implementation.

But, a MobileNet based model still does not work for me. The Resnet10 one seems to work well.
Is there any limitation?

Thanks.

AastaLLL · January 20, 2021, 6:44am

Hi,

Sorry for the late update.

Do you also find some layers assigned to the DLA when creating MobileNet?
Since DLA doesn’t support all the TensorRT operations, it’s expected that MobileNet runs more layers on GPU than ResNet10.

Thanks.

marmikshah · January 20, 2021, 7:43am

Hey,
Not a problem. Thanks for your reply.
Yes I can see warning messages regarding layers not being supported on DLA and hence they fallback to GPU.
This is the log generated:

WARNING: [TRT]: Default DLA is enabled but layer output_bbox/bias is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer conv1/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_depthwise_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_project/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_project_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_project_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_project_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_project_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_expand/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_expand_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_expand_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_depthwise_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_project/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_project_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_project_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_project_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_project_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_1_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_projected_inputs/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_expand/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_expand_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_expand_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_depthwise_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_project/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_project_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_project_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_project_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_project_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_2_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_expand/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_expand_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_expand_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_depthwise_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_project/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_project_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_project_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_project_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_project_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_3_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_projected_inputs/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_expand/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_expand_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_expand_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_depthwise_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_project/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_project_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_project_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_project_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_project_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_4_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_projected_inputs/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_expand/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_expand_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_expand_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_depthwise_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_project/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_project_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_project_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_project_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_project_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_5_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_expand/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_expand_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_expand_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_depthwise_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_project/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_project_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_project_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_project_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_project_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_6_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_projected_inputs/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_expand/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_expand_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_expand_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_depthwise_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_project/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_project_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_project_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_project_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_project_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_7_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_projected_inputs/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_expand/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_expand_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_expand_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_depthwise_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_project/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_project_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_project_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_project_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_project_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_8_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_projected_inputs/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_expand/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_expand_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_expand_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_depthwise_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_project/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_project_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_project_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_project_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_project_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_9_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_expand/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_expand_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_expand_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_depthwise_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_project/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_project_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_project_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_project_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_project_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_10_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_projected_inputs/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_expand/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_expand_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_expand_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_depthwise_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_project/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_project_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_project_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_project_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_project_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_11_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_projected_inputs/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_expand/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_expand_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_expand_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_depthwise_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_project/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_project_bn/moving_variance is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_project_bn/gamma is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_project_bn/beta is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_project_bn/moving_mean is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer block_12_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer output_bbox/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer output_cov/kernel is not supported on DLA, falling back to GPU.
WARNING: [TRT]: Default DLA is enabled but layer output_cov/bias is not supported on DLA, falling back to GPU.
INFO: [TRT]: 
INFO: [TRT]: --------------- Layers running on DLA: 
INFO: [TRT]: {conv1/convolution,bn_conv1/batchnorm/mul_1,bn_conv1/batchnorm/add_1,re_lu_1/Relu,expanded_conv_depthwise/depthwise,expanded_conv_depthwise_bn/batchnorm/mul_1,expanded_conv_depthwise_bn/batchnorm/add_1,expanded_conv_relu/Relu,expanded_conv_project/convolution,expanded_conv_project_bn/batchnorm/mul_1,expanded_conv_project_bn/batchnorm/add_1,block_1_expand/convolution,block_1_expand_bn/batchnorm/mul_1,block_1_expand_bn/batchnorm/add_1,re_lu_2/Relu,block_1_depthwise/depthwise,block_1_depthwise_bn/batchnorm/mul_1,block_1_depthwise_bn/batchnorm/add_1,block_1_relu/Relu,block_1_project/convolution,block_1_project_bn/batchnorm/mul_1,block_1_project_bn/batchnorm/add_1,block_2_projected_inputs/convolution,block_2_expand/convolution,block_2_expand_bn/batchnorm/mul_1,block_2_expand_bn/batchnorm/add_1,re_lu_3/Relu,block_2_depthwise/depthwise,block_2_depthwise_bn/batchnorm/mul_1,block_2_depthwise_bn/batchnorm/add_1,block_2_relu/Relu,block_2_project/convolution,block_2_project_bn/batchnorm/mul_1,block_2_project_bn/batchnorm/add_1,block_2_add/add,block_3_expand/convolution,block_3_expand_bn/batchnorm/mul_1,block_3_expand_bn/batchnorm/add_1,re_lu_4/Relu,block_3_depthwise/depthwise,block_3_depthwise_bn/batchnorm/mul_1,block_3_depthwise_bn/batchnorm/add_1,block_3_relu/Relu,block_3_project/convolution,block_3_project_bn/batchnorm/mul_1,block_3_project_bn/batchnorm/add_1,block_4_projected_inputs/convolution,block_4_expand/convolution,block_4_expand_bn/batchnorm/mul_1,block_4_expand_bn/batchnorm/add_1,re_lu_5/Relu,block_4_depthwise/depthwise,block_4_depthwise_bn/batchnorm/mul_1,block_4_depthwise_bn/batchnorm/add_1,block_4_relu/Relu,block_4_project/convolution,block_4_project_bn/batchnorm/mul_1,block_4_project_bn/batchnorm/add_1,block_4_add/add,block_5_projected_inputs/convolution,block_5_expand/convolution,block_5_expand_bn/batchnorm/mul_1,block_5_expand_bn/batchnorm/add_1,re_lu_6/Relu,block_5_depthwise/depthwise,block_5_depthwise_bn/batchnorm/mul_1,block_5_depthwise_bn/batchnorm/add_1,block_5_relu/Relu,block_5_project/convolution,block_5_project_bn/batchnorm/mul_1,block_5_project_bn/batchnorm/add_1,block_5_add/add,block_6_expand/convolution,block_6_expand_bn/batchnorm/mul_1,block_6_expand_bn/batchnorm/add_1,re_lu_7/Relu,block_6_depthwise/depthwise,block_6_depthwise_bn/batchnorm/mul_1,block_6_depthwise_bn/batchnorm/add_1,block_6_relu/Relu,block_6_project/convolution,block_6_project_bn/batchnorm/mul_1,block_6_project_bn/batchnorm/add_1,block_7_projected_inputs/convolution,block_7_expand/convolution,block_7_expand_bn/batchnorm/mul_1,block_7_expand_bn/batchnorm/add_1,re_lu_8/Relu,block_7_depthwise/depthwise,block_7_depthwise_bn/batchnorm/mul_1,block_7_depthwise_bn/batchnorm/add_1,block_7_relu/Relu,block_7_project/convolution,block_7_project_bn/batchnorm/mul_1,block_7_project_bn/batchnorm/add_1,block_7_add/add,block_8_projected_inputs/convolution,block_8_expand/convolution,block_8_expand_bn/batchnorm/mul_1,block_8_expand_bn/batchnorm/add_1,re_lu_9/Relu,block_8_depthwise/depthwise,block_8_depthwise_bn/batchnorm/mul_1,block_8_depthwise_bn/batchnorm/add_1,block_8_relu/Relu,block_8_project/convolution,block_8_project_bn/batchnorm/mul_1,block_8_project_bn/batchnorm/add_1,block_8_add/add,block_9_projected_inputs/convolution,block_9_expand/convolution,block_9_expand_bn/batchnorm/mul_1,block_9_expand_bn/batchnorm/add_1,re_lu_10/Relu,block_9_depthwise/depthwise,block_9_depthwise_bn/batchnorm/mul_1,block_9_depthwise_bn/batchnorm/add_1,block_9_relu/Relu,block_9_project/convolution,block_9_project_bn/batchnorm/mul_1,block_9_project_bn/batchnorm/add_1,block_9_add/add,block_10_expand/convolution,block_10_expand_bn/batchnorm/mul_1,block_10_expand_bn/batchnorm/add_1,re_lu_11/Relu,block_10_depthwise/depthwise,block_10_depthwise_bn/batchnorm/mul_1,block_10_depthwise_bn/batchnorm/add_1,block_10_relu/Relu,block_10_project/convolution,block_10_project_bn/batchnorm/mul_1,block_10_project_bn/batchnorm/add_1,block_11_projected_inputs/convolution,block_11_expand/convolution,block_11_expand_bn/batchnorm/mul_1,block_11_expand_bn/batchnorm/add_1,re_lu_12/Relu,block
INFO: [TRT]: --------------- Layers running on GPU: 
INFO: [TRT]: 
INFO: [TRT]: Detected 1 inputs and 2 output network tensors.

Note sure if this is related, but I am exporting an unpruned model and using that.

Thanks.

AastaLLL · January 21, 2021, 3:38am

Hi,

This log looks strange to us.
You can see lots of layers are fallback to the GPU.
However, the layer placement in the end indicates all the layer is placed to the DLA rather than GPU:

INFO: [TRT]: --------------- Layers running on DLA: 
INFO: [TRT]: {conv1/convolution,bn_conv1/batchnorm/mul_1,bn_conv1/batchnorm/add_1,re_lu_1/Relu,expanded_conv_depthwise/depthwise,expanded_conv_depthwise_bn/batchnorm/mul_1,expanded_conv_depthwise_bn/batchnorm/add_1,expanded_conv_relu/Relu,expanded_conv_project/convolution,expanded_conv_project_bn/batchnorm/mul_1,expanded_conv_project_bn/batchnorm/add_1,block_1_expand/convolution,block_1_expand_bn/batchnorm/mul_1,block_1_expand_bn/batchnorm/add_1,re_lu_2/Relu,block_1_depthwise/depthwise,block_1_depthwise_bn/batchnorm/mul_1,block_1_depthwise_bn/batchnorm/add_1,block_1_relu/Relu,block_1_project/convolution,block_1_project_bn/batchnorm/mul_1,block_1_project_bn/batchnorm/add_1,block_2_projected_inputs/convolution,block_2_expand/convolution,block_2_expand_bn/batchnorm/mul_1,block_2_expand_bn/batchnorm/add_1,re_lu_3/Relu,block_2_depthwise/depthwise,block_2_depthwise_bn/batchnorm/mul_1,block_2_depthwise_bn/batchnorm/add_1,block_2_relu/Relu,block_2_project/convolution,block_2_project_bn/batchnorm/mul_1,block_2_project_bn/batchnorm/add_1,block_2_add/add,block_3_expand/convolution,block_3_expand_bn/batchnorm/mul_1,block_3_expand_bn/batchnorm/add_1,re_lu_4/Relu,block_3_depthwise/depthwise,block_3_depthwise_bn/batchnorm/mul_1,block_3_depthwise_bn/batchnorm/add_1,block_3_relu/Relu,block_3_project/convolution,block_3_project_bn/batchnorm/mul_1,block_3_project_bn/batchnorm/add_1,block_4_projected_inputs/convolution,block_4_expand/convolution,block_4_expand_bn/batchnorm/mul_1,block_4_expand_bn/batchnorm/add_1,re_lu_5/Relu,block_4_depthwise/depthwise,block_4_depthwise_bn/batchnorm/mul_1,block_4_depthwise_bn/batchnorm/add_1,block_4_relu/Relu,block_4_project/convolution,block_4_project_bn/batchnorm/mul_1,block_4_project_bn/batchnorm/add_1,block_4_add/add,block_5_projected_inputs/convolution,block_5_expand/convolution,block_5_expand_bn/batchnorm/mul_1,block_5_expand_bn/batchnorm/add_1,re_lu_6/Relu,block_5_depthwise/depthwise,block_5_depthwise_bn/batchnorm/mul_1,block_5_depthwise_bn/batchnorm/add_1,block_5_relu/Relu,block_5_project/convolution,block_5_project_bn/batchnorm/mul_1,block_5_project_bn/batchnorm/add_1,block_5_add/add,block_6_expand/convolution,block_6_expand_bn/batchnorm/mul_1,block_6_expand_bn/batchnorm/add_1,re_lu_7/Relu,block_6_depthwise/depthwise,block_6_depthwise_bn/batchnorm/mul_1,block_6_depthwise_bn/batchnorm/add_1,block_6_relu/Relu,block_6_project/convolution,block_6_project_bn/batchnorm/mul_1,block_6_project_bn/batchnorm/add_1,block_7_projected_inputs/convolution,block_7_expand/convolution,block_7_expand_bn/batchnorm/mul_1,block_7_expand_bn/batchnorm/add_1,re_lu_8/Relu,block_7_depthwise/depthwise,block_7_depthwise_bn/batchnorm/mul_1,block_7_depthwise_bn/batchnorm/add_1,block_7_relu/Relu,block_7_project/convolution,block_7_project_bn/batchnorm/mul_1,block_7_project_bn/batchnorm/add_1,block_7_add/add,block_8_projected_inputs/convolution,block_8_expand/convolution,block_8_expand_bn/batchnorm/mul_1,block_8_expand_bn/batchnorm/add_1,re_lu_9/Relu,block_8_depthwise/depthwise,block_8_depthwise_bn/batchnorm/mul_1,block_8_depthwise_bn/batchnorm/add_1,block_8_relu/Relu,block_8_project/convolution,block_8_project_bn/batchnorm/mul_1,block_8_project_bn/batchnorm/add_1,block_8_add/add,block_9_projected_inputs/convolution,block_9_expand/convolution,block_9_expand_bn/batchnorm/mul_1,block_9_expand_bn/batchnorm/add_1,re_lu_10/Relu,block_9_depthwise/depthwise,block_9_depthwise_bn/batchnorm/mul_1,block_9_depthwise_bn/batchnorm/add_1,block_9_relu/Relu,block_9_project/convolution,block_9_project_bn/batchnorm/mul_1,block_9_project_bn/batchnorm/add_1,block_9_add/add,block_10_expand/convolution,block_10_expand_bn/batchnorm/mul_1,block_10_expand_bn/batchnorm/add_1,re_lu_11/Relu,block_10_depthwise/depthwise,block_10_depthwise_bn/batchnorm/mul_1,block_10_depthwise_bn/batchnorm/add_1,block_10_relu/Relu,block_10_project/convolution,block_10_project_bn/batchnorm/mul_1,block_10_project_bn/batchnorm/add_1,block_11_projected_inputs/convolution,block_11_expand/convolution,block_11_expand_bn/batchnorm/mul_1,block_11_expand_bn/batchnorm/add_1,re_lu_12/Relu,block
INFO: [TRT]: --------------- Layers running on GPU: 
INFO: [TRT]:

Could you double-check and try it again?
Do you see the similar behavior on MobileNet and Resnet10 ?
Thanks.

marmikshah · January 22, 2021, 1:33am

Hey,
Sure here you go.

Test 1: Pretrained Model provided in Deepstream Samples

> 0:00:00.417151808 25965   0x7f64002260 INFO                 nvinfer gstnvinfer.cpp:619:gst_nvinfer_logger:<pgie> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1715> [UID = 1]: Trying to create engine from model files
> WARNING: DLA does not support FP32 precision type, using FP16 mode.
> INFO: [TRT]: 
> INFO: [TRT]: --------------- Layers running on DLA: 
> INFO: [TRT]: {conv1,bn_conv1,activation_1/Relu,block_1a_conv_1,block_1a_conv_shortcut,block_1a_bn_1,block_1a_bn_shortcut,activation_2/Relu,block_1a_conv_2,block_1a_bn_2,add_1,activation_3/Relu,block_2a_conv_1,block_2a_conv_shortcut,block_2a_bn_1,block_2a_bn_shortcut,activation_4/Relu,block_2a_conv_2,block_2a_bn_2,add_2,activation_5/Relu,block_3a_conv_1,block_3a_conv_shortcut,block_3a_bn_1,block_3a_bn_shortcut,activation_6/Relu,block_3a_conv_2,block_3a_bn_2,add_3,activation_7/Relu,block_4a_conv_1,block_4a_conv_shortcut,block_4a_bn_1,block_4a_bn_shortcut,activation_8/Relu,block_4a_conv_2,block_4a_bn_2,add_4,activation_9/Relu,conv2d_bbox,conv2d_cov,conv2d_cov/Sigmoid}, 
> INFO: [TRT]: --------------- Layers running on GPU: 
> INFO: [TRT]: 
> INFO: [TRT]: Detected 1 inputs and 2 output network tensors.

Test 2: DetectNet V2 (with Resnet10 Backbone @ 640x480 Input size)

> 0:00:00.365840370 18151   0x7f40002270 INFO                 nvinfer gstnvinfer.cpp:619:gst_nvinfer_logger:<pgie> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1715> [UID = 1]: Trying to create engine from model files
> WARNING: DLA does not support FP32 precision type, using FP16 mode.
> WARNING: [TRT]: Default DLA is enabled but layer output_bbox/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer conv1/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer conv1/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_conv_1/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_conv_1/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_1/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_1/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_1/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_1/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_1/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_1/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_1/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_1/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_1/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_conv_2/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_conv_2/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_2/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_2/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_2/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_2/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_2/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_2/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_2/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_2/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_2/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_conv_shortcut/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_conv_shortcut/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_shortcut/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_shortcut/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_shortcut/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_shortcut/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_shortcut/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_shortcut/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_shortcut/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_shortcut/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1a_bn_shortcut/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_conv_1/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_conv_1/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_bn_1/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_bn_1/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_bn_1/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_bn_1/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_bn_1/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_bn_1/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_bn_1/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_bn_1/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_bn_1/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_conv_2/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_conv_2/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_bn_2/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_bn_2/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_bn_2/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_bn_2/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_bn_2/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_bn_2/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_bn_2/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_bn_2/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1b_bn_2/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_conv_1/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_conv_1/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_1/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_1/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_1/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_1/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_1/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_1/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_1/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_1/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_1/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_conv_2/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_conv_2/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_2/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_2/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_2/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_2/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_2/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_2/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_2/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_2/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_2/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_conv_shortcut/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_conv_shortcut/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_shortcut/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_shortcut/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_shortcut/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_shortcut/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_shortcut/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_shortcut/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_shortcut/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_shortcut/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2a_bn_shortcut/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_conv_1/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_conv_1/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_bn_1/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_bn_1/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_bn_1/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_bn_1/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_bn_1/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_bn_1/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_bn_1/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_bn_1/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_bn_1/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_conv_2/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_conv_2/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_bn_2/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_bn_2/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_bn_2/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_bn_2/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_bn_2/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_bn_2/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_bn_2/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_bn_2/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2b_bn_2/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_conv_1/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_conv_1/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_1/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_1/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_1/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_1/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_1/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_1/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_1/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_1/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_1/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_conv_2/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_conv_2/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_2/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_2/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_2/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_2/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_2/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_2/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_2/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_2/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_2/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_conv_shortcut/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_conv_shortcut/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_shortcut/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_shortcut/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_shortcut/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_shortcut/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_shortcut/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_shortcut/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_shortcut/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_shortcut/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3a_bn_shortcut/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_conv_1/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_conv_1/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_bn_1/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_bn_1/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_bn_1/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_bn_1/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_bn_1/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_bn_1/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_bn_1/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_bn_1/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_bn_1/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_conv_2/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_conv_2/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_bn_2/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_bn_2/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_bn_2/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_bn_2/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_bn_2/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_bn_2/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_bn_2/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_bn_2/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3b_bn_2/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_conv_1/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_conv_1/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_1/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_1/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_1/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_1/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_1/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_1/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_1/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_1/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_1/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_conv_2/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_conv_2/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_2/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_2/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_2/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_2/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_2/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_2/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_2/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_2/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_2/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_conv_shortcut/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_conv_shortcut/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_shortcut/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_shortcut/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_shortcut/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_shortcut/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_shortcut/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_shortcut/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_shortcut/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_shortcut/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4a_bn_shortcut/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_conv_1/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_conv_1/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_bn_1/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_bn_1/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_bn_1/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_bn_1/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_bn_1/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_bn_1/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_bn_1/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_bn_1/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_bn_1/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_conv_2/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_conv_2/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_bn_2/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_bn_2/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_bn_2/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_bn_2/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_bn_2/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_bn_2/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_bn_2/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_bn_2/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4b_bn_2/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer output_bbox/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer output_cov/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer output_cov/bias is not supported on DLA, falling back to GPU.
> INFO: [TRT]: 
> INFO: [TRT]: --------------- Layers running on DLA: 
> INFO: [TRT]: {conv1/convolution,conv1/BiasAdd,bn_conv1/batchnorm/mul_1,bn_conv1/batchnorm/add_1,activation_1/Relu,block_1a_conv_1/convolution,block_1a_conv_1/BiasAdd,block_1a_bn_1/batchnorm/mul_1,block_1a_bn_1/batchnorm/add_1,block_1a_relu_1/Relu,block_1a_conv_2/convolution,block_1a_conv_2/BiasAdd,block_1a_bn_2/batchnorm/mul_1,block_1a_bn_2/batchnorm/add_1,block_1a_conv_shortcut/convolution,block_1a_conv_shortcut/BiasAdd,block_1a_bn_shortcut/batchnorm/mul_1,block_1a_bn_shortcut/batchnorm/add_1,add_1/add,block_1a_relu/Relu,block_1b_conv_1/convolution,block_1b_conv_1/BiasAdd,block_1b_bn_1/batchnorm/mul_1,block_1b_bn_1/batchnorm/add_1,block_1b_relu_1/Relu,block_1b_conv_2/convolution,block_1b_conv_2/BiasAdd,block_1b_bn_2/batchnorm/mul_1,block_1b_bn_2/batchnorm/add_1,add_2/add,block_1b_relu/Relu,block_2a_conv_1/convolution,block_2a_conv_1/BiasAdd,block_2a_bn_1/batchnorm/mul_1,block_2a_bn_1/batchnorm/add_1,block_2a_relu_1/Relu,block_2a_conv_2/convolution,block_2a_conv_2/BiasAdd,block_2a_bn_2/batchnorm/mul_1,block_2a_bn_2/batchnorm/add_1,block_2a_conv_shortcut/convolution,block_2a_conv_shortcut/BiasAdd,block_2a_bn_shortcut/batchnorm/mul_1,block_2a_bn_shortcut/batchnorm/add_1,add_3/add,block_2a_relu/Relu,block_2b_conv_1/convolution,block_2b_conv_1/BiasAdd,block_2b_bn_1/batchnorm/mul_1,block_2b_bn_1/batchnorm/add_1,block_2b_relu_1/Relu,block_2b_conv_2/convolution,block_2b_conv_2/BiasAdd,block_2b_bn_2/batchnorm/mul_1,block_2b_bn_2/batchnorm/add_1,add_4/add,block_2b_relu/Relu,block_3a_conv_1/convolution,block_3a_conv_1/BiasAdd,block_3a_bn_1/batchnorm/mul_1,block_3a_bn_1/batchnorm/add_1,block_3a_relu_1/Relu,block_3a_conv_2/convolution,block_3a_conv_2/BiasAdd,block_3a_bn_2/batchnorm/mul_1,block_3a_bn_2/batchnorm/add_1,block_3a_conv_shortcut/convolution,block_3a_conv_shortcut/BiasAdd,block_3a_bn_shortcut/batchnorm/mul_1,block_3a_bn_shortcut/batchnorm/add_1,add_5/add,block_3a_relu/Relu,block_3b_conv_1/convolution,block_3b_conv_1/BiasAdd,block_3b_bn_1/batchnorm/mul_1,block_3b_bn_1/batchnorm/add_1,block_3b_relu_1/Relu,block_3b_conv_2/convolution,block_3b_conv_2/BiasAdd,block_3b_bn_2/batchnorm/mul_1,block_3b_bn_2/batchnorm/add_1,add_6/add,block_3b_relu/Relu,block_4a_conv_1/convolution,block_4a_conv_1/BiasAdd,block_4a_bn_1/batchnorm/mul_1,block_4a_bn_1/batchnorm/add_1,block_4a_relu_1/Relu,block_4a_conv_2/convolution,block_4a_conv_2/BiasAdd,block_4a_bn_2/batchnorm/mul_1,block_4a_bn_2/batchnorm/add_1,block_4a_conv_shortcut/convolution,block_4a_conv_shortcut/BiasAdd,block_4a_bn_shortcut/batchnorm/mul_1,block_4a_bn_shortcut/batchnorm/add_1,add_7/add,block_4a_relu/Relu,block_4b_conv_1/convolution,block_4b_conv_1/BiasAdd,block_4b_bn_1/batchnorm/mul_1,block_4b_bn_1/batchnorm/add_1,block_4b_relu_1/Relu,block_4b_conv_2/convolution,block_4b_conv_2/BiasAdd,block_4b_bn_2/batchnorm/mul_1,block_4b_bn_2/batchnorm/add_1,add_8/add,block_4b_relu/Relu,output_bbox/convolution,output_bbox/BiasAdd,output_cov/convolution,output_cov/BiasAdd,output_cov/Sigmoid}, 
> INFO: [TRT]: --------------- Layers running on GPU: 
> INFO: [TRT]: 
> INFO: [TRT]: Detected 1 inputs and 2 output network tensors.

Test 3: DetectNet V2 (with MobileNet_V2 Backbone @ 640x360 Input size)

> 0:00:00.376783135  5704   0x7f6c002270 INFO                 nvinfer gstnvinfer.cpp:619:gst_nvinfer_logger:<pgie> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1715> [UID = 1]: Trying to create engine from model files
> WARNING: DLA does not support FP32 precision type, using FP16 mode.
> WARNING: [TRT]: Default DLA is enabled but layer output_bbox/bias is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer conv1/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer bn_conv1/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_depthwise_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_project/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_project_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_project_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_project_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_project_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer expanded_conv_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_expand/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_expand_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_expand_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_depthwise_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_project/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_project_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_project_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_project_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_project_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_1_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_projected_inputs/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_expand/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_expand_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_expand_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_depthwise_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_project/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_project_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_project_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_project_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_project_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_2_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_expand/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_expand_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_expand_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_depthwise_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_project/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_project_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_project_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_project_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_project_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_3_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_projected_inputs/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_expand/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_expand_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_expand_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_depthwise_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_project/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_project_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_project_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_project_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_project_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_4_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_projected_inputs/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_expand/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_expand_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_expand_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_depthwise_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_project/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_project_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_project_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_project_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_project_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_5_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_expand/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_expand_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_expand_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_depthwise_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_project/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_project_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_project_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_project_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_project_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_6_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_projected_inputs/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_expand/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_expand_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_expand_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_depthwise_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_project/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_project_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_project_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_project_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_project_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_7_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_projected_inputs/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_expand/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_expand_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_expand_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_depthwise_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_project/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_project_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_project_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_project_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_project_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_8_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_projected_inputs/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_expand/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_expand_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_expand_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_depthwise_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_project/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_project_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_project_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_project_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_project_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_9_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_expand/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_expand_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_expand_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_depthwise_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_project/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_project_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_project_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_project_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_project_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_10_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_projected_inputs/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_expand/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_expand_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_expand_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_depthwise_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_project/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_project_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_project_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_project_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_project_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_11_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_projected_inputs/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_expand/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_expand_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_expand_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_expand_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_expand_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_expand_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_expand_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_expand_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_expand_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_expand_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_depthwise/depthwise_kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_depthwise_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_depthwise_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_depthwise_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_depthwise_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_depthwise_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_depthwise_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_depthwise_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_depthwise_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_depthwise_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_project/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_project_bn/moving_variance is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_project_bn/Reshape_1/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_project_bn/batchnorm/add/y is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_project_bn/gamma is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_project_bn/Reshape_3/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_project_bn/beta is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_project_bn/Reshape_2/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_project_bn/moving_mean is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer block_12_project_bn/Reshape/shape is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer output_bbox/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer output_cov/kernel is not supported on DLA, falling back to GPU.
> WARNING: [TRT]: Default DLA is enabled but layer output_cov/bias is not supported on DLA, falling back to GPU.
> INFO: [TRT]: 
> INFO: [TRT]: --------------- Layers running on DLA: 
> INFO: [TRT]: {conv1/convolution,bn_conv1/batchnorm/mul_1,bn_conv1/batchnorm/add_1,re_lu_1/Relu,expanded_conv_depthwise/depthwise,expanded_conv_depthwise_bn/batchnorm/mul_1,expanded_conv_depthwise_bn/batchnorm/add_1,expanded_conv_relu/Relu,expanded_conv_project/convolution,expanded_conv_project_bn/batchnorm/mul_1,expanded_conv_project_bn/batchnorm/add_1,block_1_expand/convolution,block_1_expand_bn/batchnorm/mul_1,block_1_expand_bn/batchnorm/add_1,re_lu_2/Relu,block_1_depthwise/depthwise,block_1_depthwise_bn/batchnorm/mul_1,block_1_depthwise_bn/batchnorm/add_1,block_1_relu/Relu,block_1_project/convolution,block_1_project_bn/batchnorm/mul_1,block_1_project_bn/batchnorm/add_1,block_2_projected_inputs/convolution,block_2_expand/convolution,block_2_expand_bn/batchnorm/mul_1,block_2_expand_bn/batchnorm/add_1,re_lu_3/Relu,block_2_depthwise/depthwise,block_2_depthwise_bn/batchnorm/mul_1,block_2_depthwise_bn/batchnorm/add_1,block_2_relu/Relu,block_2_project/convolution,block_2_project_bn/batchnorm/mul_1,block_2_project_bn/batchnorm/add_1,block_2_add/add,block_3_expand/convolution,block_3_expand_bn/batchnorm/mul_1,block_3_expand_bn/batchnorm/add_1,re_lu_4/Relu,block_3_depthwise/depthwise,block_3_depthwise_bn/batchnorm/mul_1,block_3_depthwise_bn/batchnorm/add_1,block_3_relu/Relu,block_3_project/convolution,block_3_project_bn/batchnorm/mul_1,block_3_project_bn/batchnorm/add_1,block_4_projected_inputs/convolution,block_4_expand/convolution,block_4_expand_bn/batchnorm/mul_1,block_4_expand_bn/batchnorm/add_1,re_lu_5/Relu,block_4_depthwise/depthwise,block_4_depthwise_bn/batchnorm/mul_1,block_4_depthwise_bn/batchnorm/add_1,block_4_relu/Relu,block_4_project/convolution,block_4_project_bn/batchnorm/mul_1,block_4_project_bn/batchnorm/add_1,block_4_add/add,block_5_projected_inputs/convolution,block_5_expand/convolution,block_5_expand_bn/batchnorm/mul_1,block_5_expand_bn/batchnorm/add_1,re_lu_6/Relu,block_5_depthwise/depthwise,block_5_depthwise_bn/batchnorm/mul_1,block_5_depthwise_bn/batchnorm/add_1,block_5_relu/Relu,block_5_project/convolution,block_5_project_bn/batchnorm/mul_1,block_5_project_bn/batchnorm/add_1,block_5_add/add,block_6_expand/convolution,block_6_expand_bn/batchnorm/mul_1,block_6_expand_bn/batchnorm/add_1,re_lu_7/Relu,block_6_depthwise/depthwise,block_6_depthwise_bn/batchnorm/mul_1,block_6_depthwise_bn/batchnorm/add_1,block_6_relu/Relu,block_6_project/convolution,block_6_project_bn/batchnorm/mul_1,block_6_project_bn/batchnorm/add_1,block_7_projected_inputs/convolution,block_7_expand/convolution,block_7_expand_bn/batchnorm/mul_1,block_7_expand_bn/batchnorm/add_1,re_lu_8/Relu,block_7_depthwise/depthwise,block_7_depthwise_bn/batchnorm/mul_1,block_7_depthwise_bn/batchnorm/add_1,block_7_relu/Relu,block_7_project/convolution,block_7_project_bn/batchnorm/mul_1,block_7_project_bn/batchnorm/add_1,block_7_add/add,block_8_projected_inputs/convolution,block_8_expand/convolution,block_8_expand_bn/batchnorm/mul_1,block_8_expand_bn/batchnorm/add_1,re_lu_9/Relu,block_8_depthwise/depthwise,block_8_depthwise_bn/batchnorm/mul_1,block_8_depthwise_bn/batchnorm/add_1,block_8_relu/Relu,block_8_project/convolution,block_8_project_bn/batchnorm/mul_1,block_8_project_bn/batchnorm/add_1,block_8_add/add,block_9_projected_inputs/convolution,block_9_expand/convolution,block_9_expand_bn/batchnorm/mul_1,block_9_expand_bn/batchnorm/add_1,re_lu_10/Relu,block_9_depthwise/depthwise,block_9_depthwise_bn/batchnorm/mul_1,block_9_depthwise_bn/batchnorm/add_1,block_9_relu/Relu,block_9_project/convolution,block_9_project_bn/batchnorm/mul_1,block_9_project_bn/batchnorm/add_1,block_9_add/add,block_10_expand/convolution,block_10_expand_bn/batchnorm/mul_1,block_10_expand_bn/batchnorm/add_1,re_lu_11/Relu,block_10_depthwise/depthwise,block_10_depthwise_bn/batchnorm/mul_1,block_10_depthwise_bn/batchnorm/add_1,block_10_relu/Relu,block_10_project/convolution,block_10_project_bn/batchnorm/mul_1,block_10_project_bn/batchnorm/add_1,block_11_projected_inputs/convolution,block_11_expand/convolution,block_11_expand_bn/batchnorm/mul_1,block_11_expand_bn/batchnorm/add_1,re_lu_12/Relu,block
> INFO: [TRT]: --------------- Layers running on GPU: 
> INFO: [TRT]: 
> INFO: [TRT]: Detected 1 inputs and 2 output network tensors.

Thanks.

AastaLLL · January 22, 2021, 3:59am

Thanks for your experiment.
We are discussing this issue internally. Will get back to you later.

Morganh · January 22, 2021, 4:33am

@marmikshah
Please refer to topic Jetson Xavier - error running tlt-converter - #5 by Morganh

Actually the DLA is working. Just some layers are not supported on DLA. They will be falling back to GPU.

Topic		Replies	Views
Missing dynamic range for tensor output_bbox/BiasAdd. DLA requires all tensors dynamic range to be known DeepStream SDK	7	824	November 16, 2021
Transfer Learning Toolkit DLA warning messages TAO Toolkit dla	9	1589	July 1, 2022
Use TAO converter with DLA enable for pruned TLT model. But the GPU still load when inference TAO Toolkit tensorrt , dla , tao	8	803	April 26, 2023
Fail to convert .uff to .engine File when DLA is Enabled(Out of Memory) DeepStream SDK dla	9	530	October 12, 2021
Issues with running UFFSSD on DLA with Jetson Xavier Jetson AGX Xavier tensorrt , nvbugs , dla	18	1245	October 18, 2021
Deepstream-Yolo doesn't use DLA DeepStream SDK	20	549	June 25, 2024
using DLA but not accelerate Jetson AGX Xavier	2	1492	October 18, 2021
Conver tf1 model to onnx, inference in tensorrt error Jetson Xavier NX tensorrt , tensorflow , jetson-inference , python	4	1222	October 10, 2021
Trying using contemporary DLA and GPU on Jetson NX DeepStream SDK dla	8	645	April 26, 2023
Using DLA for Peoplenet tlt model in Deepstream DeepStream SDK jetson-inference , dla	2	1159	October 12, 2021

Unable to use DLA cores in nvinfer

Related topics