Uff-parser for DLA bug reports

From our cnn net deployment experience, Caffe-parser for DLA works fine while Uff-parser for DLA is unfavorable. We use the official model and benchmark tool to brief this bug.
Command:

./trtexec --uff=resnet50-infer-5.uff --output=GPU_0/tower_0/Softmax --uffInput=input,3,224,224 --fp16 --batch=1 --useDLACore=0 --allowGPUFallback

Bug reports:

Default DLA is enabled but layer GPU_0/tower_0/mul/y is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/tower_0/sub/y is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv0/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv0/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv0/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv0/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv0/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv2/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv2/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv2/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv2/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv2/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv3/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv3/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv3/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv3/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv3/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv4/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv4/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv4/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv4/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv4/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv1/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv1/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv1/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv1/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv1/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv5/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv5/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv5/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv5/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv5/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv6/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv6/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv6/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv6/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv6/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv7/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv7/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv7/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv7/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv7/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv8/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv8/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv8/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv8/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv8/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv9/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv9/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv9/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv9/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv9/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv10/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv10/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv10/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv10/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv10/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv12/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv12/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv12/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv12/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv12/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv13/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv13/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv13/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv13/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv13/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv14/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv14/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv14/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv14/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv14/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv11/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv11/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv11/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv11/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv11/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv15/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv15/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv15/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv15/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv15/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv16/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv16/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv16/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv16/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv16/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv17/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv17/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv17/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv17/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv17/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv18/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv18/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv18/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv18/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv18/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv19/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv19/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv19/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv19/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv19/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv20/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv20/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv20/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv20/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv20/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv21/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv21/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv21/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv21/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv21/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv22/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv22/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv22/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv22/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv22/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv23/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv23/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv23/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv23/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv23/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv25/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv25/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv25/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv25/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv25/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv26/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv26/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv26/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv26/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv26/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv27/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv27/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv27/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv27/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv27/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv24/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv24/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv24/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv24/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv24/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv28/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv28/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv28/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv28/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv28/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv29/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv29/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv29/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv29/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv29/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv30/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv30/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv30/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv30/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv30/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv31/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv31/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv31/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv31/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv31/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv32/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv32/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv32/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv32/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv32/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv33/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv33/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv33/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv33/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv33/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv34/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv34/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv34/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv34/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv34/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv35/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv35/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv35/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv35/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv35/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv36/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv36/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv36/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv36/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv36/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv37/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv37/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv37/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv37/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv37/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv38/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv38/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv38/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv38/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv38/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv39/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv39/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv39/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv39/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv39/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv40/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv40/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv40/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv40/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv40/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv41/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv41/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv41/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv41/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv41/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv42/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv42/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv42/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv42/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv42/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv44/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv44/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv44/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv44/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv44/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv45/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv45/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv45/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv45/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv45/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv46/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv46/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv46/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv46/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv46/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv43/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv43/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv43/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv43/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv43/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv47/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv47/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv47/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv47/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv47/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv48/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv48/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv48/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv48/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv48/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv49/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv49/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv49/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv49/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv49/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv50/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv50/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv50/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv50/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv50/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv51/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv51/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv51/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv51/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv51/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv52/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv52/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv52/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv52/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv52/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/tower_0/spatial_avg is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/fully_connected0/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/fully_connected0/biases is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/tower_0/Softmax_HL_1804289383 is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/tower_0/Softmax is not running on DLA, falling back to GPU.

Hi,

DLA is a hardware based inference engine so the supported operation is limited.
Here is our DLA support matrix for your reference:
https://docs.nvidia.com/deeplearning/sdk/tensorrt-support-matrix/index.html#layers-precision-matrix

You should find the detail layer deployed on the DLA like this:

******************************
Layers running on DLA: 
block1_conv1/convolution, block1_conv1/BiasAdd, block1_conv1/relu/Relu, block1_conv2/convolution, block1_conv2/BiasAdd, block1_conv2/relu/Relu, block1_pool/MaxPool, block2_conv1/convolution, block2_conv1/BiasAdd, block2_conv1/relu/Relu, block2_conv2/convolution, block2_conv2/BiasAdd, block2_conv2/relu/Relu, block2_pool/MaxPool, block3_conv1/convolution, block3_conv1/BiasAdd, block3_conv1/relu/Relu, block3_conv2/convolution, block3_conv2/BiasAdd, block3_conv2/relu/Relu, block3_conv3/convolution, block3_conv3/BiasAdd, block3_conv3/relu/Relu, block3_pool/MaxPool, block4_conv1/convolution, block4_conv1/BiasAdd, block4_conv1/relu/Relu, block4_conv2/convolution, block4_conv2/BiasAdd, block4_conv2/relu/Relu, block4_conv3/convolution, block4_conv3/BiasAdd, block4_conv3/relu/Relu, block4_pool/MaxPool, block5_conv1/convolution, block5_conv1/BiasAdd, block5_conv1/relu/Relu, block5_conv2/convolution, block5_conv2/BiasAdd, block5_conv2/relu/Relu, block5_conv3/convolution, block5_conv3/BiasAdd, block5_conv3/relu/Relu, block5_pool/MaxPool, sequential_1/dense_1/MatMul, sequential_1/dense_1/BiasAdd, 
******************************

******************************
Layers running on GPU: 
block1_conv1/kernel, block1_conv1/bias, block1_conv2/kernel, block1_conv2/bias, block2_conv1/kernel, block2_conv1/bias, block2_conv2/kernel, block2_conv2/bias, (Unnamed Layer* 21) [Padding], block3_conv1/kernel, block3_conv1/bias, block3_conv2/kernel, block3_conv2/bias, block3_conv3/kernel, block3_conv3/bias, block4_conv1/kernel, block4_conv1/bias, block4_conv2/kernel, block4_conv2/bias, block4_conv3/kernel, block4_conv3/bias, (Unnamed Layer* 54) [Padding], block5_conv1/kernel, block5_conv1/bias, block5_conv2/kernel, block5_conv2/bias, block5_conv3/kernel, block5_conv3/bias, sequential_1/reshape_1/strided_slice/stack, sequential_1/reshape_1/strided_slice/stack_1, sequential_1/reshape_1/strided_slice/stack_2, sequential_1/reshape_1/Reshape/shape/1, sequential_1/reshape_1/Reshape, dense_1/kernel, dense_1/bias, sequential_1/dense_1/Softmax_HL_1804289383, sequential_1/dense_1/Softmax, 
******************************

Thanks.

[b]Hi

We are aware of that DLA supported operation is limited. [/b]

The problem is that Caffe-parser for DLA works really fine. It can almost enable a whole caffe version resnet-50 except the last softmax layer which not in the DLA support matrix,details shown as below

avgRuns: 100
deploy: ResNet-50-deploy.prototxt.bak
model: ResNet-50-model.caffemodel
fp16
batch: 1
iterations: 10000
output: prob
useSpinWait
useDLACore: 1
allowGPUFallback
Input "data": 3x224x224
Output "prob": 1000x1x1
Default DLA is enabled but layer prob is not running on DLA, falling back to GPU.
name=data, bindingIndex=0, buffers.size()=2
name=prob, bindingIndex=1, buffers.size()=2
Average over 100 runs is 7.50552 ms (host walltime is 7.56428 ms, 99% percentile time is 16.0644).
Average over 100 runs is 7.37703 ms (host walltime is 7.438 ms, 99% percentile time is 7.58138).
Average over 100 runs is 7.37841 ms (host walltime is 7.43225 ms, 99% percentile time is 7.66186).
Average over 100 runs is 7.3665 ms (host walltime is 7.41721 ms, 99% percentile time is 7.58358).
Average over 100 runs is 7.32494 ms (host walltime is 7.38709 ms, 99% percentile time is 7.55958).
Average over 100 runs is 7.39191 ms (host walltime is 7.45263 ms, 99% percentile time is 7.58496).
Average over 100 runs is 7.40344 ms (host walltime is 7.4552 ms, 99% percentile time is 7.93517).
Average over 100 runs is 7.35569 ms (host walltime is 7.3988 ms, 99% percentile time is 7.56634).
Average over 100 runs is 7.36976 ms (host walltime is 7.41538 ms, 99% percentile time is 7.62246).
Average over 100 runs is 7.3619 ms (host walltime is 7.40516 ms, 99% percentile time is 7.67434).
Average over 100 runs is 7.39047 ms (host walltime is 7.43542 ms, 99% percentile time is 7.64122).

So can the onnx parser,which just not enable Shuffle and Softmax layer which are not in the supported matrix ,details shown as below

onnx: /media/nvidia/ssd/data/ResNet50.onnx
fp16
batch: 1
useDLACore: 0
allowGPUFallback
----------------------------------------------------------------
Input filename:   /media/nvidia/ssd/data/ResNet50.onnx
ONNX IR version:  0.0.3
Opset version:    6
Producer name:    onnx-caffe2
Producer version: 
Domain:           
Model version:    0
Doc string:       
----------------------------------------------------------------
 ----- Parsing of ONNX model /media/nvidia/ssd/data/ResNet50.onnx is Done ---- 
Default DLA is enabled but layer (Unnamed Layer* 173) [Shuffle] is not running on DLA, falling back to GPU.
Default DLA is enabled but layer (Unnamed Layer* 174) [Shuffle] is not running on DLA, falling back to GPU.
Default DLA is enabled but layer (Unnamed Layer* 176) [Shuffle] is not running on DLA, falling back to GPU.
Default DLA is enabled but layer (Unnamed Layer* 177) [Shuffle] is not running on DLA, falling back to GPU.
Default DLA is enabled but layer (Unnamed Layer* 178) [Softmax] is not running on DLA, falling back to GPU.
Default DLA is enabled but layer (Unnamed Layer* 179) [Shuffle] is not running on DLA, falling back to GPU.
name=gpu_0/data_0, bindingIndex=0, buffers.size()=2
name=gpu_0/softmax_1, bindingIndex=1, buffers.size()=2
Average over 10 runs is 7.92238 ms (host walltime is 8.05496 ms, 99% percentile time is 8.48218).
Average over 10 runs is 7.75359 ms (host walltime is 7.85487 ms, 99% percentile time is 7.82026).
Average over 10 runs is 7.70181 ms (host walltime is 7.86785 ms, 99% percentile time is 7.8448).
Average over 10 runs is 7.77416 ms (host walltime is 7.88871 ms, 99% percentile time is 7.83853).
Average over 10 runs is 7.73611 ms (host walltime is 7.8491 ms, 99% percentile time is 7.85328).
Average over 10 runs is 7.75789 ms (host walltime is 7.86962 ms, 99% percentile time is 7.8472).
Average over 10 runs is 7.74677 ms (host walltime is 7.84763 ms, 99% percentile time is 7.80272).
Average over 10 runs is 7.74065 ms (host walltime is 7.84628 ms, 99% percentile time is 7.80906).
Average over 10 runs is 7.72787 ms (host walltime is 7.83149 ms, 99% percentile time is 7.76541).
Average over 10 runs is 7.7721 ms (host walltime is 7.87982 ms, 99% percentile time is 7.86182).

However,Uff-parser even can not parse node “conv/weights” which is one of the components of convolution layer,details shown as below

uff: /home/nvidia/ws/UFF/bin/resnet50-infer-5.uff
output: GPU_0/tower_0/Softmax
uffInput: input,3,224,224
fp16
batch: 1
useDLACore: 0
allowGPUFallback
Default DLA is enabled but layer GPU_0/tower_0/mul/y is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/tower_0/sub/y is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv0/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv0/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv0/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv0/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv0/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv2/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv2/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv2/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv2/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv2/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv3/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv3/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv3/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv3/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv3/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv4/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv4/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv4/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv4/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv4/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv1/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv1/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv1/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv1/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv1/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv5/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv5/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv5/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv5/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv5/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv6/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv6/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv6/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv6/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv6/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv7/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv7/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv7/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv7/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv7/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv8/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv8/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv8/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv8/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv8/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv9/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv9/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv9/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv9/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv9/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv10/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv10/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv10/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv10/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv10/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv12/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv12/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv12/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv12/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv12/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv13/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv13/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv13/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv13/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv13/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv14/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv14/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv14/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv14/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv14/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv11/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv11/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv11/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv11/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv11/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv15/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv15/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv15/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv15/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv15/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv16/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv16/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv16/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv16/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv16/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv17/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv17/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv17/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv17/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv17/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv18/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv18/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv18/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv18/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv18/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv19/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv19/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv19/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv19/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv19/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv20/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv20/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv20/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv20/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv20/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv21/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv21/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv21/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv21/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv21/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv22/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv22/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv22/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv22/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv22/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv23/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv23/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv23/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv23/moving_mean is not running on DLA, falling back to GPUI  am .
Default DLA is enabled but layer GPU_0/conv23/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv25/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv25/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv25/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv25/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv25/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv26/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv26/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv26/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv26/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv26/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv27/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv27/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv27/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv27/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv27/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv24/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv24/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv24/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv24/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv24/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv28/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv28/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv28/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv28/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv28/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv29/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv29/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv29/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv29/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv29/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv30/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv30/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv30/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv30/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv30/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv31/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv31/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv31/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv31/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv31/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv32/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv32/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv32/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv32/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv32/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv33/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv33/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv33/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv33/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv33/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv34/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv34/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv34/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv34/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv34/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv35/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv35/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv35/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv35/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv35/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv36/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv36/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv36/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv36/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv36/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv37/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv37/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv37/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv37/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv37/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv38/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv38/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv38/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv38/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv38/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv39/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv39/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv39/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv39/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv39/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv40/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv40/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv40/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv40/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv40/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv41/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv41/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv41/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv41/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv41/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv42/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv42/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv42/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv42/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv42/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv44/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv44/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv44/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv44/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv44/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv45/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv45/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv45/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv45/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv45/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv46/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv46/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv46/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv46/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv46/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv43/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv43/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv43/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv43/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv43/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv47/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv47/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv47/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv47/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv47/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv48/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv48/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv48/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv48/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv48/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv49/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv49/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv49/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv49/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv49/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv50/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv50/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv50/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv50/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv50/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv51/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv51/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv51/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv51/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv51/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv52/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv52/gamma is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv52/beta is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv52/moving_mean is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/conv52/moving_variance is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/tower_0/spatial_avg is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/fully_connected0/weights is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/fully_connected0/biases is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/tower_0/Softmax_HL_1804289383 is not running on DLA, falling back to GPU.
Default DLA is enabled but layer GPU_0/tower_0/Softmax is not running on DLA, falling back to GPU.
name=input, bindingIndex=0, buffers.size()=2
name=GPU_0/tower_0/Softmax, bindingIndex=1, buffers.size()=2
Average over 10 runs is 9.43093 ms (host walltime is 9.55101 ms, 99% percentile time is 10.2212).
Average over 10 runs is 9.34132 ms (host walltime is 9.47746 ms, 99% percentile time is 9.65318).
Average over 10 runs is 9.28025 ms (host walltime is 9.41021 ms, 99% percentile time is 9.51965).
Average over 10 runs is 9.24734 ms (host walltime is 9.3895 ms, 99% percentile time is 9.58013).
Average over 10 runs is 9.32075 ms (host walltime is 9.48118 ms, 99% percentile time is 9.64048).
Average over 10 runs is 9.23781 ms (host walltime is 9.36873 ms, 99% percentile time is 9.55728).
Average over 10 runs is 9.16416 ms (host walltime is 9.31777 ms, 99% percentile time is 9.50365).
Average over 10 runs is 9.25845 ms (host walltime is 9.38907 ms, 99% percentile time is 9.51696).
Average over 10 runs is 9.2533 ms (host walltime is 9.38927 ms, 99% percentile time is 9.6759).
Average over 10 runs is 9.18303 ms (host walltime is 9.33254 ms, 99% percentile time is 9.49533).

And the above three elapsed time comparisons, uff vs onnx vs caffe = 9.55101ms vs 7.8491ms vs 7.32494ms can tell a lot.

Thanks

Hi,

This looks like a framework issue to me.

Different frameworks have their own implementations even for the same resnet model.
Not all the implementation map to the same TensorRT/DLA layer.

You can see almost all the operation in caffe are directly supported by the DLA while TensorFlow doesn’t.
This because TensorFlow keep adding the new implementation/layer into the frameworks.
Sometimes, we need to use other layer type to handle the variance.

There are some overhead to shift implementation between GPU and DLA for tensor data transferring.
So you will see the TensorFlow performance is obviously degraded by the DLA <-> GPU transfer.

Thanks.

Hello,

thanks for the explanations. I am wondering why layers with name “kernel” (e.g. block1_conv1/kernel) are not supported to run on DLA.
Those layers seem to stem from a standard convolution operation, which should be supported according to the Developer guide.
Is a solution for this available?

Best Regards
Frank

Hi,

There are lots of possible format of convolution.
Due to hardware accelerator, not all the combination are supported by the DLA.

You can find the detail DLA support matrix here:
https://docs.nvidia.com/deeplearning/sdk/tensorrt-developer-guide/index.html#dla_layers

Thanks.