&&&& RUNNING TensorRT.trtexec # /home/ubuntu/klass_fr/tensorrt-5.1.6.0/aarch64-linux-gnu/samples/trtexec/build/trtexec --uff=./libs/klass_fr/tensor_rt/data/resnetdream_nchw.uff --uffInput=input_img,3,224,224 --uffInput=input_yaw,1,1,1 --output=dream.add/add [I] uff: ./libs/klass_fr/tensor_rt/data/resnetdream_nchw.uff [I] uffInput: input_img,3,224,224 [I] uffInput: input_yaw,1,1,1 [I] output: dream.add/add conv2d/Conv2D + re_lu/Relu 0.618ms max_pooling2d/MaxPool 0.156ms layer1.0.basic.conv2d.1/Conv2D + layer1. 0.342ms layer1.0.basic.conv2d.2/Conv2D + layer1. 0.354ms layer1.1.basic.conv2d.1/Conv2D + layer1. 0.314ms layer1.1.basic.conv2d.2/Conv2D + layer1. 0.338ms layer2.0.basic.conv2d.1/Conv2D + layer2. 0.269ms layer2.0.resample.conv2d/Conv2D 0.062ms layer2.0.basic.conv2d.2/Conv2D + layer2. 0.364ms layer2.1.basic.conv2d.1/Conv2D + layer2. 0.353ms layer2.1.basic.conv2d.2/Conv2D + layer2. 0.359ms layer3.0.basic.conv2d.1/Conv2D + layer3. 0.285ms layer3.0.resample.conv2d/Conv2D 0.045ms layer3.0.basic.conv2d.2/Conv2D + layer3. 0.334ms layer3.1.basic.conv2d.1/Conv2D + layer3. 0.326ms layer3.1.basic.conv2d.2/Conv2D + layer3. 0.327ms layer4.0.basic.conv2d.1/Conv2D + layer4. 0.517ms layer4.0.resample.conv2d/Conv2D 0.085ms layer4.0.basic.conv2d.2/Conv2D + layer4. 0.655ms layer4.1.basic.conv2d.1/Conv2D + layer4. 0.517ms layer4.1.basic.conv2d.2/Conv2D + layer4. 0.647ms average_pooling2d/AvgPool 0.021ms dense/MatMul 0.019ms dense/BiasAdd 0.010ms Abs 0.004ms truediv + sub 0.004ms mul + Sigmoid 0.005ms dream.dense.1/MatMul 0.010ms dream.dense.1/BiasAdd + Tanh 0.011ms dream.dense.2/MatMul 0.011ms dream.dense.2/BiasAdd + Tanh_1 0.005ms dream.dense.3/MatMul 0.010ms dream.dense.3/BiasAdd 0.004ms dream.multiply/mul 0.004ms dream.add/add 0.004ms Time over all layers: 7.390 [I] Average over 10 runs is 7.57153 ms (host walltime is 7.60476 ms, 99% percentile time is 7.82256). conv2d/Conv2D + re_lu/Relu 1.233ms max_pooling2d/MaxPool 0.311ms layer1.0.basic.conv2d.1/Conv2D + layer1. 0.684ms layer1.0.basic.conv2d.2/Conv2D + layer1. 0.706ms layer1.1.basic.conv2d.1/Conv2D + layer1. 0.627ms layer1.1.basic.conv2d.2/Conv2D + layer1. 0.673ms layer2.0.basic.conv2d.1/Conv2D + layer2. 0.545ms layer2.0.resample.conv2d/Conv2D 0.124ms layer2.0.basic.conv2d.2/Conv2D + layer2. 0.730ms layer2.1.basic.conv2d.1/Conv2D + layer2. 0.700ms layer2.1.basic.conv2d.2/Conv2D + layer2. 0.717ms layer3.0.basic.conv2d.1/Conv2D + layer3. 0.570ms layer3.0.resample.conv2d/Conv2D 0.089ms layer3.0.basic.conv2d.2/Conv2D + layer3. 0.665ms layer3.1.basic.conv2d.1/Conv2D + layer3. 0.649ms layer3.1.basic.conv2d.2/Conv2D + layer3. 0.652ms layer4.0.basic.conv2d.1/Conv2D + layer4. 1.028ms layer4.0.resample.conv2d/Conv2D 0.170ms layer4.0.basic.conv2d.2/Conv2D + layer4. 1.293ms layer4.1.basic.conv2d.1/Conv2D + layer4. 1.022ms layer4.1.basic.conv2d.2/Conv2D + layer4. 1.279ms average_pooling2d/AvgPool 0.041ms dense/MatMul 0.039ms dense/BiasAdd 0.019ms Abs 0.007ms truediv + sub 0.009ms mul + Sigmoid 0.010ms dream.dense.1/MatMul 0.021ms dream.dense.1/BiasAdd + Tanh 0.022ms dream.dense.2/MatMul 0.021ms dream.dense.2/BiasAdd + Tanh_1 0.009ms dream.dense.3/MatMul 0.021ms dream.dense.3/BiasAdd 0.007ms dream.multiply/mul 0.009ms dream.add/add 0.008ms Time over all layers: 14.713 [I] Average over 10 runs is 7.48594 ms (host walltime is 7.52068 ms, 99% percentile time is 7.768). conv2d/Conv2D + re_lu/Relu 1.836ms max_pooling2d/MaxPool 0.465ms layer1.0.basic.conv2d.1/Conv2D + layer1. 1.026ms layer1.0.basic.conv2d.2/Conv2D + layer1. 1.060ms layer1.1.basic.conv2d.1/Conv2D + layer1. 0.940ms layer1.1.basic.conv2d.2/Conv2D + layer1. 1.010ms layer2.0.basic.conv2d.1/Conv2D + layer2. 0.814ms layer2.0.resample.conv2d/Conv2D 0.186ms layer2.0.basic.conv2d.2/Conv2D + layer2. 1.106ms layer2.1.basic.conv2d.1/Conv2D + layer2. 1.050ms layer2.1.basic.conv2d.2/Conv2D + layer2. 1.082ms layer3.0.basic.conv2d.1/Conv2D + layer3. 0.859ms layer3.0.resample.conv2d/Conv2D 0.134ms layer3.0.basic.conv2d.2/Conv2D + layer3. 1.001ms layer3.1.basic.conv2d.1/Conv2D + layer3. 0.974ms layer3.1.basic.conv2d.2/Conv2D + layer3. 0.978ms layer4.0.basic.conv2d.1/Conv2D + layer4. 1.541ms layer4.0.resample.conv2d/Conv2D 0.255ms layer4.0.basic.conv2d.2/Conv2D + layer4. 1.933ms layer4.1.basic.conv2d.1/Conv2D + layer4. 1.530ms layer4.1.basic.conv2d.2/Conv2D + layer4. 1.908ms average_pooling2d/AvgPool 0.062ms dense/MatMul 0.058ms dense/BiasAdd 0.029ms Abs 0.011ms truediv + sub 0.013ms mul + Sigmoid 0.015ms dream.dense.1/MatMul 0.032ms dream.dense.1/BiasAdd + Tanh 0.034ms dream.dense.2/MatMul 0.032ms dream.dense.2/BiasAdd + Tanh_1 0.014ms dream.dense.3/MatMul 0.032ms dream.dense.3/BiasAdd 0.011ms dream.multiply/mul 0.013ms dream.add/add 0.012ms Time over all layers: 22.057 [I] Average over 10 runs is 7.51084 ms (host walltime is 7.54009 ms, 99% percentile time is 7.68512). conv2d/Conv2D + re_lu/Relu 2.440ms max_pooling2d/MaxPool 0.620ms layer1.0.basic.conv2d.1/Conv2D + layer1. 1.367ms layer1.0.basic.conv2d.2/Conv2D + layer1. 1.412ms layer1.1.basic.conv2d.1/Conv2D + layer1. 1.253ms layer1.1.basic.conv2d.2/Conv2D + layer1. 1.347ms layer2.0.basic.conv2d.1/Conv2D + layer2. 1.078ms layer2.0.resample.conv2d/Conv2D 0.248ms layer2.0.basic.conv2d.2/Conv2D + layer2. 1.474ms layer2.1.basic.conv2d.1/Conv2D + layer2. 1.394ms layer2.1.basic.conv2d.2/Conv2D + layer2. 1.441ms layer3.0.basic.conv2d.1/Conv2D + layer3. 1.145ms layer3.0.resample.conv2d/Conv2D 0.179ms layer3.0.basic.conv2d.2/Conv2D + layer3. 1.331ms layer3.1.basic.conv2d.1/Conv2D + layer3. 1.297ms layer3.1.basic.conv2d.2/Conv2D + layer3. 1.302ms layer4.0.basic.conv2d.1/Conv2D + layer4. 2.056ms layer4.0.resample.conv2d/Conv2D 0.341ms layer4.0.basic.conv2d.2/Conv2D + layer4. 2.578ms layer4.1.basic.conv2d.1/Conv2D + layer4. 2.035ms layer4.1.basic.conv2d.2/Conv2D + layer4. 2.538ms average_pooling2d/AvgPool 0.082ms dense/MatMul 0.078ms dense/BiasAdd 0.039ms Abs 0.014ms truediv + sub 0.018ms mul + Sigmoid 0.020ms dream.dense.1/MatMul 0.042ms dream.dense.1/BiasAdd + Tanh 0.045ms dream.dense.2/MatMul 0.042ms dream.dense.2/BiasAdd + Tanh_1 0.018ms dream.dense.3/MatMul 0.042ms dream.dense.3/BiasAdd 0.015ms dream.multiply/mul 0.018ms dream.add/add 0.016ms Time over all layers: 29.368 [I] Average over 10 runs is 7.4811 ms (host walltime is 7.51096 ms, 99% percentile time is 7.65744). conv2d/Conv2D + re_lu/Relu 3.044ms max_pooling2d/MaxPool 0.775ms layer1.0.basic.conv2d.1/Conv2D + layer1. 1.709ms layer1.0.basic.conv2d.2/Conv2D + layer1. 1.764ms layer1.1.basic.conv2d.1/Conv2D + layer1. 1.566ms layer1.1.basic.conv2d.2/Conv2D + layer1. 1.683ms layer2.0.basic.conv2d.1/Conv2D + layer2. 1.354ms layer2.0.resample.conv2d/Conv2D 0.310ms layer2.0.basic.conv2d.2/Conv2D + layer2. 1.844ms layer2.1.basic.conv2d.1/Conv2D + layer2. 1.745ms layer2.1.basic.conv2d.2/Conv2D + layer2. 1.800ms layer3.0.basic.conv2d.1/Conv2D + layer3. 1.431ms layer3.0.resample.conv2d/Conv2D 0.223ms layer3.0.basic.conv2d.2/Conv2D + layer3. 1.664ms layer3.1.basic.conv2d.1/Conv2D + layer3. 1.621ms layer3.1.basic.conv2d.2/Conv2D + layer3. 1.628ms layer4.0.basic.conv2d.1/Conv2D + layer4. 2.573ms layer4.0.resample.conv2d/Conv2D 0.426ms layer4.0.basic.conv2d.2/Conv2D + layer4. 3.221ms layer4.1.basic.conv2d.1/Conv2D + layer4. 2.547ms layer4.1.basic.conv2d.2/Conv2D + layer4. 3.176ms average_pooling2d/AvgPool 0.103ms dense/MatMul 0.097ms dense/BiasAdd 0.048ms Abs 0.018ms truediv + sub 0.022ms mul + Sigmoid 0.025ms dream.dense.1/MatMul 0.053ms dream.dense.1/BiasAdd + Tanh 0.056ms dream.dense.2/MatMul 0.053ms dream.dense.2/BiasAdd + Tanh_1 0.023ms dream.dense.3/MatMul 0.053ms dream.dense.3/BiasAdd 0.019ms dream.multiply/mul 0.022ms dream.add/add 0.020ms Time over all layers: 36.717 [I] Average over 10 runs is 7.51551 ms (host walltime is 7.54515 ms, 99% percentile time is 7.80784). conv2d/Conv2D + re_lu/Relu 3.647ms max_pooling2d/MaxPool 0.929ms layer1.0.basic.conv2d.1/Conv2D + layer1. 2.050ms layer1.0.basic.conv2d.2/Conv2D + layer1. 2.115ms layer1.1.basic.conv2d.1/Conv2D + layer1. 1.880ms layer1.1.basic.conv2d.2/Conv2D + layer1. 2.020ms layer2.0.basic.conv2d.1/Conv2D + layer2. 1.623ms layer2.0.resample.conv2d/Conv2D 0.372ms layer2.0.basic.conv2d.2/Conv2D + layer2. 2.215ms layer2.1.basic.conv2d.1/Conv2D + layer2. 2.094ms layer2.1.basic.conv2d.2/Conv2D + layer2. 2.162ms layer3.0.basic.conv2d.1/Conv2D + layer3. 1.719ms layer3.0.resample.conv2d/Conv2D 0.268ms layer3.0.basic.conv2d.2/Conv2D + layer3. 1.999ms layer3.1.basic.conv2d.1/Conv2D + layer3. 1.946ms layer3.1.basic.conv2d.2/Conv2D + layer3. 1.954ms layer4.0.basic.conv2d.1/Conv2D + layer4. 3.085ms layer4.0.resample.conv2d/Conv2D 0.512ms layer4.0.basic.conv2d.2/Conv2D + layer4. 3.866ms layer4.1.basic.conv2d.1/Conv2D + layer4. 3.053ms layer4.1.basic.conv2d.2/Conv2D + layer4. 3.812ms average_pooling2d/AvgPool 0.124ms dense/MatMul 0.117ms dense/BiasAdd 0.058ms Abs 0.021ms truediv + sub 0.027ms mul + Sigmoid 0.031ms dream.dense.1/MatMul 0.063ms dream.dense.1/BiasAdd + Tanh 0.067ms dream.dense.2/MatMul 0.063ms dream.dense.2/BiasAdd + Tanh_1 0.027ms dream.dense.3/MatMul 0.063ms dream.dense.3/BiasAdd 0.022ms dream.multiply/mul 0.027ms dream.add/add 0.024ms Time over all layers: 44.055 [I] Average over 10 runs is 7.5051 ms (host walltime is 7.53465 ms, 99% percentile time is 7.73882). conv2d/Conv2D + re_lu/Relu 4.250ms max_pooling2d/MaxPool 1.084ms layer1.0.basic.conv2d.1/Conv2D + layer1. 2.392ms layer1.0.basic.conv2d.2/Conv2D + layer1. 2.468ms layer1.1.basic.conv2d.1/Conv2D + layer1. 2.194ms layer1.1.basic.conv2d.2/Conv2D + layer1. 2.356ms layer2.0.basic.conv2d.1/Conv2D + layer2. 1.895ms layer2.0.resample.conv2d/Conv2D 0.434ms layer2.0.basic.conv2d.2/Conv2D + layer2. 2.590ms layer2.1.basic.conv2d.1/Conv2D + layer2. 2.442ms layer2.1.basic.conv2d.2/Conv2D + layer2. 2.526ms layer3.0.basic.conv2d.1/Conv2D + layer3. 2.006ms layer3.0.resample.conv2d/Conv2D 0.313ms layer3.0.basic.conv2d.2/Conv2D + layer3. 2.334ms layer3.1.basic.conv2d.1/Conv2D + layer3. 2.272ms layer3.1.basic.conv2d.2/Conv2D + layer3. 2.278ms layer4.0.basic.conv2d.1/Conv2D + layer4. 3.598ms layer4.0.resample.conv2d/Conv2D 0.597ms layer4.0.basic.conv2d.2/Conv2D + layer4. 4.508ms layer4.1.basic.conv2d.1/Conv2D + layer4. 3.572ms layer4.1.basic.conv2d.2/Conv2D + layer4. 4.456ms average_pooling2d/AvgPool 0.144ms dense/MatMul 0.136ms dense/BiasAdd 0.067ms Abs 0.025ms truediv + sub 0.031ms mul + Sigmoid 0.036ms dream.dense.1/MatMul 0.074ms dream.dense.1/BiasAdd + Tanh 0.078ms dream.dense.2/MatMul 0.073ms dream.dense.2/BiasAdd + Tanh_1 0.032ms dream.dense.3/MatMul 0.074ms dream.dense.3/BiasAdd 0.026ms dream.multiply/mul 0.031ms dream.add/add 0.028ms Time over all layers: 51.420 [I] Average over 10 runs is 7.52677 ms (host walltime is 7.55749 ms, 99% percentile time is 7.74864). conv2d/Conv2D + re_lu/Relu 4.854ms max_pooling2d/MaxPool 1.239ms layer1.0.basic.conv2d.1/Conv2D + layer1. 2.734ms layer1.0.basic.conv2d.2/Conv2D + layer1. 2.821ms layer1.1.basic.conv2d.1/Conv2D + layer1. 2.507ms layer1.1.basic.conv2d.2/Conv2D + layer1. 2.692ms layer2.0.basic.conv2d.1/Conv2D + layer2. 2.164ms layer2.0.resample.conv2d/Conv2D 0.497ms layer2.0.basic.conv2d.2/Conv2D + layer2. 2.957ms layer2.1.basic.conv2d.1/Conv2D + layer2. 2.786ms layer2.1.basic.conv2d.2/Conv2D + layer2. 2.884ms layer3.0.basic.conv2d.1/Conv2D + layer3. 2.291ms layer3.0.resample.conv2d/Conv2D 0.358ms layer3.0.basic.conv2d.2/Conv2D + layer3. 2.665ms layer3.1.basic.conv2d.1/Conv2D + layer3. 2.595ms layer3.1.basic.conv2d.2/Conv2D + layer3. 2.600ms layer4.0.basic.conv2d.1/Conv2D + layer4. 4.113ms layer4.0.resample.conv2d/Conv2D 0.683ms layer4.0.basic.conv2d.2/Conv2D + layer4. 5.136ms layer4.1.basic.conv2d.1/Conv2D + layer4. 4.072ms layer4.1.basic.conv2d.2/Conv2D + layer4. 5.080ms average_pooling2d/AvgPool 0.165ms dense/MatMul 0.156ms dense/BiasAdd 0.077ms Abs 0.029ms truediv + sub 0.035ms mul + Sigmoid 0.041ms dream.dense.1/MatMul 0.084ms dream.dense.1/BiasAdd + Tanh 0.089ms dream.dense.2/MatMul 0.084ms dream.dense.2/BiasAdd + Tanh_1 0.036ms dream.dense.3/MatMul 0.084ms dream.dense.3/BiasAdd 0.030ms dream.multiply/mul 0.036ms dream.add/add 0.032ms Time over all layers: 58.706 [I] Average over 10 runs is 7.45012 ms (host walltime is 7.47952 ms, 99% percentile time is 7.68832). conv2d/Conv2D + re_lu/Relu 5.459ms max_pooling2d/MaxPool 1.395ms layer1.0.basic.conv2d.1/Conv2D + layer1. 3.077ms layer1.0.basic.conv2d.2/Conv2D + layer1. 3.172ms layer1.1.basic.conv2d.1/Conv2D + layer1. 2.821ms layer1.1.basic.conv2d.2/Conv2D + layer1. 3.028ms layer2.0.basic.conv2d.1/Conv2D + layer2. 2.430ms layer2.0.resample.conv2d/Conv2D 0.559ms layer2.0.basic.conv2d.2/Conv2D + layer2. 3.335ms layer2.1.basic.conv2d.1/Conv2D + layer2. 3.134ms layer2.1.basic.conv2d.2/Conv2D + layer2. 3.246ms layer3.0.basic.conv2d.1/Conv2D + layer3. 2.578ms layer3.0.resample.conv2d/Conv2D 0.403ms layer3.0.basic.conv2d.2/Conv2D + layer3. 3.003ms layer3.1.basic.conv2d.1/Conv2D + layer3. 2.920ms layer3.1.basic.conv2d.2/Conv2D + layer3. 2.927ms layer4.0.basic.conv2d.1/Conv2D + layer4. 4.628ms layer4.0.resample.conv2d/Conv2D 0.769ms layer4.0.basic.conv2d.2/Conv2D + layer4. 5.781ms layer4.1.basic.conv2d.1/Conv2D + layer4. 4.585ms layer4.1.basic.conv2d.2/Conv2D + layer4. 5.713ms average_pooling2d/AvgPool 0.185ms dense/MatMul 0.175ms dense/BiasAdd 0.086ms Abs 0.032ms truediv + sub 0.040ms mul + Sigmoid 0.046ms dream.dense.1/MatMul 0.095ms dream.dense.1/BiasAdd + Tanh 0.101ms dream.dense.2/MatMul 0.094ms dream.dense.2/BiasAdd + Tanh_1 0.041ms dream.dense.3/MatMul 0.095ms dream.dense.3/BiasAdd 0.033ms dream.multiply/mul 0.040ms dream.add/add 0.036ms Time over all layers: 66.061 [I] Average over 10 runs is 7.52212 ms (host walltime is 7.55172 ms, 99% percentile time is 7.66666). conv2d/Conv2D + re_lu/Relu 6.062ms max_pooling2d/MaxPool 1.549ms layer1.0.basic.conv2d.1/Conv2D + layer1. 3.419ms layer1.0.basic.conv2d.2/Conv2D + layer1. 3.525ms layer1.1.basic.conv2d.1/Conv2D + layer1. 3.135ms layer1.1.basic.conv2d.2/Conv2D + layer1. 3.364ms layer2.0.basic.conv2d.1/Conv2D + layer2. 2.707ms layer2.0.resample.conv2d/Conv2D 0.621ms layer2.0.basic.conv2d.2/Conv2D + layer2. 3.707ms layer2.1.basic.conv2d.1/Conv2D + layer2. 3.482ms layer2.1.basic.conv2d.2/Conv2D + layer2. 3.603ms layer3.0.basic.conv2d.1/Conv2D + layer3. 2.862ms layer3.0.resample.conv2d/Conv2D 0.448ms layer3.0.basic.conv2d.2/Conv2D + layer3. 3.333ms layer3.1.basic.conv2d.1/Conv2D + layer3. 3.244ms layer3.1.basic.conv2d.2/Conv2D + layer3. 3.250ms layer4.0.basic.conv2d.1/Conv2D + layer4. 5.141ms layer4.0.resample.conv2d/Conv2D 0.854ms layer4.0.basic.conv2d.2/Conv2D + layer4. 6.417ms layer4.1.basic.conv2d.1/Conv2D + layer4. 5.085ms layer4.1.basic.conv2d.2/Conv2D + layer4. 6.349ms average_pooling2d/AvgPool 0.207ms dense/MatMul 0.195ms dense/BiasAdd 0.096ms Abs 0.036ms truediv + sub 0.044ms mul + Sigmoid 0.051ms dream.dense.1/MatMul 0.105ms dream.dense.1/BiasAdd + Tanh 0.112ms dream.dense.2/MatMul 0.105ms dream.dense.2/BiasAdd + Tanh_1 0.045ms dream.dense.3/MatMul 0.105ms dream.dense.3/BiasAdd 0.037ms dream.multiply/mul 0.045ms dream.add/add 0.040ms Time over all layers: 73.377 [I] Average over 10 runs is 7.47747 ms (host walltime is 7.50997 ms, 99% percentile time is 7.67946). &&&& PASSED TensorRT.trtexec # /home/ubuntu/klass_fr/tensorrt-5.1.6.0/aarch64-linux-gnu/samples/trtexec/build/trtexec --uff=./libs/klass_fr/tensor_rt/data/resnetdream_nchw.uff --uffInput=input_img,3,224,224 --uffInput=input_yaw,1,1,1 --output=dream.add/add