Using TensorFlow backend. 2020-02-06 18:17:10.084343: I tensorflow/core/platform/cpu_feature_guard.cc:141] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2020-02-06 18:17:13.571148: I tensorflow/compiler/xla/service/service.cc:150] XLA service 0x67b1e00 executing computations on platform CUDA. Devices: 2020-02-06 18:17:13.571235: I tensorflow/compiler/xla/service/service.cc:158] StreamExecutor device (0): GeForce GTX 1080 Ti, Compute Capability 6.1 2020-02-06 18:17:13.571262: I tensorflow/compiler/xla/service/service.cc:158] StreamExecutor device (1): GeForce GTX 1080 Ti, Compute Capability 6.1 2020-02-06 18:17:13.571283: I tensorflow/compiler/xla/service/service.cc:158] StreamExecutor device (2): GeForce GTX 1080 Ti, Compute Capability 6.1 2020-02-06 18:17:13.571304: I tensorflow/compiler/xla/service/service.cc:158] StreamExecutor device (3): GeForce GTX 1080 Ti, Compute Capability 6.1 2020-02-06 18:17:13.571324: I tensorflow/compiler/xla/service/service.cc:158] StreamExecutor device (4): GeForce GTX 1080 Ti, Compute Capability 6.1 2020-02-06 18:17:13.571344: I tensorflow/compiler/xla/service/service.cc:158] StreamExecutor device (5): GeForce GTX 1080 Ti, Compute Capability 6.1 2020-02-06 18:17:13.571391: I tensorflow/compiler/xla/service/service.cc:158] StreamExecutor device (6): GeForce GTX 1080 Ti, Compute Capability 6.1 2020-02-06 18:17:13.571413: I tensorflow/compiler/xla/service/service.cc:158] StreamExecutor device (7): GeForce GTX 1080 Ti, Compute Capability 6.1 2020-02-06 18:17:13.595644: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2199895000 Hz 2020-02-06 18:17:13.599929: I tensorflow/compiler/xla/service/service.cc:150] XLA service 0x68d61e0 executing computations on platform Host. Devices: 2020-02-06 18:17:13.599995: I tensorflow/compiler/xla/service/service.cc:158] StreamExecutor device (0): , 2020-02-06 18:17:13.600784: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1433] Found device 0 with properties: name: GeForce GTX 1080 Ti major: 6 minor: 1 memoryClockRate(GHz): 1.683 pciBusID: 0000:04:00.0 totalMemory: 10.92GiB freeMemory: 10.76GiB 2020-02-06 18:17:13.600836: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1512] Adding visible gpu devices: 0 2020-02-06 18:17:13.620158: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] Device interconnect StreamExecutor with strength 1 edge matrix: 2020-02-06 18:17:13.620194: I tensorflow/core/common_runtime/gpu/gpu_device.cc:990] 0 2020-02-06 18:17:13.620207: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1003] 0: N 2020-02-06 18:17:13.620555: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1115] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10470 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1080 Ti, pci bus id: 0000:04:00.0, compute capability: 6.1) 2020-02-06 18:17:13,627 [INFO] iva.ssd.scripts.train: Loading experiment spec at /workspace/examples/ssd/specs/ssd_train_resnet18_kitti.txt. 2020-02-06 18:17:13,629 [INFO] /usr/local/lib/python2.7/dist-packages/iva/ssd/utils/spec_loader.pyc: Merging specification from /workspace/examples/ssd/specs/ssd_train_resnet18_kitti.txt WARNING:tensorflow:From ./detectnet_v2/dataloader/utilities.py:114: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version. Instructions for updating: Use eager execution and: `tf.data.TFRecordDataset(path)` 2020-02-06 18:17:13,636 [WARNING] tensorflow: From ./detectnet_v2/dataloader/utilities.py:114: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version. Instructions for updating: Use eager execution and: `tf.data.TFRecordDataset(path)` WARNING:tensorflow:From /usr/local/lib/python2.7/dist-packages/tensorflow/python/data/ops/iterator_ops.py:358: colocate_with (from tensorflow.python.framework.ops) is deprecated and will be removed in a future version. Instructions for updating: Colocations handled automatically by placer. 2020-02-06 18:17:13,730 [WARNING] tensorflow: From /usr/local/lib/python2.7/dist-packages/tensorflow/python/data/ops/iterator_ops.py:358: colocate_with (from tensorflow.python.framework.ops) is deprecated and will be removed in a future version. Instructions for updating: Colocations handled automatically by placer. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. WARNING:tensorflow:From ./ssd/utils/tensor_utils.py:31: setdiff1d (from tensorflow.python.ops.array_ops) is deprecated and will be removed after 2018-11-30. Instructions for updating: This op will be removed after the deprecation date. Please switch to tf.sets.difference(). 2020-02-06 18:17:26,776 [WARNING] tensorflow: From ./ssd/utils/tensor_utils.py:31: setdiff1d (from tensorflow.python.ops.array_ops) is deprecated and will be removed after 2018-11-30. Instructions for updating: This op will be removed after the deprecation date. Please switch to tf.sets.difference(). target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. target/truncation is not updated to match the crop areaif the dataset contains target/truncation. 2020-02-06 18:17:46,997 [INFO] iva.ssd.scripts.train: Loading pretrained weights. This may take a while... WARNING:tensorflow:From /usr/local/lib/python2.7/dist-packages/tensorflow/python/ops/math_ops.py:3066: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use tf.cast instead. 2020-02-06 18:18:00,815 [WARNING] tensorflow: From /usr/local/lib/python2.7/dist-packages/tensorflow/python/ops/math_ops.py:3066: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use tf.cast instead. __________________________________________________________________________________________________ Layer (type) Output Shape Param # Connected to ================================================================================================== Input (InputLayer) (16, 3, 384, 1248) 0 __________________________________________________________________________________________________ conv1 (Conv2D) (16, 64, 192, 624) 9472 Input[0][0] __________________________________________________________________________________________________ bn_conv1 (BatchNormalization) (16, 64, 192, 624) 256 conv1[0][0] __________________________________________________________________________________________________ activation_18 (Activation) (16, 64, 192, 624) 0 bn_conv1[0][0] __________________________________________________________________________________________________ block_1a_conv_1 (Conv2D) (16, 64, 96, 312) 36928 activation_18[0][0] __________________________________________________________________________________________________ block_1a_bn_1 (BatchNormalizati (16, 64, 96, 312) 256 block_1a_conv_1[0][0] __________________________________________________________________________________________________ activation_19 (Activation) (16, 64, 96, 312) 0 block_1a_bn_1[0][0] __________________________________________________________________________________________________ block_1a_conv_2 (Conv2D) (16, 64, 96, 312) 36928 activation_19[0][0] __________________________________________________________________________________________________ block_1a_conv_shortcut (Conv2D) (16, 64, 96, 312) 4160 activation_18[0][0] __________________________________________________________________________________________________ block_1a_bn_2 (BatchNormalizati (16, 64, 96, 312) 256 block_1a_conv_2[0][0] __________________________________________________________________________________________________ block_1a_bn_shortcut (BatchNorm (16, 64, 96, 312) 256 block_1a_conv_shortcut[0][0] __________________________________________________________________________________________________ add_9 (Add) (16, 64, 96, 312) 0 block_1a_bn_2[0][0] block_1a_bn_shortcut[0][0] __________________________________________________________________________________________________ activation_20 (Activation) (16, 64, 96, 312) 0 add_9[0][0] __________________________________________________________________________________________________ block_1b_conv_1 (Conv2D) (16, 64, 96, 312) 36928 activation_20[0][0] __________________________________________________________________________________________________ block_1b_bn_1 (BatchNormalizati (16, 64, 96, 312) 256 block_1b_conv_1[0][0] __________________________________________________________________________________________________ activation_21 (Activation) (16, 64, 96, 312) 0 block_1b_bn_1[0][0] __________________________________________________________________________________________________ block_1b_conv_2 (Conv2D) (16, 64, 96, 312) 36928 activation_21[0][0] __________________________________________________________________________________________________ block_1b_conv_shortcut (Conv2D) (16, 64, 96, 312) 4160 activation_20[0][0] __________________________________________________________________________________________________ block_1b_bn_2 (BatchNormalizati (16, 64, 96, 312) 256 block_1b_conv_2[0][0] __________________________________________________________________________________________________ block_1b_bn_shortcut (BatchNorm (16, 64, 96, 312) 256 block_1b_conv_shortcut[0][0] __________________________________________________________________________________________________ add_10 (Add) (16, 64, 96, 312) 0 block_1b_bn_2[0][0] block_1b_bn_shortcut[0][0] __________________________________________________________________________________________________ activation_22 (Activation) (16, 64, 96, 312) 0 add_10[0][0] __________________________________________________________________________________________________ block_2a_conv_1 (Conv2D) (16, 128, 48, 156) 73856 activation_22[0][0] __________________________________________________________________________________________________ block_2a_bn_1 (BatchNormalizati (16, 128, 48, 156) 512 block_2a_conv_1[0][0] __________________________________________________________________________________________________ activation_23 (Activation) (16, 128, 48, 156) 0 block_2a_bn_1[0][0] __________________________________________________________________________________________________ block_2a_conv_2 (Conv2D) (16, 128, 48, 156) 147584 activation_23[0][0] __________________________________________________________________________________________________ block_2a_conv_shortcut (Conv2D) (16, 128, 48, 156) 8320 activation_22[0][0] __________________________________________________________________________________________________ block_2a_bn_2 (BatchNormalizati (16, 128, 48, 156) 512 block_2a_conv_2[0][0] __________________________________________________________________________________________________ block_2a_bn_shortcut (BatchNorm (16, 128, 48, 156) 512 block_2a_conv_shortcut[0][0] __________________________________________________________________________________________________ add_11 (Add) (16, 128, 48, 156) 0 block_2a_bn_2[0][0] block_2a_bn_shortcut[0][0] __________________________________________________________________________________________________ activation_24 (Activation) (16, 128, 48, 156) 0 add_11[0][0] __________________________________________________________________________________________________ block_2b_conv_1 (Conv2D) (16, 128, 48, 156) 147584 activation_24[0][0] __________________________________________________________________________________________________ block_2b_bn_1 (BatchNormalizati (16, 128, 48, 156) 512 block_2b_conv_1[0][0] __________________________________________________________________________________________________ activation_25 (Activation) (16, 128, 48, 156) 0 block_2b_bn_1[0][0] __________________________________________________________________________________________________ block_2b_conv_2 (Conv2D) (16, 128, 48, 156) 147584 activation_25[0][0] __________________________________________________________________________________________________ block_2b_conv_shortcut (Conv2D) (16, 128, 48, 156) 16512 activation_24[0][0] __________________________________________________________________________________________________ block_2b_bn_2 (BatchNormalizati (16, 128, 48, 156) 512 block_2b_conv_2[0][0] __________________________________________________________________________________________________ block_2b_bn_shortcut (BatchNorm (16, 128, 48, 156) 512 block_2b_conv_shortcut[0][0] __________________________________________________________________________________________________ add_12 (Add) (16, 128, 48, 156) 0 block_2b_bn_2[0][0] block_2b_bn_shortcut[0][0] __________________________________________________________________________________________________ activation_26 (Activation) (16, 128, 48, 156) 0 add_12[0][0] __________________________________________________________________________________________________ block_3a_conv_1 (Conv2D) (16, 256, 24, 78) 295168 activation_26[0][0] __________________________________________________________________________________________________ block_3a_bn_1 (BatchNormalizati (16, 256, 24, 78) 1024 block_3a_conv_1[0][0] __________________________________________________________________________________________________ activation_27 (Activation) (16, 256, 24, 78) 0 block_3a_bn_1[0][0] __________________________________________________________________________________________________ block_3a_conv_2 (Conv2D) (16, 256, 24, 78) 590080 activation_27[0][0] __________________________________________________________________________________________________ block_3a_conv_shortcut (Conv2D) (16, 256, 24, 78) 33024 activation_26[0][0] __________________________________________________________________________________________________ block_3a_bn_2 (BatchNormalizati (16, 256, 24, 78) 1024 block_3a_conv_2[0][0] __________________________________________________________________________________________________ block_3a_bn_shortcut (BatchNorm (16, 256, 24, 78) 1024 block_3a_conv_shortcut[0][0] __________________________________________________________________________________________________ add_13 (Add) (16, 256, 24, 78) 0 block_3a_bn_2[0][0] block_3a_bn_shortcut[0][0] __________________________________________________________________________________________________ activation_28 (Activation) (16, 256, 24, 78) 0 add_13[0][0] __________________________________________________________________________________________________ block_3b_conv_1 (Conv2D) (16, 256, 24, 78) 590080 activation_28[0][0] __________________________________________________________________________________________________ block_3b_bn_1 (BatchNormalizati (16, 256, 24, 78) 1024 block_3b_conv_1[0][0] __________________________________________________________________________________________________ activation_29 (Activation) (16, 256, 24, 78) 0 block_3b_bn_1[0][0] __________________________________________________________________________________________________ block_3b_conv_2 (Conv2D) (16, 256, 24, 78) 590080 activation_29[0][0] __________________________________________________________________________________________________ block_3b_conv_shortcut (Conv2D) (16, 256, 24, 78) 65792 activation_28[0][0] __________________________________________________________________________________________________ block_3b_bn_2 (BatchNormalizati (16, 256, 24, 78) 1024 block_3b_conv_2[0][0] __________________________________________________________________________________________________ block_3b_bn_shortcut (BatchNorm (16, 256, 24, 78) 1024 block_3b_conv_shortcut[0][0] __________________________________________________________________________________________________ add_14 (Add) (16, 256, 24, 78) 0 block_3b_bn_2[0][0] block_3b_bn_shortcut[0][0] __________________________________________________________________________________________________ activation_30 (Activation) (16, 256, 24, 78) 0 add_14[0][0] __________________________________________________________________________________________________ block_4a_conv_1 (Conv2D) (16, 512, 24, 78) 1180160 activation_30[0][0] __________________________________________________________________________________________________ block_4a_bn_1 (BatchNormalizati (16, 512, 24, 78) 2048 block_4a_conv_1[0][0] __________________________________________________________________________________________________ activation_31 (Activation) (16, 512, 24, 78) 0 block_4a_bn_1[0][0] __________________________________________________________________________________________________ block_4a_conv_2 (Conv2D) (16, 512, 24, 78) 2359808 activation_31[0][0] __________________________________________________________________________________________________ block_4a_conv_shortcut (Conv2D) (16, 512, 24, 78) 131584 activation_30[0][0] __________________________________________________________________________________________________ block_4a_bn_2 (BatchNormalizati (16, 512, 24, 78) 2048 block_4a_conv_2[0][0] __________________________________________________________________________________________________ block_4a_bn_shortcut (BatchNorm (16, 512, 24, 78) 2048 block_4a_conv_shortcut[0][0] __________________________________________________________________________________________________ add_15 (Add) (16, 512, 24, 78) 0 block_4a_bn_2[0][0] block_4a_bn_shortcut[0][0] __________________________________________________________________________________________________ activation_32 (Activation) (16, 512, 24, 78) 0 add_15[0][0] __________________________________________________________________________________________________ block_4b_conv_1 (Conv2D) (16, 512, 24, 78) 2359808 activation_32[0][0] __________________________________________________________________________________________________ block_4b_bn_1 (BatchNormalizati (16, 512, 24, 78) 2048 block_4b_conv_1[0][0] __________________________________________________________________________________________________ activation_33 (Activation) (16, 512, 24, 78) 0 block_4b_bn_1[0][0] __________________________________________________________________________________________________ block_4b_conv_2 (Conv2D) (16, 512, 24, 78) 2359808 activation_33[0][0] __________________________________________________________________________________________________ block_4b_conv_shortcut (Conv2D) (16, 512, 24, 78) 262656 activation_32[0][0] __________________________________________________________________________________________________ block_4b_bn_2 (BatchNormalizati (16, 512, 24, 78) 2048 block_4b_conv_2[0][0] __________________________________________________________________________________________________ block_4b_bn_shortcut (BatchNorm (16, 512, 24, 78) 2048 block_4b_conv_shortcut[0][0] __________________________________________________________________________________________________ add_16 (Add) (16, 512, 24, 78) 0 block_4b_bn_2[0][0] block_4b_bn_shortcut[0][0] __________________________________________________________________________________________________ activation_34 (Activation) (16, 512, 24, 78) 0 add_16[0][0] __________________________________________________________________________________________________ expand_conv1 (Conv2D) (16, 1024, 24, 78) 4719616 activation_34[0][0] __________________________________________________________________________________________________ expand1_relu (ReLU) (16, 1024, 24, 78) 0 expand_conv1[0][0] __________________________________________________________________________________________________ expand_conv2 (Conv2D) (16, 1024, 24, 78) 1049600 expand1_relu[0][0] __________________________________________________________________________________________________ expand2_relu (ReLU) (16, 1024, 24, 78) 0 expand_conv2[0][0] __________________________________________________________________________________________________ additional_map0_0 (Conv2D) (16, 256, 24, 78) 262400 expand2_relu[0][0] __________________________________________________________________________________________________ additional_map0_0_relu (ReLU) (16, 256, 24, 78) 0 additional_map0_0[0][0] __________________________________________________________________________________________________ additional_map0_1 (Conv2D) (16, 512, 12, 39) 1180160 additional_map0_0_relu[0][0] __________________________________________________________________________________________________ additional_map0_1_relu (ReLU) (16, 512, 12, 39) 0 additional_map0_1[0][0] __________________________________________________________________________________________________ additional_map1_0 (Conv2D) (16, 128, 12, 39) 65664 additional_map0_1_relu[0][0] __________________________________________________________________________________________________ additional_map1_0_relu (ReLU) (16, 128, 12, 39) 0 additional_map1_0[0][0] __________________________________________________________________________________________________ additional_map1_1 (Conv2D) (16, 256, 6, 20) 295168 additional_map1_0_relu[0][0] __________________________________________________________________________________________________ additional_map1_1_relu (ReLU) (16, 256, 6, 20) 0 additional_map1_1[0][0] __________________________________________________________________________________________________ additional_map2_0 (Conv2D) (16, 128, 6, 20) 32896 additional_map1_1_relu[0][0] __________________________________________________________________________________________________ additional_map2_0_relu (ReLU) (16, 128, 6, 20) 0 additional_map2_0[0][0] __________________________________________________________________________________________________ additional_map2_1 (Conv2D) (16, 256, 3, 10) 295168 additional_map2_0_relu[0][0] __________________________________________________________________________________________________ additional_map2_1_relu (ReLU) (16, 256, 3, 10) 0 additional_map2_1[0][0] __________________________________________________________________________________________________ additional_map3_0 (Conv2D) (16, 128, 3, 10) 32896 additional_map2_1_relu[0][0] __________________________________________________________________________________________________ additional_map3_0_relu (ReLU) (16, 128, 3, 10) 0 additional_map3_0[0][0] __________________________________________________________________________________________________ additional_map3_1 (Conv2D) (16, 256, 2, 5) 295168 additional_map3_0_relu[0][0] __________________________________________________________________________________________________ additional_map3_1_relu (ReLU) (16, 256, 2, 5) 0 additional_map3_1[0][0] __________________________________________________________________________________________________ ssd_conf_0 (Conv2D) (16, 18, 48, 156) 20754 activation_26[0][0] __________________________________________________________________________________________________ ssd_conf_1 (Conv2D) (16, 18, 24, 78) 82962 activation_34[0][0] __________________________________________________________________________________________________ ssd_conf_2 (Conv2D) (16, 18, 12, 39) 82962 additional_map0_1_relu[0][0] __________________________________________________________________________________________________ ssd_conf_3 (Conv2D) (16, 18, 6, 20) 41490 additional_map1_1_relu[0][0] __________________________________________________________________________________________________ ssd_conf_4 (Conv2D) (16, 18, 3, 10) 41490 additional_map2_1_relu[0][0] __________________________________________________________________________________________________ ssd_conf_5 (Conv2D) (16, 18, 2, 5) 41490 additional_map3_1_relu[0][0] __________________________________________________________________________________________________ permute_13 (Permute) (16, 48, 156, 18) 0 ssd_conf_0[0][0] __________________________________________________________________________________________________ permute_15 (Permute) (16, 24, 78, 18) 0 ssd_conf_1[0][0] __________________________________________________________________________________________________ permute_17 (Permute) (16, 12, 39, 18) 0 ssd_conf_2[0][0] __________________________________________________________________________________________________ permute_19 (Permute) (16, 6, 20, 18) 0 ssd_conf_3[0][0] __________________________________________________________________________________________________ permute_21 (Permute) (16, 3, 10, 18) 0 ssd_conf_4[0][0] __________________________________________________________________________________________________ permute_23 (Permute) (16, 2, 5, 18) 0 ssd_conf_5[0][0] __________________________________________________________________________________________________ ssd_loc_0 (Conv2D) (16, 24, 48, 156) 27672 activation_26[0][0] __________________________________________________________________________________________________ ssd_loc_1 (Conv2D) (16, 24, 24, 78) 110616 activation_34[0][0] __________________________________________________________________________________________________ ssd_loc_2 (Conv2D) (16, 24, 12, 39) 110616 additional_map0_1_relu[0][0] __________________________________________________________________________________________________ ssd_loc_3 (Conv2D) (16, 24, 6, 20) 55320 additional_map1_1_relu[0][0] __________________________________________________________________________________________________ ssd_loc_4 (Conv2D) (16, 24, 3, 10) 55320 additional_map2_1_relu[0][0] __________________________________________________________________________________________________ ssd_loc_5 (Conv2D) (16, 24, 2, 5) 55320 additional_map3_1_relu[0][0] __________________________________________________________________________________________________ conf_reshape_0 (Reshape) (16, 44928, 1, 3) 0 permute_13[0][0] __________________________________________________________________________________________________ conf_reshape_1 (Reshape) (16, 11232, 1, 3) 0 permute_15[0][0] __________________________________________________________________________________________________ conf_reshape_2 (Reshape) (16, 2808, 1, 3) 0 permute_17[0][0] __________________________________________________________________________________________________ conf_reshape_3 (Reshape) (16, 720, 1, 3) 0 permute_19[0][0] __________________________________________________________________________________________________ conf_reshape_4 (Reshape) (16, 180, 1, 3) 0 permute_21[0][0] __________________________________________________________________________________________________ conf_reshape_5 (Reshape) (16, 60, 1, 3) 0 permute_23[0][0] __________________________________________________________________________________________________ permute_14 (Permute) (16, 48, 156, 24) 0 ssd_loc_0[0][0] __________________________________________________________________________________________________ permute_16 (Permute) (16, 24, 78, 24) 0 ssd_loc_1[0][0] __________________________________________________________________________________________________ permute_18 (Permute) (16, 12, 39, 24) 0 ssd_loc_2[0][0] __________________________________________________________________________________________________ permute_20 (Permute) (16, 6, 20, 24) 0 ssd_loc_3[0][0] __________________________________________________________________________________________________ permute_22 (Permute) (16, 3, 10, 24) 0 ssd_loc_4[0][0] __________________________________________________________________________________________________ permute_24 (Permute) (16, 2, 5, 24) 0 ssd_loc_5[0][0] __________________________________________________________________________________________________ ssd_anchor_0 (AnchorBoxes) (16, 7488, 6, 8) 0 ssd_loc_0[0][0] __________________________________________________________________________________________________ ssd_anchor_1 (AnchorBoxes) (16, 1872, 6, 8) 0 ssd_loc_1[0][0] __________________________________________________________________________________________________ ssd_anchor_2 (AnchorBoxes) (16, 468, 6, 8) 0 ssd_loc_2[0][0] __________________________________________________________________________________________________ ssd_anchor_3 (AnchorBoxes) (16, 120, 6, 8) 0 ssd_loc_3[0][0] __________________________________________________________________________________________________ ssd_anchor_4 (AnchorBoxes) (16, 30, 6, 8) 0 ssd_loc_4[0][0] __________________________________________________________________________________________________ ssd_anchor_5 (AnchorBoxes) (16, 10, 6, 8) 0 ssd_loc_5[0][0] __________________________________________________________________________________________________ mbox_conf (Concatenate) (16, 59928, 1, 3) 0 conf_reshape_0[0][0] conf_reshape_1[0][0] conf_reshape_2[0][0] conf_reshape_3[0][0] conf_reshape_4[0][0] conf_reshape_5[0][0] __________________________________________________________________________________________________ loc_reshape_0 (Reshape) (16, 44928, 1, 4) 0 permute_14[0][0] __________________________________________________________________________________________________ loc_reshape_1 (Reshape) (16, 11232, 1, 4) 0 permute_16[0][0] __________________________________________________________________________________________________ loc_reshape_2 (Reshape) (16, 2808, 1, 4) 0 permute_18[0][0] __________________________________________________________________________________________________ loc_reshape_3 (Reshape) (16, 720, 1, 4) 0 permute_20[0][0] __________________________________________________________________________________________________ loc_reshape_4 (Reshape) (16, 180, 1, 4) 0 permute_22[0][0] __________________________________________________________________________________________________ loc_reshape_5 (Reshape) (16, 60, 1, 4) 0 permute_24[0][0] __________________________________________________________________________________________________ anchor_reshape_0 (Reshape) (16, 44928, 1, 8) 0 ssd_anchor_0[0][0] __________________________________________________________________________________________________ anchor_reshape_1 (Reshape) (16, 11232, 1, 8) 0 ssd_anchor_1[0][0] __________________________________________________________________________________________________ anchor_reshape_2 (Reshape) (16, 2808, 1, 8) 0 ssd_anchor_2[0][0] __________________________________________________________________________________________________ anchor_reshape_3 (Reshape) (16, 720, 1, 8) 0 ssd_anchor_3[0][0] __________________________________________________________________________________________________ anchor_reshape_4 (Reshape) (16, 180, 1, 8) 0 ssd_anchor_4[0][0] __________________________________________________________________________________________________ anchor_reshape_5 (Reshape) (16, 60, 1, 8) 0 ssd_anchor_5[0][0] __________________________________________________________________________________________________ mbox_conf_sigmoid (Activation) (16, 59928, 1, 3) 0 mbox_conf[0][0] __________________________________________________________________________________________________ mbox_loc (Concatenate) (16, 59928, 1, 4) 0 loc_reshape_0[0][0] loc_reshape_1[0][0] loc_reshape_2[0][0] loc_reshape_3[0][0] loc_reshape_4[0][0] loc_reshape_5[0][0] __________________________________________________________________________________________________ mbox_priorbox (Concatenate) (16, 59928, 1, 8) 0 anchor_reshape_0[0][0] anchor_reshape_1[0][0] anchor_reshape_2[0][0] anchor_reshape_3[0][0] anchor_reshape_4[0][0] anchor_reshape_5[0][0] __________________________________________________________________________________________________ concatenate_2 (Concatenate) (16, 59928, 1, 15) 0 mbox_conf_sigmoid[0][0] mbox_loc[0][0] mbox_priorbox[0][0] __________________________________________________________________________________________________ ssd_predictions (Reshape) (16, 59928, 15) 0 concatenate_2[0][0] ================================================================================================== Total params: 20,503,036 Trainable params: 20,481,916 Non-trainable params: 21,120 __________________________________________________________________________________________________ 2020-02-06 18:21:57,074 [INFO] iva.ssd.scripts.train: Number of images in the training dataset: 6434 2020-02-06 18:21:57,074 [INFO] iva.ssd.scripts.train: Number of images in the validation dataset: 1047 Epoch 1/180 2020-02-06 18:22:21.853987: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_16/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.854083: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_16/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:21.854118: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_16/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.854149: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_16/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.854179: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_16/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.854209: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_16/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.854238: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_16/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:21.854268: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_16/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:21.854347: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_17/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.854380: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_17/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:21.854411: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_17/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.854441: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_17/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.854470: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_17/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.854498: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_17/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.854527: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_17/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:21.854556: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_17/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:21.854594: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_18/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.854624: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_18/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:21.854653: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_18/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.854684: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_18/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.854713: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_18/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.854741: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_18/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.854770: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_18/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:21.854799: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_18/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:21.854837: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_19/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.854867: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_19/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:21.854897: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_19/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.854926: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_19/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.854956: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_19/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.855000: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_19/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.855029: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_19/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:21.855059: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_19/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:21.855099: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_20/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.855130: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_20/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:21.855162: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_20/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.855192: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_20/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.855223: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_20/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.855252: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_20/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.855282: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_20/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:21.855311: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_20/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:21.855388: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_21/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.855420: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_21/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:21.855452: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_21/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.855482: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_21/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.855511: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_21/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.855540: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_21/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.855569: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_21/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:21.855615: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_21/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:21.855656: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_22/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.855688: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_22/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:21.855719: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_22/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.855751: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_22/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.855783: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_22/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.855813: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_22/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.855857: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_22/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:21.855888: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_22/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:21.855928: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_23/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.855972: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_23/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:21.856003: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_23/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.856032: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_23/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.856062: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_23/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.856091: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_23/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.856120: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_23/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:21.856149: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_23/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:21.856188: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_24/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.856218: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_24/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:21.856250: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_24/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.856281: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_24/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.856311: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_24/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.856339: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_24/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.856368: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_24/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:21.856397: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_24/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:21.856437: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_25/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.856468: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_25/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:21.856498: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_25/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.856527: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_25/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.856558: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_25/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.856587: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_25/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.856617: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_25/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:21.856645: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_25/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:21.856684: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_26/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.856713: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_26/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:21.856743: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_26/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.856773: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_26/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.856802: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_26/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.856831: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_26/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.856860: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_26/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:21.856905: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_26/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:21.856946: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_27/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.856977: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_27/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:21.857008: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_27/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.857055: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_27/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.857086: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_27/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.857116: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_27/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.857147: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_27/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:21.857179: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_27/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:21.857220: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_28/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.857266: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_28/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:21.857297: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_28/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.857327: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_28/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.857358: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_28/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.857401: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_28/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.857430: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_28/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:21.857459: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_28/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:21.857498: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_29/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.857543: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_29/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:21.857573: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_29/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.857603: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_29/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.857633: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_29/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.857662: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_29/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.857691: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_29/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:21.857721: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_29/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:21.857761: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_30/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.857791: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_30/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:21.857823: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_30/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.857853: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_30/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.857897: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_30/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.857926: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_30/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.857956: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_30/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:21.857985: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_30/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:21.858039: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_31/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.858070: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_31/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:21.858101: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_31/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.858131: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_31/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.858161: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_31/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.858191: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_31/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:21.858220: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_31/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:21.858250: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_31/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:26.930643: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_16/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.930743: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_16/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:26.930809: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_16/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.930841: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_16/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.930872: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_16/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.930902: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_16/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.930932: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_16/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:26.930962: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_16/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:26.931061: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_17/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.931110: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_17/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:26.931141: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_17/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.931171: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_17/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.931201: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_17/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.931231: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_17/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.931260: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_17/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:26.931290: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_17/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:26.931329: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_18/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.931384: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_18/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:26.931419: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_18/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.931450: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_18/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.931481: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_18/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.931512: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_18/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.931543: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_18/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:26.931574: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_18/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:26.931616: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_19/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.931647: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_19/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:26.931679: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_19/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.931711: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_19/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.931743: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_19/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.931774: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_19/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.931804: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_19/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:26.931835: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_19/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:26.931890: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_20/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.931921: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_20/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:26.931954: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_20/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.931985: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_20/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.932015: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_20/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.932045: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_20/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.932075: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_20/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:26.932105: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_20/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:26.932144: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_21/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.932175: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_21/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:26.932206: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_21/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.932237: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_21/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.932267: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_21/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.932296: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_21/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.932326: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_21/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:26.932357: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_21/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:26.932397: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_22/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.932428: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_22/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:26.932460: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_22/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.932491: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_22/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.932521: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_22/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.932551: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_22/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.932580: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_22/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:26.932610: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_22/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:26.932649: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_23/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.932680: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_23/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:26.932710: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_23/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.932741: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_23/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.932772: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_23/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.932800: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_23/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.932829: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_23/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:26.932859: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_23/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:26.932898: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_24/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.932929: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_24/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:26.932960: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_24/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.932990: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_24/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.933022: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_24/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.933050: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_24/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.933080: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_24/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:26.933110: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_24/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:26.933150: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_25/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.933181: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_25/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:26.933212: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_25/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.933243: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_25/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.933273: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_25/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.933302: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_25/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.933331: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_25/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:26.933361: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_25/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:26.933402: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_26/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.933432: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_26/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:26.933463: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_26/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.933494: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_26/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.933525: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_26/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.933553: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_26/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.933583: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_26/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:26.933613: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_26/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:26.933652: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_27/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.933684: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_27/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:26.933715: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_27/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.933745: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_27/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.933776: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_27/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.933806: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_27/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.933835: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_27/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:26.933865: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_27/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:26.933905: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_28/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.933935: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_28/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:26.933966: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_28/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.933997: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_28/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.934028: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_28/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.934057: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_28/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.934087: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_28/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:26.934116: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_28/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:26.934155: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_29/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.934185: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_29/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:26.934216: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_29/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.934246: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_29/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.934275: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_29/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.934304: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_29/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.934334: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_29/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:26.934363: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_29/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:26.934403: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_30/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.934434: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_30/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:26.934464: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_30/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.934494: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_30/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.934525: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_30/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.934554: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_30/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.934582: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_30/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:26.934612: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_30/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:26.934652: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_31/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.934682: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_31/CornerCoordToCentroids/StridedReplace/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?,1] 2020-02-06 18:22:26.934713: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_31/CornerCoordToCentroids/strided_slice_4. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.934743: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_31/CornerCoordToCentroids/strided_slice_5. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.934774: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_31/CornerCoordToCentroids/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.934803: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_31/CornerCoordToCentroids/strided_slice_7. Error: ValidateStridedSliceOp returned partial shapes [?,1] and [?] 2020-02-06 18:22:26.934832: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_31/CornerCoordToCentroids/StridedReplace/strided_slice_1. Error: ValidateStridedSliceOp returned partial shapes [?,0] and [?,0] 2020-02-06 18:22:26.934862: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node cond_31/strided_slice_6. Error: ValidateStridedSliceOp returned partial shapes [?,4] and [?,4] 2020-02-06 18:22:28.535120: I tensorflow/stream_executor/dso_loader.cc:152] successfully opened CUDA library libcublas.so.10.0 locally 2020-02-06 18:22:28.928697: I tensorflow/core/kernels/cuda_solvers.cc:159] Creating CudaSolver handles for stream 0x68f7c10 2020-02-06 18:22:31.573325: W tensorflow/core/common_runtime/bfc_allocator.cc:211] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.54GiB. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2020-02-06 18:22:31.905356: W tensorflow/core/common_runtime/bfc_allocator.cc:211] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.32GiB. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 403/403 [==============================] - 313s 775ms/step - loss: 25650025135294871982982639906717696.0000 WARNING:tensorflow:From /usr/local/lib/python2.7/dist-packages/horovod/tensorflow/__init__.py:91: div (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Deprecated in favor of operator or tf.math.divide. 2020-02-06 18:27:35,573 [WARNING] tensorflow: From /usr/local/lib/python2.7/dist-packages/horovod/tensorflow/__init__.py:91: div (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Deprecated in favor of operator or tf.math.divide. Epoch 00001: saving model to /workspace/tlt-experiments/experiment_dir_unpruned/weights/ssd_resnet18_epoch_001.tlt Epoch 2/180 403/403 [==============================] - 297s 736ms/step - loss: 2717585389788514021575491584.0000 Epoch 00002: saving model to /workspace/tlt-experiments/experiment_dir_unpruned/weights/ssd_resnet18_epoch_002.tlt Epoch 3/180 378/403 [===========================>..] - ETA: 18s - loss: 637414950664982198023618560.00002020-02-06 18:38:29.476113: E tensorflow/stream_executor/cuda/cuda_event.cc:48] Error polling for event status: failed to query event: CUDA_ERROR_ILLEGAL_INSTRUCTION: an illegal instruction was encountered 2020-02-06 18:38:29.476202: F tensorflow/core/common_runtime/gpu/gpu_event_mgr.cc:274] Unexpected Event status: 1 [ad0cc9e19363:00167] *** Process received signal *** [ad0cc9e19363:00167] Signal: Aborted (6) [ad0cc9e19363:00167] Signal code: (-6) [ad0cc9e19363:00167] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x11390)[0x7f90410a3390] [ad0cc9e19363:00167] [ 1] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x38)[0x7f9040cfd428] [ad0cc9e19363:00167] [ 2] /lib/x86_64-linux-gnu/libc.so.6(abort+0x16a)[0x7f9040cff02a] [ad0cc9e19363:00167] [ 3] /usr/local/lib/python2.7/dist-packages/tensorflow/python/_pywrap_tensorflow_internal.so(+0x753ed94)[0x7f8fa7188d94] [ad0cc9e19363:00167] [ 4] /usr/local/lib/python2.7/dist-packages/tensorflow/python/_pywrap_tensorflow_internal.so(_ZN10tensorflow8EventMgr10PollEventsEbPN4absl13InlinedVectorINS0_5InUseELm4ESaIS3_EEE+0x105)[0x7f8fa7437795] [ad0cc9e19363:00167] [ 5] /usr/local/lib/python2.7/dist-packages/tensorflow/python/../libtensorflow_framework.so(_ZN10tensorflow7GPUUtil18CopyCPUTensorToGPUEPKNS_6TensorEPKNS_13DeviceContextEPNS_6DeviceEPS1_St8functionIFvRKNS_6StatusEEE+0x483)[0x7f8f9f20e393] [ad0cc9e19363:00167] [ 6] /usr/local/lib/python2.7/dist-packages/tensorflow/python/../libtensorflow_framework.so(_ZNK10tensorflow16GPUDeviceContext21CopyCPUTensorToDeviceEPKNS_6TensorEPNS_6DeviceEPS1_St8functionIFvRKNS_6StatusEEE+0x7d)[0x7f8f9f20ef5d] [ad0cc9e19363:00167] [ 7] /usr/local/lib/python2.7/dist-packages/tensorflow/python/../libtensorflow_framework.so(+0x70cc27)[0x7f8f9f235c27] [ad0cc9e19363:00167] [ 8] /usr/local/lib/python2.7/dist-packages/tensorflow/python/../libtensorflow_framework.so(_ZN10tensorflow10CopyTensor6ViaDMAEN4absl11string_viewEPNS_13DeviceContextES4_PNS_6DeviceES6_NS_19AllocatorAttributesES7_PKNS_6TensorEPS8_iSt8functionIFvRKNS_6StatusEEE+0xd49)[0x7f8f9f237f19] [ad0cc9e19363:00167] [ 9] /usr/local/lib/python2.7/dist-packages/tensorflow/python/../libtensorflow_framework.so(_ZN10tensorflow22IntraProcessRendezvous18SameWorkerRecvDoneERKNS_10Rendezvous9ParsedKeyERKNS1_4ArgsES7_RKNS_6TensorEPS8_St8functionIFvRKNS_6StatusEEE+0x4d4)[0x7f8f9f28cfd4] [ad0cc9e19363:00167] [10] /usr/local/lib/python2.7/dist-packages/tensorflow/python/../libtensorflow_framework.so(+0x7645dd)[0x7f8f9f28d5dd] [ad0cc9e19363:00167] [11] /usr/local/lib/python2.7/dist-packages/tensorflow/python/../libtensorflow_framework.so(_ZN10tensorflow19LocalRendezvousImpl9RecvAsyncERKNS_10Rendezvous9ParsedKeyERKNS1_4ArgsESt8functionIFvRKNS_6StatusES7_S7_RKNS_6TensorEbEE+0x9b8)[0x7f8f9f01e6d8] [ad0cc9e19363:00167] [12] /usr/local/lib/python2.7/dist-packages/tensorflow/python/../libtensorflow_framework.so(_ZN10tensorflow22IntraProcessRendezvous9RecvAsyncERKNS_10Rendezvous9ParsedKeyERKNS1_4ArgsESt8functionIFvRKNS_6StatusES7_S7_RKNS_6TensorEbEE+0x47f)[0x7f8f9f28dc7f] [ad0cc9e19363:00167] [13] /usr/local/lib/python2.7/dist-packages/tensorflow/python/_pywrap_tensorflow_internal.so(_ZN10tensorflow6RecvOp12ComputeAsyncEPNS_15OpKernelContextESt8functionIFvvEE+0x15a)[0x7f8fa6c0572a] [ad0cc9e19363:00167] [14] /usr/local/lib/python2.7/dist-packages/tensorflow/python/../libtensorflow_framework.so(_ZN10tensorflow13BaseGPUDevice12ComputeAsyncEPNS_13AsyncOpKernelEPNS_15OpKernelContextESt8functionIFvvEE+0x184)[0x7f8f9f200a04] [ad0cc9e19363:00167] [15] /usr/local/lib/python2.7/dist-packages/tensorflow/python/../libtensorflow_framework.so(+0x722d5d)[0x7f8f9f24bd5d] [ad0cc9e19363:00167] [16] /usr/local/lib/python2.7/dist-packages/tensorflow/python/../libtensorflow_framework.so(+0x715f00)[0x7f8f9f23ef00] [ad0cc9e19363:00167] [17] /usr/local/lib/python2.7/dist-packages/tensorflow/python/../libtensorflow_framework.so(_ZN5Eigen15ThreadPoolTemplIN10tensorflow6thread16EigenEnvironmentEE10WorkerLoopEi+0x306)[0x7f8f9f2bddc6] [ad0cc9e19363:00167] [18] /usr/local/lib/python2.7/dist-packages/tensorflow/python/../libtensorflow_framework.so(_ZNSt17_Function_handlerIFvvEZN10tensorflow6thread16EigenEnvironment12CreateThreadESt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data+0x44)[0x7f8f9f2bcc84] [ad0cc9e19363:00167] [19] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xb8c80)[0x7f8f91746c80] [ad0cc9e19363:00167] [20] /lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba)[0x7f90410996ba] [ad0cc9e19363:00167] [21] /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)[0x7f9040dcf41d] [ad0cc9e19363:00167] *** End of error message *** /usr/local/bin/tlt-train: line 32: 167 Aborted (core dumped) tlt-train-g1 ${PYTHON_ARGS[*]}